{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:10:25.319240Z", "iopub.status.busy": "2022-09-15T17:10:25.318890Z", "iopub.status.idle": "2022-09-15T17:10:28.197404Z", "shell.execute_reply": "2022-09-15T17:10:28.196265Z" } }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:10:28.269851Z", "iopub.status.busy": "2022-09-15T17:10:28.268702Z", "iopub.status.idle": "2022-09-15T17:10:28.274612Z", "shell.execute_reply": "2022-09-15T17:10:28.273786Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:10:28.278412Z", "iopub.status.busy": "2022-09-15T17:10:28.278116Z", "iopub.status.idle": "2022-09-15T17:10:28.292469Z", "shell.execute_reply": "2022-09-15T17:10:28.291698Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:10:28.296291Z", "iopub.status.busy": "2022-09-15T17:10:28.295993Z", "iopub.status.idle": "2022-09-15T17:10:28.301180Z", "shell.execute_reply": "2022-09-15T17:10:28.300413Z" } }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:10:28.305154Z", "iopub.status.busy": "2022-09-15T17:10:28.304858Z", "iopub.status.idle": "2022-09-15T17:13:15.679626Z", "shell.execute_reply": "2022-09-15T17:13:15.678568Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.808197, 'x2': 0.515484, 'x3': 0.311732, 'x4': 0.927427, 'x5': 0.021217, 'x6': 0.141828}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.016945, 0.0), 'l2norm': (1.377233, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.751789, 'x2': 0.009418, 'x3': 0.935766, 'x4': 0.481968, 'x5': 0.276135, 'x6': 0.014904}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.017174, 0.0), 'l2norm': (1.322762, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.430394, 'x2': 0.453745, 'x3': 0.42868, 'x4': 0.041489, 'x5': 0.34033, 'x6': 0.030578}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.095472, 0.0), 'l2norm': (0.832689, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.09921, 'x2': 0.790143, 'x3': 0.532389, 'x4': 0.15217, 'x5': 0.418675, 'x6': 0.883382}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.416461, 0.0), 'l2norm': (1.377104, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.835693, 'x2': 0.075814, 'x3': 0.453538, 'x4': 0.14145, 'x5': 0.533597, 'x6': 0.462874}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.238305, 0.0), 'l2norm': (1.19533, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.619054, 'x2': 0.542657, 'x3': 0.266134, 'x4': 0.969628, 'x5': 0.721164, 'x6': 0.855231}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.000897, 0.0), 'l2norm': (1.714704, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.892539, 'x2': 0.383274, 'x3': 0.470328, 'x4': 0.133546, 'x5': 0.00762, 'x6': 0.743713}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.157822, 0.0), 'l2norm': (1.317473, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.923559, 'x2': 0.960248, 'x3': 0.605177, 'x4': 0.927958, 'x5': 0.780139, 'x6': 0.705904}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.000232, 0.0), 'l2norm': (2.02714, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.708208, 'x2': 0.330662, 'x3': 0.080302, 'x4': 0.558602, 'x5': 0.163857, 'x6': 0.759264}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.383489, 0.0), 'l2norm': (1.238027, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.293659, 'x2': 0.97249, 'x3': 0.875223, 'x4': 0.99334, 'x5': 0.336409, 'x6': 0.140827}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.360936, 0.0), 'l2norm': (1.708132, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.871813, 'x2': 0.776927, 'x3': 0.807538, 'x4': 0.643326, 'x5': 0.572012, 'x6': 0.67223}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.024997, 0.0), 'l2norm': (1.791298, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.265784, 'x2': 0.00613, 'x3': 0.388793, 'x4': 0.364144, 'x5': 0.640832, 'x6': 0.167751}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:28] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.126329, 0.0), 'l2norm': (0.890644, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:287: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:298: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-15 17:10:48] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.59258, 'x2': 0.273142, 'x3': 0.058336, 'x4': 0.423357, 'x5': 0.184469, 'x6': 0.741409}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:10:48] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.036659, 0.0), 'l2norm': (1.091837, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:287: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:298: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-15 17:11:07] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.551129, 'x2': 0.261791, 'x3': 0.039915, 'x4': 0.384436, 'x5': 0.18932, 'x6': 0.750001}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:11:07] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.232265, 0.0), 'l2norm': (1.058303, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:287: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:298: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-15 17:11:26] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.504631, 'x2': 0.244459, 'x3': 0.017705, 'x4': 0.337493, 'x5': 0.191796, 'x6': 0.759005}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:11:26] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.410859, 0.0), 'l2norm': (1.02054, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:287: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:298: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-15 17:11:45] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.446076, 'x2': 0.213803, 'x3': 0.0, 'x4': 0.273792, 'x5': 0.196028, 'x6': 0.765181}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:11:45] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.57544, 0.0), 'l2norm': (0.971384, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:11:54] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.375206, 'x2': 0.165681, 'x3': 0.001586, 'x4': 0.219009, 'x5': 0.21342, 'x6': 0.751781}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:11:54] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.785514, 0.0), 'l2norm': (0.909352, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:287: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.13/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:298: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-15 17:12:13] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.300877, 'x2': 0.115408, 'x3': 0.024442, 'x4': 0.211551, 'x5': 0.24803, 'x6': 0.706709}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:13] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.167579, 0.0), 'l2norm': (0.842706, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:22] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.233536, 'x2': 0.083638, 'x3': 0.038716, 'x4': 0.234747, 'x5': 0.279406, 'x6': 0.658766}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:22] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.411644, 0.0), 'l2norm': (0.793839, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:30] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.146209, 'x2': 0.005342, 'x3': 0.048771, 'x4': 0.278852, 'x5': 0.278569, 'x6': 0.653842}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:30] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.313867, 0.0), 'l2norm': (0.778879, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:39] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.189787, 'x2': 0.119162, 'x3': 0.00199, 'x4': 0.211476, 'x5': 0.31105, 'x6': 0.612905}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:39] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.228972, 0.0), 'l2norm': (0.753226, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:49] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.24814, 'x2': 0.059964, 'x3': 0.106228, 'x4': 0.269188, 'x5': 0.291451, 'x6': 0.642139}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:49] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.621875, 0.0), 'l2norm': (0.803867, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:58] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.223991, 'x2': 0.081532, 'x3': 0.166045, 'x4': 0.219476, 'x5': 0.293558, 'x6': 0.633415}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:12:58] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.666839, 0.0), 'l2norm': (0.78737, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:07] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.247451, 'x2': 0.043382, 'x3': 0.166454, 'x4': 0.224677, 'x5': 0.356192, 'x6': 0.656468}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:07] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.537283, 0.0), 'l2norm': (0.836136, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:15] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.257378, 'x2': 0.034039, 'x3': 0.156994, 'x4': 0.212263, 'x5': 0.248616, 'x6': 0.600127}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:15] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.352214, 0.0), 'l2norm': (0.747708, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:13:15.685824Z", "iopub.status.busy": "2022-09-15T17:13:15.685483Z", "iopub.status.idle": "2022-09-15T17:13:15.715957Z", "shell.execute_reply": "2022-09-15T17:13:15.714856Z" } }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:13:15.721394Z", "iopub.status.busy": "2022-09-15T17:13:15.721063Z", "iopub.status.idle": "2022-09-15T17:13:15.760453Z", "shell.execute_reply": "2022-09-15T17:13:15.759470Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:15] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.81, 'x2': 0.52, 'x3': 0.31, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.75, 'x2': 0.01, 'x3': 0.94, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.43, 'x2': 0.45, 'x3': 0.43, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.1, 'x2': 0.79, 'x3': 0.53, 'x...
40Sobol4COMPLETED{'4_0': {'x1': 0.84, 'x2': 0.08, 'x3': 0.45, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.62, 'x2': 0.54, 'x3': 0.27, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.89, 'x2': 0.38, 'x3': 0.47, '...
70Sobol7COMPLETED{'7_0': {'x1': 0.92, 'x2': 0.96, 'x3': 0.61, '...
80Sobol8COMPLETED{'8_0': {'x1': 0.71, 'x2': 0.33, 'x3': 0.08, '...
90Sobol9COMPLETED{'9_0': {'x1': 0.29, 'x2': 0.97, 'x3': 0.88, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.87, 'x2': 0.78, 'x3': 0.81, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.27, 'x2': 0.01, 'x3': 0.39, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.59, 'x2': 0.27, 'x3': 0.06, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.55, 'x2': 0.26, 'x3': 0.04, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.5, 'x2': 0.24, 'x3': 0.02, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.45, 'x2': 0.21, 'x3': 0.0, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.38, 'x2': 0.17, 'x3': 0.0, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.3, 'x2': 0.12, 'x3': 0.02, '...
181GPEI18COMPLETED{'18_0': {'x1': 0.23, 'x2': 0.08, 'x3': 0.04, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.15, 'x2': 0.01, 'x3': 0.05, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.19, 'x2': 0.12, 'x3': 0.0, '...
211GPEI21COMPLETED{'21_0': {'x1': 0.25, 'x2': 0.06, 'x3': 0.11, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.22, 'x2': 0.08, 'x3': 0.17, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.25, 'x2': 0.04, 'x3': 0.17, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.26, 'x2': 0.03, 'x3': 0.16, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.81, 'x2': 0.52, 'x3': 0.31, '... \n", "1 {'1_0': {'x1': 0.75, 'x2': 0.01, 'x3': 0.94, '... \n", "2 {'2_0': {'x1': 0.43, 'x2': 0.45, 'x3': 0.43, '... \n", "3 {'3_0': {'x1': 0.1, 'x2': 0.79, 'x3': 0.53, 'x... \n", "4 {'4_0': {'x1': 0.84, 'x2': 0.08, 'x3': 0.45, '... \n", "5 {'5_0': {'x1': 0.62, 'x2': 0.54, 'x3': 0.27, '... \n", "6 {'6_0': {'x1': 0.89, 'x2': 0.38, 'x3': 0.47, '... \n", "7 {'7_0': {'x1': 0.92, 'x2': 0.96, 'x3': 0.61, '... \n", "8 {'8_0': {'x1': 0.71, 'x2': 0.33, 'x3': 0.08, '... \n", "9 {'9_0': {'x1': 0.29, 'x2': 0.97, 'x3': 0.88, '... \n", "10 {'10_0': {'x1': 0.87, 'x2': 0.78, 'x3': 0.81, ... \n", "11 {'11_0': {'x1': 0.27, 'x2': 0.01, 'x3': 0.39, ... \n", "12 {'12_0': {'x1': 0.59, 'x2': 0.27, 'x3': 0.06, ... \n", "13 {'13_0': {'x1': 0.55, 'x2': 0.26, 'x3': 0.04, ... \n", "14 {'14_0': {'x1': 0.5, 'x2': 0.24, 'x3': 0.02, '... \n", "15 {'15_0': {'x1': 0.45, 'x2': 0.21, 'x3': 0.0, '... \n", "16 {'16_0': {'x1': 0.38, 'x2': 0.17, 'x3': 0.0, '... \n", "17 {'17_0': {'x1': 0.3, 'x2': 0.12, 'x3': 0.02, '... \n", "18 {'18_0': {'x1': 0.23, 'x2': 0.08, 'x3': 0.04, ... \n", "19 {'19_0': {'x1': 0.15, 'x2': 0.01, 'x3': 0.05, ... \n", "20 {'20_0': {'x1': 0.19, 'x2': 0.12, 'x3': 0.0, '... \n", "21 {'21_0': {'x1': 0.25, 'x2': 0.06, 'x3': 0.11, ... \n", "22 {'22_0': {'x1': 0.22, 'x2': 0.08, 'x3': 0.17, ... \n", "23 {'23_0': {'x1': 0.25, 'x2': 0.04, 'x3': 0.17, ... \n", "24 {'24_0': {'x1': 0.26, 'x2': 0.03, 'x3': 0.16, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:15.765572Z", "iopub.status.busy": "2022-09-15T17:13:15.765212Z", "iopub.status.idle": "2022-09-15T17:13:16.367972Z", "shell.execute_reply": "2022-09-15T17:13:16.366984Z" } }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.22399122198464227,\n", " 'x2': 0.08153161805289375,\n", " 'x3': 0.16604511225609692,\n", " 'x4': 0.21947589985065627,\n", " 'x5': 0.2935581235385248,\n", " 'x6': 0.6334151028417162}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:16.372812Z", "iopub.status.busy": "2022-09-15T17:13:16.372494Z", "iopub.status.idle": "2022-09-15T17:13:16.381005Z", "shell.execute_reply": "2022-09-15T17:13:16.380121Z" } }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.7873707188905149, 'hartmann6': -2.6668265555499846}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:16.385823Z", "iopub.status.busy": "2022-09-15T17:13:16.385504Z", "iopub.status.idle": "2022-09-15T17:13:16.393417Z", "shell.execute_reply": "2022-09-15T17:13:16.392235Z" } }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:16.397592Z", "iopub.status.busy": "2022-09-15T17:13:16.397090Z", "iopub.status.idle": "2022-09-15T17:13:17.355532Z", "shell.execute_reply": "2022-09-15T17:13:17.354390Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:16] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.8771984640876005, -1.9262737340291416, -1.9727994568533904, -2.016263623299244, -2.0561426186228626, -2.091911280639553, -2.1230548035890644, -2.1490821933491118, -2.1695407509601603, -2.1840308308252894, -2.1922199331509677, -2.193855100012224, -2.188772634185664, -2.176904363843783, -2.158280007103083, -2.1330255840039056, -2.1013582001927933, -2.063577819121828, -2.0200568117732938, -1.9712281223777428, -1.9175728372718543, -1.8596078250236696, -1.797873962790284, -1.7329253044170687, -1.6653193997866826, -1.5956088540293019, -1.5243341242196968, -1.4520174898326093, -1.3791580979203104, -1.3062279693692673, -1.2336688527980464, -1.1618898221036402, -1.0912655276397796, -1.0221350259447073, -0.9548011264419896, -0.889530204310113, -0.8265524363167714, -0.7660624210130464, -0.7082201468095413, -0.6531522717861302, -0.6009536782930871, -0.5516892640723745, -0.5053959302371154, -0.46208472535465384, -0.42174310434998497, -0.38433726116784006, -0.34981449521905084, -0.3181055736357452, -0.2891270542422837, -0.26278353781629926 ], [ -1.891858362122326, -1.9414864826534122, -1.988529106410152, -2.032464157157231, -2.072757328601772, -2.1088723842795662, -2.140283388851855, -2.1664885747817864, -2.1870253068882275, -2.201485360369356, -2.209529524538829, -2.210900442822888, -2.2054326487312794, -2.193058975254993, -2.173812872444235, -2.1478265932074576, -2.115325611407111, -2.076619944528847, -2.0320932273049515, -1.9821904230893495, -1.9274049935560233, -1.8682662123407399, -1.8053271413640304, -1.7391536191302432, -1.670314458289362, -1.5993729263428493, -1.5268794925853173, -1.453365765060286, -1.3793395090864762, -1.3052806277577595, -1.2316379883121948, -1.1588269904531519, -1.087227788657062, -1.017184096566401, -0.9490025154062578, -0.8829523388123693, -0.8192657932743165, -0.7581386769599736, -0.6997313607147104, -0.6441701143463989, -0.5915487196863651, -0.5419303299948436, -0.4953495335373316, -0.45181457793514024, -0.4113097114175497, -0.37379759751755226, -0.33922176113166247, -0.3075090262139277, -0.27857190863536907, -0.2523109317876153 ], [ -1.902800121205852, -1.952798725418998, -2.0001787751753923, -2.0444103782779433, -2.0849510150732744, -2.121256031030252, -2.1527911225597878, -2.1790465185156473, -2.199552308963703, -2.2138941137557504, -2.2217280674121582, -2.2227939859791688, -2.2169256299154663, -2.2040572055213117, -2.184225625806342, -2.1575685025200135, -2.1243182669925322, -2.0847931376433375, -2.0393858265535343, -1.9885509093275764, -1.9327917031410242, -1.8726473494688847, -1.8086806199856178, -1.7414667870141338, -1.6715837437110594, -1.5996034345412453, -1.5260845667815404, -1.451566516898593, -1.3765643165918842, -1.3015645954731234, -1.2270223638820492, -1.1533585339396075, -1.0809580944943311, -1.010168872427123, -0.9413008265777143, -0.874625830338696, -0.8103779046985317, -0.7487538658042805, -0.6899143508734997, -0.6339851844857892, -0.5810590447926196, -0.5311973866744766, -0.4844325768234061, -0.44077019444174725, -0.4001914509032931, -0.362655682410711, -0.32810287142521743, -0.29645615540469483, -0.26762428506955716, -0.24150399886918705 ], [ -1.9098874723431618, -1.9600653607499587, -2.007594589037893, -2.0519398605377512, -2.092553108900505, -2.128884131715311, -2.1603932520930273, -2.186565708399245, -2.206927216114888, -2.2210598796962695, -2.2286174087211243, -2.2293384761949406, -2.223057104863579, -2.209709202858776, -2.1893347623620074, -2.16207570288258, -2.1281697812516516, -2.0879413182511537, -2.0417896656926926, -1.9901763625514697, -1.9336118393609552, -1.8726423716927654, -1.807837797624397, -1.7397803318889542, -1.669054650870422, -1.5962392979028062, -1.5218993700953787, -1.446580393618412, -1.370803268409643, -1.2950601585128076, -1.2198112134654597, -1.145482022759654, -1.0724617241358503, -1.0011017036129872, -0.9317148385315263, -0.8645752436650515, -0.7999184848319987, -0.7379422252427235, -0.6788072681618006, -0.6226389564698308, -0.5695288863214409, -0.5195368890196124, -0.4726932329195488, -0.42900099589691854, -0.3884385587833583, -0.3509621712125518, -0.31650854349640156, -0.28499742137732653, -0.2563341046460438, -0.2304118754949005 ], [ -1.913023030827072, -1.9631832803795684, -2.0106678542723313, -2.0549385775164226, -2.0954446349124556, -2.131633291972814, -2.162962649369053, -2.188916127615559, -2.2090181214417632, -2.222849995814657, -2.230065370419598, -2.2304035218779656, -2.2236997813701507, -2.2098920437772964, -2.1890229024198327, -2.1612373982904227, -2.1267768190349727, -2.0859693133857067, -2.039218259258749, -1.98698934392062, -1.9297972191765251, -1.8681924304090174, -1.8027491280978098, -1.7340538858766807, -1.6626957901184996, -1.5892578422882013, -1.514309629078206, -1.438401163686116, -1.3620577784675452, -1.2857759471424945, -1.2100199261699167, -1.1352191230511364, -1.0617661187861533, -0.990015288759369, -0.9202819789043146, -0.8528422014537882, -0.7879328173459791, -0.7257521714924092, -0.6664611439282004, -0.6101845756174392, -0.5570130233980582, -0.5070047949405322, -0.46018821209160676, -0.41656404977957007, -0.3761080978175544, -0.3387737944094946, -0.3044948828383257, -0.27318804655751805, -0.2447554825425653, -0.21908737808095802 ], [ -1.9121511628859653, -1.962094525517359, -2.009338515922164, -2.053344670851289, -2.0935622911379643, -2.1294391943127, -2.160434476563938, -2.1860329759770654, -2.2057608750212228, -2.219201617203034, -2.2260110923519254, -2.2259309311611677, -2.218798799494644, -2.204554820244084, -2.1832436452309585, -2.155012170441628, -2.120103330661936, -2.0788467373629214, -2.031647094211012, -1.97897134307852, -1.9213353964933537, -1.8592911472693416, -1.7934142554699477, -1.7242930287146956, -1.6525185539971674, -1.5786761173060526, -1.503337863436625, -1.4270565992648567, -1.3503606231421141, -1.2737494632475754, -1.1976904208954595, -1.12261583397519, -1.0489209954207157, -0.9769626781471846, -0.907058229307429, -0.8394852025667086, -0.774481498030573, -0.7122459767798708, -0.6529395121684951, -0.5966864345092622, -0.5435763205965749, -0.49366607541307783, -0.446982250730359, -0.4035235442735968, -0.3632634236441741, -0.3261528211563096, -0.2921228489715052, -0.26108748821142314, -0.2329462108802136, -0.20758649919815853 ], [ -1.907259682676091, -1.9567881215432243, -2.0035971304779596, -2.0471505582365777, -2.086900685881308, -2.1222989537814287, -2.152808645004237, -2.17791921131038, -2.1971616814801775, -2.2101243386235487, -2.216467643288018, -2.215937273544081, -2.208374205599901, -2.1937209906532646, -2.172023766658921, -2.1434299998954955, -2.1081823811824147, -2.0666096214154015, -2.0191150589290534, -1.966164010846391, -1.908270706716489, -1.8459854811760334, -1.7798827153048598, -1.7105498354287425, -1.638577523232572, -1.564551171909479, -1.4890435417366152, -1.4126085217379336, -1.335775885599788, -1.2590469319107636, -1.1828909131391718, -1.1077421774549518, -1.0339979670037012, -0.9620168318673875, -0.8921176288742813, -0.8245790784069194, -0.7596398512913186, -0.6974991532477364, -0.638317767921808, -0.5822195126969709, -0.5292930554501337, -0.47959403586738136, -0.43314743222350305, -0.3899501137061807, -0.349973519313721, -0.31316640686364106, -0.2794576194717314, -0.24875882174065767, -0.22096716357636292, -0.19596783577000565 ], [ -1.898380278026301, -1.9473004760395973, -1.9934852229279285, -2.036403235415092, -2.0755125705221045, -2.1102712683378915, -2.1401498718680916, -2.1646455042783526, -2.1832969486465394, -2.195699937083868, -2.2015216618587345, -2.2005134273770803, -2.1925204173324664, -2.177487774833191, -2.155462557211762, -2.1265915596918026, -2.0911154110661947, -2.0493596514360877, -2.001723666243331, -1.9486683738963533, -1.890703477526531, -1.8283749378097187, -1.7622531439604958, -1.692922085031948, -1.6209696734197325, -1.5469792569386462, -1.4715222773263439, -1.3951519885240322, -1.318398131308739, -1.2417624639642577, -1.165715063653642, -1.0906913328413335, -1.0170896639400189, -0.9452697296944921, -0.8755513749701812, -0.8082140875393765, -0.7434970222655191, -0.6815995464985163, -0.6226822663540582, -0.5668684854617566, -0.5142460409030261, -0.46486945611793173, -0.41876234782192656, -0.37592002341632236, -0.336312206791622, -0.2998858335131528, -0.2665678608205262, -0.23626804334898832, -0.2088816316911296, -0.18429195757774208 ], [ -1.8855876472992126, -1.9337143253191262, -1.9790940174940017, -2.0212027671322605, -2.059507070202731, -2.0934743747218336, -2.12258535522182, -2.1463476375421715, -2.1643104285247823, -2.1760792855967743, -2.181330086278933, -2.179821178140502, -2.1714027482986955, -2.156022663425321, -2.133728370396902, -2.1046648494525515, -2.0690689932435053, -2.0272610748589748, -1.9796341271313098, -1.9266420833775102, -1.8687874531179773, -1.8066091642748967, -1.7406710340550147, -1.6715511642252443, -1.5998324125857755, -1.5260939814267638, -1.4509040883690842, -1.3748136426016249, -1.2983508341060996, -1.2220165472855031, -1.1462805254929203, -1.071578232137482, -0.9983083717721326, -0.9268310472834269, -0.8574665354509627, -0.7904946628631218, -0.726154758784094, -0.6646461529783093, -0.6061291766986394, -0.5507266157236713, -0.49852555668504883, -0.4495795626305801, -0.40391111104338495, -0.36151422727684657, -0.3223572482708841, -0.2863856551027897, -0.25352491799477883, -0.22368330347318754, -0.19675460010713297, -0.1726207263397599 ], [ -1.8689974141849284, -1.9161563147960798, -1.96056164950886, -2.0016991002762596, -2.0390460748434824, -2.0720820042876413, -2.1003002955617767, -2.1232216110811803, -2.140407943814689, -2.1514767580456486, -2.156114312464397, -2.1540872180491957, -2.145251344342673, -2.1295573856821592, -2.1070527096426916, -2.0778794763797923, -2.0422693671849514, -2.0005355297383636, -1.9530625002555126, -1.900294895744615, -1.8427256049924554, -1.7808840790436204, -1.7153251658376762, -1.646618777886945, -1.575340545898742, -1.502063505682111, -1.4273507938113639, -1.3517492872247532, -1.2757841075758378, -1.1999539152550391, -1.12472693270149, -1.0505376548469396, -0.9777842207851928, -0.9068264315769541, -0.8379844030646733, -0.7715378399996978, -0.707725910178338, -0.6467476867217334, -0.5887631152258165, -0.5338944520088941, -0.48222811130720367, -0.4338168536558644, -0.38868224500174087, -0.3468173161411676, -0.30818935447267726, -0.272742764332939, -0.24040193786813358, -0.2110740850447954, -0.1846519786390668, -0.16101657753030496 ], [ -1.8487629618031325, -1.894793385527024, -1.9380690666268419, -1.9780874481141262, -2.0143390844579807, -2.046317681099953, -2.0735316559656276, -2.095516894572039, -2.111850185575303, -2.1221626480001436, -2.1261523300319123, -2.12359511017334, -2.1143530942997195, -2.098379884631399, -2.0757223769613242, -2.0465190714097616, -2.010995197323242, -1.969455199325111, -1.9222732761441321, -1.8698827015491597, -1.8127646048198682, -1.7514367760585392, -1.6864429206475449, -1.6183426439015793, -1.5477023203446765, -1.4750869028769387, -1.4010526592142252, -1.3261407848626776, -1.2508718283927054, -1.1757408687952002, -1.1012133986148283, -1.0277218834278368, -0.9556629826943107, -0.8853954257202012, -0.8172385381391152, -0.7514714094408856, -0.6883326822955128, -0.6280209319607319, -0.5706955911250462, -0.5164783639307895, -0.46545506386137414, -0.4176778042709721, -0.37316746768344666, -0.33191638032870086, -0.2938911212501999, -0.25903540015716076, -0.22727294446135937, -0.19851034313673377, -0.17263980274437696, -0.14954177882329533 ], [ -1.8250713840801684, -1.8698282031935882, -1.9118348990762055, -1.950602573581572, -1.9856368889958529, -2.0164477974111845, -2.042560651428943, -2.063528370721366, -2.078944173936945, -2.0884542327633087, -2.091769495190877, -2.0886758899289513, -2.079042187000197, -2.0628249557172795, -2.040070310854394, -2.010912429081837, -1.9755690982234095, -1.9343347843475232, -1.8875718368086054, -1.8357004926450342, -1.7791883022154429, -1.7185395020595355, -1.6542847361491897, -1.5869713972560517, -1.517154744082933, -1.4453898579198392, -1.3722244392026168, -1.2981924085737881, -1.2238082643173107, -1.1495621517165486, -1.075915612679866, -1.0032979991929296, -0.9321035465919278, -0.8626891091105388, -0.795372559502582, -0.7304318473955862, -0.6681046991771948, -0.6085889279742518, -0.5520433079279988, -0.4985889543359534, -0.4483111415347052, -0.40126148421428454, -0.35746040522903144, -0.3168998135723441, -0.279545919471171, -0.24534211890582924, -0.2142118866584103, -0.1860616246887199, -0.1607834207670621, -0.13825768048341802 ], [ -1.7981387865317742, -1.8414939017815954, -1.8821096156453372, -1.9195123364992241, -1.953224498498927, -1.9827739344578474, -2.0077044867335663, -2.0275875371930545, -2.0420339920888195, -2.0507061271970883, -2.0533286089010496, -2.049697984041061, -2.0396899934891426, -2.0232642140702906, -2.0004657532462833, -1.9714239758962182, -1.936348489038484, -1.8955228086875717, -1.8492962575449803, -1.7980746856975904, -1.7423105782771597, -1.6824930339851294, -1.619137990034709, -1.5527789541546728, -1.48395839960511, -1.4132198952871227, -1.3411009846468804, -1.2681267938724734, -1.1948043379233437, -1.1216174961110905, -1.049022640400851, -0.977444912940414, -0.9072751595814859, -0.8388675303124886, -0.7725377545852583, -0.7085620902189108, -0.6471769307870336, -0.5885790405264009, -0.532926370161714, -0.48033939347523635, -0.43090289416553784, -0.3846681260825928, -0.3416552672966243, -0.3018560892682324, -0.2652367660314935, -0.23174075408984618, -0.2012916809837273, -0.17379618861880852, -0.14914668594536384, -0.12722397405705033 ], [ -1.7682051797534093, -1.8100484223398237, -1.8491692857166688, -1.8851108670541616, -1.9174137289578193, -1.945624876666876, -1.969307831706581, -1.9880534931175255, -2.0014913513539225, -2.00930051017806, -2.0112199002213984, -2.0070570552002573, -1.9966948818031307, -1.9800959877397246, -1.957304324164293, -1.9284441196441526, -1.8937162972806658, -1.8533927414953832, -1.807808894238251, -1.7573552045825875, -1.7024679372422096, -1.643619780295023, -1.5813106001157404, -1.5160585912939208, -1.4483919764637532, -1.3788413356518738, -1.3079325918024385, -1.2361806487664189, -1.1640836669249541, -1.0921179642320886, -1.0207335404397704, -0.9503502336071, -0.881354526013323, -0.814097018471363, -0.748890586925139, -0.6860092239346512, -0.6256875521506531, -0.5681209795764124, -0.5134664496379923, -0.461843724688316, -0.41333713074485057, -0.3679976845271272, -0.32584552118337884, -0.28687254204333623, -0.25104520564884736, -0.21830739145149558, -0.1885832732011533, -0.16178014753734116, -0.13779117210351965, -0.11649797621886437 ], [ -1.7355291997862956, -1.775768711592316, -1.8133092439197944, -1.8477116943022818, -1.87853580423192, -1.9053487096133863, -1.9277344515207202, -1.945304151556881, -1.9577064481564088, -1.9646376991673398, -1.965851400013649, -1.9611662621418753, -1.9504724534235864, -1.933735620185839, -1.9109984764591414, -1.8823799360123696, -1.8480719476675316, -1.8083343471253372, -1.7634881402930924, -1.7139076767399173, -1.6600121615677876, -1.6022569020587885, -1.5411246083164338, -1.4771169812162168, -1.4107467400400355, -1.3425301756743215, -1.2729802680480118, -1.2026003791751587, -1.1318785230033204, -1.0612822153347887, -0.9912539155555583, -0.9222070812188002, -0.8545228623334964, -0.7885474619102555, -0.7245901822019805, -0.6629221630414545, -0.6037758016890495, -0.5473448250819988, -0.49378496764015434, -0.4432151926689958, -0.3957193840831469, -0.35134842815644374, -0.3101226022287261, -0.2720341883027213, -0.2370502335511393, -0.20511538613733704, -0.17615474266528464, -0.1500766523324284, -0.12677543190169605, -0.10613395450243213 ], [ -1.7003828648572075, -1.7389450122706542, -1.7748379113595432, -1.8076411047427734, -1.8369342684603003, -1.862305313171523, -1.8833593176650365, -1.899728014704203, -1.911079457836826, -1.917127423347599, -1.9176400586706102, -1.912447290108009, -1.9014465559046432, -1.884606534253551, -1.8619686784402694, -1.8336465335851266, -1.7998229677545066, -1.7607455824713782, -1.7167206581071315, -1.6681060316386385, -1.6153033003303279, -1.5587497046066456, -1.498909980079926, -1.4362683963528016, -1.3713211308836222, -1.3045690685428033, -1.2365110761786218, -1.1676377774285944, -1.0984258439255505, -1.0293328206326102, -0.9607925100408778, -0.8932109473045406, -0.8269630020824011, -0.7623896405504642, -0.6997958721642286, -0.63944939122316, -0.5815799050829294, -0.5263791213617675, -0.47400134797752114, -0.42456464414062134, -0.37815244867206643, -0.33481560470770766, -0.29457469691969995, -0.25742261835652525, -0.2233272881541446, -0.19223444788777988, -0.1640704724150137, -0.13874513999352078, -0.11615431565345213, -0.09618251081563856 ], [ -1.6630465433584127, -1.6998754339004782, -1.734070974683389, -1.7652319428923904, -1.7929584292642264, -1.8168594760054424, -1.8365614290737298, -1.8517167424480871, -1.8620128954573303, -1.867181024073173, -1.8670038350499552, -1.8613223777239902, -1.8500412972747378, -1.833132283464002, -1.8106355508003174, -1.782659323874464, -1.7493774363148864, -1.711025265514309, -1.6678943049168236, -1.6203257152569341, -1.5687031970976208, -1.5134454966203759, -1.4549988056585361, -1.3938292571128506, -1.3304156585628997, -1.2652425578179256, -1.1987936987132102, -1.1315459046854726, -1.0639634197561718, -0.996492737756813, -0.9295579562641537, -0.8635566972076226, -0.7988566378660581, -0.735792691884125, -0.6746648695517334, -0.6157368308662622, -0.5592351257615442, -0.5053490956641572, -0.4542313914521635, -0.40599904671223597, -0.36073503305658083, -0.3184902166593456, -0.2792856320345908, -0.24311498992584768, -0.20994734028341056, -0.17972981783810016, -0.15239040591741393, -0.12784066315532105, -0.1059783670135882, -0.08669003709510403 ], [ -1.6238042686685443, -1.6588609458414287, -1.6913260690599814, -1.720818001977868, -1.746957479548937, -1.7693747766386685, -1.7877174841844838, -1.8016586493239808, -1.8109049723917625, -1.8152047056145195, -1.8143548750274943, -1.8082074560227155, -1.7966741774885575, -1.7797297076474807, -1.7574130784387818, -1.729827321782933, -1.6971374050962003, -1.6595666505804956, -1.6173918923628547, -1.5709376622743982, -1.5205696995761002, -1.4666880577881236, -1.409720041578289, -1.3501131580596397, -1.28832821869378, -1.224832687055706, -1.160094337964084, -1.0945752759986105, -1.0287263547738108, -0.9629820392768094, -0.8977557579871631, -0.8334357953210132, -0.770381774974946, -0.7089217791376332, -0.6493501369436998, -0.5919258989325902, -0.5368719945059148, -0.4843750486892806, -0.4345858150462718, -0.387620165082183, -0.3435605620301607, -0.3024579390224694, -0.2643338982582015, -0.22918314842010012, -0.19697610154649947, -0.16766155699597451, -0.1411694082205126, -0.11741331703744984, -0.09629330933944114, -0.07769825522764973 ], [ -1.5829394969210326, -1.616200888673168, -1.6469180590511074, -1.674729094439041, -1.6992753812345516, -1.720208306323153, -1.7371964698427893, -1.7499331860057332, -1.7581439954871927, -1.7615938748836477, -1.7600938123026275, -1.7535064288266344, -1.741750365662361, -1.724803224124737, -1.7027029335117392, -1.6755475200231835, -1.6434933460047398, -1.6067519713992517, -1.5655858496189943, -1.5203031036353938, -1.4712516350820146, -1.4188128037519148, -1.3633948838766374, -1.305426464884679, -1.2453499253718983, -1.1836150755780142, -1.1206730392674538, -1.056970431606019, -0.9929438842475862, -0.929014969625113, -0.8655855797916869, -0.8030338175202452, -0.7417104559303654, -0.6819360160643022, -0.6239984993388811, -0.568151794608735, -0.5146147594670438, -0.4635709545144905, -0.41516898970028837, -0.36952342513990477, -0.3267161561357579, -0.2867982039657193, -0.24979183032373964, -0.21569289365769284, -0.1844733693502495, -0.15608396190773255, -0.13045674522939, -0.1075077758704176, -0.08713963335572783, -0.0692438505611328 ], [ -1.5407313672910126, -1.5721890589508607, -1.601154965890256, -1.6272868423738247, -1.650246541060376, -1.6697062527099762, -1.685355174370256, -1.696906401160358, -1.7041037940951655, -1.7067285466379944, -1.7046051615254247, -1.6976065609809678, -1.6856580891246655, -1.66874022313851, -1.6468898839796116, -1.6202003197785393, -1.588819615818894, -1.5529479549365943, -1.512833804231625, -1.4687692343817056, -1.421084586476601, -1.370142691289496, -1.3163328226558018, -1.26006453652086, -1.201761516379846, -1.1418555191595565, -1.0807804961129752, -1.0189669519678, -0.9568366014431564, -0.8947973829634643, -0.8332388918620032, -0.7725282964920444, -0.7130067980107168, -0.6549866868022538, -0.5987490354081476, -0.5445420503587257, -0.49258008513009577, -0.44304329559326583, -0.3960778997259886, -0.3517969866136048, -0.31028180693917373, -0.2715834687588541, -0.23572495836845242, -0.20270340608676107, -0.17249252014240035, -0.14504511775580387, -0.12029569014006303, -0.09816294675351478, -0.07855229308971612, -0.06135820509467482 ], [ -1.4974514927611016, -1.5271103878195347, -1.5543345525389571, -1.5788011887386224, -1.6001922676310656, -1.6182003212431348, -1.6325345894580041, -1.642927336700862, -1.6491401176645337, -1.6509697483920205, -1.6482537318894686, -1.640874899234834, -1.628765058666838, -1.6119074944626792, -1.5903382199122933, -1.5641459576398757, -1.5334708881870318, -1.4985022668113483, -1.4594750531848382, -1.416665725972693, -1.37038746388305, -1.3209848690578785, -1.2688283918504033, -1.2143085932243247, -1.1578303572229607, -1.0998071452509808, -1.0406553688384061, -0.9807889489416741, -0.920614126892267, -0.860524592824568, -0.8008969991556785, -0.7420869268016942, -0.6844253682086098, -0.6282157828013568, -0.5737317670332349, -0.521215363737191, -0.4708760155059508, -0.4228901462365652, -0.37740133559923117, -0.33452103454326076, -0.29432975707205655, -0.2568786749129037, -0.22219153740319975, -0.1902668385497519, -0.16108015616829086, -0.1345865935126429, -0.11072326106610908, -0.08941174445401467, -0.07056051311759193, -0.054067232971109824 ], [ -1.4533612835638738, -1.4812382066643228, -1.5067415494218, -1.5295676009440606, -1.5494179694739139, -1.566004942025931, -1.579057136980108, -1.5883252817698295, -1.5935879198599685, -1.5946568334652556, -1.591381964269321, -1.583655625934072, -1.5714158298125573, -1.5546485872461102, -1.5333891043146575, -1.5077218425104428, -1.4777794753830205, -1.443740820928641, -1.4058278678271923, -1.3643020380039979, -1.3194598381048737, -1.271628050088193, -1.2211585995593228, -1.1684232237722731, -1.113808043443714, -1.0577081269768769, -1.0005221244778968, -0.942647042742915, -0.884473230530963, -0.8263796442147389, -0.7687294650710456, -0.7118661387840486, -0.6561099034187623, -0.6017548632269061, -0.5490666521579869, -0.49828071370391636, -0.4496012041544585, -0.4032005062200442, -0.3592193209968514, -0.31776728983788716, -0.2789240848530403, -0.24274089800665344, -0.20924225417348474, -0.17842807273961614, -0.15027590482131215, -0.12474327820331788, -0.10177008891171979, -0.08128098621989399, -0.06318770622184067, -0.047391317403363775 ], [ -1.4087097857175737, -1.434832072708741, -1.4586454833869236, -1.479864918453919, -1.4982110345582913, -1.5134151916368723, -1.5252246398289437, -1.5334077951818945, -1.5377594309221625, -1.5381055975323954, -1.5343080828100524, -1.5262682340228297, -1.5139299883209927, -1.4972819931556245, -1.4763587424389197, -1.4512407022317324, -1.4220534469864874, -1.3889658691976075, -1.3521875581045495, -1.3119654647790404, -1.2685799811939613, -1.2223405610447342, -1.173581002741144, -1.1226545033235402, -1.0699285793064746, -1.015779939276769, -0.9605893851610944, -0.9047368149607948, -0.848596398844375, -0.7925320013491749, -0.7368929231752661, -0.6820100347588804, -0.6281923690094864, -0.5757242315055987, -0.5248628731077429, -0.47583675314740137, -0.4288444024170396, -0.384053875712543, -0.34160276524731403, -0.30159873020999883, -0.2641204850341853, -0.22921918010720643, -0.19692010375982194, -0.1672246331884143, -0.14011236394961735, -0.11554335216898859, -0.09346040990476179, -0.07379140152059871, -0.056451496846403604, -0.041345344859833766 ], [ -1.3637320028730089, -1.3881361135494967, -1.410299059139568, -1.4299537836562624, -1.4468393206400556, -1.4607053497495073, -1.47131694783275, -1.4784593995914725, -1.481942914982812, -1.4816070902631928, -1.477324948991594, -1.4690064094555733, -1.4566010457857101, -1.4401000401143775, -1.419537259933758, -1.394989434844888, -1.366575446308782, -1.3344547791716364, -1.2988252117791037, -1.2599198407527012, -1.2180035466806218, -1.173369009072869, -1.1263323749324488, -1.0772286777177191, -1.0264070948585615, -0.9742261244464296, -0.921048756573901, -0.8672377124427482, -0.8131508242709433, -0.7591366299847947, -0.7055302570877431, -0.6526496683651422, -0.600792336986613, -0.5502324094795967, -0.5012184020475255, -0.45397145952222484, -0.40868418808173523, -0.36552005418390277, -0.32461332441644, -0.28606950539621623, -0.24996623037804566, -0.21635453037234398, -0.18526042244695407, -0.15668674629227397, -0.13061518160487884, -0.10700838278462066, -0.085812173178754, -0.06695774799464682, -0.0503638424634365, -0.0359388293973959 ], [ -1.3186476603695152, -1.3413778410567279, -1.3619370348810609, -1.380075589055289, -1.3955501810621815, -1.4081280072844438, -1.417591128319842, -1.4237408507140135, -1.426402010498426, -1.4254270162239995, -1.4206995095813124, -1.4121375109377867, -1.3996959350213873, -1.3833683873555167, -1.3631881827940524, -1.3392285608458978, -1.3116021053665732, -1.2804594057637884, -1.2459870208597794, -1.2084048236461211, -1.167962815095184, -1.1249374987039176, -1.0796279060684117, -1.0323513594749267, -0.9834390522273937, -0.9332315228503012, -0.8820740964292999, -0.8303123654433565, -0.7782877830313372, -0.7263334426839013, -0.6747701185224357, -0.6239026383023809, -0.5740166560495257, -0.5253758823109833, -0.47821981748582854, -0.4327620182653408, -0.3891889099513832, -0.34765913964860773, -0.30830344836683243, -0.2712250250818421, -0.2365002936487992, -0.20418007465160815, -0.17429105895710773, -0.14683752776628545, -0.12180325492103039, -0.09915353058757304, -0.07883725058502322, -0.06078902195192626, -0.0449312422976873, -0.031176117611179777 ], [ -1.273660365116559, -1.294767380815254, -1.3137755308725392, -1.3304518722301095, -1.344569950562437, -1.355913644304504, -1.3642811339035459, -1.369488889351357, -1.3713755576157198, -1.3698056258390992, -1.3646727371923195, -1.355902544560271, -1.343455002563171, -1.3273260197680998, -1.3075484186076651, -1.284192178283412, -1.257363963386115, -1.227205965860982, -1.193894108510931, -1.1576356734120665, -1.1186664281856613, -1.077247327588406, -1.0336608685149808, -0.9882071747558154, -0.9411998852431581, -0.8929619173032679, -0.8438211753714838, -0.7941062758771128, -0.7441423601356585, -0.6942470682135728, -0.64472674674023, -0.5958729614441929, -0.5479593799641471, -0.5012390818456891, -0.4559423407135482, -0.41227490901919694, -0.37041681948716254, -0.3305217006018204, -0.2927165873914276, -0.25710219444006077, -0.2237536063008856, -0.1927213317924662, -0.16403266320949983, -0.1376932791595994, -0.11368903021291288, -0.09198784933824333, -0.07254173364194161, -0.05528874966310493, -0.04015502089544554, -0.027056662864279435 ], [ -1.2289571128221009, -1.2484970623196194, -1.2660117099584343, -1.2812840917025392, -1.29410381876349, -1.3042706004045812, -1.3115978659447194, -1.3159163910647713, -1.3170778244003893, -1.314958006128404, -1.3094599716239088, -1.3005165406096602, -1.2880924052863711, -1.2721856488653664, -1.2528286473338976, -1.2300883304084524, -1.2040658005774298, -1.1748953301360459, -1.1427427737845808, -1.1078034478640273, -1.0702995364479078, -1.0304770897087154, -0.9886026821156391, -0.9449597982390548, -0.8998450133931306, -0.8535640359801306, -0.8064276787564191, -0.758747827389262, -0.710833476219262, -0.6629869023324584, -0.6155000489506455, -0.5686511868727969, -0.5227019175803908, -0.47789457336341234, -0.4344500585765081, -0.3925661624541885, -0.35241635867801324, -0.31414909115345213, -0.2778875303019286, -0.2437297705741024, -0.2117494285967082, -0.18199659285793823, -0.15449907030815924, -0.1292638726356996, -0.10627888499357274, -0.08551466218004655, -0.0669263012163106, -0.05045534440516031, -0.03603167281628905, -0.02357535631180152 ], [ -1.1847080943870762, -1.2027413165589114, -1.2188237717228265, -1.2327537207577144, -1.2443360241877177, -1.2533853667338488, -1.2597295596612261, -1.2632128368436741, -1.2636990531887509, -1.2610746908933108, -1.2552515805285145, -1.2461692503920085, -1.2337968286632937, -1.2181344379390024, -1.1992140395843083, -1.1770997046188176, -1.15188730706853, -1.1237036534792497, -1.0927050775140177, -1.0590755405931433, -1.0230242882157008, -0.984783117227893, -0.9446033125372543, -0.9027523134694412, -0.8595101709885443, -0.8151658580407923, -0.770013496712168, -0.7243485677123864, -0.6784641695446909, -0.6326473959515533, -0.5871759000677492, -0.5423147114323851, -0.4983133670770339, -0.4554034101019634, -0.4137962986293957, -0.37368175528679215, -0.33522657320512916, -0.2985738798569062, -0.2638428458754243, -0.2311288131693422, -0.2005038058713613, -0.17201737939524409, -0.14569775732767287, -0.12155320301886519, -0.09957357233423259, -0.07973199572570477, -0.06198664113500385, -0.04628251378909143, -0.03255325424847144, -0.020722901733733368 ], [ -1.141066755286754, -1.1576568306758648, -1.1723712060927232, -1.1850226015042284, -1.195430307955938, -1.2034231361139374, -1.208842425090692, -1.2115450371400487, -1.211406257981393, -1.2083225201578869, -1.2022138683896906, -1.1930260914764068, -1.180732454698592, -1.165334979270709, -1.1468652303032028, -1.1253845908332836, -1.100984015612093, -1.0737832734106532, -1.043929699779921, -1.0115964929548724, -0.9769805937894638, -0.940300196462782, -0.9017919406945133, -0.861707838981687, -0.8203119945494721, -0.7778771677853784, -0.7346812511421937, -0.6910037147966989, -0.6471220874015018, -0.6033085375178914, -0.5598266211271494, -0.5169282583882996, -0.4748509981185396, -0.4338156211618398, -0.39402412403813736, -0.355658112484868, -0.3188776214063129, -0.2838203641666961, -0.2506014009636873, -0.21931320399208043, -0.19002608689142064, -0.16278895800123894, -0.1376303514351973, -0.11455968693203755, -0.09356870867007905, -0.07463305443610113, -0.05771390933368625, -0.04275970218639524, -0.02970780753537472, -0.018486221288570803 ], [ -1.0981700648910733, -1.113382913446107, -1.1267952572066715, -1.138233507391423, -1.1475305731410161, -1.1545285553368885, -1.1590814864467294, -1.16105805057485, -1.1603442132139445, -1.1568456884392013, -1.1504901727821266, -1.1412292798418824, -1.1290401176244387, -1.1139264611539532, -1.0959194853521554, -1.0750780366558588, -1.0514884354225862, -1.0252638140170602, -0.9965430069140676, -0.9654890187886124, -0.9322871042712888, -0.8971424989733084, -0.8602778458826311, -0.8219303647570066, -0.7823488151406954, -0.7417903064429279, -0.7005170112784707, -0.6587928408918047, -0.6168801436571213, -0.5750364888972153, -0.5335115980633535, -0.49254448317926536, -0.452360848040682, -0.41317080086954394, -0.37516691810421765, -0.33852268817253783, -0.30339135205380074, -0.26990514492347806, -0.2381749309562089, -0.20829021214833854, -0.18031948239323337, -0.1543108904085011, -0.1302931696887656, -0.10827679046751748, -0.08825528758301748, -0.07020671890063879, -0.054095211214600925, -0.03987255396985967, -0.027479805347174535, -0.01684887990942796 ], [ -1.0561389564806118, -1.0700420299248072, -1.0822195537563408, -1.092510868545875, -1.100761702593246, -1.1068266312024437, -1.1105715704291468, -1.1118762470929566, -1.1106365830618148, -1.106766930495168, -1.1002020961159498, -1.090899096707152, -1.0788385947113353, -1.064025971649663, -1.0464920074937543, -1.0262931454287574, -1.0035113329219023, -0.9782534409995943, -0.9506502736196694, -0.9208551876805784, -0.8890423514299232, -0.8554046749158941, -0.820151450912932, -0.7835057487676905, -0.7457016071618622, -0.7069810750899649, -0.6675911534646453, -0.6277806925729407, -0.5877973028295422, -0.5478843375071883, -0.5082780059272276, -0.4692046735718639, -0.43087840147041456, -0.3934987709452811, -0.35724903153062415, -0.32229459996292376, -0.2887819271261548, -0.25683773835994106, -0.2265686412836403, -0.19806108488599738, -0.17138164460574, -0.1465776008634403, -0.12367777321116824, -0.1026935689919255, -0.08362020404820514, -0.06643805337943398, -0.05111409143723611, -0.03760338464537272, -0.02585060241376569, -0.015791517081011897 ], [ -1.0150789028425697, -1.0277404683989717, -1.0387508674395338, -1.0479616203198114, -1.0552304946296487, -1.060423748907646, -1.0634184015065127, -1.064104473129208, -1.0623871484739182, -1.058188801416164, -1.051450829398064, -1.0421352462048084, -1.0302259879283113, -1.0157298943231388, -0.9986773364913826, -0.9791224713482066, -0.957143113057542, -0.9328402210738169, -0.9063370131749718, -0.8777777196660055, -0.8473260016757036, -0.8151630622167665, -0.7814854835955192, -0.7465028290577782, -0.7104350504437293, -0.6735097472216232, -0.6359593255835037, -0.5980181091825891, -0.5599194553130384, -0.5218929315349105, -0.48416160756373083, -0.44693951535635545, -0.41042932652854425, -0.37482029049328125, -0.34028646915823824, -0.3069852949911902, -0.27505646922597804, -0.24462120650440522, -0.2157818219266151, -0.18862164687588445, -0.16320525156886134, -0.13957894540931493, -0.11777152110003553, -0.09779520515642726, -0.07964677590141189, -0.0633088100359076, -0.0487510202334589, -0.035931648623649615, -0.02479888422033172, -0.01529227604485417 ], [ -0.9750805965242307, -0.9865691075144634, -0.9964799664014617, -1.004676141147109, -1.0110266820949834, -1.0154087678719337, -1.0177097689535448, -1.017829283346138, -1.0156810963063465, -1.0111950152299611, -1.0043185319299281, -0.9950182674939203, -0.9832811596328155, -0.9691153586421271, -0.9525508054353797, -0.9336394731463227, -0.9124552620965606, -0.8890935460855449, -0.8636703756612746, -0.8363213510641795, -0.8072001838166646, -0.7764769714796973, -0.7443362150181705, -0.7109746126440479, -0.6765986680617873, -0.6414221547818675, -0.6056634815604383, -0.5695430069254338, -0.5332803529269079, -0.4970917694080589, -0.4611875999291274, -0.42576989873132376, -0.3910302446449424, -0.3571477926050246, -0.32428759657739514, -0.2925992295069779, -0.2622157167925795, -0.23325279026232815, -0.20580846019382026, -0.17996289408978816, -0.155778583109783, -0.13330077059243806, -0.11255811218070177, -0.0935635337583477, -0.0763152516803044, -0.06079791949999258, -0.04698386636417773, -0.0348343942219671, -0.0243011037282157, -0.015327221968886695 ], [ -0.9362207078979795, -0.9466042559497793, -0.955482535437053, -0.962729251050578, -0.9682240058557406, -0.9718541658909483, -0.9735167364444002, -0.9731202096862978, -0.9705863412332498, -0.9658518125869832, -0.9588697373236376, -0.9496109714127685, -0.9380651920085701, -0.924241714272525, -0.9081700219702732, -0.8898999944028712, -0.8695018193404936, -0.8470655887107643, -0.8227005806015061, -0.7965342374981386, -0.7687108565091441, -0.7393900126377282, -0.7087447409891395, -0.6769595082372942, -0.644228007771678, -0.6107508167157059, -0.5767329563881741, -0.5423814006268681, -0.507902578496591, -0.47349991901020194, -0.4393714853489099, -0.40570774446865054, -0.37268951480300316, -0.34048613001600836, -0.3092538505497602, -0.2791345473082767, -0.25025467358257913, -0.22272453268325332, -0.19663784016284214, -0.17207157141931273, -0.1490860782536111, -0.12772545190217555, -0.10801810536851009, -0.08997754461807328, -0.07360329635958429, -0.05888195961168008, -0.04578834888269667, -0.03428669837123821, -0.024331898907397287, -0.015870742183074382 ], [ -0.8985626980310981, -0.9079085411781724, -0.9158201391945793, -0.922181246872119, -0.9268813187370304, -0.9298172076423621, -0.9308948702775248, -0.930031043869117, -0.9271548565858764, -0.9222093336335104, -0.915152761812739, -0.9059598774145601, -0.8946228456540775, -0.8811520042349331, -0.8655763488655797, -0.8479437443562206, -0.8283208510424304, -0.806792762461493, -0.7834623562482328, -0.7584493659778627, -0.7318891870881488, -0.7039314350431023, -0.6747382785752383, -0.6444825751949477, -0.6133458401999067, -0.5815160841308633, -0.549185556921525, -0.5165484397392779, -0.4837985275202956, -0.45112694625068306, -0.41871994892557507, -0.38675683266295613, -0.3554080165673559, -0.3248333156384703, -0.2951804404215199, -0.26658374542590546, -0.23916324191290061, -0.21302388284643514, -0.1882551200122744, -0.16493072592519664, -0.14310886649854193, -0.12283240481206192, -0.10412941185984237, -0.08701385697609831, -0.07148644872145415, -0.05753559628980831, -0.04513846183350312, -0.03426207533197889, -0.024864485558180327, -0.016895923137541846 ], [ -0.8621576668810722, -0.8705318276378003, -0.8775412086192608, -0.8830789544837073, -0.8870437002541417, -0.8893411180336982, -0.8898854668724177, -0.8886011141033163, -0.8854239949721947, -0.8803029769331471, -0.8732010956345377, -0.8640966313777503, -0.8529839976259246, -0.8398744168444959, -0.8247963633943203, -0.8077957581683641, -0.7889359049537503, -0.7682971639174705, -0.7459763629934644, -0.7220859531727561, -0.6967529186946676, -0.6701174578738306, -0.642331454768564, -0.6135567661004413, -0.5839633517581411, -0.5537272808128093, -0.5230286481472761, -0.4920494394215895, -0.460971383993137, -0.42997383639609066, -0.39923172688719877, -0.3689136202495228, -0.3391799194434113, -0.3101812468215497, -0.2820570305925928, -0.2549343182255809, -0.2289268318103851, -0.20413427335404466, -0.18064188094568, -0.1585202300016746, -0.13782526770674997, -0.11859856353566911, -0.10086775453987207, -0.08464716100096759, -0.06993854609995953, -0.056731992373128204, -0.04500686781637797, -0.03473285541818738, -0.025871021485821544, -0.018374900214504608 ], [ -0.8270452205143992, -0.8345121479921223, -0.8406820343969852, -0.8454567818905294, -0.8487435662499256, -0.8504562447246077, -0.8505167640857286, -0.8488565407440193, -0.845417783531206, -0.8401547293396019, -0.833034762346702, -0.8240393890184345, -0.813165043434896, -0.8004237006172394, -0.7858432793181054, -0.7694678200116141, -0.7513574284175921, -0.7315879796628794, -0.7102505829881054, -0.687450811649833, -0.6633077072766806, -0.6379525723725699, -0.6115275688955822, -0.5841841448537399, -0.5560813146130253, -0.5273838220456597, -0.49826021866272907, -0.4688808913472996, -0.4394160760806187, -0.41003389497658516, -0.38089845386353427, -0.35216803646931005, -0.3239934289253855, -0.29651640482974084, -0.2698683965973173, -0.24416937345706036, -0.21952694046563592, -0.19603566658267113, -0.1737766434925495, -0.1528172707585307, -0.13321125732048122, -0.11499882451322951, -0.09820709184165977, -0.0828506237877602, -0.06893211396514842, -0.05644318194140241, -0.04536525793444901, -0.035670531239532455, -0.027322939521489564, -0.02027917786947464 ], [ -0.7932543438608826, -0.7998766341102153, -0.8052677542165616, -0.8093377602849249, -0.8120017607659997, -0.8131811974262249, -0.8128051242054216, -0.8108114589690547, -0.8071481820530204, -0.8017744551349351, -0.794661634392791, -0.7857941531336068, -0.7751702510541572, -0.762802529957411, -0.7487183189873352, -0.7329598361371186, -0.7155841368016551, -0.6966628443597298, -0.6762816620757155, -0.6545396699168992, -0.631548414124841, -0.6074308015099309, -0.5823198144193675, -0.556357066121382, -0.5296912199021137, -0.5024762984148887, -0.4748699126591178, -0.4470314422784861, -0.4191202005218224, -0.39129361806856844, -0.3637054798644547, -0.3365042480543645, -0.3098315020023559, -0.2838205232776474, -0.258595049451969, -0.23426821575250212, -0.2109416982541611, -0.18870506662046593, -0.16763534867558982, -0.14779680356881475, -0.1292408952096844, -0.11200645319993985, -0.09612000480783334, -0.08159625870586484, -0.06843871925274159, -0.05664040902156775, -0.04618467699526607, -0.03704607027114348, -0.029191248125117975, -0.022579918758659057 ], [ -0.760804267971822, -0.7666424369454268, -0.771313323291859, -0.7747345627900861, -0.7768286201989016, -0.777523954335098, -0.7767561792615614, -0.7744691993511744, -0.7706162950221045, -0.7651611356032364, -0.7580786961247489, -0.7493560558454556, -0.738993057999063, -0.7270028125096045, -0.7134120262113028, -0.6982611483133578, -0.6816043223725612, -0.6635091397755448, -0.6440561935966895, -0.6233384356099483, -0.6014603431303384, -0.5785369061915371, -0.5546924492840126, -0.530059305433813, -0.504776363736737, -0.4789875145007537, -0.45284001879763025, -0.42648283137334153, -0.40006490739728173, -0.3737335243264146, -0.3476326501217636, -0.3219013881119508, -0.29667252692515933, -0.272071221133797, -0.2482138246575184, -0.22520689468591726, -0.20314637909340905, -0.18211699523758462, -0.16219180288599455, -0.1434319690292788, -0.125886717715459, -0.10959345395291853, -0.09457804730637243, -0.08085525813232164, -0.06842928750065136, -0.05729443071619578, -0.0474358139397566, -0.03883019363566076, -0.03144679934660055, -0.025248201510906565 ], [ -0.7297053228672168, -0.7348176266686983, -0.7388244598095757, -0.7416504928904244, -0.7432250020740498, -0.7434829283580107, -0.7423659316050244, -0.7398234195300096, -0.7358135309866765, -0.7303040525806461, -0.7232732478960213, -0.7147105794675472, -0.7046173050442324, -0.693006931630477, -0.6799055131961456, -0.6653517807419995, -0.649397096509233, -0.6321052274494317, -0.6135519365466899, -0.5938243941382797, -0.5730204149540282, -0.5512475301336952, -0.5286219069345856, -0.5052671321533908, -0.4813128783930719, -0.45689347513128964, -0.43214640900240486, -0.40721077968985775, -0.3822257392359174, -0.35732894331107534, -0.33265504296291915, -0.3083342445277636, -0.28449096372016536, -0.2612425974419732, -0.23869843364823595, -0.21695871579096593, -0.19611387409054992, -0.1762439313422115, -0.15741808634832566, -0.13969447357154507, -0.12312009340872299, -0.10773090374356575, -0.09355206026421503, -0.08059829050679101, -0.06887438474355845, -0.058375785671986424, -0.04908925834366662, -0.040993621838505856, -0.034060524760829436, -0.02825524762074405 ], [ -0.6999597688607837, -0.7044020662535975, -0.7077985588349724, -0.7100804364291309, -0.7111832726640801, -0.7110479876842912, -0.7096218046118452, -0.7068591821030257, -0.7027227045869353, -0.697183911474412, -0.690224046821817, -0.6818347116373863, -0.6720184022175948, -0.6607889195675485, -0.6481716370461166, -0.6342036158240634, -0.6189335604860834, -0.6024216100772256, -0.584738963024531, -0.5659673375940059, -0.5461982728142346, -0.5255322780564609, -0.5040778426530952, -0.481950320003915, -0.4592707034967187, -0.4361643141823177, -0.4127594224079778, -0.3891858274387797, -0.36557342039035845, -0.34205075647408045, -0.31874366254738473, -0.2957739052227705, -0.27325794330714037, -0.2513057861449651, -0.23001997659036655, -0.2094947139390826, -0.1898151283471914, -0.17105671420884205, -0.15328492582993147, -0.13655493468900237, -0.12091154377748259, -0.10638925109448638, -0.09301245144214132, -0.08079576329799099, -0.06974446576867699, -0.05985502945803223, -0.051115724488424386, -0.04350728884859745, -0.03700364063987638, -0.03157261857983418 ], [ -0.6715626007730916, -0.6753882532510578, -0.6782255697599533, -0.6800117726099391, -0.680688249235566, -0.6802014268192097, -0.6785036399289792, -0.6755539754174984, -0.6713190781485281, -0.6657739008356932, -0.6589023814220916, -0.650698032014811, -0.6411644244101498, -0.6303155586828052, -0.6181761031301511, -0.6047814960146972, -0.5901779019803277, -0.5744220186742707, -0.5575807319292422, -0.5397306207932157, -0.5209573166831686, -0.5013547239306092, -0.481024111925644, -0.4600730918942775, -0.43861449399551966, -0.41676516282959086, -0.3946446915274595, -0.3723741162637414, -0.3500745942189267, -0.32786608863993605, -0.30586608465202436, -0.28418835882420035, -0.26294182417735246, -0.2422294703742197, -0.22214741630251078, -0.20278408924775104, -0.18421954146890818, -0.16652491137494307, -0.14976203280162392, -0.1339831922523821, -0.11923103053310502, -0.10553858209734546, -0.0929294427214612, -0.08141805391547563, -0.07101009078242715, -0.0617029388760959, -0.05348624495815857, -0.04634252638393743, -0.040247824098734286, -0.0351723848411194 ], [ -0.6445023207161953, -0.6477621257712812, -0.6500888336577144, -0.6514252407164189, -0.6517180939786533, -0.6509188854572563, -0.6489846389394727, -0.6458786752094914, -0.6415713410191175, -0.6360406868572994, -0.6292730786718665, -0.6212637291849452, -0.6120171353169137, -0.6015474094787565, -0.5898784940828651, -0.5770442505210513, -0.5630884160223965, -0.5480644241839462, -0.5320350875144951, -0.5150721429940035, -0.49725566437811075, -0.47867334771594816, -0.4594196792461108, -0.43959499743248764, -0.4193044633357007, -0.3986569557197587, -0.37776390919536285, -0.3567381152275989, -0.33569250691620733, -0.31473894902859956, -0.29398705478048137, -0.2735430502880626, -0.25350870645492674, -0.23398035632984315, -0.2150480137314611, -0.1967946062614192, -0.1792953328212804, -0.1626171525293888, -0.14681840862918982, -0.13194858771815632, -0.11804821152731149, -0.1051488556504564, -0.09327328714575667, -0.082435710871812, -0.07264211281320776, -0.06389068750925353, -0.05617233601515159, -0.04947122056925202, -0.04376536227109007, -0.039027268540727356 ], [ -0.6187616761915165, -0.6215038297459375, -0.6233658779568431, -0.6242957603012801, -0.6242451577033181, -0.6231702135945085, -0.6210322471399958, -0.6177984460496238, -0.6134425258446126, -0.6079453421972911, -0.6012954430311892, -0.5934895474766466, -0.5845329395268601, -0.574439765321918, -0.5632332243846597, -0.5509456468129762, -0.5376184503625046, -0.5233019734903097, -0.508055182729661, -0.49194525518162435, -0.47504703939298143, -0.4574424003914719, -0.43921945711643184, -0.42047172285928536, -0.40129716155483997, -0.38179717477736486, -0.3620755360296798, -0.3422372903035772, -0.3223876378737308, -0.3026308218118424, -0.28306903873163136, -0.2638013917763099, -0.24492290383596738, -0.22652360745554856, -0.20868772591105667, -0.19149295756176732, -0.17500987291781744, -0.15930143099860605, -0.14442261860778238, -0.1304202132267699, -0.1173326674354962, -0.10519011019977698, -0.09401445809606912, -0.08381962763317563, -0.07461183831281137, -0.06638999496190512, -0.05914613716525885, -0.05286594330713412, -0.04752927676127716, -0.043110762107800626 ], [ -0.594318361119158, -0.5965884454112036, -0.5980291667034043, -0.5985932034406254, -0.5982367722156229, -0.5969202820980295, -0.5946089809343862, -0.5912735823627762, -0.5868908617905839, -0.5814442093458347, -0.5749241278566359, -0.5673286642554891, -0.5586637634513154, -0.5489435346574553, -0.5381904213940397, -0.5264352678752443, -0.5137172762156808, -0.5000838508101845, -0.4855903283176535, -0.47029959386997955, -0.454281586386, -0.4376126981505116, -0.4203750760692643, -0.4026558341795775, -0.3845461890265687, -0.36614053134864744, -0.3475354490934802, -0.3288287180486691, -0.3101182772662161, -0.29150120694021586, -0.27307272642931524, -0.25492522968056575, -0.23714737440975808, -0.21982324004528186, -0.20303156768941277, -0.18684509325269683, -0.17132998255083132, -0.15654537460741558, -0.14254303677578528, -0.1293671326750745, -0.1170541014214933, -0.10563264430746833, -0.09512381300759531, -0.08554119162292984, -0.07689116344879576, -0.06917325228242643, -0.06238052737564437, -0.05650006077002456, -0.05151342570140427, -0.047397224992443254 ], [ -0.5711456781418546, -0.572986671664207, -0.5740468053765788, -0.574283118329754, -0.5736559909542104, -0.5721297386043563, -0.5696731969917093, -0.5662602894280476, -0.5618705653526186, -0.5564896993946076, -0.5501099402466606, -0.5427304989136518, -0.5343578664601084, -0.5250060522083114, -0.5146967344264509, -0.5034593168739113, -0.49133088611340014, -0.4783560662264216, -0.46458676944358346, -0.4500818431858389, -0.4349066160643722, -0.4191323474610438, -0.4028355873603672, -0.3860974550781441, -0.369002847378903, -0.35163958814056606, -0.3340975331566952, -0.3164676448124919, -0.29884105218338264, -0.2813081125450192, -0.26395749032221427, -0.24687526912701108, -0.23014411174377225, -0.21384248173077025, -0.19804393875927306, -0.18281651795522103, -0.16822220141154276, -0.15431648777762563, -0.14114806348884856, -0.12875857685697978, -0.11718251398159685, -0.1064471733359118, -0.09657273398821975, -0.0875724107903374, -0.07945268852929788, -0.07221362601563586, -0.0658492203741694, -0.06034782140169126, -0.0556925857403463, -0.05186196075751148 ], [ -0.5492131611476775, -0.5506654675309088, -0.5513831997923188, -0.551327404049267, -0.5504622780038391, -0.5487557091420572, -0.5461798048290444, -0.5427114052695515, -0.5383325698997603, -0.5330310275686716, -0.526800580877688, -0.5196414552912517, -0.5115605841176355, -0.5025718211878224, -0.4926960740242101, -0.4819613514747306, -0.47040272117047655, -0.458062173718496, -0.4449883922346243, -0.43123642761770653, -0.41686728182757704, -0.4019474033127277, -0.3865481005951581, -0.3707448818131447, -0.3546167296992876, -0.33824532298240695, -0.3217142164993909, -0.30510799334113514, -0.2885114030941175, -0.27200850064211823, -0.2556818000368405, -0.23961145761996971, -0.22387449788443414, -0.20854409451607114, -0.19368891769072782, -0.17937255706131505, -0.16565302801228465, -0.15258236675130932, -0.14020631772112424, -0.12856411472075657, -0.11768835509483055, -0.1076049644453505, -0.0983332475971288, -0.0898860200484165, -0.08226981289318969, -0.07548514322852529, -0.06952684136500054, -0.06438442573464132, -0.060042516224246834, -0.056481276729690055 ], [ -0.5284871574563555, -0.5295886504676922, -0.529999669096399, -0.5296849367798683, -0.528612146036039, -0.5267524462920291, -0.524080923685961, -0.5205770647459698, -0.5162251954863755, -0.5110148872687517, -0.5049413207758037, -0.4980055996541102, -0.4902150058063859, -0.4815831889572185, -0.4721302839726067, -0.4618829504710964, -0.4508743305043499, -0.43914392148345605, -0.42673736305558363, -0.413706138260616, -0.40010719098338277, -0.38600246342468847, -0.371458359002776, -0.35654513772253826, -0.34133625256913247, -0.3259076368508884, -0.3103369535905043, -0.29470281900295414, -0.2790840127672325, -0.2635586881681321, -0.24820359523308155, -0.23309332970825258, -0.21829962010989368, -0.20389066416659674, -0.18993052476369787, -0.17647859405206956, -0.16358913273991482, -0.15131088980486251, -0.13968680600641648, -0.1287538027085917, -0.11854265569984446, -0.10907795197846049, -0.10037812590415074, -0.0924555697400139, -0.08531681245149025, -0.07896275970817601, -0.07338898735738053, -0.06858608020251866, -0.06454000771389534, -0.061232528306272016 ], [ -0.5089313695346374, -0.509717451622575, -0.5098550132343425, -0.5093121481131879, -0.508059744079588, -0.5060719250368722, -0.5033264850821066, -0.4998053074604152, -0.4954947607728294, -0.4903860646708137, -0.48447561726406263, -0.47776527664668567, -0.4702625893193991, -0.46198095885480595, -0.45293974891550015, -0.4431643156805881, -0.43268596584929353, -0.4215418376494007, -0.40977470365697777, -0.3974326957028005, -0.38456895366616706, -0.3712412015028934, -0.35751125538296147, -0.3434444702849604, -0.3291091327689555, -0.3145758088865568, -0.29991665724821015, -0.28520471811711534, -0.27051319000549445, -0.25591470558695295, -0.24148061879126637, -0.22728031470719712, -0.21338055338756112, -0.199844857842442, -0.18673295544541046, -0.17410028069873051, -0.16199754584937898, -0.15047038426808768, -0.13955906985150024, -0.12929831403773562, -0.11971714039093684, -0.11083883515989479, -0.10268097079229643, -0.09525549812475032, -0.08856890189573441, -0.08262241336125098, -0.07741227313932308, -0.07293003696933642, -0.06916291683792686, -0.06609414988078388 ], [ -0.4905073564627145, -0.4910110285219249, -0.4909060356087076, -0.49016355641185794, -0.48875739631300974, -0.4866643877249558, -0.4838647827098206, -0.4803426313604532, -0.4760861391333082, -0.4710879961592388, -0.4653456715479003, -0.45886166585578636, -0.45164371521607194, -0.4437049411340316, -0.43506394063224885, -0.4257448122767856, -0.4157771146151902, -0.40519575469055735, -0.3940408055393161, -0.38235725290679556, -0.37019467279320506, -0.357606842840553, -0.34465129195320376, -0.33138879387503006, -0.3178828116880308, -0.30419890131455096, -0.2904040830635404, -0.27656619102893387, -0.2627532106977227, -0.2490326154351682, -0.2354707125699883, -0.22213200959709156, -0.2090786105521123, -0.19636965190266698, -0.1840607863676147, -0.17220372194713807, -0.16084582216086996, -0.15002977209082047, -0.13979331335700806, -0.130169049663437, -0.12118432308689908, -0.1128611598837419, -0.10521628329833055, -0.09826118970307474, -0.0920022834077534, -0.08644106466199497, -0.08157436474809276, -0.07739462162314725, -0.07389018931508162, -0.07104567419567287 ] ], "zauto": true, "zmax": 2.2304035218779656, "zmin": -2.2304035218779656 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.3445600354486937, 0.33320846752873706, 0.3222787036267094, 0.3118855511942022, 0.30214910292181646, 0.29319352613832345, 0.28514499037759183, 0.27812833429048095, 0.2722621405091984, 0.2676521249791645, 0.26438316818969265, 0.2625108464999039, 0.2620537903537934, 0.2629883816838665, 0.2652470483589592, 0.2687207404195373, 0.2732653028260196, 0.2787107072144303, 0.28487171009260454, 0.2915585233903173, 0.29858640375558276, 0.30578350820935507, 0.31299677223524996, 0.3200958614569851, 0.32697541627265164, 0.3335558753273596, 0.33978316514743095, 0.34562751173933615, 0.35108158745910656, 0.3561581653093691, 0.36088741843127614, 0.36531397628584894, 0.36949383032429683, 0.3734911696979752, 0.3773752206238846, 0.38121716035744957, 0.3850871771736437, 0.3890517497783106, 0.3931712210938557, 0.3974977399234392, 0.40207363718353667, 0.40693028950364524, 0.4120875016722061, 0.41755341202036667, 0.4233248943426414, 0.4293884003188159, 0.435721161668327, 0.44229265462448436, 0.4490662224311969, 0.45600075438179544 ], [ 0.3438633267632732, 0.3323245653372348, 0.321181871611852, 0.31055119150960264, 0.3005552117007057, 0.2913223092732204, 0.2829844934925399, 0.2756738761489244, 0.26951729097669463, 0.26462896314365053, 0.26110161966172846, 0.25899704268876667, 0.2583375958498836, 0.25910044020313117, 0.2612158259368861, 0.26457004119732613, 0.2690125986337065, 0.2743664150837451, 0.28043935189713987, 0.2870355684475771, 0.29396554600368646, 0.30105414713013456, 0.30814651949474275, 0.31511195532786596, 0.3218459766366289, 0.3282709675605481, 0.3343356624360132, 0.34001375623693725, 0.3453018554153007, 0.35021694324549096, 0.354793498798526, 0.3590803829135777, 0.36313758665216095, 0.3670329260880421, 0.37083876055004544, 0.37462880853455643, 0.37847513538185684, 0.3824453880486539, 0.38660035292079303, 0.3909919101455257, 0.395661449980865, 0.4006388014443609, 0.4059417008064367, 0.4115757987387382, 0.4175351733938176, 0.4238032865547263, 0.430354295441612, 0.4371546169872461, 0.4441646359199495, 0.45134045251583027 ], [ 0.3442192749736875, 0.33256660901177476, 0.3212858826872265, 0.31049345528229233, 0.3003136305755927, 0.29087771743456525, 0.28232195203971405, 0.27478377129104603, 0.26839602958333714, 0.26327907046618726, 0.2595311111805577, 0.2572180688894239, 0.25636452138437754, 0.2569476658382427, 0.2588957336259492, 0.2620914057455868, 0.2663796785240152, 0.27157876580551127, 0.27749226095574975, 0.28392093050848083, 0.29067298223507887, 0.2975722034896057, 0.30446382742224964, 0.3112182848619085, 0.3177331465919759, 0.3239335985303586, 0.32977176880497255, 0.3352251771977245, 0.3402945258224804, 0.34500100559183916, 0.3493832590892434, 0.3534941162247647, 0.35739720249492074, 0.36116350876450476, 0.36486800474424597, 0.3685863747502093, 0.3723919530264402, 0.37635293569766964, 0.3805299454917923, 0.3849740213925054, 0.38972509595636745, 0.3948110064694343, 0.4002470622033707, 0.4060361604061316, 0.4121694116807298, 0.4186272053906357, 0.425380621910577, 0.43239308402408916, 0.4396221358887201, 0.44702124419437544 ], [ 0.3456008633440858, 0.3339095172012231, 0.32256856799050104, 0.3116941393738782, 0.30141119499971897, 0.2918526389889379, 0.2831571666418925, 0.2754653319257427, 0.2689134226991988, 0.26362508750026853, 0.2597012432008109, 0.2572094939400308, 0.25617485886131175, 0.25657374109632747, 0.2583325969939269, 0.26133177893519494, 0.2654138872159736, 0.27039510611897033, 0.27607767642011777, 0.28226185642752105, 0.28875623417020924, 0.2953858245776573, 0.30199784697277754, 0.30846536823798426, 0.31468913163911216, 0.32059791919522385, 0.3261477660220427, 0.33132029428856014, 0.3361203832200571, 0.34057334923380017, 0.34472177891820877, 0.34862213573877693, 0.35234124652645543, 0.35595276365081185, 0.3595336917301797, 0.3631610629119247, 0.36690884156938564, 0.3708451368464341, 0.3750297983384831, 0.37951246421192075, 0.384331119967977, 0.38951120823572377, 0.3950653052586795, 0.4009933498195456, 0.40728337862281017, 0.4139126929468482, 0.42084935883456553, 0.42805393015930093, 0.4354812816976789, 0.4430824470895341 ], [ 0.3479620853569409, 0.3363067060283529, 0.32498340000394654, 0.31410746315658616, 0.30380358331942214, 0.2942048995920697, 0.28545072352854056, 0.2776823930420292, 0.27103687877124616, 0.2656381418100048, 0.261586844741269, 0.25894971525280114, 0.257750396312274, 0.25796369736086805, 0.259514633331156, 0.26228262549135684, 0.26611011347501634, 0.27081401128623483, 0.2761981667636664, 0.28206521709795657, 0.2882267527072817, 0.2945112636705917, 0.30076978721472547, 0.3068794484609415, 0.31274521004239103, 0.3183001686229952, 0.3235047059574408, 0.3283447533612638, 0.3328293808351163, 0.3369878838627466, 0.3408665134543405, 0.3445249763691254, 0.34803281968596983, 0.35146580445205494, 0.3549023654397183, 0.3584202474030563, 0.3620934024166649, 0.3659892274907484, 0.37016621563001, 0.37467208506484795, 0.37954243848398683, 0.3847999852196622, 0.3904543343176556, 0.3965023369168274, 0.4029289256650294, 0.40970837118507186, 0.41680585482832444, 0.4241792458337418, 0.43178097044452396, 0.4395598695783935 ], [ 0.35124024140098636, 0.3396925037846382, 0.32846199040185725, 0.3176626048719563, 0.30741783854565197, 0.29785971081099344, 0.28912631082912305, 0.2813574429713037, 0.27468805239799243, 0.26923950291474613, 0.2651093765644558, 0.262361124507616, 0.2610153696929627, 0.2610446761992828, 0.26237303794826977, 0.2648803455127597, 0.2684110293474251, 0.2727853374359712, 0.2778114848124655, 0.2832971589446912, 0.28905936581321706, 0.2949321305204931, 0.30077197977578346, 0.30646138665301853, 0.3119104717457435, 0.3170572758265204, 0.3218668921567435, 0.32632970348927565, 0.33045892744755584, 0.33428764168760516, 0.33786543789366297, 0.34125483888306934, 0.3445276026768139, 0.3477610286176829, 0.3510343719239204, 0.35442546403034, 0.3580076269208673, 0.36184696056897653, 0.36600007309600013, 0.3705123120272137, 0.37541654031801136, 0.38073248122639347, 0.3864666314086496, 0.39261271329223857, 0.39915260888237813, 0.4060576915685094, 0.4132904538693097, 0.42080631984591366, 0.428555531827844, 0.4364850110913024 ], [ 0.3553588360288232, 0.34398534517312845, 0.33291760347376886, 0.322267559126233, 0.3121565974728896, 0.3027142997848236, 0.2940757756909072, 0.2863771266830755, 0.27974879511622797, 0.2743069532040264, 0.2701436554653776, 0.26731707299845836, 0.2658435137686885, 0.26569287974835537, 0.2667886384919648, 0.26901245145553243, 0.2722126430572904, 0.2762150500751744, 0.2808346205345271, 0.2858863734776259, 0.29119479161723827, 0.29660119826870607, 0.3019690435163101, 0.30718725428299876, 0.31217190829138014, 0.31686651436744456, 0.32124116110926054, 0.32529076112519534, 0.3290325849190995, 0.33250325354682964, 0.3357553428177133, 0.33885374144943614, 0.34187189774930204, 0.34488808123689424, 0.34798177562953625, 0.35123030766844254, 0.35470580315697775, 0.3584725481940913, 0.36258482015358023, 0.36708523876111915, 0.37200367125465883, 0.3773567057612546, 0.383147683328714, 0.3893672526828504, 0.39599438538505216, 0.4029977661013719, 0.41033745644815545, 0.4179667235364477, 0.4258339264624077, 0.43388436452787427 ], [ 0.36023081620136554, 0.3490914359468014, 0.33824931529796254, 0.32781387121821404, 0.3179034917389678, 0.3086440744271683, 0.3001661466941482, 0.292600198122234, 0.28607006896172416, 0.28068462992677545, 0.27652850957736597, 0.27365313644174327, 0.27206965484499207, 0.2717451604989395, 0.27260314136514985, 0.2745281617181879, 0.27737399239891947, 0.28097384819635607, 0.28515126609157965, 0.28973038277001667, 0.29454477722601524, 0.29944446503077105, 0.30430095987284966, 0.3090105231559162, 0.31349582008442733, 0.3177062261463895, 0.32161701565181894, 0.3252276388913134, 0.32855927071868324, 0.3316517965773586, 0.334560392239489, 0.33735184794633766, 0.3401007825499742, 0.3428858856687974, 0.3457863143351486, 0.3488783553748994, 0.3522324472458632, 0.35591063697841835, 0.3599645302779107, 0.3644337757100746, 0.369345106176619, 0.3747119413303336, 0.380534532577627, 0.3868006085926351, 0.39348645592719866, 0.40055834928944145, 0.4079742322580622, 0.41568554354071685, 0.4236390868659054, 0.43177885323985465 ], [ 0.36576190204721476, 0.3549085795540821, 0.3443464315150378, 0.3341817579368809, 0.3245290968448503, 0.31550953096112955, 0.3072476208897786, 0.2998666776174391, 0.2934823097015498, 0.2881945492933931, 0.2840793204734387, 0.28118043166383166, 0.279503474553345, 0.27901285441638085, 0.27963264944417693, 0.2812512532382277, 0.2837290488837085, 0.2869079191219557, 0.2906213043079848, 0.2947037187282068, 0.2989989849122695, 0.30336680536572963, 0.30768757504709826, 0.3118655186456357, 0.3158303269997146, 0.3195374958414385, 0.3229675663350073, 0.3261244518476268, 0.32903302131497913, 0.33173610122445074, 0.3342910553065407, 0.3367661003695086, 0.3392365144132547, 0.34178088607708734, 0.3444775412400468, 0.34740126384132197, 0.35062040586127785, 0.3541944585103044, 0.35817213498968575, 0.3625899953697803, 0.3674716255250922, 0.3728273633901916, 0.3786545461082838, 0.3849382310925053, 0.3916523240824394, 0.3987610303316432, 0.40622053358024574, 0.41398080319545155, 0.4219874333003929, 0.43018342803717297 ], [ 0.3718538000410829, 0.36132989729207926, 0.35109281629160016, 0.3412451621334264, 0.3318968388902697, 0.3231631390896726, 0.3151615378982869, 0.308006989419348, 0.3018057441839795, 0.2966480426241997, 0.29260042928588276, 0.28969875923236427, 0.2879430889968492, 0.2872954597731597, 0.28768110144865333, 0.28899295161950156, 0.2910988014058084, 0.29385002334527177, 0.29709076925311223, 0.3006666953260978, 0.3044325631821489, 0.30825836690488945, 0.3120338771657795, 0.31567165091675436, 0.31910863819991125, 0.32230654942113596, 0.3252511506818827, 0.32795064929289147, 0.33043332682042975, 0.3327445768573988, 0.3349435084102843, 0.33709927991814176, 0.3392873292877456, 0.3415856586483471, 0.3440713175184301, 0.3468172057998858, 0.3498892913586741, 0.353344309462387, 0.3572279859206711, 0.3615738037600618, 0.36640231432747516, 0.3717209764820438, 0.377524490620986, 0.38379557721115726, 0.3905061330624023, 0.3976186845909125, 0.4050880478905098, 0.41286310217220323, 0.42088858662349543, 0.4291068403776856 ], [ 0.37840714113242996, 0.368247236359311, 0.3583708616466714, 0.3488763839165823, 0.33986839102819183, 0.3314555996852642, 0.3237475737537247, 0.31685013005851, 0.31085952058121846, 0.3058557752568337, 0.3018959089959435, 0.29900793979175616, 0.29718672178427213, 0.2963924018858773, 0.29655188605108324, 0.29756317184581604, 0.2993019322030035, 0.3016294524616222, 0.30440097312665704, 0.3074736303863653, 0.3107134246211703, 0.31400089551271293, 0.31723538442600546, 0.320337900677434, 0.3232526842783923, 0.3259475917302776, 0.32841344257766963, 0.33066246746262595, 0.33272600206003067, 0.33465157857558137, 0.3364995762454715, 0.33833960074027813, 0.3402467651005629, 0.3422980383937972, 0.34456881151515345, 0.34712980396404713, 0.35004440464312914, 0.35336650819946075, 0.3571388799167843, 0.36139205863159585, 0.36614378848434237, 0.3713989549867365, 0.377149987016193, 0.3833776728011389, 0.3900523248759636, 0.3971352176519965, 0.40458021348171513, 0.4123354904414158, 0.42034528823338396, 0.42855159726920744 ], [ 0.3853240417334978, 0.37555413041739044, 0.3660649175995443, 0.3569500525673454, 0.34830825487565775, 0.3402410902567592, 0.33284968206166854, 0.32623030501420186, 0.3204690029285945, 0.31563562346467555, 0.31177791586156006, 0.3089165097173038, 0.3070416027856428, 0.30611199315358256, 0.3060567276660876, 0.30677920443141016, 0.3081631900621652, 0.3100799895350611, 0.3123959686880382, 0.31497974116396954, 0.3177085229287769, 0.3204733595632324, 0.3231830993587505, 0.3257671019045059, 0.3281767410114861, 0.3303857961479871, 0.3323898433009933, 0.3342047663961731, 0.335864521245264, 0.3374182976947863, 0.3389272405733944, 0.3404609021271984, 0.34209360323100413, 0.34390087426587557, 0.3459561281477979, 0.3483276895254586, 0.3510762699562688, 0.354252944174632, 0.35789765187174133, 0.3620382251482027, 0.3666899240040335, 0.37185544912057406, 0.3775253903985059, 0.3836790594903353, 0.39028564445835345, 0.3973056155558123, 0.40469230456204097, 0.4123935776545492, 0.42035352435487494, 0.42851409256681655 ], [ 0.39251023563120063, 0.3831482430111716, 0.3740640915676588, 0.36534632239863823, 0.3570873836643231, 0.3493813304932196, 0.34232059620086874, 0.33599183851912046, 0.3304710376778766, 0.3258182309140521, 0.3220724617176935, 0.31924763702316766, 0.3173299635955804, 0.3162774541177083, 0.31602168695373933, 0.3164716524707957, 0.3175192199196908, 0.3190455837822425, 0.32092801826611483, 0.3230463558787052, 0.32528875742636587, 0.3275565034920641, 0.32976767584993055, 0.33185969694379797, 0.3337907582552061, 0.33554020428570486, 0.33710795995509224, 0.3385131052164322, 0.339791717359042, 0.34099412031720466, 0.34218169927484465, 0.34342345366993476, 0.3447924675670798, 0.3463624697900669, 0.3482046363825897, 0.35038475726394713, 0.3529608522741929, 0.35598128505134624, 0.3594833913705826, 0.3634926144409815, 0.3680221232337386, 0.3730728791669251, 0.37863410857426255, 0.3846841310605776, 0.3911914861781492, 0.39811629337546556, 0.40541177432722275, 0.41302586415053394, 0.4209028397138428, 0.42898489943718426 ], [ 0.3998767655748539, 0.3909332784886651, 0.38226439871459966, 0.37395327469145867, 0.36608583604027767, 0.3587484732827765, 0.3520249271158893, 0.34599243422436116, 0.3407173257583306, 0.33625044154088973, 0.3326228668196637, 0.3298425694550397, 0.32789247407804284, 0.32673034624531583, 0.3262906051141548, 0.3264879018678678, 0.32722206554984984, 0.3283838802035545, 0.32986113194780226, 0.3315444311319273, 0.3333324330554921, 0.33513621065447463, 0.33688264607819607, 0.3385167929789463, 0.34000321799720806, 0.3413263657379686, 0.34249001577141114, 0.34351592060585673, 0.3444417346883897, 0.345318367125531, 0.34620691260672987, 0.34717533153963315, 0.348295056876712, 0.3496376981610838, 0.35127199240067225, 0.3532611192444743, 0.35566045993278206, 0.3585158419318772, 0.36186227935722287, 0.3657231960859494, 0.3701101037998448, 0.3750226987788214, 0.3804493358909689, 0.3863678332314516, 0.39274655500220845, 0.3995457138155571, 0.40671882803557424, 0.4142142667138145, 0.4219768153741095, 0.42994920077015725 ], [ 0.4073412531855051, 0.39882038513081836, 0.3905702985569169, 0.38266857859878606, 0.375194540677421, 0.3682269407308308, 0.3618410289286462, 0.35610502420455425, 0.351076211917356, 0.34679699770363565, 0.34329135379897263, 0.3405621331202967, 0.33858967499891995, 0.3373319825070455, 0.3367265424423687, 0.33669363509638583, 0.3371407957227315, 0.33796798088788854, 0.33907297098229566, 0.34035658977660843, 0.3417274134248056, 0.34310574436408176, 0.344426718307762, 0.345642484705817, 0.34672345211900596, 0.3476586251348781, 0.3484550858002471, 0.3491366961005372, 0.34974212220967327, 0.35032230631952205, 0.35093753522671994, 0.3516542720839258, 0.3525419241662079, 0.35366971204343534, 0.3551037839499806, 0.3569046864705564, 0.35912526453294413, 0.3618090265910375, 0.3649889801544748, 0.36868692124545926, 0.3729131487064294, 0.3776665680059038, 0.38293514585121546, 0.3886966736130742, 0.3949197928684469, 0.4015652304875276, 0.4085871850062434, 0.4159348022924173, 0.42355367812977085, 0.4313873289149152 ], [ 0.4148287854678918, 0.40672910122109923, 0.3988956869346936, 0.39140050641698315, 0.3843163031164379, 0.37771438338057006, 0.37166186785596994, 0.36621850745238343, 0.36143326247258883, 0.35734094346585804, 0.35395928384352654, 0.3512868308541336, 0.34930198658981604, 0.3479634064765973, 0.3472117926618772, 0.3469729420843233, 0.3471617634435244, 0.3476868910879018, 0.3484555044225285, 0.34937799767413685, 0.350372215017592, 0.35136704740590197, 0.35230526303088544, 0.35314550465160954, 0.35386343295740874, 0.35445202923757474, 0.35492109815537976, 0.35529603696085343, 0.35561596350102687, 0.3559313216629156, 0.3563011066762482, 0.356789869716037, 0.357464667125549, 0.35839211157109296, 0.35963566064134483, 0.3612532461130889, 0.36329531001595017, 0.36580327813929336, 0.3688084729042575, 0.37233144810957064, 0.376381717497775, 0.38095784466860355, 0.3860478600238844, 0.3916299681810588, 0.3976735051603719, 0.40414009883078933, 0.41098497999671085, 0.41815838695348867, 0.4256070048546381, 0.43327538357142575 ], [ 0.4222724670929518, 0.4145879086497797, 0.40716442919583284, 0.4000684174020788, 0.39336620518554616, 0.3871219569484932, 0.38139513923466245, 0.3762376771678302, 0.37169098574113973, 0.36778313864331624, 0.36452648468932003, 0.3619160234550747, 0.3599287974777314, 0.35852445272515276, 0.35764698134391015, 0.35722752000789876, 0.35718796263109626, 0.3574450775478313, 0.35791480189429237, 0.3585164118768282, 0.35917632106827024, 0.3598313228889003, 0.36043115497518446, 0.36094031522401426, 0.36133910052082, 0.3616238718230598, 0.36180657716175757, 0.3619135906064781, 0.3619839519708148, 0.3620671183883571, 0.3622203621033777, 0.3625059648580665, 0.36298836418383124, 0.3637313984064745, 0.36479577569146904, 0.36623686141200534, 0.36810284310228353, 0.3704332993578264, 0.3732581730474851, 0.37659713229401454, 0.3804592941742762, 0.384843283180166, 0.3897375956112133, 0.3951212393142418, 0.40096461412557205, 0.4072305922521653, 0.4138757510995479, 0.42085170560815605, 0.4281064846017576, 0.4355858968430478 ], [ 0.42961369164037566, 0.42233446301787514, 0.41531052418624703, 0.40860282571732914, 0.4022715439255717, 0.3963740994062884, 0.3909628543812447, 0.3860825981869381, 0.38176799423970403, 0.37804121615361097, 0.37491003025137853, 0.3723665737069405, 0.37038702648742367, 0.36893228629468144, 0.36794964452697576, 0.3673753498262524, 0.3671378554079705, 0.36716149143371235, 0.3673702881627397, 0.3676916938694923, 0.36805997208953356, 0.3684191131095094, 0.3687251447802921, 0.36894777203049534, 0.36907131137771654, 0.3690949176610126, 0.36903212777316236, 0.36890977269875774, 0.3687663356362363, 0.3686498594787146, 0.3686155287668528, 0.3687230657305096, 0.3690340837806961, 0.3696095329805056, 0.37050735136018575, 0.37178040689360414, 0.3734747828258964, 0.37562842944929586, 0.378270182622144, 0.381419135081907, 0.38508434001174996, 0.38926482456156986, 0.39394989066535047, 0.39911967877901877, 0.40474596580920225, 0.41079316184583403, 0.4172194628473096, 0.42397811008306624, 0.43101870357111427, 0.43828851689016973 ], [ 0.43680218404099236, 0.42991556685792426, 0.42327798357136015, 0.41694515844750263, 0.41097144036003724, 0.40540796511460164, 0.40030058083280823, 0.3956876437122305, 0.3915978406215164, 0.388048233477305, 0.38504273706177, 0.38257122830886675, 0.38060943845279016, 0.37911970501535874, 0.3780525709276965, 0.37734912965192846, 0.37694394367104783, 0.37676831959445256, 0.37675370936076036, 0.37683501965852323, 0.37695364247676516, 0.3770600593880511, 0.37711591317187265, 0.3770954781398992, 0.3769864935234954, 0.3767903532422835, 0.3765216720012428, 0.3762072734781237, 0.375884671782954, 0.37560014128530395, 0.3754064897928324, 0.37536066268804785, 0.3755213081281789, 0.37594642446574267, 0.376691191659278, 0.37780606197531735, 0.37933515662582656, 0.3813149891457753, 0.38377351693738865, 0.38672951081706547, 0.3901922275127422, 0.3941613691171152, 0.39862731328530887, 0.40357159596140907, 0.40896762353913224, 0.4147815840452111, 0.42097351871221833, 0.4274985081166346, 0.434307922570926, 0.4413506856508081 ], [ 0.4437958622427275, 0.4372869460274207, 0.43102050080959725, 0.42504729414907655, 0.41941622591375266, 0.41417264133078635, 0.40935647783518625, 0.40500034769196586, 0.40112769533974857, 0.39775119473268233, 0.39487155961689424, 0.39247692309375776, 0.39054290109700207, 0.3890333924108512, 0.38790209548126103, 0.38709465194614334, 0.3865512700665564, 0.38620964571658456, 0.38600798653573165, 0.3858879535172554, 0.38579735776699287, 0.38569248161413244, 0.3855399269367004, 0.3853179258307253, 0.3850170781764212, 0.3846405074748864, 0.38420345155468133, 0.38373232924125283, 0.383263347842094, 0.38284073811705227, 0.38251472098849354, 0.38233932084231426, 0.3823701415906361, 0.38266221285967944, 0.3832679959252551, 0.38423561552475227, 0.3856073588126475, 0.3874184608231265, 0.38969617986131455, 0.39245915716456375, 0.3957170517413578, 0.39947044088065964, 0.4037109764844597, 0.40842178488848335, 0.4135780923252788, 0.4191480501902681, 0.4250937253447725, 0.431372212746987, 0.4379368224039267, 0.4447382909798339 ], [ 0.4505605600589763, 0.4444128805933976, 0.4385009716114051, 0.43287095496150735, 0.4275666906835674, 0.42262824164881724, 0.41809023038608406, 0.41398018272611997, 0.41031698008635004, 0.4071095593763038, 0.4043560009426626, 0.4020431272020769, 0.40014669777830797, 0.39863223540086085, 0.3974564583221624, 0.3965692389231654, 0.3959159630129724, 0.39544013569659314, 0.3950860692993056, 0.3948014947946052, 0.3945399562238992, 0.39426287271778954, 0.39394118057604577, 0.3935564955277312, 0.393101761456786, 0.39258137644847424, 0.39201081047324715, 0.39141575174372145, 0.3908308404561017, 0.3902980680357586, 0.3898649351389103, 0.3895824702520597, 0.3895032110381642, 0.38967924216471383, 0.39016036752109856, 0.3909924744184528, 0.39221612638839454, 0.3938654031858149, 0.39596699393345797, 0.3985395425396178, 0.4015932422820453, 0.40512967633326447, 0.4091419003725007, 0.4136147603730518, 0.4185254325086284, 0.42384416351644233, 0.42953518033297894, 0.43555772925114455, 0.44186719886123077, 0.4484162786298975 ], [ 0.45706964634237085, 0.45126573212898136, 0.4456909149492008, 0.4403870083769852, 0.43539325600319734, 0.4307449438963774, 0.4264719527312481, 0.4225973358546223, 0.4191360290093033, 0.4160938077767746, 0.41346660608166363, 0.4112402912612001, 0.4093909589732721, 0.4078857683495864, 0.40668429040627246, 0.4057402978608089, 0.4050038884747555, 0.4044238109851039, 0.40394985391065513, 0.4035351617069724, 0.4031383568260035, 0.40272536653132446, 0.40227087652479654, 0.4017593572353113, 0.40118563180750855, 0.4005549770931258, 0.3998827703952276, 0.39919371535616277, 0.3985206997206127, 0.39790335457605513, 0.39738639736936066, 0.39701784772744636, 0.39684720462639894, 0.3969236656567093, 0.39729445537004837, 0.3980033125883662, 0.3990891693576151, 0.4005850398886133, 0.4025171281490833, 0.40490415794608003, 0.4077569280472873, 0.41107809489730446, 0.41486218448319123, 0.4190958312823917, 0.42375823552013747, 0.42882182086834514, 0.4342530647483987, 0.44001346435798433, 0.44606059499889283, 0.45234921422363006 ], [ 0.4633035688494724, 0.4578254003122809, 0.45256983188737143, 0.44757471976151075, 0.4428751152395224, 0.43850201793645127, 0.4344811067377067, 0.4308315261185915, 0.42756481881845604, 0.424684101203139, 0.42218357225039754, 0.42004842985362134, 0.4182552400844411, 0.4167727693796152, 0.4155632511157125, 0.41458402204968225, 0.41378943532259244, 0.413132938211919, 0.4125691955706693, 0.41205614299023474, 0.4115568649465006, 0.41104120980938147, 0.41048707309861276, 0.4098813008939286, 0.4092201857765789, 0.4085095476374877, 0.40776441097942523, 0.4070083087373347, 0.4062722595488267, 0.40559347976146193, 0.4050139018679352, 0.40457857615630144, 0.40433403132826395, 0.4043266628322525, 0.4046012060039847, 0.4051993370969692, 0.4061584316090726, 0.4075104982990828, 0.4092813002362302, 0.41148967106788786, 0.41414703412326287, 0.41725713198711645, 0.42081597278808314, 0.4248119953267122, 0.4292264480254058, 0.4340339672549784, 0.439203330342783, 0.44469834920958967, 0.4504788636175555, 0.45650178940265873 ], [ 0.4692493449421074, 0.46407873367522123, 0.45912452934752496, 0.454420984263668, 0.4499993719520881, 0.4458868717910562, 0.44210546160482084, 0.43867088730058174, 0.43559178734462967, 0.4328690515909986, 0.430495486931147, 0.4284558459623669, 0.4267272505180679, 0.4252800121575061, 0.42407882034344974, 0.42308424010453105, 0.4222544379855022, 0.4215470403070662, 0.4209210219387696, 0.4203385262797516, 0.4197665263161601, 0.4191782504449488, 0.41855431328779086, 0.41788350946397995, 0.41716324627991963, 0.41639960899366835, 0.4156070694041984, 0.4148078646238399, 0.41403108739695593, 0.4133115413016102, 0.4126884225121188, 0.4122038935311822, 0.41190161294474237, 0.4118252791502024, 0.41201723640987803, 0.41251718044078356, 0.4133609902411558, 0.4145797047536617, 0.41619865814623963, 0.41823678568951916, 0.420706112172652, 0.42361143475255447, 0.4269502103855437, 0.43071265347723986, 0.43488204195648617, 0.4394352203894099, 0.4443432783923389, 0.44957237308840503, 0.4550846571013294, 0.46083926952255677 ], [ 0.47490001590978814, 0.47001891260574535, 0.46534842767166845, 0.46091955695733927, 0.45676019330920753, 0.45289413202792034, 0.4493401079645833, 0.4461109252627055, 0.44321274589505716, 0.44064460226844265, 0.4383981911918507, 0.4364579913734369, 0.43480172548579515, 0.43340116297546544, 0.4322232341611359, 0.43123140286532025, 0.43038722647920924, 0.4296520206568125, 0.4289885413287551, 0.4283625989361649, 0.42774452749900677, 0.4271104428094191, 0.4264432381744274, 0.4257332814975873, 0.42497879322144244, 0.424185900189479, 0.42336837541351435, 0.4225470876084973, 0.42174919658428556, 0.4210071403902149, 0.42035746666096907, 0.4198395632530135, 0.4194943417821307, 0.4193629225261916, 0.4194853614853185, 0.41989945182230826, 0.42063962414930983, 0.4217359644933676, 0.42321336578972013, 0.42509082801508713, 0.4273809224064881, 0.4300894350648493, 0.43321520319999435, 0.43675015248946925, 0.44067953646211083, 0.4449823692329757, 0.4496320326157205, 0.45459702912008804, 0.4598418449341477, 0.4653278825864805 ], [ 0.48025407733136144, 0.47564481735541, 0.47124086449033603, 0.467070292767347, 0.4631579885651415, 0.45952476569609796, 0.45618653047433466, 0.45315355033743165, 0.45042988200688305, 0.44801301246907405, 0.4458937576299078, 0.4440564495555158, 0.44247942487349645, 0.44113580606505115, 0.4399945463784164, 0.43902169031402244, 0.4381817870410466, 0.437439384950037, 0.4367605322256582, 0.4361142104623502, 0.43547363501841513, 0.4348173658217458, 0.43413018451341645, 0.4334037071310901, 0.4326367152235655, 0.4318352017907919, 0.4310121413098391, 0.43018700488102, 0.42938505167215485, 0.4286364357360806, 0.42797517233008536, 0.42743800967528467, 0.42706325064833445, 0.42688956470531964, 0.42695482441049365, 0.427294994607455, 0.42794309683775184, 0.4289282680055407, 0.4302749307642441, 0.4320020931708674, 0.43412279572962703, 0.4366437236896997, 0.4395650001966578, 0.4428801709668361, 0.4465763836086522, 0.45063475528868896, 0.4550309123446617, 0.45973567606139704, 0.46471586138206633, 0.46993515067399894 ], [ 0.48531489454368015, 0.48096038980070255, 0.4768064027880846, 0.47287840260671804, 0.4691986169406606, 0.4657852454983359, 0.4626517374916962, 0.4598061800006439, 0.4572508444193118, 0.454981934210732, 0.452989568634125, 0.451258024331584, 0.4497662407137332, 0.44848857755234517, 0.44739579594049617, 0.4464562186455879, 0.44563701433593783, 0.44490554312060293, 0.44423069857390907, 0.44358418360880064, 0.44294166348752845, 0.44228374797597286, 0.44159676520141683, 0.4408733013169531, 0.44011249192783586, 0.4393200628628612, 0.43850812883015416, 0.4376947683500612, 0.4369034016505351, 0.4361620044736134, 0.43550219457634065, 0.43495822891400904, 0.43456594819286554, 0.434361702193868, 0.43438128487302274, 0.43465890379448546, 0.4352262049254754, 0.4361113718310154, 0.4373383179075507, 0.4389259909484764, 0.44088781005426325, 0.44323125453792694, 0.44595762206613604, 0.44906196831587325, 0.4525332330280194, 0.45635454820189064, 0.46050371440949667, 0.46495382207305896, 0.46967398717786313, 0.4746301660849254 ], [ 0.49009010989588514, 0.48597399492442744, 0.48205414795602547, 0.4783537288470407, 0.47489262588976716, 0.47168675664718346, 0.4687474434669256, 0.4660809045290803, 0.46368790008021715, 0.461563568676362, 0.45969747976448944, 0.45807391724958935, 0.45667239478786625, 0.45546838874890655, 0.4544342605939022, 0.45354032823341417, 0.4527560368638392, 0.4520511744939774, 0.4513970760244728, 0.45076776205493235, 0.45014096397080794, 0.44949899454449377, 0.4488294324870774, 0.44812559939472824, 0.44738681774761757, 0.446618448549236, 0.4458317164232167, 0.44504333812956137, 0.4442749771526441, 0.44355255191378407, 0.4429054280322303, 0.442365525845792, 0.44196637331609134, 0.4417421319858309, 0.44172662056378076, 0.4419523578114142, 0.4424496443952201, 0.4432457026241017, 0.4443638934234747, 0.4458230309514694, 0.4476368160516117, 0.4498134092844333, 0.4523551617977829, 0.4552585174060144, 0.4585140921042234, 0.46210692850039514, 0.46601691331411593, 0.4702193373032134, 0.4746855697741654, 0.47938381495642335 ], [ 0.49459104693837386, 0.490697786255858, 0.48699707677585385, 0.48351004139027326, 0.48025451900283433, 0.47724444237291397, 0.4744892985830466, 0.4719937077057386, 0.4697571528840112, 0.467773889644412, 0.46603305396101485, 0.46451897791177205, 0.46321170959855934, 0.4620877214647297, 0.46112077943802277, 0.46028293554190236, 0.459545599578119, 0.45888064164717207, 0.4582614767153912, 0.4576640848940014, 0.45706792606177726, 0.4564567143063338, 0.45581902572330124, 0.4551487217900821, 0.45444517929818146, 0.45371332624755867, 0.45296349080786624, 0.4522110771111777, 0.4514760869763137, 0.45078251045450707, 0.45015761021501394, 0.44963112530655935, 0.4492344189925783, 0.448999593629113, 0.4489585935423982, 0.4491423151958013, 0.449579743097502, 0.4502971300830841, 0.45131724162520853, 0.4526586851274617, 0.45433534596376507, 0.4563559515024096, 0.4587237818628918, 0.46143654141718504, 0.46448639824120436, 0.46786019045172916, 0.47153978953612957, 0.47550260241829173, 0.479722187041988, 0.4841689513865398 ], [ 0.4988321158976202, 0.4951470786508753, 0.4916513804397425, 0.48836435488144175, 0.4853020522805503, 0.4824766848462973, 0.47989616036174326, 0.47756373527316803, 0.47547781494717356, 0.47363192309157176, 0.47201485429910617, 0.47061101390355403, 0.4694009386423717, 0.4683619809541105, 0.46746913006982366, 0.4666959352273377, 0.46601549095020456, 0.4654014416949386, 0.46482896328132023, 0.4642756811211789, 0.46372248990751097, 0.46315424557816925, 0.46256030746888965, 0.46193491609905846, 0.4612773995371396, 0.46059220839043374, 0.4598887858402702, 0.45918128453948626, 0.4584881464022116, 0.4578315642190732, 0.4572368456021174, 0.45673170012017833, 0.4563454699014892, 0.4561083228705562, 0.45605042664280704, 0.4562011203887012, 0.456588102014581, 0.4572366488506701, 0.45816889144057127, 0.45940316146643123, 0.4609534356258162, 0.4628288967040765, 0.4650336306397359, 0.4675664738598471, 0.47042101875438885, 0.473585777414804, 0.4770444954912881, 0.48077660013717965, 0.48475775935100657, 0.4889605252365229 ], [ 0.5028302245791324, 0.4993397316186142, 0.49603582363658466, 0.49293626770395743, 0.4900555578674411, 0.48740441895380193, 0.4849894029995277, 0.4828126052829088, 0.4808715230834339, 0.4791590743357238, 0.4776637856063205, 0.4763701498620409, 0.4752591450540063, 0.474308895427388, 0.4734954494678519, 0.47279364215991543, 0.4721780051950949, 0.4716236871132183, 0.4711073460286959, 0.47060798032232576, 0.47010766706683427, 0.4695921835293486, 0.4690514933754683, 0.46848008574067335, 0.4678771617465996, 0.46724666899907963, 0.4665971898529959, 0.4659416935690847, 0.4652971657887477, 0.4646841309619363, 0.46412608452480847, 0.4636488518961241, 0.4632798910167554, 0.463047554555936, 0.4629803274414015, 0.4631060553736901, 0.4634511806455963, 0.46404000287382546, 0.46489398388183734, 0.46603111745944875, 0.46746538545913896, 0.46920632108594434, 0.4712586978772791, 0.4736223586088871, 0.4762921923915262, 0.4792582610366923, 0.4825060680861739, 0.486016956526549, 0.4897686149014377, 0.4937356668758579 ], [ 0.5066041990713146, 0.5032955467247208, 0.5001711222059513, 0.49724732407438615, 0.49453729526678536, 0.492050477597784, 0.48979226176490576, 0.48776375639815767, 0.485961695384934, 0.48437849664305854, 0.48300247808615265, 0.48181822828303283, 0.48080712092830624, 0.4799479544155991, 0.47921769117638907, 0.4785922665131397, 0.47804743371779573, 0.47755961141495595, 0.4771067001936869, 0.4766688384251875, 0.47622907133350917, 0.4757739124736197, 0.4752937823557501, 0.47478331465226414, 0.47424152590268714, 0.4736718496259818, 0.4730820400524911, 0.472483954161564, 0.4718932232830065, 0.47132882719551294, 0.47081258452252234, 0.4703685734641073, 0.4700224967705725, 0.4698010046666469, 0.46973098947847824, 0.46983886623213095, 0.4701498545758718, 0.47068727893549817, 0.4714719055506945, 0.4725213365092878, 0.47384948156768514, 0.4754661279285712, 0.47737662590185787, 0.4795817044033783, 0.4820774247299756, 0.48485527443300386, 0.4879023960266371, 0.49120193842411763, 0.4947335130666676, 0.4984737322273389 ], [ 0.5101742191405308, 0.5070356832447841, 0.5040793426721834, 0.5013204015729761, 0.49877083132200706, 0.4964389687270708, 0.49432921160267773, 0.4924418323035367, 0.49077292517889487, 0.4893144978259192, 0.48805470890027935, 0.4869782476315423, 0.4860668427048944, 0.4852998814153063, 0.4846551144973032, 0.48410941816042335, 0.4836395828157899, 0.48322309777722666, 0.4828389027116488, 0.4824680795244671, 0.48209446234653786, 0.48170514796051694, 0.48129089399687114, 0.48084639721121036, 0.48037044884666463, 0.47986596827032973, 0.4793399195972242, 0.478803118788776, 0.47826994071199286, 0.47775793691616397, 0.4772873755437137, 0.47688071502554347, 0.4765620232552637, 0.4763563540482231, 0.47628909310256823, 0.476385286545003, 0.4766689664902482, 0.4771624897388308, 0.47788590749331933, 0.4788563853792844, 0.4800876936573486, 0.4815897868949744, 0.4833684902568036, 0.4854253059037479, 0.4877573479350392, 0.4903574082567718, 0.4932141492683759, 0.4963124129489859, 0.49963363039445435, 0.5031563115826885 ], [ 0.513561273861093, 0.5105820970342385, 0.5077833279336613, 0.5051791276064447, 0.5027804516288434, 0.50059468591406, 0.49862538093554254, 0.49687210244392244, 0.4953304119019158, 0.49399198380706427, 0.49284486025161384, 0.4918738360140183, 0.49106096075242156, 0.49038613900490796, 0.4898278041222505, 0.48936363924921733, 0.48897131714720216, 0.4886292309694789, 0.4883171898798982, 0.4880170563679333, 0.4877133059247792, 0.48739349406015814, 0.4870486201295361, 0.48667338181995473, 0.48626631817708227, 0.4858298425741933, 0.4853701699152086, 0.48489714458039956, 0.4844239771785894, 0.4839668991386862, 0.4835447446891762, 0.4831784700183616, 0.4828906195921809, 0.48270474994250606, 0.48264482190118296, 0.4827345733388295, 0.4829968859531891, 0.4834531613875066, 0.48412272366742315, 0.4850222662586534, 0.4861653625733621, 0.4875620581454734, 0.4892185607319104, 0.4911370412340719, 0.4933155537296519, 0.49574807740425664, 0.4984246772573449, 0.5013317746729351, 0.5044525138176091, 0.5077672057879518 ], [ 0.5167866436675498, 0.5139570083629308, 0.511306154324221, 0.50884732941924, 0.5065906073516083, 0.5045425557963701, 0.5027060033428192, 0.5010799211779644, 0.49965943045040934, 0.49843594026749616, 0.49739741474481375, 0.4965287609615261, 0.4958123235980968, 0.4952284669076931, 0.49475622085107834, 0.4943739659151465, 0.4940601303904824, 0.4937938746133328, 0.4935557386771948, 0.493328233107221, 0.4930963556483793, 0.4928480213262442, 0.49257439700438965, 0.49227013553661836, 0.49193350810301434, 0.4915664362927957, 0.49117442788092347, 0.4907664220246876, 0.49035455082258617, 0.4899538249247016, 0.48958175130074827, 0.48925789153145505, 0.48900336927702714, 0.48884033606615773, 0.4887914053686375, 0.4888790661156809, 0.48912508836513097, 0.48954993551359305, 0.4901721990745557, 0.49100807324529033, 0.4920708869370304, 0.4933707103530884, 0.4949140513874176, 0.4967036540537675, 0.498738406985995, 0.5010133650745271, 0.5035198819408576, 0.5062458456757272, 0.5091760055389061, 0.5122923735251462 ], [ 0.5198714155160489, 0.5171824050886561, 0.5146706260318387, 0.5123485231907094, 0.5102254024963798, 0.5083071269372973, 0.5065959111804532, 0.5050902289491268, 0.5037848421947595, 0.5026709552104621, 0.5017364905735688, 0.5009664776711498, 0.5003435390369227, 0.49984845521912846, 0.49946078569763297, 0.4991595216234818, 0.4989237458688327, 0.4987332769246426, 0.4985692753451452, 0.49841479442918984, 0.49825526034338175, 0.49807887063417294, 0.4978769037822957, 0.4976439359081917, 0.49737796378256166, 0.49708043583150874, 0.49675619480806493, 0.4964133372426226, 0.4960629957453097, 0.49571905081864864, 0.4953977791882533, 0.4951174459328257, 0.49489784805411174, 0.4947598177127992, 0.49472469425995, 0.4948137754361111, 0.49504775962407965, 0.49544619266681283, 0.49602693426065175, 0.49680566001909765, 0.4977954156831796, 0.499006239387785, 0.5004448662315281, 0.5021145266237718, 0.5040148461238542, 0.5061418500059454, 0.5084880709400159, 0.5110427533867519, 0.513792143966241, 0.5167198535206674 ], [ 0.5228360380803372, 0.5202795878904075, 0.5178988133250706, 0.5157054483471063, 0.5137081274136202, 0.5119121055036568, 0.5103190761661895, 0.5089271001378559, 0.5077306519878634, 0.5067207864773706, 0.5058854203222651, 0.505209719298999, 0.5046765755796178, 0.504267156187218, 0.5039615007683096, 0.5037391455858511, 0.5035797507114028, 0.5034637086861815, 0.5033727151941209, 0.5032902852636771, 0.5032022018954725, 0.5030968875236976, 0.5029656921225146, 0.5028030948774481, 0.5026068190254621, 0.5023778616527946, 0.5021204419078302, 0.5018418722683335, 0.5015523582728438, 0.5012647325951444, 0.5009941296436331, 0.5007576071503268, 0.5005737216167411, 0.5004620651187791, 0.5004427719050607, 0.5005360044522138, 0.5007614300894002, 0.5011377008193881, 0.50168195032887, 0.5024093231451715, 0.5033325512109972, 0.5044615926087359, 0.5058033456498258, 0.5073614490428192, 0.5091361754785515, 0.5111244219481269, 0.5133197957510293, 0.515712790812719, 0.5182910449667825, 0.5210396655712852 ], [ 0.5256999237958146, 0.523268764253557, 0.5210116411022385, 0.5189396533806615, 0.5170608445663722, 0.5153799435204663, 0.5138982024043977, 0.5126133427871907, 0.5115196160905524, 0.5106079788885484, 0.509866377832062, 0.5092801335639003, 0.5088324083433449, 0.5085047385336631, 0.5082776108239238, 0.5081310601228154, 0.508045267413699, 0.5080011373278407, 0.5079808375348221, 0.5079682849870436, 0.5079495673071764, 0.5079132909150288, 0.5078508506373662, 0.5077566183671574, 0.5076280507303542, 0.5074657176270163, 0.5072732549389389, 0.5070572456829403, 0.5068270345201062, 0.5065944809178279, 0.5063736565317872, 0.5061804926614373, 0.5060323840549934, 0.5059477559891971, 0.5059456024697733, 0.5060450045760613, 0.5062646393273039, 0.5066222908349134, 0.5071343767313076, 0.5078155037125202, 0.508678066285496, 0.5097319022992536, 0.5109840174615685, 0.5124383887940928, 0.5140958539569528, 0.5159540897731758, 0.5180076793717047, 0.5202482634527986, 0.5226647675690973, 0.5252436942797312 ], [ 0.5284811040449962, 0.5261686974361487, 0.524028533881507, 0.5220711391436367, 0.5203040323512834, 0.5187314852877873, 0.5173543772214222, 0.5161701553536282, 0.5151729059487503, 0.5143535357343741, 0.5137000576597249, 0.5131979700084487, 0.5128307135681195, 0.5125801883538633, 0.5124273094363699, 0.5123525807725618, 0.5123366664960559, 0.5123609407133308, 0.5124079992254472, 0.5124621194810086, 0.512509658193588, 0.5125393791839263, 0.5125427069363239, 0.5125139039457172, 0.5124501720887044, 0.5123516799433547, 0.5122215192222974, 0.5120655943254739, 0.511892449549602, 0.511713038819949, 0.5115404430568705, 0.5113895405735778, 0.5112766363259517, 0.5112190564729847, 0.5112347155874388, 0.5113416649575956, 0.5115576316630097, 0.5118995593580065, 0.5123831627846174, 0.5130225087713425, 0.513829636673067, 0.514814230724727, 0.5159833555333719, 0.5173412639172587, 0.5188892836013258, 0.5206257860623562, 0.5225462373140539, 0.5246433268971952, 0.5269071680607663, 0.5293255593251275 ], [ 0.5311959428320454, 0.5289964157298548, 0.5269671224746406, 0.525118064758275, 0.5234562919866986, 0.5219856768288627, 0.520706784523084, 0.5196168450302163, 0.5187098322019003, 0.51797664882952, 0.5174054111782288, 0.516981821807477, 0.5166896154954962, 0.5165110601839551, 0.5164274931831417, 0.5164198724434461, 0.5164693234070343, 0.5165576636167237, 0.5166678896332432, 0.5167846136310517, 0.5168944400482299, 0.5169862756302944, 0.5170515689496987, 0.5170844778744174, 0.5170819654269774, 0.5170438259974434, 0.5169726449728919, 0.5168736955815093, 0.5167547772089686, 0.516625999733316, 0.5164995186539617, 0.5163892260670349, 0.5163104029522434, 0.51627933884473, 0.516312925788591, 0.5164282344793095, 0.5166420816244945, 0.5169705986665196, 0.5174288129656167, 0.5180302531727011, 0.518786590671465, 0.519707328515342, 0.5207995481567071, 0.5220677224616084, 0.5235136010961633, 0.5251361715027139, 0.5269316955515161, 0.5288938187853092, 0.5310137462021892, 0.5332804759570758 ], [ 0.5338589129470156, 0.5317669859870084, 0.5298430162618407, 0.5280965199855231, 0.5265341212201813, 0.525159342019835, 0.5239724842148547, 0.5229706110680549, 0.5221476322321442, 0.5214944903220692, 0.5209994423927439, 0.5206484250786988, 0.5204254884436923, 0.5203132809448587, 0.5202935664590164, 0.5203477540485566, 0.5204574219532155, 0.5206048189921142, 0.5207733289076614, 0.5209478859216654, 0.5211153326577779, 0.5212647143994142, 0.5213875062312218, 0.5214777718403419, 0.5215322545693947, 0.5215504027032799, 0.521534331965406, 0.5214887288579123, 0.521420698890908, 0.5213395640074339, 0.5212566137268374, 0.5211848147948751, 0.5211384845211127, 0.521132933551647, 0.5211840845800182, 0.5213080744123935, 0.5215208478041667, 0.5218377524670832, 0.5222731454762368, 0.5228400218420861, 0.5235496761202058, 0.5244114075055439, 0.5254322778392259, 0.5266169303433864, 0.5279674747550976, 0.5294834419752992, 0.5311618085507573, 0.5329970884626999, 0.5349814870067673, 0.5371051092003325 ], [ 0.5364824369371649, 0.5344933536853699, 0.5326696432823972, 0.5310203662028079, 0.5295517569373438, 0.5282670274135666, 0.5271662596291466, 0.526246394975135, 0.5255013230705368, 0.5249220680133508, 0.5244970651681082, 0.5242125173303867, 0.5240528156484304, 0.5240010082591985, 0.524039298315465, 0.5241495529310862, 0.5243138054409671, 0.5245147350722104, 0.5247361104198583, 0.52496318576704, 0.5251830420508206, 0.525384866950557, 0.5255601710099839, 0.5257029387937857, 0.5258097157711307, 0.5258796329057932, 0.5259143718473149, 0.5259180742224365, 0.5258971989037771, 0.5258603313771447, 0.5258179495344695, 0.5257821504716501, 0.5257663432366251, 0.5257849129931839, 0.5258528627478776, 0.5259854396022333, 0.5261977533760229, 0.5265043963047432, 0.5269190732299981, 0.5274542521518832, 0.5281208450830343, 0.5289279287448776, 0.5298825137272685, 0.5309893692920955, 0.5322509090920111, 0.5336671408001196, 0.5352356801486972, 0.5369518273234295, 0.5388087012293797, 0.5407974249985621 ], [ 0.5390767932834701, 0.5371862498504318, 0.5354581583863419, 0.5339011461688551, 0.5325210867932074, 0.5313209158346186, 0.5303005330061963, 0.5294567976217269, 0.5287836196840477, 0.5282721442160141, 0.527911021904762, 0.5276867550939492, 0.5275841049248702, 0.5275865431954851, 0.5276767313673674, 0.5278370090861004, 0.5280498754774537, 0.5282984481558871, 0.5285668871087321, 0.5288407731625858, 0.5291074333759144, 0.5293562082445834, 0.5295786579106784, 0.5297687065346182, 0.5299227255798087, 0.5300395579651429, 0.5301204858969413, 0.5301691457592302, 0.5301913937983602, 0.5301951265721264, 0.5301900603312746, 0.5301874737392241, 0.5301999186729708, 0.5302409043186026, 0.5303245603833884, 0.53046528596586, 0.5306773913980464, 0.530974741116577, 0.5313704062310706, 0.5318763358327748, 0.5325030561253027, 0.5332594060855992, 0.5341523175335707, 0.5351866462017889, 0.5363650586964698, 0.5376879782148203, 0.539153589654234, 0.5407579024605772, 0.5424948673678276, 0.5443565412224601 ], [ 0.5416500861507998, 0.5398541630830911, 0.538217417593429, 0.5367480606435342, 0.5354516278819409, 0.5343308067368768, 0.5333853470234884, 0.532612061276986, 0.5320049167209143, 0.5315552162995109, 0.5312518618971538, 0.5310816890672224, 0.5310298595685476, 0.5310802959430211, 0.5312161413428043, 0.5314202278073159, 0.53167553708736, 0.5319656397395216, 0.5322751003539912, 0.5325898392093454, 0.5328974431588888, 0.5331874209674067, 0.5334514004998825, 0.533683267027245, 0.5338792434168735, 0.5340379141167241, 0.5341601956545238, 0.5342492569154657, 0.5343103928070606, 0.5343508551489613, 0.534379644817533, 0.5344072693987323, 0.5344454709106004, 0.5345069285779315, 0.5346049421795505, 0.5347531021184068, 0.5349649530352927, 0.5352536584254292, 0.5356316742361659, 0.5361104397319215, 0.53670009392459, 0.5374092255178403, 0.5382446635645317, 0.5392113148860593, 0.540312052787826, 0.5415476598000936, 0.5429168251826095, 0.5444161958791339, 0.5460404776260142, 0.547782581132767 ], [ 0.5442082750781816, 0.5425033728931189, 0.5409540147278639, 0.5395680078378238, 0.5383505683685037, 0.5373041592388818, 0.5364284083227487, 0.535720112599577, 0.5351733298462394, 0.5347795551932778, 0.5345279758053213, 0.5344057933735542, 0.5343986012802832, 0.5344908013794939, 0.5346660444040429, 0.534907678035109, 0.5351991875455027, 0.5355246154874183, 0.5358689489348306, 0.5362184651000559, 0.5365610285260656, 0.5368863353444207, 0.537186102157206, 0.537454198868494, 0.5376867262183204, 0.5378820398599415, 0.5380407236005914, 0.5381655149512503, 0.538261186470537, 0.5383343866158443, 0.5383934440030441, 0.5384481391867352, 0.5385094483525973, 0.5385892636879609, 0.5387000956686651, 0.5388547630477267, 0.5390660769095001, 0.5393465256984394, 0.5397079685687612, 0.5401613446512219, 0.5407164058229772, 0.5413814802391105, 0.5421632732072126, 0.5430667109571763, 0.5440948315078838, 0.5452487252232884, 0.546527525871538, 0.5479284511592953, 0.5494468899235794, 0.5510765315354812 ], [ 0.5467552591372767, 0.5451380386584637, 0.5436723744880241, 0.5423656797448175, 0.5412228660806128, 0.5402461918397422, 0.5394351870976548, 0.5387866607580958, 0.5382947910030559, 0.5379512963817366, 0.5377456810034544, 0.5376655439514266, 0.5376969403921146, 0.537824780072286, 0.5380332480372939, 0.5383062324444025, 0.538627745182891, 0.5389823224905654, 0.5393553946846672, 0.5397336163067471, 0.5401051502315707, 0.5404599014537224, 0.5407896982243277, 0.5410884198877398, 0.5413520721280757, 0.5415788113778826, 0.5417689208947298, 0.5419247415260156, 0.5420505605205427, 0.5421524619751016, 0.5422381426906323, 0.5423166974116889, 0.5423983776767273, 0.5424943288384511, 0.542616310225506, 0.5427764038901738, 0.5429867178825402, 0.5432590904550038, 0.5436048019667439, 0.5440343014577679, 0.5445569548335782, 0.5451808212950441, 0.5459124640351687, 0.5467568003024397, 0.5477169947248695, 0.5487943983525744, 0.5499885342857556, 0.5512971291013172, 0.5527161876743453, 0.5542401075070936 ], [ 0.5492930085329343, 0.5477603369427292, 0.5463748944998849, 0.5451437077803905, 0.5440713964365645, 0.5431600312061323, 0.5424090652142779, 0.5418153432973499, 0.5413731904152062, 0.5410745764557886, 0.5409093511568319, 0.5408655397405643, 0.5409296873917635, 0.5410872390489538, 0.5413229401811426, 0.5416212442645775, 0.5419667134612117, 0.5423444003866424, 0.5427402006643332, 0.5431411680116374, 0.5435357857199392, 0.5439141904307364, 0.5442683459612481, 0.5445921665251113, 0.5448815899914213, 0.5451346028274843, 0.5453512191028437, 0.5455334164395766, 0.5456850321335539, 0.54581162290474, 0.5459202919207582, 0.5460194869276623, 0.5461187735528912, 0.5462285881389608, 0.5463599748252224, 0.5465243120028611, 0.5467330336918166, 0.5469973517801533, 0.5473279853704137, 0.5477349036349322, 0.5482270885387245, 0.548812323501672, 0.5494970135161629, 0.5502860414090984, 0.5511826638593431, 0.5521884494979828, 0.5533032599940227, 0.5545252735416997, 0.5558510487036977, 0.5572756252123279 ], [ 0.5518217354426029, 0.550370638705016, 0.5490621276909335, 0.5479028489438459, 0.5468971408671776, 0.5460469012119215, 0.5453515241427084, 0.5448079111951643, 0.5444105570055777, 0.5441517071772594, 0.5440215823104589, 0.5440086593077351, 0.5440999987704276, 0.5442816057539512, 0.5445388104034605, 0.5448566550253632, 0.545220274877716, 0.5456152612493932, 0.5460279970821517, 0.5464459573021069, 0.5468579680088168, 0.5472544205858879, 0.5476274385434673, 0.5479709964121239, 0.5482809912459543, 0.5485552682575637, 0.5487936028210461, 0.5489976415815394, 0.5491708057526414, 0.5493181599213824, 0.5494462498679147, 0.5495629130895334, 0.5496770659303378, 0.549798471478292, 0.549937492703778, 0.5501048356645512, 0.5503112879627816, 0.5505674579700023, 0.5508835205869209, 0.5512689754265664, 0.5517324232542621, 0.5522813662492874, 0.5529220371486596, 0.5536592615899004, 0.5544963570043677, 0.5554350702635127, 0.5564755550027001, 0.5576163882094008, 0.5588546243397117, 0.560185883994173 ], [ 0.5543400951495328, 0.5529677171878564, 0.551732995569764, 0.5506422029574224, 0.5496994061419507, 0.5489063426700446, 0.5482623632454408, 0.5477644438333653, 0.5474072681968886, 0.547183378323965, 0.5470833871045492, 0.547096244911014, 0.5472095496013567, 0.5474098880219306, 0.5476831963840734, 0.5480151269079769, 0.5483914087893129, 0.5487981927273148, 0.5492223698093854, 0.549651857321666, 0.5500758459010102, 0.5504850042361745, 0.5508716391682611, 0.5512298104681902, 0.5515554007495146, 0.5518461419037727, 0.5521016001414469, 0.5523231222198453, 0.5525137457855936, 0.5526780770035935, 0.5528221388343175, 0.5529531934986552, 0.5530795428653349, 0.553210310728329, 0.5533552112142299, 0.553524307861461, 0.5537277682202167, 0.5539756190994631, 0.5542775077936218, 0.5546424747130811, 0.5550787427788406, 0.5555935286900741, 0.556192880714572, 0.5568815469823879, 0.5576628773968929, 0.5585387612467816, 0.5595096014548454, 0.5605743251935839, 0.5617304293994101, 0.5629740585923088 ], [ 0.5568454082381057, 0.5555489769904016, 0.5543850227256376, 0.5533594505794714, 0.5524760647510676, 0.5517364539419057, 0.5511399387164757, 0.5506835843563814, 0.5503622798125062, 0.5501688803334815, 0.5500944084827766, 0.5501283057534349, 0.5502587250118887, 0.5504728526586221, 0.5507572487295472, 0.5510981931617884, 0.5514820270413459, 0.5518954787278281, 0.5523259661791313, 0.5527618684352626, 0.5531927609313607, 0.5536096109797729, 0.5540049312999402, 0.5543728908219768, 0.5547093831131106, 0.5550120536693911, 0.555280287993314, 0.5555151628719112, 0.5557193636197546, 0.5558970703014742, 0.5560538161418789, 0.5561963215059644, 0.5563323070143384, 0.5564702895687365, 0.5566193653014375, 0.5567889837228608, 0.5569887176031123, 0.5572280333561498, 0.5575160668638554, 0.5578614097440643, 0.5582719109963349, 0.5587544987237641, 0.5593150262110891, 0.5599581460350375, 0.5606872151041982, 0.5615042325996051, 0.5624098117544842, 0.563403185323293, 0.5644822435034171, 0.5656436020458724 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0169447 (SEM: 0)
x1: 0.808197
x2: 0.515484
x3: 0.311732
x4: 0.927427
x5: 0.0212169
x6: 0.141828", "Arm 1_0
hartmann6: -0.0171743 (SEM: 0)
x1: 0.751789
x2: 0.00941824
x3: 0.935766
x4: 0.481968
x5: 0.276135
x6: 0.0149037", "Arm 2_0
hartmann6: -0.0954722 (SEM: 0)
x1: 0.430394
x2: 0.453745
x3: 0.42868
x4: 0.0414895
x5: 0.34033
x6: 0.0305782", "Arm 3_0
hartmann6: -0.416461 (SEM: 0)
x1: 0.0992099
x2: 0.790143
x3: 0.532389
x4: 0.15217
x5: 0.418675
x6: 0.883382", "Arm 4_0
hartmann6: -0.238305 (SEM: 0)
x1: 0.835693
x2: 0.0758136
x3: 0.453538
x4: 0.14145
x5: 0.533597
x6: 0.462874", "Arm 5_0
hartmann6: -0.00089729 (SEM: 0)
x1: 0.619054
x2: 0.542657
x3: 0.266134
x4: 0.969628
x5: 0.721164
x6: 0.855231", "Arm 6_0
hartmann6: -0.157822 (SEM: 0)
x1: 0.892539
x2: 0.383274
x3: 0.470328
x4: 0.133546
x5: 0.00762028
x6: 0.743713", "Arm 7_0
hartmann6: -0.000231512 (SEM: 0)
x1: 0.923559
x2: 0.960248
x3: 0.605177
x4: 0.927958
x5: 0.780139
x6: 0.705904", "Arm 8_0
hartmann6: -0.383489 (SEM: 0)
x1: 0.708208
x2: 0.330662
x3: 0.0803024
x4: 0.558602
x5: 0.163857
x6: 0.759264", "Arm 9_0
hartmann6: -0.360936 (SEM: 0)
x1: 0.293659
x2: 0.97249
x3: 0.875223
x4: 0.99334
x5: 0.336409
x6: 0.140827", "Arm 10_0
hartmann6: -0.0249966 (SEM: 0)
x1: 0.871813
x2: 0.776927
x3: 0.807538
x4: 0.643326
x5: 0.572012
x6: 0.67223", "Arm 11_0
hartmann6: -0.126329 (SEM: 0)
x1: 0.265784
x2: 0.00612966
x3: 0.388793
x4: 0.364144
x5: 0.640832
x6: 0.167751", "Arm 12_0
hartmann6: -1.03666 (SEM: 0)
x1: 0.59258
x2: 0.273142
x3: 0.0583361
x4: 0.423357
x5: 0.184469
x6: 0.741409", "Arm 13_0
hartmann6: -1.23226 (SEM: 0)
x1: 0.551129
x2: 0.261791
x3: 0.0399145
x4: 0.384436
x5: 0.18932
x6: 0.750001", "Arm 14_0
hartmann6: -1.41086 (SEM: 0)
x1: 0.504631
x2: 0.244459
x3: 0.0177052
x4: 0.337493
x5: 0.191796
x6: 0.759005", "Arm 15_0
hartmann6: -1.57544 (SEM: 0)
x1: 0.446076
x2: 0.213803
x3: 2.37766e-15
x4: 0.273792
x5: 0.196028
x6: 0.765181", "Arm 16_0
hartmann6: -1.78551 (SEM: 0)
x1: 0.375206
x2: 0.165681
x3: 0.00158615
x4: 0.219009
x5: 0.21342
x6: 0.751781", "Arm 17_0
hartmann6: -2.16758 (SEM: 0)
x1: 0.300877
x2: 0.115408
x3: 0.024442
x4: 0.211551
x5: 0.24803
x6: 0.706709", "Arm 18_0
hartmann6: -2.41164 (SEM: 0)
x1: 0.233536
x2: 0.0836376
x3: 0.0387164
x4: 0.234747
x5: 0.279406
x6: 0.658766", "Arm 19_0
hartmann6: -2.31387 (SEM: 0)
x1: 0.146209
x2: 0.005342
x3: 0.0487713
x4: 0.278852
x5: 0.278569
x6: 0.653842", "Arm 20_0
hartmann6: -2.22897 (SEM: 0)
x1: 0.189787
x2: 0.119162
x3: 0.00199033
x4: 0.211476
x5: 0.31105
x6: 0.612905", "Arm 21_0
hartmann6: -2.62188 (SEM: 0)
x1: 0.24814
x2: 0.0599642
x3: 0.106228
x4: 0.269188
x5: 0.291451
x6: 0.642139", "Arm 22_0
hartmann6: -2.66684 (SEM: 0)
x1: 0.223991
x2: 0.0815316
x3: 0.166045
x4: 0.219476
x5: 0.293558
x6: 0.633415", "Arm 23_0
hartmann6: -2.53728 (SEM: 0)
x1: 0.247451
x2: 0.0433822
x3: 0.166454
x4: 0.224677
x5: 0.356192
x6: 0.656468" ], "type": "scatter", "x": [ 0.8081970810890198, 0.7517893770709634, 0.4303943682461977, 0.09920991584658623, 0.8356926199048758, 0.619053908623755, 0.8925394397228956, 0.9235591311007738, 0.7082078410312533, 0.2936592809855938, 0.8718132339417934, 0.26578432600945234, 0.5925800883496698, 0.551128539622191, 0.504630586183211, 0.44607621656513147, 0.3752063509950746, 0.3008766500594382, 0.23353573380527481, 0.1462085543732612, 0.18978712754936752, 0.24814020494327513, 0.22399122198464227, 0.24745053362015107 ], "xaxis": "x", "y": [ 0.5154842138290405, 0.009418242610991001, 0.45374472439289093, 0.7901433296501637, 0.07581357471644878, 0.5426569981500506, 0.3832741053774953, 0.9602481089532375, 0.3306616209447384, 0.9724899800494313, 0.7769272327423096, 0.006129659712314606, 0.27314221590797644, 0.26179101316971004, 0.24445918942248304, 0.2138033196037768, 0.16568055720455532, 0.11540757583440457, 0.08363759345907099, 0.005341995379521409, 0.11916159611843083, 0.059964178453312346, 0.08153161805289375, 0.043382223363818195 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0169447 (SEM: 0)
x1: 0.808197
x2: 0.515484
x3: 0.311732
x4: 0.927427
x5: 0.0212169
x6: 0.141828", "Arm 1_0
hartmann6: -0.0171743 (SEM: 0)
x1: 0.751789
x2: 0.00941824
x3: 0.935766
x4: 0.481968
x5: 0.276135
x6: 0.0149037", "Arm 2_0
hartmann6: -0.0954722 (SEM: 0)
x1: 0.430394
x2: 0.453745
x3: 0.42868
x4: 0.0414895
x5: 0.34033
x6: 0.0305782", "Arm 3_0
hartmann6: -0.416461 (SEM: 0)
x1: 0.0992099
x2: 0.790143
x3: 0.532389
x4: 0.15217
x5: 0.418675
x6: 0.883382", "Arm 4_0
hartmann6: -0.238305 (SEM: 0)
x1: 0.835693
x2: 0.0758136
x3: 0.453538
x4: 0.14145
x5: 0.533597
x6: 0.462874", "Arm 5_0
hartmann6: -0.00089729 (SEM: 0)
x1: 0.619054
x2: 0.542657
x3: 0.266134
x4: 0.969628
x5: 0.721164
x6: 0.855231", "Arm 6_0
hartmann6: -0.157822 (SEM: 0)
x1: 0.892539
x2: 0.383274
x3: 0.470328
x4: 0.133546
x5: 0.00762028
x6: 0.743713", "Arm 7_0
hartmann6: -0.000231512 (SEM: 0)
x1: 0.923559
x2: 0.960248
x3: 0.605177
x4: 0.927958
x5: 0.780139
x6: 0.705904", "Arm 8_0
hartmann6: -0.383489 (SEM: 0)
x1: 0.708208
x2: 0.330662
x3: 0.0803024
x4: 0.558602
x5: 0.163857
x6: 0.759264", "Arm 9_0
hartmann6: -0.360936 (SEM: 0)
x1: 0.293659
x2: 0.97249
x3: 0.875223
x4: 0.99334
x5: 0.336409
x6: 0.140827", "Arm 10_0
hartmann6: -0.0249966 (SEM: 0)
x1: 0.871813
x2: 0.776927
x3: 0.807538
x4: 0.643326
x5: 0.572012
x6: 0.67223", "Arm 11_0
hartmann6: -0.126329 (SEM: 0)
x1: 0.265784
x2: 0.00612966
x3: 0.388793
x4: 0.364144
x5: 0.640832
x6: 0.167751", "Arm 12_0
hartmann6: -1.03666 (SEM: 0)
x1: 0.59258
x2: 0.273142
x3: 0.0583361
x4: 0.423357
x5: 0.184469
x6: 0.741409", "Arm 13_0
hartmann6: -1.23226 (SEM: 0)
x1: 0.551129
x2: 0.261791
x3: 0.0399145
x4: 0.384436
x5: 0.18932
x6: 0.750001", "Arm 14_0
hartmann6: -1.41086 (SEM: 0)
x1: 0.504631
x2: 0.244459
x3: 0.0177052
x4: 0.337493
x5: 0.191796
x6: 0.759005", "Arm 15_0
hartmann6: -1.57544 (SEM: 0)
x1: 0.446076
x2: 0.213803
x3: 2.37766e-15
x4: 0.273792
x5: 0.196028
x6: 0.765181", "Arm 16_0
hartmann6: -1.78551 (SEM: 0)
x1: 0.375206
x2: 0.165681
x3: 0.00158615
x4: 0.219009
x5: 0.21342
x6: 0.751781", "Arm 17_0
hartmann6: -2.16758 (SEM: 0)
x1: 0.300877
x2: 0.115408
x3: 0.024442
x4: 0.211551
x5: 0.24803
x6: 0.706709", "Arm 18_0
hartmann6: -2.41164 (SEM: 0)
x1: 0.233536
x2: 0.0836376
x3: 0.0387164
x4: 0.234747
x5: 0.279406
x6: 0.658766", "Arm 19_0
hartmann6: -2.31387 (SEM: 0)
x1: 0.146209
x2: 0.005342
x3: 0.0487713
x4: 0.278852
x5: 0.278569
x6: 0.653842", "Arm 20_0
hartmann6: -2.22897 (SEM: 0)
x1: 0.189787
x2: 0.119162
x3: 0.00199033
x4: 0.211476
x5: 0.31105
x6: 0.612905", "Arm 21_0
hartmann6: -2.62188 (SEM: 0)
x1: 0.24814
x2: 0.0599642
x3: 0.106228
x4: 0.269188
x5: 0.291451
x6: 0.642139", "Arm 22_0
hartmann6: -2.66684 (SEM: 0)
x1: 0.223991
x2: 0.0815316
x3: 0.166045
x4: 0.219476
x5: 0.293558
x6: 0.633415", "Arm 23_0
hartmann6: -2.53728 (SEM: 0)
x1: 0.247451
x2: 0.0433822
x3: 0.166454
x4: 0.224677
x5: 0.356192
x6: 0.656468" ], "type": "scatter", "x": [ 0.8081970810890198, 0.7517893770709634, 0.4303943682461977, 0.09920991584658623, 0.8356926199048758, 0.619053908623755, 0.8925394397228956, 0.9235591311007738, 0.7082078410312533, 0.2936592809855938, 0.8718132339417934, 0.26578432600945234, 0.5925800883496698, 0.551128539622191, 0.504630586183211, 0.44607621656513147, 0.3752063509950746, 0.3008766500594382, 0.23353573380527481, 0.1462085543732612, 0.18978712754936752, 0.24814020494327513, 0.22399122198464227, 0.24745053362015107 ], "xaxis": "x2", "y": [ 0.5154842138290405, 0.009418242610991001, 0.45374472439289093, 0.7901433296501637, 0.07581357471644878, 0.5426569981500506, 0.3832741053774953, 0.9602481089532375, 0.3306616209447384, 0.9724899800494313, 0.7769272327423096, 0.006129659712314606, 0.27314221590797644, 0.26179101316971004, 0.24445918942248304, 0.2138033196037768, 0.16568055720455532, 0.11540757583440457, 0.08363759345907099, 0.005341995379521409, 0.11916159611843083, 0.059964178453312346, 0.08153161805289375, 0.043382223363818195 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:17.362326Z", "iopub.status.busy": "2022-09-15T17:13:17.360586Z", "iopub.status.idle": "2022-09-15T17:13:18.051649Z", "shell.execute_reply": "2022-09-15T17:13:18.050611Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:17] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.8814716576160373, 0.8812155803717097, 0.8815137958291724, 0.8823730435742632, 0.883797929313602, 0.8857908408704557, 0.8883518791766571, 0.891478805987078, 0.8951670106027058, 0.8994094982869466, 0.9041969031201629, 0.9095175276558146, 0.9153574109169091, 0.9217004251052308, 0.9285284000568357, 0.9358212731569074, 0.9435572612906272, 0.9517130505672606, 0.960263999060919, 0.9691843476560069, 0.9784474342221144, 0.9880259067047328, 0.9978919312341634, 1.008017391960408, 1.018374079963765, 1.0289338692286187, 1.0396688782723522, 1.050551616572669, 1.061555115421957, 1.072653043249645, 1.0838198057905126, 1.0950306317391376, 1.1062616447229288, 1.1174899225546633, 1.128693544798257, 1.139851629708269, 1.150944361593411, 1.1619530096159967, 1.1728599389816468, 1.1836486154031942, 1.1943036036455612, 1.2048105608795527, 1.2151562254947958, 1.225328401948341, 1.2353159421574884, 1.245108723883709, 1.254697626500098, 1.2640745044871435, 1.2732321589610502, 1.2821643075044968 ], [ 0.881308210780821, 0.8810715671461291, 0.8813931696588684, 0.8822800150875372, 0.8837369500164837, 0.8857665792111518, 0.8883691881275421, 0.8915426817364087, 0.8952825425628432, 0.8995818113391636, 0.9044310937241399, 0.9098185960434371, 0.915730191973378, 0.922149520665804, 0.9290581152132324, 0.9364355588147958, 0.9442596647180963, 0.952506675101383, 0.961151473566397, 0.9701678058107659, 0.9795285032727419, 0.9892057050046157, 0.9991710736488089, 1.0093960020881738, 1.019851808061317, 1.030509914732874, 1.041342015859048, 1.0523202247722299, 1.063417206914506, 1.0746062960736744, 1.085861594815896, 1.0971580598699344, 1.1084715734037636, 1.1197790012538915, 1.131058239229688, 1.142288248629952, 1.1534490820864782, 1.1645219007996692, 1.175488984162475, 1.1863337326887209, 1.1970406650762166, 1.2075954101484405, 1.2179846943348873, 1.2281963252712396, 1.2382191720285007, 1.2480431424155076, 1.2576591577423974, 1.2670591253836432, 1.2762359094374403, 1.2851832997437782 ], [ 0.8816104211975204, 0.8813950468053493, 0.8817412841624189, 0.8826563953033901, 0.8841454812146317, 0.8862113816078049, 0.8888545877463856, 0.8920731710623999, 0.8958627312218392, 0.9002163678889546, 0.905124680460677, 0.9105757993801801, 0.9165554513439205, 0.923047058984368, 0.9300318737171014, 0.9374891386674687, 0.9453962771582134, 0.9537291012722862, 0.9624620345325703, 0.9715683427164622, 0.9810203671558363, 0.990789755454914, 1.0008476852889756, 1.01116507774208, 1.0217127974404965, 1.0324618374975478, 1.043383487978798, 1.054449487208178, 1.0656321557582804, 1.0769045133990678, 1.0882403796205076, 1.0996144586006402, 1.1110024096684374, 1.1223809044198196, 1.1337276716953502, 1.145021531630648, 1.1562424199559598, 1.1673714036598977, 1.178390689052903, 1.189283623176152, 1.2000346894076086, 1.2106294980231018, 1.2210547723806757, 1.2312983313127035, 1.24134906823432, 1.251196927409149, 1.260832877754313, 1.2702488845162334, 1.2794378791063032, 1.2883937273504302 ], [ 0.8823857977735228, 0.882193641021072, 0.88256585656315, 0.8835099795794998, 0.885031378940703, 0.8871331472975392, 0.8898160028911363, 0.8930782065395748, 0.8969154983849251, 0.9013210596553557, 0.9062855046402306, 0.9117969071894966, 0.9178408644289278, 0.9244005982908777, 0.9314570932400978, 0.9389892665558923, 0.9469741659597186, 0.9553871883757893, 0.964202313189112, 0.9733923434463607, 0.9829291489085574, 0.9927839055806654, 1.002927327195611, 1.0133298850268408, 1.0239620132805103, 1.0347942981342755, 1.045797649220942, 1.056943452990004, 1.0682037079143867, 1.0795511419437689, 1.0909593129440114, 1.102402693111079, 1.1138567385154583, 1.1252979450304537, 1.1367038919353734, 1.1480532744745773, 1.1593259266066112, 1.1705028351048417, 1.181566146081325, 1.1924991649064953, 1.2032863503953903, 1.213913304030572, 1.2243667548965713, 1.2346345409123958, 1.2447055868690924, 1.2545698797091291, 1.2642184414231816, 1.273643299888335, 1.2828374579284765, 1.291794860842215 ], [ 0.883640365933774, 0.8834734940516469, 0.8838731383940841, 0.884847114822834, 0.8864010732280512, 0.8885383767020584, 0.8912599908741132, 0.894564387764863, 0.8984474698618613, 0.9029025208355892, 0.9079201891194566, 0.9134885093909296, 0.9195929649752932, 0.9262165916911513, 0.9333401210850206, 0.9409421587409169, 0.9489993916605539, 0.957486817704968, 0.9663779897480497, 0.9756452674071404, 0.9852600698322891, 0.995193123899999, 1.005414703137726, 1.015894853704189, 1.0266036047028417, 1.0375111609732108, 1.048588077267981, 1.0598054133754953, 1.0711348702876557, 1.0825489079457897, 1.0940208454285312, 1.1055249446847013, 1.1170364790701444, 1.1285317880320695, 1.139988319309364, 1.1513846599946747, 1.1627005577457232, 1.1739169333494963, 1.1850158857436932, 1.1959806904920558, 1.2067957926009865, 1.2174467944579428, 1.2279204395716545, 1.2382045927016574, 1.2482882168817309, 1.2581613477689724, 1.2678150656874074, 1.2772414656821063, 1.286433625855869, 1.2953855742250902 ], [ 0.8853785881538765, 0.8852391931951251, 0.8856678366086431, 0.8866726219503954, 0.8882594925245175, 0.8904320982703078, 0.8931916710563288, 0.8965369138633138, 0.9004639108881108, 0.9049660663139518, 0.910034079073906, 0.915655959357741, 0.9218170901258791, 0.9285003339350791, 0.9356861824449145, 0.9433529434848461, 0.9514769587871035, 0.9600328445222681, 0.9689937465546862, 0.9783316027128741, 0.9880174051592785, 0.9980214569660453, 1.0083136181144685, 1.0188635372340933, 1.0296408664187804, 1.0406154573685802, 1.051757537893645, 1.0630378684783857, 1.0744278791443078, 1.0858997872765326, 1.0974266974003142, 1.1089826841205703, 1.120542859580399, 1.1320834268658289, 1.143581720796218, 1.1550162375049562, 1.1663666541456592, 1.1776138399652598, 1.1887398598771437, 1.1997279715520601, 1.210562616928424, 1.2212294089312128, 1.2317151140833351, 1.242007631596926, 1.2520959694461313, 1.261970217847643, 1.2716215205107146, 1.2810420439644314, 1.2902249452253494, 1.2991643380332973 ], [ 0.8876033069183176, 0.8874937117243072, 0.8879530570719439, 0.8889897404532008, 0.8906100097391683, 0.8928178162779992, 0.8956146745121165, 0.8989995349743526, 0.9029686792551084, 0.9075156461615289, 0.912631197541537, 0.9183033301748136, 0.9245173370994896, 0.9312559182936673, 0.9384993373362085, 0.946225617988055, 0.9544107728238592, 0.9630290551603624, 0.9720532254688391, 0.9814548240285137, 0.9912044425553526, 1.0012719887259465, 1.0116269387559627, 1.0222385743829832, 1.0330762016853323, 1.0441093501147245, 1.0553079509233196, 1.0666424948303799, 1.078084169308074, 1.0896049762816098, 1.1011778313472715, 1.1127766458242474, 1.124376393085251, 1.135953160668695, 1.147484189675096, 1.1589479029041712, 1.1703239231095484, 1.1815930826452277, 1.192737425661777, 1.2037402038878844, 1.2145858669108804, 1.225260047752472, 1.235749544426137, 1.2460422980630164, 1.2561273681041474, 1.2659949049795953, 1.2756361206289821, 1.2850432571626293, 1.294209553917779, 1.3031292131284622 ], [ 0.8903157149832381, 0.8902383792501336, 0.8907302753599098, 0.8918000998810469, 0.8934544145387039, 0.8956974839141321, 0.8985311177337049, 0.9019545262715811, 0.9059641992511624, 0.9105538190649174, 0.9157142179225108, 0.9214333858585246, 0.9276965328823219, 0.9344862045960344, 0.941782446981444, 0.9495630132335893, 0.9578036037321079, 0.9664781294981415, 0.9755589896259785, 0.9850173539637777, 0.9948234434926293, 1.0049468022005303, 1.0153565556080166, 1.026021652373908, 1.036911086539909, 1.0479940989423115, 1.059240357128094, 1.070620113771838, 1.0821043441126603, 1.0936648633311001, 1.1052744250783981, 1.1169068025674793, 1.1285368537496163, 1.140140572145445, 1.1516951248872456, 1.1631788794730826, 1.1745714206448756, 1.1858535586919998, 1.1970073303589845, 1.2080159934077943, 1.2188640157581458, 1.229537060007356, 1.2400219640181054, 1.2503067181593517, 1.2603804396945792, 1.2702333447318823, 1.279856718083187, 1.289242881323475, 1.298385159295691, 1.3072778452710505 ], [ 0.8935153571727809, 0.8934728837971306, 0.8939993391105945, 0.8951037223540215, 0.8967929157645841, 0.8990715052040921, 0.9019416035346853, 0.9054026872383163, 0.9094514586787477, 0.9140817465000706, 0.919284454830924, 0.9250475685607342, 0.9313562176366852, 0.938192798877102, 0.9455371498967504, 0.9533667668531639, 0.9616570560353241, 0.9703816087707765, 0.9795124895063643, 0.9890205279347755, 0.9988756074126046, 1.0090469434160614, 1.0195033472472852, 1.0302134715420055, 1.0411460352936055, 1.052270027089412, 1.063554886060072, 1.0749706606893374, 1.086488146137278, 1.098079001112419, 1.1097158456029421, 1.1213723409577219, 1.1330232539083678, 1.1446445061558366, 1.156213211122953, 1.1677076994091828, 1.1791075343878792, 1.1903935192695918, 1.201547696826368, 1.2125533428394408, 1.2233949542012232, 1.2340582324772882, 1.2445300636174768, 1.2547984943998032, 1.2648527060971233, 1.274682985775436, 1.2842806955638446, 1.2936382401790953, 1.3027490329416942, 1.311607460484783 ], [ 0.8972001666849229, 0.8971953085833749, 0.897758504839667, 0.8988990588339889, 0.9006241764342047, 0.9029387678878682, 0.9058452508751936, 0.9093433675038424, 0.913430029842736, 0.9180992081689259, 0.9233418734931516, 0.9291460016939012, 0.9354966415759289, 0.9423760442633135, 0.9497638472481563, 0.9576373035630287, 0.9659715450396633, 0.9747398683264055, 0.9839140329833971, 0.9934645622298508, 1.0033610384813294, 1.0135723874513707, 1.0240671461456194, 1.0348137114615101, 1.0457805672887495, 1.0569364889847392, 1.0682507248905297, 1.079693155179778, 1.0912344288173552, 1.1028460797658208, 1.1145006238336, 1.126171637723212, 1.1378338219244628, 1.1494630491190725, 1.1610363997320123, 1.1725321861926918, 1.1839299673673602, 1.195210554502541, 1.2063560098868367, 1.2173496393021201, 1.2281759792008409, 1.2388207794178026, 1.249270982105941, 1.259514697477747, 1.269541176838326, 1.2793407833135053, 1.2889049606060996, 1.2982262000555977, 1.3072980062301591, 1.31611486124369 ], [ 0.9013665369396897, 0.9014022044824321, 0.9020045100528791, 0.9031830597594603, 0.9049453816302322, 0.9072967072128822, 0.9102397532089384, 0.9137745184988941, 0.9178981134733083, 0.9226046374364664, 0.9278851162847624, 0.9337275075062816, 0.9401167738471685, 0.9470350217136089, 0.9544616962170747, 0.9623738220638913, 0.9707462782535412, 0.979552094566579, 0.9887627587550115, 0.9983485248368649, 1.00827871463045, 1.0185220064115694, 1.0290467061926318, 1.0398209985328895, 1.0508131749718106, 1.0619918391416314, 1.0733260883841205, 1.08478567229793, 1.0963411291023906, 1.107963901042445, 1.1196264302960341, 1.1313022369939574, 1.1429659810365864, 1.1545935094039317, 1.1661618906173297, 1.1776494379337215, 1.1890357227476909, 1.2003015795518681, 1.2114291036712386, 1.222401642848321, 1.2332037836196668, 1.243821333293974, 1.2542412982210203, 1.2644518589310672, 1.2744423426271223, 1.284203193428181, 1.2937259406903077, 1.3030031656736494, 1.312028466776526, 1.3207964235216474 ], [ 0.9060094273228395, 0.9060886963592549, 0.90673267862012, 0.9079512777286671, 0.9097523366560943, 0.9121413977181945, 0.9151214621692305, 0.9186927675612465, 0.9228526021244648, 0.9275951733259644, 0.9329115430851849, 0.93878963599919, 0.945214320597686, 0.9521675581227265, 0.9596286092365822, 0.9675742866238137, 0.9759792405684697, 0.9848162649497083, 0.9940566123209446, 1.0036703084412288, 1.013626458501816, 1.0238935391179556, 1.0344396718045177, 1.0452328750663848, 1.0562412934002423, 1.0674334024416596, 1.0787781902300544, 1.0902453151355531, 1.1018052414242387, 1.1134293537542328, 1.1250900521129952, 1.136760828840684, 1.1484163294482737, 1.1600323989437287, 1.1715861153365528, 1.1830558119103243, 1.1944210897452157, 1.20566282184638, 1.2167631500980276, 1.2277054761234565, 1.238474446993606, 1.2490559365953022, 1.2594370233479373, 1.2696059648463713, 1.279552169909023, 1.2892661684247404, 1.2987395793195495, 1.3079650769048448, 1.3169363558211324, 1.3256480947551197 ], [ 0.9111224977895708, 0.9112486179528031, 0.9119370537717205, 0.9131979962849374, 0.9150395892459038, 0.9174676666129443, 0.920485490126327, 0.924093508092528, 0.928289156865771, 0.9330667232462857, 0.9384172800977229, 0.9443287003932462, 0.95078574804119, 0.9577702382275467, 0.965261256149527, 0.9732354209682734, 0.9816671813456013, 0.9905291296608294, 0.9997923235033248, 1.0094266049226468, 1.0194009098945969, 1.0296835623301883, 1.040242548605082, 1.0510457699774087, 1.0620612713941706, 1.0732574460861137, 1.0846032160532129, 1.096068189081711, 1.1076227933381837, 1.1192383908798087, 1.1308873716208405, 1.1425432294173732, 1.1541806219878783, 1.1657754163867309, 1.1773047217018908, 1.1887469105664674, 1.2000816309658353, 1.2112898096964946, 1.2223536486969735, 1.2332566153318678, 1.2439834275721857, 1.2545200348833212, 1.2648535955088465, 1.2749724507260725, 1.2848660965496517, 1.2945251532727893, 1.3039413331621736, 1.3131074065623662, 1.3220171666174698, 1.3306653927812528 ], [ 0.916698263356021, 0.9168746659076168, 0.917610548949815, 0.9189163747612794, 0.9208005656452485, 0.9232692185974867, 0.9263258216945488, 0.9299709962781808, 0.9342022884012456, 0.9390140283619657, 0.9443972699311292, 0.9503398128830501, 0.9568263052153024, 0.9638384159269155, 0.9713550657534022, 0.9793527017113708, 0.9878056013150409, 0.9966861934290725, 1.0059653844708958, 1.0156128807016782, 1.025597499378114, 1.0358874634078015, 1.046450675771806, 1.0572549713240966, 1.0682683446613213, 1.0794591536101896, 1.090796298541128, 1.1022493782217146, 1.1137888233005222, 1.125386008785195, 1.137013347064234, 1.1486443631341703, 1.1602537537433588, 1.17181743216059, 1.1833125602302283, 1.1947175692951393, 1.2060121714624163, 1.2171773625633617, 1.2281954180251784, 1.239049882733903, 1.2497255558310545, 1.2602084712548727, 1.2704858747135959, 1.2805461976654067, 1.2903790287790466, 1.2999750832613755, 1.3093261703638939, 1.3184251593188765, 1.327265943907408, 1.3358434058246889 ], [ 0.9227282554090516, 0.9229585593544074, 0.9237451025511969, 0.925098595067608, 0.9270277065420578, 0.9295387584747973, 0.9326354211784493, 0.9363184422509994, 0.9405854315891579, 0.9454307218127387, 0.9508453144526663, 0.9568169134976229, 0.963330040502952, 0.9703662202486603, 0.9779042230052524, 0.9859203485064244, 0.9943887372342222, 1.003281696075974, 1.012570027366983, 1.0222233524471582, 1.0322104229012372, 1.0424994144849256, 1.053058200300803, 1.0638546010695198, 1.0748566113651525, 1.0860326014849462, 1.0973514952420689, 1.1087829244408052, 1.1202973611453515, 1.1318662291080113, 1.143461995895982, 1.1550582473609818, 1.1666297461421966, 1.1781524758895368, 1.189603672849827, 1.200961846380731, 1.2122067898548192, 1.2233195832959411, 1.2342825889593212, 1.245079440931219, 1.2556950296887501, 1.266115482429768, 1.2763281398594442, 1.2863215300072783, 1.2960853395468428, 1.305610383002093, 1.3148885701488364, 1.3239128718579627, 1.3326772845779327, 1.341176793616885 ], [ 0.9292031732030499, 0.9294911878431825, 0.9303318191007645, 0.9317359930382105, 0.9337125859081624, 0.9362680954138435, 0.9394063209425675, 0.9431280820635244, 0.947431001284492, 0.9523093693463714, 0.95775410161915, 0.9637527848442238, 0.9702898061414966, 0.9773465514752623, 0.9849016585117627, 0.9929313084794089, 1.0014095426408458, 1.010308590751956, 1.0195992009886778, 1.0292509629700952, 1.0392326175088686, 1.04951234847783, 1.060058053658211, 1.0708375926359066, 1.0818190107659353, 1.0929707389702246, 1.1042617697087422, 1.1156618099021942, 1.1271414119132892, 1.13867208393245, 1.150226381278246, 1.161777980223186, 1.173301736001139, 1.1847737266513534, 1.196171284313283, 1.2074730155137188, 1.218658811890301, 1.2297098526802548, 1.2406086001767733, 1.2513387892232637, 1.2618854116830593, 1.2722346966929436, 1.282374087386504, 1.2922922146603266, 1.3019788684543578, 1.3114249669285518, 1.3206225238418785, 1.3295646143770117, 1.33824533960435, 1.3466597897415167 ], [ 0.9361130068902638, 0.9364627284851832, 0.937361077652489, 0.9388191555365939, 0.9408459947992851, 0.9434482121659764, 0.946629675579828, 0.9503912171342821, 0.9547304180617955, 0.9596414828124163, 0.9651152085320055, 0.9711390466244545, 0.9776972460572705, 0.9847710640046055, 0.9923390279110536, 1.0003772333872631, 1.0088596638046126, 1.0177585194779122, 1.027044546521896, 1.0366873575944338, 1.046655738660038, 1.0569179375594169, 1.0674419315419827, 1.0781956720264605, 1.0891473057331185, 1.100265372018227, 1.111518976773253, 1.1228779436597862, 1.134312943759369, 1.1457956049443134, 1.1572986024334009, 1.1687957320950928, 1.1802619681084112, 1.1916735065943145, 1.2030077967955786, 1.2142435613168323, 1.2253608068456314, 1.2363408266663583, 1.247166196157579, 1.2578207623357887, 1.2682896283789653, 1.2785591339363462, 1.2886168319096598, 1.29845146227862, 1.3080529234414302, 1.3174122414515441, 1.3265215374549666, 1.3353739935691145, 1.3439638173938389, 1.3522862053073483 ], [ 0.9434471140804223, 0.9438627140255568, 0.9448225893753676, 0.9463379660249958, 0.9484179740388468, 0.9510692847541622, 0.954295769246529, 0.9580982105037537, 0.9624740951159909, 0.9674174996655123, 0.9729190755325192, 0.9789661261818585, 0.9855427644895266, 0.9926301343837651, 1.0002066803483856, 1.008248449285902, 1.0167294110934153, 1.0256217865157489, 1.0348963730678828, 1.044522861877371, 1.054470140101033, 1.0647065750933433, 1.0752002777556713, 1.0859193435036263, 1.096832070090111, 1.1079071521510626, 1.1191138528322024, 1.130422153236125, 1.1418028807205096, 1.1532278172955426, 1.164669789523203, 1.1761027414204481, 1.1875017919197925, 1.1988432784496226, 1.2101047881689553, 1.221265178332906, 1.2323045871821854, 1.243204436647908, 1.2539474280482517, 1.2645175318307382, 1.2748999722884284, 1.2850812080539213, 1.2950489090556498, 1.3047919305090696, 1.3143002844136904, 1.3235651089367704, 1.3325786359870733, 1.341334157218154, 1.3498259886495543, 1.3580494340561742 ], [ 0.9511942361195747, 0.951680038129504, 0.9527053911846554, 0.9542815864961861, 0.9564177850998995, 0.9591206436240356, 0.9623939689451737, 0.9662384344546245, 0.9706513825376342, 0.9756267261091895, 0.9811549501562483, 0.9872232048345942, 0.9938154758559009, 1.0009128154613514, 1.0084936173167607, 1.0165339201730337, 1.0250077273152094, 1.0338873311550394, 1.0431436345259735, 1.0527464621907008, 1.0626648577330005, 1.0728673623849228, 1.0833222734649957, 1.0939978810082784, 1.1048626818918046, 1.1158855713321367, 1.1270360120855187, 1.1382841820376202, 1.149601101147387, 1.160958738920364, 1.1723301037401355, 1.1836893154891115, 1.1950116629467546, 1.2062736474699376, 1.2174530144410236, 1.228528773919795, 1.2394812118610432, 1.2502918931657336, 1.2609436577257698, 1.2714206105054564, 1.2817081065816547, 1.2917927319435552, 1.301662280735365, 1.311305729514732, 1.3207132089982163, 1.3298759736748338, 1.33878636959092, 1.3474378005449374, 1.3558246928792443, 1.3639424590173035 ], [ 0.9593424481435491, 0.9599028925154725, 0.9609977709561248, 0.9626383724774977, 0.9648338172367364, 0.9675906756971647, 0.9709126245087979, 0.9748001713876838, 0.9792504717520332, 0.9842572473026631, 0.9898108047460377, 0.9958981439470964, 1.0025031397908275, 1.0096067804392694, 1.0171874454086136, 1.0252212088705344, 1.0336821560005174, 1.042542702582733, 1.0517739102164148, 1.0613457912858495, 1.0712275993612461, 1.0813881019272873, 1.0917958333323203, 1.1024193266547775, 1.1132273238305843, 1.1241889639059286, 1.135273949698293, 1.1464526934840378, 1.1576964425967886, 1.1689773860275243, 1.180268743271393, 1.191544836773326, 1.2027811493885407, 1.2139543682991463, 1.2250424168185277, 1.2360244754755305, 1.2468809937054912, 1.257593693389842, 1.268145565385846, 1.2785208600772007, 1.288705072860145, 1.2986849253621968, 1.3084483430755507, 1.3179844299779544, 1.3272834406130247, 1.3363367500117618, 1.3451368217588993, 1.3536771744425, 1.3619523466733028, 1.369957860821232 ], [ 0.9678790475091943, 0.968518641638917, 0.9696871311696904, 0.9713957290540052, 0.9736534397755522, 0.976466676971967, 0.9798389253791397, 0.9837704781760125, 0.9882582701690318, 0.9932958142376754, 0.9988732366896138, 1.0049773989326383, 1.0115920887073278, 1.0186982633199169, 1.0262743286497684, 1.0342964400502952, 1.0427388138360563, 1.0515740404336889, 1.0607733923094675, 1.070307121454474, 1.0801447425538333, 1.0902552990478993, 1.100607610165351, 1.1111704977149253, 1.1219129919985753, 1.1328045166803107, 1.1438150528316844, 1.1549152826914881, 1.1660767139336423, 1.1772717854415515, 1.1884739557432855, 1.1996577753747941, 1.2107989445100666, 1.2218743572317747, 1.2328621338164503, 1.2437416423787386, 1.2544935111642528, 1.2650996327043185, 1.2755431609534704, 1.285808502426728, 1.2958813022426545, 1.3057484258647265, 1.3153979372213316, 1.3248190737769527, 1.3340022190274166, 1.3429388728018445, 1.351621619675874, 1.3600440957349993, 1.3682009538745985, 1.3760878277837785 ], [ 0.9767903963483302, 0.9775136521984491, 0.9787598094798233, 0.9805399272316602, 0.9828628192367379, 0.9857346751991592, 0.989158733084224, 0.9931350318714248, 0.9976602625711716, 1.0027277222613904, 1.0083273646062811, 1.0144459328532636, 1.0210671579557857, 1.0281720043454234, 1.0357389476803132, 1.0437442714947711, 1.0521623723266258, 1.0609660652368265, 1.0701268835515658, 1.0796153681740557, 1.0894013430040037, 1.0994541739456558, 1.1097430097415102, 1.1202370034863656, 1.1309055141869626, 1.1417182881589456, 1.1526456204107185, 1.1636584964634547, 1.1747287153053072, 1.1858289943802132, 1.1969330576710808, 1.2080157080558556, 1.2190528851951148, 1.230021710253936, 1.2409005187717468, 1.251668882974727, 1.2623076247804101, 1.272798820677104, 1.2831257995767198, 1.2932731346424995, 1.3032266299879065, 1.3129733030337039, 1.3225013632010436, 1.3318001875127872, 1.3408602935765317, 1.349673310333257, 1.3582319468772859, 1.3665299595874463, 1.3745621177566287, 1.3823241678671883 ], [ 0.9860617430587086, 0.9868731039879011, 0.9882008838395188, 0.990055908667016, 0.992446728983176, 0.9953792493058908, 0.9988564144884775, 1.0028779798026504, 1.0074403799765808, 1.0125366995638463, 1.0181567364007746, 1.0242871432505596, 1.0309116301112875, 1.0380112100785561, 1.0455644737846086, 1.0535478801787181, 1.0619360540740226, 1.0707020831454155, 1.0798178088515513, 1.0892541071265516, 1.0989811557372176, 1.1089686860188182, 1.1191862173560212, 1.1296032733128722, 1.140189578767523, 1.1509152377933924, 1.1617508923601103, 1.1726678622121045, 1.1836382665244096, 1.1946351281366414, 1.2056324613285903, 1.2166053442256253, 1.2275299770106374, 1.238383727172779, 1.2491451630445058, 1.2597940768696412, 1.2703114986102952, 1.2806797016428626, 1.2908822014175612, 1.3009037480660053, 1.3107303138420217, 1.3203490761761632, 1.3297483970185215, 1.338917799041181, 1.347847939174304, 1.3565305798609113, 1.3649585583375605, 1.3731257541821429, 1.3810270553171877, 1.3886583226171065 ], [ 0.9956770521817555, 0.9965808130873134, 0.9979939939395603, 0.999927110448376, 1.0023883821729664, 1.0053833747105863, 1.0089147027516707, 1.0129818184171528, 1.0175808975559621, 1.0227048244154542, 1.0283432652828257, 1.0344828158154749, 1.0411072047560743, 1.048197537520972, 1.0557325654668746, 1.0636889694272917, 1.0720416487223874, 1.0807640090044761, 1.0898282439644873, 1.09920560716703, 1.1088666712090218, 1.1187815721068748, 1.1289202373819318, 1.1392525967819256, 1.149748774976664, 1.1603792659161156, 1.1711150888470208, 1.1819279262549687, 1.192790244233944, 1.203675395985687, 1.2145577093164173, 1.2254125591292824, 1.2362164260069035, 1.246946942041327, 1.2575829250995625, 1.2681044027144177, 1.2784926267651093, 1.2887300800639225, 1.298800475897598, 1.3086887514895709, 1.3183810562557094, 1.3278647356263997, 1.337128311105417, 1.3461614571355343, 1.3549549752448429, 1.3635007658601213, 1.3717917980959389, 1.3798220777624326, 1.3875866137817738, 1.3950813831632012 ], [ 1.0056188711333705, 1.0066190968853586, 1.008121208728036, 1.010135339186074, 1.012669316041482, 1.015728320716707, 1.0193146099094714, 1.023427322244966, 1.0280623803558404, 1.0332124873261164, 1.0388672074910392, 1.0450131164144547, 1.0516340032980234, 1.0587111100887392, 1.0662233939192924, 1.0741478022554445, 1.0824595526411014, 1.0911324109753324, 1.1001389638005599, 1.1094508812110444, 1.1190391678162994, 1.1288743998160904, 1.1389269467354637, 1.1491671767785467, 1.1595656451166605, 1.1700932647449107, 1.1807214598283104, 1.1914223017165948, 1.2021686280355144, 1.2129341454612634, 1.2236935169523648, 1.234422434348999, 1.245097677353052, 1.2556971599733682, 1.2661999655611051, 1.2765863715709156, 1.2868378651681855, 1.2969371507631753, 1.3068681504936799, 1.3166159986022983, 1.3261670305672049, 1.3355087677503275, 1.3446298982283833, 1.35352025437438, 1.3621707876633395, 1.37057354108945, 1.3787216195049246, 1.3866091581254825, 1.3942312893943607, 1.4015841083567908 ], [ 1.0158682560714285, 1.0169687034943378, 1.018562962289109, 1.0206607158769232, 1.0232693477076424, 1.0263936185638864, 1.0300354078158407, 1.0341935377847489, 1.0388636896898338, 1.0440384091308617, 1.049707191004079, 1.0558566292002938, 1.06247061518021, 1.0695305706081244, 1.0770157015271908, 1.0849032641745944, 1.0931688349163509, 1.101786578700489, 1.1107295118634728, 1.1199697561606001, 1.1294787816363319, 1.139227636503704, 1.1491871626369825, 1.159328195645903, 1.169621748820886, 1.1800391805306962, 1.1905523449226865, 1.2011337260218007, 1.2117565555470806, 1.222394914961323, 1.2330238224386416, 1.2436193055746165, 1.2541584607731302, 1.2646195003228884, 1.2749817882254302, 1.2852258658563538, 1.2953334685348974, 1.305287534046312, 1.3150722041101277, 1.3246728197191742, 1.3340759111929783, 1.3432691836993385, 1.352241498903434, 1.3609828533089987, 1.3694843537644807, 1.3777381905219868, 1.3857376081608672, 1.393476874622862, 1.4009512485530948, 1.408156945101184 ], [ 1.0264047696033456, 1.0276088177561138, 1.029298069510822, 1.031481702012287, 1.0341666109026357, 1.0373571084265036, 1.0410546846503062, 1.0452578484888235, 1.0499620554313709, 1.0551597193837192, 1.0608402988626133, 1.0669904437625422, 1.073594187851977, 1.0806331731958985, 1.088086894841067, 1.0959329565274132, 1.104147330402666, 1.1127046155038767, 1.1215782911050816, 1.1307409619889202, 1.1401645933840463, 1.149820733813025, 1.159680724488459, 1.1697158942245434, 1.1798977391244936, 1.1901980865748343, 1.2005892433302867, 1.211044127708628, 1.221536386131177, 1.2320404944391061, 1.242531844585553, 1.252986817446684, 1.2633828426093854, 1.2736984460789387, 1.2839132869063001, 1.2940081837630246, 1.3039651324933748, 1.3137673156508225, 1.3233991049825422, 1.3328460577639647, 1.3420949078106401, 1.3511335519098033, 1.3599510323237447, 1.3685375159256659, 1.3768842704394249, 1.3849836381712328, 1.3928290075466028, 1.4004147827015556, 1.4077363513250227, 1.4147900509093827 ], [ 1.0372065525117855, 1.0385171448930692, 1.0403038215107776, 1.0425752059493325, 1.0453376718959544, 1.0485950631261611, 1.0523484744787288, 1.056596108253935, 1.0613332116787795, 1.0665520926891245, 1.0722422049377491, 1.0783902893730228, 1.0849805587672003, 1.0919949124775132, 1.0994131706289108, 1.1072133190969078, 1.1153717586890566, 1.1238635535696686, 1.1326626752128457, 1.1417422390631924, 1.1510747317220127, 1.1606322269449667, 1.1703865891015153, 1.1803096630517678, 1.1903734496692195, 1.200550266491667, 1.2108128932224964, 1.2211347020308747, 1.231489772809731, 1.241852993742296, 1.252200147697567, 1.2625079851205951, 1.2727542842021786, 1.2829178992038117, 1.292978797876891, 1.302918088950857, 1.312718040674289, 1.3223620913783043, 1.3318348529951638, 1.3411221084105138, 1.350210803458638, 1.3590890342904596, 1.3677460307582683, 1.376172136372891, 1.3843587853026036, 1.3922984768017748, 1.3999847473836442, 1.4074121409885674, 1.4145761773473504, 1.421473318699768 ], [ 1.0482504624535514, 1.0496700633018516, 1.0515561511318228, 1.053916759039453, 1.056757713711706, 1.0600823776634456, 1.0638914493486036, 1.0681828335565045, 1.0729515867775101, 1.0781899348987087, 1.0838873550373493, 1.0900307101447575, 1.096604424081022, 1.103590685573468, 1.110969671097635, 1.118719778639013, 1.1268178660995376, 1.1352394896113396, 1.1439591381667005, 1.1529504618115871, 1.1621864912542497, 1.17163984718578, 1.1812829379561225, 1.1910881445392896, 1.2010279919806226, 1.211075306760862, 1.2212033597416538, 1.231385994575615, 1.241597741669237, 1.2518139179756327, 1.2620107130633464, 1.2721652620541763, 1.2822557061450501, 1.292261241524847, 1.3021621575661362, 1.311939865214018, 1.321576916510709, 1.3310570161868154, 1.3403650262208522, 1.3494869642206213, 1.3584099964167469, 1.3671224259843995, 1.3756136773278087, 1.383874276877559, 1.391895830867168, 1.3996710004762833, 1.407193474656026, 1.414457940889953, 1.4214600540931954, 1.4281964038133714 ], [ 1.059512266111862, 1.061042831484578, 1.0630298524134878, 1.0654807448041577, 1.0684007718096982, 1.0717928081019763, 1.075657158217395, 1.0799914396079617, 1.0847905343571171, 1.0900466072160249, 1.0957491827931163, 1.1018852718953736, 1.108439536086273, 1.1153944800203939, 1.1227306624399742, 1.1304269183499192, 1.1384605864673178, 1.1468077373840138, 1.155443398932471, 1.1643417760306096, 1.1734764628577334, 1.1828206456441934, 1.192347294694562, 1.2020293445461467, 1.2118398614160342, 1.2217521973238976, 1.2317401305005968, 1.2417779919048515, 1.2518407778708733, 1.2619042490956855, 1.2719450163430621, 1.2819406133884768, 1.291869557853956, 1.3017114006816064, 1.3114467650682968, 1.3210573757323327, 1.330526079405603, 1.3398368574435122, 1.3489748314222925, 1.3579262625513653, 1.3666785456710389, 1.3752201985367245, 1.3835408470137924, 1.3916312067264962, 1.3994830616239902, 1.407089239849705, 1.4144435872303955, 1.4215409386405722, 1.428377087447927, 1.4349487532070782 ], [ 1.0709668680263762, 1.0726098310677112, 1.0746988351328768, 1.0772406618606596, 1.0802400020127496, 1.0836992411037403, 1.0876182949040278, 1.091994503900717, 1.0968225901306254, 1.102094674439748, 1.1078003480671212, 1.1139267899221876, 1.1204589199779145, 1.1273795794788202, 1.134669729688416, 1.1423086622414986, 1.1502742155141377, 1.1585429926056894, 1.1670905774802847, 1.1758917465468468, 1.1849206735077338, 1.1941511257256652, 1.2035566506912279, 1.2131107514520945, 1.2227870501131937, 1.2325594387468293, 1.2424022172698415, 1.2522902180527846, 1.2621989172229486, 1.2721045328062661, 1.281984110020123, 1.2918155941769984, 1.3015778917849787, 1.3112509205341383, 1.3208156489359366, 1.330254126435861, 1.3395495048481696, 1.348686051966356, 1.3576491581861958, 1.3664253369424724, 1.3750022197085765, 1.3833685462441658, 1.3915141507037085, 1.3994299441418245, 1.4071078938743353, 1.4145410000797192, 1.4217232699579463, 1.4286496897044862, 1.4353161945083321, 1.4417196367453788 ], [ 1.0825885589634172, 1.084344827843838, 1.0865363957860772, 1.089169401784717, 1.0922479620562637, 1.0957739760197776, 1.0997469777871849, 1.1041640409193259, 1.1090197394476813, 1.1143061636536509, 1.1200129855421415, 1.1261275666956585, 1.1326351002390203, 1.1395187787213648, 1.1467599804653483, 1.1543384679946929, 1.1622325932692406, 1.1704195054747124, 1.1788753579644604, 1.1875755116251867, 1.1964947324625277, 1.205607381611621, 1.2148875963078234, 1.2243094606313436, 1.2338471650870304, 1.2434751543089198, 1.2531682623945672, 1.2629018355793287, 1.2726518421545099, 1.2823949697146304, 1.2921087099847097, 1.3017714316263354, 1.3113624415488696, 1.320862035357341, 1.330251537650392, 1.3395133329392408, 1.348630887992116, 1.3575887664190436, 1.3663726363008228, 1.3749692716357929, 1.3833665483315847, 1.391553435410262, 1.399519982027169, 1.4072573008313618, 1.4147575481215129, 1.4220139011802257, 1.4290205331039378, 1.4357725853883494, 1.442266138481584, 1.4484981804805719 ], [ 1.0943512684455459, 1.0962212349091407, 1.0985154888055624, 1.101239525692093, 1.1043968907722999, 1.1079890039990552, 1.112015026352662, 1.1164717739145529, 1.1213536824151134, 1.126652821177072, 1.1323589523567585, 1.1384596293914913, 1.1449403276085626, 1.1517845998572618, 1.158974250516393, 1.1664895220321703, 1.174309289040316, 1.1824112559819724, 1.190772154867143, 1.1993679404523838, 1.2081739805923324, 1.217165239921539, 1.2263164553497852, 1.2356023021330682, 1.244997549530898, 1.2544772052888096, 1.2640166483996187, 1.2735917498000973, 1.283178980851932, 1.2927555096350136, 1.3022992852460398, 1.3117891104430819, 1.3212047031051035, 1.330526747082831, 1.3397369331021438, 1.3488179904423994, 1.3577537101504917, 1.366528960566656, 1.3751296959323638, 1.3835429588258126, 1.3917568771294917, 1.399760656180202, 1.4075445666889577, 1.4150999289493456, 1.4224190937830459, 1.429495420602867, 1.4363232529107368, 1.442897891492529, 1.449215565525367, 1.455273401777311 ], [ 1.1062288090398167, 1.1082123652909452, 1.1106089853695356, 1.113423527002123, 1.1166589726031315, 1.120316272147128, 1.124394223048912, 1.128889392706945, 1.1337960861295246, 1.1391063579575424, 1.1448100656494924, 1.1508949588374955, 1.157346798930136, 1.1641495028082338, 1.1712853047351865, 1.1787349311758257, 1.1864777839134932, 1.194492127554823, 1.202755278148345, 1.2112437901900672, 1.2199336397461074, 1.228800401802893, 1.2378194202761703, 1.246965969388746, 1.256215405375759, 1.2655433077053946, 1.274925609217341, 1.2843387147834944, 1.2937596082863299, 1.3031659478882929, 1.3125361497296062, 1.3218494603393118, 1.331086018173568, 1.3402269048041078, 1.3492541863670433, 1.3581509459471282, 1.3669013076146448, 1.3754904528522531, 1.3839046301082942, 1.3921311581933449, 1.4001584242008822, 1.4079758765839023, 1.415574013960839, 1.422944370159688, 1.4300794959429453, 1.4369729377910283, 1.443619214061413, 1.450013788787254, 1.4561530433347705, 1.462034246103787 ], [ 1.1181951034214146, 1.120291665139626, 1.12278991101114, 1.125694071773351, 1.1290065790433268, 1.1327279245566217, 1.1368565525072143, 1.1413887898261335, 1.1463188166010079, 1.1516386762886415, 1.1573383232340517, 1.163405703470822, 1.169826863880443, 1.176586084458667, 1.1836660285366811, 1.19104790617902, 1.1987116464941623, 1.2066360751470973, 1.2147990938939957, 1.2231778594370204, 1.231748959313467, 1.2404885828923014, 1.249372685862679, 1.2583771468742644, 1.2674779152376887, 1.2766511488227907, 1.2858733415064725, 1.2951214397237507, 1.3043729478654418, 1.3136060224430108, 1.3227995551042941, 1.3319332447311145, 1.3409876589795398, 1.3499442857337038, 1.3587855750336826, 1.367494972105715, 1.376056942168907, 1.3844569877169808, 1.3926816589772946, 1.400718558234813, 1.4085563386775097, 1.4161846983757427, 1.4235943699540783, 1.4307771064541648, 1.4377256638246851, 1.4444337804127843, 1.4508961537738518, 1.45710841506531, 1.4630671012471734, 1.4687696252785232 ], [ 1.1302243885123993, 1.1324329220146905, 1.1350316567952092, 1.138024211595829, 1.141412482171433, 1.1451965154997565, 1.1493744135010744, 1.1539422704129942, 1.158894145833136, 1.1642220733597368, 1.1699161029736136, 1.1759643739654748, 1.1823532143648459, 1.1890672624302994, 1.196089605722943, 1.2034019334953125, 1.2109846984834476, 1.2188172846101364, 1.2268781775367876, 1.2351451354090548, 1.2435953575125425, 1.2522056488877231, 1.2609525792509724, 1.2698126348371388, 1.2787623620253301, 1.2877785018373118, 1.2968381146117787, 1.3059186943586183, 1.3149982724861449, 1.324055510770682, 1.3330697836001761, 1.3420212496706931, 1.350890913444754, 1.3596606767917605, 1.3683133813221862, 1.3768328419977576, 1.3852038726489315, 1.3934123040593862, 1.4014449952854091, 1.4092898388679542, 1.4169357605690744, 1.4243727142250495, 1.431591672259327, 1.4385846123428128, 1.4453445006303274, 1.4518652719441962, 1.4581418072210606, 1.464169908489362, 1.4699462716037694, 1.4754684569305585 ], [ 1.1422913938030452, 1.1446104456943595, 1.1473081617755345, 1.1503875669739545, 1.153850038347805, 1.1576951929189265, 1.1619208017644114, 1.1665227339263982, 1.171494931982447, 1.1768294194244528, 1.1825163385074646, 1.1885440160700358, 1.1948990540392537, 1.2015664408985485, 1.208529680256509, 1.2157709327337987, 1.2232711676074508, 1.2310103209541634, 1.2389674573694498, 1.2471209326778, 1.255448555372904, 1.2639277448295703, 1.2725356846086615, 1.2812494694350234, 1.2900462446688226, 1.2989033373159067, 1.3077983778344202, 1.3167094121945717, 1.3256150038360703, 1.334494325342966, 1.3433272398172371, 1.352094372079343, 1.3607771699541096, 1.3693579560127107, 1.3778199702344425, 1.3861474041249287, 1.3943254268795602, 1.4023402042130444, 1.4101789104881974, 1.4178297347715425, 1.4252818814219443, 1.4325255657838165, 1.4395520055119628, 1.446353408003861, 1.4529229543606845, 1.459254780243909, 1.4653439539427846, 1.4711864519216162, 1.4767791320767232, 1.4821197049018464 ], [ 1.1543714931482694, 1.1567992211502363, 1.159594066661509, 1.1627584813329845, 1.1662933423219344, 1.1701978524732828, 1.1744694638518707, 1.1791038276887904, 1.1840947724274762, 1.1894343101803835, 1.1951126706738342, 1.2011183607590754, 1.207438246844512, 1.214057657153482, 1.2209605005006567, 1.228129398257741, 1.235545826292233, 1.2431902638640595, 1.2510423467148504, 1.2590810218567359, 1.2672847018432436, 1.2756314165743607, 1.2840989609458595, 1.29266503689812, 1.3013073886516013, 1.3100039301363204, 1.3187328638306486, 1.327472790422218, 1.3362028088892668, 1.3449026067745777, 1.3535525405847602, 1.3621337063938037, 1.3706280008601581, 1.3790181729794588, 1.3872878669895594, 1.3954216569193127, 1.4034050733277894, 1.4112246228157883, 1.4188678009079276, 1.4263230989022428, 1.4335800052674719, 1.4406290021382362, 1.4474615574185046, 1.4540701129568436, 1.4604480692067197, 1.4665897667342607, 1.4724904648875141, 1.4781463178976135, 1.4835543486450986, 1.4887124202950845 ], [ 1.166440830884107, 1.1689750348656016, 1.1718648401342886, 1.175112147265372, 1.1787173534476338, 1.1826792638275658, 1.1869950236276587, 1.191660073681062, 1.1966681309220224, 1.2020111942581326, 1.2076795752286988, 1.2136619519962821, 1.2199454445623577, 1.2265157086501435, 1.2333570454400715, 1.2404525242462894, 1.2477841152493205, 1.255332829516336, 1.263078863715614, 1.2710017471423736, 1.2790804889016607, 1.2872937233287918, 1.2956198519613968, 1.3040371806057593, 1.3125240502608528, 1.3210589608759709, 1.3296206871209346, 1.3381883855412327, 1.3467416926535085, 1.355260813708283, 1.3637266020061063, 1.372120628798451, 1.3804252439346991, 1.3886236275300023, 1.3966998330241964, 1.404638822078832, 1.4124264918168603, 1.4200496949481693, 1.4274962533440207, 1.4347549656264436, 1.441815609326241, 1.448668938137977, 1.4553066747650256, 1.4617214998055088, 1.4679070370836762, 1.4738578357844394, 1.4795693497035063, 1.485037913884753, 1.4902607188813293, 1.4952357828490968 ], [ 1.1784764241011736, 1.181114576625909, 1.1840968801633325, 1.1874247075101536, 1.1910979965578936, 1.1951151717100983, 1.1994730838062813, 1.2041669708370437, 1.2091904408526457, 1.214535477566029, 1.22019246830582, 1.2261502532415558, 1.232396194214393, 1.2389162610733861, 1.245695133134423, 1.2527163132291552, 1.259962251772282, 1.267414478322904, 1.2750537382269618, 1.282860132082988, 1.29081325595693, 1.2988923404717956, 1.3070763871053772, 1.315344300238837, 1.323675013706161, 1.3320476107971695, 1.3404414368628135, 1.348836203859722, 1.3572120863500854, 1.3655498086416793, 1.373830722909799, 1.3820368782868937, 1.390151081034826, 1.3981569460283545, 1.406038939874574, 1.4137824160714094, 1.4213736426682337, 1.4287998229329448, 1.4360491095534424, 1.4431106129084066, 1.449974403934081, 1.4566315120931632, 1.4630739189211373, 1.469294547587541, 1.4752872488677702, 1.481046783877836, 1.4865688038827032, 1.4918498274507372, 1.4968872151939514, 1.5016791423072884 ], [ 1.1904562434530879, 1.193195519398689, 1.1962675931172557, 1.1996733335686753, 1.2034122404420826, 1.2074823746532701, 1.2118803053641023, 1.2166010755032035, 1.2216381870616362, 1.2269836067070308, 1.232627791560249, 1.2385597343525614, 1.2447670266569497, 1.251235938477285, 1.2579515121860743, 1.264897668617542, 1.272057323035464, 1.2794125086886385, 1.2869445057247084, 1.2946339733400496, 1.3024610831853325, 1.3104056522125986, 1.3184472733304486, 1.3265654424228415, 1.3347396804788219, 1.3429496497713402, 1.3511752632107814, 1.3593967861802632, 1.3675949303340007, 1.3757509390048217, 1.3838466640211826, 1.3918646338759735, 1.3997881133176864, 1.4076011545474925, 1.4152886403027827, 1.422836319187069, 1.4302308336681815, 1.4374597412106456, 1.444511529035146, 1.4513756230084398, 1.4580423911634774, 1.4645031423330144, 1.4707501203539057, 1.4767764942658683, 1.4825763448907812, 1.4881446481393397, 1.4934772553534774, 1.4985708709577135, 1.5034230276619969, 1.5080320594337837 ], [ 1.2023592750847603, 1.2051965800726505, 1.208355453572153, 1.2118362849388882, 1.2156381569322947, 1.2197587843945514, 1.2241944677203, 1.2289400628355571, 1.233988968839117, 1.2393331338670992, 1.244963079162135, 1.2508679407949885, 1.257035528022365, 1.2634523968833684, 1.2701039373452816, 1.2769744721057694, 1.284047365037651, 1.2913051372148092, 1.2987295884726884, 1.306301922522376, 1.3140028737422176, 1.3218128339049786, 1.3297119772531172, 1.3376803825022265, 1.3456981505276508, 1.3537455166670052, 1.3618029567485024, 1.3698512861283927, 1.3778717511889778, 1.3858461129086304, 1.39375672226591, 1.4015865873793778, 1.409319432411122, 1.416939748374554, 1.424432836083804, 1.431784841562541, 1.4389827842936824, 1.446014578737839, 1.4528690495784051, 1.4595359411653435, 1.466005921630107, 1.4722705821320021, 1.4783224316746137, 1.4841548879020032, 1.4897622642507886, 1.4951397537989117, 1.5002834101169265, 1.505190125395216, 1.5098576060923512, 1.5142843463265971 ], [ 1.2141655662441035, 1.2170975637550998, 1.220340047611197, 1.223892951815575, 1.2277549634595613, 1.2319234687730565, 1.2363945124590827, 1.241162771807154, 1.2462215466262714, 1.2515627655563046, 1.2571770088358953, 1.263053547150554, 1.2691803957755998, 1.2755443828787811, 1.2821312305646464, 1.2889256470307167, 1.2959114280627126, 1.3030715660190049, 1.3103883644352745, 1.3178435564119446, 1.3254184250191667, 1.333093924059214, 1.3408507976551793, 1.348669697281177, 1.3565312950066315, 1.3644163918906758, 1.372306020628316, 1.3801815417146175, 1.3880247325535948, 1.3958178690932108, 1.4035437997139444, 1.4111860112346648, 1.4187286870240048, 1.4261567573164233, 1.4334559419288475, 1.440612785654758, 1.4476146866775557, 1.4544499183936088, 1.4611076450682818, 1.4675779317658235, 1.4738517489981153, 1.4799209725295246, 1.4857783787575956, 1.4914176360648745, 1.4968332925076082, 1.5020207601757427, 1.5069762965270384, 1.5116969829686466, 1.5161807009336012, 1.5204261056782238 ], [ 1.2258562569776492, 1.2288793941216967, 1.2322021021724474, 1.2358238838469968, 1.2397430516755503, 1.2439566806953681, 1.2484605731190157, 1.2532492362790242, 1.258315874785251, 1.2636523974378076, 1.269249439038489, 1.275096396856483, 1.2811814811450413, 1.287491778787794, 1.2940133288852234, 1.3007312088791538, 1.3076296296584058, 1.3146920379908527, 1.321901224582785, 1.3292394360700872, 1.3366884892905053, 1.3442298862651727, 1.3518449284230134, 1.3595148287272745, 1.3672208205031513, 1.37494426191403, 1.3826667351873727, 1.3903701398455213, 1.3980367793493025, 1.405649440710252, 1.4131914667683323, 1.4206468209644656, 1.4280001445586905, 1.43523680635435, 1.442342945084325, 1.4493055046967536, 1.4561122628434848, 1.4627518529251036, 1.4692137800816443, 1.4754884315390253, 1.4815670817289142, 1.4874418925960833, 1.4931059094939996, 1.4985530530491151, 1.5037781073490213, 1.5087767047820453, 1.5135453078276697, 1.518081188070712, 1.5223824026885169, 1.526447768640842 ], [ 1.2374136000709584, 1.240524132039544, 1.2439235027042705, 1.2476108072253798, 1.2515840044166457, 1.255839875429675, 1.2603739932737936, 1.265180704307319, 1.270253122539947, 1.2755831372632622, 1.2811614341927267, 1.286977529974075, 1.2930198195927372, 1.299275635937986, 1.3057313205229153, 1.3123723041541802, 1.3191831961856035, 1.3261478808791474, 1.3332496193336232, 1.3404711554237752, 1.3477948242140103, 1.3552026613671235, 1.3626765121525068, 1.3701981387643654, 1.3777493247827315, 1.3853119757439663, 1.3928682149277303, 1.4004004736114537, 1.4078915751866037, 1.415324812672036, 1.4226840192949295, 1.4299536319375423, 1.437118747366586, 1.4441651712689523, 1.4510794602123296, 1.457848956730186, 1.4644618177972364, 1.4709070370135293, 1.477174460852974, 1.4832547993557927, 1.4891396316557435, 1.4948214067328887, 1.5002934397736958, 1.5055499045038516, 1.5105858218380621, 1.5153970451671928, 1.5199802425783417, 1.5243328762798738, 1.528453179482085, 1.5323401309664122 ], [ 1.2488209711249456, 1.2520149843895496, 1.2554873010741456, 1.259236632064107, 1.2632606029592375, 1.2675557181626995, 1.2721173348145975, 1.2769396475622274, 1.2820156849175934, 1.2873373176869976, 1.29289527967782, 1.2986792006053118, 1.3046776508472375, 1.3108781974370467, 1.3172674704546863, 1.3238312387764244, 1.3305544939855187, 1.3374215411279164, 1.3444160949217645, 1.3515213799950114, 1.358720233728619, 1.3659952103196373, 1.3733286847432795, 1.3807029553812058, 1.3881003441890138, 1.3955032933949056, 1.4028944578492473, 1.4102567922771811, 1.4175736328209574, 1.4248287723912791, 1.4320065294760742, 1.4390918101778685, 1.4460701633653765, 1.452927828929398, 1.4596517792262558, 1.4662297538722031, 1.4726502881193304, 1.478902735096693, 1.484977282239928, 1.4908649622591825, 1.4965576590094622, 1.5020481086313886, 1.5073298963249155, 1.5123974491063998, 1.5172460248820379, 1.5218716981504588, 1.526271342625934, 1.5304426110527696, 1.5343839124626415, 1.5380943871104598 ], [ 1.2600628703891887, 1.2633363047255934, 1.2668777153754798, 1.2706854517059425, 1.2747568262042954, 1.279088083446152, 1.283674378044634, 1.288509762447608, 1.2935871852519882, 1.298898500483746, 1.3044344880568164, 1.3101848853821836, 1.3161384298582226, 1.3222829117436663, 1.3286052367025891, 1.335091497124836, 1.3417270511699704, 1.3484966083627943, 1.3553843204852845, 1.3623738764633246, 1.369448599935439, 1.376591548210968, 1.3837856113736868, 1.391013610358399, 1.398258392918468, 1.405502926507071, 1.4127303872098023, 1.4199242439878401, 1.4270683376152897, 1.434146953819161, 1.44114489025242, 1.448047517047983, 1.454840830811529, 1.4615115020125355, 1.4680469158238036, 1.4744352065391135, 1.4806652857656681, 1.4867268646419445, 1.4926104703729421, 1.4983074574036148, 1.503810013568642, 1.5091111615638075, 1.514204756082681, 1.519085476953764, 1.523748818599766, 1.5281910761238926, 1.5324093283100446, 1.5364014178056657, 1.5401659287395093, 1.5437021620121292 ], [ 1.2711249177209751, 1.2744735871431836, 1.2780801230036938, 1.2819425353285485, 1.286057843150198, 1.2904220478831043, 1.2950301149260708, 1.2998759642493276, 1.3049524705608813, 1.3102514734626483, 1.3157637978076833, 1.3214792842620005, 1.3273868298644405, 1.3334744381735066, 1.339729278397522, 1.3461377527314071, 1.3526855709748937, 1.3593578313880006, 1.3661391066522879, 1.3730135337519698, 1.3799649065664286, 1.3869767699729607, 1.3940325142927348, 1.4011154689700718, 1.4082089944514211, 1.4152965713217815, 1.422361885858979, 1.4293889112765692, 1.4363619840409632, 1.4432658747645852, 1.450085853291924, 1.456807747706687, 1.4634179970937655, 1.4699036979875952, 1.4762526445269686, 1.482453362414469, 1.4884951368450543, 1.4943680346231378, 1.5000629207299812, 1.5055714696342013, 1.5108861716582898, 1.5160003347241613, 1.5209080818027838, 1.5256043443878684, 1.5300848523037698, 1.534346120144389, 1.5383854306249036, 1.5422008151129025, 1.5457910315911196, 1.549155540291356 ], [ 1.281993841813838, 1.2854134544972033, 1.2890810481344606, 1.2929943149725165, 1.2971499997718423, 1.3015438771656709, 1.306170736585032, 1.311024375412519, 1.3160976008915046, 1.321382241162806, 1.3268691656311178, 1.332548314684632, 1.3384087386073564, 1.344438645341797, 1.350625456585724, 1.356955871547093, 1.3634159375412542, 1.3699911264990026, 1.3766664163655995, 1.3834263763114953, 1.3902552546445464, 1.3971370683106783, 1.4040556928918342, 1.410994952054688, 1.4179387054671555, 1.4248709342785093, 1.4317758233500757, 1.438637839523056, 1.4454418053151088, 1.4521729675451391, 1.4588170604934882, 1.4653603633097825, 1.4717897514814118, 1.4780927422694907, 1.4842575341049304, 1.4902730400135815, 1.4961289152051773, 1.501815579015644, 1.50732423143599, 1.512646864493743, 1.5177762687752696, 1.5227060353905428, 1.5274305536868802, 1.531945005016747, 1.5362453528580937, 1.5403283295756744, 1.5441914200998808, 1.5478328427869128, 1.5512515277119694, 1.5544470926362903 ], [ 1.2926574646447986, 1.2961436419091272, 1.2998681445350813, 1.303828367914375, 1.3080208012214967, 1.3124410083748872, 1.31708361598305, 1.32194230885517, 1.3270098335414604, 1.332278010237207, 1.3377377532394532, 1.3433790999901214, 1.3491912485785325, 1.3551626034146858, 1.3612808286279598, 1.3675329085998829, 1.3739052149089528, 1.380383578854969, 1.3869533686432085, 1.3935995702464559, 1.4003068709265916, 1.4070597443861939, 1.413842536532997, 1.4206395508735747, 1.427435132604848, 1.4342137505397994, 1.4409600760835108, 1.447659058565406, 1.4542959963290454, 1.460856603080272, 1.467327069094892, 1.4736941169858717, 1.4799450518255077, 1.486067805507818, 1.492050975319172, 1.4978838567593875, 1.5035564707203501, 1.5090595851839332, 1.5143847316452947, 1.519524216501951, 1.5244711276734655, 1.5292193367323943, 1.5337634968350866, 1.5380990367426464, 1.5422221512188394, 1.5461297880849718, 1.549819632202515, 1.5532900866441999, 1.5565402513042665, 1.5595698991893068 ] ], "zauto": true, "zmax": 1.5595698991893068, "zmin": -1.5595698991893068 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.07397288403207367, 0.07281092000768513, 0.07178452211837297, 0.07087814101218405, 0.07007777096087545, 0.0693718393512555, 0.06875192597455188, 0.0682132742099661, 0.06775507312766206, 0.06738050385980554, 0.06709655483264883, 0.06691361930666481, 0.06684489651034872, 0.06690562594754011, 0.06711219413879843, 0.06748116395654281, 0.06802828725347597, 0.06876756884226587, 0.06971045077027249, 0.07086517774718877, 0.072236387100485, 0.07382494205310773, 0.07562800002561018, 0.07763928348432086, 0.07984950404115722, 0.08224688322164572, 0.0848177151163859, 0.08754692463509764, 0.09041858710088144, 0.09341638750969132, 0.096524008862686, 0.09972544750571112, 0.10300525917536621, 0.10634874278458266, 0.10974207045156317, 0.11317237248231679, 0.11662778546931049, 0.12009747074806859, 0.12357160941381454, 0.12704137909245564, 0.13049891676045705, 0.13393727114429912, 0.13735034760156656, 0.1407328478770496, 0.14408020671779007, 0.1473885269996274, 0.15065451474559954, 0.15387541518794262, 0.15704895082852033, 0.16017326227855916 ], [ 0.07106262073373794, 0.06991229692988613, 0.06890427386080909, 0.06802190626486881, 0.06725013465676728, 0.06657645094598134, 0.0659916737278331, 0.06549049199656101, 0.06507175592064217, 0.06473850979238094, 0.06449777485442641, 0.0643600993574825, 0.06433890162493375, 0.06444964081697244, 0.0647088604904731, 0.06513316157934858, 0.06573817208515678, 0.06653758727515448, 0.0675423529570891, 0.0687600530758974, 0.07019454167460146, 0.07184583145028274, 0.07371022221451977, 0.07578062842043273, 0.07804704982829756, 0.08049712483284961, 0.08311671067344288, 0.08589044561150183, 0.08880226163937942, 0.09183582942036751, 0.0949749280853914, 0.09820374046553591, 0.10150707937595232, 0.10487055319761909, 0.10828067989582434, 0.1117249583979924, 0.1151919054304762, 0.11867106483733916, 0.12215299529521581, 0.12562924131824352, 0.12909229156854526, 0.13253552776177693, 0.135953166871921, 0.13934019887297996, 0.14269232188298964, 0.1460058762751812, 0.14927777907290835, 0.15250545973403987, 0.15568679824579632, 0.15882006628460757 ], [ 0.06830278537860213, 0.06716549357339802, 0.06617792467961812, 0.06532238183153455, 0.06458277790511026, 0.06394567877979168, 0.06340113450803651, 0.06294325361577646, 0.06257049910337795, 0.06228570368179742, 0.062095815923411964, 0.06201139957211786, 0.062045917310351965, 0.062214839782641064, 0.06253463161233068, 0.06302167788773458, 0.06369122470881027, 0.0645564121869686, 0.06562747412338182, 0.0669111635210212, 0.06841043821774782, 0.07012441056841356, 0.07204853548677015, 0.07417498827424802, 0.07649317125331793, 0.07899028686609876, 0.08165192242429704, 0.08446260447256365, 0.0874062950639726, 0.09046681535512366, 0.09362819226427876, 0.09687493105691647, 0.1001922209237374, 0.10356608254507936, 0.10698346701106846, 0.11043231491417686, 0.11390158341972084, 0.11738124796309576, 0.12086228410418003, 0.1243366340808113, 0.12779716177609168, 0.13123759914556518, 0.13465248661984616, 0.1380371095798538, 0.14138743266919857, 0.14470003343850513, 0.14797203659100264, 0.1512010499035238, 0.1543851027221855, 0.1575225877709832 ], [ 0.06570233025546257, 0.06457898791595577, 0.0636135429143687, 0.06278731808604074, 0.0620832455998733, 0.0614869882341212, 0.06098782545479806, 0.06057925578314018, 0.060259294299247, 0.06003046599133547, 0.05989951160975397, 0.05987683429679113, 0.05997572497240724, 0.06021141441715811, 0.060600011108159234, 0.06115739516927452, 0.06189814745617941, 0.06283459490378679, 0.06397604538881305, 0.06532826631923143, 0.0668932331288587, 0.06866914208289449, 0.0706506529134199, 0.07282930644864233, 0.07519405342339233, 0.07773183261265378, 0.08042814638342445, 0.0832675957742579, 0.08623435170144896, 0.08931255140721205, 0.09248661864992541, 0.09574151225768308, 0.09906291100789244, 0.10243734408488771, 0.10585227632575665, 0.109296156680599, 0.11275843720706422, 0.1162295687558568, 0.11970097843016657, 0.12316503298206852, 0.12661499155680572, 0.13004495059838064, 0.13344978326145004, 0.13682507530703308, 0.14016705916660477, 0.1434725476186924, 0.14673886831710672, 0.14996380022774541, 0.15314551286328432, 0.15628250904678043 ], [ 0.06326941831435243, 0.06216037319585637, 0.06121820945122289, 0.06042337085736376, 0.05975787825411855, 0.05920652780663052, 0.05875783016941158, 0.05840463803993311, 0.058144441584835616, 0.0579793364450747, 0.05791568707095592, 0.05796352092714279, 0.05813569943511209, 0.05844692167427888, 0.05891262758790306, 0.059547877427907916, 0.060366290300943454, 0.061379123104055876, 0.06259455902673312, 0.0640172520028044, 0.06564814329809357, 0.0674845347426666, 0.0695203764895499, 0.07174671043934172, 0.0741522053176238, 0.07672372439056172, 0.0794468785002384, 0.08230653154494422, 0.08528723947078781, 0.08837361528499176, 0.0915506207875875, 0.09480379077665224, 0.0981193980173572, 0.10148456802287874, 0.10488735235725637, 0.10831676826459857, 0.11176281131547808, 0.11521644665669749, 0.11866958346596476, 0.12211503639011916, 0.12554647708519184, 0.12895837845886762, 0.13234595381301753, 0.13570509276756107, 0.13903229559202285, 0.14232460735748786, 0.14557955313406934, 0.1487950752869288, 0.1519694737606042, 0.1551013500833021 ], [ 0.06101138400129615, 0.059916325571179686, 0.058997987160013005, 0.05823606704387516, 0.05761176759520111, 0.057109067835167726, 0.05671571306527869, 0.05642386472926297, 0.05623039094946082, 0.056136807281579465, 0.056148897682579656, 0.0562760597488952, 0.05653042907777932, 0.056925847496298296, 0.05747674944098262, 0.05819704837240305, 0.059099107596306544, 0.06019287382425875, 0.06148523536483033, 0.06297964104916254, 0.06467598508029256, 0.06657073309430196, 0.068657241729392, 0.07092621156360433, 0.07336621189164685, 0.07596422323293694, 0.07870615603974072, 0.08157731813232229, 0.08456281618186698, 0.0876478865958591, 0.09081815803300636, 0.09405985180296958, 0.09735992824393652, 0.10070618752948231, 0.10408733284555385, 0.10749300295194197, 0.11091378009667326, 0.11434117825703247, 0.11776761581826518, 0.12118637609446564, 0.12459155853757709, 0.12797802304662137, 0.13134132945225496, 0.13467767398487424, 0.1379838243148961, 0.1412570545638745, 0.14449508151182935, 0.14769600306112832, 0.15085823985562916, 0.15398048079345528 ], [ 0.0589347449435502, 0.057852630568810015, 0.056957956108566535, 0.05622984182972878, 0.055648788364743275, 0.055198018897118485, 0.05486451598002023, 0.05463969135545406, 0.05451967039803159, 0.05450520632312883, 0.054601262458752825, 0.05481631623490278, 0.055161449501341255, 0.05564929875068437, 0.05629294619244683, 0.057104836713703075, 0.05809580367442689, 0.05927427562608393, 0.060645715749871994, 0.06221231830491116, 0.06397295644095076, 0.06592334916861357, 0.06805639688622009, 0.07036262690421369, 0.07283069228099047, 0.07544787627032139, 0.07820056724866978, 0.08107468196496109, 0.08405602617873419, 0.08713059020558521, 0.09028478245427157, 0.09350560714199577, 0.09678079365337412, 0.10009888510115701, 0.1034492930741482, 0.10682232469267341, 0.11020918717014695, 0.1136019742303671, 0.11699363801045055, 0.1203779494998917, 0.12374945011380235, 0.12710339664893885, 0.1304357015983979, 0.1337428705807279, 0.13702193845187272, 0.14027040549887626, 0.14348617495229918, 0.14666749289358472, 0.14981289147110594, 0.15292113617401354 ], [ 0.057045269890531644, 0.05597427487745306, 0.055102322346019715, 0.05440815660891641, 0.053871716884699446, 0.053475542187413155, 0.05320585158892995, 0.05305323284347994, 0.053012922172987205, 0.05308469645500788, 0.053272425174195094, 0.053583346049113544, 0.05402713888687054, 0.054614879426359425, 0.05535795908524486, 0.05626705613535741, 0.05735123664997951, 0.05861724812970052, 0.060069045636166954, 0.06170756265045311, 0.06353071155777806, 0.06553357659125741, 0.06770874864687977, 0.0700467475387877, 0.0725364815793076, 0.07516570398998587, 0.07792143743711054, 0.08079034938290744, 0.08375907037959532, 0.08681445429202629, 0.089943783795127, 0.09313492681355903, 0.096376450433544, 0.09965769876130023, 0.10296884065458542, 0.10630089250866501, 0.10964572051654893, 0.1129960261406301, 0.11634531796591374, 0.11968787265620208, 0.12301868738808981, 0.12633342587047844, 0.12962835984588061, 0.13290030779327777, 0.13614657239408823, 0.13936487817090307, 0.14255331055536233, 0.14571025748275826, 0.1488343544456251, 0.1519244337678046 ], [ 0.05534810109359328, 0.054285602113586455, 0.05343459954487925, 0.052773697751510515, 0.05228243760612043, 0.05194275454797013, 0.05174009832093107, 0.051664141214996455, 0.051709058382319165, 0.05187340757018099, 0.05215966484869625, 0.05257349044183436, 0.053122808495293466, 0.05381678919302316, 0.05466482167876743, 0.055675560800103455, 0.05685611850804667, 0.0582114516126905, 0.05974397322539566, 0.06145338914509843, 0.06333673702086565, 0.06538858908023022, 0.06760137052329306, 0.0699657451744719, 0.07247102578062684, 0.0751055757637585, 0.07785717968860231, 0.08071336927327036, 0.08366169939674, 0.08668997393164109, 0.08978642454684464, 0.09293984732160261, 0.09613970258651369, 0.0993761832941569, 0.10264025675772417, 0.10592368400463548, 0.10921902040799643, 0.11251960074863314, 0.11581951144676446, 0.11911355238163855, 0.12239719047321657, 0.1256665070111883, 0.12891814056284523, 0.13214922715515265, 0.13535733929443816, 0.13854042525034072, 0.14169674988390688, 0.14482483814103997, 0.1479234221626984, 0.1509913927850378 ], [ 0.05384791950551573, 0.05279052035051, 0.05195785110523457, 0.051328643977139474, 0.050882225929615076, 0.05060001741374981, 0.05046668760434457, 0.05047088577295161, 0.05060553211134795, 0.050867700603167525, 0.05125815892879093, 0.05178064861920695, 0.0524409969032395, 0.05324615294756909, 0.05420323663172085, 0.055318677553479155, 0.0565975055304594, 0.058042832415614025, 0.05965554100073751, 0.06143417359181425, 0.0633749939661013, 0.06547218426988137, 0.06771813371214101, 0.07010377773466481, 0.07261895269870317, 0.07525273971399944, 0.07799378005400816, 0.08083055230741622, 0.08375160736000874, 0.08674576138132804, 0.0898022494474615, 0.09291084365226733, 0.09606193994598482, 0.09924661783268551, 0.10245667670867463, 0.10568465219851755, 0.10892381543918923, 0.11216815792038937, 0.11541236422155403, 0.11865177478644287, 0.12188234072779196, 0.12510057253900958, 0.12830348448962106, 0.13148853638212002, 0.13465357423968471, 0.13779677137054272, 0.14091657111285402, 0.14401163240398196, 0.14708077914258724, 0.15012295412531662 ], [ 0.05254912971859983, 0.05149273639870171, 0.05067496645571782, 0.05007497541862154, 0.049672080286351866, 0.04944728312641653, 0.04938445792007887, 0.049471111810783105, 0.04969870189084614, 0.050062543305953916, 0.05056137992830238, 0.05119670757513509, 0.05197194615354506, 0.05289155480102415, 0.053960175067517414, 0.055181872457707365, 0.0565595272808003, 0.05809440357529456, 0.05978590255350486, 0.06163148748392211, 0.06362675259056741, 0.06576560059657578, 0.06804049178490172, 0.07044273059134155, 0.07296276192617493, 0.07559045679264849, 0.0783153738896054, 0.08112698986792541, 0.08401489539650996, 0.08696895720637825, 0.08997944806255215, 0.09303714748499282, 0.09613341631438428, 0.09926024815139203, 0.10241030047341576, 0.10557690796828342, 0.10875408038447197, 0.1119364870090553, 0.1151194297508449, 0.11829880671687247, 0.12147106810975959, 0.1246331662249687, 0.127782501275727, 0.1309168647082429, 0.1340343815830051, 0.13713345348564263, 0.1402127032924182, 0.14327092295303775, 0.1463070252715486, 0.1493200004703358 ], [ 0.05145603017995606, 0.0503959788884721, 0.049588931150723256, 0.04901478249832821, 0.04865306098994121, 0.048484456246982374, 0.04849203397076032, 0.04866203710792757, 0.048984249574586664, 0.049451957848655824, 0.05006158419287853, 0.05081208457952457, 0.051704209174570144, 0.05273971781416742, 0.05392063028355219, 0.0552485735171042, 0.056724267091608584, 0.05834716690263321, 0.06011526720118383, 0.06202504542410789, 0.06407152384983474, 0.06624841732618142, 0.0685483364125928, 0.07096301886815355, 0.07348356791658263, 0.07610068173320872, 0.0788048641297274, 0.08158661091141126, 0.08443656967609584, 0.08734567299867972, 0.0903052462162182, 0.09330709165318454, 0.09634355133970088, 0.09940755026390548, 0.10249262209375289, 0.10559291918338924, 0.10870320858590093, 0.11181885574103104, 0.11493579749014299, 0.11805050607889762, 0.12115994582550614, 0.12426152414379185, 0.12735303860323213, 0.13043262167337605, 0.1334986847322565, 0.13654986281580603, 0.13958496144913135, 0.14260290673492443, 0.14560269968517367, 0.14858337557707121 ], [ 0.050572925533795464, 0.04950416190688919, 0.048703038855192816, 0.04815052049953949, 0.047826580827052614, 0.04771171493004554, 0.047788176725155965, 0.0480408327275815, 0.04845759829117759, 0.049029485730404464, 0.049750335144922754, 0.05061631927882606, 0.051625317906243286, 0.052776249975816286, 0.05406843705650483, 0.055501052618523346, 0.05707269104068104, 0.05878107043163042, 0.060622866506487294, 0.06259366233258638, 0.06468799132527406, 0.06689944812623849, 0.0692208429633256, 0.07164437848416032, 0.07416183260750436, 0.07676473562617413, 0.07944453395372764, 0.08219273620437473, 0.08500103966585028, 0.0878614367706274, 0.09076630207342408, 0.09370846069952922, 0.09668123941326202, 0.09967850150199618, 0.10269466666909312, 0.10572471713106883, 0.10876419114365246, 0.1118091652417209, 0.11485622656099273, 0.1179024367007801, 0.12094528867166837, 0.12398265853558639, 0.12701275337719706, 0.1300340572374532, 0.13304527658877152, 0.13604528683651612, 0.1390330811963994, 0.1420077231276394, 0.14496830330482852, 0.14791390189630535 ], [ 0.049904135290433575, 0.048821436903266825, 0.0480209882010167, 0.047485150016458755, 0.04719458654506032, 0.047129731836181174, 0.047272044830017054, 0.047604929529614086, 0.04811427187497818, 0.048788609750225025, 0.04961899704748816, 0.05059864574430235, 0.05172243536886358, 0.05298637218920141, 0.0543870656741977, 0.05592127109852889, 0.05758552772577988, 0.059375904268101375, 0.06128784901824041, 0.06331613208036871, 0.0654548615652412, 0.06769755387018653, 0.07003723924316366, 0.07246658662608188, 0.07497803529643873, 0.07756392433703672, 0.08021661400632259, 0.08292859545462028, 0.08569258691786831, 0.0885016156156663, 0.09134908522830504, 0.09422882917636793, 0.09713515010344614, 0.1000628460620625, 0.10300722398657677, 0.10596410113701703, 0.10892979532570164, 0.11190110489022718, 0.1148752795400689, 0.11784998336391801, 0.12082325142541875, 0.12379344148233412, 0.1267591824282403, 0.12971932107006318, 0.13267286881671914, 0.13561894976505795, 0.13855675153367158, 0.14148548002011346, 0.14440431905161757, 0.1473123956738902 ], [ 0.04945385995768238, 0.04835208677104461, 0.04754681296268789, 0.04702210845350243, 0.04675957524120255, 0.04673973901916879, 0.04694331303094318, 0.04735219705791053, 0.04795014238519216, 0.04872307794902662, 0.04965914074805608, 0.05074848115837764, 0.051982923141555205, 0.0533555551179553, 0.05486031448954805, 0.056491611830143104, 0.0582440231074537, 0.06011206247158731, 0.06209003566378426, 0.06417196557519432, 0.06635157677099503, 0.06862232423057497, 0.07097745223254409, 0.0734100713119481, 0.07591324375785635, 0.07848007064408404, 0.08110377556382241, 0.08377778193084746, 0.08649578191211116, 0.08925179584427492, 0.09204022146876761, 0.0948558726060616, 0.09769400707268859, 0.10055034379103181, 0.10342106919403715, 0.10630283320367447, 0.10919273526607852, 0.11208830114911554, 0.11498745143507651, 0.11788846285537732, 0.12078992379938365, 0.12369068547215241, 0.12658981026601232, 0.12948651894265925, 0.13238013819415015, 0.13527005006512177, 0.1381556445804044, 0.1410362767404021, 0.14391122883159543, 0.1467796787629432 ], [ 0.049225884813724446, 0.04810023550742576, 0.04728461338506368, 0.04676507672391372, 0.04652440811704232, 0.046543399108640485, 0.04680211048299851, 0.04728095800132091, 0.04796152823932857, 0.048827090067804925, 0.04986281887409685, 0.051055785116225, 0.05239477520573836, 0.05387001411697705, 0.05547285027792092, 0.057195449008764394, 0.05903052500376327, 0.06097112989160562, 0.06301049936365269, 0.06514195631517856, 0.06735886174491723, 0.06965460319444776, 0.07202261048830118, 0.07445638967969935, 0.07694956777343602, 0.0794959425313823, 0.08208953319641789, 0.08472462917847498, 0.08739583461940963, 0.09009810734229352, 0.09282679107334509, 0.09557764008123387, 0.09834683557646409, 0.10113099340147318, 0.10392716274830154, 0.10673281587596453, 0.1095458290613441, 0.11236445529396051, 0.11518728949994297, 0.1180132273361079, 0.1208414188145653, 0.1236712181878524, 0.1265021316342426, 0.1293337643269858, 0.13216576844869965, 0.13499779362588143, 0.13782944111538672, 0.14066022288416694, 0.14348952649758023, 0.1463165864829607 ], [ 0.04922313226803909, 0.048069379784690815, 0.047238090293750576, 0.046717538823355595, 0.046491916435182926, 0.04654247571687129, 0.04684877032821112, 0.04738982776557014, 0.04814512997485761, 0.049095330372334746, 0.05022269100401385, 0.05151126729841885, 0.05294689438818526, 0.05451703861387451, 0.05621057454830485, 0.05801753685690939, 0.05992888221769556, 0.06193628276067902, 0.06403196103369195, 0.06620856815257568, 0.06845910151285634, 0.07077685571838713, 0.07315539952337774, 0.07558857190001908, 0.07807049126344894, 0.08059557299931584, 0.0831585514932088, 0.08575450373233948, 0.08837887220678298, 0.09102748530543077, 0.09369657373233968, 0.09638278171973454, 0.09908317203398921, 0.10179522399610923, 0.10451682398833494, 0.10724624819884929, 0.10998213766176919, 0.11272346596605021, 0.11546950031754483, 0.11821975692460492, 0.1209739519222079, 0.1237319492384133, 0.12649370692977255, 0.12925922356359784, 0.13202848620388496, 0.13480142146774513, 0.13757785096808392, 0.14035745225674864, 0.14313972614341852, 0.14592397100357396 ], [ 0.04944711120003898, 0.04826179026757866, 0.0474099272596243, 0.04688217572472923, 0.04666433664854115, 0.0467383352005792, 0.047083417491457544, 0.04767740057589554, 0.048497819352380546, 0.04952285713017728, 0.05073200458117773, 0.05210644626337492, 0.053629212962118235, 0.05528515808995198, 0.057060819929083545, 0.05894422410598275, 0.0609246680037159, 0.062992515162835, 0.0651390157139307, 0.06735615968498766, 0.0696365637939563, 0.07197338866798308, 0.07436028169452008, 0.07679134025872988, 0.07926109041075252, 0.08176447663174127, 0.08429685906926228, 0.08685401524930043, 0.08943214378930929, 0.09202786803555338, 0.09463823785782013, 0.09726072809506225, 0.09989323239248966, 0.10253405143073027, 0.10518187483473196, 0.10783575636668247, 0.11049508234580421, 0.1131595335845592, 0.11582904146765811, 0.11850373910861675, 0.12118390878076045, 0.1238699270211527, 0.126562208936201, 0.12926115329127946, 0.13196708994268683, 0.1346802310729614, 0.13740062752830046, 0.14012813134153354, 0.142862365270112, 0.14560269990150174 ], [ 0.04989734591935015, 0.048677870166296766, 0.047801109144322916, 0.047260179043579646, 0.047042654255059276, 0.04713135125601454, 0.04750545677279225, 0.04814183432036214, 0.04901632455376986, 0.05010488329081661, 0.05138445983924467, 0.05283358360335232, 0.05443267981930878, 0.05616416701155439, 0.058012400039726124, 0.05996351915783791, 0.062005254107183466, 0.06412671837520634, 0.0663182158120974, 0.06857107144286485, 0.07087749094140804, 0.07323044854413514, 0.07562360058037071, 0.07805122064709524, 0.08050815220453764, 0.08298977459927644, 0.08549197895215913, 0.08801115081517473, 0.09054415692576594, 0.09308833374774063, 0.09564147579577335, 0.09820182201989652, 0.10076803880307576, 0.10333919841830405, 0.1059147521117537, 0.10849449732561266, 0.11107853894014055, 0.113667244784861, 0.11626119602575613, 0.11886113335984214, 0.12146790022284475, 0.12408238442478349, 0.126705459761493, 0.12933792920160692, 0.13198047121778497, 0.13463359072263775, 0.1372975758932193, 0.13997246193597765, 0.1426580025725557, 0.14535364973267706 ], [ 0.05057088647149936, 0.049315582911345426, 0.04841029380424303, 0.04785060041698679, 0.04762596625903504, 0.04772031216859393, 0.048113048624761644, 0.04878040841894395, 0.049696873500756564, 0.050836500104053654, 0.05217400276175951, 0.05368553242540203, 0.055349150389792205, 0.05714504373484044, 0.05905554762690183, 0.06106504072964123, 0.06315977001010091, 0.06532764708135035, 0.06755804426006885, 0.06984160692387364, 0.07217009019809599, 0.0745362222927374, 0.07693359338202105, 0.07935656712575663, 0.08180021120219237, 0.08426024311345674, 0.08673298773130483, 0.08921534338276259, 0.09170475363073456, 0.09419918224230427, 0.09669708915121765, 0.09919740552308239, 0.10169950633853367, 0.1042031792348867, 0.10670858869730256, 0.10921623506500056, 0.11172690820775354, 0.1142416361183821, 0.11676162904031331, 0.11928822008638586, 0.12182280358791212, 0.12436677262625911, 0.1269214573318535, 0.12948806558165743, 0.1320676276853918, 0.13466094652837532, 0.13726855444483807, 0.13989067784425444, 0.14252721032165036, 0.14517769466947414 ], [ 0.051461996933240856, 0.050170059069803485, 0.04923335547053613, 0.04864985720526023, 0.048410978652205665, 0.048501937848997784, 0.04890266734380146, 0.04958913607769025, 0.050534864159659985, 0.05171240214396313, 0.05309459674849998, 0.054655545533658936, 0.05637122138277735, 0.05821980347767741, 0.060181779760694325, 0.062239891664804266, 0.0643789838221058, 0.0665858073679288, 0.06884881064927821, 0.0711579384114925, 0.0735044508583435, 0.07588076729901845, 0.07828033488152829, 0.08069752051559717, 0.0831275229146092, 0.08556630126723871, 0.08801051705211171, 0.09045748571903266, 0.09290513525407906, 0.09535196896335323, 0.0977970301302143, 0.10023986652404537, 0.1026804930735132, 0.10511935137231494, 0.10755726506436689, 0.10999539055539129, 0.11243516290964056, 0.1148782371993328, 0.11732642596244984, 0.11978163377249673, 0.12224579021329632, 0.12472078276737168, 0.1272083912564582, 0.12971022551124567, 0.13222766789437165, 0.1347618221616988, 0.13731346993309088, 0.13988303577074723, 0.14247056154919882, 0.1450756904663885 ], [ 0.052562088073040185, 0.05123346216908874, 0.05026318949046776, 0.04965148929101489, 0.04939173327475274, 0.04947059577632217, 0.04986882234302944, 0.05056250186872358, 0.05152462345696018, 0.05272666753280666, 0.0541400208358322, 0.0557370869619557, 0.0574920511160476, 0.05938132405234128, 0.061383727082558806, 0.0634804912722527, 0.06565513846312276, 0.0678932982954049, 0.07018250015056406, 0.07251196530648416, 0.07487241393906513, 0.07725589403118781, 0.07965563429751187, 0.0820659202606394, 0.08448199101237606, 0.08689995347181277, 0.08931671075273205, 0.0917299013391131, 0.09413784599520567, 0.09653949962821146, 0.09893440564216155, 0.10132265066083809, 0.10370481785638504, 0.10608193750184657, 0.10845543377095274, 0.11082706723250771, 0.11319887291953132, 0.11557309427994243, 0.11795211371786028, 0.12033838079294255, 0.12273433944088143, 0.12514235579519922, 0.12756464831705136, 0.1300032219696876, 0.13245980810753247, 0.13493581159280005, 0.13743226641720774, 0.13994980080951744, 0.14248861247141995, 0.14504845422641002 ], [ 0.05385991371211285, 0.052495142219208965, 0.05148981623867156, 0.050846211855386396, 0.05055961305322108, 0.05061826584980204, 0.05100399103889123, 0.051693370288095036, 0.052659297198508905, 0.053872632815191245, 0.05530373157571427, 0.05692368216940288, 0.05870519930330183, 0.060623176908664075, 0.06265495829447287, 0.06478039590516116, 0.06698177124561144, 0.06924363345806947, 0.07155259990115491, 0.07389714792605813, 0.07626741562172738, 0.07865502095099865, 0.08105290306361791, 0.08345518604484545, 0.08585706333243467, 0.0882547000047338, 0.09064514973177971, 0.09302628313197628, 0.09539672442637365, 0.09775579353693803, 0.10010345108628456, 0.10244024410345531, 0.10476725061661354, 0.10708602171715376, 0.10939852010782083, 0.11170705459356774, 0.11401421042681859, 0.1163227758628414, 0.11863566569757109, 0.12095584292925851, 0.12328623998767838, 0.1256296811935748, 0.12798880823439224, 0.1303660104637938, 0.13276336175190573, 0.13518256543768925, 0.13762490867715077, 0.14009122715954264, 0.14258188079998324, 0.14509674063449202 ], [ 0.05534200077283168, 0.05394205029775372, 0.05290076330347793, 0.05222225050348298, 0.0519036197021098, 0.05193475546133914, 0.05229877084968311, 0.05297307778179539, 0.05393088736979212, 0.055142881798506294, 0.056578810003422034, 0.05820882969655014, 0.06000450978018122, 0.0619394870448486, 0.06398982302248821, 0.06613413011342383, 0.06835353814513871, 0.07063156264387675, 0.07295392174631898, 0.0753083344490552, 0.0776843209799573, 0.08007301709813557, 0.08246700788042834, 0.08486018249678569, 0.08724760902866635, 0.08962542703659272, 0.09199075494521723, 0.0943416091127189, 0.09667683150624566, 0.09899602310758816, 0.10129948046222144, 0.10358813312951005, 0.10586348017767837, 0.1081275242867974, 0.11038270247004685, 0.11263181288915666, 0.11487793771143899, 0.11712436241677868, 0.11937449239391003, 0.12163176804565312, 0.12389957993255278, 0.12618118570626288, 0.12847963070526522, 0.13079767409935733, 0.1331377223758244, 0.13550177176660821, 0.13789136093606294, 0.1403075349024538, 0.14275082077667392, 0.1452212154938776 ], [ 0.056993245425449035, 0.05555934389899751, 0.054481657106667226, 0.0537658955519291, 0.05341086978217527, 0.05340812187092514, 0.053742219236809545, 0.05439168845446598, 0.055330426928877983, 0.05652934656913796, 0.05795799811306504, 0.059585983148065694, 0.06138404796687332, 0.06332483530141768, 0.06538332737620191, 0.0675370428605509, 0.06976605700976574, 0.07205290736865363, 0.07438243452102072, 0.07674159356778516, 0.07911925993548599, 0.08150604369724082, 0.08389411982029418, 0.0862770772082036, 0.08864978654254763, 0.09100828525440718, 0.09334967707570135, 0.0956720432486583, 0.09797436241445244, 0.10025643633638284, 0.10251881886593961, 0.10476274589062608, 0.10699006438857843, 0.109203159143569, 0.11140487613480124, 0.11359844209736018, 0.11578738023709695, 0.11797542256028701, 0.12016641972338606, 0.12236424970008156, 0.12457272688092472, 0.12679551344684942, 0.1290360349785366, 0.13129740227143077, 0.13358234122134657, 0.13589313243545803, 0.13823156192286257, 0.1405988838485177, 0.14299579591911354, 0.14542242753640572 ], [ 0.05879759002804471, 0.05733109083696345, 0.05621692939542754, 0.05546218384800385, 0.05506722543776203, 0.05502522999155991, 0.05532232377439991, 0.055938369647791954, 0.056848261396836595, 0.05802350116478631, 0.059433814218743025, 0.061048599552831435, 0.06283809385021025, 0.06477420699208813, 0.06683104815476042, 0.06898519592005345, 0.07121577743107081, 0.07350441826535845, 0.07583511390476248, 0.07819406082112702, 0.08056947330353662, 0.0829514025090805, 0.08533156705158954, 0.08770319946243749, 0.09006090959797151, 0.09240056406502656, 0.0947191796014935, 0.09701482779088483, 0.09928654830347615, 0.10153426790708937, 0.10375872269320746, 0.10596138126867069, 0.10814436703966378, 0.11031037814441942, 0.11246260405947094, 0.11460463839719755, 0.11674038791343612, 0.11887397823410077, 0.12100965726763545, 0.1231516976733635, 0.12530430008258445, 0.12747149900063234, 0.1296570734397085, 0.13186446433624058, 0.13409670069242022, 0.1363563361572065, 0.1386453974426776, 0.14096534557906787, 0.14331705057244343, 0.14570077957149244 ], [ 0.06073869791299273, 0.05924098032158583, 0.05809054253116017, 0.05729561213181727, 0.056857968920591584, 0.05677236408812603, 0.057026533022486496, 0.05760183160452871, 0.05847439454409786, 0.05961661685454294, 0.060998725831443994, 0.06259024032727392, 0.06436118240195546, 0.0662829828932149, 0.06832908459292805, 0.07047528530914926, 0.07269987946008188, 0.07498365740428463, 0.0773098135341331, 0.07966380271965973, 0.08203317334796283, 0.08440739557823601, 0.08677769601067521, 0.08913690462988486, 0.09147931626145255, 0.09380056645742754, 0.09609752033244028, 0.09836817211628203, 0.10061155285918998, 0.10282764367820067, 0.10501729207204828, 0.1071821290987297, 0.10932448556669808, 0.11144730581314798, 0.11355405811219689, 0.11564864125479797, 0.11773528735237007, 0.1198184614169677, 0.12190275873975652, 0.1239928015031132, 0.12609313639718148, 0.12820813524911776, 0.13034190079730018, 0.1324981797449069, 0.13468028510652477, 0.13689102962561772, 0.13913267170537827, 0.14140687488338358, 0.14371468141927043, 0.14605650008439983 ], [ 0.06280055983282715, 0.06127296735624961, 0.06008665436331721, 0.05925080065707862, 0.05876844135743822, 0.058635819265754105, 0.058842282386769654, 0.059370775407179936, 0.060198852816478556, 0.061300043555456644, 0.06264535324995694, 0.06420470521697132, 0.06594817749342585, 0.06784696301168348, 0.069874041338182, 0.07200459187584281, 0.07421619907849115, 0.0764889047923122, 0.07880515763489293, 0.08114969971062766, 0.08350942051878736, 0.08587319855821605, 0.08823174362203613, 0.09057744717840154, 0.09290424429963895, 0.09520748798041707, 0.09748383503595501, 0.09973114181178303, 0.1019483674536815, 0.10413548232848585, 0.10629337925025359, 0.10842378538419113, 0.11052917302826694, 0.11261266787935158, 0.11467795385403033, 0.1167291740334819, 0.1187708278164135, 0.12080766487187784, 0.12284457696105162, 0.12488648911926445, 0.12693825203304615, 0.12900453769056144, 0.13108974051152705, 0.13319788616489836, 0.13533255015794782, 0.1374967880361933, 0.13969307868575662, 0.14192328180149388, 0.14418861010416317, 0.14648961638948355 ], [ 0.06496798923920499, 0.06341180205548226, 0.06219016955460834, 0.06131305074623128, 0.060784588388409264, 0.060602416762151015, 0.06075746267237575, 0.06123430237040501, 0.062012028179489746, 0.06306548383157809, 0.06436667674277058, 0.06588617781078164, 0.06759436274093164, 0.06946241052368746, 0.071463033214406, 0.07357095409115325, 0.07576317543934714, 0.07801908561406824, 0.08032045297080982, 0.08265134677761614, 0.08499801598647355, 0.08734874791165625, 0.08969372144093797, 0.09202486366278477, 0.09433571461373176, 0.0966213019639675, 0.09887802556746558, 0.10110355064150642, 0.10329670769908907, 0.10545739708141479, 0.10758649591669144, 0.10968576549116783, 0.11175775730764521, 0.11380571649007082, 0.11583348164295815, 0.1178453807678191, 0.11984612335260082, 0.12184068926064845, 0.1238342155279465, 0.12583188260580816, 0.12783880193614056, 0.12985990699591976, 0.13189985007947921, 0.13396290709120706, 0.13605289249518362, 0.13817308631904177, 0.14032617475261172, 0.14251420544131604, 0.14473855807904648, 0.14699993038785836 ], [ 0.06722698680552566, 0.06564342113795167, 0.06438715118736646, 0.06346876677406275, 0.06289338042655097, 0.0626599091452193, 0.06276079720608835, 0.06318225200186631, 0.06390496896954732, 0.0649052323649585, 0.0661562238948555, 0.06762936289455326, 0.06929553299487802, 0.0711261026576482, 0.0730937011751746, 0.0751727546624174, 0.07733981333443844, 0.07957371319863026, 0.08185561636073675, 0.08416896898612948, 0.08649940817736645, 0.0888346409500581, 0.09116431133515818, 0.09347986587249267, 0.09577442341618733, 0.09804265206817926, 0.10028065394586673, 0.10248585713543482, 0.1046569133830214, 0.10679359967675667, 0.10889672176032066, 0.11096801771235039, 0.11301005996950267, 0.11502615452340637, 0.11702023645192401, 0.11899676142664664, 0.12096059334614534, 0.1229168887530565, 0.12487097917633293, 0.12682825297162437, 0.12879403858712124, 0.1307734914365934, 0.13277148669769223, 0.13479252036064093, 0.13684062072724398, 0.1389192723089814, 0.14103135371120118, 0.14317909064157613, 0.14536402467470064, 0.1475869978740851 ], [ 0.06956497357179339, 0.06795519990443165, 0.06666508897777466, 0.06570573608725704, 0.06508309771724777, 0.06479726226380794, 0.06484211157878612, 0.06520545072117953, 0.0658696001777274, 0.06681236258894555, 0.06800821987734719, 0.0694295999901956, 0.07104807266293589, 0.07283537661160605, 0.07476422935947302, 0.07680891255285738, 0.07894565396603308, 0.08115284209936799, 0.08341111329155237, 0.08570334849188863, 0.08801461068629006, 0.09033204683769615, 0.0926447714852188, 0.09494374349169052, 0.09722164300863735, 0.09947275246142713, 0.10169284306118741, 0.10387906681887973, 0.10602985308550839, 0.10814480812023534, 0.11022461598041335, 0.11227093904985347, 0.11428631671278454, 0.11627406099604273, 0.11823814840603988, 0.12018310765066015, 0.12211390343224682, 0.12403581699948736, 0.12595432462611553, 0.127874975615646, 0.12980327178763873, 0.13174455065867588, 0.13370387467158273, 0.13568592883726247, 0.13769492903114575, 0.1397345429360817, 0.14180782526042263, 0.14391716840717314, 0.14606426925705066, 0.14825011218858924 ], [ 0.07197090520540532, 0.07033607759475169, 0.06901303624314999, 0.06801327700333781, 0.06734348723661272, 0.06700481717971273, 0.06699249525969761, 0.06729586697967191, 0.06789886595632558, 0.06878085135676726, 0.06991769051421137, 0.07128294272647119, 0.07284901085563167, 0.07458816120535573, 0.07647335486741395, 0.07847887302661488, 0.08058074764818467, 0.0827570258751266, 0.08498790311048532, 0.08725575931341394, 0.08954512860799224, 0.0918426262674959, 0.0941368510091604, 0.09641827511422166, 0.09867913048423058, 0.10091329538007118, 0.10311618414792606, 0.10528464055143577, 0.1074168342370376, 0.10951215921805682, 0.11157113295921603, 0.11359529459071156, 0.1155871009151328, 0.11754981914283384, 0.11948741566357772, 0.12140444060259636, 0.12330590838830406, 0.12519717504884686, 0.12708381342719566, 0.1289714879317834, 0.1308658307948829, 0.13277232206996537, 0.13469617574269593, 0.13664223434520711, 0.13861487434513683, 0.14061792433440035, 0.14265459768165809, 0.1447274408596767, 0.14683829814339752, 0.14898829283000156 ], [ 0.07443528732179891, 0.0727765773081826, 0.07142163693815991, 0.07038227503891835, 0.06966580913063958, 0.06927434629954174, 0.06920436521448978, 0.069446678730591, 0.06998679647585788, 0.07080564062366171, 0.07188051478490079, 0.0731861991390064, 0.07469604759863727, 0.07638298819659174, 0.07822036425590533, 0.08018259004476352, 0.08224562324167503, 0.08438727493476748, 0.08658738674646706, 0.08882790640430056, 0.09109289038786333, 0.09336845744352394, 0.0956427113449566, 0.09790564620772826, 0.10014904337226427, 0.10236636547427125, 0.1045526507788987, 0.10670440904453875, 0.10881951896501249, 0.11089712648583522, 0.11293754289247956, 0.11494214143999329, 0.11691325136737121, 0.11885404836538878, 0.12076844090244403, 0.12266095222491889, 0.12453659830602609, 0.1264007624905622, 0.12825906804367215, 0.13011725023113385, 0.1319810299096822, 0.13385599086393968, 0.1357474632718175, 0.1376604156991185, 0.1395993579112825, 0.14156825654937033, 0.14357046536167814, 0.14560867123349813, 0.14768485674407034, 0.1498002794347414 ], [ 0.07695011467645671, 0.07526874487441228, 0.07388306779808086, 0.07280513192720146, 0.07204279558267176, 0.0715990238412566, 0.07147144811552837, 0.07165226589567072, 0.0721285078561501, 0.07288264130888206, 0.0738934289575542, 0.0751369327961147, 0.07658754936713752, 0.07821898044838044, 0.08000507333576806, 0.08192049733715434, 0.0839412506402404, 0.08604501092447174, 0.08821135370937085, 0.09042186610660712, 0.09266018263801375, 0.09491196619190223, 0.09716485258551814, 0.09940837258346094, 0.1016338611261163, 0.10383436016464949, 0.10600451890478409, 0.1081404933581273, 0.11023984577783646, 0.11230144370171226, 0.11432535783908153, 0.11631275783424, 0.11826580495168479, 0.12018754090374467, 0.12208177233677475, 0.12395295087161003, 0.1258060490252637, 0.12764643279357485, 0.12947973211915878, 0.13131171087680174, 0.13314813835199635, 0.13499466444300848, 0.13685670096231647, 0.13873931143566567, 0.14064711168998303, 0.1425841832880463, 0.1445540015199946, 0.14655937922027418, 0.1486024271710618, 0.1506845313117981 ], [ 0.07950875665955297, 0.07780603067400728, 0.07639092046256452, 0.07527565229999322, 0.07446854601342404, 0.07397333261562183, 0.07378870040134351, 0.07390814382878508, 0.07432014770435284, 0.07500868849963468, 0.07595398848039919, 0.07713342832410301, 0.07852251549366797, 0.080095816990392, 0.08182778925555495, 0.08369346645054697, 0.0856689942153275, 0.08773201539039546, 0.08986192608291411, 0.09204002579416713, 0.09424958589383561, 0.09647585838769433, 0.09870604319261533, 0.10092922804928181, 0.10313631138543188, 0.10531991518931301, 0.10747429235731903, 0.1095952310186235, 0.11167995693581537, 0.11372703414013842, 0.11573626339165599, 0.11770857777903716, 0.1196459347246361, 0.1215512037842408, 0.12342804988336258, 0.12528081197547383, 0.1271143775089905, 0.12893405351785137, 0.13074543557532048, 0.13255427624325622, 0.134366354982093, 0.1361873517354885, 0.13802272654759198, 0.13987760759586482, 0.14175668992149368, 0.14366414691472942, 0.14560355627481703, 0.1475778417330954, 0.1495892313297601, 0.15163923250088907 ], [ 0.0821058091299565, 0.08038313580814332, 0.07894004587174906, 0.0777888906084875, 0.07693838075813492, 0.07639292809007336, 0.07615218528412447, 0.07621085446283242, 0.07655880020421818, 0.07718145910768406, 0.07806049603064583, 0.07917462729976063, 0.08050051935577486, 0.08201367721802041, 0.08368925583753478, 0.08550275180056255, 0.08743055659506822, 0.08945037167090437, 0.0915414982229354, 0.09368502130999841, 0.09586390990645961, 0.09806305335474841, 0.1002692518565563, 0.10247117515383312, 0.10465930008034212, 0.10682583457776752, 0.10896463322309351, 0.1110711073317264, 0.11314213124056371, 0.11517594536425667, 0.11717205597768167, 0.11913113133476387, 0.12105489362484749, 0.12294600633936431, 0.1248079568290593, 0.12664493413690536, 0.12846170256018347, 0.1302634717951398, 0.1320557649192011, 0.13384428583984703, 0.13563478815874794, 0.13743294764004116, 0.13924424061234084, 0.14107383066057763, 0.1429264658688711, 0.14480638866035547, 0.14671725995407994, 0.14866209894092375, 0.15064323929496903, 0.15266230211385765 ], [ 0.08473692920509082, 0.08299584030744454, 0.08152637941289571, 0.08034097716831175, 0.07944867204469422, 0.07885447796974476, 0.07855892381646053, 0.07855783065219046, 0.07884236431503422, 0.0793993633868358, 0.08021190494787321, 0.08126004166688994, 0.08252162964250717, 0.08397316793931302, 0.0855905845724662, 0.08734992410591239, 0.08922791337508866, 0.09120240004669192, 0.09325267179444212, 0.0953596715755878, 0.09750612770196025, 0.09967661740493101, 0.10185758066469422, 0.10403729822564868, 0.1062058446525271, 0.10835502441734365, 0.11047829655568177, 0.11257069146452003, 0.11462872192362253, 0.11665028935906392, 0.11863458566654242, 0.1205819905084628, 0.12249396383281912, 0.12437293338197299, 0.12622217712095848, 0.12804570077933294, 0.1298481110332932, 0.13163448522389, 0.1334102388824854, 0.13518099268738176, 0.13695244077888016, 0.13873022258950865, 0.14051980048176504, 0.14232634551265216, 0.14415463355489536, 0.14600895379936005, 0.14789303135045667, 0.14980996522303158, 0.15176218257895835, 0.1537514095326789 ], [ 0.08739866589465732, 0.08564082704171436, 0.08414676110917926, 0.08292893804821944, 0.08199666715075483, 0.08135549200056698, 0.0810067341785818, 0.08094724695876347, 0.0811694170939625, 0.08166142085896878, 0.08240770701271487, 0.08338965204095238, 0.0845863175497501, 0.08597523775300452, 0.08753317457341664, 0.089236794517361, 0.09106324027539585, 0.09299058703777405, 0.09499818656206925, 0.09706691043966276, 0.09917930823206718, 0.10131969718209856, 0.10347419915008668, 0.1056307382343034, 0.10777900991314554, 0.1099104299516888, 0.1120180690034038, 0.11409657692327034, 0.1161420993155429, 0.11815218774277766, 0.12012570427380569, 0.12206272059163963, 0.12396441166360585, 0.1258329439461623, 0.12767135821252848, 0.12948344731394765, 0.13127362948072693, 0.13304681810516125, 0.134808289295172, 0.13656354881642785, 0.13831820032548472, 0.14007781701310812, 0.14184781890569914, 0.14363335809883282, 0.14543921411250693, 0.14726970136224837, 0.14912859044138319, 0.1510190445228762, 0.15294357173607262, 0.15490399388124892 ], [ 0.09008829590352545, 0.08831551116281637, 0.08679876114617198, 0.08555051948689625, 0.08458031469302672, 0.08389415304106243, 0.08349407009934602, 0.08337786740387493, 0.08353907201668927, 0.08396712965560499, 0.08464781255205309, 0.08556379777450875, 0.08669535565873274, 0.08802108344398223, 0.08951862519942556, 0.09116533229370764, 0.09293883486358953, 0.09481751036063751, 0.09678084795669269, 0.09880971640251342, 0.10088654795552361, 0.10299545292837328, 0.10512227917797513, 0.1072546293210909, 0.10938184631387465, 0.11149497574618535, 0.11358671106835468, 0.11565132613911204, 0.1176845980146583, 0.11968372178876101, 0.12164721851072298, 0.12357483670724248, 0.12546744776806215, 0.1273269353782919, 0.12915607925092218, 0.13095843359373904, 0.13273820100162015, 0.13450010276645089, 0.13624924691305165, 0.1379909955726495, 0.1397308335696087, 0.1414742402990926, 0.14322656709359613, 0.14499292230038036, 0.14677806621158707, 0.14858631780312564, 0.1504214749538553, 0.15228674944704704, 0.15418471762181576, 0.15611728706826852 ], [ 0.09280367080831306, 0.0910178815785642, 0.08948051754812732, 0.08820402397437963, 0.08719810149114285, 0.08646915708857669, 0.08601986622697683, 0.08584889797443555, 0.08595083987354656, 0.08631633645731335, 0.08693242949967481, 0.08778306474329983, 0.08884971372271237, 0.09011205286841167, 0.09154864508998932, 0.09313757908468749, 0.09485703529102615, 0.09668576145534824, 0.09860345286934113, 0.10059104128333961, 0.10263090210272399, 0.10470699217158716, 0.10680493096808194, 0.10891203714074561, 0.11101733065282472, 0.11311150885202864, 0.11518690286183964, 0.11723741897826039, 0.11925846833719358, 0.12124688701427194, 0.12320084791618308, 0.1251197652875853, 0.127004192350348, 0.12885571247135172, 0.13067682428233343, 0.13247082131439908, 0.1342416669275872, 0.13599386558136398, 0.13773233177618677, 0.13946225827205713, 0.14118898543200367, 0.14291787372412657, 0.144654181526247, 0.14640295039810358, 0.1481688999091112, 0.14995633393336183, 0.15176906005328086, 0.15361032336172978, 0.15548275553788574, 0.15738833961819884 ], [ 0.09554307926083712, 0.09374635824751995, 0.09219058998927061, 0.09088816223834674, 0.08984890454569998, 0.08907956711080804, 0.08858339557932661, 0.08835984921339768, 0.08840449765492782, 0.08870911239136589, 0.0892619465817277, 0.09004817571079969, 0.09105045581632973, 0.09224954832084915, 0.0936249611134043, 0.09515556283384065, 0.09682013858474675, 0.09859786768862618, 0.10046871538323981, 0.10241373919166294, 0.10441531668056449, 0.10645730463054648, 0.10852514082929052, 0.11060589940681054, 0.11268830945544768, 0.11476274508338632, 0.11682119336753936, 0.11885720510347714, 0.12086583190581103, 0.12284355213533575, 0.12478818732171944, 0.1266988101919412, 0.1285756450733206, 0.130419961280317, 0.1322339600807822, 0.1340206559359955, 0.13578375288776143, 0.13752751719519324, 0.1392566475753344, 0.14097614464909147, 0.14269118141263912, 0.1444069767226371, 0.14612867388294548, 0.1478612264371381, 0.14960929319667085, 0.1513771443669377, 0.1531685803772851, 0.15498686468748096, 0.1568346714490889, 0.15871404846707532 ], [ 0.09830512591340779, 0.09649966702116039, 0.09492783157479384, 0.0936019231622771, 0.09253186042728981, 0.091724683304559, 0.09118414204072295, 0.09091041218476263, 0.09089996897750414, 0.0911456386084943, 0.09163682440967619, 0.09235988700779016, 0.09329864244169049, 0.094434933757536, 0.09574923032774423, 0.09722121409059213, 0.0988303209591368, 0.10055621637097635, 0.10237919426685738, 0.1042804973289369, 0.10624256247039864, 0.10824919934358616, 0.1102857113914042, 0.11233896923043639, 0.11439744544959488, 0.11645121867850985, 0.11849195335479175, 0.12051286021822594, 0.12250864131216548, 0.12447542224036455, 0.12641067363009703, 0.12831312318126564, 0.13018265931361964, 0.13202022723065052, 0.1338277181676722, 0.13560785265160705, 0.13736405874102034, 0.13910034640821814, 0.14082117944376207, 0.1425313464820236, 0.1442358329409125, 0.14593969581866842, 0.14764794337790954, 0.149365421758509, 0.15109671048800122, 0.15284602869863692, 0.15461715361763226, 0.15641335258148203, 0.1582373294517452, 0.16009118589804777 ], [ 0.10108862735256649, 0.09927673228847363, 0.09769127889604598, 0.09634446208076948, 0.09524625275253278, 0.09440393076420883, 0.09382168924371909, 0.09350034952197651, 0.09343721810894967, 0.09362610389159373, 0.09405749705265512, 0.09471889423082891, 0.0955952403394734, 0.09666944858880751, 0.09792295756467614, 0.09933628718615009, 0.10088956240830449, 0.10256298263065795, 0.10433722403969123, 0.10619377019777379, 0.10811517236622523, 0.11008524514687151, 0.11208920525294792, 0.11411376197951337, 0.11614716768606165, 0.11817923573711846, 0.12020133219153349, 0.12220634631551526, 0.1241886438621518, 0.1261440060908358, 0.12806955672717354, 0.1299636784915426, 0.13182592043901348, 0.13365689713171394, 0.13545818058005968, 0.13723218591316283, 0.13898205184319923, 0.14071151714652191, 0.14242479457002633, 0.14412644376031347, 0.14582124498314195, 0.14751407553137522, 0.14920979079412452, 0.1509131119651304, 0.15262852229626375, 0.1543601736497156, 0.15611180487279155, 0.15788667322101382, 0.15968749970217674, 0.16151642882394243 ], [ 0.1038925243905446, 0.10207658670829088, 0.10048005965847198, 0.09911500685099087, 0.09799141733582768, 0.09711676441899218, 0.09649562602710286, 0.09612940211875937, 0.09601615852265084, 0.09615061557596565, 0.09652428566868787, 0.09712574877479008, 0.09794104198424738, 0.09895413011148481, 0.10014742073131541, 0.10150228833363226, 0.1029995775554852, 0.10462006299793877, 0.10634485131274699, 0.10815571875006864, 0.1100353834028581, 0.11196771566664923, 0.11393789302517862, 0.11593250645997596, 0.11793962593686715, 0.11994883190743735, 0.12195121888326868, 0.12393937612326279, 0.1259073494736221, 0.1278505875090052, 0.1297658743888611, 0.1316512512805437, 0.13350592780601617, 0.13533018472575803, 0.13712526895966326, 0.13889328203561216, 0.14063706312637858, 0.1423600679594995, 0.14406624503832446, 0.14575991077256878, 0.1474456252620157, 0.14912807058836075, 0.1508119335314161, 0.1525017946244432, 0.15420202539123876, 0.1559166954616514, 0.15764949104473852, 0.15940364595734366, 0.1611818860727531, 0.1629863876854879 ], [ 0.10671580950333198, 0.10489829674292822, 0.10329331658852418, 0.1019127804766511, 0.10076666394374194, 0.09986259039256312, 0.09920546791368122, 0.09879721123972744, 0.09863657611402275, 0.0987191242628, 0.09903732500063754, 0.09958078628664148, 0.10033659607857336, 0.10128974606412092, 0.10242360542140187, 0.10372041229508797, 0.10516175440190992, 0.10672901629706665, 0.10840377791921246, 0.11016815587859687, 0.11200508474648771, 0.11389853995158057, 0.1158337067444332, 0.11779710123493117, 0.1197766500321666, 0.12176173483419876, 0.12374320770731533, 0.12571338198256843, 0.12766600284039065, 0.12959620085472226, 0.13150043108461712, 0.133376399759659, 0.1352229802102883, 0.13704011943599412, 0.13882873656647685, 0.14059061443238305, 0.142328285500281, 0.14404491351824802, 0.1457441723410317, 0.147430123535631, 0.14910709448912343, 0.15077955883255412, 0.15245202104234962, 0.15412890707200122, 0.1558144627938806, 0.15751266189069368, 0.15922712462989755, 0.16096104868893574, 0.16271715288529934, 0.16449763431776773 ], [ 0.10955746792737991, 0.1077409024307595, 0.10613014603974273, 0.10473693875172405, 0.10357121323434401, 0.10264070254817628, 0.10195059361022131, 0.10150325533708575, 0.10129806667589727, 0.10133136224301081, 0.10159650296386061, 0.1020840675521984, 0.10278214980563838, 0.10367673826843599, 0.10475214995440135, 0.10599148884003905, 0.10737710225807805, 0.10889101314301673, 0.11051531210717105, 0.11223249946534748, 0.11402577277532548, 0.11587925976680498, 0.11777819955400973, 0.11970907685360019, 0.12165971477481217, 0.12361933187374391, 0.12557856881905088, 0.12752948941215614, 0.12946556000008724, 0.13138161062229559, 0.13327378061152245, 0.13513945085820445, 0.13697716456078315, 0.13878653801823343, 0.1405681628646662, 0.1423235010820287, 0.14405477413618736, 0.14576484764330322, 0.1474571130666211, 0.14913536804848798, 0.15080369707971164, 0.1524663542812862, 0.15412765010749388, 0.15579184376307073, 0.15746304305289774, 0.15914511324709718, 0.1608415963486313, 0.162555641900039, 0.1642899501705185, 0.16604672823717945 ], [ 0.11241643084919514, 0.11060336976480807, 0.10898954964314406, 0.10758652129825731, 0.10640414733923066, 0.10545023281453089, 0.10473019531120496, 0.10424680058218044, 0.10399998689765445, 0.10398679516691359, 0.10420141313296095, 0.10463533188347202, 0.10527760314620056, 0.10611517787090241, 0.10713330152918103, 0.10831593981623396, 0.10964620977230125, 0.11110679501289689, 0.11268032878238098, 0.11434973395943714, 0.11609851417928653, 0.11791099441121491, 0.11977251243145795, 0.12166956466742684, 0.1235899110032242, 0.12552264353647713, 0.12745822417986744, 0.12938849560099308, 0.1313066694453721, 0.13320729520128008, 0.13508621251541264, 0.1369404892981325, 0.13876834758632114, 0.14056907886492157, 0.14234295037881983, 0.14409110388208113, 0.14581544825545445, 0.1475185474572506, 0.14920350533850327, 0.15087384893225328, 0.15253341190137049, 0.1541862198836643, 0.15583637949356108, 0.1574879727154749, 0.15914495834794543, 0.16081108202606673, 0.16248979616341655, 0.16418419091825248, 0.16589693701074493, 0.16763024091004966 ], [ 0.11529153917291789, 0.11348455410438307, 0.11187039740502665, 0.11046041441586615, 0.1092643725615004, 0.10829011386267853, 0.10754324151315868, 0.10702686398917408, 0.1067414179622963, 0.1066845862480817, 0.1068513196374263, 0.10723396273581307, 0.10782247519801656, 0.10860473231412715, 0.1095668837903711, 0.11069374727198274, 0.11196921360722162, 0.1133766435226754, 0.11489923948046313, 0.11652038118281785, 0.118223917768557, 0.11999441371579189, 0.12181734856759005, 0.12367927277299232, 0.12556792326482774, 0.12747230303485477, 0.1293827290978935, 0.13129085303312255, 0.133189657898184, 0.1350734348412641, 0.13693774226567967, 0.1387793499795684, 0.14059617041671765, 0.14238717875353543, 0.14415232357052618, 0.14589242960597426, 0.14760909411181267, 0.14930457833146146, 0.1509816956601044, 0.15264369810278478, 0.15429416269879023, 0.15593687961735583, 0.15757574363710816, 0.15921465068971616, 0.1608574010699037, 0.16250761078583845, 0.16416863234612736, 0.1658434860562181, 0.16753480263538523, 0.16924477767593568 ], [ 0.1181815164747522, 0.1163831731789589, 0.11477140078604241, 0.11335732427871692, 0.11215059275676083, 0.11115905276261301, 0.11038845105910142, 0.10984218796803301, 0.10952114071867185, 0.10942357213528403, 0.10954513376715179, 0.10987896502695155, 0.11041588213896285, 0.11114464384110127, 0.11205227576031804, 0.1131244327166136, 0.11434577796481023, 0.11570036020154231, 0.1171719724288274, 0.11874448076797563, 0.12040211541582116, 0.1221297196468783, 0.12391295580143975, 0.12573846945082384, 0.1275940144219871, 0.1294685422031744, 0.1313522595869384, 0.13323665838717974, 0.1351145208268678, 0.13697990384030778, 0.13882810514736266, 0.14065561359010684, 0.14246004590684924, 0.14424007186980284, 0.14599532953457436, 0.1477263322377946, 0.14943436892392678, 0.1511213993709544, 0.15278994590284967, 0.15444298320962732, 0.15608382792886455, 0.15771602966239662, 0.1593432650966863, 0.1609692368557268, 0.16259757863455648, 0.16423176803609524, 0.1658750483639573, 0.16753036041242497, 0.16920028504841975, 0.17088699710818386 ], [ 0.12108494990923094, 0.11929778840592647, 0.11769109445584813, 0.11627575916493314, 0.11506129209228284, 0.11405551434535297, 0.11326427719026388, 0.11269122515496657, 0.11233762136556782, 0.11220224949244681, 0.11228140144209067, 0.11256895343390437, 0.11305652623547685, 0.1137337190599139, 0.11458840178704924, 0.1156070472857875, 0.11677508483301817, 0.11807725673043858, 0.11949796274280618, 0.12102158033281588, 0.12263275228015763, 0.12431663668764183, 0.12605911729330746, 0.12784697427669248, 0.12966801734952466, 0.13151118392149494, 0.1333666056426714, 0.13522564677229373, 0.13708091772899816, 0.1389262669413731, 0.14075675381842945, 0.14256860535263632, 0.1443591585895249, 0.1461267909675106, 0.1478708403574997, 0.14959151651364758, 0.1512898055779868, 0.15296736925262014, 0.15462644025172373, 0.15626971565875475, 0.15790024982905818, 0.15952134848232485, 0.16113646561231604, 0.1627491047942216, 0.1643627263866274, 0.165980662002015, 0.16760603745656702, 0.1692417052095933, 0.1708901870707132, 0.17255362769711222 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.37723 (SEM: 0)
x1: 0.808197
x2: 0.515484
x3: 0.311732
x4: 0.927427
x5: 0.0212169
x6: 0.141828", "Arm 1_0
l2norm: 1.32276 (SEM: 0)
x1: 0.751789
x2: 0.00941824
x3: 0.935766
x4: 0.481968
x5: 0.276135
x6: 0.0149037", "Arm 2_0
l2norm: 0.832689 (SEM: 0)
x1: 0.430394
x2: 0.453745
x3: 0.42868
x4: 0.0414895
x5: 0.34033
x6: 0.0305782", "Arm 3_0
l2norm: 1.3771 (SEM: 0)
x1: 0.0992099
x2: 0.790143
x3: 0.532389
x4: 0.15217
x5: 0.418675
x6: 0.883382", "Arm 4_0
l2norm: 1.19533 (SEM: 0)
x1: 0.835693
x2: 0.0758136
x3: 0.453538
x4: 0.14145
x5: 0.533597
x6: 0.462874", "Arm 5_0
l2norm: 1.7147 (SEM: 0)
x1: 0.619054
x2: 0.542657
x3: 0.266134
x4: 0.969628
x5: 0.721164
x6: 0.855231", "Arm 6_0
l2norm: 1.31747 (SEM: 0)
x1: 0.892539
x2: 0.383274
x3: 0.470328
x4: 0.133546
x5: 0.00762028
x6: 0.743713", "Arm 7_0
l2norm: 2.02714 (SEM: 0)
x1: 0.923559
x2: 0.960248
x3: 0.605177
x4: 0.927958
x5: 0.780139
x6: 0.705904", "Arm 8_0
l2norm: 1.23803 (SEM: 0)
x1: 0.708208
x2: 0.330662
x3: 0.0803024
x4: 0.558602
x5: 0.163857
x6: 0.759264", "Arm 9_0
l2norm: 1.70813 (SEM: 0)
x1: 0.293659
x2: 0.97249
x3: 0.875223
x4: 0.99334
x5: 0.336409
x6: 0.140827", "Arm 10_0
l2norm: 1.7913 (SEM: 0)
x1: 0.871813
x2: 0.776927
x3: 0.807538
x4: 0.643326
x5: 0.572012
x6: 0.67223", "Arm 11_0
l2norm: 0.890644 (SEM: 0)
x1: 0.265784
x2: 0.00612966
x3: 0.388793
x4: 0.364144
x5: 0.640832
x6: 0.167751", "Arm 12_0
l2norm: 1.09184 (SEM: 0)
x1: 0.59258
x2: 0.273142
x3: 0.0583361
x4: 0.423357
x5: 0.184469
x6: 0.741409", "Arm 13_0
l2norm: 1.0583 (SEM: 0)
x1: 0.551129
x2: 0.261791
x3: 0.0399145
x4: 0.384436
x5: 0.18932
x6: 0.750001", "Arm 14_0
l2norm: 1.02054 (SEM: 0)
x1: 0.504631
x2: 0.244459
x3: 0.0177052
x4: 0.337493
x5: 0.191796
x6: 0.759005", "Arm 15_0
l2norm: 0.971384 (SEM: 0)
x1: 0.446076
x2: 0.213803
x3: 2.37766e-15
x4: 0.273792
x5: 0.196028
x6: 0.765181", "Arm 16_0
l2norm: 0.909352 (SEM: 0)
x1: 0.375206
x2: 0.165681
x3: 0.00158615
x4: 0.219009
x5: 0.21342
x6: 0.751781", "Arm 17_0
l2norm: 0.842706 (SEM: 0)
x1: 0.300877
x2: 0.115408
x3: 0.024442
x4: 0.211551
x5: 0.24803
x6: 0.706709", "Arm 18_0
l2norm: 0.793839 (SEM: 0)
x1: 0.233536
x2: 0.0836376
x3: 0.0387164
x4: 0.234747
x5: 0.279406
x6: 0.658766", "Arm 19_0
l2norm: 0.778879 (SEM: 0)
x1: 0.146209
x2: 0.005342
x3: 0.0487713
x4: 0.278852
x5: 0.278569
x6: 0.653842", "Arm 20_0
l2norm: 0.753226 (SEM: 0)
x1: 0.189787
x2: 0.119162
x3: 0.00199033
x4: 0.211476
x5: 0.31105
x6: 0.612905", "Arm 21_0
l2norm: 0.803867 (SEM: 0)
x1: 0.24814
x2: 0.0599642
x3: 0.106228
x4: 0.269188
x5: 0.291451
x6: 0.642139", "Arm 22_0
l2norm: 0.78737 (SEM: 0)
x1: 0.223991
x2: 0.0815316
x3: 0.166045
x4: 0.219476
x5: 0.293558
x6: 0.633415", "Arm 23_0
l2norm: 0.836136 (SEM: 0)
x1: 0.247451
x2: 0.0433822
x3: 0.166454
x4: 0.224677
x5: 0.356192
x6: 0.656468" ], "type": "scatter", "x": [ 0.31173232197761536, 0.9357655588537455, 0.42868010234087706, 0.5323885567486286, 0.453537967056036, 0.2661335999146104, 0.4703281670808792, 0.6051765102893114, 0.0803024498745799, 0.8752231253311038, 0.8075381815433502, 0.38879250455647707, 0.05833612704812935, 0.03991452019966993, 0.017705238660749842, 2.3776596220266027e-15, 0.0015861491053817, 0.024441977333069156, 0.038716405686118886, 0.048771287899794014, 0.0019903333971591657, 0.10622835805521122, 0.16604511225609692, 0.1664540660049333 ], "xaxis": "x", "y": [ 0.9274271130561829, 0.4819675078615546, 0.04148946236819029, 0.15217014588415623, 0.1414504498243332, 0.9696278860792518, 0.13354576844722033, 0.9279575180262327, 0.5586023516952991, 0.9933402203023434, 0.6433255095034838, 0.36414415296167135, 0.4233565766884484, 0.3844356571866069, 0.33749287524986354, 0.27379164121508354, 0.2190092867823915, 0.2115506176641371, 0.23474661957714096, 0.2788523702058227, 0.2114763618362025, 0.269188499390071, 0.21947589985065627, 0.2246768932736442 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.37723 (SEM: 0)
x1: 0.808197
x2: 0.515484
x3: 0.311732
x4: 0.927427
x5: 0.0212169
x6: 0.141828", "Arm 1_0
l2norm: 1.32276 (SEM: 0)
x1: 0.751789
x2: 0.00941824
x3: 0.935766
x4: 0.481968
x5: 0.276135
x6: 0.0149037", "Arm 2_0
l2norm: 0.832689 (SEM: 0)
x1: 0.430394
x2: 0.453745
x3: 0.42868
x4: 0.0414895
x5: 0.34033
x6: 0.0305782", "Arm 3_0
l2norm: 1.3771 (SEM: 0)
x1: 0.0992099
x2: 0.790143
x3: 0.532389
x4: 0.15217
x5: 0.418675
x6: 0.883382", "Arm 4_0
l2norm: 1.19533 (SEM: 0)
x1: 0.835693
x2: 0.0758136
x3: 0.453538
x4: 0.14145
x5: 0.533597
x6: 0.462874", "Arm 5_0
l2norm: 1.7147 (SEM: 0)
x1: 0.619054
x2: 0.542657
x3: 0.266134
x4: 0.969628
x5: 0.721164
x6: 0.855231", "Arm 6_0
l2norm: 1.31747 (SEM: 0)
x1: 0.892539
x2: 0.383274
x3: 0.470328
x4: 0.133546
x5: 0.00762028
x6: 0.743713", "Arm 7_0
l2norm: 2.02714 (SEM: 0)
x1: 0.923559
x2: 0.960248
x3: 0.605177
x4: 0.927958
x5: 0.780139
x6: 0.705904", "Arm 8_0
l2norm: 1.23803 (SEM: 0)
x1: 0.708208
x2: 0.330662
x3: 0.0803024
x4: 0.558602
x5: 0.163857
x6: 0.759264", "Arm 9_0
l2norm: 1.70813 (SEM: 0)
x1: 0.293659
x2: 0.97249
x3: 0.875223
x4: 0.99334
x5: 0.336409
x6: 0.140827", "Arm 10_0
l2norm: 1.7913 (SEM: 0)
x1: 0.871813
x2: 0.776927
x3: 0.807538
x4: 0.643326
x5: 0.572012
x6: 0.67223", "Arm 11_0
l2norm: 0.890644 (SEM: 0)
x1: 0.265784
x2: 0.00612966
x3: 0.388793
x4: 0.364144
x5: 0.640832
x6: 0.167751", "Arm 12_0
l2norm: 1.09184 (SEM: 0)
x1: 0.59258
x2: 0.273142
x3: 0.0583361
x4: 0.423357
x5: 0.184469
x6: 0.741409", "Arm 13_0
l2norm: 1.0583 (SEM: 0)
x1: 0.551129
x2: 0.261791
x3: 0.0399145
x4: 0.384436
x5: 0.18932
x6: 0.750001", "Arm 14_0
l2norm: 1.02054 (SEM: 0)
x1: 0.504631
x2: 0.244459
x3: 0.0177052
x4: 0.337493
x5: 0.191796
x6: 0.759005", "Arm 15_0
l2norm: 0.971384 (SEM: 0)
x1: 0.446076
x2: 0.213803
x3: 2.37766e-15
x4: 0.273792
x5: 0.196028
x6: 0.765181", "Arm 16_0
l2norm: 0.909352 (SEM: 0)
x1: 0.375206
x2: 0.165681
x3: 0.00158615
x4: 0.219009
x5: 0.21342
x6: 0.751781", "Arm 17_0
l2norm: 0.842706 (SEM: 0)
x1: 0.300877
x2: 0.115408
x3: 0.024442
x4: 0.211551
x5: 0.24803
x6: 0.706709", "Arm 18_0
l2norm: 0.793839 (SEM: 0)
x1: 0.233536
x2: 0.0836376
x3: 0.0387164
x4: 0.234747
x5: 0.279406
x6: 0.658766", "Arm 19_0
l2norm: 0.778879 (SEM: 0)
x1: 0.146209
x2: 0.005342
x3: 0.0487713
x4: 0.278852
x5: 0.278569
x6: 0.653842", "Arm 20_0
l2norm: 0.753226 (SEM: 0)
x1: 0.189787
x2: 0.119162
x3: 0.00199033
x4: 0.211476
x5: 0.31105
x6: 0.612905", "Arm 21_0
l2norm: 0.803867 (SEM: 0)
x1: 0.24814
x2: 0.0599642
x3: 0.106228
x4: 0.269188
x5: 0.291451
x6: 0.642139", "Arm 22_0
l2norm: 0.78737 (SEM: 0)
x1: 0.223991
x2: 0.0815316
x3: 0.166045
x4: 0.219476
x5: 0.293558
x6: 0.633415", "Arm 23_0
l2norm: 0.836136 (SEM: 0)
x1: 0.247451
x2: 0.0433822
x3: 0.166454
x4: 0.224677
x5: 0.356192
x6: 0.656468" ], "type": "scatter", "x": [ 0.31173232197761536, 0.9357655588537455, 0.42868010234087706, 0.5323885567486286, 0.453537967056036, 0.2661335999146104, 0.4703281670808792, 0.6051765102893114, 0.0803024498745799, 0.8752231253311038, 0.8075381815433502, 0.38879250455647707, 0.05833612704812935, 0.03991452019966993, 0.017705238660749842, 2.3776596220266027e-15, 0.0015861491053817, 0.024441977333069156, 0.038716405686118886, 0.048771287899794014, 0.0019903333971591657, 0.10622835805521122, 0.16604511225609692, 0.1664540660049333 ], "xaxis": "x2", "y": [ 0.9274271130561829, 0.4819675078615546, 0.04148946236819029, 0.15217014588415623, 0.1414504498243332, 0.9696278860792518, 0.13354576844722033, 0.9279575180262327, 0.5586023516952991, 0.9933402203023434, 0.6433255095034838, 0.36414415296167135, 0.4233565766884484, 0.3844356571866069, 0.33749287524986354, 0.27379164121508354, 0.2190092867823915, 0.2115506176641371, 0.23474661957714096, 0.2788523702058227, 0.2114763618362025, 0.269188499390071, 0.21947589985065627, 0.2246768932736442 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:18.063064Z", "iopub.status.busy": "2022-09-15T17:13:18.062042Z", "iopub.status.idle": "2022-09-15T17:13:18.150217Z", "shell.execute_reply": "2022-09-15T17:13:18.149178Z" } }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.01694472461741595, -0.01717433280498715, -0.09547222725242638, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -1.0366588986858292, -1.2322649140034774, -1.41085896077612, -1.5754401364764035, -1.7855140282564224, -2.167579424105896, -2.4116440318175703, -2.4116440318175703, -2.4116440318175703, -2.621875014515807, -2.666838666554814, -2.666838666554814, -2.666838666554814 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.8081970810890198
x2: 0.5154842138290405
x3: 0.31173232197761536
x4: 0.9274271130561829
x5: 0.021216947585344315
x6: 0.1418282389640808", "
Parameterization:
x1: 0.7517893770709634
x2: 0.009418242610991001
x3: 0.9357655588537455
x4: 0.4819675078615546
x5: 0.27613547071814537
x6: 0.014903741888701916", "
Parameterization:
x1: 0.4303943682461977
x2: 0.45374472439289093
x3: 0.42868010234087706
x4: 0.04148946236819029
x5: 0.3403296461328864
x6: 0.030578247271478176", "
Parameterization:
x1: 0.09920991584658623
x2: 0.7901433296501637
x3: 0.5323885567486286
x4: 0.15217014588415623
x5: 0.41867530532181263
x6: 0.8833815855905414", "
Parameterization:
x1: 0.8356926199048758
x2: 0.07581357471644878
x3: 0.453537967056036
x4: 0.1414504498243332
x5: 0.5335968816652894
x6: 0.4628741042688489", "
Parameterization:
x1: 0.619053908623755
x2: 0.5426569981500506
x3: 0.2661335999146104
x4: 0.9696278860792518
x5: 0.7211642675101757
x6: 0.8552314601838589", "
Parameterization:
x1: 0.8925394397228956
x2: 0.3832741053774953
x3: 0.4703281670808792
x4: 0.13354576844722033
x5: 0.007620280608534813
x6: 0.7437132699415088", "
Parameterization:
x1: 0.9235591311007738
x2: 0.9602481089532375
x3: 0.6051765102893114
x4: 0.9279575180262327
x5: 0.7801387198269367
x6: 0.7059039724990726", "
Parameterization:
x1: 0.7082078410312533
x2: 0.3306616209447384
x3: 0.0803024498745799
x4: 0.5586023516952991
x5: 0.1638567065820098
x6: 0.7592640221118927", "
Parameterization:
x1: 0.2936592809855938
x2: 0.9724899800494313
x3: 0.8752231253311038
x4: 0.9933402203023434
x5: 0.3364094002172351
x6: 0.14082650747150183", "
Parameterization:
x1: 0.8718132339417934
x2: 0.7769272327423096
x3: 0.8075381815433502
x4: 0.6433255095034838
x5: 0.5720118544995785
x6: 0.6722296858206391", "
Parameterization:
x1: 0.26578432600945234
x2: 0.006129659712314606
x3: 0.38879250455647707
x4: 0.36414415296167135
x5: 0.6408322639763355
x6: 0.16775120329111814", "
Parameterization:
x1: 0.5925800883496698
x2: 0.27314221590797644
x3: 0.05833612704812935
x4: 0.4233565766884484
x5: 0.18446932376741745
x6: 0.7414085254552428", "
Parameterization:
x1: 0.551128539622191
x2: 0.26179101316971004
x3: 0.03991452019966993
x4: 0.3844356571866069
x5: 0.18932032137593563
x6: 0.7500013232476499", "
Parameterization:
x1: 0.504630586183211
x2: 0.24445918942248304
x3: 0.017705238660749842
x4: 0.33749287524986354
x5: 0.19179637930775792
x6: 0.7590053848635414", "
Parameterization:
x1: 0.44607621656513147
x2: 0.2138033196037768
x3: 2.3776596220266027e-15
x4: 0.27379164121508354
x5: 0.1960283982497859
x6: 0.7651809213889516", "
Parameterization:
x1: 0.3752063509950746
x2: 0.16568055720455532
x3: 0.0015861491053817
x4: 0.2190092867823915
x5: 0.21341958260448132
x6: 0.7517811547706578", "
Parameterization:
x1: 0.3008766500594382
x2: 0.11540757583440457
x3: 0.024441977333069156
x4: 0.2115506176641371
x5: 0.24803030034531343
x6: 0.7067087829556798", "
Parameterization:
x1: 0.23353573380527481
x2: 0.08363759345907099
x3: 0.038716405686118886
x4: 0.23474661957714096
x5: 0.2794064638336137
x6: 0.6587664485941566", "
Parameterization:
x1: 0.1462085543732612
x2: 0.005341995379521409
x3: 0.048771287899794014
x4: 0.2788523702058227
x5: 0.2785686870961966
x6: 0.6538418929568701", "
Parameterization:
x1: 0.18978712754936752
x2: 0.11916159611843083
x3: 0.0019903333971591657
x4: 0.2114763618362025
x5: 0.3110502691288429
x6: 0.6129045087999881", "
Parameterization:
x1: 0.24814020494327513
x2: 0.059964178453312346
x3: 0.10622835805521122
x4: 0.269188499390071
x5: 0.29145089185707024
x6: 0.6421385797539393", "
Parameterization:
x1: 0.22399122198464227
x2: 0.08153161805289375
x3: 0.16604511225609692
x4: 0.21947589985065627
x5: 0.2935581235385248
x6: 0.6334151028417162", "
Parameterization:
x1: 0.24745053362015107
x2: 0.043382223363818195
x3: 0.1664540660049333
x4: 0.2246768932736442
x5: 0.3561924288001816
x6: 0.6564679319111213", "
Parameterization:
x1: 0.25737762125626723
x2: 0.03403943404450493
x3: 0.15699412531338594
x4: 0.21226265001629985
x5: 0.2486164576526881
x6: 0.6001271307562599" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.01694472461741595, -0.01717433280498715, -0.09547222725242638, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -1.0366588986858292, -1.2322649140034774, -1.41085896077612, -1.5754401364764035, -1.7855140282564224, -2.167579424105896, -2.4116440318175703, -2.4116440318175703, -2.4116440318175703, -2.621875014515807, -2.666838666554814, -2.666838666554814, -2.666838666554814 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.01694472461741595, -0.01717433280498715, -0.09547222725242638, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -0.4164610915145818, -1.0366588986858292, -1.2322649140034774, -1.41085896077612, -1.5754401364764035, -1.7855140282564224, -2.167579424105896, -2.4116440318175703, -2.4116440318175703, -2.4116440318175703, -2.621875014515807, -2.666838666554814, -2.666838666554814, -2.666838666554814 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.01694472461741595 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:18.156197Z", "iopub.status.busy": "2022-09-15T17:13:18.155730Z", "iopub.status.idle": "2022-09-15T17:13:18.211116Z", "shell.execute_reply": "2022-09-15T17:13:18.210117Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:18] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:18.216046Z", "iopub.status.busy": "2022-09-15T17:13:18.215700Z", "iopub.status.idle": "2022-09-15T17:13:18.679273Z", "shell.execute_reply": "2022-09-15T17:13:18.678337Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:18] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:18.684908Z", "iopub.status.busy": "2022-09-15T17:13:18.683198Z", "iopub.status.idle": "2022-09-15T17:13:18.714373Z", "shell.execute_reply": "2022-09-15T17:13:18.713122Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:18] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:18.720812Z", "iopub.status.busy": "2022-09-15T17:13:18.719919Z", "iopub.status.idle": "2022-09-15T17:13:26.628960Z", "shell.execute_reply": "2022-09-15T17:13:26.628039Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.218766, 'x2': 0.108186, 'x3': 0.168311, 'x4': 0.287487, 'x5': 0.307756, 'x6': 0.679613}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-15T17:13:26.634240Z", "iopub.status.busy": "2022-09-15T17:13:26.633932Z", "iopub.status.idle": "2022-09-15T17:13:26.645842Z", "shell.execute_reply": "2022-09-15T17:13:26.644877Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:13:26.651426Z", "iopub.status.busy": "2022-09-15T17:13:26.651074Z", "iopub.status.idle": "2022-09-15T17:13:26.671060Z", "shell.execute_reply": "2022-09-15T17:13:26.670160Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-15 17:13:26] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-09-15T17:13:26.676662Z", "iopub.status.busy": "2022-09-15T17:13:26.676325Z", "iopub.status.idle": "2022-09-15T17:13:26.685187Z", "shell.execute_reply": "2022-09-15T17:13:26.684195Z" } }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.13" } }, "nbformat": 4, "nbformat_minor": 2 }