{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:25:57.603440Z", "iopub.status.busy": "2022-11-10T20:25:57.602920Z", "iopub.status.idle": "2022-11-10T20:25:59.910241Z", "shell.execute_reply": "2022-11-10T20:25:59.908471Z" } }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:25:59.968122Z", "iopub.status.busy": "2022-11-10T20:25:59.967039Z", "iopub.status.idle": "2022-11-10T20:25:59.972272Z", "shell.execute_reply": "2022-11-10T20:25:59.971588Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:25:59.975341Z", "iopub.status.busy": "2022-11-10T20:25:59.974928Z", "iopub.status.idle": "2022-11-10T20:25:59.986374Z", "shell.execute_reply": "2022-11-10T20:25:59.985399Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:25:59] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:25:59.990012Z", "iopub.status.busy": "2022-11-10T20:25:59.989393Z", "iopub.status.idle": "2022-11-10T20:25:59.993910Z", "shell.execute_reply": "2022-11-10T20:25:59.993320Z" } }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:25:59.996709Z", "iopub.status.busy": "2022-11-10T20:25:59.996114Z", "iopub.status.idle": "2022-11-10T20:27:42.564897Z", "shell.execute_reply": "2022-11-10T20:27:42.564317Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/runner/work/Ax/Ax/ax/core/observation.py:274: FutureWarning:\n", "\n", "In a future version of pandas, a length 1 tuple will be returned when iterating over a groupby with a grouper equal to a list of length 1. Don't supply a list with a single grouper to avoid this warning.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.172321, 'x2': 0.517218, 'x3': 0.344523, 'x4': 0.885683, 'x5': 0.140317, 'x6': 0.718026}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.046833, 0.0), 'l2norm': (1.317418, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.146472, 'x2': 0.038841, 'x3': 0.088612, 'x4': 0.162793, 'x5': 0.587168, 'x6': 0.875173}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.396739, 0.0), 'l2norm': (1.080745, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.809404, 'x2': 0.326209, 'x3': 0.626972, 'x4': 0.082043, 'x5': 0.075042, 'x6': 0.975072}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.637356, 0.0), 'l2norm': (1.455256, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.797891, 'x2': 0.250534, 'x3': 0.600155, 'x4': 0.60133, 'x5': 0.228134, 'x6': 0.951364}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.48787, 0.0), 'l2norm': (1.54218, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.563197, 'x2': 0.492574, 'x3': 0.968255, 'x4': 0.8177, 'x5': 0.955405, 'x6': 0.813688}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.001946, 0.0), 'l2norm': (1.93413, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.421558, 'x2': 0.814971, 'x3': 0.03074, 'x4': 0.127464, 'x5': 0.794167, 'x6': 0.873966}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.004945, 0.0), 'l2norm': (1.5012, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.699434, 'x2': 0.047338, 'x3': 0.882242, 'x4': 0.915542, 'x5': 0.973457, 'x6': 0.066844}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.000826, 0.0), 'l2norm': (1.749315, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.271127, 'x2': 0.745455, 'x3': 0.913109, 'x4': 0.351518, 'x5': 0.719434, 'x6': 0.180559}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.906873, 0.0), 'l2norm': (1.461757, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.218215, 'x2': 0.574428, 'x3': 0.536205, 'x4': 0.252885, 'x5': 0.982586, 'x6': 0.60361}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.444431, 0.0), 'l2norm': (1.434877, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.591028, 'x2': 0.222858, 'x3': 0.834184, 'x4': 0.461383, 'x5': 0.65922, 'x6': 0.726995}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.15202, 0.0), 'l2norm': (1.50692, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.056185, 'x2': 0.153245, 'x3': 0.349294, 'x4': 0.243428, 'x5': 0.940295, 'x6': 0.918951}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.155673, 0.0), 'l2norm': (1.391593, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.902924, 'x2': 0.647648, 'x3': 0.180444, 'x4': 0.34063, 'x5': 0.584432, 'x6': 0.567231}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:00] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.074036, 0.0), 'l2norm': (1.430601, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.'), OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.'), OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.'), OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 11-10 20:26:15] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.245593, 'x2': 0.0, 'x3': 0.078957, 'x4': 0.090501, 'x5': 0.390547, 'x6': 0.770684}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:15] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.347773, 0.0), 'l2norm': (0.906213, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.'), OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:27] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.278499, 'x2': 0.0, 'x3': 0.082759, 'x4': 0.058813, 'x5': 0.326477, 'x6': 0.74841}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:27] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.365714, 0.0), 'l2norm': (0.868663, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:37] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.2416, 'x2': 0.0, 'x3': 0.021506, 'x4': 0.108558, 'x5': 0.352812, 'x6': 0.679172}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:37] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.611604, 0.0), 'l2norm': (0.810166, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:48] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.189616, 'x2': 0.0, 'x3': 0.005524, 'x4': 0.084756, 'x5': 0.356595, 'x6': 0.598097}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:48] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.378585, 0.0), 'l2norm': (0.72667, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:54] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.280064, 'x2': 0.0, 'x3': 0.0, 'x4': 0.196006, 'x5': 0.347918, 'x6': 0.679666}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:54] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.994334, 0.0), 'l2norm': (0.836568, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:59] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.324287, 'x2': 0.0, 'x3': 0.0, 'x4': 0.246527, 'x5': 0.309038, 'x6': 0.66616}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:26:59] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.166236, 0.0), 'l2norm': (0.839768, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:04] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.407115, 'x2': 0.0, 'x3': 0.0, 'x4': 0.273261, 'x5': 0.333879, 'x6': 0.627779}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:04] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.009171, 0.0), 'l2norm': (0.86371, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:09] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.296689, 'x2': 0.0, 'x3': 0.0, 'x4': 0.297054, 'x5': 0.270394, 'x6': 0.713101}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:09] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.146693, 0.0), 'l2norm': (0.870569, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:15] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.312275, 'x2': 0.056833, 'x3': 0.0, 'x4': 0.264895, 'x5': 0.273077, 'x6': 0.656239}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:15] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.270711, 0.0), 'l2norm': (0.822274, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:20] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.345813, 'x2': 0.102402, 'x3': 0.0, 'x4': 0.24465, 'x5': 0.247353, 'x6': 0.707538}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:20] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.128842, 0.0), 'l2norm': (0.867018, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:24] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.290884, 'x2': 0.057239, 'x3': 0.0, 'x4': 0.285079, 'x5': 0.247642, 'x6': 0.579308}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:24] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.091576, 0.0), 'l2norm': (0.752386, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 11-10 20:27:36] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.291377, 'x2': 0.073973, 'x3': 0.0, 'x4': 0.290157, 'x5': 0.304633, 'x6': 0.669787}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:36] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.365431, 0.0), 'l2norm': (0.846155, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:42] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.295062, 'x2': 0.09856, 'x3': 0.061148, 'x4': 0.304024, 'x5': 0.311007, 'x6': 0.670674}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:42] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.546605, 0.0), 'l2norm': (0.859927, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:27:42.568520Z", "iopub.status.busy": "2022-11-10T20:27:42.568279Z", "iopub.status.idle": "2022-11-10T20:27:42.577751Z", "shell.execute_reply": "2022-11-10T20:27:42.577222Z" } }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:27:42.581088Z", "iopub.status.busy": "2022-11-10T20:27:42.580858Z", "iopub.status.idle": "2022-11-10T20:27:42.605397Z", "shell.execute_reply": "2022-11-10T20:27:42.604874Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:42] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.17, 'x2': 0.52, 'x3': 0.34, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.15, 'x2': 0.04, 'x3': 0.09, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.81, 'x2': 0.33, 'x3': 0.63, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.8, 'x2': 0.25, 'x3': 0.6, 'x4...
40Sobol4COMPLETED{'4_0': {'x1': 0.56, 'x2': 0.49, 'x3': 0.97, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.42, 'x2': 0.81, 'x3': 0.03, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.7, 'x2': 0.05, 'x3': 0.88, 'x...
70Sobol7COMPLETED{'7_0': {'x1': 0.27, 'x2': 0.75, 'x3': 0.91, '...
80Sobol8COMPLETED{'8_0': {'x1': 0.22, 'x2': 0.57, 'x3': 0.54, '...
90Sobol9COMPLETED{'9_0': {'x1': 0.59, 'x2': 0.22, 'x3': 0.83, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.06, 'x2': 0.15, 'x3': 0.35, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.9, 'x2': 0.65, 'x3': 0.18, '...
121GPEI12COMPLETED{'12_0': {'x1': 0.25, 'x2': 0.0, 'x3': 0.08, '...
131GPEI13COMPLETED{'13_0': {'x1': 0.28, 'x2': 0.0, 'x3': 0.08, '...
141GPEI14COMPLETED{'14_0': {'x1': 0.24, 'x2': 0.0, 'x3': 0.02, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.19, 'x2': 0.0, 'x3': 0.01, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.28, 'x2': 0.0, 'x3': 0.0, 'x...
171GPEI17COMPLETED{'17_0': {'x1': 0.32, 'x2': 0.0, 'x3': 0.0, 'x...
181GPEI18COMPLETED{'18_0': {'x1': 0.41, 'x2': 0.0, 'x3': 0.0, 'x...
191GPEI19COMPLETED{'19_0': {'x1': 0.3, 'x2': 0.0, 'x3': 0.0, 'x4...
201GPEI20COMPLETED{'20_0': {'x1': 0.31, 'x2': 0.06, 'x3': 0.0, '...
211GPEI21COMPLETED{'21_0': {'x1': 0.35, 'x2': 0.1, 'x3': 0.0, 'x...
221GPEI22COMPLETED{'22_0': {'x1': 0.29, 'x2': 0.06, 'x3': 0.0, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.29, 'x2': 0.07, 'x3': 0.0, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.3, 'x2': 0.1, 'x3': 0.06, 'x...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.17, 'x2': 0.52, 'x3': 0.34, '... \n", "1 {'1_0': {'x1': 0.15, 'x2': 0.04, 'x3': 0.09, '... \n", "2 {'2_0': {'x1': 0.81, 'x2': 0.33, 'x3': 0.63, '... \n", "3 {'3_0': {'x1': 0.8, 'x2': 0.25, 'x3': 0.6, 'x4... \n", "4 {'4_0': {'x1': 0.56, 'x2': 0.49, 'x3': 0.97, '... \n", "5 {'5_0': {'x1': 0.42, 'x2': 0.81, 'x3': 0.03, '... \n", "6 {'6_0': {'x1': 0.7, 'x2': 0.05, 'x3': 0.88, 'x... \n", "7 {'7_0': {'x1': 0.27, 'x2': 0.75, 'x3': 0.91, '... \n", "8 {'8_0': {'x1': 0.22, 'x2': 0.57, 'x3': 0.54, '... \n", "9 {'9_0': {'x1': 0.59, 'x2': 0.22, 'x3': 0.83, '... \n", "10 {'10_0': {'x1': 0.06, 'x2': 0.15, 'x3': 0.35, ... \n", "11 {'11_0': {'x1': 0.9, 'x2': 0.65, 'x3': 0.18, '... \n", "12 {'12_0': {'x1': 0.25, 'x2': 0.0, 'x3': 0.08, '... \n", "13 {'13_0': {'x1': 0.28, 'x2': 0.0, 'x3': 0.08, '... \n", "14 {'14_0': {'x1': 0.24, 'x2': 0.0, 'x3': 0.02, '... \n", "15 {'15_0': {'x1': 0.19, 'x2': 0.0, 'x3': 0.01, '... \n", "16 {'16_0': {'x1': 0.28, 'x2': 0.0, 'x3': 0.0, 'x... \n", "17 {'17_0': {'x1': 0.32, 'x2': 0.0, 'x3': 0.0, 'x... \n", "18 {'18_0': {'x1': 0.41, 'x2': 0.0, 'x3': 0.0, 'x... \n", "19 {'19_0': {'x1': 0.3, 'x2': 0.0, 'x3': 0.0, 'x4... \n", "20 {'20_0': {'x1': 0.31, 'x2': 0.06, 'x3': 0.0, '... \n", "21 {'21_0': {'x1': 0.35, 'x2': 0.1, 'x3': 0.0, 'x... \n", "22 {'22_0': {'x1': 0.29, 'x2': 0.06, 'x3': 0.0, '... \n", "23 {'23_0': {'x1': 0.29, 'x2': 0.07, 'x3': 0.0, '... \n", "24 {'24_0': {'x1': 0.3, 'x2': 0.1, 'x3': 0.06, 'x... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:42.608546Z", "iopub.status.busy": "2022-11-10T20:27:42.608319Z", "iopub.status.idle": "2022-11-10T20:27:42.996921Z", "shell.execute_reply": "2022-11-10T20:27:42.996155Z" } }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.29506216793846574,\n", " 'x2': 0.09855985754364237,\n", " 'x3': 0.06114817023649496,\n", " 'x4': 0.30402435742169126,\n", " 'x5': 0.3110071373642808,\n", " 'x6': 0.670673573760974}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:42.999993Z", "iopub.status.busy": "2022-11-10T20:27:42.999773Z", "iopub.status.idle": "2022-11-10T20:27:43.005730Z", "shell.execute_reply": "2022-11-10T20:27:43.005085Z" } }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.8599296327559474, 'hartmann6': -2.5465908225719267}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:43.009089Z", "iopub.status.busy": "2022-11-10T20:27:43.008834Z", "iopub.status.idle": "2022-11-10T20:27:43.015139Z", "shell.execute_reply": "2022-11-10T20:27:43.014495Z" } }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:43.017909Z", "iopub.status.busy": "2022-11-10T20:27:43.017655Z", "iopub.status.idle": "2022-11-10T20:27:43.707819Z", "shell.execute_reply": "2022-11-10T20:27:43.706872Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:43] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.8116653519273327, -0.8398682227220984, -0.868142761933682, -0.8962343505596546, -0.9238632423827772, -0.9507283575181915, -0.9765125063596113, -1.0008890265631998, -1.023529704552147, -1.044113729141865, -1.062337301358345, -1.0779234175166161, -1.0906312689407947, -1.100264675691815, -1.106679002208909, -1.1097860910863702, -1.1095568900221089, -1.1060216212790155, -1.0992675322613865, -1.0894344472255197, -1.0767084923552923, -1.0613144729997777, -1.043507433829201, -1.0235639295976446, -1.001773483552596, -0.9784306254122851, -0.9538277969250744, -0.9282493054697091, -0.901966407154089, -0.8752335184420019, -0.8482854932103632, -0.8213358604799063, -0.7945758946070345, -0.7681743809355227, -0.7422779419060543, -0.7170117978136689, -0.6924808498008959, -0.6687709880013153, -0.6459505433996373, -0.6240718169083749, -0.6031726327697451, -0.5832778753776465, -0.5644009788919097, -0.5465453476312908, -0.5297056923052137, -0.5138692728381082, -0.4990170430295685, -0.48512469575243944, -0.4721636099839973, -0.4601017028430019 ], [ -0.823396375088955, -0.8522685970380555, -0.8812113707379542, -0.9099634478970009, -0.938237722402975, -0.9657251027082467, -0.992099857175409, -1.0170264179662314, -1.0401675147929947, -1.0611933819239117, -1.079791653645639, -1.0956774516430017, -1.1086030899704655, -1.1183667945794462, -1.1248198642808749, -1.1278717901708923, -1.1274929936307028, -1.1237150235404563, -1.1166282499258544, -1.106377280015149, -1.0931544812226457, -1.077192106661592, -1.0587535730556834, -1.038124437948841, -1.0156035706950302, -0.991494923499719, -0.966100201076449, -0.9397126159752347, -0.9126118139769108, -0.8850599684378516, -0.857298977985525, -0.8295486586985203, -0.8020057975301683, -0.7748439246020051, -0.7482136640895829, -0.7222435330188572, -0.697041071280423, -0.6726942021775812, -0.6492727391746256, -0.6268299701112071, -0.6054042643568711, -0.5850206608828192, -0.5656924059324936, -0.547422417925613, -0.5302046645600138, -0.51402544295217, -0.4988645582659418, -0.484696399805257, -0.4714909161654294, -0.45921449291048855 ], [ -0.8333606186095147, -0.8627575697460482, -0.8922197203386135, -0.9214805698383469, -0.9502473020498081, -0.9782047244182158, -1.0050207058710485, -1.0303530999852741, -1.0538580244014222, -1.0751992373891621, -1.0940582217888632, -1.1101444721442952, -1.1232054005680885, -1.133035246306303, -1.1394824030885238, -1.1424546691051531, -1.1419220696467196, -1.1379170863875054, -1.1305323281337147, -1.1199158710842334, -1.1062646592343197, -1.0898164697657016, -1.070841004472911, -1.0496306660172663, -1.0264915249942743, -1.0017348943322255, -0.9756698179711358, -0.9485966670684866, -0.9208019320291988, -0.8925542109804245, -0.8641013289414706, -0.835668477171678, -0.8074572367360874, -0.7796453405518208, -0.752387030007361, -0.7258138718798228, -0.7000359155237379, -0.675143086715943, -0.651206731367781, -0.6282812384109524, -0.606405685846638, -0.5856054668784555, -0.5658938641202532, -0.5472735491196569, -0.5297379919961507, -0.513272772032289, -0.4978567847713249, -0.48346334475816266, -0.47006118569829847, -0.45761536167214945 ], [ -0.8414077969201117, -0.8711739416675219, -0.900995466571954, -0.9306020946676405, -0.9596970659984122, -0.987961131608876, -1.0150580538138096, -1.040641598756592, -1.0643638913958606, -1.0858848729921098, -1.1048824702912365, -1.1210629707589135, -1.1341710172493293, -1.1439986040424022, -1.150392484443632, -1.1532594902925442, -1.1525694087805805, -1.148355246352698, -1.140710911256159, -1.1297865408608687, -1.1157818639905068, -1.0989381042885726, -1.079528988341096, -1.0578514213356593, -1.0342163412745815, -1.0089401739568942, -0.982337201568292, -0.9547130436963613, -0.9263593438470099, -0.8975496657137779, -0.8685365357499122, -0.8395495224905485, -0.8107942164434685, -0.7824519636550826, -0.7546802072471958, -0.7276133005026402, -0.7013636692262986, -0.6760232176129173, -0.6516648889058916, -0.6283443085282321, -0.6061014523808645, -0.5849622962583582, -0.5649404136950579, -0.5460384990509461, -0.5282498003975123, -0.5115594529427635, -0.49594570853763953, -0.4813810604342105, -0.4678332651128312, -0.4552662648408732 ], [ -0.8474145554984072, -0.8773864958375043, -0.9073994943538689, -0.9371810455263112, -0.9664322905888388, -0.9948320531322519, -1.0220423706622526, -1.0477155054182952, -1.071502303403504, -1.0930616424690653, -1.1120705815104122, -1.1282347098009153, -1.141298115659147, -1.1510523623890396, -1.1573438868553316, -1.160079324469416, -1.1592284070685162, -1.154824261970634, -1.1469611398722106, -1.1357897919384266, -1.1215108794878093, -1.1043669153905034, -1.084633294961243, -1.0626089750347374, -1.0386073105627185, -1.012947471812431, -0.9859467581020707, -0.9579140115626037, -0.9291442294256231, -0.899914384458107, -0.8704803947680787, -0.841075137009822, -0.8119073691475229, -0.7831614170399914, -0.7549974793063423, -0.7275524134813204, -0.7009408801506487, -0.6752567380318439, -0.6505745999765737, -0.6269514763573443, -0.6044284474846986, -0.5830323201610172, -0.562777235047, -0.5436662011987737, -0.5256925420343465, -0.5088412432745263, -0.49309019827140677, -0.4784113497918051, -0.4647717299644052, -0.45213440191675425 ], [ -0.8512882620002094, -0.8812981049868123, -0.911330350475329, -0.9411118547338366, -0.9703435427181377, -0.9987044706780706, -1.025857356902436, -1.0514555594518267, -1.0751513683429832, -1.0966053553844295, -1.1154964002992482, -1.131531902660445, -1.1444576122222834, -1.1540664802133507, -1.1602059608212445, -1.1627832777571794, -1.1617683091014004, -1.157193920029727, -1.1491537668043834, -1.137797783129535, -1.1233257194328339, -1.105979219647934, -1.0860329791021668, -1.0637855302719905, -1.0395501574360435, -1.0136463592480072, -0.9863921752347982, -0.9580975831628918, -0.9290590714960318, -0.8995554033575545, -0.8698445200239566, -0.8401614840170437, -0.8107173327812869, -0.7816987006750451, -0.7532680659103963, -0.7255644865405095, -0.6987047024562503, -0.6727844960777213, -0.6478802211204413, -0.6240504251695992, -0.6013375069748359, -0.5797693629116722, -0.5593609887352943, -0.5401160125481459, -0.5220281429000703, -0.5050825222930794, -0.48925698126361505, -0.47452319186952907, -0.46084772202379276, -0.44819299388932843 ], [ -0.8529698091025839, -0.8828486997258501, -0.9127273700719325, -0.9423336393759052, -0.9713700936909938, -0.9995181589214341, -1.0264435979031594, -1.0518034045417628, -1.0752539609089986, -1.0964602044432965, -1.1151054339282591, -1.1309012795775617, -1.1435972900339624, -1.1529895612439371, -1.1589278581690556, -1.1613207623337227, -1.1601385103405417, -1.155413356990234, -1.147237481975023, -1.1357586390842878, -1.1211739004173735, -1.1037219588582792, -1.0836745108170356, -1.0613272468850496, -1.036990936886309, -1.0109830194809744, -0.9836200092347862, -0.9552109300106506, -0.9260518845078587, -0.8964217841375816, -0.8665791957977557, -0.836760213800096, -0.8071772350393762, -0.7780185007923818, -0.749448265928264, -0.7216074623988867, -0.6946147356076022, -0.6685677471276485, -0.6435446533526892, -0.6196056856596635, -0.5967947726594529, -0.5751411585781748, -0.5546609834936255, -0.5353588009784318, -0.517229016731005, -0.5002572381440274, -0.48442152965084795, -0.46969357230841846, -0.45603972863268527, -0.4434220154046592 ], [ -0.8524352712104851, -0.8820169283620216, -0.911572317175606, -0.9408317989866704, -0.9695014504073539, -0.9972671280419952, -1.0237998986896168, -1.0487628012982688, -1.0718188052301105, -1.0926397175315998, -1.1109156810453782, -1.1263648091020888, -1.138742435656724, -1.1478494348034258, -1.1535390890111208, -1.1557220631408969, -1.1543691658053492, -1.1495117382007312, -1.1412396850701032, -1.1296973323493098, -1.1150774417196299, -1.0976138184106388, -1.0775730063984101, -1.0552455733134514, -1.0309374514227283, -1.0049617314865102, -0.9776312161339084, -0.9492519417082267, -0.9201177834406425, -0.890506176381615, -0.8606749184183611, -0.8308599735281545, -0.801274162401673, -0.7721066114470545, -0.7435228269450929, -0.7156652656228317, -0.6886542832552633, -0.6625893566661856, -0.6375504897858956, -0.6135997298535105, -0.5907827344869541, -0.5691303436015525, -0.5486601217274154, -0.52937784604215, -0.5112789234214729, -0.4943497261301565, -0.4785688406005003, -0.4639082272781938, -0.45033429197223784, -0.437808870741633 ], [ -0.8496963279671399, -0.8788204232422692, -0.9078894587210089, -0.9366378619857925, -0.9647769407829342, -0.9919989186432693, -1.0179822652134627, -1.042398280449267, -1.0649187964277926, -1.0852247566236488, -1.1030153303732502, -1.1180171324658585, -1.1299930574360622, -1.1387502166262027, -1.1441464909307166, -1.1460952850020059, -1.1445681844865618, -1.1395953649776576, -1.1312637633262252, -1.1197131799889353, -1.1051306173190734, -1.087743259024061, -1.06781055220634, -1.0456158639599398, -1.0214581540865235, -0.9956440433849697, -0.9684805748301822, -0.9402688746682777, -0.9112988323281118, -0.8818448397436709, -0.8521625668433235, -0.8224867024433662, -0.7930295582324993, -0.7639804161207255, -0.7355054933359422, -0.7077484024400804, -0.6808309922138467, -0.6548544678059984, -0.6299007028019983, -0.6060336705428476, -0.5833009361363931, -0.5617351635132029, -0.5413556032192226, -0.5221695362439747, -0.5041736570393789, -0.48735538507813336, -0.47169409898863823, -0.4571622906857574, -0.443726639214585, -0.43134900546416255 ], [ -0.8447994472948481, -0.8733146812235962, -0.9017440984239563, -0.9298276302684529, -0.9572834299764017, -0.98381185678391, -1.0091006743894315, -1.0328314158726455, -1.054686778879426, -1.0743588196287097, -1.0915576216260516, -1.106020036130778, -1.1175180380546648, -1.1258662231477965, -1.1309279965728927, -1.1326200706198197, -1.1309149956932896, -1.1258415833963185, -1.117483228765651, -1.1059742837032505, -1.0914947593277655, -1.0742637285892962, -1.0545318544593776, -1.0325734816521737, -1.0086787049860721, -0.9831457731463521, -0.956274113028357, -0.9283581776519523, -0.8996822392446508, -0.8705161756661913, -0.8411122374458224, -0.8117027363867683, -0.7824985649908567, -0.7536884374814816, -0.7254387357527778, -0.6978938446362766, -0.6711768679972793, -0.6453906281727585, -0.62061886434382, -0.596927559207508, -0.5743663367609363, -0.5529698864463888, -0.5327593799045229, -0.5137438559274274, -0.49592155683509287, -0.479281205476092, -0.4638032165177973, -0.449460838840251, -0.4362212279103277, -0.4240464482292242 ], [ -0.8378239006868982, -0.8655906568598607, -0.8932396996903345, -0.9205177864822172, -0.9471513720053693, -0.9728505180022811, -0.9973139295759393, -1.0202350643332614, -1.0413091791824225, -1.0602410935136275, -1.0767533645900196, -1.0905945013141538, -1.1015467962914476, -1.109433341998526, -1.1141238204229498, -1.1155387177625726, -1.1136517124077194, -1.1084901062334573, -1.1001333031849827, -1.0887094704570484, -1.0743906320589698, -1.0573865308612855, -1.0379376464248566, -1.0163077702320693, -0.992776520411493, -0.9676321314168523, -0.9411647892620846, -0.9136607091787716, -0.885397078396678, -0.8566379187746779, -0.8276308666213266, -0.7986048224503336, -0.7697683919868457, -0.7413090205077136, -0.713392713773093, -0.6861642382252617, -0.6597476985955664, -0.6342474005575021, -0.6097489178806128, -0.5863202963056124, -0.5640133390406434, -0.5428649306363491, -0.5228983665532756, -0.5041246647180405, -0.4865438426713381, -0.470146149568899, -0.45491324643303777, -0.44081933086460723, -0.42783220415418843, -0.41591427963735117 ], [ -0.8288787547459909, -0.8557712458707251, -0.8825138134384736, -0.908861222866009, -0.9345495029859243, -0.9592997577112391, -0.9828230129160369, -1.0048260390851735, -1.0250180169491805, -1.0431178363086901, -1.058861745085933, -1.0720110050299831, -1.0823591712089322, -1.0897386018445523, -1.0940258277856172, -1.0951454676376091, -1.093072461435471, -1.0878325046635027, -1.079500684075786, -1.0681984343127315, -1.0540890373927163, -1.0373719658073446, -1.0182764179508506, -0.9970544101269404, -0.9739737747188282, -0.949311374860524, -0.9233467896475005, -0.8963566586786829, -0.8686098080089363, -0.8403632174383726, -0.8118588356421959, -0.783321207241902, -0.7549558451905878, -0.7269482622072553, -0.6994635650532142, -0.6726465133844909, -0.6466219488098176, -0.621495507803886, -0.5973545426595537, -0.5742691863775817, -0.5522935092416364, -0.5314667260340574, -0.5118144228796728, -0.4933497812349923, -0.4760747834192567, -0.4599813893093001, -0.44505267750652, -0.4312639466337156, -0.41858377369262567, -0.4069750268976414 ], [ -0.8180990381243726, -0.8440068952817948, -0.8697330885998779, -0.8950414146839755, -0.9196785477293719, -0.94337773114614, -0.9658634110039364, -0.9868567477839421, -1.0060818772263902, -1.0232727230325889, -1.0381801004257738, -1.0505787976029841, -1.060274289354693, -1.06710872976677, -1.0709658926893881, -1.0717747799309179, -1.0695116944821585, -1.064200672481413, -1.0559122733784976, -1.0447608318467638, -1.0309003668144263, -1.0145194138935631, -0.9958350919620961, -0.9750867308592276, -0.9525293767829199, -0.9284274595567391, -0.9030488577632962, -0.8766595407484958, -0.8495189072178411, -0.8218758839835401, -0.7939657992751536, -0.7660080052036067, -0.7382041943463913, -0.7107373357512511, -0.6837711449080859, -0.6574499989375324, -0.6318992107345769, -0.6072255824497894, -0.5835181679953991, -0.5608491849444958, -0.539275027200954, -0.5188373403435298, -0.4995641310021456, -0.4814708896259995, -0.46456171235549637, -0.44883041238095356, -0.4342616142666219, -0.42083182645419326, -0.4085104878260094, -0.39726098413308664 ], [ -0.8056413174399987, -0.8304706106287572, -0.8550876755850247, -0.8792661911181303, -0.9027643372712251, -0.9253283465839677, -0.9466969043287712, -0.9666063315288942, -0.9847964263206458, -1.0010167797859932, -1.015033327491157, -1.0266348540125845, -1.035639140935933, -1.0418984442528783, -1.045304007726744, -1.04578936478008, -1.043332249732382, -1.037955023767747, -1.0297236135926813, -1.0187450520389771, -1.005163790865054, -0.9891570193024181, -0.9709292626448581, -0.9507065515937148, -0.9287304463288781, -0.905252172976015, -0.8805270894752706, -0.8548096486628434, -0.8283489742882963, -0.8013851155016566, -0.7741460006406076, -0.7468450741958836, -0.719679572671269, -0.6928293757147941, -0.6664563576785338, -0.6407041605038939, -0.6156983101377269, -0.5915466041219022, -0.5683397061951524, -0.546151893475042, -0.5250419120054046, -0.505053906314966, -0.4862183974938479, -0.46855329171508986, -0.4520649068632233, -0.4367490089200985, -0.42259185210362105, -0.4095712176973223, -0.39765744638394096, -0.3868144580906123 ], [ -0.7916789280778017, -0.8153526390562111, -0.8387853362556218, -0.8617612531908921, -0.8840507236897136, -0.9054135750986837, -0.9256032801104123, -0.9443717997466726, -0.9614749989033484, -0.9766784644702471, -0.9897635093078108, -1.0005331086706226, -1.008817494156977, -1.0144791280454208, -1.0174168002663666, -1.0175686311889027, -1.0149138232013821, -1.009473077617519, -1.001307673813068, -0.9905172868841947, -0.9772366909441681, -0.9616315511564408, -0.9438935445426422, -0.9242350657991713, -0.9028837705655143, -0.8800771876282263, -0.8560575976318032, -0.8310673338610097, -0.8053446153601411, -0.7791199782600747, -0.7526133309480294, -0.7260316248167327, -0.6995671059118229, -0.6733960941167799, -0.6476782251558857, -0.6225560857825354, -0.5981551729138774, -0.574584111926464, -0.5519350765978479, -0.5302843621010793, -0.5096930719941491, -0.4902078894130806, -0.4718619109729696, -0.4546755286991164, -0.4386573503509459, -0.42380515167520105, -0.4101068555407902, -0.3975415328449744, -0.3860804189426794, -0.3756879376061887 ], [ -0.7763970977316513, -0.7988550927321725, -0.8210455519071023, -0.8427637573474365, -0.8637926375109674, -0.8839059878588853, -0.9028723638189238, -0.920459578668606, -0.9364396944684825, -0.9505943501669115, -0.9627202316286766, -0.9726344580861821, -0.9801796425742185, -0.9852283835710659, -0.9876869630932261, -0.9874980626775536, -0.9846423606953314, -0.9791389379687991, -0.9710444879209047, -0.9604513959956309, -0.9474848145303905, -0.9322989083619986, -0.915072479597336, -0.896004195592786, -0.8753076427007598, -0.8532064119202432, -0.8299293946115616, -0.8057064309039468, -0.7807644143855922, -0.7553239177539108, -0.7295963682345226, -0.7037817708081635, -0.678066952811601, -0.652624285735089, -0.6276108288477196, -0.6031678340231492, -0.5794205509059444, -0.5564782752912701, -0.534434590168728, -0.5133677572007485, -0.49334122543096004, -0.47440423282328725, -0.4565924840443816, -0.43992889413469727, -0.4244243920036703, -0.4100787799111604, -0.3968816453829215, -0.38481332069113683, -0.3738458826120564, -0.36394418223590597 ], [ -0.7599881760415674, -0.7811867448645318, -0.8020938799208561, -0.82251623275776, -0.84224957180229, -0.8610818194260688, -0.8787966802736686, -0.8951777946958698, -0.9100133128014098, -0.9231007472955376, -0.9342519304303463, -0.9432978757392899, -0.9500933321606625, -0.9545208192615202, -0.9564939488696479, -0.9559598702108496, -0.9529007206079522, -0.9473340183182504, -0.9393119933837694, -0.9289199110910742, -0.9162734955687446, -0.9015156037852474, -0.8848123296756926, -0.8663487328734878, -0.8463243867505117, -0.8249489278091611, -0.8024377656005779, -0.7790080825257522, -0.7548752194890858, -0.7302495095336793, -0.7053335898778108, -0.6803201951047291, -0.6553904118429011, -0.6307123586751493, -0.6064402442546228, -0.5827137512879434, -0.5596576934782469, -0.5373818958162127, -0.5159812547658874, -0.4955359428667777, -0.47611173102304283, -0.45776041029296455, -0.44052030246253393, -0.4244168544006405, -0.4094633147044653, -0.39566149229286585, -0.3830025955364249, -0.37146814764890734, -0.3610309700419204, -0.3516562209085562 ], [ -0.742647147874637, -0.7625581869923905, -0.7821567575485576, -0.8012610389447529, -0.8196797058163259, -0.837214774141269, -0.8536649635801159, -0.8688295121391084, -0.8825123464820438, -0.8945264797917247, -0.9046984819332256, -0.9128728468100951, -0.9189160719467853, -0.9227202674935991, -0.9242061269922239, -0.9233251200078108, -0.9200608053866427, -0.9144292104340009, -0.9064782717888127, -0.8962863838116738, -0.8839601456150781, -0.8696314347982389, -0.8534539619062025, -0.8355994733100813, -0.8162537716302262, -0.7956127132055053, -0.7738783235510424, -0.7512551468760671, -0.7279469173509178, -0.7041536105663114, -0.6800689057871667, -0.6558780649214978, -0.6317562137960413, -0.6078669960108688, -0.5843615595212132, -0.5613778309669107, -0.5390400321401073, -0.5174583961278345, -0.49672904670279405, -0.4769340124666115, -0.4581413560178217, -0.4404054069636214, -0.42376709493628706, -0.40825438409426273, -0.3938828133277429, -0.38065614633561895, -0.36856713306613587, -0.35759837925672966, -0.34772331479259444, -0.3389072452975511 ], [ -0.7245675660282437, -0.7431774873392479, -0.7614568948402385, -0.7792355060035471, -0.7963348086384627, -0.8125707121908735, -0.8277566467317371, -0.8417070487744542, -0.8542411452635247, -0.865186920842074, -0.8743851312577828, -0.8816932099439025, -0.886988907567138, -0.8901735072216593, -0.8911744716475226, -0.8899474029828162, -0.8864772286339452, -0.8807785663811697, -0.8728952646040544, -0.8628991559335095, -0.8508881012098639, -0.8369834323405834, -0.8213269253243833, -0.8040774471836614, -0.7854074227360892, -0.7654992599171863, -0.7445418573703709, -0.7227272973580616, -0.7002478030165404, -0.6772930138134067, -0.6540476087451534, -0.6306892849269612, -0.6073870809336133, -0.5843000202696825, -0.5615760409990138, -0.539351172821873, -0.517748922434379, -0.4968798312747409, -0.4768411759809702, -0.45771679010543975, -0.4395769947670344, -0.42247863481195647, -0.40646522455787226, -0.3915672123155004, -0.37780237490485924, -0.3651763520148523, -0.3536833256953825, -0.3433068432132036, -0.33402077302492617, -0.3257903749976572 ], [ -0.7059379961707378, -0.7232464411822725, -0.7402093438749997, -0.7566678387744592, -0.7724559964339792, -0.787403279357539, -0.8013373837302624, -0.8140874097327747, -0.8254872798028686, -0.8353793024669239, -0.8436177612813172, -0.8500723959594892, -0.8546316376059654, -0.8572054633182065, -0.8577277477173162, -0.8561580098447507, -0.8524824820496697, -0.8467144609397356, -0.8388939365482184, -0.8290865316721623, -0.817381816007368, -0.8038910867756783, -0.7887447271851227, -0.7720892652683008, -0.7540842582472383, -0.7348991221980532, -0.7147100146910903, -0.6936968609394591, -0.6720405936788024, -0.6499206553983824, -0.6275127903574801, -0.6049871344879832, -0.5825065949095417, -0.5602254981294305, -0.5382884774972543, -0.5168295662630388, -0.49597146249787993, -0.4758249357708524, -0.4564883521752, -0.43804730315790863, -0.42057433350466134, -0.40412877347642673, -0.38875668813616426, -0.3744909621023339, -0.3613515393871216, -0.3493458351985824, -0.3384693298316289, -0.3287063449325396, -0.3200309909179243, -0.3124082628527173 ], [ -0.6869390264147063, -0.7029574594035956, -0.7186182823789011, -0.7337738131559925, -0.7482703598955447, -0.7619504840110257, -0.7746555935990495, -0.7862288141971434, -0.7965180640866595, -0.805379243466827, -0.8126794322467079, -0.8182999814972446, -0.8221393800960421, -0.82411578167447, -0.8241690879472343, -0.8222625024945333, -0.8183834930069063, -0.8125441282063024, -0.8047807859857969, -0.7951532594063355, -0.7837433147353974, -0.7706527786891764, -0.7560012489289403, -0.7399235317811473, -0.722566913895331, -0.7040883705558647, -0.6846518035799043, -0.6644253874902435, -0.6435790854734837, -0.622282378084786, -0.6007022292123647, -0.579001296754454, -0.5573363808365377, -0.5358570909943495, -0.5147047060943732, -0.4940111971286796, -0.4738983834223095, -0.4544771969817153, -0.4358470371574309, -0.41809520764503516, -0.40129643893669964, -0.38551251021145894, -0.3707919937020655, -0.35717015022935683, -0.3446690056056738, -0.333297633355793, -0.3230526599156136, -0.3139189952826632, -0.30587077688819175, -0.29887249949155315 ], [ -0.6677408585786955, -0.682491103191371, -0.6968745089956352, -0.7107542496184174, -0.723988433434541, -0.7364321783233572, -0.747939968015636, -0.7583682410808765, -0.7675781473231715, -0.7754383917280566, -0.7818280744408597, -0.7866394277970379, -0.7897803491888346, -0.791176632203987, -0.7907738082008804, -0.7885385259367438, -0.7844594171402961, -0.7785474196336247, -0.7708355550244235, -0.7613781832012612, -0.750249778994303, -0.7375432957627901, -0.7233681950801039, -0.707848230345438, -0.691119074834303, -0.6733258816965642, -0.6546208554428641, -0.6351609025699565, -0.6151054143947972, -0.5946142191954013, -0.5738457246547525, -0.5529552565201659, -0.5320935863103756, -0.5114056306273317, -0.49102929776541315, -0.4710944542615203, -0.45172198497839244, -0.43302292518612273, -0.4150976515127227, -0.3980351298005337, -0.38191223062457336, -0.36679313586970463, -0.3527288703824927, -0.33975699930738346, -0.32790153260322163, -0.31717307249055327, -0.3075692273957963, -0.2990752987739057, -0.2916652274887511, -0.28530276721706016 ], [ -0.6485014693261921, -0.6620142424823634, -0.6751536159113645, -0.6877932165939586, -0.6998024448522686, -0.7110483678674844, -0.7213978518347277, -0.7307198881197117, -0.738888055329092, -0.7457830473285113, -0.7512951879898614, -0.7553268477973638, -0.7577946761760108, -0.7586315670136244, -0.7577882834338474, -0.7552346811148822, -0.750960486580396, -0.7449756067806049, -0.7373099675255826, -0.7280128993875732, -0.717152109035314, -0.7048122902574514, -0.6910934411323781, -0.6761089612552349, -0.659983605410776, -0.6428513677664511, -0.6248533640931933, -0.6061357695154903, -0.5868478568383162, -0.5671401666705541, -0.5471628264395832, -0.5270640219887291, -0.5069886136911651, -0.48707687970571156, -0.4674633628174223, -0.44827579477909507, -0.4296340735517572, -0.4116492744477265, -0.3944226856924371, -0.3780448716764888, -0.3625947819454557, -0.34813893894787995, -0.33473075039539113, -0.3224100002255471, -0.3112025733191538, -0.30112046193466857, -0.29216208636952656, -0.2843129404373774, -0.2775465472245493, -0.2718256862663352 ], [ -0.6293653074141985, -0.6416787933704365, -0.6536147821008989, -0.6650568942838355, -0.6758852627583567, -0.6859782533080533, -0.6952143866525559, -0.7034744212746179, -0.7106435456608438, -0.7166136189511101, -0.7212853917146764, -0.7245706343634164, -0.7263941001734485, -0.7266952533691966, -0.725429700272759, -0.7225702728389025, -0.7181077283465196, -0.7120510456719378, -0.7044273162867769, -0.695281245657329, -0.6846742968446147, -0.6726835217201006, -0.6594001354610417, -0.6449278963141509, -0.6293813547938887, -0.6128840346189791, -0.5955666021862798, -0.5775650728661511, -0.5590190916707038, -0.5400703137800382, -0.5208608979272241, -0.5015321136412504, -0.4822230526871544, -0.4630694265247298, -0.4442024259653031, -0.42574761708935904, -0.4078238494220373, -0.3905421586723765, -0.374004657019966, -0.3583034184720031, -0.3435193840212645, -0.3297213292054466, -0.31696495242028044, -0.3052921527294523, -0.2947305678740937, -0.28529343469055646, -0.27697981506609637, -0.2697752030977171, -0.2636524975309339, -0.25857329315893895 ], [ -0.6104624779714051, -0.621620974798083, -0.6324001162855388, -0.642693016302228, -0.6523899472504698, -0.6613798977838861, -0.6695522993264116, -0.6767988851390792, -0.6830156366585356, -0.6881047641524886, -0.6919766630695414, -0.6945517843984168, -0.6957623573477318, -0.6955539059633093, -0.6938865079182865, -0.6907357533739502, -0.6860933739833227, -0.6799675260336577, -0.6723827264720397, -0.6633794551230137, -0.6530134497938163, -0.6413547322802516, -0.6284864118242857, -0.6145033178590633, -0.5995105156975585, -0.583621757229848, -0.566957913981356, -0.5496454325365855, -0.5318148429805275, -0.5135993403776247, -0.4951334481699414, -0.4765517615248379, -0.4579877588912581, -0.43957266212074597, -0.42143432025344274, -0.4036960902193184, -0.3864756899588767, -0.36988400637515095, -0.3540238523345436, -0.3389886833472018, -0.3248613044779195, -0.31171261931755545, -0.2996004922300399, -0.28856880852475797, -0.27864682060669244, -0.2698488586073001, -0.2621744609856256, -0.2556089467469842, -0.2501244117621747, -0.2456810941796419 ], [ -0.5919083553364666, -0.6019610164105302, -0.6116344714886325, -0.6208308008739563, -0.6294498054077844, -0.6373904115618148, -0.6445522174322074, -0.6508371472881018, -0.6561511750048011, -0.6604060706045649, -0.6635211197640831, -0.6654247639870913, -0.6660561095232507, -0.6653662562142287, -0.6633194032396788, -0.6598936969797229, -0.6550817964595029, -0.6488911434702574, -0.6413439367175178, -0.6324768214149645, -0.62234031681618, -0.6109980135298114, -0.5985255795106366, -0.5850096179577577, -0.5705464217868215, -0.5552406678905252, -0.5392040902684245, -0.5225541646649892, -0.505412829102656, -0.4879052552246136, -0.4701586753214123, -0.45230125999934634, -0.43446103238480505, -0.41676479731312466, -0.39933705893393934, -0.3822988984308565, -0.365766785965674, -0.3498513083014002, -0.33465580636333836, -0.3202749352529173, -0.30679318200871364, -0.29428340149223087, -0.28280545444588445, -0.2724050490548613, -0.2631128929219605, -0.25494425212834526, -0.24789898689530365, -0.2419620923546849, -0.23710472509526348, -0.23328565057208828 ], [ -0.5738035615583128, -0.5828032462912447, -0.591425651407874, -0.5995812833331204, -0.6071788550495799, -0.614126549437944, -0.620333399616599, -0.6257107575819669, -0.6301738165460982, -0.6336431475514437, -0.6360462076302849, -0.6373187753217733, -0.6374062700148979, -0.6362649144673258, -0.6338627049140979, -0.6301801602133432, -0.6252108301023737, -0.6189615523424112, -0.6114524587003378, -0.6027167396897345, -0.5928001871166634, -0.5817605411558476, -0.569666674436715, -0.5565976491062349, -0.5426416838796557, -0.5278950666806502, -0.512461044754664, -0.4964487183952093, -0.4799719570445168, -0.4631483479955243, -0.4460981787763866, -0.42894344514372595, -0.4118068681091124, -0.3948108963101513, -0.3780766651405226, -0.36172288230256067, -0.34586461185620987, -0.3306119364279356, -0.316068490848458, -0.3023298804332205, -0.2894820227399476, -0.27759948073453566, -0.2667438837420081, -0.25696255440983085, -0.24828746840647542, -0.240734663125871, -0.2343041803082203, -0.22898057868947708, -0.224733995332281, -0.22152167978569548 ], [ -0.5562342471557354, -0.5642364881945531, -0.5718649312908034, -0.5790379658504713, -0.5856726062133615, -0.5916856242581601, -0.5969947786154692, -0.6015201151541655, -0.6051853086781129, -0.6079190120093124, -0.6096561761656785, -0.6103393044367766, -0.6099196040034052, -0.6083580014099996, -0.6056259926271763, -0.601706304445624, -0.5965933512047463, -0.5902934789549441, -0.5828249975797062, -0.5742180096243045, -0.564514052059311, -0.5537655734655687, -0.5420352737635322, -0.5293953363374384, -0.5159265830650824, -0.5017175813307928, -0.48686372867227257, -0.47146633550305894, -0.4556317196681019, -0.43947031881577736, -0.4230958181588168, -0.4066242826697579, -0.3901732747115846, -0.3738609312399379, -0.3578049698588397, -0.34212159115335494, -0.32692424700291245, -0.3123222522331284, -0.2984192311363145, -0.28531141177464414, -0.27308580924618364, -0.26181837217092097, -0.2515722000951104, -0.24239596641670702, -0.234322693476673, -0.22736901630803408, -0.22153503611629466, -0.21680480766576493, -0.2131474370900922, -0.21051870272761553 ], [ -0.5392726131537275, -0.546334701714236, -0.5530278213423567, -0.5592777072689651, -0.5650090784265818, -0.5701466502419835, -0.5746162267045815, -0.5783458494423349, -0.5812669777815048, -0.5833156708660394, -0.5844337411204222, -0.5845698478608282, -0.5836805008256064, -0.5817309458485332, -0.5786959087748309, -0.5745601788517601, -0.5693190189436854, -0.5629783966729734, -0.5555550375609771, -0.5470763079976604, -0.5375799419695764, -0.527113630527649, -0.5157344966492676, -0.5035084802022441, -0.4905096580114209, -0.4768195225270978, -0.4625262393643892, -0.44772389918248456, -0.43251177324152634, -0.416993574822094, -0.4012767208945588, -0.3854715804309451, -0.3696906880983172, -0.35404789541758086, -0.338657426634013, -0.3236328045467345, -0.3090856136266633, -0.29512407533761165, -0.28185142509360106, -0.2693641028002849, -0.2577497994877238, -0.2470854392892724, -0.2374352143094134, -0.22884882198336354, -0.2213600704661146, -0.21498600819345115, -0.20972669465791272, -0.20556566462198567, -0.2024710601793266, -0.20039733183146746 ], [ -0.5229776178672169, -0.5291578045957253, -0.5349750078499204, -0.5403617845185616, -0.5452499818929742, -0.5495716412881735, -0.5532599662539277, -0.5562503358757748, -0.5584813407120091, -0.5598958167112449, -0.5604418512025879, -0.5600737348997866, -0.5587528349039919, -0.556448365944488, -0.5531380404969017, -0.5488085828132607, -0.5434560970582669, -0.5370862853762882, -0.5297145174736222, -0.5213657588291042, -0.5120743695871931, -0.5018837902160935, -0.49084613285723233, -0.4790216987493966, -0.46647844205901623, -0.45329139884917624, -0.4395420968169773, -0.42531795694025165, -0.4107116924867217, -0.3958207042007206, -0.3807464632075356, -0.3655938656498253, -0.3504705357776119, -0.3354860477696048, -0.32075103176921693, -0.30637612751126464, -0.2924707508081257, -0.27914164562461286, -0.26649120916977065, -0.25461560076687684, -0.24360267764676147, -0.2335298406489792, -0.22446191537333626, -0.21644923112403203, -0.20952607971059678, -0.20370972780507124, -0.19900011438098197, -0.19538029283927816, -0.1928175903651943, -0.1912653753624607 ], [ -0.5073958176364887, -0.5127526233092193, -0.5177534153338167, -0.522337066431871, -0.5264420012857352, -0.530007001202871, -0.532972060960409, -0.5352792808078057, -0.5368737743097215, -0.5377045710762514, -0.5377254926042507, -0.5368959795545688, -0.5351818498769306, -0.5325559692667651, -0.5289988184289487, -0.5244989453966475, -0.5190532955119165, -0.5126674163697207, -0.5053555397757251, -0.4971405472718372, -0.48805382974932243, -0.4781350548297034, -0.4674318578239791, -0.45599947301231447, -0.44390032161439374, -0.4312035711073894, -0.41798467752161017, -0.40432491809279547, -0.39031091632128856, -0.37603415528431494, -0.3615904682307035, -0.3470794883936884, -0.33260403302366226, -0.3182693904476579, -0.30418247428368594, -0.29045080681606816, -0.27718129532808766, -0.2644787725580615, -0.25244428724177514, -0.2411731545807213, -0.23075281015232219, -0.22126055290422908, -0.2127613087018746, -0.20530558644748487, -0.1989278216297803, -0.19364529480487247, -0.18945776806018322, -0.1863479050309671, -0.18428244564127338, -0.18321401836325568 ], [ -0.4925622971282778, -0.49715392542183, -0.5013973414735423, -0.5052372502385761, -0.50861813128459, -0.5114849541820834, -0.5137839356134009, -0.5154633233798394, -0.516474190729478, -0.5167712232510129, -0.51631348009601, -0.5150651115848763, -0.5129960163585223, -0.5100824231447804, -0.5063073848482277, -0.5016611759216374, -0.4961415876651949, -0.4897541200148011, -0.4825120722855607, -0.47443653898277804, -0.4655563199380962, -0.4559077564521141, -0.44553450664145555, -0.43448727365789397, -0.42282349978122846, -0.4106070375519707, -0.3979078061229451, -0.38480143694017965, -0.37136890783064924, -0.3576961587449714, -0.34387367600089835, -0.32999602519558857, -0.3161613064008644, -0.3024704993734474, -0.28902666205706407, -0.2759339436591791, -0.26329637542461104, -0.25121640962176917, -0.23979319215233363, -0.22912057839722821, -0.21928493632982093, -0.21036282437371256, -0.2024186792286975, -0.19550269167917667, -0.18964907314457835, -0.18487490902544435, -0.18117974910639711, -0.17854600442320068, -0.17694012112944169, -0.17631440945567645 ], [ -0.4785016514369599, -0.48238549476765613, -0.48592962485290303, -0.4890841201187638, -0.49179902286916266, -0.49402497448036176, -0.49571388351362455, -0.496819613868819, -0.49729867878484857, -0.4971109256842635, -0.4962201966456128, -0.49459494972505, -0.4922088274581191, -0.4890411606308117, -0.48507739774801206, -0.480309453435788, -0.4747359721409128, -0.46836250675505453, -0.4612016149911703, -0.45327287926761384, -0.4446028583097622, -0.4352249804770081, -0.4251793898118036, -0.4145127558719295, -0.4032780574742644, -0.39153434851923463, -0.3793465110943479, -0.3667849971295434, -0.35392555509462154, -0.3408489327327269, -0.32764054081038685, -0.3143900566030686, -0.30119093969896493, -0.28813982721646547, -0.2753357714293646, -0.2628792810994829, -0.2508711298972264, -0.23941090287286082, -0.22859526699073385, -0.21851597609202622, -0.209257655259115, -0.2008954532667505, -0.19349269990548879, -0.18709874814957372, -0.1817472062017449, -0.1774547577991007, -0.17422072302634783, -0.17202743027638046, -0.1708413701545819, -0.17061500879481195 ], [ -0.4652289887093686, -0.4684612175794367, -0.47136281338723107, -0.4738887956390805, -0.4759943084069451, -0.4776351837555439, -0.47876853069919945, -0.47935333851673045, -0.47935108229390544, -0.47872631805058596, -0.4774472548076367, -0.47548629149482646, -0.4728205077013091, -0.4694320988948051, -0.46530874881734874, -0.4604439342016433, -0.45483715960887605, -0.44849412290863255, -0.4414268145321987, -0.43365355595607835, -0.42519898474431306, -0.4160939947446106, -0.4063756405687662, -0.39608701519855094, -0.38527710838581886, -0.3740006514382238, -0.3623179510141763, -0.35029471074252416, -0.33800183492040037, -0.3255152033541294, -0.312915400772513, -0.30028737841081077, -0.2877200196937336, -0.2753055769451924, -0.26313894244282143, -0.2513167159199654, -0.2399360331396223, -0.22909312810935423, -0.2188816167747618, -0.20939051436565437, -0.20070203281108112, -0.19288924754210013, -0.1860137698438019, -0.18012360258331472, -0.1752513808459284, -0.17141319177143055, -0.16860812240844014, -0.1668186047517557, -0.16601152994612922, -0.16614001272030243 ], [ -0.4527509281342519, -0.455386154387757, -0.4577003084351884, -0.45965294549595737, -0.46120388159261383, -0.4623136929673676, -0.4629442348374735, -0.46305916980726647, -0.46262449558623553, -0.4616090613869219, -0.4599850625398276, -0.4577285034879164, -0.45481962040603485, -0.4512432561954337, -0.4469891824644714, -0.4420523652281134, -0.43643317332083353, -0.43013753078135275, -0.42317701658437834, -0.41556891691411524, -0.40733623655459394, -0.3985076767869531, -0.3891175873308915, -0.37920589927151516, -0.3688180445291138, -0.358004865244686, -0.34682251348555126, -0.33533233797188233, -0.3236007501672623, -0.31169905718450897, -0.2997032437025735, -0.28769367971434257, -0.275754725776851, -0.26397420301389907, -0.2524426921345212, -0.24125262515793844, -0.23049713667156757, -0.2202686498922628, -0.21065718831081848, -0.20174842781400015, -0.193621537489979, -0.1863468983873635, -0.17998383360093784, -0.1745785214952178, -0.17016228479745643, -0.16675043996775085, -0.1643418474079038, -0.1629192277960707, -0.16245021852828023, -0.16288905866336822 ], [ -0.4410665737254893, -0.4431575784727354, -0.4449374659360339, -0.44636994865072566, -0.4474191152363248, -0.4480498728838064, -0.4482284040051231, -0.447922628657913, -0.4471026639244977, -0.4457412713369032, -0.44381428373106224, -0.4413010035949193, -0.4381845660340844, -0.43445226087595534, -0.4300958101037091, -0.42511159866609993, -0.4195008586383189, -0.41326980858998763, -0.4064297517185139, -0.39899713770021406, -0.3909935941775138, -0.3824459342332991, -0.3733861460197425, -0.3638513698502158, -0.353883866497567, -0.3435309781659286, -0.3328450806393639, -0.32188352150980826, -0.3107085352300536, -0.29938712114347954, -0.2879908657798834, -0.2765956858173385, -0.26528146353936166, -0.25413154285843875, -0.24323205172396, -0.2326710169283771, -0.22253724119230212, -0.21291892141480417, -0.2039020026668502, -0.19556828612844235, -0.18799334098344156, -0.18124430859994478, -0.17537772748817315, -0.17043754147188184, -0.16645347069298722, -0.1634399154670142, -0.16139552164919047, -0.16030346712974586, -0.1601324460239092, -0.16083824906041466 ], [ -0.4301684492927186, -0.43176596689263036, -0.4330626413952008, -0.434025990629466, -0.43462400575353155, -0.43482554322983236, -0.43460072664418814, -0.4339213511037743, -0.4327612827036562, -0.4310968456126645, -0.4289071897183465, -0.42617463248993903, -0.4228849697486958, -0.419027751334753, -0.4145965191650294, -0.4095890068033473, -0.4040073013118409, -0.3978579697108857, -0.3911521537282847, -0.3839056375549953, -0.3761388939418143, -0.3678771140820378, -0.3591502262624503, -0.3499929071853064, -0.34044458814808076, -0.33054945592143137, -0.32035644521945117, -0.30991921616615614, -0.2992961062135894, -0.28855004168190146, -0.27774838964260806, -0.26696272649709896, -0.25626849565971754, -0.24574452372580424, -0.23547236306180974, -0.2255354297900607, -0.21601791077845978, -0.2070034227809998, -0.1985734225938045, -0.19080538989190565, -0.18377083418970463, -0.1775332122065536, -0.1721458773332647, -0.1676502116340507, -0.16407410388071753, -0.16143092636160206, -0.15971912502893804, -0.15892247588748754, -0.15901098709250128, -0.1599423569734284 ], [ -0.42004338428850074, -0.42119593458608784, -0.42205817015810076, -0.42260108748798875, -0.4227962380112247, -0.42261607535440904, -0.42203430882575355, -0.4210262568614519, -0.4195691940372531, -0.417642685431483, -0.4152289025874035, -0.4123129160644943, -0.4088829605663403, -0.404930669843629, -0.4004512799315286, -0.395443800711753, -0.3899111571982222, -0.383860303230813, -0.37730231132165293, -0.3702524431347455, -0.36273020540463585, -0.35475939594147143, -0.34636814367564717, -0.33758894543499707, -0.3284587003137863, -0.31901874010161346, -0.3093148513310323, -0.2993972811392478, -0.2893207154139753, -0.2791442137352048, -0.26893108161173473, -0.2587486566926598, -0.24866798235602716, -0.23876333981644526, -0.22911160929113472, -0.2197914326452718, -0.2108821553014203, -0.20246253513765744, -0.19460922160871608, -0.18739502994431023, -0.18088706256318088, -0.1751447607228136, -0.17021799970417095, -0.16614536420182768, -0.16295274965586026, -0.16065242372066824, -0.15924264753716943, -0.15870790264868573, -0.15901970599838766, -0.16013793543438304 ], [ -0.41067334383889553, -0.41142710575750885, -0.41190127818945077, -0.41207003375286777, -0.41190816799743435, -0.4113914070735516, -0.4104967186749351, -0.40920262079458913, -0.4074894828577821, -0.4053398140614527, -0.4027385342632823, -0.3996732235154681, -0.39613434730082275, -0.39211545565736117, -0.3876133556105935, -0.3826282575944784, -0.3771638977461623, -0.3712276390142224, -0.3648305548331241, -0.35798749960169296, -0.3507171702856031, -0.3430421630840865, -0.3349890282196093, -0.32658832450778263, -0.3178746734473423, -0.30888681016292363, -0.29966762568560945, -0.29026419184082897, -0.28072775653123005, -0.2711136935904791, -0.261481387828139, -0.2518940326382594, -0.24241831494789012, -0.23312396079533926, -0.22408311504824663, -0.21536953143908566, -0.2070575550646626, -0.1992208896403792, -0.1919311568190184, -0.18525627498488428, -0.17925870939670752, -0.17399367226256635, -0.16950737648395287, -0.16583546509379865, -0.1630017439675029, -0.16101733353577874, -0.15988032458231116, -0.15957597710366211, -0.16007744751245934, -0.16134697844440682 ], [ -0.40203619922289124, -0.40243491974196755, -0.40256492156264523, -0.40240327360859873, -0.40192772368408536, -0.40111697116811396, -0.3999509405244257, -0.3984110508863007, -0.3964804770914909, -0.39414439787509925, -0.3913902274772503, -0.3882078276739661, -0.38458969816391375, -0.3805311442954027, -0.37603042223692407, -0.37108886280869047, -0.36571097622121096, -0.35990454082549905, -0.3536806795850286, -0.34705392825584847, -0.3400422991443489, -0.33266734375413476, -0.3249542166059305, -0.31693174101014665, -0.3086324756052431, -0.300092778082933, -0.29135285976231406, -0.2824568216317299, -0.27345265925959994, -0.2643922207285111, -0.25533109866169634, -0.24632843474052024, -0.23744661318899818, -0.2287508189580919, -0.22030843731888983, -0.21218827491094872, -0.2044595886881655, -0.1971909193125595, -0.1904487397924095, -0.18429594847313957, -0.17879025696078765, -0.1739825461341965, -0.16991528375165987, -0.1666211109430359, -0.1641217075910526, -0.16242703491924104, -0.16153502685265753, -0.16143176282180194, -0.16209210988270462, -0.16348077929769533 ], [ -0.3941064374048828, -0.39419137086042044, -0.394018555127978, -0.3935676967901902, -0.3928192265436674, -0.3917545409843287, -0.39035624319239515, -0.38860837799429904, -0.38649665796616284, -0.3840086766242792, -0.38113410581830576, -0.3778648750854804, -0.3741953316077695, -0.3701223803928264, -0.3656456053157354, -0.36076737264288916, -0.35549291953651685, -0.3498304307304996, -0.34379110700003224, -0.3373892291523515, -0.3306422209885157, -0.3235707139893865, -0.31619861534406557, -0.3085531793688464, -0.30066508038370066, -0.292568482767527, -0.2843011012710037, -0.27590424181835926, -0.2674228100948637, -0.258905272346619, -0.25040355020704963, -0.24197282925888086, -0.23367125975773728, -0.22555952787849254, -0.21770027747149334, -0.21015736616625058, -0.20299494627563297, -0.19627637078102322, -0.19006293790960926, -0.18441250416657684, -0.1793780141574951, -0.1750060142222023, -0.17133523297278308, -0.168395321837992, -0.16620584929648852, -0.16477563134980444, -0.16410245776374466, -0.16417324118114351, -0.1649645792574994, -0.16644368459492642 ], [ -0.3868558099978442, -0.38666568348467945, -0.38622883244983663, -0.3855273621526982, -0.38454413756318717, -0.3832629978211597, -0.3816689678544204, -0.3797484635641377, -0.3774894872271467, -0.37488181017840594, -0.3719171404167587, -0.36858927350361026, -0.3648942259648631, -0.360830351316208, -0.3563984397542741, -0.35160180342571146, -0.3464463499324435, -0.3409406472822417, -0.33509598378161953, -0.3289264263336331, -0.3224488802005898, -0.31568315249191614, -0.3086520204311993, -0.30138130385532813, -0.2938999394359907, -0.28624005184431234, -0.2784370145794913, -0.27052949055100173, -0.2625594398656438, -0.2545720797802934, -0.2466157796309052, -0.2387418719767197, -0.23100436049828177, -0.2234595057088934, -0.2161652716814948, -0.20918062118073544, -0.202564653215199, -0.19637558635431795, -0.190669603194492, -0.1854995856879006, -0.18091378665268287, -0.17695449796261042, -0.17365678833376885, -0.17104739061172192, -0.16914381755936791, -0.16795377484488228, -0.16747492034855183, -0.1676949921179578, -0.16859229707244283, -0.17013652351526742 ], [ -0.38025392330841346, -0.3798249247118948, -0.3791602401701757, -0.3782441528249869, -0.3770617323868881, -0.3755990254148943, -0.37384324143305925, -0.37178293175014065, -0.36940815812766326, -0.36671064887595883, -0.36368394053757, -0.36032350402177604, -0.3566268548500746, -0.35259364801589077, -0.3482257587982127, -0.34352735163634296, -0.3385049398055069, -0.3331674390646595, -0.3275262186173289, -0.32159515258176075, -0.31539067466992166, -0.3089318379049032, -0.3022403799616564, -0.29534079311620864, -0.2882603958744866, -0.281029401185654, -0.273680973809421, -0.2662512670068906, -0.2587794263880603, -0.2513075466310617, -0.24388056507504086, -0.23654607510335945, -0.22935404203953347, -0.22235640527543155, -0.21560655286479913, -0.20915865916467602, -0.20306688255335725, -0.1973844289162453, -0.19216249734221824, -0.18744913681715702, -0.18328805567300055, -0.17971743768181359, -0.1767688280946358, -0.17446615758330508, -0.17282497019725362, -0.17185191213764184, -0.17154452165632816, -0.1718913384010391, -0.17287232594182056, -0.17445957751329988 ], [ -0.374268771961462, -0.3736345577833371, -0.37277567056265415, -0.3716783673190722, -0.37032971052755537, -0.36871773697400756, -0.3668316213987399, -0.364661832187983, -0.3622002766791572, -0.35944043408997706, -0.3563774746533114, -0.353008364217119, -0.3493319543188568, -0.34534905852340625, -0.34106251657072695, -0.33647724855578254, -0.33160030189733203, -0.3264408941835555, -0.3210104550561834, -0.315322670065706, -0.3093935288671754, -0.30324137921510375, -0.29688698696243887, -0.29035360069886174, -0.28366701782466197, -0.27685564681600305, -0.2699505582831613, -0.2629855152631583, -0.2559969711507951, -0.24902402190871176, -0.24210829788419896, -0.23529377990128142, -0.2286265245206207, -0.2221542847161322, -0.2159260149586134, -0.20999125404894903, -0.20439938515726364, -0.19919878040808925, -0.19443584679047332, -0.19015400064708265, -0.1863926086298342, -0.1831859425696326, -0.18056220271075074, -0.1785426666900014, -0.17714101926923875, -0.17636290957510214, -0.17620576880972105, -0.17665890343712587, -0.17770385892933405, -0.17931502989280135 ], [ -0.36886721909680387, -0.3680589397577666, -0.3670369362841731, -0.3657892510640379, -0.36430474352983233, -0.36257324000050295, -0.3605856774952617, -0.3583342391196791, -0.3558124789464303, -0.35301543475901787, -0.34993972758428593, -0.3465836475860816, -0.3429472265956275, -0.3390322982724312, -0.3348425475734169, -0.33038355180274626, -0.3256628159636171, -0.3206898053811681, -0.3154759785634188, -0.3100348229760421, -0.304381895801888, -0.2985348708297131, -0.2925135913799136, -0.28634012765976313, -0.2800388351985026, -0.27363640911516407, -0.2671619270094667, -0.260646871346948, -0.2541251204599919, -0.24763289585098236, -0.24120865252532497, -0.23489289878089958, -0.2287279324310293, -0.2227574820394561, -0.21702624458497888, -0.21157931519630513, -0.2064615102684545, -0.2017165923205827, -0.19738641311912508, -0.19351000036507282, -0.1901226218592127, -0.18725486850441364, -0.18493180262861142, -0.18317221980022125, -0.18198806971367532, -0.18138407451511973, -0.18135757147758758, -0.18189859231273497, -0.1829901753032772, -0.18460889082289322 ], [ -0.3640154263506983, -0.36306176705024107, -0.3619052313014265, -0.36053547266635766, -0.35894296665793124, -0.3571191436759583, -0.35505651529862137, -0.3527487918245453, -0.3501909892906948, -0.3473795246320498, -0.3443122981870491, -0.34098876336554285, -0.3374099839519493, -0.33357868017557746, -0.32949926529612905, -0.3251778749741703, -0.3206223920717114, -0.315842469707031, -0.31084955532716074, -0.30565691822790175, -0.30027968232568825, -0.29473486506561464, -0.28904142215162587, -0.2832202963438981, -0.2772944669396865, -0.2712889948109136, -0.2652310561050538, -0.25914995603204305, -0.25307711268020083, -0.24704599966320673, -0.2410920357449282, -0.23525240957535198, -0.22956582845883278, -0.22407218181846977, -0.21881211284751179, -0.2138264958317917, -0.20915582178643932, -0.20483950125526673, -0.20091510009281965, -0.19741753132020923, -0.19437823305855695, -0.19182436828543548, -0.1897780858495045, -0.18825588300517937, -0.1872681071195924, -0.18681862798768267, -0.18690470270993909, -0.18751704320659635, -0.1886400834409936, -0.19025243078076604 ], [ -0.35967923685238323, -0.35860647235277954, -0.357341541756532, -0.35587554886074035, -0.3542004182155605, -0.3523090129992176, -0.3501952458030865, -0.3478541804782539, -0.34528212352638143, -0.34247670394773067, -0.3394369409738621, -0.33616329968941505, -0.33265773515616326, -0.3289237262553749, -0.32496630101780155, -0.32079205566725044, -0.3164091699159356, -0.31182742117289663, -0.3070582002226272, -0.30211453057188276, -0.2970110930342753, -0.291764256226804, -0.286392112509695, -0.2809145175493222, -0.2753531301799764, -0.2697314476574668, -0.2640748298249409, -0.25841050425127443, -0.25276754316890315, -0.2471768021540136, -0.2416708100871996, -0.23628360013868488, -0.2310504724664324, -0.22600768111061498, -0.22119204029671724, -0.21664044905418545, -0.21238933767397694, -0.2084740449190351, -0.20492814079102062, -0.2017827156281321, -0.19906566181299812, -0.19680097876199099, -0.1950081344814193, -0.19370151722758355, -0.19289000831444048, -0.19257670180391873, -0.1927587889974085, -0.19342761600542735, -0.19456891217987904, -0.19616317696190955 ], [ -0.35582451434755225, -0.35465657623597613, -0.3533070102155015, -0.3517682216903516, -0.3500334300759582, -0.3480967732309601, -0.3459534045007566, -0.34359958074743413, -0.3410327400684413, -0.3382515683214684, -0.3352560540613265, -0.3320475320343924, -0.32862871593838894, -0.3250037217043482, -0.3211780830530455, -0.31715876147675204, -0.3129541530556048, -0.30857409459634966, -0.3040298714465559, -0.2993342289667086, -0.2945013890260575, -0.2895470720314408, -0.2844885239240652, -0.2793445463272983, -0.27413552665556573, -0.2688834635725371, -0.26361198180143264, -0.2583463290380532, -0.25311334670298635, -0.24794140560360156, -0.24286029737085002, -0.23790107289914697, -0.2330958200481854, -0.22847737464204843, -0.22407896136910954, -0.21993376454230518, -0.21607443275174, -0.2125325260721561, -0.20933791941841495, -0.2065181805113031, -0.20409794527257585, -0.2020983168070043, -0.2005363159501532, -0.1994244112462108, -0.19877015391992015, -0.19857593890916947, -0.19883890659766368, -0.19955099206732496, -0.20069912022042224, -0.20226553684162019 ], [ -0.35241744136417796, -0.35117599645215025, -0.3497632563817429, -0.34817279101140175, -0.3463989724766774, -0.34443706760300263, -0.34228332275716655, -0.33993503970787975, -0.3373906413853667, -0.33464972682681204, -0.33171311505448586, -0.32858287813543907, -0.32526236418835763, -0.3217562116013021, -0.3180703561663538, -0.31421203318420676, -0.310189776804661, -0.3060134189125384, -0.3016940897142826, -0.2972442218098005, -0.29267755894093783, -0.28800916980082136, -0.2832554662914929, -0.2784342244709904, -0.273564605190901, -0.2686671701605593, -0.26376388796518757, -0.25887812350177997, -0.2540346034733718, -0.24925935009654576, -0.2445795751235379, -0.24002352674663185, -0.23562028301237647, -0.2313994870775209, -0.2273910220053149, -0.22362462580203413, -0.2201294509426598, -0.21693357657470969, -0.21406348568704348, -0.21154352347870042, -0.2093953565960801, -0.2076374554324416, -0.20628462292884153, -0.2053475929838683, -0.20483271950998594, -0.20474177338865152, -0.20507185930210792, -0.20581545807840906, -0.20696059334559447, -0.2084911145870577 ], [ -0.34942477910865877, -0.3481293176704434, -0.3466726570052958, -0.34504940500752657, -0.3432549556712141, -0.3412855707417435, -0.33913845374038665, -0.33681181510417424, -0.33430492749162743, -0.3316181706812572, -0.3287530659201612, -0.32571230004446117, -0.3224997401659676, -0.319120440169678, -0.3155806406603615, -0.3118877642979716, -0.3080504086363086, -0.3040783385963639, -0.2999824805408827, -0.2957749195551129, -0.2914689009774978, -0.28707883647381505, -0.2826203140340803, -0.2781101102331086, -0.27356620198622805, -0.26900777391657216, -0.26445521640443226, -0.2599301084936958, -0.2554551791700945, -0.25105424018480926, -0.2467520836540834, -0.2425743381899791, -0.2385472783623035, -0.23469758388677642, -0.2310520470775692, -0.22763722975062728, -0.22447907382535526, -0.22160247319832327, -0.21903081784826728, -0.21678552431980025, -0.21488556943079473, -0.21334704595228993, -0.2121827598430741, -0.2114018881745784, -0.21100971505450494, -0.21100745968804913, -0.2113922063938336, -0.21215694124848383, -0.21329069450428106, -0.2147787824922267 ] ], "zauto": true, "zmax": 1.1627832777571794, "zmin": -1.1627832777571794 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.4192137102871954, 0.41286656699414687, 0.4067599148351753, 0.4009681161754847, 0.3955619540906296, 0.3906058472925541, 0.386155155717417, 0.3822538083254564, 0.3789324944569422, 0.3762076400717106, 0.3740813366910058, 0.37254230541693667, 0.3715678684826854, 0.37112677926991144, 0.37118264541488216, 0.3716975869183846, 0.3726357192844997, 0.37396605358659907, 0.3756644666855579, 0.37771451164342246, 0.38010699604604004, 0.38283843030475156, 0.38590860914605385, 0.3893177078716788, 0.39306332845749703, 0.3971379103867603, 0.4015268344787096, 0.40620741612460404, 0.41114883655781403, 0.4163129263268441, 0.42165561602135626, 0.4271288161561688, 0.43268248002640464, 0.4382666308267385, 0.4438331837809805, 0.4493374518961335, 0.45473927949406157, 0.460003794088732, 0.46510180144621793, 0.47000987063614663, 0.4747101671667488, 0.4791900952918908, 0.48344180779164286, 0.48746163516773733, 0.49124947800779906, 0.4948081975197092, 0.49814303075746275, 0.501261049354998, 0.5041706739131904, 0.5068812506396108 ], [ 0.4179735944669244, 0.4115464412382794, 0.4053643111673095, 0.3995036077888629, 0.39403719257549763, 0.389031485354956, 0.38454363900116345, 0.3806190308073883, 0.3772893257585049, 0.3745713479644972, 0.37246694150299453, 0.37096391241842486, 0.37003802784354645, 0.36965592032641387, 0.36977862368282916, 0.37036537052649254, 0.37137722864808076, 0.3727801562243806, 0.3745471192972539, 0.37665903417043833, 0.37910445700596523, 0.3818781185657578, 0.38497856405076203, 0.3884052772688141, 0.3921557232480976, 0.39622272531947383, 0.400592508610816, 0.4052436125496075, 0.4101467290018918, 0.4152653888736244, 0.4205573202354637, 0.4259762461622966, 0.4314738800551405, 0.43700190128942806, 0.44251374144807615, 0.44796606783957776, 0.45331990578216713, 0.4585413873714314, 0.4636021489570014, 0.46847942200629256, 0.4731558738884858, 0.47761925866190097, 0.48186193563051305, 0.48588030742959776, 0.4896742214471814, 0.49324636976008396, 0.49660171431787786, 0.4997469563705813, 0.502690062387832, 0.5054398530718853 ], [ 0.41747913030050837, 0.4110152728217082, 0.40479840099669717, 0.3989061809088553, 0.39341283601229987, 0.3883861811244821, 0.38388471276654046, 0.37995500350485417, 0.37662966351821703, 0.37392611542687937, 0.3718463736115406, 0.37037792823651544, 0.36949571554960337, 0.36916502475612517, 0.369345067020213, 0.3699928340872769, 0.3710668203662916, 0.37253018520313574, 0.37435299556379664, 0.3765133077673824, 0.37899700461091185, 0.3817964771306429, 0.3849083995640023, 0.38833096391719957, 0.39206099622586255, 0.3960913618936028, 0.40040898892056587, 0.40499371490890373, 0.4098180235841315, 0.41484760668183407, 0.42004258860461363, 0.42535919518837445, 0.4307516344664577, 0.4361739785103705, 0.44158187901824686, 0.44693400265664845, 0.45219312485452334, 0.45732686592364924, 0.4623080876702088, 0.4671149914756582, 0.4717309713600328, 0.47614427987820884, 0.48034756313167076, 0.48433731579965567, 0.48811329960906374, 0.4916779603428261, 0.4950358702065415, 0.49819321468719685, 0.5011573362592349, 0.5039363415665182 ], [ 0.41773911491705307, 0.41128271787156306, 0.4050726040776731, 0.39918686217942306, 0.39370029303945686, 0.3886814291264681, 0.384189591984256, 0.3802722346224522, 0.3769628335200797, 0.3742795801120975, 0.37222506882155254, 0.3707870889831465, 0.36994050987822696, 0.36965011676108916, 0.3698741306999703, 0.3705680466585782, 0.37168837012069417, 0.3731958343882832, 0.3750577418680277, 0.37724918707573557, 0.3797530711541943, 0.38255898414902606, 0.3856611847929649, 0.38905602192603617, 0.3927391976192579, 0.39670326182410587, 0.4009356577532906, 0.4054175239980723, 0.4101233285151248, 0.4150212865662967, 0.42007441948956126, 0.42524205464968506, 0.43048155010118916, 0.4357500437108499, 0.44100606480910626, 0.4462108952112567, 0.4513296158340035, 0.4563318183780887, 0.4611919951138785, 0.4658896427830551, 0.4704091298684499, 0.4747393817681212, 0.4788734378121555, 0.48280792953848345, 0.4865425228329887, 0.49007935869083935, 0.49342251935871095, 0.4965775390571721, 0.49955097171216634, 0.5023500223292251 ], [ 0.4187438777466134, 0.4123387939939232, 0.40617665558474947, 0.40033511280070166, 0.3948887281793419, 0.389906033010846, 0.3854466044415622, 0.3815584032910554, 0.37827563216304666, 0.37561736139336777, 0.37358712122352533, 0.37217357291597575, 0.37135225730777593, 0.3710882912738251, 0.37133975990195994, 0.37206145496644194, 0.373208555813691, 0.37473984831324186, 0.37662013410743633, 0.37882158980411984, 0.3813239789180754, 0.38411377625172366, 0.38718240955387817, 0.3905239325770878, 0.39413249936251915, 0.3980000044977753, 0.4021141931755565, 0.40645744383837934, 0.4110063072512414, 0.4157317720270454, 0.4206001364172616, 0.42557431010265706, 0.4306153496221822, 0.4356840417410366, 0.4407423811353502, 0.4457548318739893, 0.4506893072346442, 0.45551784290496133, 0.4602169709280103, 0.4647678246109826, 0.4691560184821679, 0.4733713536734588, 0.47740739961619805, 0.48126099943697326, 0.48493174045902554, 0.4884214239664549, 0.4917335607658222, 0.4948729117006291, 0.49784508553699436, 0.5006562007775986 ], [ 0.4204656967141827, 0.4141542969495958, 0.40808001762782786, 0.4023192305808594, 0.3969454526016311, 0.39202648692125747, 0.38762156953949184, 0.38377874855533245, 0.38053274499366485, 0.37790353455341774, 0.37589584550781446, 0.3744996887140491, 0.373691928405749, 0.37343878084063736, 0.3736990101420781, 0.3744274961223218, 0.3755787942397409, 0.37711030404629353, 0.37898471246887055, 0.3811714761470201, 0.3836472386532382, 0.38639522332151116, 0.3894037772816165, 0.39266434524285676, 0.3961692065701482, 0.3999093095551795, 0.4038724865189977, 0.4080422459527901, 0.4123972326169747, 0.41691134366736654, 0.4215544051386808, 0.4262932585227582, 0.43109308429119875, 0.4359187942915205, 0.4407363503396076, 0.4455139030919972, 0.450222685270304, 0.4548376304218225, 0.4593377189321126, 0.46370607540851067, 0.46792985587382413, 0.4719999704667555, 0.475910689006208, 0.4796591743806234, 0.48324498366560414, 0.48666957030375696, 0.4899358134867891, 0.49304759370813384, 0.49600942675230403, 0.4988261624453087 ], [ 0.4228601528925217, 0.41668222168185626, 0.41073334851705323, 0.40508784584274204, 0.3998174229462313, 0.3949884533752901, 0.3906592338226727, 0.3868774465557464, 0.383678057948225, 0.3810818795094616, 0.37909497939806674, 0.37770906124638, 0.3769028291338505, 0.37664424492865645, 0.3768934736385554, 0.3776062219494833, 0.3787371207107497, 0.3802427943449445, 0.3820843021178158, 0.3842287226869356, 0.3866497714690509, 0.38932747157460346, 0.39224702232460884, 0.3953971050696906, 0.3987679198143491, 0.40234925180385334, 0.40612882779936765, 0.41009114845631517, 0.41421689239652587, 0.4184828967130458, 0.42286264251063577, 0.4273271220270472, 0.43184593900829005, 0.4363884939651484, 0.4409251247399227, 0.4454281030164618, 0.44987242191947174, 0.4542363430794466, 0.45850169984415606, 0.4626539749056029, 0.46668218514241716, 0.47057861456463185, 0.4743384390055122, 0.47795928491185635, 0.4814407604675048, 0.48478399141099493, 0.48799118714443473, 0.49106525574851445, 0.49400947981757104, 0.49682725896351726 ], [ 0.42586829971700807, 0.4198600586474544, 0.4140708991817492, 0.40857238357444037, 0.4034337288235407, 0.39871923206587223, 0.3944856767629033, 0.3907799129210998, 0.3876368245341436, 0.3850778939149722, 0.38311054027045444, 0.3817283477786491, 0.38091221124924446, 0.3806323256265466, 0.38085084391852453, 0.38152494306909207, 0.3826099837040184, 0.38406243778566185, 0.3858422914015851, 0.3879147039187643, 0.3902508082259313, 0.3928276532892322, 0.39562740109802486, 0.39863597789689453, 0.40184143160408653, 0.4052322577280572, 0.4087959270140751, 0.41251778854313614, 0.4163804456256433, 0.4203636233481919, 0.4244444788299078, 0.42859825668281515, 0.4327991663069441, 0.4370213533104336, 0.4412398500974916, 0.4454314145340839, 0.44957519458045314, 0.4536531858862633, 0.4576504750972309, 0.46155528207229285, 0.4653588286825631, 0.4690550705823776, 0.47264033206608275, 0.4761128838488577, 0.47947250037272876, 0.48272002800249375, 0.4858569890756544, 0.48888523989903704, 0.49180669399818067, 0.4946231156519663 ], [ 0.4294194518947829, 0.4236127592909443, 0.41801362415194954, 0.41269027923807994, 0.40770886424448194, 0.4031310314663351, 0.3990115243591262, 0.3953959019975646, 0.39231860131217755, 0.3898015276905356, 0.3878533381482252, 0.3864695284646491, 0.38563335994968356, 0.385317571485741, 0.3854867308968984, 0.38610000113596654, 0.38711404483712214, 0.38848577516245447, 0.39017468528384375, 0.39214455009404103, 0.3943643822201054, 0.39680862583338616, 0.39945666982257527, 0.40229184139297397, 0.40530009076141177, 0.4084685919388861, 0.41178446486545256, 0.41523377749006357, 0.4188009237672787, 0.42246840721203877, 0.426217000510348, 0.4300262073969015, 0.43387492719032156, 0.437742214796248, 0.4416080365674073, 0.44545394052382875, 0.44926358315693304, 0.45302308004358977, 0.4567211705494352, 0.46034920598543305, 0.4639009847548628, 0.46737246716375597, 0.4707614070769802, 0.47406693819278645, 0.4772891502117828, 0.48042868543601813, 0.4834863801453828, 0.4864629681775873, 0.48935885710511007, 0.4921739807733121 ], [ 0.4334343578289774, 0.4278561187583755, 0.4224727443233047, 0.4173486811709159, 0.41254651983622054, 0.40812479348303005, 0.4041357442819864, 0.40062320998795553, 0.3976208007080144, 0.3951505362955266, 0.39322209384403567, 0.391832770833042, 0.390968205072243, 0.3906038146036234, 0.3907068397984939, 0.39123879865746974, 0.39215811691406316, 0.39342267600151726, 0.39499203820799805, 0.3968291572985915, 0.39890145666926347, 0.4011812436344691, 0.4036455137671969, 0.4062752701279371, 0.40905452878612264, 0.41196919922056, 0.41500601645884017, 0.41815166656744535, 0.42139219706326836, 0.42471274895465777, 0.4280975965753613, 0.43153044189506495, 0.4349948851639659, 0.43847498405500823, 0.4419558169424571, 0.44542397916680115, 0.4488679601578731, 0.4522783704665547, 0.45564800817082807, 0.45897177176266324, 0.4622464403454969, 0.46547035134609877, 0.4686430110533783, 0.47176467456043464, 0.47483592972224004, 0.4778573152676959, 0.48082899697612935, 0.4837505185918141, 0.4866206366093791, 0.4894372408442687 ], [ 0.437828510680142, 0.432500313149046, 0.42735348476330975, 0.4224483540404157, 0.4178436081695071, 0.41359428921002117, 0.40974975501534483, 0.40635173774738004, 0.4034326486016078, 0.40101427904346115, 0.3991070325884378, 0.3977097853078469, 0.39681041945143597, 0.3963870082249046, 0.3964095595438148, 0.3968421631720728, 0.39764533962000653, 0.39877836875535616, 0.400201385294141, 0.40187706603213863, 0.4037717936761227, 0.40585625447505097, 0.4081054997817248, 0.410498563940265, 0.4130177738146812, 0.4156479041758013, 0.4183753278973751, 0.4211872844048035, 0.42407135085440956, 0.42701515608893725, 0.43000633506935215, 0.4330326870616471, 0.4360824777941454, 0.43914481505959563, 0.44221002773655665, 0.44526998751895314, 0.44831832774156904, 0.45135053156139665, 0.4543638798208117, 0.45735726523000236, 0.4603308927759952, 0.46328589579597734, 0.46622390271953773, 0.46914659122327745, 0.47205526485145877, 0.4749504826288563, 0.4778317655504692, 0.4806973958787585, 0.4835443167331744, 0.48636813129504275 ], [ 0.4425153734399242, 0.4374533491846579, 0.4325587300992856, 0.42788751364276334, 0.4234942442760392, 0.41943020460303787, 0.41574157029165343, 0.41246764333897773, 0.40963929222500134, 0.40727772996145645, 0.405393748659533, 0.40398750041368914, 0.40304887004585305, 0.4025584296770937, 0.4024889051597598, 0.40280702893191433, 0.40347561186439185, 0.4044556454637441, 0.405708249310332, 0.407196306477242, 0.4088856772248313, 0.41074594049459484, 0.41275067394048653, 0.4148773369687892, 0.41710686002044356, 0.41942306282925457, 0.42181202399618234, 0.4242615066612164, 0.4267605154835059, 0.42929902486196825, 0.4318678835019433, 0.4344588710365911, 0.43706486163648756, 0.43968003865525024, 0.4423001029542697, 0.4449224240192365, 0.4475460950675273, 0.4501718686242548, 0.4528019652743496, 0.45543976361991473, 0.45808939248701047, 0.46075525619089036, 0.4634415296570042, 0.4661516622508885, 0.4688879274675924, 0.47165105063742524, 0.47443993923406746, 0.47725153112202157, 0.4800807661495811, 0.48292067687186707 ], [ 0.44740933443370573, 0.44262422758647707, 0.4379923841685837, 0.43356536599379736, 0.4293934418848615, 0.42552396602241244, 0.4219997206787785, 0.4188573213670521, 0.4161257946466772, 0.41382544169141466, 0.41196709144089877, 0.41055182424164827, 0.40957121091761706, 0.40900806627664726, 0.4088376656482801, 0.40902932531865954, 0.4095482102042838, 0.4103572111109876, 0.41141873315832916, 0.4126962566140708, 0.4141555680904499, 0.41576560753580666, 0.4174989268754505, 0.4193318016793311, 0.42124407148353754, 0.4232188034813922, 0.4252418772656522, 0.4273015769203332, 0.4293882548512258, 0.4314941042061323, 0.4336130485325969, 0.4357407326483526, 0.4378745804636433, 0.44001387513425655, 0.4421598145304101, 0.44431549963089734, 0.44648582348726445, 0.4486772419423615, 0.4508974224016961, 0.453154781873743, 0.455457938706087, 0.45781511274981895, 0.4602335152318693, 0.4627187719261653, 0.4652744212157369, 0.46790152267271484, 0.470598402591666, 0.47336055156004475, 0.4761806769070183, 0.47904890104956505 ], [ 0.45242826163709543, 0.44792567714410264, 0.44356227876970084, 0.4393851825760076, 0.4354403434460104, 0.4317711092833078, 0.42841674133375446, 0.42541098404120553, 0.4227807783710907, 0.4205452155137643, 0.41871482099263324, 0.41729124113536353, 0.4162673749160527, 0.4156279566371024, 0.4153505530651846, 0.4154068981840279, 0.4157644558369997, 0.41638808055004334, 0.417241643100009, 0.4182895004995346, 0.4194977176493153, 0.42083498517100676, 0.42227321866773226, 0.42378786248667955, 0.4253579506262533, 0.4269659952807008, 0.42859777848656105, 0.4302421154729569, 0.4318906423823784, 0.43353765976880343, 0.43518004065550386, 0.4368171914542988, 0.43845103832474414, 0.4400860021114368, 0.44172892230587374, 0.44338889411875787, 0.4450769916627383, 0.4468058629798079, 0.4485891975476415, 0.4504410822565177, 0.45237527600821986, 0.4544044445451281, 0.4565394046210604, 0.4587884293001422, 0.4611566636371739, 0.46364569245923004, 0.4662532902459462, 0.4689733685370592, 0.4717961205756041, 0.4747083478222318 ], [ 0.45749557797433, 0.4532763745438453, 0.4491825380264985, 0.445256807889739, 0.4415408676643081, 0.438074061391564, 0.4348920786710795, 0.432025679003935, 0.4294995350894496, 0.42733127762575224, 0.4255308190926654, 0.4241000198332603, 0.42303273662334606, 0.4223152635280734, 0.42192714048752006, 0.4218422712550711, 0.4220302639900617, 0.42245788940256884, 0.4230905457969158, 0.4238936284387061, 0.4248337208092695, 0.4258795539305687, 0.42700271220921043, 0.4281780950519173, 0.4293841684191223, 0.4306030564861731, 0.4318205294238471, 0.43302593950054613, 0.4342121461809244, 0.4353754544768063, 0.4365155726303531, 0.4376355781999356, 0.4387418681190758, 0.43984405987862113, 0.4409548084061932, 0.4420895065184628, 0.4432658454308406, 0.44450322468230197, 0.44582201656282133, 0.4472427070356601, 0.4487849513641867, 0.45046659626748226, 0.45230272965478036, 0.4543048224048438, 0.45648002345925803, 0.45883065971000114, 0.4613539767197267, 0.4640421369948702, 0.4668824716957454, 0.46985796186357953 ], [ 0.46254182851306874, 0.45860261795372453, 0.45477536178913947, 0.45109855605358024, 0.4476097221401408, 0.44434427074791416, 0.4413343373043307, 0.4386076486258215, 0.43618648814294425, 0.43408682970244256, 0.432317706242449, 0.43088086858240826, 0.42977077120835305, 0.4289748975297748, 0.42847440916161267, 0.4282450758567441, 0.428258418710879, 0.42848298277412217, 0.4288856487282596, 0.42943289767601756, 0.4300919573461597, 0.4308317795230379, 0.43162382356040274, 0.43244264540458405, 0.4332663120198502, 0.43407667488151713, 0.4348595420270313, 0.4356047861614951, 0.43630641780263085, 0.4369626395196482, 0.43757588243660506, 0.43815281177148124, 0.43870427637931186, 0.439245169669199, 0.43979416690283135, 0.4403733072107661, 0.4410073975847283, 0.44172322999013813, 0.44254862043580545, 0.4435112986583491, 0.44463769687565, 0.4459517033524623, 0.44747345875283256, 0.44921827820180843, 0.45119577818957907, 0.4534092746446232, 0.45585549779141327, 0.4585246432319859, 0.4614007504351426, 0.46446237319419986 ], [ 0.4675057500837366, 0.4638394655357576, 0.46027223838920867, 0.45683850399214365, 0.45357178357964373, 0.4505036806582178, 0.44766285184931265, 0.4450740026357948, 0.44275696479204696, 0.44072591470024736, 0.4389887890477503, 0.4375469458044889, 0.43639510388270253, 0.4355215754245372, 0.4349087821721346, 0.43453402456361956, 0.4343704521445437, 0.4343881694562253, 0.43455540483351374, 0.43483967134862944, 0.4352088588850258, 0.4356322121261352, 0.43608116830302257, 0.43653004771772064, 0.4369566064329218, 0.4373424718913911, 0.4376734873974066, 0.43793999022724955, 0.4381370414588685, 0.4382646149485266, 0.438327740161616, 0.43833658082577404, 0.4383064205423004, 0.4382575192261131, 0.438214801850675, 0.4382073443472563, 0.4382676310687856, 0.4384305738303526, 0.43873230333987334, 0.4392087681767848, 0.4398942018458757, 0.44081954156534153, 0.4420108996874511, 0.44348819654246713, 0.44526405954027337, 0.4473430767344789, 0.449721465056953, 0.45238717748592394, 0.455320434484803, 0.458494628659633 ], [ 0.47233488273718144, 0.468931381601825, 0.46561463161465905, 0.46241522671909097, 0.45936288989561413, 0.4564855871984067, 0.45380861911881626, 0.4513537318208778, 0.449138296079046, 0.44717460389308067, 0.44546933080264245, 0.444023205271636, 0.44283091513150785, 0.4418812656675143, 0.44115758596671223, 0.4406383617026431, 0.44029805599450555, 0.44010806760749976, 0.4400377692431872, 0.44005556876813867, 0.440129942623419, 0.4402304020033853, 0.4403283665991587, 0.4403979353389815, 0.44041655629443544, 0.4403656069070894, 0.44023089980048197, 0.4400031283709807, 0.4396782605571345, 0.43925787974261243, 0.4387494601395816, 0.43816655193596266, 0.4375288407462885, 0.43686203821327124, 0.4361975575730443, 0.43557193101751884, 0.43502593581203364, 0.4346034138447735, 0.43434979423509223, 0.4343103592859881, 0.43452832751888504, 0.43504285949547944, 0.4358871173721491, 0.4370865223114198, 0.4386573507727221, 0.4406057894848618, 0.44292753100475435, 0.4456079420231873, 0.4486227823774169, 0.4519394024014343 ], [ 0.4769857808776873, 0.47383245324141526, 0.4707542089508342, 0.4677780449428966, 0.46493011631586306, 0.462234953912907, 0.4597146618203656, 0.45738813065620043, 0.45527030692434556, 0.45337156059533185, 0.45169719169585915, 0.4502471115784901, 0.4490157256677376, 0.4479920323700544, 0.4471599386032743, 0.4464987776330566, 0.4459840014325549, 0.44558800936637305, 0.44528106899070274, 0.44503228382611093, 0.4448105669444156, 0.4445855871700856, 0.4443286650750043, 0.44401360687267966, 0.44361747393609813, 0.44312129242064596, 0.44251071033120365, 0.44177660790173595, 0.44091566153133704, 0.4399308524420897, 0.43883189980268805, 0.4376355857129326, 0.4363659278068999, 0.43505414611844384, 0.43373836620129463, 0.4324630022910223, 0.43127777438396686, 0.4302363328688496, 0.42939449420244596, 0.4288081299423284, 0.42853079602139654, 0.428611233948034, 0.4290909131983078, 0.4300018062472987, 0.43136458743798317, 0.4331874205127396, 0.4354654484714943, 0.4381810302897494, 0.4413046930135116, 0.4447966975606883 ], [ 0.48142389127498403, 0.47850625041600897, 0.47565268942842825, 0.47288686805460073, 0.4702316224572753, 0.46770827318288377, 0.46533591523972556, 0.4631307205475951, 0.4611052866839888, 0.45926806751079957, 0.45762292033543994, 0.4561688003779461, 0.4548996264556695, 0.4538043323595515, 0.4528671072212756, 0.45206781646311195, 0.4513825840805439, 0.4507845083893244, 0.4502444780385744, 0.4497320536140903, 0.4492163824786924, 0.4486671199553304, 0.4480553373995143, 0.4473544056912839, 0.4465408497191344, 0.44559517422295647, 0.44450266294978685, 0.443254150933563, 0.44184676377859694, 0.4402846084822565, 0.4385793883431845, 0.43675090099431507, 0.4348273650592909, 0.43284550922494386, 0.4308503499296952, 0.4288945830425698, 0.42703752370041553, 0.4253435495091856, 0.4238800372853674, 0.422714832181405, 0.42191334720579454, 0.4215354539444206, 0.42163238133321335, 0.42224387621732384, 0.42339588560639024, 0.4250989889612634, 0.4273477401719208, 0.43012098263520937, 0.43338309371485706, 0.4370860164275991 ], [ 0.4856231673960178, 0.4829254048363159, 0.4802813920651354, 0.4777117188298574, 0.4752361615797959, 0.4728730697325903, 0.47063873580939575, 0.4685467749667698, 0.46660754252689524, 0.4648276195820268, 0.46320939617786067, 0.4617507786858367, 0.4604450427369162, 0.4592808458115431, 0.45824240489681767, 0.4573098354424952, 0.45645963923348837, 0.4556653217878588, 0.4548981153175398, 0.45412778161910683, 0.4533234704977877, 0.45245461300388745, 0.4514918340179449, 0.4504078744474868, 0.44917851830062155, 0.4477835230695876, 0.4462075522945976, 0.44444110628544803, 0.44248144048983046, 0.4403334509904119, 0.438010493514851, 0.43553508696383525, 0.43293943607149576, 0.43026569226149736, 0.427565859620472, 0.42490124754436764, 0.4223413770828043, 0.4199622686234326, 0.41784407795384404, 0.416068107394511, 0.4147132961339863, 0.4138523810827629, 0.41354800243195533, 0.4138490881896254, 0.41478787057761835, 0.41637785141462824, 0.4186129421927782, 0.4214678705484163, 0.4248997934213816, 0.428850918647774 ], [ 0.4895654866088567, 0.4870709796267786, 0.4846205623039464, 0.4822320225181382, 0.4799223397376589, 0.47770713868295467, 0.4756001281454831, 0.4736125465132176, 0.4717526381496109, 0.47002518610476635, 0.4684311263620474, 0.46696726672887795, 0.46562612955278715, 0.4643959319109357, 0.46326071026101645, 0.4622005894384801, 0.46119218914124566, 0.46020915545041036, 0.4592228011384051, 0.4582028368912769, 0.45711817615222056, 0.45593779875206214, 0.45463166218687256, 0.4531716534686251, 0.4515325779424052, 0.4496931833765982, 0.44763721714393395, 0.4453545107506559, 0.442842078883049, 0.4401052093121814, 0.4371585054988284, 0.4340268260067653, 0.4307460448160361, 0.42736353602659555, 0.4239382679868471, 0.4205403795977517, 0.4172501108411376, 0.41415597691543704, 0.41135211717222064, 0.40893482074628296, 0.4069983298718051, 0.4056301409164635, 0.40490614387093593, 0.4048860365754963, 0.40560949068275437, 0.4070935093977226, 0.40933129672791746, 0.41229277176565005, 0.41592664732316603, 0.42016379695964867 ], [ 0.4932399306078256, 0.4909316948474739, 0.4886585462664258, 0.4864357348687642, 0.48427770402782294, 0.4821976018290794, 0.48020677840493314, 0.47831428746161114, 0.47652641241997246, 0.47484623882064664, 0.4732732946181729, 0.4718032785479617, 0.4704278938828882, 0.4691348007741638, 0.4679076953514292, 0.4667265183532766, 0.46556779087489797, 0.4644050704552588, 0.4632095176790831, 0.46195056204131874, 0.4605966560600622, 0.4591161082987386, 0.4574779885875108, 0.45565310164012895, 0.45361502765036615, 0.4513412294869727, 0.44881422497934675, 0.446022818762287, 0.44296338059491114, 0.4396411454864412, 0.4360714950374927, 0.4322811591277821, 0.4283092529483048, 0.4242080377333697, 0.42004326705120004, 0.41589395865600626, 0.41185142144018144, 0.40801737692566853, 0.4045010552080064, 0.40141522528226703, 0.3988712427554719, 0.39697335684727847, 0.3958126909060778, 0.3954614586646797, 0.3959680561604592, 0.3973536373908379, 0.39961062585710905, 0.4027033564990926, 0.40657073988015074, 0.4111305655157373 ], [ 0.4966419813773933, 0.4945030650410515, 0.49239087289868666, 0.49031837311910975, 0.4882977279074838, 0.48633985399742785, 0.48445396955003867, 0.4826471428373631, 0.4809238600169131, 0.4792856304629978, 0.4777306483100942, 0.4762535279606569, 0.47484512930495765, 0.47349248542025635, 0.4721788418267036, 0.47088381236078575, 0.46958365283610537, 0.468251650350629, 0.46685862375180626, 0.4653735296281152, 0.46376416830985817, 0.4619979855744993, 0.46004296770063235, 0.4578686296672048, 0.45544709799359245, 0.4527542902266438, 0.4497711916283587, 0.4464852254121617, 0.4428917051241021, 0.4389953456902094, 0.43481179253850105, 0.4303691055225762, 0.4257091060182895, 0.42088846228144566, 0.4159793521875936, 0.4110695084216303, 0.40626142689327716, 0.40167051626387396, 0.3974219998526189, 0.3936464662885316, 0.3904741124718079, 0.38802792863900015, 0.3864163153897525, 0.3857258453856474, 0.3860150188775392, 0.38730984693553594, 0.3896018982646117, 0.39284909157788556, 0.3969790897480909, 0.40189476637505445 ], [ 0.49977267628132793, 0.49778649535532904, 0.49581929359013455, 0.49388200261275145, 0.49198474937570424, 0.49013645840956915, 0.48834444052760084, 0.48661398097679925, 0.48494794173445566, 0.483346393766837, 0.48180629544431597, 0.4803212328505481, 0.47888123642224756, 0.47747268630218076, 0.47607831617649304, 0.4746773224818225, 0.47324558304532194, 0.471755986805116, 0.4701788745445898, 0.46848258975573015, 0.4666341388794206, 0.4645999611479871, 0.46234680980854287, 0.4598427482171527, 0.4570582656198431, 0.45396751772930416, 0.45054969572726367, 0.4467905232434221, 0.44268387325451414, 0.43823348467778817, 0.4334547405858668, 0.42837644534421937, 0.42304250572474594, 0.417513381066825, 0.4118671212664646, 0.40619976293916404, 0.4006248119354842, 0.3952715185657052, 0.39028167051841617, 0.3858047114027995, 0.38199116093832786, 0.37898457168163757, 0.3769125820697996, 0.37587795086480447, 0.3759506832082007, 0.37716237851287143, 0.37950368563270365, 0.38292527003352783, 0.38734210373321243, 0.3926403524487791 ], [ 0.5026377572285519, 0.5007883733384181, 0.49895081856555534, 0.4971342206139107, 0.4953469059102609, 0.49359603731376367, 0.49188723801246187, 0.4902242125845655, 0.4886083777374693, 0.4870385163357261, 0.48551046887321525, 0.4840168764605623, 0.48254698867496526, 0.481086548319422, 0.47961776340262735, 0.4781193746867431, 0.47656682520789073, 0.4749325365121903, 0.47318629519606153, 0.47129575285130754, 0.4692270427499286, 0.4669455174958343, 0.4644166132259087, 0.46160684743801284, 0.4584849587121717, 0.4550231969064011, 0.4511987711552011, 0.44699545933172213, 0.4424053755244659, 0.43743088027402177, 0.43208660032312296, 0.4264014987737699, 0.4204209011473416, 0.41420833671513063, 0.4078469977994515, 0.4014405556290418, 0.39511300793788173, 0.38900718663300526, 0.38328154884877697, 0.3781049453784597, 0.37364924197909805, 0.3700799816798891, 0.36754570147305643, 0.36616697544772475, 0.36602660820454336, 0.36716248532114915, 0.36956429522810974, 0.3731746943535197, 0.3778946699626847, 0.383592118939265 ], [ 0.5052468408427948, 0.5035191847741538, 0.5017967799068287, 0.5000871687225814, 0.4983970991802828, 0.49673219259223234, 0.4950965971767229, 0.4934926365542036, 0.4919204638635188, 0.49037773327076173, 0.488859301335562, 0.4873569709287766, 0.4858592901475599, 0.4843514179893961, 0.4828150675238698, 0.4812285360881583, 0.47956683081240636, 0.4778018967480719, 0.4759029542022231, 0.4738369517037106, 0.47156914140184086, 0.4690637845930676, 0.46628499635239823, 0.4631977396700111, 0.45976898069973765, 0.4559690172252982, 0.4517729915998734, 0.4471625963775584, 0.44212797453978386, 0.4366698052067051, 0.4308015481995141, 0.4245517945601437, 0.41796663262286915, 0.41111188806045273, 0.40407503011585794, 0.396966456361456, 0.38991978176754283, 0.38309068101567995, 0.3766537956241, 0.3707972639794912, 0.36571461562688723, 0.3615941328483799, 0.3586063186369508, 0.35689073225169315, 0.35654397497167184, 0.35761079070641105, 0.36007991151690233, 0.3638854381324156, 0.36891344299567924, 0.37501249256707836 ], [ 0.5076126294457618, 0.5059926742366486, 0.504371942791249, 0.5027565964416657, 0.5011520131232434, 0.4995624810576403, 0.49799087742222786, 0.49643833981864577, 0.49490393967074436, 0.4933843677888885, 0.49187364316288607, 0.49036285654054024, 0.488839960495764, 0.48728961751141625, 0.4856931171615809, 0.4840283728784002, 0.48227000816072296, 0.48038954156927677, 0.4783556795923806, 0.4761347265659425, 0.47369112135237723, 0.47098811142082125, 0.4679885762421946, 0.4646560133414638, 0.46095570165252414, 0.45685605758412473, 0.452330198846039, 0.4473577287958137, 0.4419267487330129, 0.4360360956610501, 0.4296977864946668, 0.4229396238246105, 0.4158078798557536, 0.40836992037398756, 0.4007165564391729, 0.3929638171440713, 0.38525372707590666, 0.3777535627107667, 0.3706529855911287, 0.36415846117442485, 0.35848454311697037, 0.35384200254873566, 0.35042343057305264, 0.3483877501593028, 0.34784580539191995, 0.3488495176741911, 0.3513867348000414, 0.3553828319477721, 0.36070867757119796, 0.3671932796110653 ], [ 0.5097501765893948, 0.5082250645313138, 0.5066936795792534, 0.5051609910485624, 0.503631201134523, 0.5021074608814889, 0.5005915703343033, 0.4990836694451219, 0.4975819275611951, 0.49608224044596205, 0.49457794473113836, 0.493059560419152, 0.4915145725324139, 0.48992726324489577, 0.48827860586902433, 0.4865462319729693, 0.48470448275984707, 0.48272455575518913, 0.4805747579274328, 0.4782208766997062, 0.4756266809620812, 0.4727545651795849, 0.46956635097075006, 0.46602426198619834, 0.4620920893309933, 0.4577365658044338, 0.45292896735831395, 0.44764695863733156, 0.4418766951573382, 0.43561518601337296, 0.42887290575909404, 0.42167661921450145, 0.41407234447258306, 0.4061283225330013, 0.397937781935326, 0.38962118031673476, 0.3813274741133302, 0.373233826326967, 0.365543044275199, 0.3584780070700554, 0.3522724879106132, 0.3471581989372917, 0.3433486385221778, 0.34102132162172655, 0.3403009425977466, 0.34124651601557704, 0.34384516770968465, 0.3480139414652291, 0.35360915857069325, 0.3604412281270637 ], [ 0.5116762158680662, 0.5102343438716096, 0.5087812157512491, 0.5073207829754381, 0.5058562518571031, 0.5043898190308961, 0.5029223902560515, 0.5014532880595357, 0.4999799549421867, 0.4984976600240269, 0.49699921805905933, 0.4954747306670455, 0.49391136038519035, 0.4922931487293388, 0.4906008898863875, 0.4888120719735442, 0.48690089805251935, 0.484838399349792, 0.4825926534874609, 0.4801291210500691, 0.4774111145640217, 0.47440041498278757, 0.4710580520446263, 0.46734526632949824, 0.4632246723301044, 0.4586616430875534, 0.4536259374680972, 0.44809359026325, 0.4420490819044861, 0.43548779709507374, 0.4284187677465411, 0.4208676719716768, 0.41288002306325516, 0.4045244247185463, 0.3958956849043087, 0.38711746529808905, 0.3783439954947884, 0.3697602121416492, 0.36157952631473245, 0.3540383459222891, 0.34738659191138305, 0.34187387716755663, 0.3377318530012036, 0.33515440654874473, 0.3342785969075739, 0.3351699029806831, 0.3378149941237317, 0.3421237014164411, 0.34793966021316647, 0.3550571141415648 ], [ 0.5134085577606075, 0.5120396254544547, 0.5106549523029228, 0.509257631309714, 0.5078500382660617, 0.5064335846007386, 0.5050084527024798, 0.50357331832492, 0.5021250658634115, 0.5006585034775008, 0.49916608618584835, 0.4976376561472061, 0.4960602103328884, 0.4944177066743466, 0.49269092052930563, 0.49085736396327184, 0.4888912809194375, 0.48676373189460304, 0.4844427823098442, 0.4818938094266652, 0.4790799434741008, 0.47596265966690227, 0.4725025390268184, 0.46866021733482555, 0.46439754303039726, 0.4596789662052073, 0.4544731816089794, 0.44875504813225536, 0.44250780451306354, 0.4357255944392987, 0.4284163014116586, 0.4206046712530321, 0.4123356632063571, 0.4036779128651152, 0.39472710428119423, 0.3856089273692913, 0.37648113710962605, 0.367534041491937, 0.3589885578253886, 0.35109086318240457, 0.34410274441522715, 0.3382871798976116, 0.33388957836096905, 0.3311164167746608, 0.3301144199963154, 0.33095427922884796, 0.33362257015435864, 0.3380238196787643, 0.343992146854963, 0.35130963482819305 ], [ 0.514965556205538, 0.5136605809347693, 0.5123358659336904, 0.5109937906419478, 0.5096360512501855, 0.5082634293285772, 0.5068755421272552, 0.50547057838568, 0.5040450246500665, 0.5025933883155943, 0.5011079248528497, 0.4995783779126336, 0.4979917421970632, 0.4963320601089276, 0.4945802642246997, 0.49271407857053506, 0.49070799252109837, 0.48853332191096344, 0.4861583726867001, 0.4835487231867666, 0.4806676419746833, 0.4774766591233084, 0.4739363099895189, 0.4700070718231409, 0.4656505149442053, 0.46083069150761874, 0.45551578568944023, 0.44968004884867113, 0.4433060408307022, 0.43638719250575436, 0.42893069249027493, 0.42096067927519704, 0.4125216837265902, 0.40368220951138073, 0.3945382523839101, 0.38521643533474254, 0.3758762708538428, 0.3667108607572715, 0.3579451391704176, 0.34983062766173406, 0.34263572942305753, 0.33663100913658767, 0.33206982617747116, 0.32916608325504887, 0.3280723718512583, 0.3288627598495296, 0.3315241580464298, 0.3359583914475144, 0.3419943880734172, 0.34940745006277457 ], [ 0.516365644386178, 0.5151169470275644, 0.5138449860505216, 0.512551558138622, 0.5112378165069504, 0.5099040541555162, 0.5085494680879176, 0.507171907672413, 0.5057676114756041, 0.5043309381501383, 0.5028540982813764, 0.5013268954614554, 0.499736486225818, 0.49806716981912946, 0.4963002200197008, 0.49441377241719586, 0.4923827815934442, 0.49017906360330743, 0.48777144001341194, 0.48512600057096095, 0.4822065023961414, 0.478974924477049, 0.47539219724116855, 0.4714191280933234, 0.46701754499102804, 0.46215168120733974, 0.45678982506732435, 0.4509062580324355, 0.44448350205191456, 0.4375148910355634, 0.4300074692459645, 0.4219851978527867, 0.4134924148695976, 0.4045974365543222, 0.3953961019850494, 0.38601493868846076, 0.3766134611896523, 0.36738491260585593, 0.35855455251541396, 0.35037445428888386, 0.34311382830273396, 0.3370443026553065, 0.33242051259740135, 0.32945775009834494, 0.3283099595077354, 0.32905235075718137, 0.3316726099430537, 0.3360728768844549, 0.34208192638043994, 0.3494745118707692 ], [ 0.5176269376681875, 0.5164281029386173, 0.5152029460942802, 0.513952798217542, 0.5126783920823988, 0.5113796592225369, 0.5100555073843454, 0.50870358098008, 0.5073200083056363, 0.5058991405708141, 0.5044332891851383, 0.5029124692170681, 0.5013241584581996, 0.4996530830307703, 0.49788104192921023, 0.49598678424197057, 0.49394595402639635, 0.49173111889147614, 0.4893118992860331, 0.4866552163202662, 0.4837256767120331, 0.48048611420109993, 0.47689830756378687, 0.47292389620574266, 0.4685255151663571, 0.4636681720773502, 0.4583208888468322, 0.4524586299884825, 0.4460645365907878, 0.439132478363805, 0.43166992365073914, 0.4237011053008404, 0.41527042403584247, 0.40644597402040894, 0.39732299012716216, 0.3880268953838751, 0.3787154666247375, 0.36957944396828035, 0.360840716472824, 0.3527470925884967, 0.3455627305830005, 0.33955371843772814, 0.33496918271632353, 0.3320196394994303, 0.33085574451825356, 0.33155151363008734, 0.33409579568181264, 0.3383940691181256, 0.3442800558678871, 0.35153429392692515 ], [ 0.5187669006582838, 0.517612715392418, 0.5164296058100234, 0.5152185413668123, 0.5139799430982459, 0.5127134939440521, 0.5114179290271785, 0.5100908080255067, 0.5087282729228104, 0.5073247957379284, 0.5058729222880957, 0.504363019611445, 0.5027830363107166, 0.5011182867318149, 0.49935127149888353, 0.49746154843526946, 0.4954256692589574, 0.4932171986193831, 0.4908068330291347, 0.4881626380522467, 0.48525042277593794, 0.482034271163644, 0.4784772504102144, 0.47454231691326093, 0.470193440891882, 0.46539697086613846, 0.4601232588191652, 0.4543485652912079, 0.4480572599036006, 0.44124432533049834, 0.43391815921541144, 0.4261036456515853, 0.4178454310646402, 0.4092112828227696, 0.40029532597684203, 0.39122083821889897, 0.3821421337950035, 0.373244893358885, 0.3647441305018994, 0.3568788941631469, 0.3499028989623264, 0.3440706885736132, 0.33961977076421984, 0.33675036846209944, 0.3356057000143876, 0.3362564729346918, 0.3386929799369919, 0.3428266538412966, 0.34850065326508994, 0.355506951282819 ], [ 0.5198020748080973, 0.5186884475411091, 0.5175437406616955, 0.5163686532923378, 0.5151633899145284, 0.5139274835603893, 0.5126595986925012, 0.5113573155074779, 0.5100168985462928, 0.5086330538310418, 0.5071986802556877, 0.5057046226045321, 0.5041394353092, 0.5024891678228991, 0.5007371842216836, 0.49886403126707024, 0.496847370619697, 0.49466199213162204, 0.4922799261388413, 0.48967067342458476, 0.4868015720510237, 0.4836383206010773, 0.48014567757112075, 0.47628835672030195, 0.4720321380587843, 0.46734521367619725, 0.46219978642203585, 0.4565739369328283, 0.4504537696571277, 0.4438358398354231, 0.43672984862795083, 0.42916156965170466, 0.4211759329899206, 0.41284013726026125, 0.4042465812535977, 0.39551530003130736, 0.3867954571389495, 0.37826529682907006, 0.3701298301331053, 0.3626154782127937, 0.35596101977644196, 0.35040459425812825, 0.34616726542337484, 0.34343468642749136, 0.34233945230587987, 0.3429473195577829, 0.345250172423585, 0.3491673085263548, 0.35455470179281795, 0.36122012706305223 ], [ 0.5207478627456485, 0.5196717278600853, 0.5185627944792522, 0.5174215705312178, 0.5162481259885088, 0.5150419286333315, 0.513801659415212, 0.5125250087982692, 0.511208456640604, 0.5098470395026173, 0.5084341108277364, 0.5069611011445115, 0.5054172872527644, 0.5037895812126446, 0.5020623517775054, 0.5002172926187385, 0.4982333532067877, 0.4960867494745106, 0.4937510723551099, 0.4911975129410333, 0.4883952233617029, 0.4853118325528063, 0.48191413591431587, 0.47816897742730863, 0.4740443420543993, 0.46951067500239346, 0.4645424423151962, 0.4591199436653759, 0.45323138213883735, 0.4468751857955392, 0.44006255977196523, 0.4328202228890499, 0.4251932456408851, 0.4172478530762684, 0.4090739827331476, 0.40078729273491426, 0.3925302019638248, 0.38447142694715647, 0.37680339008049524, 0.36973686549379564, 0.3634923780836736, 0.35828825593083546, 0.3543258907394877, 0.35177360983472494, 0.3507513740992453, 0.3513189341750854, 0.35346978321638145, 0.35713217614400855, 0.3621769550058278, 0.3684304912697176 ], [ 0.521618365463567, 0.5205775751366709, 0.519502691480778, 0.5183940987734424, 0.5172518018390565, 0.5160752741289925, 0.5148632854674405, 0.5136137105778584, 0.5123233206448082, 0.5109875615299452, 0.5096003238331405, 0.5081537117358061, 0.5066378194300745, 0.5050405258536009, 0.5033473203312216, 0.5015411734807466, 0.49960246928235486, 0.4975090154626755, 0.49523615024920964, 0.49275696407734726, 0.4900426549751468, 0.4870630361220767, 0.483787213489226, 0.4801844505053304, 0.4762252352754603, 0.4718825638132148, 0.4671334496637599, 0.46196066557859333, 0.45635471560984897, 0.45031602476410165, 0.44385731634471665, 0.4370061219515165, 0.4298073330085605, 0.4223256528053065, 0.4146477423076915, 0.4068837718345222, 0.3991679997999726, 0.3916579141298892, 0.38453142055174816, 0.3779815899437533, 0.372208641287899, 0.36740918804266154, 0.36376332256357075, 0.3614207782507757, 0.3604880054419985, 0.3610182655594556, 0.36300657338973236, 0.36639047445498973, 0.3710564671123278, 0.37685077122748645 ], [ 0.5224262685279936, 0.5214194757276008, 0.5203777039124845, 0.5193012702594865, 0.5181901716662982, 0.5170439448745862, 0.5158615064935046, 0.5146409738047188, 0.513379468359963, 0.5120729057466373, 0.5107157764804718, 0.5093009247516085, 0.5078193336456622, 0.5062599274090297, 0.5046094032371445, 0.5028521068360972, 0.5009699675428669, 0.4989425099982215, 0.49674696017898085, 0.49435846396740935, 0.4917504363445544, 0.4888950587385857, 0.4857639410367436, 0.4823289632528316, 0.47856330974123595, 0.47444270596454324, 0.46994686379339545, 0.46506113555991546, 0.4597783687315852, 0.4541009409158401, 0.44804293738069756, 0.4416324084994724, 0.43491361047922045, 0.42794908769970375, 0.4208213984332672, 0.41363421976641956, 0.40651249925081906, 0.3996012649678441, 0.3930626873249529, 0.38707104030132405, 0.38180537663325176, 0.3774400389412078, 0.37413356873247805, 0.37201707583186777, 0.37118354899115696, 0.37167974385463143, 0.37350204006195015, 0.37659701263327694, 0.38086658294757864, 0.38617678059808636 ], [ 0.5231827735151487, 0.5222093093118301, 0.5212003716010947, 0.5201562566646192, 0.519076999199154, 0.5179622441627568, 0.5168110989049239, 0.5156219662697793, 0.5143923604758833, 0.5131187089311909, 0.5117961447216763, 0.5104182962809815, 0.5089770826480264, 0.5074625246707755, 0.5058625844210882, 0.5041630468411293, 0.5023474591378915, 0.5003971445790953, 0.4982913080387541, 0.4960072508354168, 0.4935207120664977, 0.4908063527519355, 0.487838397645655, 0.48459144751688604, 0.48104147195112307, 0.47716698907952865, 0.4729504337782138, 0.46837970925621886, 0.4634499078135379, 0.4581651738873555, 0.45254066507431334, 0.4466045432460317, 0.440399896898134, 0.43398645679618897, 0.42744192048619883, 0.420862650605594, 0.41436346467974305, 0.40807620368627795, 0.4021467734697762, 0.39673042287315863, 0.39198518040264724, 0.38806362978864306, 0.3851035467358214, 0.3832182831166441, 0.3824880660233533, 0.382953456940193, 0.3846120078815519, 0.3874186656886225, 0.39128983165247144, 0.39611036893417334 ], [ 0.5238975708774701, 0.5229573193378091, 0.5219814696531213, 0.5209703337759339, 0.5199240191794743, 0.5188423120375378, 0.5177245412044884, 0.5165694235284994, 0.5153748921238898, 0.5141379105634423, 0.5128542775130834, 0.5115184280821267, 0.5101232400425576, 0.5086598549986417, 0.5071175264630954, 0.5054835085058814, 0.5037430000708925, 0.5018791610956886, 0.4998732171276081, 0.4977046691362188, 0.4953516246316583, 0.4927912649837653, 0.49000046197515235, 0.48695655407102456, 0.4836382895590514, 0.48002693942863806, 0.47610757732343273, 0.47187051666253715, 0.4673128854597982, 0.4624403066855617, 0.45726863530852785, 0.45182568154650127, 0.446152822745166, 0.44030637381734267, 0.43435854983332794, 0.42839781799566967, 0.42252840707047085, 0.41686873180277995, 0.4115485134561565, 0.40670445294083646, 0.4024744543322857, 0.39899060622324867, 0.39637138622365986, 0.39471381082314594, 0.3940864347940492, 0.3945241334573383, 0.396025429487303, 0.3985527666370066, 0.4020356677617775, 0.4063762679109484 ], [ 0.5245788503573978, 0.5236721242289384, 0.5227300203352838, 0.521752893988359, 0.5207409505162832, 0.5196941393081173, 0.5186120292894988, 0.5174936662369095, 0.5163374134030044, 0.5151407782301715, 0.5139002294578977, 0.5126110106436277, 0.5112669579554041, 0.5098603319737888, 0.5083816750572108, 0.5068197074628054, 0.5051612767533996, 0.5033913759454973, 0.5014932462628313, 0.49944858017703186, 0.49723783958703494, 0.49484070247727857, 0.492236649174109, 0.4894056963500367, 0.4863292831277308, 0.48299130886305947, 0.47937931619644675, 0.47548580539625074, 0.47130965640092565, 0.46685762273243153, 0.46214584602129366, 0.4572013208067012, 0.4520632164884526, 0.4467839375086254, 0.44142977600918676, 0.43608098723120553, 0.4308311031593321, 0.425785303448477, 0.42105769564090606, 0.4167674301436156, 0.41303369620343866, 0.4099698099102705, 0.40767679486364367, 0.40623703304179576, 0.4057086769999252, 0.40612151580117095, 0.4074748494956581, 0.4097376637648684, 0.412851063277124, 0.4167326006102152 ], [ 0.5252333448992212, 0.524360765167048, 0.5234533448349749, 0.5225115022029422, 0.521535556576271, 0.5205256326279277, 0.5194815469178494, 0.5184026768778377, 0.5172878136008426, 0.5161350010380124, 0.5149413656885581, 0.5137029425276292, 0.512414504693988, 0.511069406267458, 0.5096594492013495, 0.5081747870191826, 0.5066038791146121, 0.5049335102896307, 0.5031488904240032, 0.5012338488048295, 0.4991711365996581, 0.49694284919122006, 0.4945309775791743, 0.4919180947612105, 0.48908817887228334, 0.48602756977658057, 0.4827260495926178, 0.47917803002985376, 0.4753838200992853, 0.47135093637610287, 0.46709540424048407, 0.4626429823022664, 0.45803022384192393, 0.4533052696046194, 0.4485282477773291, 0.44377114302254184, 0.43911699228263623, 0.4346582774991586, 0.43049442190325654, 0.42672836344229315, 0.4234622783450264, 0.4207926540836778, 0.4188050475414072, 0.41756898353004657, 0.41713351711609986, 0.4175239703351951, 0.4187402457915734, 0.42075692792795977, 0.42352514503413974, 0.42697593432305847 ], [ 0.5258664037755797, 0.5250287859471844, 0.5241571501643252, 0.5232519901500576, 0.5223137473744465, 0.5213427251172986, 0.5203389854905778, 0.5193022296519119, 0.5182316624306544, 0.5171258438032923, 0.5159825310776932, 0.5147985172366154, 0.5135694725878355, 0.5122897985863569, 0.5109525043290134, 0.5095491176551437, 0.5080696438949988, 0.5065025859701484, 0.5048350396606867, 0.5030528773266834, 0.5011410321447457, 0.4990838929562947, 0.4968658170988831, 0.4944717650840971, 0.4918880566586892, 0.4891032425707547, 0.4861090801465286, 0.4829015934063658, 0.4794821897227671, 0.47585879477710297, 0.4720469557304721, 0.4680708492365387, 0.4639641167367467, 0.4597704355519833, 0.4555437226254269, 0.45134786140960803, 0.4472558453978527, 0.4433482489744232, 0.4397109722935929, 0.43643226491376824, 0.4335991124162325, 0.43129316499409676, 0.4295864837261372, 0.42853745937053755, 0.4281872978559424, 0.42855744795382145, 0.4296482629299465, 0.4314390486679341, 0.43388948114511, 0.43694221078101847 ], [ 0.5264820903806569, 0.5256803400334822, 0.5248456459935074, 0.5239785835525548, 0.5230797176769637, 0.5221495260989152, 0.5211883062284197, 0.5201960660589535, 0.5191724001842806, 0.5181163532022438, 0.5170262741345789, 0.5158996670007043, 0.5147330442862109, 0.5135217916596196, 0.5122600538110469, 0.5109406525973103, 0.5095550496576375, 0.5080933661940247, 0.5065444725848341, 0.5048961598344697, 0.5031354034959878, 0.5012487286020371, 0.49922268128657626, 0.4970444091683885, 0.4947023481866324, 0.49218700840145496, 0.4894918452485406, 0.4866141957949275, 0.4835562516144158, 0.4803260309579018, 0.47693830302551515, 0.4734154066590289, 0.469787895316806, 0.4660949309114487, 0.46238434273975365, 0.45871226674125826, 0.45514228767678466, 0.4517440257185895, 0.4485911420842193, 0.4457587868497763, 0.44332057419992865, 0.4413452403488425, 0.4398932070083538, 0.43901332495410944, 0.4387400936099257, 0.4390916327438131, 0.44006861821214427, 0.4416542924583055, 0.4438155391995436, 0.44650489304502755 ], [ 0.527083299893031, 0.5263183196029231, 0.5255216857486691, 0.5246940559735189, 0.5238361143262286, 0.5229485026727085, 0.522031736830974, 0.5210861075595908, 0.5201115674244744, 0.5191076056636112, 0.518073114444667, 0.5170062513272433, 0.5159043042390583, 0.5147635667718208, 0.513579232998145, 0.5123453221927006, 0.5110546446907579, 0.5096988205208021, 0.5082683623030613, 0.5067528331312809, 0.5051410886949483, 0.503421610723913, 0.5015829359402509, 0.4996141810919267, 0.49750566033378874, 0.49524958622525056, 0.492840839935572, 0.4902777898908437, 0.48756313108419946, 0.4847047096815328, 0.4817162895825203, 0.47861820962561435, 0.4754378728201587, 0.47221000337760305, 0.4689766048426904, 0.46578655513532297, 0.4626947838899401, 0.4597609961168637, 0.45704793526493764, 0.45461921822062884, 0.45253682246882315, 0.4508583566880752, 0.44963429288916384, 0.4489053714927069, 0.4487004013004769, 0.44903465773339796, 0.44990903383671477, 0.4513100248546632, 0.4532105401436627, 0.4555714507221571 ], [ 0.5276718918267859, 0.526944501101303, 0.5261869259591802, 0.5253999027452535, 0.5245842255455712, 0.5237406851945269, 0.5228699939345247, 0.52197269582855, 0.5210490638673583, 0.5200989857392466, 0.5191218414216194, 0.5181163770710078, 0.5170805810728555, 0.5160115694855091, 0.5149054893787267, 0.5137574496179954, 0.5125614893696299, 0.5113105948894103, 0.5099967749134139, 0.5086112041181007, 0.50714444260774, 0.5055867371986124, 0.5039284074044893, 0.5021603155104316, 0.5002744159891659, 0.49826437481071617, 0.496126243971477, 0.4938591708846531, 0.4914661162192709, 0.48895454749746237, 0.4863370695089609, 0.483631946782615, 0.4808634685827738, 0.4780621040421266, 0.4752643952303546, 0.47251254051989156, 0.46985363092277826, 0.4673385192817507, 0.46502032681963734, 0.4629526229934977, 0.46118735072802763, 0.45977260600784076, 0.4587504129970059, 0.4581546570054088, 0.4580093419015513, 0.45832732225519224, 0.4591096234015811, 0.46034540879841734, 0.46201259128541833, 0.4640790230368132 ], [ 0.5282488324145393, 0.5275597017072178, 0.5268419976508525, 0.5260965281238572, 0.5253241846615847, 0.5245258883368358, 0.5237025222353849, 0.5228548506076804, 0.5219834255634579, 0.5210884831304434, 0.5201698316013244, 0.5192267363067962, 0.5182578062200552, 0.5172608890446664, 0.516232982572805, 0.5151701710232504, 0.5140675956730283, 0.512919469282257, 0.5117191434900671, 0.5104592374621655, 0.5091318345550266, 0.5077287516134465, 0.5062418827503986, 0.5046636161078427, 0.5029873182202371, 0.5012078762692087, 0.49932228381146704, 0.49733025058381014, 0.49523481187105, 0.49304290784998756, 0.4907658985635343, 0.4884199761195382, 0.486026432882568, 0.4836117435299009, 0.48120742071563904, 0.47884960964463863, 0.47657839695363674, 0.4744368245079182, 0.4724696190742203, 0.47072167350597965, 0.46923634218277616, 0.46805363995973404, 0.46720845588296916, 0.4667289061694556, 0.46663495174630476, 0.46693739186539895, 0.4676373172074216, 0.46872606643071807, 0.47018568461538096, 0.4719898371118684 ], [ 0.5288143418342547, 0.5281639411449298, 0.527486683602249, 0.5267834388096256, 0.5260551806554264, 0.5253029393647967, 0.5245277410905869, 0.5237305351137903, 0.5229121094523203, 0.5220729965577487, 0.5212133717923418, 0.5203329484867124, 0.5194308745277213, 0.5185056365464701, 0.5175549787829176, 0.5165758445030108, 0.5155643483394221, 0.5145157880257111, 0.5134247036161633, 0.5122849913695978, 0.511090077990203, 0.5098331588553494, 0.5085075012410015, 0.5071068104274831, 0.5056256530016415, 0.504059927754138, 0.5024073704080939, 0.5006680741333522, 0.4988450035539322, 0.49694447594343805, 0.4949765797857201, 0.4929554981999281, 0.49089970333005195, 0.4888319882126367, 0.4867793054612145, 0.48477238793949895, 0.4828451359224861, 0.4810337682831611, 0.4793757517618938, 0.4779085415247257, 0.4766681864175117, 0.4756878712954624, 0.4749964837844851, 0.4746173009773287, 0.474566890562608, 0.4748543095357388, 0.4754806623565855, 0.4764390513618455, 0.4777149190561805, 0.4792867490561153 ], [ 0.5293680415215428, 0.5287566035263926, 0.5281200955331076, 0.5274594372422678, 0.5267756682461664, 0.526069905584282, 0.5253432897734238, 0.5245969193787615, 0.5238317748627904, 0.5230486332559849, 0.5222479761152197, 0.5214298942388487, 0.520593993639958, 0.5197393082762851, 0.5188642259188689, 0.5179664342259055, 0.517042894485691, 0.5160898505200083, 0.5151028798261953, 0.5140769931308686, 0.5130067871037147, 0.5118866530362844, 0.5107110418569419, 0.5094747829841271, 0.5081734512945273, 0.5068037729995202, 0.505364057599838, 0.5038546394620481, 0.5022783090930727, 0.5006407110757556, 0.4989506831084309, 0.4972205089564929, 0.4954660577216763, 0.49370678305781435, 0.4919655592174264, 0.4902683364667209, 0.48864360669612017, 0.48712168098434616, 0.4857337941037353, 0.4845110656976834, 0.48348336285207144, 0.4826781223306304, 0.4821192009116787, 0.48182582716413386, 0.4818117261782889, 0.482084479574301, 0.48264516698008314, 0.4834883136738281, 0.4846021447454449, 0.485969121984234 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0468335 (SEM: 0)
x1: 0.172321
x2: 0.517218
x3: 0.344523
x4: 0.885683
x5: 0.140317
x6: 0.718026", "Arm 1_0
hartmann6: -0.396739 (SEM: 0)
x1: 0.146472
x2: 0.0388413
x3: 0.0886124
x4: 0.162793
x5: 0.587168
x6: 0.875173", "Arm 2_0
hartmann6: -0.637356 (SEM: 0)
x1: 0.809404
x2: 0.326209
x3: 0.626972
x4: 0.0820427
x5: 0.0750418
x6: 0.975072", "Arm 3_0
hartmann6: -0.48787 (SEM: 0)
x1: 0.797891
x2: 0.250534
x3: 0.600155
x4: 0.60133
x5: 0.228134
x6: 0.951364", "Arm 4_0
hartmann6: -0.00194616 (SEM: 0)
x1: 0.563197
x2: 0.492574
x3: 0.968255
x4: 0.8177
x5: 0.955405
x6: 0.813688", "Arm 5_0
hartmann6: -0.00494513 (SEM: 0)
x1: 0.421558
x2: 0.814971
x3: 0.0307404
x4: 0.127464
x5: 0.794167
x6: 0.873966", "Arm 6_0
hartmann6: -0.000826118 (SEM: 0)
x1: 0.699434
x2: 0.0473385
x3: 0.882242
x4: 0.915542
x5: 0.973457
x6: 0.0668445", "Arm 7_0
hartmann6: -0.906873 (SEM: 0)
x1: 0.271127
x2: 0.745455
x3: 0.913109
x4: 0.351518
x5: 0.719434
x6: 0.180559", "Arm 8_0
hartmann6: -0.444431 (SEM: 0)
x1: 0.218215
x2: 0.574428
x3: 0.536205
x4: 0.252885
x5: 0.982586
x6: 0.60361", "Arm 9_0
hartmann6: -0.15202 (SEM: 0)
x1: 0.591028
x2: 0.222858
x3: 0.834184
x4: 0.461383
x5: 0.65922
x6: 0.726995", "Arm 10_0
hartmann6: -0.155673 (SEM: 0)
x1: 0.0561848
x2: 0.153245
x3: 0.349294
x4: 0.243428
x5: 0.940295
x6: 0.918951", "Arm 11_0
hartmann6: -0.0740362 (SEM: 0)
x1: 0.902924
x2: 0.647648
x3: 0.180444
x4: 0.34063
x5: 0.584432
x6: 0.567231", "Arm 12_0
hartmann6: -1.34777 (SEM: 0)
x1: 0.245593
x2: 1.21241e-17
x3: 0.078957
x4: 0.0905012
x5: 0.390547
x6: 0.770684", "Arm 13_0
hartmann6: -1.36571 (SEM: 0)
x1: 0.278499
x2: 0
x3: 0.0827593
x4: 0.0588128
x5: 0.326477
x6: 0.74841", "Arm 14_0
hartmann6: -1.6116 (SEM: 0)
x1: 0.2416
x2: 0
x3: 0.0215059
x4: 0.108558
x5: 0.352812
x6: 0.679172", "Arm 15_0
hartmann6: -1.37858 (SEM: 0)
x1: 0.189616
x2: 0
x3: 0.00552408
x4: 0.0847555
x5: 0.356595
x6: 0.598097", "Arm 16_0
hartmann6: -1.99433 (SEM: 0)
x1: 0.280064
x2: 7.99771e-17
x3: 1.92949e-17
x4: 0.196006
x5: 0.347918
x6: 0.679666", "Arm 17_0
hartmann6: -2.16624 (SEM: 0)
x1: 0.324287
x2: 0
x3: 0
x4: 0.246527
x5: 0.309038
x6: 0.66616", "Arm 18_0
hartmann6: -2.00917 (SEM: 0)
x1: 0.407115
x2: 0
x3: 0
x4: 0.273261
x5: 0.333879
x6: 0.627779", "Arm 19_0
hartmann6: -2.14669 (SEM: 0)
x1: 0.296689
x2: 8.01505e-17
x3: 1.31228e-16
x4: 0.297054
x5: 0.270394
x6: 0.713101", "Arm 20_0
hartmann6: -2.27071 (SEM: 0)
x1: 0.312275
x2: 0.0568335
x3: 0
x4: 0.264895
x5: 0.273077
x6: 0.656239", "Arm 21_0
hartmann6: -2.12884 (SEM: 0)
x1: 0.345813
x2: 0.102402
x3: 1.10937e-18
x4: 0.24465
x5: 0.247353
x6: 0.707538", "Arm 22_0
hartmann6: -2.09158 (SEM: 0)
x1: 0.290884
x2: 0.0572386
x3: 2.07853e-17
x4: 0.285079
x5: 0.247642
x6: 0.579308", "Arm 23_0
hartmann6: -2.36543 (SEM: 0)
x1: 0.291377
x2: 0.0739728
x3: 0
x4: 0.290157
x5: 0.304633
x6: 0.669787" ], "type": "scatter", "x": [ 0.17232143878936768, 0.14647230692207813, 0.8094036234542727, 0.7978907218202949, 0.5631966022774577, 0.421558135189116, 0.6994339982047677, 0.27112725377082825, 0.21821485739201307, 0.5910276407375932, 0.056184783577919006, 0.9029239639639854, 0.24559304915285976, 0.27849866003589085, 0.24159981518467807, 0.1896162908269893, 0.2800643839982301, 0.3242870816288127, 0.4071147641553506, 0.2966890418686397, 0.3122748369233028, 0.3458129720691997, 0.2908844379733138, 0.2913766633907688 ], "xaxis": "x", "y": [ 0.5172182321548462, 0.03884132858365774, 0.32620884478092194, 0.2505344543606043, 0.4925741786137223, 0.8149710493162274, 0.04733846243470907, 0.7454551002010703, 0.5744284531101584, 0.22285840194672346, 0.15324465930461884, 0.6476479414850473, 1.2124057953282886e-17, 0.0, 0.0, 0.0, 7.99771395479593e-17, 0.0, 0.0, 8.015051338605287e-17, 0.05683348614449365, 0.10240242871102467, 0.057238600120706966, 0.0739728413892877 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0468335 (SEM: 0)
x1: 0.172321
x2: 0.517218
x3: 0.344523
x4: 0.885683
x5: 0.140317
x6: 0.718026", "Arm 1_0
hartmann6: -0.396739 (SEM: 0)
x1: 0.146472
x2: 0.0388413
x3: 0.0886124
x4: 0.162793
x5: 0.587168
x6: 0.875173", "Arm 2_0
hartmann6: -0.637356 (SEM: 0)
x1: 0.809404
x2: 0.326209
x3: 0.626972
x4: 0.0820427
x5: 0.0750418
x6: 0.975072", "Arm 3_0
hartmann6: -0.48787 (SEM: 0)
x1: 0.797891
x2: 0.250534
x3: 0.600155
x4: 0.60133
x5: 0.228134
x6: 0.951364", "Arm 4_0
hartmann6: -0.00194616 (SEM: 0)
x1: 0.563197
x2: 0.492574
x3: 0.968255
x4: 0.8177
x5: 0.955405
x6: 0.813688", "Arm 5_0
hartmann6: -0.00494513 (SEM: 0)
x1: 0.421558
x2: 0.814971
x3: 0.0307404
x4: 0.127464
x5: 0.794167
x6: 0.873966", "Arm 6_0
hartmann6: -0.000826118 (SEM: 0)
x1: 0.699434
x2: 0.0473385
x3: 0.882242
x4: 0.915542
x5: 0.973457
x6: 0.0668445", "Arm 7_0
hartmann6: -0.906873 (SEM: 0)
x1: 0.271127
x2: 0.745455
x3: 0.913109
x4: 0.351518
x5: 0.719434
x6: 0.180559", "Arm 8_0
hartmann6: -0.444431 (SEM: 0)
x1: 0.218215
x2: 0.574428
x3: 0.536205
x4: 0.252885
x5: 0.982586
x6: 0.60361", "Arm 9_0
hartmann6: -0.15202 (SEM: 0)
x1: 0.591028
x2: 0.222858
x3: 0.834184
x4: 0.461383
x5: 0.65922
x6: 0.726995", "Arm 10_0
hartmann6: -0.155673 (SEM: 0)
x1: 0.0561848
x2: 0.153245
x3: 0.349294
x4: 0.243428
x5: 0.940295
x6: 0.918951", "Arm 11_0
hartmann6: -0.0740362 (SEM: 0)
x1: 0.902924
x2: 0.647648
x3: 0.180444
x4: 0.34063
x5: 0.584432
x6: 0.567231", "Arm 12_0
hartmann6: -1.34777 (SEM: 0)
x1: 0.245593
x2: 1.21241e-17
x3: 0.078957
x4: 0.0905012
x5: 0.390547
x6: 0.770684", "Arm 13_0
hartmann6: -1.36571 (SEM: 0)
x1: 0.278499
x2: 0
x3: 0.0827593
x4: 0.0588128
x5: 0.326477
x6: 0.74841", "Arm 14_0
hartmann6: -1.6116 (SEM: 0)
x1: 0.2416
x2: 0
x3: 0.0215059
x4: 0.108558
x5: 0.352812
x6: 0.679172", "Arm 15_0
hartmann6: -1.37858 (SEM: 0)
x1: 0.189616
x2: 0
x3: 0.00552408
x4: 0.0847555
x5: 0.356595
x6: 0.598097", "Arm 16_0
hartmann6: -1.99433 (SEM: 0)
x1: 0.280064
x2: 7.99771e-17
x3: 1.92949e-17
x4: 0.196006
x5: 0.347918
x6: 0.679666", "Arm 17_0
hartmann6: -2.16624 (SEM: 0)
x1: 0.324287
x2: 0
x3: 0
x4: 0.246527
x5: 0.309038
x6: 0.66616", "Arm 18_0
hartmann6: -2.00917 (SEM: 0)
x1: 0.407115
x2: 0
x3: 0
x4: 0.273261
x5: 0.333879
x6: 0.627779", "Arm 19_0
hartmann6: -2.14669 (SEM: 0)
x1: 0.296689
x2: 8.01505e-17
x3: 1.31228e-16
x4: 0.297054
x5: 0.270394
x6: 0.713101", "Arm 20_0
hartmann6: -2.27071 (SEM: 0)
x1: 0.312275
x2: 0.0568335
x3: 0
x4: 0.264895
x5: 0.273077
x6: 0.656239", "Arm 21_0
hartmann6: -2.12884 (SEM: 0)
x1: 0.345813
x2: 0.102402
x3: 1.10937e-18
x4: 0.24465
x5: 0.247353
x6: 0.707538", "Arm 22_0
hartmann6: -2.09158 (SEM: 0)
x1: 0.290884
x2: 0.0572386
x3: 2.07853e-17
x4: 0.285079
x5: 0.247642
x6: 0.579308", "Arm 23_0
hartmann6: -2.36543 (SEM: 0)
x1: 0.291377
x2: 0.0739728
x3: 0
x4: 0.290157
x5: 0.304633
x6: 0.669787" ], "type": "scatter", "x": [ 0.17232143878936768, 0.14647230692207813, 0.8094036234542727, 0.7978907218202949, 0.5631966022774577, 0.421558135189116, 0.6994339982047677, 0.27112725377082825, 0.21821485739201307, 0.5910276407375932, 0.056184783577919006, 0.9029239639639854, 0.24559304915285976, 0.27849866003589085, 0.24159981518467807, 0.1896162908269893, 0.2800643839982301, 0.3242870816288127, 0.4071147641553506, 0.2966890418686397, 0.3122748369233028, 0.3458129720691997, 0.2908844379733138, 0.2913766633907688 ], "xaxis": "x2", "y": [ 0.5172182321548462, 0.03884132858365774, 0.32620884478092194, 0.2505344543606043, 0.4925741786137223, 0.8149710493162274, 0.04733846243470907, 0.7454551002010703, 0.5744284531101584, 0.22285840194672346, 0.15324465930461884, 0.6476479414850473, 1.2124057953282886e-17, 0.0, 0.0, 0.0, 7.99771395479593e-17, 0.0, 0.0, 8.015051338605287e-17, 0.05683348614449365, 0.10240242871102467, 0.057238600120706966, 0.0739728413892877 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:43.713012Z", "iopub.status.busy": "2022-11-10T20:27:43.712570Z", "iopub.status.idle": "2022-11-10T20:27:44.211819Z", "shell.execute_reply": "2022-11-10T20:27:44.210989Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:43] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9452806271574599, 0.9463299171135822, 0.9478486319894114, 0.9498360369566211, 0.9522905018121508, 0.9552092999634262, 0.9585883691050635, 0.9624220664358023, 0.9667029513199126, 0.9714216228387849, 0.9765666306796829, 0.9821244676620255, 0.9880796429335968, 0.9944148277249782, 1.0011110609559717, 1.0081479997650578, 1.0155041996799892, 1.0231574100767158, 1.0310848722538943, 1.0392636094720733, 1.047670700388889, 1.056283529293462, 1.065080008314482, 1.0740387683143617, 1.0831393164868073, 1.0923621597680893, 1.1016888940841834, 1.1111022602191338, 1.120586167737166, 1.1301256889496436, 1.139707025410243, 1.1493174498621794, 1.158945226957853, 1.1685795164228936, 1.1782102626352589, 1.18782807482137, 1.1974241022161138, 1.2069899085707243, 1.2165173503022946, 1.2259984623457498, 1.2354253553869567, 1.2447901276281073, 1.2540847935807002, 1.2633012316263417, 1.2724311512707707, 1.2814660801885456, 1.2903973703623721, 1.299216221907991, 1.3079137225789994, 1.3164809004929268 ], [ 0.9464491269225157, 0.9475624184569141, 0.949142487845383, 0.9511884060204353, 0.9536984542007685, 0.9566699134277248, 0.960098808729317, 0.9639796434890465, 0.9683051599346687, 0.9730661558764376, 0.9782513780970229, 0.9838475017793781, 0.989839195297843, 0.9962092619577536, 1.0029388453095849, 1.010007682277097, 1.017394387970374, 1.0250767570576276, 1.0330320683681646, 1.0412373815508515, 1.049669816817338, 1.058306810876466, 1.0671263440229577, 1.0761071349465559, 1.0852288011813134, 1.0944719842432886, 1.1038184394422628, 1.1132510911375517, 1.122754054873255, 1.1323126284069616, 1.1419132541609456, 1.1515434560938032, 1.1611917544207173, 1.1708475620014276, 1.1805010665567772, 1.1901431031496839, 1.1997650215521176, 1.2093585531891713, 1.218915682280375, 1.2284285255666467, 1.2378892246085684, 1.2472898540708504, 1.2566223486869603, 1.2658784507601166, 1.275049679148676, 1.2841273197595386, 1.2931024366899195, 1.3019659023683567, 1.3107084443936634, 1.3193207062844574 ], [ 0.9480333649988525, 0.9492138276334868, 0.9508581146744657, 0.9529650766529398, 0.955532877339011, 0.9585587758747873, 0.9620388566521538, 0.9659677449225881, 0.9703383468054796, 0.9751416463524192, 0.9803665819823376, 0.9860000128104057, 0.9920267745973297, 0.9984298167329132, 1.0051904063383024, 1.012288383001981, 1.019702447253676, 1.0274104669329893, 1.0353897875053342, 1.0436175346435488, 1.0520708997095678, 1.060727400944634, 1.0695651151125616, 1.0785628760049784, 1.087700437616598, 1.096958600960056, 1.1063193044518393, 1.1157656786044166, 1.1252820664431842, 1.1348540116648045, 1.1444682170927545, 1.1541124764844892, 1.1637755832121675, 1.1734472197736858, 1.1831178324812788, 1.1927784960017291, 1.2024207726560143, 1.212036571496682, 1.2216180121361975, 1.2311572980736902, 1.2406466038457573, 1.250077979710537, 1.2594432767818222, 1.2687340946001382, 1.2779417521137533, 1.287057282009638, 1.296071447349497, 1.3049747785915542, 1.3137576283655057, 1.3224102408482223 ], [ 0.9500282241120368, 0.9512789333622242, 0.9529902753703015, 0.9551608555394951, 0.9577886898732874, 0.9608709820334418, 0.9644038416904669, 0.9683819841360847, 0.9727984521989417, 0.9776443953979099, 0.9829089304584941, 0.9885790948803335, 0.994639893798722, 1.0010744315369213, 1.0078641135496467, 1.01498890168482, 1.0224276052086996, 1.0301581911107391, 1.03815809917113, 1.046404549632843, 1.0548748337309282, 1.0635465795919472, 1.0723979880238357, 1.081408034436725, 1.090556634576008, 1.0998247729408246, 1.109194593745508, 1.118649455102858, 1.1281739478087858, 1.1377538807251424, 1.1473762353210226, 1.1570290924633635, 1.1667015350550942, 1.1763835306024815, 1.1860657982396041, 1.195739665123319, 1.2053969174038517, 1.2150296511362833, 1.2246301284872532, 1.2341906443772073, 1.2437034082601375, 1.2531604450783298, 1.262553518559195, 1.2718740789881533, 1.2811132364588076, 1.2902617594456287, 1.299310097444998, 1.3082484254616222, 1.3170667073371605, 1.3257547743639202 ], [ 0.9524275201416332, 0.9537514320336675, 0.9555326134940293, 0.9577694024688046, 0.9604596365849332, 0.9636004276117942, 0.9671878714425852, 0.9712167350352587, 0.9756801632518325, 0.9805694424640171, 0.9858738466935467, 0.9915805791334809, 0.9976748099175341, 1.0041398016842107, 1.0109571084324536, 1.0181068301721314, 1.0255679052882984, 1.0333184235938293, 1.0413359450510211, 1.0495978115686049, 1.0580814417668698, 1.0667646009351879, 1.0756256404746565, 1.0846437028876064, 1.093798889853224, 1.10307239214724, 1.1124465811679178, 1.121905062668061, 1.1314326940091366, 1.1410155668897084, 1.1506409580884103, 1.160297251325284, 1.1699738338956014, 1.1796609722669613, 1.189349671338571, 1.1990315225147374, 1.2086985461039657, 1.2183430337749266, 1.2279573968338775, 1.2375340258927663, 1.247065167045638, 1.2565428189570094, 1.2659586543100927, 1.2753039679147486, 1.2845696525082226, 1.2937462019868733, 1.3028237405788594, 1.3117920753936747, 1.320640768932216, 1.3293592275523827 ], [ 0.9552241787479016, 0.9566241089574986, 0.9584778364214525, 0.9607834125480831, 0.9635384669162512, 0.9667399816158587, 0.9703839962420411, 0.9744652858952543, 0.9789770564719424, 0.9839106956234466, 0.9892556065564769, 0.9949991386256457, 1.0011266162938217, 1.0076214583231973, 1.0144653726840207, 1.0216386094463306, 1.0291202532040387, 1.0368885375849277, 1.0449211664099387, 1.053195628527918, 1.0616894958894756, 1.0703806968087357, 1.0792477584782993, 1.0882700146116644, 1.097427775595228, 1.1067024597735775, 1.1160766855126651, 1.1255343245372205, 1.1350605177691768, 1.1446416555478602, 1.154265324725275, 1.1639202257271162, 1.1735960632659903, 1.1832834149871547, 1.1929735829040808, 1.2026584330103425, 1.2123302288917959, 1.221981465454834, 1.231604708974427, 1.2411924494982258, 1.2507369711825032, 1.2602302453710585, 1.2696638501798954, 1.2790289190744237, 1.2883161195084063, 1.297515661242205, 1.3066173325850075, 1.3156105616148241, 1.3244844985000834, 1.3332281144242173 ], [ 0.9584104009386909, 0.9598890093720707, 0.9618178896111114, 0.9641947913302362, 0.9670171084853669, 0.9702816558541951, 0.9739843724569437, 0.9781199945602084, 0.9826817433038672, 0.9876610663512215, 0.9930474618349495, 0.9988283995410823, 1.0049893416629554, 1.0115138554537044, 1.0183838034510506, 1.0255795935013292, 1.0330804699391372, 1.0408648281959831, 1.0489105370877416, 1.057195255496215, 1.0656967327212499, 1.0743930841969542, 1.0832630364148987, 1.092286136734587, 1.1014429252928082, 1.110715067482151, 1.1200854465036347, 1.1295382163611676, 1.139058816408687, 1.1486339492310846, 1.1582515242764821, 1.1679005702888934, 1.1775711202333863, 1.1872540730607906, 1.1969410373109246, 1.2066241621674472, 1.2162959621046456, 1.2259491416422326, 1.235576426880143, 1.2451704103556935, 1.2547234153023221, 1.2642273845733925, 1.27367379834622, 1.2830536233033445, 1.2923572944013173, 1.301574728709088, 1.3106953692629344, 1.319708255564942, 1.3286021163389683, 1.3373654795032972 ], [ 0.9619778079349339, 0.9635375890156579, 0.9655441114505224, 0.9679948122049536, 0.9708868250692186, 0.9742167614454273, 0.9779804154620015, 0.9821724359451383, 0.9867860104488639, 0.9918126012405264, 0.9972417622476035, 1.003061052726078, 1.009256050736867, 1.0158104593454125, 1.02270629159176, 1.0299241166245592, 1.0374433483525876, 1.0452425587650753, 1.0532997999772724, 1.0615929214896298, 1.0700998717026924, 1.0787989751545572, 1.0876691791116606, 1.09669026499672, 1.1058430216832733, 1.1151093789563018, 1.124472500482263, 1.1339168365030299, 1.1434281372216286, 1.1529934285324033, 1.1626009524072802, 1.1722400749155033, 1.1819011655449512, 1.191575452212865, 1.201254857085722, 1.2109318190364016, 1.2205991091946342, 1.2302496465207453, 1.2398763205701635, 1.249471828537027, 1.259028533206787, 1.268538347581729, 1.277992650687538, 1.2873822374939325, 1.296697304106183, 1.3059274675579693, 1.3150618178195388, 1.324088998173171, 1.3329973090067315, 1.3417748293920506 ], [ 0.9659175600339545, 0.9675608383599055, 0.9696473622429739, 0.9721742491796281, 0.9751383518797534, 0.9785360450072965, 0.9823629349754898, 0.9866135346974462, 0.9912809480934552, 0.9963566042108184, 1.0018300702862228, 1.0076889600986023, 1.013918941399052, 1.0205038360023668, 1.0274257991274807, 1.0346655607468649, 1.042202710491719, 1.0500160083120067, 1.0580837048878693, 1.0663838581504899, 1.0748946347838666, 1.0835945879846511, 1.0924629049151593, 1.1014796191390197, 1.1106257848782333, 1.1198836112050818, 1.129236555330385, 1.1386693750259038, 1.148168140979285, 1.1577202105772093, 1.1673141652923795, 1.1769397145480722, 1.1865875696735526, 1.1962492923492212, 1.2059171227577905, 1.215583793468106, 1.225242335818561, 1.2348858861534728, 1.2445074996005712, 1.2540999790627225, 1.2636557266530555, 1.27316662388839, 1.2826239455854342, 1.2920183106566852, 1.3013396710153886, 1.3105773377510046, 1.3197200418182962, 1.328756024865775, 1.3376731546355234, 1.3464590586574183 ], [ 0.9702204490101598, 0.971949379504473, 0.9741181256791752, 0.9767234826835479, 0.9797620050651846, 0.9832298008317122, 0.9871222485628783, 0.9914336784733918, 0.9961570613220831, 1.0012837444621132, 1.0068032642573508, 1.012703251528066, 1.0189694344101294, 1.0255857329227718, 1.0325344325102914, 1.0397964198695266, 1.0473514629961809, 1.0551785178706787, 1.063256045862146, 1.071562328184591, 1.080075766178883, 1.0887751585530852, 1.0976399488437647, 1.106650438200449, 1.1157879601371612, 1.125035015166193, 1.134375364276339, 1.143794081095116, 1.1532775633392902, 1.162813504865155, 1.172390830328174, 1.1819995951907853, 1.19163085460379, 1.2012765055398253, 1.2109291074634878, 1.2205816877421782, 1.2302275388656185, 1.2398600152555486, 1.2494723378954626, 1.2590574150754181, 1.2686076871286216, 1.2781150020773993, 1.2875705276151657, 1.2969647029145326, 1.3062872315300778, 1.3155271143696181, 1.3246727195663919, 1.3337118842980809, 1.342632042308971, 1.3514203701639593 ], [ 0.9748769675848785, 0.9766935388709688, 0.9789465852859287, 0.9816325800505243, 0.9847477661499946, 0.9882879588060071, 0.9922482721866474, 0.9966228099639016, 1.0014043622754327, 1.0065841473475785, 1.0121516264798198, 1.018094409076966, 1.0243982525723374, 1.0310471522498186, 1.0380235090123737, 1.0453083591228012, 1.0528816484157457, 1.060722533793227, 1.0688096963081068, 1.0771216522567606, 1.0856370510367803, 1.0943349508091056, 1.103195065084634, 1.1121979751627549, 1.1213253048714515, 1.1305598553178815, 1.13988569839838, 1.1492882286907464, 1.158754174117328, 1.1682715664809897, 1.1778296736896883, 1.1874188962426075, 1.1970306313827201, 1.2066571092405054, 1.216291206290394, 1.2259262424758888, 1.235555769356919, 1.2451733574876847, 1.2547723918126958, 1.264345884030904, 1.2738863104985112, 1.2833854832425813, 1.2928344600405475, 1.302223497379468, 1.3115420476295194, 1.3207787991986848, 1.3299217560490697, 1.3389583509864749, 1.347875585747441, 1.3566601901695614 ], [ 0.9798773615252581, 0.9817834010669565, 0.9841226807285315, 0.98689135480672, 0.9900853446148962, 0.9937001502763472, 0.99773058900519, 1.002170497967683, 1.0070124425866054, 1.0122474670956418, 1.0178649151373809, 1.0238523368282877, 1.0301954874372719, 1.0368784133682134, 1.043883614346505, 1.0511922666807438, 1.0587844908230215, 1.066639646588496, 1.0747366407027967, 1.083054233297487, 1.091571332174283, 1.1002672658416761, 1.109122028336362, 1.1181164906007084, 1.1272325746773713, 1.1364533882205798, 1.1457633178501017, 1.1551480807399654, 1.1645947345964143, 1.1740916468963492, 1.1836284249829538, 1.1931958093969337, 1.202785533696046, 1.2123901549999223, 1.2220028605853814, 1.231617257010324, 1.2412271493840525, 1.2508263194112508, 1.26040831156398, 1.2699662370137763, 1.2794926046303354, 1.2889791873227667, 1.2984169302526414, 1.307795905086787, 1.317105311696996, 1.3263335258472404, 1.3354681887554034, 1.3444963322535333, 1.3534045317846455, 1.3621790787353052 ], [ 0.9852116695624191, 0.9872088491448351, 0.9896361489715423, 0.9924894093149408, 0.9957642225308612, 0.9994557550132099, 1.0035584987809094, 1.008065989090956, 1.0129705269632396, 1.0182629416417242, 1.0239324195580362, 1.0299664157045982, 1.0363506527118496, 1.0430692039520144, 1.0501046504585847, 1.0574382974765495, 1.065050434720637, 1.0729206243872824, 1.081028002079191, 1.0893515775677938, 1.0978705243618276, 1.106564449109662, 1.1154136337798917, 1.1243992452587455, 1.1335035084480611, 1.1427098401560734, 1.1520029420796096, 1.1613688520295213, 1.170794953306397, 1.1802699428498182, 1.1897837595177294, 1.199327474654793, 1.2088931480206326, 1.2184736531945317, 1.2280624777508646, 1.237653504772402, 1.2472407835569277, 1.2568182985477034, 1.2663797464096964, 1.2759183315844906, 1.285426590401353, 1.2948962527685253, 1.3043181485905029, 1.3136821634622269, 1.3229772451261375, 1.3321914589873884, 1.3413120880411897, 1.3503257701984448, 1.359218664413222, 1.367976636288229 ], [ 0.9908697540142646, 0.9929595943740268, 0.9954765535277088, 0.998416163979609, 1.0017736842899698, 1.0055439320400772, 1.0097210502855314, 1.0142982420319788, 1.0192675094242007, 1.0246194306416756, 1.0303429995955005, 1.0364255436144356, 1.0428527244256451, 1.049608619323616, 1.056675873215442, 1.064035908365003, 1.071669176864387, 1.0795554406737768, 1.0876740649872838, 1.0960043122510474, 1.1045256260278566, 1.1132178958197205, 1.1220616957677112, 1.1310384917628797, 1.140130812891002, 1.1493223843034928, 1.158598219586758, 1.1679446715372976, 1.177349440994358, 1.18680154409325, 1.1962912390400346, 1.2058099143261791, 1.2153499412469826, 1.2249044946894672, 1.2344673474189019, 1.2440326444853167, 1.2535946658108696, 1.2631475863689667, 1.2726852444351582, 1.2822009289517389, 1.2916871968792303, 1.301135730342423, 1.310537241369512, 1.319881429183513, 1.3291569916157042, 1.338351688673689, 1.3474524530492344, 1.3564455397709305, 1.365316705531283, 1.3740514075152395 ], [ 0.9968413219443049, 0.9990251957284585, 1.0016333024061295, 1.0046608740227245, 1.008102832783965, 1.0119536359205683, 1.0162070584244922, 1.0208559461805353, 1.0258919738256382, 1.031305438129313, 1.037085110355827, 1.0432181619332008, 1.0496901686380204, 1.056485190699264, 1.0635859203968043, 1.070973885016558, 1.0786296912055897, 1.0865332964456529, 1.0946642940878104, 1.1030021997573654, 1.1115267286204698, 1.120218054765077, 1.1290570456341253, 1.1380254659712252, 1.1471061470614188, 1.1562831181721853, 1.1655416980468423, 1.174868545114942, 1.184251665813608, 1.193680381117051, 1.2031452521088377, 1.2126379662606823, 1.222151187054071, 1.2316783707333945, 1.2412135553227706, 1.2507511285464539, 1.2602855828834263, 1.2698112675164697, 1.279322148193633, 1.2888115867479253, 1.2982721519548415, 1.307695472341966, 1.3170721394282432, 1.3263916667792781, 1.3356425065358215, 1.3448121211702464, 1.353887104658867, 1.3628533444611464, 1.3716962139352007, 1.3804007841550854 ], [ 1.0031159342948357, 1.0053950669518663, 1.008095653208909, 1.0112126329618893, 1.014740591858885, 1.018673618968875, 1.0230051070639785, 1.0277275258842187, 1.032832200240985, 1.0383091214551365, 1.0441468138675658, 1.0503322698004554, 1.0568509580069705, 1.0636869034675114, 1.0708228309689334, 1.0782403613731588, 1.0859202476659093, 1.0938426374341188, 1.1019873489633254, 1.1103341493125047, 1.1188630242159743, 1.1275544312591335, 1.1363895293275184, 1.1453503787490604, 1.1544201077964682, 1.1635830422849276, 1.1728247959086857, 1.182132319745621, 1.1914939100693702, 1.200899174300581, 1.210338955662234, 1.2198052179398229, 1.2292908927415633, 1.23878969284961, 1.2482958966698294, 1.2578041104041737, 1.2673090163078844, 1.2768051171032255, 1.2862864880738194, 1.295746549268526, 1.3051778702943386, 1.3145720191246917, 1.323919464091934, 1.3332095348873878, 1.3424304443143438, 1.3515693682602594, 1.3606125774606441, 1.369545611613833, 1.378353484567036, 1.387020908682628 ], [ 1.0096829997329535, 1.0120584683319456, 1.0148527031048757, 1.0180603612573575, 1.0216756943086247, 1.0256924194157215, 1.0301035382650356, 1.034901131615414, 1.0400761587956728, 1.0456182883154304, 1.0515157795761207, 1.0577554280799666, 1.0643225789590913, 1.0712012070920665, 1.078374057068818, 1.0858228329377448, 1.0935284258790372, 1.101471167408833, 1.1096310960946734, 1.117988226736331, 1.126522812269544, 1.135215590079961, 1.1440480058291491, 1.1530024092058986, 1.1620622171811374, 1.1712120413526987, 1.1804377768311605, 1.1897266508726307, 1.1990672301530958, 1.208449386256405, 1.2178642196746392, 1.2273039434577526, 1.2367617286601358, 1.2462315149639849, 1.255707791340439, 1.2651853533258384, 1.2746590453679947, 1.2841234985821464, 1.293572875903086, 1.3030006377077563, 1.3123993411599202, 1.3217604854995357, 1.3310744131298733, 1.34033027276055, 1.3495160464369471, 1.3586186376291467, 1.367624013333328, 1.3765173899153085, 1.38528345052032, 1.3939065813269143 ], [ 1.0165317511931902, 1.019004481461685, 1.0218933624134516, 1.0251927794330238, 1.0288966553424646, 1.032998336089521, 1.0374904290467466, 1.0423646196183423, 1.0476114928658353, 1.0532203839794607, 1.0591792758481466, 1.0654747551474304, 1.0720920315319886, 1.0790150185709646, 1.0862264704694795, 1.093708165504487, 1.1014411253560312, 1.1094058588976694, 1.1175826192357607, 1.1259516635797988, 1.1344935066469755, 1.1431891595681292, 1.152020347536073, 1.160969700636281, 1.170020913377871, 1.1791588693862403, 1.1883697285362513, 1.1976409745256442, 1.2069614215527755, 1.2163211794238338, 1.2257115771317704, 1.2351250457867067, 1.244554962799437, 1.2539954604816683, 1.2634412037626164, 1.2728871435270963, 1.282328254085331, 1.2917592653341383, 1.30117440200398, 1.3105671436552435, 1.319930019396276, 1.3292544503001684, 1.3385306500277332, 1.3477475903314777, 1.3568930333487697, 1.3659536275668185, 1.3749150598070263, 1.383762252155114, 1.3924795908036098, 1.4010511733014435 ], [ 1.0236512057425726, 1.0262219677791562, 1.0292063128118754, 1.0325983669509828, 1.0363917330971129, 1.0405793914730141, 1.0451535578002094, 1.050105522367902, 1.0554254941140986, 1.0611024712534696, 1.0671241550160493, 1.073476916962926, 1.0801458242235746, 1.087114721630979, 1.0943663655343294, 1.1018826011664977, 1.109644573751716, 1.1176329628610848, 1.1258282296169915, 1.1342108669734277, 1.1427616442472852, 1.1514618381787982, 1.160293443934083, 1.1692393605476399, 1.1782835462913794, 1.1874111403323293, 1.1966085478088606, 1.205863486139719, 1.2151649910187095, 1.224503381191019, 1.2338701818132225, 1.2432580070333419, 1.252660403456426, 1.2620716574462603, 1.2714865707955259, 1.2809002111782386, 1.290307645916275, 1.2997036697893956, 1.309082539626645, 1.3184377298574517, 1.3277617236389898, 1.3370458532205385, 1.3462802006502803, 1.355453565879348, 1.3645535042362749, 1.3735664298758004, 1.3824777769790435, 1.3912722068826575, 1.3999338473132763, 1.4084465495106928 ], [ 1.03103011142313, 1.0336995145820953, 1.03677995384521, 1.040265310460027, 1.0441488797298404, 1.0484232865772793, 1.05308036369652, 1.058111013080315, 1.0635050724909574, 1.0692512061837476, 1.075336834820842, 1.081748114123577, 1.0884699663652981, 1.095486163987034, 1.10277946080193, 1.110331763561309, 1.1181243350271117, 1.1261380189727845, 1.1343534775130755, 1.142751431638241, 1.1513128966154698, 1.1600194048702965, 1.168853209960496, 1.1777974662270956, 1.1868363796059873, 1.1959553258898823, 1.2051409334467926, 1.2143811280477659, 1.2236651380687775, 1.232983458956039, 1.242327776538608, 1.2516908496016705, 1.2610663531676045, 1.270448685234164, 1.2798327413374906, 1.2892136632517393, 1.2985865703490593, 1.3079462844689427, 1.317287061305164, 1.326602342912197, 1.3358845464894695, 1.3451249036872859, 1.3543133620525123, 1.363438555992604, 1.372487849277276, 1.3814474454248002, 1.390302557237443, 1.3990376229990136, 1.407636554817434, 1.416083004280468 ], [ 1.038656887144356, 1.0414253745392286, 1.0446023435671687, 1.0481814469424071, 1.0521556882452552, 1.0565173523865932, 1.0612579034481333, 1.0663678682663162, 1.071836724856915, 1.0776528128519778, 1.0838032793322068, 1.0902740687228678, 1.0970499606109538, 1.1041146550381928, 1.1114509013676996, 1.1190406643328137, 1.1268653193187583, 1.1349058681734925, 1.1431431667248384, 1.1515581555209367, 1.1601320859512823, 1.168846734712126, 1.1776846004508883, 1.1866290772868384, 1.1956646007153746, 1.2047767621405028, 1.213952388944393, 1.22317958761179, 1.2324477480122489, 1.2417475075493942, 1.2510706745696, 1.2604101112470856, 1.2697595771984918, 1.279113536395214, 1.2884669315877362, 1.297814932448435, 1.30715266592541, 1.316474939725897, 1.325775972129068, 1.3350491430468865, 1.3442867819072133, 1.353480007056204, 1.362618628697506, 1.3716911229940663, 1.3806846793734886, 1.3895853171587265, 1.3983780623571076, 1.4070471715697208, 1.415576387936048, 1.4239492137846785 ], [ 1.0465195628803245, 1.0493874058531276, 1.0526611401890982, 1.0563342082184004, 1.0603993410059838, 1.0648485032737371, 1.0696728102746351, 1.0748624326622715, 1.0804065060962322, 1.086293060725027, 1.0925089824531387, 1.0990400138158158, 1.105870798070248, 1.1129849662911449, 1.1203652641420685, 1.127993712702018, 1.1358517962436805, 1.1439206690870272, 1.1521813734502657, 1.1606150604419645, 1.1692032068447575, 1.177927821015641, 1.1867716319772588, 1.1957182565326978, 1.2047523399602948, 1.2138596665144161, 1.2230272365712647, 1.232243307830199, 1.2414973985403193, 1.2507802513110364, 1.2600837567382153, 1.269400836897759, 1.278725289796187, 1.2880515971921076, 1.297374699868006, 1.306689746457856, 1.3159918242737847, 1.3252756830722128, 1.3345354650674142, 1.3437644563090232, 1.3529548752674225, 1.3620977136220493, 1.371182641531126, 1.380197985161526, 1.3891307785115405, 1.3979668854641252, 1.4066911825739254, 1.4152877891388498, 1.4237403290535386, 1.432032208754845 ], [ 1.0546057272451168, 1.0575730200383462, 1.060943551427295, 1.0647105730927402, 1.0688665657138225, 1.0734031976281766, 1.0783112597648477, 1.0835805907065494, 1.0892000064106742, 1.0951572478247895, 1.1014389569085048, 1.1080306880752266, 1.1149169584033416, 1.1220813365954505, 1.1295065678682672, 1.1371747298547663, 1.145067413196847, 1.1531659197266768, 1.1614514708664287, 1.1699054189950808, 1.1785094549188777, 1.1872458051358423, 1.196097413221863, 1.2050481003253977, 1.2140827003996917, 1.223187166405641, 1.2323486442817602, 1.2415555120133153, 1.2507973816672826, 1.2600650628331806, 1.2693504865742788, 1.2786465898106523, 1.28794716109508, 1.2972466500731183, 1.3065399445965018, 1.3158221215041397, 1.3250881794514475, 1.3343327647042962, 1.3435499032277685, 1.3527327542566616, 1.3618734013004152, 1.3709626957013326, 1.3799901651281723, 1.388943994828723, 1.3978110836322089, 1.4065771705030898, 1.4152270219377032, 1.4237446665031628, 1.4321136607673408, 1.4403173707198662 ], [ 1.0629024882472944, 1.0659691430217428, 1.0694362970447182, 1.073297032330441, 1.077543603668969, 1.0821674100825476, 1.087158946585444, 1.092507748086764, 1.098202337923901, 1.1042301924930606, 1.110577731180626, 1.1172303378322939, 1.1241724168374352, 1.1313874839519544, 1.1388582894882011, 1.14656696958471, 1.1544952199484941, 1.1626244856865267, 1.1709361605217643, 1.1794117887209334, 1.1880332633441173, 1.1967830148718728, 1.2056441847995507, 1.2146007793564573, 1.2236377990723994, 1.232741340456198, 1.2418986665671297, 1.2510982437619964, 1.2603297424123798, 1.2695839999469316, 1.2788529452313049, 1.2881294841142277, 1.2974073470094905, 1.306680900717933, 1.3159449283759483, 1.3251943834670674, 1.3344241262043988, 1.3436286531315424, 1.3528018332075953, 1.3619366655014336, 1.3710250743878551, 1.380057757303712, 1.3890240973814572, 1.3979121487132509, 1.4067086961585589, 1.4153993854135267, 1.4239689135487126, 1.4324012662346248, 1.440679985835129, 1.4487884544166354 ], [ 1.071396451128214, 1.0745621934048941, 1.0781255883028447, 1.0820795700022348, 1.0864161936307726, 1.0911266184154775, 1.0962010748531137, 1.1016288259122897, 1.1073981328971787, 1.1134962358162594, 1.1199093562429738, 1.1266227281629384, 1.1336206595999823, 1.1408866252418484, 1.1484033880740225, 1.1561531462932968, 1.16411770053978, 1.172278635723706, 1.1806175113633697, 1.18911605430931, 1.19775634792206, 1.2065210121199352, 1.2153933691543204, 1.224357590453965, 1.2333988203730726, 1.2425032731624543, 1.2516582999554358, 1.2608524230305922, 1.2700753351054515, 1.2793178619644028, 1.2885718873780143, 1.2978302400872974, 1.3070865436700196, 1.3163350314419193, 1.325570330225546, 1.3347872188597656, 1.3439803696750425, 1.3531440836696176, 1.3622720325006803, 1.371357022222099, 1.3803907944318357, 1.3893638796407843, 1.3982655149475005, 1.4070836335852173, 1.415804928140766, 1.4244149831336212, 1.4328984672053449, 1.441239371231604, 1.4494212766492431, 1.4574276381533378 ], [ 1.080073715143372, 1.0833380797121863, 1.0869971261064224, 1.091043662934457, 1.0954695729573762, 1.1002658067388003, 1.1054223636975036, 1.1109282689484723, 1.1167715548960098, 1.1229392559507463, 1.1294174232354923, 1.1361911640698985, 1.1432447087297732, 1.1505615047542173, 1.1581243371239505, 1.1659154710697814, 1.1739168131269773, 1.1821100853121895, 1.1904770069131696, 1.1989994782812763, 1.2076597611317177, 1.2164406501210137, 1.2253256308294003, 1.2342990196838164, 1.2433460817853863, 1.2524531230366387, 1.2616075533961462, 1.2707979185304659, 1.2800138976080302, 1.289246265520616, 1.2984868184700769, 1.3077282626765991, 1.31696406701068, 1.3261882816853017, 1.335395326814171, 1.3445797566581157, 1.3537360076908218, 1.362858141062153, 1.3719395923364819, 1.3809729431161761, 1.389949729821582, 1.3988603040170084, 1.4076937559744989, 1.4164379087463244, 1.4250793843991965, 1.4336037381190228, 1.441995650601744, 1.4502391652993527, 1.4583179550988583, 1.4662156028495756 ], [ 1.0889198893085685, 1.0922822166346249, 1.0960361178736242, 1.1001742983455687, 1.1046884961725754, 1.1095694851891806, 1.1148070683020872, 1.1203900682557826, 1.1263063232926311, 1.1325426947598725, 1.1390850925046243, 1.1459185221832124, 1.1530271566777184, 1.160394431903676, 1.1680031655858922, 1.1758356961793337, 1.1838740380604946, 1.1921000484065942, 1.2004956007790517, 1.2090427602810414, 1.2177239552096324, 1.226522140314729, 1.23542094706221, 1.2444048166392976, 1.2534591118093914, 1.2625702041077598, 1.2717255332654358, 1.2809136361665012, 1.290124143104322, 1.2993477396373991, 1.3085760929979964, 1.3178017428284678, 1.3270179570676663, 1.3362185551390353, 1.345397702242557, 1.3545496805298818, 1.363668645185271, 1.3727483757883203, 1.3817820355171484, 1.3907619523611654, 1.3996794370752081, 1.4085246516840648, 1.417286539695483, 1.4259528249013305, 1.4345100802447028, 1.442943862527105, 1.4512389036441928, 1.4593793453225643, 1.467349002377087, 1.475131639305806 ], [ 1.0979201257051265, 1.1013795588672257, 1.105227311790487, 1.1094560084372802, 1.1140572698714635, 1.1190217251981094, 1.124339015663509, 1.129997797633228, 1.1359857506459077, 1.1422895964257451, 1.1488951337695175, 1.1557872928163588, 1.1629502105887164, 1.1703673280640052, 1.17802150755115, 1.1858951679018033, 1.1939704341264872, 1.2022292973156774, 1.2106537803603057, 1.2192261047857345, 1.2279288540112427, 1.2367451284773576, 1.2456586883056977, 1.254654079437123, 1.2637167395116837, 1.2728330800956242, 1.2819905422252196, 1.2911776226338518, 1.3003838684777396, 1.3095998389073162, 1.3188170324855575, 1.3280277802796254, 1.3372251054997153, 1.3464025518781126, 1.3555539846041367, 1.3646733695536357, 1.3737545387083085, 1.3827909518917758, 1.391775466984753, 1.4007001322405417, 1.4095560147646393, 1.4183330782540369, 1.4270201205042083, 1.4356047770946136, 1.4440735925323152, 1.4524121547300388, 1.4606052838685377, 1.4686372631411697, 1.4764920969752766, 1.4841537820728858 ], [ 1.107059167984161, 1.1106146501909484, 1.1145550461774842, 1.118872919801922, 1.1235598020035593, 1.1286062085832735, 1.13400165352852, 1.139734662538794, 1.1457927918320254, 1.152162657088665, 1.1588299766219672, 1.165779631713143, 1.1729957457003983, 1.1804617820282584, 1.188160660179033, 1.1960748873092992, 1.2041867025457658, 1.2124782302671009, 1.2209316382977524, 1.229529296735581, 1.2382539330922078, 1.247088779504394, 1.2560177079435846, 1.2650253495811803, 1.2740971947397455, 1.2832196701656473, 1.2923801906960648, 1.301567182772412, 1.3107700776924336, 1.319979273023212, 1.3291860612539919, 1.3383825255955732, 1.347561403877418, 1.356715922796727, 1.3658396063587142, 1.374926064201476, 1.3839687675492158, 1.3929608226248944, 1.4018947532173351, 1.4107623053840879, 1.419554287581746, 1.4282604585018837, 1.4368694723827997, 1.4453688876818314, 1.4537452401734707, 1.4619841764794432, 1.470070639508377, 1.4779890939223945, 1.4857237779059502, 1.4932589672078265 ], [ 1.116321412194967, 1.1199716849364687, 1.124003311181739, 1.1284088149918297, 1.1331796630560473, 1.1383062881921961, 1.1437781104640277, 1.149583559670441, 1.1557101033292856, 1.1621442841207756, 1.1688717701467954, 1.175877420426142, 1.183145366925851, 1.1906591132608233, 1.1984016490889158, 1.2063555782643984, 1.2145032580319253, 1.2228269459623067, 1.2313089509420516, 1.2399317843111877, 1.2486783071695506, 1.257531869910612, 1.2664764401665072, 1.2754967155353427, 1.2845782176967029, 1.293707364795409, 1.3028715192885283, 1.3120590088155892, 1.3212591180857254, 1.330462050304925, 1.3396588573257986, 1.3488413385304627, 1.358001909494763, 1.367133442761905, 1.376229084590292, 1.385282053312297, 1.3942854268677811, 1.4032319290015596, 1.4121137252898053, 1.4209222412627016, 1.4296480150643456, 1.4382805960377805, 1.446808498209137, 1.4552192139934472, 1.4634992889634926, 1.4716344538359265, 1.479609805624364, 1.4874100267604409, 1.4950196292158768, 1.50242321030436 ], [ 1.1256909769037706, 1.1294345788057383, 1.133555819835555, 1.138047203405906, 1.1429001564479269, 1.1481050575946565, 1.1536512647617407, 1.1595271451217501, 1.1657201107810269, 1.1722166633563786, 1.1790024501660625, 1.186062333988439, 1.1933804774151484, 1.200940441842758, 1.2087253002008147, 1.216717761672709, 1.2249003059694732, 1.2332553241836623, 1.241765262879273, 1.250412767850327, 1.2591808238845974, 1.2680528868764127, 1.2770130047213817, 1.2860459235782025, 1.2951371762860668, 1.3042731499749092, 1.313441130202153, 1.3226293193036982, 1.3318268270759006, 1.3410236324349825, 1.3502105153605741, 1.359378959256255, 1.3685210248849775, 1.3776291982863018, 1.3866962165605932, 1.3957148770820127, 1.4046778374931754, 1.4135774155850318, 1.4224053996446469, 1.431152880768548, 1.4398101186797159, 1.4483664515028525, 1.4568102576451747, 1.46512897452669, 1.4733091747740208, 1.481336696190141, 1.4891968179448691, 1.496874472507564, 1.5043544811609868, 1.5116218005389537 ], [ 1.1351517796661064, 1.1389870461194116, 1.1431960855982295, 1.1477713986991211, 1.1527043954640022, 1.1579854273033063, 1.1636038198260161, 1.1695479089400629, 1.1758050828455702, 1.1823618324631358, 1.1892038124540911, 1.1963159143713176, 1.2036823527133373, 1.2112867638300104, 1.2191123168211653, 1.2271418348389675, 1.2353579245878592, 1.2437431113316486, 1.2522799763682577, 1.260951293710507, 1.2697401626014484, 1.2786301324767542, 1.2876053170481958, 1.2966504943065411, 1.305751189420271, 1.3148937377350087, 1.3240653253603578, 1.3332540051765043, 1.3424486865188712, 1.3516390973282713, 1.3608157182137135, 1.369969688694994, 1.379092686898557, 1.3881767851901787, 1.3972142856376608, 1.4061975407678067, 1.4151187667269327, 1.4239698575236246, 1.4327422103131884, 1.4414265724149962, 1.4500129206705807, 1.4584903826478077, 1.4668472070062608, 1.4750707871892224, 1.483147738831678, 1.4910640273572795, 1.4988051387096273, 1.5063562834717414, 1.5137026230410962, 1.520829506099613 ], [ 1.1446876171763598, 1.148612680813335, 1.1529075037359806, 1.1575646001314186, 1.1625753842332764, 1.1679302051372797, 1.1736183837868364, 1.1796282539670833, 1.1859472093557761, 1.1925617586178263, 1.199457590221304, 1.2066196481483362, 1.214032219041997, 1.2216790306395515, 1.2295433606565007, 1.237608154654293, 1.2458561508813306, 1.254270009640497, 1.2628324444127563, 1.2715263517508972, 1.280334936840506, 1.2892418315936762, 1.2982312021817017, 1.3072878430163335, 1.3163972543475297, 1.325545700858439, 1.334720248909239, 1.3439087804206604, 1.3530999818113991, 1.362283306931494, 1.3714489135899834, 1.3805875740841096, 1.3896905611186523, 1.398749511666661, 1.407756272655169, 1.4167027338165727, 1.4255806545393357, 1.4343814929387353, 1.443096246454984, 1.451715313844674, 1.46022838823803, 1.4686243898253226, 1.476891444670187, 1.4850169132509667, 1.4929874689015277, 1.500789222782347, 1.5084078888185115, 1.515828979582801, 1.5230380226195992, 1.530020786258528 ], [ 1.1542822467653608, 1.158295038849513, 1.1626734342214173, 1.1674099755738359, 1.1724961005248766, 1.1779221785739653, 1.183677551268782, 1.189750576988909, 1.1961286819172725, 1.2027984187195138, 1.2097455342003312, 1.2169550467928765, 1.2244113342142926, 1.2320982310423556, 1.239999135386147, 1.2480971232800326, 1.2563750689541882, 1.2648157687451296, 1.2734020661129088, 1.282116975027372, 1.290943798867423, 1.2998662419361675, 1.308868510721778, 1.3179354021213456, 1.327052375989517, 1.3362056095744654, 1.3453820316668104, 1.3545693346212835, 1.363755962831869, 1.3729310767659113, 1.3820844923121016, 1.3912065959898938, 1.4002882375174914, 1.409320602343267, 1.4182950679928936, 1.4272030494218488, 1.4360358399021544, 1.444784455179842, 1.4534394895416263, 1.4619909928293513, 1.4704283771525857, 1.4787403609471652, 1.4869149560903605, 1.494939501134315, 1.5028007406215411, 1.510484947264271, 1.5179780808959633, 1.5252659758734817, 1.5323345472362928, 1.539170005475933 ], [ 1.1639194672960813, 1.1680177200820836, 1.1724772841959896, 1.1772907442304836, 1.182449578447382, 1.1879441972134093, 1.1937639854897657, 1.1998973504268013, 1.2063317752406717, 1.2130538805026199, 1.220049493764404, 1.22730372810312, 1.234801069734842, 1.2425254743622673, 1.2504604714287382, 1.2585892749839773, 1.2668948994522358, 1.2753602782476305, 1.283968382912781, 1.2927023402666302, 1.3015455449322944, 1.310481764570583, 1.3194952351631564, 1.328570743766597, 1.3376936962931267, 1.3468501680664549, 1.3560269351583611, 1.3652114848420531, 1.3743920039158868, 1.3835573441706552, 1.3926969649123204, 1.4018008532229453, 1.4108594235539673, 1.4198633992921446, 1.4288036800951103, 1.4376712000084164, 1.4464567825626213, 1.4551510000844496, 1.463744045186702, 1.4722256226596677, 1.4805848696212562, 1.4888103106981436, 1.4968898532037187, 1.504810824866859, 1.512560053880526, 1.5201239881939295, 1.5274888484011364, 1.534640806570244, 1.5415661820984845, 1.5482516452315322 ], [ 1.1735831978808193, 1.1777644479885971, 1.1823025883985656, 1.1871902574782789, 1.192418989458628, 1.1979792537745473, 1.2038604991275277, 1.2100512030325958, 1.2165389277029504, 1.2233103830803735, 1.230351497645373, 1.237647497358311, 1.2451829927213027, 1.2529420735447654, 1.2609084105850443, 1.269065362819632, 1.2773960887667104, 1.2858836599511667, 1.2945111743784619, 1.3032618677039514, 1.312119219677171, 1.3210670533956628, 1.3300896249172074, 1.3391717008508157, 1.3482986216750588, 1.3574563487197273, 1.3666314929998122, 1.3758113244176942, 1.3849837602624717, 1.3941373324473796, 1.4032611335495762, 1.412344742461053, 1.4213781313262406, 1.4303515564212537, 1.4392554366919357, 1.4480802247598135, 1.4568162762437566, 1.46545372411896, 1.4739823654092836, 1.4823915676434454, 1.4906702020793745, 1.4988066096436587, 1.5067886038564544, 1.5146035128248436, 1.5222382598935664, 1.5296794800083615, 1.5369136665582994, 1.543927341664961, 1.5507072417418384, 1.5572405097168036 ], [ 1.1832575531882372, 1.1875191460200432, 1.1921330862990533, 1.1970920765500928, 1.202387720400394, 1.2080105623295387, 1.2139501326563125, 1.2201949982914944, 1.2267328198457117, 1.2335504156353276, 1.2406338329798863, 1.2479684269473192, 1.2555389464004414, 1.2633296268570744, 1.2713242893223358, 1.2795064439101795, 1.2878593967599743, 1.296366358487737, 1.3050105521984312, 1.3137753189292234, 1.3226442182958098, 1.3316011220720945, 1.3406302984480338, 1.349716484779274, 1.3588449467673454, 1.3680015221934692, 1.3771726475787778, 1.3863453664670198, 1.395507318432951, 1.4046467084207035, 1.4137522566209153, 1.422813129807976, 1.4318188558764968, 1.4407592242244351, 1.4496241755963777, 1.4584036859716312, 1.467087649979418, 1.4756657700479963, 1.484127457929374, 1.4924617552706971, 1.5006572794317676, 1.508702199726975, 1.5165842477200417, 1.5242907632227847, 1.5318087754223004, 1.5391251163127564, 1.5462265615789215, 1.5530999924772546, 1.5597325712291141, 1.5661119220353024 ], [ 1.1929269144141215, 1.197266009626957, 1.2019527949753281, 1.206980046078256, 1.212339447552638, 1.2180216327487803, 1.2240162291056225, 1.230311909466334, 1.2368964497299195, 1.2437567931652824, 1.2508791215835964, 1.2582489333632914, 1.265851128066993, 1.2736700971015922, 1.2816898195732593, 1.2898939621971548, 1.2982659818540911, 1.3067892291550187, 1.3154470511873533, 1.3242228914791838, 1.3331003851310028, 1.3420634470292823, 1.3510963510733296, 1.3601837984160237, 1.3693109728432804, 1.3784635815996926, 1.3876278802148745, 1.3967906802040368, 1.4059393389155446, 1.4150617312856353, 1.424146203842028, 1.4331815119746714, 1.4421567422567494, 1.451061222433515, 1.4598844225671412, 1.4686158516796923, 1.477244955002266, 1.4857610175269014, 1.4941530798704743, 1.5024098724014952, 1.5105197730779027, 1.5184707934652457, 1.5262505959769816, 1.5338465435961672, 1.5412457813546143, 1.5484353468565923, 1.5554023053420973, 1.5621339033668857, 1.5686177342548535, 1.5748419081053715 ], [ 1.2025759952512962, 1.2069895732801352, 1.2117460770301542, 1.216838362769078, 1.2222582059486315, 1.2279963405670515, 1.2340425044202972, 1.2403854904322575, 1.2470132042677222, 1.2539127283796891, 1.2610703925259263, 1.2684718506167212, 1.2761021635390786, 1.2839458873587588, 1.2919871660472233, 1.3002098276317335, 1.3085974824373912, 1.3171336218903114, 1.3258017161892917, 1.3345853090339619, 1.3434681075234807, 1.3524340653131088, 1.3614674571375436, 1.370552942881667, 1.379675619504106, 1.3888210593009407, 1.3979753332412634, 1.4071250184200106, 1.4162571890628195, 1.4253593909885964, 1.4344195999904648, 1.4434261652329814, 1.4523677394723906, 1.4612331986667368, 1.4700115543191892, 1.478691862640891, 1.4872631352635857, 1.495714256699466, 1.5040339139524104, 1.5122105435553936, 1.5202323007869032, 1.528087054887427, 1.5357624127863176, 1.5432457722455533, 1.5505244035646593, 1.5575855572354471, 1.5644165933581826, 1.5710051273816126, 1.5773391859130317, 1.583407366008326 ], [ 1.2121899024126732, 1.2166747720233537, 1.221497703062715, 1.226651638694772, 1.232128453404798, 1.2379189916885212, 1.2440131128021443, 1.2503997416444104, 1.25706692583745, 1.264001899017979, 1.2711911502445938, 1.2786204992763686, 1.2862751772926406, 1.2941399124163184, 1.3021990191868917, 1.3104364909172599, 1.318836093672628, 1.3273814604387835, 1.3360561839086513, 1.344843906214738, 1.3537284038746618, 1.3626936661994264, 1.3717239654419937, 1.3808039170391118, 1.389918528425818, 1.3990532350833966, 1.4081939227231022, 1.4173269348149184, 1.4264390650483116, 1.4355175347632996, 1.444549955916118, 1.4535242807386162, 1.4624287399021152, 1.4712517716823776, 1.4799819453081149, 1.488607882314473, 1.4971181802558862, 1.5055013434923525, 1.5137457258803677, 1.5218394900133987, 1.5297705871265492, 1.5375267608979857, 1.545095577179311, 1.5524644802469578, 1.5596208746029299, 1.5665522298073775, 1.5732462044417923, 1.579690784206689, 1.585874428440857, 1.5917862190527905 ], [ 1.2217541904402476, 1.2263069972747822, 1.2311929083890258, 1.2364049588684503, 1.2419351288972014, 1.2477743815254043, 1.2539127065879705, 1.2603391707524438, 1.267041973654668, 1.2740085100231966, 1.281225437595839, 1.288678750499395, 1.2963538576037708, 1.3042356651842641, 1.3123086630415677, 1.3205570130487263, 1.328964638927643, 1.337515315912537, 1.346192758841115, 1.3549807071302435, 1.36386300504609, 1.372823675671041, 1.3818469870046846, 1.3909175087160035, 1.4000201581923848, 1.4091402347120265, 1.4182634408039376, 1.427375890159022, 1.436464101819285, 1.445514980802188, 1.4545157858113553, 1.4634540852358593, 1.4723177032340264, 1.481094658311056, 1.4897730973994237, 1.4983412289937272, 1.5067872593248224, 1.5150993358241063, 1.5232655021706445, 1.5312736689840056, 1.5391116036952874, 1.5467669422982009, 1.5542272245853184, 1.5614799531831471, 1.568512675314306, 1.575313084856386, 1.5818691410567916, 1.5881691993078648, 1.5942021487629492, 1.5999575513183828 ], [ 1.2312549106765265, 1.2358721467389706, 1.24081744385165, 1.246083932915345, 1.2516637050652437, 1.25754784831381, 1.2637264903677883, 1.270188847524155, 1.2769232795199645, 1.2839173501506531, 1.2911578933808536, 1.2986310845540587, 1.3063225161684298, 1.3142172775337844, 1.3223000374674891, 1.3305551290337936, 1.3389666351900256, 1.347518474081006, 1.3561944826261558, 1.3649784969764551, 1.373854428384507, 1.3828063330336815, 1.3918184744144133, 1.400875376920346, 1.4099618694675762, 1.4190631181201456, 1.4281646469381657, 1.4372523465545317, 1.446312470334466, 1.455331618378334, 1.4642967100891393, 1.4731949465323175, 1.482013764351774, 1.4907407835496918, 1.4993637519562935, 1.5078704896706476, 1.5162488370978546, 1.5244866103933365, 1.5325715681047578, 1.5404913925397896, 1.5482336888645496, 1.555786004158654, 1.5631358676528597, 1.570270852218531, 1.5771786559522891, 1.583847201507222, 1.5902647497665403, 1.5964200236268111, 1.60230233712047, 1.607901724892565 ], [ 1.2406786543885713, 1.2453566684061403, 1.2503576206761355, 1.255674740772297, 1.2613002347442368, 1.2672253204738944, 1.2734402691726139, 1.2799344528682803, 1.2866963976931851, 1.2937138427214196, 1.3009738040197731, 1.3084626434703, 1.3161661418012824, 1.3240695751316467, 1.3321577941996372, 1.3404153053164696, 1.3488263519669204, 1.3573749958773136, 1.3660451962924103, 1.3748208861508773, 1.3836860438275498, 1.3926247591233412, 1.4016212922328481, 1.4106601245089627, 1.4197259999759355, 1.4288039567206472, 1.4378793475194316, 1.4469378493366123, 1.4559654616619728, 1.464948494035699, 1.473873543535743, 1.4827274634640308, 1.491497324948326, 1.5001703736535439, 1.5087339842401866, 1.5171756155827725, 1.5254827700274107, 1.5336429600842267, 1.5416436858798135, 1.5494724264098276, 1.5571166471207163, 1.5645638256221, 1.571801496421217, 1.578817314535768, 1.5855991367582576, 1.5921351183007049, 1.5984138216311532, 1.604424333597913, 1.6101563864790265, 1.6156004784196527 ], [ 1.2500125901233052, 1.2547475987059344, 1.2598003494239303, 1.2651641724427554, 1.270831391526783, 1.2767933579830368, 1.2830404906664352, 1.2895623218546521, 1.2963475487552298, 1.3033840903450187, 1.310659149161856, 1.3181592775729982, 1.325870447937542, 1.3337781259662878, 1.3418673464673019, 1.350122790555667, 1.3585288633062285, 1.3670697707451505, 1.3757295950131883, 1.3844923664959232, 1.393342131706489, 1.4022630157280969, 1.411239278079699, 1.4202553609613395, 1.4292959289689742, 1.4383458995443619, 1.4473904636464567, 1.4564150963975275, 1.465405557769912, 1.4743478837344945, 1.4832283686837426, 1.4920335403591771, 1.500750128939883, 1.5093650323630567, 1.5178652803228792, 1.526237999697765, 1.534470384354595, 1.5425496723369558, 1.5504631333339491, 1.5581980690263562, 1.565741828412161, 1.5730818395364627, 1.5802056582235564, 1.5871010334840117, 1.5937559883130898, 1.6001589136840808, 1.6062986727447877, 1.6121647116115156, 1.6177471727680488, 1.6230370069406368 ], [ 1.259244495440526, 1.2640325949523281, 1.2691331731638047, 1.274539661909827, 1.2802445044317796, 1.286239187813584, 1.292514281363719, 1.2990594807212716, 1.3058636574142466, 1.3129149135352627, 1.3202006411241882, 1.3277075857605398, 1.335421913773325, 1.3433292823771463, 1.3514149119448722, 1.3596636595342557, 1.3680600927035738, 1.3765885625840375, 1.3852332751285585, 1.393978359431557, 1.402807932015309, 1.4117061560086643, 1.420657294206002, 1.4296457550907695, 1.4386561310414228, 1.4476732281099562, 1.4566820869763415, 1.4656679949356857, 1.474616489068395, 1.4835133510721004, 1.492344594591164, 1.5010964462536485, 1.5097553220011046, 1.5183078006530286, 1.526740596960478, 1.535040536644245, 1.543194536052647, 1.5511895890844203, 1.559012763880515, 1.5666512114808695, 1.574092188166869, 1.5813230925820132, 1.58833151797277, 1.595105319065611, 1.6016326922527855, 1.6079022669629253, 1.6139032054055322, 1.6196253073547675, 1.6250591163160095, 1.630196023317596 ], [ 1.2683627832210715, 1.2731999622692969, 1.2783442950392383, 1.283789315368637, 1.2895275868224327, 1.295550733553547, 1.301849476965466, 1.308413677934215, 1.315232384294144, 1.3222938832294906, 1.3295857581421622, 1.3370949494868072, 1.344807818979973, 1.3527102165035405, 1.360787548938704, 1.3690248500883566, 1.3774068507783692, 1.3859180481749462, 1.394542773320008, 1.4032652558729342, 1.4120696850575112, 1.420940265850594, 1.4298612695161836, 1.4388170776875566, 1.4477922193327573, 1.4567714001069763, 1.4657395237993098, 1.4746817058211996, 1.483583278957131, 1.4924297918998675, 1.501207001415589, 1.509900859316893, 1.5184974957491049, 1.5269832005983837, 1.535344405086579, 1.5435676658032733, 1.5516396535149681, 1.55954714906235, 1.5672770484913985, 1.5748163792537606, 1.5821523288581842, 1.58927228677347, 1.5961638997033594, 1.6028151396170756, 1.6092143831762535, 1.6153505005055608, 1.6212129506628647, 1.626791880721391, 1.6320782251123163, 1.6370638018081496 ], [ 1.2773565227851018, 1.2822386752263986, 1.287422600451394, 1.2929019339846324, 1.29866935976392, 1.3047166393821437, 1.3110346469650398, 1.317613409429446, 1.324442151811783, 1.33150934729488, 1.3388027714938162, 1.3463095604887079, 1.3540162720171092, 1.3619089491633072, 1.3699731858096682, 1.3781941930500838, 1.3865568657106238, 1.3950458480817167, 1.4036455979422828, 1.4123404479524972, 1.4211146635108993, 1.4299524962154329, 1.4388382321394637, 1.4477562342340926, 1.4566909782992283, 1.4656270821285466, 1.474549327627995, 1.4834426759324446, 1.492292275798079, 1.5010834658232028, 1.5098017713402145, 1.5184328971148684, 1.5269627172715499, 1.535377264117788, 1.5436627177475073, 1.5518053984397409, 1.5597917639167043, 1.5676084134641706, 1.5752421007350623, 1.582679756748544, 1.5899085241664415, 1.5969158033922646, 1.6036893104229266, 1.6102171457266419, 1.6164878727672485, 1.6224906041925093, 1.6282150931971486, 1.633651827198543, 1.6387921207509897, 1.6436282045857644 ], [ 1.2862154560821561, 1.291138394441989, 1.2963576741084388, 1.30186703141889, 1.3076592700493872, 1.3137262886146284, 1.320059113722035, 1.3266479382177232, 1.3334821643064871, 1.3405504511680406, 1.3478407666278058, 1.3553404423742081, 1.363036232146882, 1.3709143722544064, 1.3789606437188102, 1.3871604352897164, 1.395498806527607, 1.40396055012534, 1.4125302526230261, 1.4211923526765093, 1.4299311960655312, 1.4387310866770993, 1.4475763327738833, 1.4564512879583142, 1.4653403863715344, 1.474228171822791, 1.4830993207289938, 1.4919386589540027, 1.5007311728695971, 1.509462015209436, 1.5181165065453701, 1.5266801334721833, 1.5351385448280088, 1.5434775474882474, 1.5516831034327736, 1.5597413298817038, 1.5676385043068646, 1.5753610760397736, 1.5828956860034946, 1.5902291957924635, 1.5973487269178035, 1.6042417105417768, 1.6108959474691755, 1.6172996775791455, 1.6234416573072883, 1.629311243265544, 1.6348984796549644, 1.6401941868160512, 1.6451900480949908, 1.6498786921920043 ], [ 1.2949300092330032, 1.2998894784319162, 1.305139812214601, 1.3106748463869775, 1.3164875031521954, 1.3225698170637603, 1.3289129662400285, 1.3355073085759477, 1.34234242263249, 1.3494071528263207, 1.3566896584820136, 1.3641774662482666, 1.3718575253192578, 1.3797162648447663, 1.3877396528603068, 1.39591325602426, 1.4042222994146916, 1.4126517256178015, 1.4211862523343748, 1.429810427742912, 1.438508682890134, 1.447265380432943, 1.4560648591323122, 1.4648914735998715, 1.4737296289228936, 1.482563809942868, 1.4913786051359317, 1.5001587252379438, 1.5088890169691214, 1.5175544724372063, 1.5261402350263222, 1.534631602800757, 1.5430140306565114, 1.5512731326245093, 1.559394685852519, 1.5673646378526513, 1.5751691185838539, 1.5827944588331369, 1.59022721615869, 1.5974542093630366, 1.60446256208205, 1.6112397556221567, 1.6177736906765767, 1.6240527570321672, 1.6300659098756052, 1.6358027508562896, 1.6412536116962602, 1.6464096378818942, 1.6512628698457954, 1.6558063190586385 ], [ 1.3034912997146884, 1.308482990994816, 1.3137600300877101, 1.3193163505362797, 1.325144991383796, 1.3312381214907347, 1.3375870689133529, 1.3441823550821164, 1.3510137334633807, 1.3580702323322151, 1.3653402012277107, 1.3728113606064223, 1.3804708541555357, 1.388305303177274, 1.3963008624117583, 1.4044432766294364, 1.4127179372984124, 1.4211099386191695, 1.429604132220656, 1.4381851798303744, 1.4468376032677075, 1.4555458311662677, 1.4642942419083245, 1.4730672023532658, 1.481849102062578, 1.4906243828656491, 1.499377563772475, 1.5080932614183067, 1.5167562064176794, 1.5253512562051195, 1.533863405139702, 1.5422777928409706, 1.5505797118930733, 1.558754616190029, 1.566788131284297, 1.574666068130474, 1.5823744415747996, 1.5898994948206098, 1.5972277308964506, 1.6043459518685024, 1.6112413061812323, 1.6179013440944443, 1.6243140807334837, 1.63046806580836, 1.636352458617821, 1.6419571065655711, 1.6472726251062728, 1.652290476831141, 1.6570030473118367, 1.661403715352829 ] ], "zauto": true, "zmax": 1.661403715352829, "zmin": -1.661403715352829 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.061585347134352215, 0.06081108187854339, 0.060452349588896746, 0.0604903142210557, 0.06089860471052693, 0.06164533961381843, 0.06269526174718533, 0.06401166891397923, 0.06555794954314939, 0.06729866574481108, 0.06920022696696267, 0.0712312495123662, 0.07336270740685095, 0.07556796474756299, 0.07782275427214753, 0.08010514186070489, 0.08239549695979277, 0.08467647563372457, 0.08693301523530764, 0.08915233599465122, 0.09132394364261792, 0.09343962734423113, 0.0954934479329293, 0.0974817122507011, 0.09940293009104616, 0.10125775074561132, 0.10304887649937519, 0.10478095068244879, 0.10646041817126949, 0.10809535664527921, 0.10969527754434728, 0.11127089661262518, 0.11283387519610369, 0.11439653507650822, 0.11597155150765942, 0.1175716311431263, 0.11920918351732379, 0.12089599643334936, 0.12264292677166061, 0.12445961863902702, 0.1263542602688588, 0.12833338960834972, 0.13040175615893804, 0.13256224357587632, 0.13481585408324562, 0.13716175228005162, 0.13959736275507909, 0.14211851338757314, 0.14471961448221865, 0.14739386304594684 ], [ 0.05861960738563738, 0.057914999083604216, 0.05765052217885221, 0.057802689572999603, 0.05833940233424348, 0.05922265714105199, 0.06041131089788417, 0.061863474928178126, 0.06353830815267388, 0.06539717347870971, 0.06740425349649208, 0.06952677783446748, 0.07173501357699713, 0.07400213910003056, 0.07630408244008262, 0.07861937047937136, 0.08092900960854625, 0.08321640223334445, 0.08546729458856936, 0.08766974744604569, 0.08981412041617946, 0.09189306116850693, 0.09390149209046846, 0.09583658813387927, 0.09769774061814743, 0.09948650250224973, 0.10120651114443764, 0.10286338493884727, 0.10446459057842875, 0.10601927817829007, 0.10753808222906591, 0.10903288743949664, 0.11051656003515983, 0.11200264701369081, 0.11350504815116112, 0.1150376680624381, 0.11661405811195216, 0.11824706015793601, 0.11994846567187717, 0.1217287044074542, 0.12359657628344074, 0.12555903841246435, 0.12762105634081478, 0.12978552482276043, 0.13205325923067612, 0.13442305446478037, 0.13689180442895788, 0.1394546721527134, 0.14210529869613828, 0.14483603814785173 ], [ 0.05578427513009277, 0.05515394482802222, 0.0549903856918516, 0.05526473322798685, 0.055938298055763086, 0.056966139081217365, 0.05830058859597514, 0.05989416401860566, 0.06170160753902777, 0.06368106763918008, 0.06579459829814781, 0.06800820229137279, 0.07029162276923277, 0.07261803392787741, 0.07496372547267448, 0.07730783030969718, 0.07963211388742782, 0.08192082513555704, 0.08416059961785875, 0.08634040202455698, 0.08845149491092134, 0.0904874219033171, 0.09244399538423892, 0.09431928036635265, 0.09611356762546998, 0.09782933013317818, 0.09947115747467519, 0.10104566338099726, 0.10256136190288477, 0.10402850827205859, 0.10545890129508254, 0.10686564534342505, 0.10826287173615655, 0.1096654215889957, 0.11108849496618284, 0.11254727425503479, 0.11405653281246661, 0.11563024274154055, 0.11728119772919358, 0.11902066781768705, 0.12085810249589456, 0.12280089646213821, 0.12485422893239477, 0.12702098277989896, 0.12930174460981048, 0.13169488170239146, 0.13419668718803487, 0.13680158131368056, 0.13950235449790424, 0.14229043711258688 ], [ 0.05308927794306455, 0.05253666719373171, 0.05247954608097125, 0.052882885044787664, 0.053700485378720506, 0.05487963580925434, 0.056365537016246116, 0.058104770646844134, 0.06004755118528591, 0.062148864768772454, 0.06436878258173234, 0.06667226571916633, 0.06902872231482932, 0.07141149538769653, 0.07379738485475189, 0.07616625186385506, 0.07850071841194255, 0.08078595576554377, 0.08300954635473647, 0.08516140129651033, 0.08723371649549366, 0.08922095244867088, 0.09111982534164821, 0.09292929920776173, 0.09465057060752062, 0.09628703845424622, 0.09784425235459693, 0.0993298333042941, 0.10075336096626512, 0.10212622226152408, 0.10346141682190892, 0.10477331616853605, 0.10607737542673608, 0.10738979902971214, 0.10872716515415437, 0.11010601739175041, 0.11154243606397723, 0.11305160517622197, 0.11464739374513508, 0.11634197159384246, 0.11814547928693334, 0.12006576949230555, 0.12210823283050443, 0.12427571563372017, 0.12656853066050583, 0.1289845554925464, 0.13151940783663735, 0.13416668285468455, 0.13691823526947788, 0.13976448837966424 ], [ 0.05054570345191807, 0.05007279945629669, 0.050126151177208075, 0.05066373294417901, 0.05163088758712219, 0.05296631770734818, 0.05460754939440848, 0.05649497565396277, 0.05857425922476993, 0.06079734236618132, 0.06312249826573287, 0.06551384484439232, 0.06794063776700619, 0.07037654258695689, 0.07279899161154897, 0.07518866733189376, 0.07752911675334465, 0.07980648199980357, 0.08200932515409248, 0.08412852430147917, 0.0861572198182941, 0.0880907931020863, 0.08992686309645322, 0.09166528861498789, 0.0933081664442391, 0.09485981652560443, 0.09632674630630846, 0.0977175867944126, 0.09904299317007938, 0.10031550323262452, 0.1015493477433343, 0.10276020808803203, 0.10396491881959008, 0.10518111565696807, 0.10642683339517685, 0.10772006273112804, 0.10907827985046797, 0.11051796718288885, 0.11205414732819764, 0.1136999540834501, 0.11546626420511907, 0.11736141075486484, 0.11939099373777516, 0.12155779680034505, 0.12386181089623524, 0.1263003580921501, 0.1288683020585532, 0.13155832700718442, 0.13436126427161332, 0.13726644536658894 ], [ 0.048166041788002656, 0.04777310023712091, 0.04793910650264455, 0.04861419666338668, 0.04973431602737134, 0.051228824220807025, 0.05302712846617053, 0.05506328857999604, 0.0572784817293203, 0.05962178281432747, 0.06204987677017287, 0.06452623522693497, 0.06702012447406831, 0.06950565689986428, 0.07196098588637256, 0.07436767463407243, 0.07671023185955975, 0.07897579036314462, 0.08115389936187908, 0.08323640244219875, 0.08521737652015184, 0.08709311136862298, 0.08886211310165412, 0.09052511807817251, 0.09208510589805645, 0.09354730157944774, 0.09491915778689582, 0.09621030833748309, 0.09743248439435648, 0.09859938503806487, 0.09972649457675214, 0.10083084030553952, 0.10193068670819828, 0.10304516548131945, 0.10419384527751917, 0.1053962505244541, 0.10667134463992974, 0.10803699873403892, 0.10950947158340482, 0.11110292935391594, 0.11282903347196935, 0.11469662181074747, 0.11671150211002274, 0.11887636799459486, 0.12119083825752094, 0.12365161059713543, 0.12625271301802837, 0.12898583055000457, 0.1318406822272718, 0.13480542331192485 ], [ 0.04596439557967785, 0.04564967495678665, 0.0459282828975182, 0.04674171513762617, 0.048015647713708844, 0.04966945093144095, 0.05162410137657535, 0.053807301346286376, 0.05615589286919989, 0.05861630221864991, 0.06114384233754547, 0.06370151736665461, 0.06625873528491481, 0.06879014168769733, 0.07127466110270152, 0.07369476045621862, 0.0760359141876745, 0.07828623699060909, 0.08043624806455352, 0.08247873395785564, 0.08440868214442607, 0.08622326264047027, 0.08792183941180431, 0.08950599674892326, 0.09097956816920917, 0.09234865685866987, 0.09362163737850042, 0.09480912857060624, 0.09592392757401329, 0.09698089492039495, 0.09799678115271393, 0.0989899866627984, 0.09998024880795463, 0.10098825409894592, 0.10203517844433117, 0.10314216492651948, 0.10432975588008052, 0.10561730329943941, 0.10702238769745208, 0.10856027924648914, 0.11024347531312559, 0.11208134477691462, 0.11407990194084215, 0.11624172230235744, 0.11856600047994624, 0.12104873897730387, 0.12368304687086594, 0.12645952108379505, 0.1293666801265728, 0.13239142082558453 ], [ 0.043956625972141526, 0.043716153130908667, 0.04410469721740519, 0.045054425463781904, 0.04648001559447282, 0.04829037061293896, 0.050397886362715166, 0.05272400535943379, 0.055201453572734864, 0.05777424750588214, 0.06039652996410378, 0.06303098212815, 0.0656472419106909, 0.06822053038097962, 0.07073055187712202, 0.07316066314792258, 0.07549727642276893, 0.07772945233511186, 0.07984863999349223, 0.08184852704438217, 0.08372496913439835, 0.08547597425516061, 0.08710172242698226, 0.08860460488183253, 0.089989269395545, 0.09126265985288712, 0.09243403872053793, 0.09351498110444105, 0.0945193287722537, 0.09546309226964017, 0.09636428944314113, 0.09724270973448648, 0.09811959596602651, 0.09901723936059262, 0.09995848942284957, 0.10096618794177223, 0.10206254522412825, 0.10326848573155822, 0.1046029981541484, 0.10608253000933991, 0.1077204676814832, 0.1095267385882683, 0.11150756298547615, 0.11366536995245057, 0.11599887732693055, 0.11850332113703876, 0.12117080855575145, 0.12399076102289591, 0.12695041143931823, 0.13003532083356015 ], [ 0.0421603919003711, 0.04198778638371907, 0.04248064048565338, 0.043561316816955485, 0.04513300095271048, 0.04709387957226984, 0.049347800413792116, 0.0518101568550954, 0.054409822704494265, 0.05708863790595239, 0.0597997416482453, 0.06250558827833973, 0.06517608306842398, 0.06778701728133706, 0.07031884185728499, 0.07275575380789007, 0.07508504540859381, 0.07729666257145948, 0.07938292379731526, 0.08133835897423379, 0.0831596352444044, 0.0848455440352726, 0.08639702875455427, 0.0878172365547626, 0.08911158011104656, 0.09028779672286576, 0.09135599247475966, 0.09232865893468138, 0.09322064923434197, 0.09404909973144338, 0.09483328324047616, 0.09559438055058082, 0.09635515917562226, 0.09713955250866534, 0.097972139109527, 0.09887753072035126, 0.09987968823696597, 0.10100119608951938, 0.10226253554508055, 0.1036814042552222, 0.10527213100589099, 0.10704522989772916, 0.10900712713579469, 0.11116007768844022, 0.11350227087911864, 0.1160281065892692, 0.11872860994969191, 0.12159194397615673, 0.1246039770686646, 0.12774886496439436 ], [ 0.040595025555146214, 0.04048141859187895, 0.04106971734562963, 0.04227233463095941, 0.04398081018149796, 0.0460826529357441, 0.048473388945417036, 0.05106266729879109, 0.05377578975329823, 0.05655262137788379, 0.059345410657690875, 0.062116422286832354, 0.06483581091920719, 0.06747988451439746, 0.07002976712449949, 0.07247041351669177, 0.07478991157475202, 0.07697901024591267, 0.07903081939831814, 0.08094063797694276, 0.08270587603010604, 0.08432604371923366, 0.08580278616255874, 0.08713994700353728, 0.08834364613463887, 0.08942235827162316, 0.09038697929895415, 0.09125086675265583, 0.0920298397792707, 0.09274212279259274, 0.09340821633070497, 0.09405067889267474, 0.09469380548701772, 0.09536319292831476, 0.09608518908657, 0.096886233450178, 0.0977921089942687, 0.09882713911603941, 0.10001337615220426, 0.10136983705444763, 0.1029118445844587, 0.10465052721416206, 0.10659251769553091, 0.10873987080345532, 0.11109019841512917, 0.113636998895616, 0.11637014128690008, 0.11927645526487753, 0.12234037571311389, 0.12554459499780302 ], [ 0.03928117341949492, 0.03921526464322135, 0.03988674750133748, 0.04119839903036843, 0.04303040755377053, 0.04525998216075437, 0.047774748947903324, 0.05047898777751719, 0.05329469640267352, 0.05615991323586345, 0.05902604218457194, 0.06185513066172923, 0.06461750836609775, 0.06728990010308811, 0.06985399248882193, 0.07229538628675639, 0.07460285753608033, 0.0767678578221026, 0.07878419594159071, 0.08064785514122978, 0.08235691033016025, 0.08391151774284399, 0.08531395551472441, 0.08656869775348755, 0.08768250719791118, 0.08866453269794697, 0.08952639775821769, 0.09028226551077798, 0.0909488640201101, 0.09154545416474037, 0.09209372101001947, 0.0926175692665844, 0.09314280494015514, 0.09369668949552235, 0.09430736052641668, 0.0950031243754821, 0.09581164096028665, 0.09675903775943467, 0.09786900590424222, 0.09916194321284544, 0.10065421337632986, 0.10235758499819778, 0.10427889849968874, 0.10641998525061534, 0.1087778359883138, 0.11134498986187119, 0.11411009586726989, 0.11705858774602386, 0.12017341200053898, 0.12343575493734026 ], [ 0.038240129222461255, 0.03820842559635294, 0.038947469190300114, 0.04035129011548311, 0.042289563868387045, 0.04462995693103178, 0.047252807887061314, 0.050057449995739765, 0.052962811075280364, 0.05590518358250734, 0.058835100064075566, 0.061714297659164155, 0.06451315301323791, 0.06720866559471043, 0.06978294139001497, 0.07222209041096969, 0.07451545026572949, 0.07665506006321002, 0.07863532369033534, 0.08045281502368273, 0.08210618870089169, 0.08359616856626129, 0.08492559206875032, 0.08609949305373861, 0.08712520785121908, 0.0880124905764279, 0.0887736233482504, 0.08942350592468802, 0.08997970733243149, 0.09046245981523635, 0.09089457339291478, 0.09130124826716667, 0.0917097631997208, 0.09214902192157058, 0.09264894763829423, 0.09323972838819629, 0.09395093312917613, 0.09481053841404745, 0.09584392530752053, 0.09707292156816916, 0.0985149706058565, 0.10018250307571107, 0.10208256854453261, 0.10421675613835045, 0.10658139994544963, 0.10916803390771258, 0.11196403781413272, 0.11495340413507035, 0.11811755504427532, 0.1214361477683256 ], [ 0.037492808534352724, 0.03748007939482704, 0.03826798674924615, 0.039743348276591865, 0.04176677310801851, 0.04419754564496702, 0.04690951474787515, 0.049797523609879324, 0.05277762055391278, 0.05578436240036182, 0.05876731293510284, 0.06168774569536478, 0.06451590836376656, 0.06722889639413593, 0.06980906456133934, 0.07224287493012443, 0.07452008480908212, 0.07663319425631913, 0.07857708979043977, 0.08034883574699087, 0.08194757643367483, 0.08337452103506568, 0.0846329895056876, 0.08572850187389146, 0.0866688957893021, 0.08746445803950764, 0.08812805534421984, 0.08867524820851862, 0.08912436923133675, 0.08949654438896272, 0.08981563300688773, 0.09010806021877374, 0.09040251580013983, 0.09072949669664213, 0.09112067870017657, 0.0916081165294824, 0.09222329104571018, 0.09299604589713936, 0.09395348002541462, 0.09511888199599121, 0.09651080132116131, 0.09814234643111006, 0.10002077757615073, 0.1021474288711558, 0.1045179538187053, 0.10712285148112236, 0.10994820335782506, 0.11297653797567833, 0.11618774121048167, 0.1195599422271197 ], [ 0.03705837992028318, 0.03704833330813197, 0.037863931655648726, 0.03938694970815379, 0.04147099251660615, 0.04396852901799508, 0.04674790038190437, 0.04969995210136739, 0.052738006891640064, 0.05579483637219337, 0.058818878983456745, 0.061770741658921456, 0.0646203285245253, 0.06734462329898269, 0.06992603751860665, 0.07235121236311516, 0.07461017143217717, 0.07669574071590582, 0.07860317077652808, 0.0803299118619795, 0.08187550485176814, 0.08324155995073304, 0.0844318014194845, 0.0854521608242492, 0.0863109036555507, 0.08701877495596484, 0.08758914899743082, 0.08803816622623564, 0.08838483786160464, 0.08865109502928391, 0.08886175569043193, 0.08904437975793945, 0.08922898192130962, 0.08944757441401206, 0.089733519974763, 0.09012068997299344, 0.09064244444698343, 0.09133047813753212, 0.09221360554873881, 0.09331658241743881, 0.09465907354202657, 0.09625487190720419, 0.09811144960507473, 0.1002298808392909, 0.10260512982954419, 0.1052266523669845, 0.108079228247493, 0.11114392762669578, 0.11439911714306782, 0.11782142713189167 ], [ 0.03695267486595814, 0.036928812597325576, 0.03774936653519731, 0.039293752962353434, 0.04141118184750913, 0.04394925426168748, 0.046771974415833674, 0.04976673850189905, 0.05284428642428097, 0.05593551956913213, 0.05898755584901886, 0.06196009908846132, 0.06482246878871212, 0.06755130921251415, 0.07012888184499978, 0.07254182322845279, 0.07478026199957097, 0.07683720945327999, 0.07870815771645619, 0.08039083587094273, 0.0818850868306988, 0.0831928369283337, 0.08431813659329834, 0.0852672547049139, 0.0860488115398312, 0.08667393594669928, 0.08715643163152309, 0.08751293535623944, 0.08776304660966824, 0.08792940420021922, 0.08803768077843088, 0.08811646242156518, 0.08819697846027187, 0.08831264852470216, 0.08849842143675692, 0.08878989595737763, 0.08922223732472725, 0.0898289346743132, 0.09064047851607704, 0.09168306717508287, 0.09297746766073194, 0.09453815234220678, 0.09637280531978462, 0.09848224558362341, 0.10086075827679913, 0.10349677375128183, 0.10637379782944936, 0.10947148142988232, 0.11276672267430454, 0.11623471413671316 ], [ 0.03718661783826251, 0.03713317071716372, 0.03793554625392325, 0.03947376999314553, 0.04159565583482175, 0.04414620403353865, 0.04698644599776345, 0.05000096807032707, 0.05309810047941778, 0.056206790625687474, 0.05927263095161663, 0.06225417343614964, 0.06511990061750393, 0.06784588029869522, 0.070414009852995, 0.07281073195107139, 0.07502611498857327, 0.07705321211876456, 0.07888763275908804, 0.08052727685262973, 0.08197219472458335, 0.08322454457333939, 0.08428862608454825, 0.08517097286146764, 0.08588048868443142, 0.08642861327383164, 0.08682950236829079, 0.08710020463559447, 0.08726081433017353, 0.08733457394453117, 0.0873478958727951, 0.08733026721641096, 0.08731399876258523, 0.08733377990008166, 0.0874260082862066, 0.08762787884157631, 0.08797624246923554, 0.08850627975288736, 0.0892500742272036, 0.09023520530182495, 0.09148350199109914, 0.09301009589544505, 0.09482288150801066, 0.09692243833842151, 0.09930240481766492, 0.1019502343126227, 0.10484822232920124, 0.10797467773388265, 0.11130511821853252, 0.11481339416574537 ], [ 0.037764989426583566, 0.03766779242814075, 0.038429729896923545, 0.039934379249688706, 0.042031312619978736, 0.04456541086420747, 0.04739628312393059, 0.05040647577465966, 0.05350216313280175, 0.0566103010723792, 0.059674776821066984, 0.06265275498980014, 0.06551163546437487, 0.06822667573516898, 0.0707791963476478, 0.07315525733917627, 0.07534470171774285, 0.07734048116087601, 0.07913819840821035, 0.08073581693977869, 0.0821335009631014, 0.0833335578769592, 0.08434046180782698, 0.08516094101307815, 0.08580411425616537, 0.08628166189075877, 0.08660801644963327, 0.08680055507515926, 0.08687977222528118, 0.08686940593603652, 0.0867964849734872, 0.086691258356494, 0.08658696448705229, 0.08651939671885196, 0.08652622846442962, 0.08664607680417905, 0.08691731093760105, 0.08737665008151259, 0.08805763987167645, 0.08898913766822146, 0.090193963070688, 0.09168786904278986, 0.09347895612621855, 0.09556759198808329, 0.09794682520785493, 0.10060321444709854, 0.10351794787499906, 0.10666811054955597, 0.11002796742141803, 0.11357015805248398 ], [ 0.03868580240420732, 0.03853296719924983, 0.039234270859736124, 0.04067944274411904, 0.04272284436438773, 0.045211784857807115, 0.048006154643027314, 0.0509873887536199, 0.05405988801742774, 0.05714867186763028, 0.06019580526479071, 0.0631568710448698, 0.06599796733340062, 0.06869332456814711, 0.07122348479596813, 0.07357394385785494, 0.07573415902638887, 0.07769684052464823, 0.07945746300653334, 0.08101394838248416, 0.08236648340769379, 0.0835174444050343, 0.08447140783868128, 0.08523522962048932, 0.0858181783307884, 0.08623210815076532, 0.08649165631279983, 0.08661444729765938, 0.08662128187128285, 0.0865362835006155, 0.08638696812164014, 0.08620419651960427, 0.08602196326704205, 0.08587697462974857, 0.08580797324213127, 0.08585478307386982, 0.08605707675949645, 0.08645290856553371, 0.08707710540317883, 0.0879596552400538, 0.08912426303216962, 0.09058724550323485, 0.09235690112344509, 0.09443342528089652, 0.09680935893392707, 0.0994704834541925, 0.10239702325568541, 0.10556499975843288, 0.1089475927040568, 0.11251639757884024 ], [ 0.03994042449563164, 0.03972271215401541, 0.040346170850439095, 0.041708689105063375, 0.04367205682277205, 0.046088448393712345, 0.04881982292781665, 0.05174759335727161, 0.05477493108996839, 0.057825106311426136, 0.06083834248391813, 0.06376851510828051, 0.06658024866968411, 0.06924656184160533, 0.07174703815709896, 0.07406644238335544, 0.07619369576220296, 0.07812113409997085, 0.07984398763891298, 0.08136003553306441, 0.08266939905707671, 0.08377444626472424, 0.08467978697975227, 0.08539234108902603, 0.0859214653773214, 0.08627912474301778, 0.08648009261278741, 0.08654216271716013, 0.08648635008513368, 0.08633705325739767, 0.08612214265907787, 0.08587293264586125, 0.08562398850043544, 0.08541271709543384, 0.08527869445118155, 0.08526269882023997, 0.08540544725572931, 0.08574607715128169, 0.08632046733145987, 0.08715954517301355, 0.08828776152685872, 0.08972191866059012, 0.09147050003352267, 0.09353357918756132, 0.09590329598629933, 0.09856480585668191, 0.1014975521665671, 0.10467669297192206, 0.10807452801981626, 0.1116618084377936 ], [ 0.0415143822405918, 0.04122525538240762, 0.04175717498889143, 0.04301747335202426, 0.044877411233172765, 0.047196176772132115, 0.04983956684175683, 0.0526901885125756, 0.05565069671444984, 0.05864295583070724, 0.061605453620953626, 0.0644903257461131, 0.06726061785372854, 0.06988799901072071, 0.07235094687673625, 0.07463335096570424, 0.07672346200593318, 0.07861311952394157, 0.08029720094099775, 0.08177324728831893, 0.08304123083613858, 0.0841034379284258, 0.08496444617468886, 0.08563117908639797, 0.08611302344636325, 0.08642199526924665, 0.08657293916653648, 0.08658374322500745, 0.08647554709700629, 0.08627291493566816, 0.08600393739920303, 0.0857002189916777, 0.08539670005723077, 0.08513125935004148, 0.08494404683613793, 0.0848765113809823, 0.08497011769935843, 0.08526479208888711, 0.08579719253485191, 0.08659895460220608, 0.08769510360944334, 0.0891028291759773, 0.09083078109308038, 0.0928789701250363, 0.09523926254971833, 0.0978963690119246, 0.10082916905098707, 0.10401219290397638, 0.10741709845195108, 0.11101402068686207 ], [ 0.04338861964120473, 0.04302402735800499, 0.04345435380005088, 0.04459693892569553, 0.046333857054344584, 0.04853302536244273, 0.05106571031892602, 0.05381698904412758, 0.056689858365871856, 0.05960527926546354, 0.06250024885990292, 0.06532524065774858, 0.0680416989225917, 0.07061986549686235, 0.0730370080170145, 0.07527602732474643, 0.07732439097700772, 0.07917333584053518, 0.08081728913060632, 0.08225346631866731, 0.08348161297494054, 0.0845038647496675, 0.08532470508652741, 0.08595100394706331, 0.08639212289789829, 0.08666007242135575, 0.08676970623466639, 0.08673893467045897, 0.08658893470677699, 0.08634432805988579, 0.08603329114445885, 0.08568755242759449, 0.0853422252938406, 0.08503542057171859, 0.08480758601721193, 0.08470053463773947, 0.0847561535230815, 0.08501483083756749, 0.08551369649284937, 0.08628483042580025, 0.08735363418469985, 0.08873756893407261, 0.09044542583173074, 0.09247721724426548, 0.09482467882198627, 0.09747228037562122, 0.1003985815735447, 0.10357774784084318, 0.1069810589365533, 0.11057828403187192 ], [ 0.04554092557269929, 0.045098918095404575, 0.04542101810445415, 0.04643452157517896, 0.048032963518178005, 0.05009418734184836, 0.0524963125951541, 0.05512813363387907, 0.05789394182350118, 0.060714435507329426, 0.06352550355577623, 0.06627615230114539, 0.0689262949341809, 0.07144473895906864, 0.07380749010447706, 0.07599638532179066, 0.07799802401343164, 0.07980295393081958, 0.08140506897327461, 0.08280118180818177, 0.08399074088659444, 0.08497566741320024, 0.08576029255779323, 0.08635137850594111, 0.08675820881265807, 0.08699273392378312, 0.0870697566042705, 0.08700713926076704, 0.08682601067270034, 0.08655094345340376, 0.08621006590596292, 0.08583506355852877, 0.08546101807642462, 0.08512602701616549, 0.08487055069388653, 0.0847364466824094, 0.08476568200344822, 0.08499875912835707, 0.0854729502792073, 0.08622049394541349, 0.08726695066101227, 0.08862992376455346, 0.09031831437451522, 0.09233220203363979, 0.0946633428166034, 0.0972961829346768, 0.10020922242920696, 0.10337654203707451, 0.10676932331811484, 0.11035723399098939 ], [ 0.04794728461242312, 0.04742756022900304, 0.04763777641781283, 0.048514678174148035, 0.049963302497471246, 0.05187208310226584, 0.0541270472689539, 0.056621834456151626, 0.05926300856342431, 0.06197174371713731, 0.06468332182813832, 0.06734558976352481, 0.06991709550962236, 0.07236528136430531, 0.07466489798753922, 0.07679668746605325, 0.07874632890189762, 0.08050361855777524, 0.08206185136622764, 0.08341737244101685, 0.08456927149768792, 0.08551919762883527, 0.08627127574016193, 0.08683210874816862, 0.08721085120508215, 0.08741934024972252, 0.08747226857680934, 0.08738738134613261, 0.08718567450818633, 0.08689156589770605, 0.08653300288858312, 0.08614146213978616, 0.08575178948202414, 0.08540182381747641, 0.08513175165174951, 0.08498315287213921, 0.08499772745560102, 0.08521573813554559, 0.08567426165005382, 0.08640540000980562, 0.08743464624168377, 0.08877960834423176, 0.09044925997509774, 0.09244381018690452, 0.09475518620114744, 0.09736803008515721, 0.10026104656339688, 0.10340851687982482, 0.10678180961040658, 0.11035076029697785 ], [ 0.05058300069673465, 0.049986465561502935, 0.05008356805450994, 0.05081970874690319, 0.052111000667142596, 0.05385664531374547, 0.055951266687035914, 0.05829428336421321, 0.06079546222724137, 0.06337723580595063, 0.06597486700429861, 0.06853544771816804, 0.07101641658122046, 0.07338399625057104, 0.07561175080816979, 0.07767934464302385, 0.0795715211671683, 0.08127729034437059, 0.0827893028028691, 0.08410338602580095, 0.08521821969891734, 0.08613513012930527, 0.08685798644211865, 0.08739318339512334, 0.08774969681139137, 0.08793919762741462, 0.08797620922922039, 0.08787828995230589, 0.08766621823525164, 0.08736415193728479, 0.08699972600810335, 0.08660404475580916, 0.0862115178558989, 0.08585948542493503, 0.08558758043271504, 0.08543679057411384, 0.08544821007877168, 0.0856615158746681, 0.08611325811095685, 0.08683511170990121, 0.08785227710688115, 0.08918222753106525, 0.09083396673845835, 0.09280788820073521, 0.09509623217303158, 0.09768404683468473, 0.10055049722634939, 0.10367034274070493, 0.10701541804663971, 0.1105559910951417 ], [ 0.05342353998985434, 0.05275192941942176, 0.0527365618899769, 0.053330559925923456, 0.054460370312838555, 0.05603574087381988, 0.05796022289783246, 0.06013970774960337, 0.0624879844713018, 0.0649295140333945, 0.06740017410863977, 0.0698467776858113, 0.07222598648165061, 0.07450301982705239, 0.07665038419308097, 0.07864673274859267, 0.0804758967605162, 0.08212609506469558, 0.08358931120409778, 0.08486082149060427, 0.08593885600638045, 0.08682437550529512, 0.08752094873179196, 0.08803471600953673, 0.08837442560667132, 0.08855152907524336, 0.08858032027857347, 0.08847809998806189, 0.08826534363008595, 0.08796584399970407, 0.08760679379526518, 0.08721876538924243, 0.08683553875980785, 0.08649372530486348, 0.08623213862982765, 0.08609087716608331, 0.08611011089972904, 0.08632860639042785, 0.08678207678464223, 0.08750149671118508, 0.08851156068664229, 0.08982947215207937, 0.09146421898659465, 0.09341642316435071, 0.09567876345420785, 0.09823688472252574, 0.10107064736575595, 0.10415554703592973, 0.1074641464524231, 0.11096739654453762 ], [ 0.05644510806352668, 0.05570068896488605, 0.05557487135330261, 0.05602753555210814, 0.05699454032576815, 0.058395664658490866, 0.060143401061916506, 0.062150552000281196, 0.06433559121826546, 0.06662571441828728, 0.06895805046060158, 0.0712796501375983, 0.07354678765385025, 0.0757239549994225, 0.07778278511945201, 0.07970103388967431, 0.08146168299903621, 0.08305218634427353, 0.0844638615337902, 0.08569141806356913, 0.08673260970996546, 0.08758799765980387, 0.08826081110455432, 0.08875689245318291, 0.08908471437772385, 0.08925545522548801, 0.08928311765076632, 0.08918467244157148, 0.08898020532449193, 0.08869303904427786, 0.08834979651720745, 0.08798036407298213, 0.08761770810717305, 0.08729749607254605, 0.08705747666975402, 0.08693658779118509, 0.0869737870371506, 0.0872066389525373, 0.08766974174801621, 0.08839312495193946, 0.08940078451043788, 0.09070952918683978, 0.0923282832801273, 0.09425792829191879, 0.09649168478127287, 0.09901595677328183, 0.10181150458303105, 0.10485478849830507, 0.10811933453366976, 0.11157700479053007 ], [ 0.05962501088816998, 0.058810365030438835, 0.058577082437119614, 0.05889087866307778, 0.05969603199364179, 0.06092164690559129, 0.062488916613984036, 0.0643177502013244, 0.06633178870431128, 0.0684615660182794, 0.07064606165185913, 0.07283308908271136, 0.07497895798718086, 0.0770477533995426, 0.07901046484441225, 0.08084410743195015, 0.08253091272040326, 0.08405762633121325, 0.08541492533301295, 0.08659695534937341, 0.08760098080212303, 0.08842713875645103, 0.08907828565028332, 0.08955992564441631, 0.0898802087288329, 0.09004998561851099, 0.09008290456303766, 0.08999553226577174, 0.0898074770457994, 0.08954148721949867, 0.08922349173061463, 0.0888825440403977, 0.08855062552199579, 0.0882622631330661, 0.08805392069318657, 0.08796313665880835, 0.08802740617355848, 0.08828284150894489, 0.08876268912513209, 0.08949582509762115, 0.09050538149340072, 0.09180766218362782, 0.09341148036938912, 0.09531799414673604, 0.09752104341710016, 0.10000792010899896, 0.10276045154294974, 0.10575625369696416, 0.10897001694667548, 0.11237471358190813 ], [ 0.0629418573435667, 0.06205973449548091, 0.06172261813800497, 0.06190121884973413, 0.0625472487820836, 0.06359833044160892, 0.06498393159456446, 0.06663105263225702, 0.06846880196245697, 0.0704315283554733, 0.07246059284338736, 0.07450507451224773, 0.07652175068145348, 0.07847464644320791, 0.08033437208741592, 0.0820773936382229, 0.08368532457934044, 0.08514428723019098, 0.0864443669066355, 0.08757916680357439, 0.08854546290606026, 0.08934295354814686, 0.08997409571147462, 0.09044401862316, 0.09076050391878172, 0.09093402008150932, 0.0909777967129244, 0.0909079212107639, 0.09074343651678164, 0.09050641381341874, 0.09022196871007451, 0.0899181842796578, 0.08962590052804185, 0.08937832936596644, 0.08921045929968359, 0.089158227382625, 0.08925745926354572, 0.08954261121676631, 0.09004538731977575, 0.09079334298663458, 0.09180861245284659, 0.09310690220028857, 0.09469686880406603, 0.09657995043322025, 0.09875065701888798, 0.10119726084615531, 0.10390278211533402, 0.10684614169728188, 0.1100033563255553, 0.11334867347810454 ], [ 0.06637565451947842, 0.06542888062904753, 0.06499197293547698, 0.06503989708038053, 0.06553086949088788, 0.06641019023988311, 0.06761505495071202, 0.06907937137561466, 0.0707378465154411, 0.07252898495747993, 0.07439697020418587, 0.07629260309301002, 0.07817354713877121, 0.08000412273611966, 0.08175484561299005, 0.08340185016234244, 0.08492629038497604, 0.08631377491311512, 0.087553867480982, 0.08863966788566938, 0.08956747833969449, 0.0903365539837753, 0.0909489325910714, 0.09140933602220505, 0.09172513401145005, 0.09190635885186384, 0.0919657571422847, 0.09191886173384353, 0.09178406327119519, 0.09158265634104029, 0.09133883054675715, 0.09107957251172678, 0.09083444202758585, 0.09063518596674063, 0.09051515922155917, 0.09050853486476469, 0.09064930724315932, 0.09097012131575773, 0.09150099590238278, 0.09226804109061472, 0.09329229206912802, 0.09458878461489838, 0.0961659766584042, 0.09802557772650844, 0.10016279259017076, 0.10256693035169578, 0.10522228818533626, 0.10810919775384865, 0.11120512288135581, 0.11448571452505418 ], [ 0.06990783515740139, 0.06889926096032646, 0.068366850677508, 0.06828918822908395, 0.06863014779971063, 0.06934188216115884, 0.07036870280947707, 0.07165111680869546, 0.07312941615116278, 0.07474647003563446, 0.07644962468637616, 0.07819179422514463, 0.07993191407682568, 0.08163494612787686, 0.08327160274049164, 0.08481791944688798, 0.0862547685203595, 0.08756737425961106, 0.08874486732565828, 0.08977989902655678, 0.09066832544102475, 0.0914089640770354, 0.0920034210229368, 0.09245598324232222, 0.09277356804877605, 0.0929657193491352, 0.0930446376041235, 0.09302522739963193, 0.09292514296651583, 0.0927648080226393, 0.09256738226892353, 0.09235864340385172, 0.09216675167370293, 0.09202186519329611, 0.09195558026226366, 0.09200018326929789, 0.09218772038017245, 0.09254891731747521, 0.09311201109091845, 0.09390158292403622, 0.09493749958550263, 0.09623407204584544, 0.09779952220762929, 0.09963581212418036, 0.10173884296157733, 0.10409898373652005, 0.10670185304124256, 0.10952925721291878, 0.11256018695047981, 0.11577178768657735 ], [ 0.07352124455575808, 0.07245372210589071, 0.07183023397900923, 0.07163244296777058, 0.07182912869564194, 0.07237851841493974, 0.07323140522989051, 0.07433450472774249, 0.0756335643337713, 0.07707590708299546, 0.07861228003694158, 0.08019802709636671, 0.0817936940484436, 0.08336520659577287, 0.084883758305631, 0.08632552328418566, 0.08767128093245732, 0.08890601454748953, 0.09001852468861045, 0.09100108255610331, 0.09184913741260385, 0.09256108424907404, 0.09313809242128883, 0.09358399199620314, 0.09390521138394117, 0.0941107569992016, 0.09421222285293132, 0.09422381491138729, 0.0941623717061235, 0.09404735913616072, 0.09390081399570407, 0.09374720809126784, 0.0936132038075082, 0.09352727386848, 0.09351916420185806, 0.09361919045205609, 0.09385737629663958, 0.09426246442686331, 0.09486085608565026, 0.09567555769411103, 0.09672522745613404, 0.0980234155411018, 0.09957807577033267, 0.10139139617982038, 0.1034599562933971, 0.10577517902515574, 0.10832401331124607, 0.11108976547276662, 0.11405299433247224, 0.11719239478408996 ], [ 0.07720010445396389, 0.07607648172857655, 0.07536640657994363, 0.0750541684916117, 0.07511279517027089, 0.07550587409387229, 0.07619005436516066, 0.07711782165965739, 0.07824016265060932, 0.07950884172163245, 0.08087814850831011, 0.08230609451364053, 0.08375511784549859, 0.0851923950086254, 0.08658986732525562, 0.08792407954828385, 0.08917591002997738, 0.09033025219194787, 0.09137568950210978, 0.09230419196320956, 0.09311085127184215, 0.09379366377413245, 0.09435336442291746, 0.09479331046323866, 0.09511940997932988, 0.0953400872945004, 0.09546627421586208, 0.09551141307265797, 0.09549145435674869, 0.09542482864401636, 0.09533236966227392, 0.09523716341975998, 0.09516429801969446, 0.09514049117598677, 0.09519357859569552, 0.09535185716514169, 0.09564329247305221, 0.09609461968356617, 0.09673038768602975, 0.09757201488834034, 0.0986369362977682, 0.09993792150122399, 0.10148262980230656, 0.10327344338631081, 0.10530758663309406, 0.10757750636181228, 0.11007146063000298, 0.11277424738877112, 0.1156680002636698, 0.11873298536879792 ], [ 0.0809299643420228, 0.07975309059518329, 0.07896094396833027, 0.07854006396614513, 0.07846715861696547, 0.07871053273280863, 0.07923209491305966, 0.07998964252627369, 0.0809391255704532, 0.08203665552550576, 0.08324012051729095, 0.08451036071371913, 0.0858119276984921, 0.08711349263118356, 0.08838798408894423, 0.08961253543292319, 0.09076831112716527, 0.09184026747036014, 0.09281688922224621, 0.09368993134227574, 0.09445418505302175, 0.09510727959338766, 0.09564952495128082, 0.09608379610104598, 0.09641545538650255, 0.09665230633046676, 0.09680456905463744, 0.09688486450358778, 0.09690819174815704, 0.09689187990589088, 0.0968554939415477, 0.0968206722782618, 0.09681087443482243, 0.09685101962398282, 0.09696700322086917, 0.09718508781583982, 0.09753117919544937, 0.09803001409936986, 0.0987043038629553, 0.09957389288952748, 0.10065499962427099, 0.10195960716935833, 0.10349505943539335, 0.10526389785275098, 0.10726394681518941, 0.10948862846995956, 0.11192746452619007, 0.11456670824393236, 0.11739004509807181, 0.12037930480223989 ], [ 0.08469764598646519, 0.08347038262713577, 0.08260068269030578, 0.0820770229104707, 0.08187930494349452, 0.08197998017006988, 0.08234566140980973, 0.08293899982317313, 0.08372059595051992, 0.0846507520196333, 0.08569093788262555, 0.08680491260615605, 0.08795950148546029, 0.08912506683539508, 0.09027573055053878, 0.09138941141481023, 0.09244773582478148, 0.09343587157736838, 0.09434232387836151, 0.09515872262839431, 0.09587962120586468, 0.0965023196228241, 0.09702671896570515, 0.09745520918482767, 0.09779258826811506, 0.0980460073578938, 0.09822493324057856, 0.09834111673685048, 0.09840855282795394, 0.09844341597965968, 0.09846395232241043, 0.09849030952446833, 0.09854428590840515, 0.09864898324901368, 0.09882835335049628, 0.09910663728612859, 0.09950770794405775, 0.1000543403506368, 0.10076744834228363, 0.10166533797031668, 0.10276303470076945, 0.10407174064461971, 0.10559846869256515, 0.10734588342706554, 0.10931235686156088, 0.11149222446898142, 0.11387620775619096, 0.11645195690279267, 0.11920466202183913, 0.12211768389243706 ], [ 0.08849118413231218, 0.08721641753744135, 0.08627367523310335, 0.08565311157225694, 0.08533740647316107, 0.08530265591590262, 0.08551966882435749, 0.08595550686833557, 0.08657508981996374, 0.08734271008105533, 0.08822334371800135, 0.08918369655120231, 0.0901929700200359, 0.09122336567703163, 0.09225036759109337, 0.0932528505265871, 0.09421306188078529, 0.09511652040685341, 0.09595186741495756, 0.09671069822566923, 0.09738739416131649, 0.09797896875118792, 0.09848493619310497, 0.09890720536607257, 0.0992499986580923, 0.09951979138276051, 0.09972526446419351, 0.09987726029011129, 0.09998872916881223, 0.100074651781451, 0.10015192161805339, 0.10023917096603303, 0.10035652502615357, 0.10052527164704592, 0.10076743941205472, 0.10110528456788447, 0.10156069731556412, 0.10215454945694387, 0.10290601680809462, 0.10383191912638097, 0.1049461253667892, 0.10625907112421107, 0.1077774274088538, 0.1095039461654566, 0.11143749034045923, 0.11357323791780623, 0.1159030333872168, 0.11841584904635215, 0.12109831354885559, 0.12393526598479383 ], [ 0.09229976476294624, 0.09098041864778066, 0.08996913497625941, 0.08925752989148601, 0.08883070776957797, 0.08866797043146016, 0.08874386357736795, 0.08902943971128754, 0.08949360191945453, 0.09010440325960786, 0.09083020519796264, 0.09164063545740038, 0.09250732159484798, 0.0934044055454243, 0.09430886380863644, 0.09520066825771042, 0.09606282561585194, 0.09688133179799198, 0.09764507266490212, 0.09834569685368784, 0.09897748025537685, 0.0995371959711237, 0.10002399843762952, 0.1004393259165478, 0.10078682163637034, 0.10107227046630303, 0.10130354500643335, 0.1014905523527761, 0.10164517055825333, 0.10178116206018094, 0.10191405027107997, 0.10206094541070011, 0.10224030683672145, 0.10247163196427114, 0.10277506662450644, 0.10317093846715211, 0.10367922348040237, 0.10431896514222869, 0.10510767490246875, 0.10606075003397004, 0.10719094872431888, 0.10850796130650385, 0.11001811024338533, 0.11172420046200766, 0.11362552751574195, 0.1157180361765334, 0.11799460888350116, 0.1204454539554644, 0.12305855864664077, 0.12582017198322978 ], [ 0.09611366152012005, 0.09475270736118892, 0.0936773741817557, 0.09288055985646877, 0.09234949183299757, 0.09206629563295153, 0.09200884201073209, 0.09215178329953352, 0.09246767540258131, 0.09292808601115753, 0.09350460803579765, 0.09416972343746663, 0.09489749005976832, 0.0956640477846644, 0.09644795778953981, 0.09723039937505665, 0.09799525362573779, 0.09872910353785054, 0.09942117773941488, 0.10006326082503934, 0.10064958856941306, 0.10117674146463888, 0.10164354547868008, 0.10205098480085559, 0.10240212766094545, 0.10270206306298935, 0.10295784343422434, 0.10317842574475826, 0.1033746016387896, 0.10355890562606272, 0.10374548957235483, 0.10394995182080527, 0.10418911053111617, 0.10448071349120416, 0.10484308090237564, 0.1052946834517517, 0.10585366507212714, 0.10653732750699726, 0.10736160115311318, 0.10834053240757763, 0.10948582064805118, 0.1108064370661144, 0.11230835250412194, 0.1139943926637432, 0.11586422779143656, 0.11791449196445962, 0.12013901627530393, 0.12252915208513546, 0.12507415597505755, 0.12776160718927682 ], [ 0.09992417057956414, 0.09852463520264827, 0.09738973707265389, 0.09651350480741318, 0.09588503175605625, 0.09548893481888711, 0.09530604281745063, 0.095314247794435, 0.09548944020150237, 0.09580644953753546, 0.09623992353430272, 0.09676509732995467, 0.0973584246302726, 0.09799806183803172, 0.09866421117551995, 0.09933933904014829, 0.1000082914304248, 0.10065833009927375, 0.10127911218799725, 0.10186263346170142, 0.10240315170540566, 0.1028971029201974, 0.10334301904662134, 0.10374145224628195, 0.10409490739467384, 0.10440778141996447, 0.10468630548081558, 0.1049384837330737, 0.10517402063690577, 0.10540422748940957, 0.10564189826463598, 0.10590114507470046, 0.10619718482212244, 0.10654607106306517, 0.10696436883253393, 0.10746877513320728, 0.10807569367682698, 0.108800778745402, 0.10965846891290722, 0.11066153588112622, 0.11182067589317922, 0.11314417039145952, 0.1146376385368451, 0.11630389724737188, 0.11814293546771361, 0.12015199976549039, 0.1223257794906304, 0.12465667283849594, 0.12713511097597818, 0.1297499161121463 ], [ 0.10372354422727435, 0.1022885141036942, 0.10109852952236484, 0.10014862240085652, 0.09942953187899911, 0.09892807720093827, 0.09862771924242174, 0.09850926077530804, 0.09855162503847935, 0.09873265097139652, 0.09902985050482546, 0.09942108601033799, 0.09988514123554078, 0.10040217395336096, 0.10095405113248429, 0.10152457668314104, 0.102099627581929, 0.10266721682779875, 0.103217501899455, 0.1037427558976268, 0.10423731600982165, 0.10469752083907044, 0.10512164485546842, 0.10550983499937637, 0.1058640514336458, 0.10618801169435137, 0.10648713507841012, 0.10676848207776495, 0.107040682080436, 0.107313841488329, 0.10759942395841855, 0.10791009478772706, 0.10825952266814214, 0.10866213424134971, 0.10913282012162877, 0.10968659523519003, 0.11033822118883244, 0.1111018034726912, 0.11199038098990804, 0.1130155289554788, 0.11418699790936546, 0.11551241092670726, 0.11699703790510893, 0.11864366032497381, 0.1204525327974352, 0.1224214400199861, 0.12454584053064845, 0.12681908283067092, 0.12923267565883576, 0.13177659266761407 ], [ 0.10750492345174419, 0.1060375455460229, 0.10479694659049885, 0.10377905339013987, 0.10297606169704082, 0.1023767413476281, 0.10196689612172348, 0.10172994066142527, 0.10164754811635676, 0.10170032017005692, 0.10186843526468434, 0.10213223957729843, 0.10247275647666769, 0.10287210172394408, 0.10331380196068775, 0.10378302208484988, 0.10426671259567004, 0.10475369100154691, 0.10523467231854577, 0.10570226304102592, 0.10615093123740656, 0.10657696304296349, 0.10697841312485976, 0.10735505392796284, 0.1077083258426948, 0.1080412879815284, 0.10835856708771001, 0.10866630029141529, 0.10897206603814963, 0.10928479661495522, 0.10961466537950834, 0.10997294215220974, 0.1103718113540284, 0.11082414942514064, 0.11134326084026734, 0.11194257554500571, 0.11263531464152013, 0.11343413527715211, 0.1143507694373883, 0.11539567415193105, 0.1165777119572786, 0.11790387993716353, 0.11937910315543371, 0.12100610399640861, 0.12278535334004033, 0.1247151033550891, 0.1267914958074311, 0.12900873488612313, 0.13135931016366464, 0.1338342536548055 ], [ 0.11126226997780975, 0.10976574919796947, 0.1084789989909101, 0.10739874800514793, 0.10651848518385983, 0.1058287111265443, 0.10531731611577846, 0.10497005614732675, 0.1047710912961274, 0.1047035485245418, 0.10475007340942248, 0.10489334124822791, 0.10511650616641718, 0.10540357568946195, 0.10573970650333739, 0.10611142395345265, 0.10650677280161665, 0.10691540981477829, 0.10732865008816697, 0.10773947893393297, 0.10814254006108161, 0.108534108981857, 0.1089120584005194, 0.1092758200080852, 0.10962634479767369, 0.10996606185812582, 0.1102988336930781, 0.1106299045229293, 0.11096583682432358, 0.11131443061249573, 0.11168461974648991, 0.11208633990651022, 0.11253036391656393, 0.11302810179472629, 0.11359136528490191, 0.11423209955568465, 0.1149620880427414, 0.1157926397559409, 0.11673427137992835, 0.11779639873557926, 0.1189870532386792, 0.12031263860469055, 0.12177774110828807, 0.12338500335257771, 0.12513506710562758, 0.12702658586342766, 0.12905630301266957, 0.13121918736299226, 0.13350861481993656, 0.13591658329345127 ], [ 0.11499029827351315, 0.11346789172044576, 0.11213943949510491, 0.11100239145733802, 0.11005138774901227, 0.1092784671353645, 0.1086733788420866, 0.10822397586817992, 0.10791666217976152, 0.1077368640637375, 0.10766949720988124, 0.10769940519379967, 0.10781175098959911, 0.10799234987971097, 0.10822793868794467, 0.10850638192563991, 0.10881681978960381, 0.10914976583760877, 0.10949716365521307, 0.10985241211271347, 0.11021036815366189, 0.11056733472993523, 0.11092103975506003, 0.11127061000251395, 0.111616541901333, 0.11196066931102101, 0.11230612669306261, 0.11265730471686417, 0.11301979430970767, 0.11340031454321925, 0.1138066195988505, 0.11424738042253034, 0.11473203760044902, 0.11527062347346341, 0.11587355352166682, 0.1165513894964186, 0.11731457948327809, 0.11817318279931, 0.11913659005584923, 0.12021325052215065, 0.12141041980296498, 0.12273394057775908, 0.12418806766626513, 0.12577534608262897, 0.12749654728819224, 0.12935066495162062, 0.13133496763692698, 0.1334451024057835, 0.1356752406850957, 0.13801825611353313 ], [ 0.11868440814064102, 0.11713941645378138, 0.11577369021719096, 0.11458532990392722, 0.11357000269702838, 0.1127211161184603, 0.11203007603310458, 0.11148661193463037, 0.11107914803809411, 0.11079519682979881, 0.11062175239143046, 0.11054566365393248, 0.11055397210095672, 0.11063420357044405, 0.11077460897119679, 0.11096435335965124, 0.11119365652823054, 0.11145389085848201, 0.11173764367625759, 0.1120387518194915, 0.11235231577124696, 0.1126746997308944, 0.11300352260411727, 0.11333764327788687, 0.11367714187085387, 0.11402329704330569, 0.11437855801620177, 0.11474650876572086, 0.11513182099178307, 0.11554019195879442, 0.11597826321858236, 0.11645351658398645, 0.11697414454669622, 0.11754889362035091, 0.11818688079898954, 0.11889738536333036, 0.11968962049923386, 0.12057249141600547, 0.12155434862740445, 0.12264274653111765, 0.12384421816194428, 0.1251640768351658, 0.1266062542793235, 0.12817318284942716, 0.1298657267072586, 0.13168316375021524, 0.13362321691159335, 0.13568213058440678, 0.13785478561707865, 0.14013484477109442 ], [ 0.12234061854298857, 0.12077637470894396, 0.11937777167047922, 0.11814349804522452, 0.11707013876769641, 0.11615232044837105, 0.11538292532974316, 0.1147533604235459, 0.11425386500668967, 0.11387383808785545, 0.11360216778757833, 0.11342754657313216, 0.11333875951792385, 0.11332493666993464, 0.11337576467286478, 0.113481656526218, 0.11363388146661686, 0.11382465921608419, 0.1140472242195988, 0.11429586603369538, 0.1145659518505664, 0.11485393640670685, 0.11515736340320112, 0.11547486122066017, 0.11580613429234508, 0.11615195012663361, 0.11651412074327731, 0.1168954762833885, 0.11729982782980093, 0.11773191607772521, 0.11819734245963814, 0.1187024796758482, 0.119254359321238, 0.11986053541624192, 0.12052892410431418, 0.12126762149033332, 0.12208470344513697, 0.12298801303199763, 0.1239849428340611, 0.1250822206814974, 0.12628570791619473, 0.1276002192629407, 0.12902937254923755, 0.13057547497573407, 0.13223945052519523, 0.13402081062688215, 0.13591766762623939, 0.1379267882104687, 0.14004368193446234, 0.1422627185352028 ], [ 0.1259555033331851, 0.12437535936969538, 0.12294823441819412, 0.12167334938167727, 0.12054811008615637, 0.11956822938901616, 0.11872790486115646, 0.11802004139230596, 0.11743650544872507, 0.1169683964599239, 0.11660632098178264, 0.11634065673242037, 0.11616179602220446, 0.11606036111005633, 0.1160273872080773, 0.1160544718636936, 0.11613389199646305, 0.1162586917822512, 0.11642274578892561, 0.11662080229040493, 0.11684851159927759, 0.11710244368323235, 0.1173800984066851, 0.11767991060783345, 0.11800125101348485, 0.11834442282190741, 0.11871065273919229, 0.11910207440822791, 0.11952170157445016, 0.1199733880270602, 0.12046177136402904, 0.12099219796718344, 0.12157062723974839, 0.12220351413470068, 0.12289767024725491, 0.12366010519012482, 0.12449785151713012, 0.1254177779823899, 0.1264263972720787, 0.12752967537159776, 0.12873285029620082, 0.13004026791796722, 0.13145524202420242, 0.13297994456943854, 0.1346153304340583, 0.13636109903588428, 0.13821569305276155, 0.14017633250787478, 0.14223908072690114, 0.14439893733250572 ], [ 0.12952612951192818, 0.1279334414668724, 0.12648209405616634, 0.1251717900107447, 0.12400066962253505, 0.1229654135339985, 0.12206139034769783, 0.12128284050262454, 0.12062308587203092, 0.12007475357476399, 0.11963000260627417, 0.11928074298957285, 0.119018839007651, 0.1188362904217519, 0.11872538809815796, 0.11867884287593261, 0.11868988858214619, 0.11875236168640638, 0.1188607611080961, 0.11901029214404762, 0.11919689842488522, 0.11941728532801656, 0.11966893748936162, 0.11995013208568572, 0.12025994852043449, 0.12059827413981819, 0.12096580471575244, 0.12136403772239011, 0.1217952559496731, 0.12226249877167371, 0.12276951843738299, 0.12332071908309307, 0.12392107677212767, 0.12457603972836524, 0.1252914090060458, 0.12607320107029876, 0.12692749506929218, 0.1278602688584462, 0.12887722897447743, 0.12998364063394138, 0.13118416434076172, 0.13248270575112814, 0.133882285025567, 0.13538493101229426, 0.13699160432229152, 0.13870215179051065, 0.14051529311608618, 0.14242863879473858, 0.14443873694470952, 0.14654114539947516 ], [ 0.1330499985980881, 0.13144811031510964, 0.12997677016410575, 0.1286361166939744, 0.12742494704470098, 0.12634080351858018, 0.12538009608836503, 0.12453825389574105, 0.12380989729975395, 0.12318902132710413, 0.12266918149084637, 0.12224367381238725, 0.12190570234837146, 0.12164852937652053, 0.12146560539859043, 0.12135067805107506, 0.12129788068985627, 0.1213018027025049, 0.12135754443092919, 0.12146075994557834, 0.12160769083783908, 0.12179519376383971, 0.12202076377698491, 0.12228255463329508, 0.12257939634516643, 0.12291080938645323, 0.12327701418953191, 0.123678933979974, 0.12411818860638811, 0.12459707686595209, 0.12511854491172594, 0.12568613865589529, 0.12630393864277675, 0.12697647663407574, 0.12770863409034747, 0.1285055237955541, 0.12937235698889177, 0.13031429945830747, 0.1313363210224389, 0.1324430435894708, 0.1336385934488922, 0.13492646356218435, 0.13630939133922224, 0.13778925672539682, 0.13936700442765496, 0.1410425928596384, 0.1428149709968429, 0.14468208292381463, 0.14664089854412957, 0.14868746780874673 ], [ 0.13652499161032586, 0.13491721771135315, 0.13343002974623092, 0.13206395977046156, 0.13081839164064482, 0.1296916338317415, 0.1286810208520138, 0.12778303755393638, 0.12699345953844834, 0.12630750235905014, 0.12571997237594437, 0.1252254128366344, 0.12481823994999673, 0.12449286521378782, 0.1242438018681995, 0.12406575490348054, 0.1239536953968005, 0.12390292098199632, 0.123909104903256, 0.12396833635608587, 0.12407715470438183, 0.12423257974290403, 0.12443213953273616, 0.12467389656571903, 0.12495647220324345, 0.1252790685665898, 0.1256414863967215, 0.1260441369009083, 0.12648804529466876, 0.12697484364858017, 0.12750675076597798, 0.12808653714470858, 0.12871747359951813, 0.12940326281785997, 0.13014795395725431, 0.13095584132236288, 0.1318313491289845, 0.13277890530469227, 0.1338028081197106, 0.1349070901138596, 0.13609538421972323, 0.1373707971274817, 0.13873579476518869, 0.14019210428053805, 0.1417406361382475, 0.14338142895148212, 0.14511361852852236, 0.14693543143116716, 0.148844202203382, 0.1508364124206873 ], [ 0.13994931806732597, 0.13833892658909772, 0.13683993555661916, 0.13545323133672973, 0.13417872078837484, 0.1330153923030792, 0.13196139938052348, 0.131014162014162, 0.130170480369572, 0.12942665492698646, 0.12877860744376696, 0.1282219977293884, 0.1277523322221311, 0.12736506158488411, 0.12705566585273, 0.126819726924572, 0.12665298927135424, 0.12655141054245728, 0.1265112042363354, 0.1265288767484071, 0.12660126094288954, 0.12672554796903635, 0.12689931842961105, 0.12712057329268972, 0.1273877641988719, 0.12769982212767478, 0.12805618280874395, 0.12845680683869282, 0.12890219222000687, 0.12939337698719947, 0.12993192972802747, 0.13051992613511376, 0.13115991021891085, 0.13185483945248405, 0.1326080138707393, 0.13342298997265198, 0.13430348112818022, 0.13525324701873342, 0.1362759753836758, 0.1373751599474359, 0.13855397880946396, 0.1398151777508057, 0.14116096282190013, 0.1425929062233793, 0.1441118688958724, 0.14571794243930067, 0.14741041204839858, 0.1491877411519872, 0.15104757745462685, 0.15298677917083467 ], [ 0.14332146931031486, 0.14171166440859995, 0.14020479957430845, 0.13880207895833596, 0.13750387426266963, 0.13630977560798638, 0.13521865993182397, 0.13422877296893782, 0.13333782031488425, 0.13254306290845924, 0.131841412494876, 0.13122952321174433, 0.13070387629797206, 0.13026085595773415, 0.1298968155000909, 0.12960813390289358, 0.12939126381529953, 0.1292427726398885, 0.12915937867867236, 0.12913798437718285, 0.12917570847966542, 0.1292699184646472, 0.1294182640304107, 0.12961871171906636, 0.12986958008028976, 0.13016957414766323, 0.13051781748497915, 0.1309138796944304, 0.1313577970852834, 0.13185008418844507, 0.13239173396593443, 0.13298420489243848, 0.13362939355998102, 0.1343295920517955, 0.13508743001841175, 0.13590580213327022, 0.1367877823676351, 0.13773652726146005, 0.1387551710318289, 0.1398467159072222, 0.14101392146156647, 0.1422591969125057, 0.14358450032199005, 0.14499124838875244, 0.1464802400643384, 0.1480515965877599, 0.14970471976445549, 0.15143826946956906, 0.15325016049456455, 0.15513757803896305 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.31742 (SEM: 0)
x1: 0.172321
x2: 0.517218
x3: 0.344523
x4: 0.885683
x5: 0.140317
x6: 0.718026", "Arm 1_0
l2norm: 1.08074 (SEM: 0)
x1: 0.146472
x2: 0.0388413
x3: 0.0886124
x4: 0.162793
x5: 0.587168
x6: 0.875173", "Arm 2_0
l2norm: 1.45526 (SEM: 0)
x1: 0.809404
x2: 0.326209
x3: 0.626972
x4: 0.0820427
x5: 0.0750418
x6: 0.975072", "Arm 3_0
l2norm: 1.54218 (SEM: 0)
x1: 0.797891
x2: 0.250534
x3: 0.600155
x4: 0.60133
x5: 0.228134
x6: 0.951364", "Arm 4_0
l2norm: 1.93413 (SEM: 0)
x1: 0.563197
x2: 0.492574
x3: 0.968255
x4: 0.8177
x5: 0.955405
x6: 0.813688", "Arm 5_0
l2norm: 1.5012 (SEM: 0)
x1: 0.421558
x2: 0.814971
x3: 0.0307404
x4: 0.127464
x5: 0.794167
x6: 0.873966", "Arm 6_0
l2norm: 1.74932 (SEM: 0)
x1: 0.699434
x2: 0.0473385
x3: 0.882242
x4: 0.915542
x5: 0.973457
x6: 0.0668445", "Arm 7_0
l2norm: 1.46176 (SEM: 0)
x1: 0.271127
x2: 0.745455
x3: 0.913109
x4: 0.351518
x5: 0.719434
x6: 0.180559", "Arm 8_0
l2norm: 1.43488 (SEM: 0)
x1: 0.218215
x2: 0.574428
x3: 0.536205
x4: 0.252885
x5: 0.982586
x6: 0.60361", "Arm 9_0
l2norm: 1.50692 (SEM: 0)
x1: 0.591028
x2: 0.222858
x3: 0.834184
x4: 0.461383
x5: 0.65922
x6: 0.726995", "Arm 10_0
l2norm: 1.39159 (SEM: 0)
x1: 0.0561848
x2: 0.153245
x3: 0.349294
x4: 0.243428
x5: 0.940295
x6: 0.918951", "Arm 11_0
l2norm: 1.4306 (SEM: 0)
x1: 0.902924
x2: 0.647648
x3: 0.180444
x4: 0.34063
x5: 0.584432
x6: 0.567231", "Arm 12_0
l2norm: 0.906213 (SEM: 0)
x1: 0.245593
x2: 1.21241e-17
x3: 0.078957
x4: 0.0905012
x5: 0.390547
x6: 0.770684", "Arm 13_0
l2norm: 0.868663 (SEM: 0)
x1: 0.278499
x2: 0
x3: 0.0827593
x4: 0.0588128
x5: 0.326477
x6: 0.74841", "Arm 14_0
l2norm: 0.810166 (SEM: 0)
x1: 0.2416
x2: 0
x3: 0.0215059
x4: 0.108558
x5: 0.352812
x6: 0.679172", "Arm 15_0
l2norm: 0.72667 (SEM: 0)
x1: 0.189616
x2: 0
x3: 0.00552408
x4: 0.0847555
x5: 0.356595
x6: 0.598097", "Arm 16_0
l2norm: 0.836568 (SEM: 0)
x1: 0.280064
x2: 7.99771e-17
x3: 1.92949e-17
x4: 0.196006
x5: 0.347918
x6: 0.679666", "Arm 17_0
l2norm: 0.839768 (SEM: 0)
x1: 0.324287
x2: 0
x3: 0
x4: 0.246527
x5: 0.309038
x6: 0.66616", "Arm 18_0
l2norm: 0.86371 (SEM: 0)
x1: 0.407115
x2: 0
x3: 0
x4: 0.273261
x5: 0.333879
x6: 0.627779", "Arm 19_0
l2norm: 0.870569 (SEM: 0)
x1: 0.296689
x2: 8.01505e-17
x3: 1.31228e-16
x4: 0.297054
x5: 0.270394
x6: 0.713101", "Arm 20_0
l2norm: 0.822274 (SEM: 0)
x1: 0.312275
x2: 0.0568335
x3: 0
x4: 0.264895
x5: 0.273077
x6: 0.656239", "Arm 21_0
l2norm: 0.867018 (SEM: 0)
x1: 0.345813
x2: 0.102402
x3: 1.10937e-18
x4: 0.24465
x5: 0.247353
x6: 0.707538", "Arm 22_0
l2norm: 0.752386 (SEM: 0)
x1: 0.290884
x2: 0.0572386
x3: 2.07853e-17
x4: 0.285079
x5: 0.247642
x6: 0.579308", "Arm 23_0
l2norm: 0.846155 (SEM: 0)
x1: 0.291377
x2: 0.0739728
x3: 0
x4: 0.290157
x5: 0.304633
x6: 0.669787" ], "type": "scatter", "x": [ 0.3445225656032562, 0.08861238230019808, 0.6269718110561371, 0.6001549046486616, 0.9682547897100449, 0.030740357004106045, 0.8822419652715325, 0.9131090296432376, 0.5362048223614693, 0.8341835988685489, 0.3492943523451686, 0.18044409900903702, 0.07895698914918149, 0.08275932233114527, 0.02150592158792896, 0.005524075128433562, 1.9294904814618617e-17, 0.0, 0.0, 1.31227753507787e-16, 0.0, 1.1093741294616728e-18, 2.0785326748499718e-17, 0.0 ], "xaxis": "x", "y": [ 0.8856831789016724, 0.16279342770576477, 0.08204265031963587, 0.6013302393257618, 0.8176998551934958, 0.1274635512381792, 0.9155418714508414, 0.35151762049645185, 0.2528846934437752, 0.4613829655572772, 0.24342796951532364, 0.3406304521486163, 0.09050116158448823, 0.05881279892203307, 0.10855828060616915, 0.0847555442287693, 0.19600560176106252, 0.2465269142624945, 0.2732611982545442, 0.29705365733586225, 0.26489471485056537, 0.24464974961360086, 0.2850792415154243, 0.29015697753377434 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.31742 (SEM: 0)
x1: 0.172321
x2: 0.517218
x3: 0.344523
x4: 0.885683
x5: 0.140317
x6: 0.718026", "Arm 1_0
l2norm: 1.08074 (SEM: 0)
x1: 0.146472
x2: 0.0388413
x3: 0.0886124
x4: 0.162793
x5: 0.587168
x6: 0.875173", "Arm 2_0
l2norm: 1.45526 (SEM: 0)
x1: 0.809404
x2: 0.326209
x3: 0.626972
x4: 0.0820427
x5: 0.0750418
x6: 0.975072", "Arm 3_0
l2norm: 1.54218 (SEM: 0)
x1: 0.797891
x2: 0.250534
x3: 0.600155
x4: 0.60133
x5: 0.228134
x6: 0.951364", "Arm 4_0
l2norm: 1.93413 (SEM: 0)
x1: 0.563197
x2: 0.492574
x3: 0.968255
x4: 0.8177
x5: 0.955405
x6: 0.813688", "Arm 5_0
l2norm: 1.5012 (SEM: 0)
x1: 0.421558
x2: 0.814971
x3: 0.0307404
x4: 0.127464
x5: 0.794167
x6: 0.873966", "Arm 6_0
l2norm: 1.74932 (SEM: 0)
x1: 0.699434
x2: 0.0473385
x3: 0.882242
x4: 0.915542
x5: 0.973457
x6: 0.0668445", "Arm 7_0
l2norm: 1.46176 (SEM: 0)
x1: 0.271127
x2: 0.745455
x3: 0.913109
x4: 0.351518
x5: 0.719434
x6: 0.180559", "Arm 8_0
l2norm: 1.43488 (SEM: 0)
x1: 0.218215
x2: 0.574428
x3: 0.536205
x4: 0.252885
x5: 0.982586
x6: 0.60361", "Arm 9_0
l2norm: 1.50692 (SEM: 0)
x1: 0.591028
x2: 0.222858
x3: 0.834184
x4: 0.461383
x5: 0.65922
x6: 0.726995", "Arm 10_0
l2norm: 1.39159 (SEM: 0)
x1: 0.0561848
x2: 0.153245
x3: 0.349294
x4: 0.243428
x5: 0.940295
x6: 0.918951", "Arm 11_0
l2norm: 1.4306 (SEM: 0)
x1: 0.902924
x2: 0.647648
x3: 0.180444
x4: 0.34063
x5: 0.584432
x6: 0.567231", "Arm 12_0
l2norm: 0.906213 (SEM: 0)
x1: 0.245593
x2: 1.21241e-17
x3: 0.078957
x4: 0.0905012
x5: 0.390547
x6: 0.770684", "Arm 13_0
l2norm: 0.868663 (SEM: 0)
x1: 0.278499
x2: 0
x3: 0.0827593
x4: 0.0588128
x5: 0.326477
x6: 0.74841", "Arm 14_0
l2norm: 0.810166 (SEM: 0)
x1: 0.2416
x2: 0
x3: 0.0215059
x4: 0.108558
x5: 0.352812
x6: 0.679172", "Arm 15_0
l2norm: 0.72667 (SEM: 0)
x1: 0.189616
x2: 0
x3: 0.00552408
x4: 0.0847555
x5: 0.356595
x6: 0.598097", "Arm 16_0
l2norm: 0.836568 (SEM: 0)
x1: 0.280064
x2: 7.99771e-17
x3: 1.92949e-17
x4: 0.196006
x5: 0.347918
x6: 0.679666", "Arm 17_0
l2norm: 0.839768 (SEM: 0)
x1: 0.324287
x2: 0
x3: 0
x4: 0.246527
x5: 0.309038
x6: 0.66616", "Arm 18_0
l2norm: 0.86371 (SEM: 0)
x1: 0.407115
x2: 0
x3: 0
x4: 0.273261
x5: 0.333879
x6: 0.627779", "Arm 19_0
l2norm: 0.870569 (SEM: 0)
x1: 0.296689
x2: 8.01505e-17
x3: 1.31228e-16
x4: 0.297054
x5: 0.270394
x6: 0.713101", "Arm 20_0
l2norm: 0.822274 (SEM: 0)
x1: 0.312275
x2: 0.0568335
x3: 0
x4: 0.264895
x5: 0.273077
x6: 0.656239", "Arm 21_0
l2norm: 0.867018 (SEM: 0)
x1: 0.345813
x2: 0.102402
x3: 1.10937e-18
x4: 0.24465
x5: 0.247353
x6: 0.707538", "Arm 22_0
l2norm: 0.752386 (SEM: 0)
x1: 0.290884
x2: 0.0572386
x3: 2.07853e-17
x4: 0.285079
x5: 0.247642
x6: 0.579308", "Arm 23_0
l2norm: 0.846155 (SEM: 0)
x1: 0.291377
x2: 0.0739728
x3: 0
x4: 0.290157
x5: 0.304633
x6: 0.669787" ], "type": "scatter", "x": [ 0.3445225656032562, 0.08861238230019808, 0.6269718110561371, 0.6001549046486616, 0.9682547897100449, 0.030740357004106045, 0.8822419652715325, 0.9131090296432376, 0.5362048223614693, 0.8341835988685489, 0.3492943523451686, 0.18044409900903702, 0.07895698914918149, 0.08275932233114527, 0.02150592158792896, 0.005524075128433562, 1.9294904814618617e-17, 0.0, 0.0, 1.31227753507787e-16, 0.0, 1.1093741294616728e-18, 2.0785326748499718e-17, 0.0 ], "xaxis": "x2", "y": [ 0.8856831789016724, 0.16279342770576477, 0.08204265031963587, 0.6013302393257618, 0.8176998551934958, 0.1274635512381792, 0.9155418714508414, 0.35151762049645185, 0.2528846934437752, 0.4613829655572772, 0.24342796951532364, 0.3406304521486163, 0.09050116158448823, 0.05881279892203307, 0.10855828060616915, 0.0847555442287693, 0.19600560176106252, 0.2465269142624945, 0.2732611982545442, 0.29705365733586225, 0.26489471485056537, 0.24464974961360086, 0.2850792415154243, 0.29015697753377434 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:44.216375Z", "iopub.status.busy": "2022-11-10T20:27:44.215626Z", "iopub.status.idle": "2022-11-10T20:27:44.274725Z", "shell.execute_reply": "2022-11-10T20:27:44.273566Z" } }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.046833484874564645, -0.3967388263955185, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -1.3477729048617488, -1.365713705188456, -1.6116042926826701, -1.6116042926826701, -1.9943341141674107, -2.166235737550301, -2.166235737550301, -2.166235737550301, -2.2707111139530083, -2.2707111139530083, -2.2707111139530083, -2.3654314096822477, -2.5466045566111113 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.17232143878936768
x2: 0.5172182321548462
x3: 0.3445225656032562
x4: 0.8856831789016724
x5: 0.14031696319580078
x6: 0.7180262207984924", "
Parameterization:
x1: 0.14647230692207813
x2: 0.03884132858365774
x3: 0.08861238230019808
x4: 0.16279342770576477
x5: 0.5871677119284868
x6: 0.8751725014299154", "
Parameterization:
x1: 0.8094036234542727
x2: 0.32620884478092194
x3: 0.6269718110561371
x4: 0.08204265031963587
x5: 0.07504183799028397
x6: 0.9750724416226149", "
Parameterization:
x1: 0.7978907218202949
x2: 0.2505344543606043
x3: 0.6001549046486616
x4: 0.6013302393257618
x5: 0.22813442256301641
x6: 0.9513636194169521", "
Parameterization:
x1: 0.5631966022774577
x2: 0.4925741786137223
x3: 0.9682547897100449
x4: 0.8176998551934958
x5: 0.9554052799940109
x6: 0.813687770627439", "
Parameterization:
x1: 0.421558135189116
x2: 0.8149710493162274
x3: 0.030740357004106045
x4: 0.1274635512381792
x5: 0.7941672224551439
x6: 0.8739664545282722", "
Parameterization:
x1: 0.6994339982047677
x2: 0.04733846243470907
x3: 0.8822419652715325
x4: 0.9155418714508414
x5: 0.9734572833403945
x6: 0.06684446521103382", "
Parameterization:
x1: 0.27112725377082825
x2: 0.7454551002010703
x3: 0.9131090296432376
x4: 0.35151762049645185
x5: 0.7194336708635092
x6: 0.18055862002074718", "
Parameterization:
x1: 0.21821485739201307
x2: 0.5744284531101584
x3: 0.5362048223614693
x4: 0.2528846934437752
x5: 0.9825861817225814
x6: 0.6036098003387451", "
Parameterization:
x1: 0.5910276407375932
x2: 0.22285840194672346
x3: 0.8341835988685489
x4: 0.4613829655572772
x5: 0.659220390021801
x6: 0.7269946588203311", "
Parameterization:
x1: 0.056184783577919006
x2: 0.15324465930461884
x3: 0.3492943523451686
x4: 0.24342796951532364
x5: 0.9402951002120972
x6: 0.9189509311690927", "
Parameterization:
x1: 0.9029239639639854
x2: 0.6476479414850473
x3: 0.18044409900903702
x4: 0.3406304521486163
x5: 0.5844321455806494
x6: 0.5672308318316936", "
Parameterization:
x1: 0.24559304915285976
x2: 1.2124057953282886e-17
x3: 0.07895698914918149
x4: 0.09050116158448823
x5: 0.39054727821045965
x6: 0.7706842370110238", "
Parameterization:
x1: 0.27849866003589085
x2: 0.0
x3: 0.08275932233114527
x4: 0.05881279892203307
x5: 0.32647727552359784
x6: 0.7484101638006126", "
Parameterization:
x1: 0.24159981518467807
x2: 0.0
x3: 0.02150592158792896
x4: 0.10855828060616915
x5: 0.3528119584047612
x6: 0.6791722419731495", "
Parameterization:
x1: 0.1896162908269893
x2: 0.0
x3: 0.005524075128433562
x4: 0.0847555442287693
x5: 0.3565953874137562
x6: 0.5980971589256264", "
Parameterization:
x1: 0.2800643839982301
x2: 7.99771395479593e-17
x3: 1.9294904814618617e-17
x4: 0.19600560176106252
x5: 0.34791753098318945
x6: 0.6796658403312656", "
Parameterization:
x1: 0.3242870816288127
x2: 0.0
x3: 0.0
x4: 0.2465269142624945
x5: 0.3090376417795564
x6: 0.6661597450907989", "
Parameterization:
x1: 0.4071147641553506
x2: 0.0
x3: 0.0
x4: 0.2732611982545442
x5: 0.3338791401981914
x6: 0.6277786413636809", "
Parameterization:
x1: 0.2966890418686397
x2: 8.015051338605287e-17
x3: 1.31227753507787e-16
x4: 0.29705365733586225
x5: 0.2703936020018045
x6: 0.7131007169043609", "
Parameterization:
x1: 0.3122748369233028
x2: 0.05683348614449365
x3: 0.0
x4: 0.26489471485056537
x5: 0.2730766348113879
x6: 0.6562388275016662", "
Parameterization:
x1: 0.3458129720691997
x2: 0.10240242871102467
x3: 1.1093741294616728e-18
x4: 0.24464974961360086
x5: 0.24735266739161446
x6: 0.7075381208286688", "
Parameterization:
x1: 0.2908844379733138
x2: 0.057238600120706966
x3: 2.0785326748499718e-17
x4: 0.2850792415154243
x5: 0.24764191089603677
x6: 0.5793077535908963", "
Parameterization:
x1: 0.2913766633907688
x2: 0.0739728413892877
x3: 0.0
x4: 0.29015697753377434
x5: 0.3046326420570555
x6: 0.6697866720058352", "
Parameterization:
x1: 0.29506216793846574
x2: 0.09855985754364237
x3: 0.06114817023649496
x4: 0.30402435742169126
x5: 0.3110071373642808
x6: 0.670673573760974" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.046833484874564645, -0.3967388263955185, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -1.3477729048617488, -1.365713705188456, -1.6116042926826701, -1.6116042926826701, -1.9943341141674107, -2.166235737550301, -2.166235737550301, -2.166235737550301, -2.2707111139530083, -2.2707111139530083, -2.2707111139530083, -2.3654314096822477, -2.5466045566111113 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.046833484874564645, -0.3967388263955185, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.6373557601022797, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -0.906872639132776, -1.3477729048617488, -1.365713705188456, -1.6116042926826701, -1.6116042926826701, -1.9943341141674107, -2.166235737550301, -2.166235737550301, -2.166235737550301, -2.2707111139530083, -2.2707111139530083, -2.2707111139530083, -2.3654314096822477, -2.5466045566111113 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.046833484874564645 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:44.278667Z", "iopub.status.busy": "2022-11-10T20:27:44.278055Z", "iopub.status.idle": "2022-11-10T20:27:44.312081Z", "shell.execute_reply": "2022-11-10T20:27:44.310789Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:44] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:44.314681Z", "iopub.status.busy": "2022-11-10T20:27:44.314475Z", "iopub.status.idle": "2022-11-10T20:27:44.577518Z", "shell.execute_reply": "2022-11-10T20:27:44.576490Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:44] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:44.580426Z", "iopub.status.busy": "2022-11-10T20:27:44.580119Z", "iopub.status.idle": "2022-11-10T20:27:44.599536Z", "shell.execute_reply": "2022-11-10T20:27:44.598422Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:44] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:44.602832Z", "iopub.status.busy": "2022-11-10T20:27:44.602426Z", "iopub.status.idle": "2022-11-10T20:27:49.009745Z", "shell.execute_reply": "2022-11-10T20:27:49.009114Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.290142, 'x2': 0.121615, 'x3': 0.113241, 'x4': 0.315426, 'x5': 0.313627, 'x6': 0.659443}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-11-10T20:27:49.014129Z", "iopub.status.busy": "2022-11-10T20:27:49.013057Z", "iopub.status.idle": "2022-11-10T20:27:49.021886Z", "shell.execute_reply": "2022-11-10T20:27:49.021296Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:27:49.026229Z", "iopub.status.busy": "2022-11-10T20:27:49.025138Z", "iopub.status.idle": "2022-11-10T20:27:49.039361Z", "shell.execute_reply": "2022-11-10T20:27:49.038815Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-10 20:27:49] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-11-10T20:27:49.043125Z", "iopub.status.busy": "2022-11-10T20:27:49.042039Z", "iopub.status.idle": "2022-11-10T20:27:49.048646Z", "shell.execute_reply": "2022-11-10T20:27:49.048059Z" } }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.14" } }, "nbformat": 4, "nbformat_minor": 2 }