{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:15:07.848886Z", "iopub.status.busy": "2022-09-28T16:15:07.848291Z", "iopub.status.idle": "2022-09-28T16:15:09.859053Z", "shell.execute_reply": "2022-09-28T16:15:09.858417Z" } }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:15:09.917283Z", "iopub.status.busy": "2022-09-28T16:15:09.916453Z", "iopub.status.idle": "2022-09-28T16:15:09.920848Z", "shell.execute_reply": "2022-09-28T16:15:09.920326Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:15:09.924179Z", "iopub.status.busy": "2022-09-28T16:15:09.923557Z", "iopub.status.idle": "2022-09-28T16:15:09.934747Z", "shell.execute_reply": "2022-09-28T16:15:09.934113Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:15:09.937446Z", "iopub.status.busy": "2022-09-28T16:15:09.937230Z", "iopub.status.idle": "2022-09-28T16:15:09.941230Z", "shell.execute_reply": "2022-09-28T16:15:09.940608Z" } }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:15:09.944238Z", "iopub.status.busy": "2022-09-28T16:15:09.944025Z", "iopub.status.idle": "2022-09-28T16:17:20.757340Z", "shell.execute_reply": "2022-09-28T16:17:20.756720Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/runner/work/Ax/Ax/ax/core/observation.py:274: FutureWarning:\n", "\n", "In a future version of pandas, a length 1 tuple will be returned when iterating over a groupby with a grouper equal to a list of length 1. Don't supply a list with a single grouper to avoid this warning.\n", "\n", "[INFO 09-28 16:15:09] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.374395, 'x2': 0.473328, 'x3': 0.253384, 'x4': 0.175281, 'x5': 0.91134, 'x6': 0.579642}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.08449, 0.0), 'l2norm': (1.275014, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.585993, 'x2': 0.236022, 'x3': 0.224513, 'x4': 0.497436, 'x5': 0.761981, 'x6': 0.86586}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.030709, 0.0), 'l2norm': (1.423823, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.260758, 'x2': 0.263249, 'x3': 0.332616, 'x4': 0.737915, 'x5': 0.67316, 'x6': 0.066668}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:09] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.083534, 0.0), 'l2norm': (1.11805, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.238416, 'x2': 0.290649, 'x3': 0.294604, 'x4': 0.639106, 'x5': 0.133313, 'x6': 0.860378}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.384019, 0.0), 'l2norm': (1.180928, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.752805, 'x2': 0.562042, 'x3': 0.919162, 'x4': 0.332665, 'x5': 0.156489, 'x6': 0.836415}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.785275, 0.0), 'l2norm': (1.600691, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.007848, 'x2': 0.645909, 'x3': 0.94897, 'x4': 0.305871, 'x5': 0.014403, 'x6': 0.754934}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.361091, 0.0), 'l2norm': (1.407656, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.152215, 'x2': 0.449218, 'x3': 0.133706, 'x4': 0.510388, 'x5': 0.082285, 'x6': 0.494617}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.427215, 0.0), 'l2norm': (0.868767, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.032695, 'x2': 0.986456, 'x3': 0.40432, 'x4': 0.703495, 'x5': 0.102807, 'x6': 0.575572}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.029148, 0.0), 'l2norm': (1.405132, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.503454, 'x2': 0.453209, 'x3': 0.413391, 'x4': 0.631017, 'x5': 0.679934, 'x6': 0.844067}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.061324, 0.0), 'l2norm': (1.48415, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.375814, 'x2': 0.119286, 'x3': 0.98163, 'x4': 0.627615, 'x5': 0.510208, 'x6': 0.525394}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.200105, 0.0), 'l2norm': (1.431543, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.873167, 'x2': 0.450857, 'x3': 0.64219, 'x4': 0.095507, 'x5': 0.387701, 'x6': 0.264634}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.095796, 0.0), 'l2norm': (1.267898, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.213789, 'x2': 0.505108, 'x3': 0.611463, 'x4': 0.024288, 'x5': 0.814381, 'x6': 0.708746}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:10] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.576544, 0.0), 'l2norm': (1.356781, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:15:23] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.098594, 'x2': 0.245195, 'x3': 0.109072, 'x4': 0.431905, 'x5': 0.0, 'x6': 0.695178}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:23] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.417972, 0.0), 'l2norm': (0.866921, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:15:37] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.372133, 'x2': 0.286031, 'x3': 0.143069, 'x4': 0.529643, 'x5': 0.0, 'x6': 0.570268}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:37] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.270188, 0.0), 'l2norm': (0.92005, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:15:49] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.0, 'x2': 0.367709, 'x3': 0.256513, 'x4': 0.360625, 'x5': 0.117116, 'x6': 0.655752}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:15:49] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.14149, 0.0), 'l2norm': (0.88022, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:16:00] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.0, 'x2': 0.37561, 'x3': 0.302376, 'x4': 0.297549, 'x5': 0.136556, 'x6': 0.662402}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:00] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.379659, 0.0), 'l2norm': (0.882312, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:16:11] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.0, 'x2': 0.389754, 'x3': 0.3532, 'x4': 0.241469, 'x5': 0.16101, 'x6': 0.670775}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:11] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.55812, 0.0), 'l2norm': (0.900461, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:16:23] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.0, 'x2': 0.395481, 'x3': 0.398349, 'x4': 0.157199, 'x5': 0.190189, 'x6': 0.683941}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:23] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.582175, 0.0), 'l2norm': (0.918556, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:29] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.0, 'x2': 0.392143, 'x3': 0.444687, 'x4': 0.222179, 'x5': 0.158972, 'x6': 0.642449}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:29] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.589446, 0.0), 'l2norm': (0.915915, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:35] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.0, 'x2': 0.418918, 'x3': 0.428562, 'x4': 0.235395, 'x5': 0.212135, 'x6': 0.709957}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:35] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.829999, 0.0), 'l2norm': (0.981636, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:16:47] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.0, 'x2': 0.434061, 'x3': 0.471133, 'x4': 0.261458, 'x5': 0.262458, 'x6': 0.751427}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:47] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.954321, 0.0), 'l2norm': (1.054638, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:16:58] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.0, 'x2': 0.423516, 'x3': 0.485925, 'x4': 0.25374, 'x5': 0.257668, 'x6': 0.848703}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:16:58] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-1.634544, 0.0), 'l2norm': (1.125417, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:03] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.0, 'x2': 0.439797, 'x3': 0.487461, 'x4': 0.277821, 'x5': 0.315973, 'x6': 0.710409}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:03] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.094375, 0.0), 'l2norm': (1.054867, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:08] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.0, 'x2': 0.4969, 'x3': 0.466788, 'x4': 0.26182, 'x5': 0.338495, 'x6': 0.675143}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:08] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-1.854214, 0.0), 'l2norm': (1.050594, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:\n", "\n", "Optimization failed in `gen_candidates_scipy` with the following warning(s):\n", "[OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 9.')]\n", "Trying again with a new set of initial conditions.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/opt/hostedtoolcache/Python/3.8.14/x64/lib/python3.8/site-packages/botorch/optim/optimize.py:328: RuntimeWarning:\n", "\n", "Optimization failed on the second try, after generating a new set of initial conditions.\n", "\n", "[INFO 09-28 16:17:20] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.0, 'x2': 0.402657, 'x3': 0.512897, 'x4': 0.289198, 'x5': 0.342507, 'x6': 0.692797}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:20] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.232377, 0.0), 'l2norm': (1.051718, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:17:20.760510Z", "iopub.status.busy": "2022-09-28T16:17:20.760058Z", "iopub.status.idle": "2022-09-28T16:17:20.771360Z", "shell.execute_reply": "2022-09-28T16:17:20.770834Z" } }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:17:20.775973Z", "iopub.status.busy": "2022-09-28T16:17:20.774687Z", "iopub.status.idle": "2022-09-28T16:17:20.803386Z", "shell.execute_reply": "2022-09-28T16:17:20.802841Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:20] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.37, 'x2': 0.47, 'x3': 0.25, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.59, 'x2': 0.24, 'x3': 0.22, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.26, 'x2': 0.26, 'x3': 0.33, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.24, 'x2': 0.29, 'x3': 0.29, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.75, 'x2': 0.56, 'x3': 0.92, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.01, 'x2': 0.65, 'x3': 0.95, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.15, 'x2': 0.45, 'x3': 0.13, '...
70Sobol7COMPLETED{'7_0': {'x1': 0.03, 'x2': 0.99, 'x3': 0.4, 'x...
80Sobol8COMPLETED{'8_0': {'x1': 0.5, 'x2': 0.45, 'x3': 0.41, 'x...
90Sobol9COMPLETED{'9_0': {'x1': 0.38, 'x2': 0.12, 'x3': 0.98, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.87, 'x2': 0.45, 'x3': 0.64, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.21, 'x2': 0.51, 'x3': 0.61, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.1, 'x2': 0.25, 'x3': 0.11, '...
131GPEI13COMPLETED{'13_0': {'x1': 0.37, 'x2': 0.29, 'x3': 0.14, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.0, 'x2': 0.37, 'x3': 0.26, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.0, 'x2': 0.38, 'x3': 0.3, 'x...
161GPEI16COMPLETED{'16_0': {'x1': 0.0, 'x2': 0.39, 'x3': 0.35, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.4, 'x4...
181GPEI18COMPLETED{'18_0': {'x1': 0.0, 'x2': 0.39, 'x3': 0.44, '...
191GPEI19COMPLETED{'19_0': {'x1': 0.0, 'x2': 0.42, 'x3': 0.43, '...
201GPEI20COMPLETED{'20_0': {'x1': 0.0, 'x2': 0.43, 'x3': 0.47, '...
211GPEI21COMPLETED{'21_0': {'x1': 0.0, 'x2': 0.42, 'x3': 0.49, '...
221GPEI22COMPLETED{'22_0': {'x1': 0.0, 'x2': 0.44, 'x3': 0.49, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.0, 'x2': 0.5, 'x3': 0.47, 'x...
241GPEI24COMPLETED{'24_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.51, 'x...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.37, 'x2': 0.47, 'x3': 0.25, '... \n", "1 {'1_0': {'x1': 0.59, 'x2': 0.24, 'x3': 0.22, '... \n", "2 {'2_0': {'x1': 0.26, 'x2': 0.26, 'x3': 0.33, '... \n", "3 {'3_0': {'x1': 0.24, 'x2': 0.29, 'x3': 0.29, '... \n", "4 {'4_0': {'x1': 0.75, 'x2': 0.56, 'x3': 0.92, '... \n", "5 {'5_0': {'x1': 0.01, 'x2': 0.65, 'x3': 0.95, '... \n", "6 {'6_0': {'x1': 0.15, 'x2': 0.45, 'x3': 0.13, '... \n", "7 {'7_0': {'x1': 0.03, 'x2': 0.99, 'x3': 0.4, 'x... \n", "8 {'8_0': {'x1': 0.5, 'x2': 0.45, 'x3': 0.41, 'x... \n", "9 {'9_0': {'x1': 0.38, 'x2': 0.12, 'x3': 0.98, '... \n", "10 {'10_0': {'x1': 0.87, 'x2': 0.45, 'x3': 0.64, ... \n", "11 {'11_0': {'x1': 0.21, 'x2': 0.51, 'x3': 0.61, ... \n", "12 {'12_0': {'x1': 0.1, 'x2': 0.25, 'x3': 0.11, '... \n", "13 {'13_0': {'x1': 0.37, 'x2': 0.29, 'x3': 0.14, ... \n", "14 {'14_0': {'x1': 0.0, 'x2': 0.37, 'x3': 0.26, '... \n", "15 {'15_0': {'x1': 0.0, 'x2': 0.38, 'x3': 0.3, 'x... \n", "16 {'16_0': {'x1': 0.0, 'x2': 0.39, 'x3': 0.35, '... \n", "17 {'17_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.4, 'x4... \n", "18 {'18_0': {'x1': 0.0, 'x2': 0.39, 'x3': 0.44, '... \n", "19 {'19_0': {'x1': 0.0, 'x2': 0.42, 'x3': 0.43, '... \n", "20 {'20_0': {'x1': 0.0, 'x2': 0.43, 'x3': 0.47, '... \n", "21 {'21_0': {'x1': 0.0, 'x2': 0.42, 'x3': 0.49, '... \n", "22 {'22_0': {'x1': 0.0, 'x2': 0.44, 'x3': 0.49, '... \n", "23 {'23_0': {'x1': 0.0, 'x2': 0.5, 'x3': 0.47, 'x... \n", "24 {'24_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.51, 'x... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:20.807805Z", "iopub.status.busy": "2022-09-28T16:17:20.806696Z", "iopub.status.idle": "2022-09-28T16:17:21.198286Z", "shell.execute_reply": "2022-09-28T16:17:21.197708Z" } }, "outputs": [ { "data": { "text/plain": [ "{'x1': 3.360233643198171e-14,\n", " 'x2': 0.4026574838295572,\n", " 'x3': 0.5128966783389253,\n", " 'x4': 0.28919821838697746,\n", " 'x5': 0.3425065762199245,\n", " 'x6': 0.692797327605787}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:21.202830Z", "iopub.status.busy": "2022-09-28T16:17:21.201719Z", "iopub.status.idle": "2022-09-28T16:17:21.208208Z", "shell.execute_reply": "2022-09-28T16:17:21.207700Z" } }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.2323643067278005, 'l2norm': 1.0517223963194233}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:21.212574Z", "iopub.status.busy": "2022-09-28T16:17:21.211469Z", "iopub.status.idle": "2022-09-28T16:17:21.217732Z", "shell.execute_reply": "2022-09-28T16:17:21.217207Z" } }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:21.221995Z", "iopub.status.busy": "2022-09-28T16:17:21.220878Z", "iopub.status.idle": "2022-09-28T16:17:21.862903Z", "shell.execute_reply": "2022-09-28T16:17:21.862339Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:21] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.510322044837666, -0.5055244625253126, -0.49984839459120234, -0.49333267593197355, -0.48602557235600724, -0.4779840462634883, -0.4692728411177332, -0.45996341050176426, -0.45013272240897434, -0.4398619728871477, -0.42923524512465233, -0.41833815051466616, -0.407256487224426, -0.39607494947438915, -0.3848759172978509, -0.3737383522457228, -0.36273681958468224, -0.3519406522734685, -0.34141326664355676, -0.33121163448542057, -0.32138591134719785, -0.3119792164491909, -0.3030275558260246, -0.29455987720813714, -0.2865982427860876, -0.27915810436686106, -0.27224866450030083, -0.26587330686617705, -0.2600300794876369, -0.2547122150794511, -0.24990867394799732, -0.24560469623286585, -0.24178235182258068, -0.23842107790509526, -0.23549819575711095, -0.23298939997916557, -0.23086921490423573, -0.22911141431769666, -0.22768940190783726, -0.22657655100915997, -0.22574650320219192, -0.22517342619448155, -0.2248322321319508, -0.2246987580837998, -0.22474991091496566, -0.22496377911601084, -0.22531971441030163, -0.22579838611212077, -0.22638181127733603, -0.22705336368122842 ], [ -0.551039853630169, -0.5458281181665927, -0.5395836998228447, -0.5323508520284272, -0.5241852332722878, -0.5151530113100448, -0.5053297407158948, -0.49479904773523564, -0.48365116259828556, -0.4719813437023223, -0.45988824022778085, -0.4474722398297348, -0.434833846178074, -0.4220721275485655, -0.409283272710666, -0.3965592843787799, -0.383986833868367, -0.37164629369265434, -0.35961095798342874, -0.3479464541082151, -0.33671034291935387, -0.3259518998829707, -0.315712065014531, -0.3060235461542792, -0.296911057661989, -0.2883916750634202, -0.28047528547196976, -0.27316511364121987, -0.26645830416140026, -0.2603465414693966, -0.2548166908706365, -0.24985144555121708, -0.2454299664812869, -0.24152850408365123, -0.23812099249042218, -0.23517960907904523, -0.23267529372758333, -0.23057822383227078, -0.22885824257379517, -0.22748523919674923, -0.22642948117906003, -0.22566189911864576, -0.2251543259590646, -0.22487969282193965, -0.22481218421988347, -0.22492735579885237, -0.225202218013428, -0.2256152892835276, -0.22614662222834536, -0.22677780653556678 ], [ -0.5969448718105463, -0.591300547627555, -0.5844445089488853, -0.5764272215557429, -0.5673129483611696, -0.5571786510453302, -0.5461126074383269, -0.5342127896948112, -0.5215850562461062, -0.5083412156700174, -0.49459702284494494, -0.48047016712480484, -0.46607830904030345, -0.45153721660099755, -0.43695904513676975, -0.4224507963176777, -0.40811298306794747, -0.394038518045126, -0.38031183462569523, -0.3670082412784522, -0.3541935030817413, -0.3419236381273114, -0.33024491174657344, -0.31919400791652763, -0.30879835481365703, -0.29907658019711847, -0.2900390719939061, -0.2816886199806262, -0.27402111564893716, -0.26702628904261305, -0.2606884634091152, -0.25498731077751047, -0.24989859393782465, -0.24539488265669518, -0.24144623424643596, -0.23802083075598857, -0.2350855670385693, -0.23260658575238535, -0.23054975695930224, -0.22888110140065576, -0.2275671577535341, -0.22657529521099706, -0.22587397359384997, -0.22543295389822005, -0.22522346272163818, -0.2252183144006592, -0.2253919949463974, -0.22572071199309174, -0.22618241499252756, -0.2267567898085796 ], [ -0.648425763425656, -0.6423316887137241, -0.6348185588321293, -0.6259439847354704, -0.6157822749665534, -0.6044230815524146, -0.5919696884404677, -0.5785370026992995, -0.5642493188767252, -0.5492379330755375, -0.5336386853502457, -0.5175895071379382, -0.5012280450719642, -0.4846894243406906, -0.4681042045108153, -0.4515965692352531, -0.43528277927549486, -0.419269906467315, -0.40365485520612404, -0.3885236681464804, -0.3739511043826629, -0.36000047155791126, -0.34672368818069477, -0.3341615488572526, -0.32234416306068725, -0.311291537278922, -0.3010142707173482, -0.2915143359634341, -0.28278591793645325, -0.274816286843926, -0.2675866835651761, -0.2610731987260364, -0.2552476295904138, -0.25007830167752454, -0.24553084464913333, -0.2415689144545451, -0.23815485594754426, -0.23525030218834586, -0.23281670841462432, -0.23081582021381808, -0.22921007676238858, -0.22796295112563314, -0.22703923054314457, -0.22640524036938725, -0.22602901590560365, -0.22588042675891884, -0.22593125860894636, -0.2261552573651805, -0.2265281406754618, -0.22702758161410386 ], [ -0.705831743705295, -0.6992722704574005, -0.6910542908858724, -0.6812436624572673, -0.6699264589963433, -0.6572072916105322, -0.6432071788762165, -0.6280610474643653, -0.6119149573784164, -0.5949231531866915, -0.5772450439991121, -0.5590422108837556, -0.5404755317421088, -0.5217025014138827, -0.5028748101345581, -0.48413622759091646, -0.4656208237816944, -0.4474515425934205, -0.4297391301400672, -0.41258140796575715, -0.3960628714419535, -0.38025458619244384, -0.36521435009246933, -0.35098708514424226, -0.33760542208809696, -0.3250904406825529, -0.3134525298780755, -0.302692334323564, -0.29280175650716034, -0.2837649871006156, -0.27555953954324597, -0.2681572684023503, -0.2615253544566919, -0.25562724268045, -0.25042352230152154, -0.24587274084055188, -0.2419321464953743, -0.238558355421977, -0.23570794238732118, -0.23333795494369391, -0.23140635271132903, -0.22987237456708176, -0.22869683753176429, -0.22784237193626566, -0.2272735980358962, -0.22695724964377972, -0.22686225058001497, -0.2269597497988053, -0.22722312097854558, -0.22762793216016153 ], [ -0.7694484148593426, -0.7624096529554276, -0.753436729445501, -0.7426050543383647, -0.7300145241743646, -0.7157874272123252, -0.7000657788029563, -0.6830081972970964, -0.6647864473640357, -0.6455817856860675, -0.625581243776592, -0.6049739749819071, -0.5839477789406614, -0.5626858985703967, -0.5413641638019474, -0.5201485344770627, -0.4991930735264441, -0.4786383619137412, -0.45861034968637027, -0.439219623305608, -0.42056105842967717, -0.40271381944640766, -0.3857416620674463, -0.36969349285491404, -0.3546041392384885, -0.3404952849592444, -0.32737652852124244, -0.31524652575377987, -0.30409418164754665, -0.29389986094588993, -0.28463659132709884, -0.27627123724147906, -0.2687656264567154, -0.2620776150490819, -0.2561620799245057, -0.2509718309557979, -0.24645843749071472, -0.24257296633903358, -0.23926663040719776, -0.23649134893656987, -0.23420022183249345, -0.23234792185863506, -0.23089100952343178, -0.22978817631034365, -0.22900042250830088, -0.22849117629273297, -0.2282263609033106, -0.22817441677849615, -0.22830628535952424, -0.2285953609911795 ], [ -0.8394676990115254, -0.8319377697577961, -0.8221575050775795, -0.8102134223793447, -0.7962217074311964, -0.7803255839955383, -0.7626919614802693, -0.7435075119303103, -0.7229743484974465, -0.7013054859423141, -0.678720260279929, -0.6554398709859077, -0.6316831875586415, -0.6076629353456673, -0.5835823460488332, -0.5596323286110976, -0.535989188204411, -0.5128128962064726, -0.4902458932664637, -0.46841239122717343, -0.44741812780267814, -0.42735052021467757, -0.4082791599700455, -0.3902565900075339, -0.3733193069045519, -0.35748893408627325, -0.342773516447169, -0.329168891989292, -0.3166601016030447, -0.30522280365836396, -0.2948246654165595, -0.28542670827119676, -0.2769845883989194, -0.2694497985160058, -0.2627707800969684, -0.2568939386433994, -0.251764557431604, -0.2473276076555515, -0.24352845505284715, -0.24031346498369188, -0.23763050954555842, -0.23542938166122462, -0.23366212218129045, -0.23228326689797463, -0.23125002097932335, -0.23052236870918874, -0.23006312657071382, -0.22983794765733434, -0.2298152851589007, -0.22996632227939506 ], [ -0.915951074189577, -0.9079203830579069, -0.8972782541722625, -0.8841241693470586, -0.8685935636770774, -0.8508545004152517, -0.8311034294110391, -0.8095602385094132, -0.7864628330719815, -0.7620614861831363, -0.7366131925566277, -0.710376235648533, -0.6836051439196575, -0.6565461727562139, -0.6294334071733527, -0.6024855403872132, -0.5759033471270982, -0.5498678397907397, -0.5245390710486248, -0.5000555284383852, -0.47653405451046077, -0.4540702194995123, -0.4327390714128557, -0.41259618988447716, -0.3936789741993248, -0.3760081016927101, -0.3595890995448974, -0.3444139802354035, -0.3304628981523531, -0.31770579175941416, -0.3061039821106367, -0.29561170427035355, -0.28617755331107186, -0.2777458310476648, -0.27025778357351815, -0.2636527230610799, -0.25786903024515806, -0.252845036584988, -0.2485197873499937, -0.2448336888288979, -0.24172904454222255, -0.2391504867524703, -0.23704531071508872, -0.23536371999437145, -0.23405899178092116, -0.23308757149525405, -0.23240910605674114, -0.23198642505766087, -0.23178547873566113, -0.23177524111772518 ], [ -0.9987854442923371, -0.9902469897774242, -0.9786867631108369, -0.9642194329107721, -0.9470032351518065, -0.9272357404979206, -0.9051484570982737, -0.881000561273429, -0.8550720794505955, -0.8276568482685699, -0.7990555591405646, -0.7695691541870215, -0.7394927888465128, -0.7091105191289652, -0.6786908140509776, -0.6484829406649188, -0.618714223212301, -0.5895881409040735, -0.561283201132778, -0.5339525061745156, -0.507723920680811, -0.48270074319488604, -0.4589627861238947, -0.4365677736488139, -0.415552974673548, -0.3959369970110381, -0.3777216787005961, -0.36089402199184223, -0.3454281246628924, -0.33128707168577953, -0.31842475767388634, -0.3067876170151981, -0.29631624415793456, -0.2869468912641341, -0.2786128344973132, -0.2712456036806693, -0.26477607305959905, -0.25913541351381997, -0.2542559088528622, -0.2500716408324195, -0.24651904926461232, -0.24353737506344098, -0.2410689952585594, -0.2390596599144642, -0.2374586414996268, -0.2362188075601892, -0.23529662757517478, -0.23465212462559304, -0.23424878202987642, -0.23405341442270233 ], [ -1.0876312723207728, -1.0785810198409742, -1.066045541547093, -1.0501573532451405, -1.0311017436921275, -1.0091113486863834, -0.9844592452919586, -0.9574509782463624, -0.928415965755043, -0.8976987260406849, -0.865650325835124, -0.8326203872779504, -0.7989499111585994, -0.7649650919922005, -0.730972221959769, -0.6972537117476696, -0.6640651999005355, -0.6316336795742648, -0.6001565421658337, -0.5698014198368644, -0.5407067015121798, -0.5129825973782771, -0.4867126331134043, -0.4619554651259037, -0.4387469203226103, -0.417102177065099, -0.39701801701980516, -0.3784750898951851, -0.36144014417509734, -0.3458681867056801, -0.3317045423380991, -0.3188867918499445, -0.3073465722130728, -0.2970112281289, -0.28780530780455305, -0.27965189937043544, -0.27247380728936255, -0.26619457069036556, -0.26073932784940856, -0.2560355330719959, -0.25201353401703486, -0.2486070190251246, -0.24575334525412784, -0.2433937593552773, -0.24147352302480696, -0.23994195603153012, -0.23875240925710672, -0.2378621799158701, -0.23723238048213557, -0.23682777199326577 ], [ -1.1818631837045137, -1.1723005526960182, -1.1587331114856867, -1.1413144000520867, -1.1202618248923377, -1.0958496553452313, -1.0684001421059, -1.0382733433842526, -1.0058562799513202, -0.9715520146237802, -0.9357691778927768, -0.8989123567786013, -0.8613736460066274, -0.8235255439012046, -0.7857152704827123, -0.7482604983117749, -0.7114464201366998, -0.6755240311013077, -0.6407094751269805, -0.6071842921160524, -0.5750964015229809, -0.5445616653736072, -0.5156658870782236, -0.48846711893568723, -0.4629981691226291, -0.43926921675875463, -0.4172704603429252, -0.39697473985899456, -0.3783400858623547, -0.3613121598236567, -0.34582655903946913, -0.3318109667422665, -0.319187133930783, -0.3078726841878583, -0.29778273663138355, -0.288831345391961, -0.2809327568154717, -0.27400248808091177, -0.2679582331811168, -0.26272060426568433, -0.25821371818410066, -0.2543656396603493, -0.2511086938338781, -0.24837966187183014, -0.24611987396007662, -0.24427521419919962, -0.2427960517703246, -0.2416371122201888, -0.24075730188943956, -0.24011949743201022 ], [ -1.2805042595609208, -1.2704328003741465, -1.2557793415470448, -1.236722216906281, -1.2135169291667085, -1.186487051281779, -1.1560127537657199, -1.122517795717291, -1.0864558446306178, -1.0482969255002759, -1.008514669204016, -0.9675748639399502, -0.925925639186458, -0.8839894500497273, -0.8421568937751516, -0.8007822852505453, -0.760180844773933, -0.7206273060626905, -0.6823557306022416, -0.6455603106256195, -0.6103969521759779, -0.5769854473653522, -0.545412067433362, -0.5157324326744807, -0.48797453964680015, -0.46214184887032883, -0.43821635659782143, -0.4161615917702585, -0.39592549386560233, -0.3774431391672236, -0.3606392923276463, -0.34543076737900436, -0.3317285879675341, -0.3194399409739497, -0.30846992118751104, -0.29872306762611334, -0.29010469465945865, -0.2825220234418846, -0.275885121368996, -0.27010765935078096, -0.2651074986108344, -0.26080712041603893, -0.25713391354069814, -0.25402033530547286, -0.25140396265162357, -0.24922744988740553, -0.24743840947634155, -0.24598923155598684, -0.24483685683458578, -0.24394251618472507 ], [ -1.3821569079587668, -1.3715852830619069, -1.3557978523177108, -1.3350021617393824, -1.30949875956188, -1.2796693103813994, -1.2459617284102311, -1.2088735346186226, -1.1689346415782749, -1.1266906328252144, -1.0826873799403656, -1.0374575818566945, -0.9915095592672729, -0.945318420017608, -0.8993195423029335, -0.8539042035684528, -0.8094171094506323, -0.7661555407152936, -0.7243698278858733, -0.6842648746756405, -0.6460024753150683, -0.6097042017726939, -0.5754546704943264, -0.5433050316438056, -0.513276554936041, -0.4853642138229294, -0.45954019345296143, -0.43575726736008225, -0.41395200345520006, -0.39404777201500746, -0.3759575375285517, -0.35958642306023136, -0.3448340407968947, -0.3315965861929139, -0.3197686960574412, -0.30924507339258944, -0.2999218840377411, -0.29169793235162267, -0.28447562532861725, -0.27816173668458266, -0.2726679844921046, -0.26791143779650717, -0.26381476919272084, -0.26030637148908087, -0.2573203572513716, -0.2547964601671848, -0.25267985679368576, -0.25092092638577057, -0.24947496521315282, -0.24830187015482286 ], [ -1.4849358060643594, -1.473879233467149, -1.456921135611867, -1.434303341350237, -1.4063793244296052, -1.3735986139321972, -1.3364875045741786, -1.2956278030213948, -1.2516352768790635, -1.2051392064589042, -1.1567640674620465, -1.1071139804333427, -1.056760211070003, -1.0062317266028855, -0.9560086163014253, -0.9065180621392144, -0.8581324847446098, -0.8111694740136602, -0.7658931285860817, -0.7225164618990124, -0.681204575801116, -0.6420783494054252, -0.6052184367470108, -0.570669409234839, -0.5384439163450867, -0.5085267698238646, -0.48087888276307494, -0.45544101559725064, -0.43213729691418534, -0.41087849870065885, -0.39156505404222536, -0.37408981114479006, -0.3583405215721613, -0.3442020634330726, -0.3315584024225118, -0.3202942955174216, -0.31029674400751883, -0.30145620454746613, -0.2936675690789565, -0.28683092673601496, -0.2808521230991605, -0.27564313425536024, -0.2711222748953084, -0.26721426099823364, -0.26385014841255017, -0.26096716877999615, -0.258508483764626, -0.25642287747815906, -0.25466440542350366, -0.25319201632222577 ], [ -1.5864122440746007, -1.5748945988425804, -1.5567478387296974, -1.5322536954650339, -1.5018271529138798, -1.4659959634777144, -1.4253756550581997, -1.3806425249982306, -1.3325069023848635, -1.2816884706154235, -1.2288948431224034, -1.1748040106405215, -1.1200508084200758, -1.0652172154650559, -1.010826089246187, -0.9573378346496416, -0.9051494765224264, -0.8545956249108159, -0.8059508703069729, -0.7594332081284101, -0.7152081574371616, -0.6733933024866352, -0.6340630436013287, -0.5972533944191327, -0.5629667050475475, -0.5311762253034573, -0.5018304494656003, -0.47485720468377124, -0.45016746032209093, -0.42765884608913146, -0.40721887384101074, -0.38872786239056123, -0.37206156737076035, -0.35709351990821686, -0.343697079137807, -0.33174720485107767, -0.3211219580813315, -0.3117037393058769, -0.30338027618388885, -0.296045375240784, -0.28959945448279856, -0.2839498763693653, -0.2790111026734323, -0.27470469433455724, -0.27095918031734345, -0.26770981965140206, -0.2648982802383101, -0.26247225671880525, -0.2603850478053985, -0.2585951111443775 ], [ -1.6835844532468935, -1.6716412349733454, -1.6523168083116775, -1.6259386818091863, -1.5929920910599216, -1.5540931234138409, -1.5099565035132487, -1.4613616001182095, -1.4091197140923106, -1.3540448512224672, -1.2969292566105732, -1.238524185572841, -1.179525797590398, -1.1205656912031527, -1.0622054109178183, -1.0049342004600097, -0.9491693020954493, -0.8952581722181353, -0.8434820735368959, -0.7940605981666461, -0.7471567648041342, -0.7028824124760611, -0.6613036813325504, -0.6224464273995388, -0.5863014637051858, -0.5528295557853438, -0.5219661264813569, -0.4936256444812465, -0.46770568454361144, -0.4440906560642688, -0.4226552018018111, -0.40326727126141504, -0.38579087439741216, -0.3700885217238908, -0.3560233572316278, -0.3434609911301516, -0.33227104061782753, -0.32232838871779, -0.31351417364735423, -0.3057165240446035, -0.29883105841327173, -0.292761170084034, -0.2874181215469326, -0.28272097394272033, -0.27859637863097475, -0.27497825798089626, -0.27180740184394814, -0.2690310046336003, -0.26660216569025796, -0.26447937282839995 ], [ -1.772895001607993, -1.760577330519923, -1.740128760375772, -1.7119280847202034, -1.676538622789114, -1.634673167740058, -1.5871528972771514, -1.5348652403111025, -1.4787246677292183, -1.4196389516707577, -1.3584820777610451, -1.2960739497923333, -1.2331663568559181, -1.1704343268608899, -1.1084718755036036, -1.0477911872901768, -0.9888243673213192, -0.9319270343709944, -0.8773831609861518, -0.825410691281502, -0.7761675759846844, -0.7297579556291414, -0.6862382972876915, -0.645623349515483, -0.6078918261511103, -0.5729917642466835, -0.5408455265030759, -0.5113544358934508, -0.48440304125790457, -0.45986301900865234, -0.43759671902769853, -0.417460363547745, -0.39930690729641705, -0.3829885662850774, -0.36835902197226783, -0.35527530756214265, -0.3435993841454368, -0.3331994163043288, -0.3239507595709, -0.31573667551171813, -0.30844879388208557, -0.3019873448864546, -0.2962611877375636, -0.29118766411631125, -0.28669230657047995, -0.2827084322294837, -0.27917665143999293, -0.27604431913093297, -0.2732649540654114, -0.27079764785655536 ], [ -1.850323363756955, -1.8377030187125247, -1.81624304815568, -1.7863775306994196, -1.7487529335829461, -1.7041829677917533, -1.6535971099562756, -1.5979895894127574, -1.5383737181799761, -1.4757442184626604, -1.4110483505274805, -1.3451654095534005, -1.2788935015873497, -1.2129422680666662, -1.1479302414524166, -1.0843856561461533, -1.0227497287215301, -0.9633816147345674, -0.9065644245089962, -0.8525118294552615, -0.8013749128393872, -0.7532490167684827, -0.7081804138408478, -0.6661726908075483, -0.6271927757633793, -0.5911765724687219, -0.5580341876689596, -0.5276547516980777, -0.4999108409729152, -0.47466251476311944, -0.4517609792519526, -0.4310518906116606, -0.4123783066545829, -0.3955832944459585, -0.3805121997281218, -0.36701458354377686, -0.3549458322771535, -0.34416844946783876, -0.3345530410227052, -0.32597900953873826, -0.31833497793687715, -0.3115189670321238, -0.3054383555778434, -0.30000965433572646, -0.29515812755541915, -0.2908172957477355, -0.28692835278836204, -0.2834395283073484, -0.2803054232170539, -0.2774863423879421 ], [ -1.911587895831481, -1.8987630587311535, -1.8764823251851244, -1.8452356090405502, -1.8057518598156554, -1.758942225790613, -1.7058373721044209, -1.6475277655394909, -1.585112452784415, -1.5196586719525378, -1.4521723651658038, -1.3835783923108373, -1.3147087357867175, -1.2462969349441366, -1.178977166448714, -1.1132866487185404, -1.0496703176008464, -0.9884869616646221, -0.930016207418333, -0.8744659073314337, -0.8219796112940698, -0.7726439008513364, -0.7264954406540706, -0.6835276577120304, -0.6436969999790483, -0.606928754568479, -0.5731224249588238, -0.5421566779745668, -0.5138938769064189, -0.4881842184514535, -0.46486948961787833, -0.44378645759858143, -0.4247699019456855, -0.40765529505785547, -0.39228113469427606, -0.3784909313985079, -0.3661348545616637, -0.355071043358775, -0.345166592727412, -0.3362982295260736, -0.32835269949594204, -0.32122689108409097, -0.3148277270147739, -0.30907185824248196, -0.3038851972407557, -0.2992023282912851, -0.2949658315256479, -0.2911255550808334, -0.28763786612614384, -0.2844649070493862 ], [ -1.9524936925597962, -1.9395942884064146, -1.9167784739659643, -1.8845861187894077, -1.8438180906493717, -1.7954674104162727, -1.740646131280488, -1.6805185426769191, -1.6162462881941502, -1.5489469158709883, -1.4796649449391746, -1.409353453727272, -1.3388639502572315, -1.2689424602258441, -1.200230098004036, -1.133266740926224, -1.068496746939444, -1.0062759218662585, -0.9468791547754629, -0.8905083050510547, -0.8373000512049366, -0.7873335071983512, -0.740637483583622, -0.6971973233205355, -0.6569612796570881, -0.6198464291021416, -0.5857441287386674, -0.554525035987395, -0.5260437122021823, -0.5001428307305202, -0.476657006715703, -0.4554162612120132, -0.43624912723035764, -0.4189854010447536, -0.4034585391746333, -0.38950770038290594, -0.3769794330118027, -0.36572901097940724, -0.3556214265027454, -0.3465320536205807, -0.3383470032404978, -0.3309631970432799, -0.32428819347139337, -0.3182398036309122, -0.3127455378302081, -0.307741924445603, -0.3031737418345558, -0.29899320129171836, -0.2951591148919873, -0.29163607690969207 ], [ -1.969452082385159, -1.9566420192158407, -1.9336794124043437, -1.901138142795566, -1.8598660999788275, -1.810906789017948, -1.7554190112230272, -1.694606184890283, -1.6296602887616178, -1.5617208819093444, -1.49184739415081, -1.4210021341147527, -1.3500414919251398, -1.2797131573788967, -1.2106575956833499, -1.1434124182508993, -1.0784186203520136, -1.016027925744016, -0.9565106877475706, -0.9000639569422887, -0.8468194476797732, -0.7968512273835732, -0.7501830207742274, -0.7067950708290973, -0.666630533356086, -0.6296014055402052, -0.5955940031166918, -0.564474007934201, -0.5360911093318039, -0.5102832605192118, -0.4868805664357572, -0.4657088136540515, -0.4465926469276452, -0.4293583919239118, -0.41383652029127327, -0.39986375199787216, -0.3872847910899891, -0.375953694611585, -0.3657348800852885, -0.3565037841250946, -0.34814719270342454, -0.34056327151485966, -0.3336613319648041, -0.3273613738738089, -0.3215934495292838, -0.3162968949783175, -0.31141947343412535, -0.30691647258879295, -0.3027497928876348, -0.29888705793362225 ], [ -1.9601489099449603, -1.9476202008005603, -1.9249853794121659, -1.8928243643172238, -1.8519914393767596, -1.8035336937864557, -1.7486093034363415, -1.6884170833445444, -1.6241415179623004, -1.556913043074974, -1.4877814090740795, -1.4176994578397963, -1.3475148058310387, -1.277967316485989, -1.209690670432265, -1.1432167257899186, -1.0789816806429535, -1.017333305685297, -0.9585387152972853, -0.9027922998341201, -0.8502235599316352, -0.8009046728478046, -0.7548576873563363, -0.712061292214326, -0.6724571373899604, -0.6359557099247692, -0.6024417798380624, -0.5717794378147039, -0.5438167472692699, -0.5183900303068977, -0.4953278015405283, -0.4744543569981738, -0.45559301865722623, -0.4385690295091282, -0.4232120903180744, -0.4093585279729619, -0.3968530868333533, -0.3855503387119492, -0.37531571377532796, -0.3660261630555592, -0.3575704726091386, -0.34984925868668015, -0.34277468164595193, -0.3362699229396249, -0.33026847375123125, -0.3247132854392969, -0.3195558308829597, -0.3147551223764974, -0.31027672637482195, -0.30609180874824915 ], [ -1.924214661891591, -1.9121680381050947, -1.8903672889370213, -1.8593626345040821, -1.819965033122667, -1.7731706722750324, -1.7200848545184617, -1.6618557636585658, -1.5996221240805122, -1.5344747735049395, -1.4674303657644565, -1.399414894277923, -1.331254799750503, -1.2636737267958646, -1.1972933489779127, -1.132637016401399, -1.0701352683106384, -1.010132490339199, -0.9528941859724271, -0.8986144812049214, -0.8474235973412904, -0.7993951156891747, -0.7545529247656015, -0.7128777898059848, -0.6743135192079057, -0.63877272578814, -0.6061421946405668, -0.576287875891661, -0.5490595214815028, -0.524294981829875, -0.5018241723511354, -0.48147271263292035, -0.4630652339555121, -0.446428344817647, -0.4313932401719321, -0.4177979388264675, -0.40548913529719827, -0.39432365730554897, -0.3841695277532431, -0.37490663968260146, -0.3664270634999899, -0.358635016515296, -0.3514465345451326, -0.34478889300019955, -0.33859982984934, -0.33282662478225344, -0.3274250877906979, -0.3223585065809671, -0.31759659628136394, -0.3131144875147587 ], [ -1.8635783928066239, -1.8521924106600838, -1.8316775684272244, -1.8025227699438457, -1.7654519056404843, -1.7213625494286644, -1.671261446600485, -1.616205786403187, -1.5572547209050573, -1.4954322376774765, -1.4317006150965197, -1.3669428810574473, -1.3019525030650687, -1.2374286458587387, -1.1739755621652783, -1.112104940462126, -1.0522402778311855, -0.9947225591214721, -0.9398167015748043, -0.8877183684813593, -0.8385608702301606, -0.7924219607092586, -0.7493304055325819, -0.7092722496378999, -0.67219674846776, -0.6380219517850532, -0.6066399443813332, -0.5779217554291455, -0.5517219497403418, -0.5278829113233535, -0.5062388238948409, -0.4866193458248268, -0.46885296971578666, -0.4527700506417664, -0.43820548302506607, -0.425001004972431, -0.4130071110711708, -0.40208456021542055, -0.39210547364120296, -0.3829540292573755, -0.37452677052235095, -0.3667325603137067, -0.3594922212396845, -0.3527379125779564, -0.34641229972734877, -0.34046757433816766, -0.33486438216724446, -0.32957071156476636, -0.3245607889871238, -0.31981401983548563 ], [ -1.7821916146362209, -1.771594892236528, -1.7526861787721906, -1.7258769992575465, -1.691780484549596, -1.651167545747877, -1.604917075677081, -1.553967109771608, -1.4992717114376792, -1.4417659024246587, -1.3823390939633495, -1.3218163688551037, -1.2609464564868547, -1.2003951088329237, -1.1407426517220063, -1.0824846414169336, -1.026034739533517, -0.9717290976850917, -0.9198317026865066, -0.8705402687869823, -0.823992375005807, -0.7802716350932359, -0.739413757557713, -0.7014124063200838, -0.6662248114346713, -0.6337771062610726, -0.6039693845379548, -0.5766804798592591, -0.551772472793536, -0.5290949289265376, -0.5084888659811202, -0.48979044135223915, -0.4728343442908703, -0.4574568708717979, -0.44349865590844595, -0.4308070350036144, -0.41923801247982656, -0.40865781713440513, -0.39894403727584093, -0.389986338544407, -0.3816867814709522, -0.3739597692440534, -0.366731668375669, -0.3599401546896826, -0.3535333434503531, -0.3474687650755489, -0.3417122467729664, -0.33623675602653313, -0.33102125486661504, -0.32604960516005876 ], [ -1.6851721633161345, -1.6754339120819097, -1.6582933303667189, -1.634085714572989, -1.6033125023462436, -1.5666129484501978, -1.5247287195074277, -1.4784659459114242, -1.4286589986992217, -1.3761389181583188, -1.3217079061827788, -1.2661201218286915, -1.210068300397788, -1.154175367074835, -1.0989901111056266, -1.0449860210476443, -0.992562484580706, -0.9420476845796704, -0.8937026526933668, -0.8477260605192918, -0.804259431481751, -0.7633925423418725, -0.7251688524369413, -0.6895908526919109, -0.6566252669292982, -0.6262080668519517, -0.598249281063312, -0.5726375893176863, -0.5492446974779512, -0.5279294879638836, -0.5085419363264756, -0.49092677847580524, -0.4749269064705041, -0.460386465007921, -0.4471536170457156, -0.43508294630331257, -0.42403746735505704, -0.41389022081750754, -0.40452544144072167, -0.3958392999428314, -0.3877402339850495, -0.38014889833506194, -0.37299777754062907, -0.3662305150428672, -0.35980101967226497, -0.35367241343406747, -0.34781588344098924, -0.3422094962619623, -0.336837025610378, -0.33168683514289965 ], [ -1.5778104703162317, -1.5689496371808178, -1.553606292785374, -1.5320507660061093, -1.5046865791980388, -1.4720331059828484, -1.4347018242799252, -1.3933685768676605, -1.3487449583333215, -1.301551569183689, -1.2524949506252292, -1.202249052885616, -1.1514413522028977, -1.1006432670505093, -1.0503642866517469, -1.0010491445436638, -0.9530773853528458, -0.9067647393297146, -0.862365807399429, -0.820077651993911, -0.7800439760010589, -0.7423596489737371, -0.7070754043733672, -0.6742025838303839, -0.6437178448311602, -0.6155677779834499, -0.5896734003750697, -0.5659345039155079, -0.5442338433648479, -0.5244411494535992, -0.5064169495406876, -0.49001617311395423, -0.47509151356590335, -0.46149651247874174, -0.44908832939815646, -0.4377301598039449, -0.4272932673904363, -0.4176586040907834, -0.4087180022380226, -0.40037493705540694, -0.3925448730786092, -0.3851552236353403, -0.37814496659912955, -0.37146397093401035, -0.365072096076276, -0.3589381294773656, -0.3530386267001785, -0.34735671381861544, -0.341880904343995, -0.3366039734887565 ], [ -1.4648641904021908, -1.4568658405148218, -1.4432622595697402, -1.4242721843005413, -1.4002195591047224, -1.3715229091940375, -1.3386798008031011, -1.3022473894090778, -1.2628209567764461, -1.2210125188575511, -1.1774312078129487, -1.1326665198853607, -1.0872749275452913, -1.041769898274077, -0.996615066901285, -0.9522201499768663, -0.9089391317121377, -0.8670702562976631, -0.8268574034485227, -0.7884924836246291, -0.7521185540736035, -0.717833419127887, -0.6856935338968869, -0.6557180776423376, -0.6278931010794272, -0.6021756807931826, -0.5784980345674746, -0.5567715646446724, -0.53689080289236, -0.5187372337904284, -0.5021829693929701, -0.48709424635384063, -0.4733347101519213, -0.46076844720990306, -0.44926272296154146, -0.43869038416558254, -0.42893188762933154, -0.41987692527539433, -0.4114256269148282, -0.40348933639588963, -0.3959909727441572, -0.3888650039770382, -0.3820570758875611, -0.3755233498564116, -0.3692296116617633, -0.36315021681798737, -0.3572669372266566, -0.35156776937460665, -0.34604575680771554, -0.3406978701615748 ], [ -1.3502511351044761, -1.343080265682257, -1.3311121097887373, -1.3145252400736567, -1.2935808414074605, -1.2686159159539279, -1.2400330368789847, -1.2082869352772907, -1.173868923730124, -1.1372905199577745, -1.0990675970589836, -1.0597060912796956, -1.019689910988685, -0.979471329100092, -0.9394638616780149, -0.9000374496927881, -0.8615156572983199, -0.8241745586389637, -0.7882429860536575, -0.7539038390002304, -0.721296192664054, -0.690517989457198, -0.6616291399037877, -0.634654898417434, -0.6095894124364039, -0.5863993695704248, -0.5650276868045712, -0.5453971988343951, -0.527414310016947, -0.5109725771789477, -0.49595618975500194, -0.48224331068687704, -0.46970923752885424, -0.45822933961702256, -0.447681725239527, -0.43794959356463725, -0.42892323039515234, -0.42050161492729043, -0.41259361638021647, -0.40511877387428363, -0.39800766906216123, -0.3912019172589819, -0.38465381761462414, -0.37832571483942123, -0.3721891331302685, -0.3662237467477234, -0.36041625119772197, -0.35475919467080386, -0.3492498221185235, -0.343888975105485 ], [ -1.2370144492081265, -1.230624717401526, -1.2201659772660696, -1.2057853488439099, -1.1876947081387932, -1.1661660810214345, -1.1415246979707443, -1.1141397115038538, -1.0844130512853345, -1.0527672254677654, -1.0196329832689, -0.9854376620343412, -0.9505948345576308, -0.9154956309471438, -0.8805018895729124, -0.8459411207739642, -0.8121031512305142, -0.779238250455614, -0.7475565130393508, -0.7172282696796187, -0.6883853166352226, -0.6611227791351413, -0.6355014536981024, -0.611550503314343, -0.5892704055154052, -0.5686360750890667, -0.549600099954219, -0.5320960404307336, -0.516041749170809, -0.5013426720166466, -0.4878950899058363, -0.47558925973096056, -0.46431240896542636, -0.45395153613403877, -0.4443959680270472, -0.4355396259550171, -0.4272829580432018, -0.41953450287054816, -0.41221206146946915, -0.4052434691029609, -0.39856697417128406, -0.39213124763585216, -0.3858950609836071, -0.37982668265642155, -0.3739030510632113, -0.3681087862849024, -0.36243510239102483, -0.3568786783769366, -0.3514405388932073, -0.34612498713604267 ], [ -1.1274100465516497, -1.121748794822302, -1.112665849054349, -1.1002833409007229, -1.0847741100667674, -1.0663584119209484, -1.0452990491110508, -1.0218948498985796, -0.9964726987737348, -0.9693785703845192, -0.9409681513261403, -0.9115976424294344, -0.881615246252472, -0.8513537053353105, -0.8211241066883876, -0.7912110340211527, -0.7618690448181529, -0.7333203777072513, -0.7057537536135318, -0.6793241160481649, -0.654153154954529, -0.6303304687657307, -0.6079152357238041, -0.5869382842631989, -0.5674044706611933, -0.5492952884268172, -0.5325716470047404, -0.5171767668635299, -0.5030391439253219, -0.4900755389413543, -0.47819394747260663, -0.4672965044655094, -0.4572822750425327, -0.44804988115653055, -0.43949991326266946, -0.43153707807669195, -0.4240720384754792, -0.41702290992990876, -0.4103163893499526, -0.4038885062006879, -0.39768500114005617, -0.3916613528982519, -0.385782488265119, -0.38002222162618987, -0.37436247857091015, -0.36879236221303097, -0.36330712101059637, -0.35790707346896444, -0.35259653888050285, -0.3473828150930134 ], [ -1.0230303745583584, -1.018041609151767, -1.010200831390156, -0.9996100232009146, -0.9864107882509624, -0.9707819051985166, -0.9529358111778303, -0.9331139349415813, -0.9115809603722291, -0.8886182633665102, -0.8645168787295429, -0.8395703968766792, -0.8140681672808059, -0.7882891166127944, -0.7624963982615105, -0.7369329966002572, -0.7118183274346523, -0.6873458122386592, -0.6636813596042987, -0.6409626610671546, -0.6192991967434115, -0.5987728451430179, -0.5794389974196008, -0.5613280860406005, -0.5444474489441509, -0.5287834608972388, -0.5143038727940832, -0.5009603063668737, -0.4886908559925925, -0.4774227511029435, -0.4670750325719201, -0.4575611950386317, -0.4487917452659828, -0.4406766252759583, -0.4331274490726872, -0.4260595040784705, -0.4193934735397198, -0.4130568443370791, -0.40698497566824543, -0.4011218173490769, -0.3954202810197504, -0.38984228213546457, -0.384358483995653, -0.3789477860836165, -0.37359660680479534, -0.36829801487781133, -0.36305076412428905, -0.3578582835791871, -0.35272766934630884, -0.3476687172586005 ], [ -0.9249286048395174, -0.9205549211040125, -0.913826846214157, -0.9048299075128488, -0.8936804559115955, -0.8805238013755534, -0.8655316149797349, -0.8488985341910893, -0.8308379980676992, -0.811577440696587, -0.7913530547299187, -0.7704043840135123, -0.7489690107326155, -0.7272775748143008, -0.7055493135965551, -0.6839882507158297, -0.6627801051124925, -0.6420899407938342, -0.6220605388800773, -0.6028114461693194, -0.5844386379179867, -0.567014724736534, -0.550589632113343, -0.5351916838457424, -0.5208290256165039, -0.5074913305488806, -0.49515173367102444, -0.483768946099217, -0.47328950206046466, -0.46365009260139356, -0.45477993923925286, -0.44660315940286816, -0.4390410739598905, -0.4320144062024844, -0.4254453221434959, -0.41925926453700335, -0.4133865381519866, -0.40776361166600006, -0.4023341119169317, -0.39704949859668254, -0.39186942091890464, -0.38676177126994477, -0.3817024632348727, -0.3766749716681735, -0.37166967989308614, -0.3666830832494057, -0.36171689902259074, -0.35677713057072064, -0.3518731287710469, -0.3470166874380214 ], [ -0.8337307177897932, -0.8299146665257664, -0.8241763138079803, -0.8165876144109329, -0.8072443234457978, -0.7962645544523097, -0.7837868318075258, -0.7699675922041073, -0.7549781397592634, -0.7390011212220271, -0.7222266449253276, -0.7048482068518682, -0.6870586035705943, -0.6690460055494075, -0.6509903406126692, -0.6330601031178622, -0.615409666588271, -0.5981771414126719, -0.5814827882610216, -0.5654279737193282, -0.5500946375574868, -0.535545230304764, -0.5218230741914924, -0.5089530986060646, -0.4969429016367829, -0.4857840908233008, -0.4754538579934853, -0.46591674435681024, -0.45712655250215806, -0.4490283615180677, -0.44156060027568445, -0.43465713235622716, -0.4282493046899714, -0.42226791131720764, -0.41664502440712864, -0.41131564731921044, -0.4062191494286091, -0.40130044977343815, -0.3965109261243712, -0.3918090373246878, -0.38716065893877033, -0.38253914444891735, -0.37792513548314766, -0.3733061539635993, -0.36867601597034433, -0.3640341111422477, -0.35938459252317434, -0.35473552013796045, -0.35009799770452277, -0.3454853363536714 ], [ -0.7497321552128753, -0.7464172833448526, -0.7415534501465226, -0.7352013279600693, -0.7274397528052365, -0.7183646007309266, -0.7080873168033192, -0.6967330652618744, -0.6844384967139083, -0.6713491653933243, -0.6576166671907081, -0.6433955992392872, -0.6288404593019844, -0.6141026066711651, -0.599327397387884, -0.5846515887396533, -0.5702010852135739, -0.5560890740282117, -0.5424145758356383, -0.529261416929313, -0.5166976141073143, -0.5047751522616941, -0.4935301273213004, -0.4829832226121584, -0.47314048416419247, -0.46399435917006693, -0.4555249610020629, -0.44770152340559366, -0.4404840054071627, -0.43382480700312526, -0.427670553934322, -0.4219639080731386, -0.4166453585571461, -0.41165494827589455, -0.4069338911397236, -0.40242603814592026, -0.398079154875545, -0.39384597975971175, -0.3896850410539655, -0.3855612205090733, -0.3814460625697998, -0.37731783877919645, -0.3731613870916838, -0.368967754257927, -0.3647336757650799, -0.36046093166161525, -0.3561556178921803, -0.3518273716854526, -0.34748858644332403, -0.3431536469665456 ], [ -0.6729791610103183, -0.6701108363880647, -0.6660147818537698, -0.6607422355134972, -0.6543580531209546, -0.6469398300570444, -0.6385767891719563, -0.6293684122407477, -0.6194228074964828, -0.6088548277422982, -0.5977839778459728, -0.5863321720072171, -0.5746214163856724, -0.5627714997001028, -0.5508977732995002, -0.5391090943618277, -0.5275059934118367, -0.5161791125160073, -0.5052079452771828, -0.494659895570382, -0.48458965972174955, -0.47503892690405153, -0.46603638487034654, -0.4575980124680554, -0.4497276362199108, -0.4424177251391898, -0.4356503954194112, -0.4293985943560423, -0.4236274306050546, -0.4182956155930044, -0.41335697864567517, -0.4087620164080031, -0.4044594356980381, -0.40039764843904585, -0.3965261781137706, -0.3927969395884651, -0.3891653583447903, -0.38559130114589396, -0.38203979775953884, -0.37848154217679336, -0.3748931712430143, -0.37125732809706696, -0.3675625266090316, -0.3638028404926106, -0.3599774464608106, -0.3560900543978214, -0.3521482589542519, -0.3481628463569413, -0.3441470878438636, -0.34011604738694134 ], [ -0.6033361345968226, -0.6008622078159712, -0.5974359509283665, -0.5931006781605723, -0.5879096379926084, -0.5819253279043927, -0.5752186582933879, -0.5678679490077825, -0.5599577494183157, -0.5515774857723312, -0.5428199550065604, -0.5337796992530445, -0.5245513074378338, -0.515227698047847, -0.5058984397751729, -0.49664816469058265, -0.4875551228100318, -0.47868991864216975, -0.4701144607851762, -0.4618811459291305, -0.45403228947645125, -0.44659980686854706, -0.4396051427766469, -0.43305943954287407, -0.4269639314711979, -0.4213105475301014, -0.416082701499291, -0.4112562453765153, -0.40680055884035593, -0.40267974472027607, -0.39885389783748676, -0.39528041242241246, -0.3919152918303237, -0.38871442374525655, -0.3856347847560755, -0.382635540324241, -0.379679009856444, -0.37673147182400113, -0.37376379045398517, -0.37075185311765596, -0.3676768156939367, -0.36452516134329305, -0.36128858572669664, -0.35796372823155304, -0.354551773816385, -0.35105795340441626, -0.3474909722579299, -0.34386239552893894, -0.3401860184230251, -0.3364772454451338 ], [ -0.5405406315256269, -0.538411961902514, -0.5355663192446206, -0.5320403406516168, -0.5278775992973226, -0.5231280723729291, -0.5178475212440012, -0.5120967705126369, -0.5059408758693401, -0.49944817775461714, -0.49268924747737436, -0.48573574278139875, -0.4786591992346975, -0.471529790971574, -0.4644150985379869, -0.45737892273183905, -0.4504801816947124, -0.4437719246871953, -0.4373004906684011, -0.4311048336809487, -0.42521603068150265, -0.4196569812613265, -0.4144423029152439, -0.40957842024296237, -0.40506384170075543, -0.40088961319889405, -0.3970399338742559, -0.3934929156864881, -0.3902214650590401, -0.38719426164110915, -0.38437680649477335, -0.38173250976480927, -0.3792237863616093, -0.3768131275935156, -0.3744641172228219, -0.3721423622388458, -0.36981631180732566, -0.367457942323263, -0.36504329209601094, -0.3625528356431217, -0.3599716944772442, -0.35728968819222245, -0.3545012361324811, -0.35160512554495577, -0.34860416653095294, -0.3455047571195, -0.34231638329001024, -0.3390510788268327, -0.3357228686497603, -0.33234721697359837 ], [ -0.48424759843466675, -0.4824184600119256, -0.4800728980586301, -0.4772419100007957, -0.4739609773908299, -0.47026965693881634, -0.4662111328240793, -0.4618317185971494, -0.4571802975055375, -0.4523076936217838, -0.4472659719753096, -0.4421076729395569, -0.4368849932879632, -0.4316489326369679, -0.42644842875130434, -0.42132950803668745, -0.41633447843461874, -0.41150119104788424, -0.4068623944936165, -0.4024452025928907, -0.39827069193902276, -0.3943536414610795, -0.3907024215549879, -0.3873190358510917, -0.3841993143145628, -0.38133325217611774, -0.3787054851840136, -0.37629588787212415, -0.3740802779896483, -0.3720312070031109, -0.3701188137648569, -0.3683117161819167, -0.3665779141749076, -0.36488567655272547, -0.3632043847900062, -0.36150530818007737, -0.35976228747689043, -0.35795230787820204, -0.3560559468868859, -0.354057687974425, -0.3519460967437422, -0.3497138620865886, -0.3473577102847961, -0.34487820477657594, -0.3422794481253365, -0.3395687054062615, -0.33675596968516175, -0.3338534905275653, -0.3308752856561865, -0.32783665415311003 ], [ -0.434064256877475, -0.43249263562415424, -0.43057498615643736, -0.4283375350194823, -0.4258089781184639, -0.4230201717097571, -0.4200038239495372, -0.4167941758502901, -0.4134266592347528, -0.4099375204733143, -0.40636340209700994, -0.4027408791704711, -0.39910595282993966, -0.3954935088921639, -0.39193675429104496, -0.388466647855591, -0.38511134436465416, -0.38189567184670054, -0.3788406618263624, -0.3759631508363983, -0.3732754692401703, -0.37078523047632506, -0.36849523045210647, -0.366403463147188, -0.36450325468179695, -0.3627835142554141, -0.3612290965607839, -0.3598212666000617, -0.35853825435874587, -0.35735588362449383, -0.3562482564849385, -0.3551884728287516, -0.3541493626418596, -0.3531042081641578, -0.3520274331567206, -0.3508952376899426, -0.34968615900689004, -0.3483815420818789, -0.3469659073474124, -0.3454272074997098, -0.3437569700565014, -0.3419503271403037, -0.3400059385010519, -0.3379258178022432, -0.33571507545290624, -0.3333815936205926, -0.3309356504344705, -0.32838951078824385, -0.3257570006574828, -0.323053080588635 ], [ -0.38957685834378947, -0.388224649658114, -0.3866707231331865, -0.38493726558309893, -0.383047270417977, -0.3810243106992738, -0.3788923450533946, -0.3766755451078963, -0.3743981305543773, -0.37208419753018934, -0.36975752762822334, -0.36744136811453304, -0.3651581783157159, -0.36292934202596766, -0.3607748506008728, -0.3587129656734047, -0.3567598738068284, -0.3549293476959021, -0.3532324296821009, -0.3516771534063234, -0.3502683185012143, -0.3490073314826604, -0.3478921236073004, -0.3469171535872482, -0.34607349984790425, -0.3453490436164217, -0.3447287406599724, -0.3441949760685228, -0.3437279932076125, -0.34330638496569754, -0.3429076328046101, -0.34250867700898535, -0.34208650003583985, -0.34161870409046224, -0.34108406407696046, -0.34046303793202304, -0.33973821804271964, -0.3388947099128602, -0.3379204273610412, -0.3368062971387795, -0.3355463697406652, -0.3341378371083694, -0.3325809616717147, -0.3308789245062832, -0.3290376031390241, -0.32706529157406306, -0.3249723763736152, -0.32277098310842844, -0.3204746072394309, -0.31809774260378265 ], [ -0.3503703683452202, -0.34920348269853785, -0.3479566068631196, -0.3466485055066183, -0.3452973733644631, -0.34392067637985924, -0.3425350528944028, -0.3411562628684328, -0.3397991695170586, -0.3384777361763308, -0.3372050216805208, -0.33599315980073297, -0.3348533119443047, -0.33379558681551336, -0.33282892554301635, -0.33196095539046144, -0.3311978191859717, -0.33054399075894947, -0.33000208880917625, -0.3295727027140595, -0.3292542438521826, -0.3290428351915411, -0.328932250300494, -0.32891391074493037, -0.32897694819415135, -0.3291083346217989, -0.3292930808988176, -0.32951450096576607, -0.329754535767648, -0.3299941283560819, -0.3302136391267064, -0.330393288173078, -0.33051361030066495, -0.33055590743756047, -0.33050268305990915, -0.33033804384509613, -0.3300480550611663, -0.3296210381404442, -0.3290478013696968, -0.3283217975204278, -0.3274392053734523, -0.32639893527716113, -0.32520256193256214, -0.32385419034801544, -0.32236026320848965, -0.32072931965328044, -0.318971716593364, -0.31709932421276577, -0.3151252072192994, -0.3130633028069054 ], [ -0.31604202029777606, -0.31503040360768897, -0.3140409100272443, -0.3130894050664721, -0.3121900442077157, -0.3113551710325003, -0.31059529866426083, -0.30991916148297327, -0.3093338195936818, -0.30884479608160464, -0.30845622676106255, -0.30817100376282747, -0.30799089753512443, -0.3079166461576903, -0.3079480057393621, -0.3080837605685345, -0.3083216961758424, -0.3086585422260619, -0.30908989498009143, -0.30961013087010714, -0.310212323517713, -0.31088817637222743, -0.3116279821763044, -0.3124206188261277, -0.3132535890406547, -0.314113108744952, -0.3149842463562512, -0.3158511123781408, -0.31669709598877027, -0.31750514277352193, -0.3182580655120104, -0.3189388780823261, -0.31953114117711623, -0.3200193077028466, -0.32038905549879704, -0.3206275953814406, -0.32072394347631183, -0.32066914829308624, -0.3204564649469992, -0.3200814712187159, -0.31954212264099746, -0.3188387463575879, -0.3179739759702108, -0.31695263183673994, -0.31578155319184875, -0.3144693899447195, -0.3130263630148863, -0.3114640025813089, -0.3097948736593046, -0.30803229803207155 ], [ -0.28620961547344315, -0.2853271894687931, -0.2845518672948667, -0.2838970588467379, -0.2833735236281002, -0.28298931681866435, -0.28274983866023795, -0.28265797289026484, -0.28271429469756104, -0.2829173255365345, -0.28326381126518385, -0.28374900133913183, -0.28436690983952784, -0.2851105434294464, -0.2859720863539922, -0.2869430377770984, -0.28801430161546737, -0.28917623323380026, -0.2904186506764085, -0.29173082041697596, -0.2931014288979067, -0.2945185514652674, -0.2959696297976723, -0.29744146771986013, -0.2989202535394405, -0.3003916149050678, -0.3018407098065694, -0.30325235486292157, -0.3046111896010115, -0.30590187313292616, -0.30710930759504496, -0.3082188810070916, -0.30921672091652463, -0.3100899493673923, -0.31082692940639645, -0.31141749352112014, -0.31185314507937323, -0.3121272249604634, -0.3122350370698739, -0.31217392821739587, -0.3119433198079945, -0.31154469082858816, -0.3109815135959605, -0.31025914555281986, -0.3093846819680002, -0.30836677564241255, -0.30721543059998835, -0.3059417772350602, -0.3045578365031284, -0.3030762805121787 ], [ -0.2605154306462062, -0.2597399574259186, -0.25914149087320393, -0.2587313616295053, -0.25851748314009404, -0.2585043380058336, -0.2586930846677181, -0.2590817688514989, -0.2596656182540593, -0.2604373952660045, -0.26138778128208173, -0.26250576722799757, -0.2637790279527942, -0.265194262561659, -0.2667374879927097, -0.2683942785935082, -0.2701499496354228, -0.27198968724403805, -0.2738986308806348, -0.2758619171641561, -0.27786469545821957, -0.279892126322869, -0.28192937375729543, -0.28396160127860237, -0.2859739804469452, -0.2879517186138878, -0.2898801105866191, -0.29174461670243224, -0.29353096761879693, -0.2952252940532437, -0.2968142778481492, -0.29828531916686185, -0.2996267134116868, -0.30082783063569285, -0.3018792898245096, -0.3027731204562385, -0.30350290419096804, -0.30406389035878334, -0.3044530800496662, -0.3046692749869575, -0.30471308890262194, -0.3045869207355901, -0.3042948905518451, -0.3038427405507437, -0.30323770480223555, -0.3024883523964861, -0.301604409442751, -0.30059656581058813, -0.29947627266607046, -0.2982555367388212 ], [ -0.23862661988686573, -0.23793949465226572, -0.23748589803845466, -0.2372754006881167, -0.23731354468303278, -0.23760186340852008, -0.23813803577047887, -0.23891615795217314, -0.23992710936017103, -0.2411589852910918, -0.24259756735960558, -0.24422680372966799, -0.24602927427750265, -0.2479866204065715, -0.25007992468853324, -0.2522900312078471, -0.2545978029259104, -0.2569843171701407, -0.25943100425024235, -0.26191973709135097, -0.26443288163917544, -0.2669533186994214, -0.2694644479370002, -0.2719501841219879, -0.27439495452222984, -0.27678370475923375, -0.27910191860809075, -0.28133565526450965, -0.28347160563852347, -0.2854971673654174, -0.28740053653455533, -0.28917081269498246, -0.2907981125559497, -0.29227368699736433, -0.29359003555940244, -0.29474101249437956, -0.2957219187226122, -0.29652957460576856, -0.29716236928947315, -0.2976202834126155, -0.29790488316582375, -0.2980192849331089, -0.29796809099595356, -0.29775729794987327, -0.2973941805204168, -0.29688715432161117, -0.29624562174253566, -0.29547980556018216, -0.2946005750574203, -0.29361926938609983 ], [ -0.2202330419385632, -0.21961901906721348, -0.21928308085619175, -0.21923330850618672, -0.21947328621739637, -0.2200021483275214, -0.2208147716556642, -0.22190209519777138, -0.2232515423133452, -0.22484751610424547, -0.22667193703341149, -0.22870479281527656, -0.230924673788933, -0.23330927173926674, -0.2358358257796077, -0.23848150481180797, -0.24122372170476203, -0.24404037929164257, -0.24691005233820384, -0.24981211266969017, -0.25272680665740355, -0.2556352953288099, -0.25851966759594824, -0.2613629366400966, -0.26414902849844, -0.26686277051999374, -0.26948988573166066, -0.2720169974051344, -0.27443164634951844, -0.2767223217646809, -0.27887850495230704, -0.28089072385549774, -0.2827506153286037, -0.2844509912568911, -0.28598590416584657, -0.28735070778324356, -0.2885421081300872, -0.28955820109274677, -0.29039849302984555, -0.29106390174614927, -0.29155673606748767, -0.29188065321789836, -0.2920405941749247, -0.29204269810714933, -0.29189419783195025, -0.2916032989327838, -0.29117904571652786, -0.2906311775569268, -0.2899699793559877, -0.28920612986810523 ], [ -0.20504348073011813, -0.2044903412417851, -0.20424908638032047, -0.2043265368960201, -0.20472468172998803, -0.205440746520011, -0.20646741477552566, -0.2077931831510792, -0.20940282492469164, -0.21127793113468007, -0.21339749707141187, -0.21573852279679395, -0.2182765996065522, -0.22098645920827287, -0.22384246815490405, -0.2268190560907729, -0.22989107209516946, -0.23303406845824437, -0.23622451535891986, -0.2394399530327883, -0.2426590901226069, -0.24586185807201888, -0.2490294317772086, -0.25214422639625056, -0.25518987938278426, -0.25815122560433146, -0.26101427195906424, -0.2637661763351581, -0.26639523416459654, -0.2688908742918953, -0.27124366447558745, -0.2734453256188424, -0.27548875282383833, -0.27736804060721987, -0.27907850911318555, -0.28061672791621894, -0.2819805340053916, -0.28316904076446214, -0.2841826351753225, -0.2850229610384173, -0.2856928866790224, -0.2861964563467869, -0.2865388252717893, -0.286726179070279, -0.28676563885900375, -0.28666515400719683, -0.2864333849067644, -0.2860795784597677, -0.28561343916264825, -0.28504499871186584 ], [ -0.19278121861580522, -0.19227939138080297, -0.1921135693676228, -0.19228950644269582, -0.19280791524364704, -0.19366455142408545, -0.1948504544756552, -0.19635232626349963, -0.19815302094418008, -0.2002321151747104, -0.202566525696256, -0.20513114231818064, -0.20789944755993328, -0.21084409906824653, -0.2139374566999509, -0.21715204218385165, -0.22046092500881576, -0.22383803324397855, -0.22725839215006338, -0.23069829659174657, -0.23413542541781607, -0.23754890721841593, -0.24091934732037767, -0.24422882568618776, -0.24746087468696865, -0.25060044466535825, -0.2536338639171668, -0.2565487983117868, -0.2593342143336933, -0.2619803479375509, -0.2644786803282002, -0.26682192065039356, -0.26900399463466396, -0.27102003751593395, -0.2728663890300236, -0.27454058799928927, -0.276041363932111, -0.2773686231632463, -0.2785234273277135, -0.2795079623586707, -0.2803254966948934, -0.2809803279391331, -0.2814777177881971, -0.2818238156244097, -0.2820255716853107, -0.28209064118834315, -0.2820272811604011, -0.2818442419957442, -0.2815506559340607, -0.2811559247139537 ], [ -0.1831798376897098, -0.18272199149548485, -0.18261559604008426, -0.1828655017860472, -0.1834714250027183, -0.18442804245640743, -0.18572524301361282, -0.18734851747516024, -0.18927946053112865, -0.19149635396262898, -0.1939747983455662, -0.1966883613711241, -0.1996092140199085, -0.20270873056190064, -0.20595803399984036, -0.20932847447844838, -0.2127920338160908, -0.21632165430098582, -0.21989149400498098, -0.22347711401015902, -0.22705560512525746, -0.23060566296821738, -0.23410762082821412, -0.23754344963454233, -0.240896733792765, -0.2441526307350811, -0.24729782089240138, -0.2503204535343413, -0.2532100926269566, -0.25595766559698196, -0.25855541672064286, -0.2609968658159989, -0.26327677203922106, -0.2653911018850088, -0.26733699997751303, -0.2691127609097388, -0.27071780023784553, -0.27215262274658103, -0.27341878625237226, -0.2745188594760455, -0.27545637286966274, -0.27623576169199926, -0.2768623010653153, -0.2773420331844435, -0.2776816872627902, -0.27788859316756465, -0.277970590001988, -0.27793593112417014, -0.2777931872447513, -0.27755114931729286 ] ], "zauto": true, "zmax": 1.969452082385159, "zmin": -1.969452082385159 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.4496575830749375, 0.4484767794189959, 0.4473727893295806, 0.4463504369858882, 0.4454135486831855, 0.4445650712722823, 0.4438072362124741, 0.4431417549224824, 0.4425700275352259, 0.442093345059807, 0.44171306469047106, 0.44143073975375857, 0.4412481895002745, 0.4411674993352192, 0.4411909486323797, 0.44132087031486844, 0.4415594531524256, 0.4419085034698198, 0.44236918704290396, 0.44294177393290257, 0.44362540868702566, 0.44441792580763667, 0.44531572602094255, 0.44631372322585594, 0.44740536576217765, 0.4485827295123272, 0.4498366749719418, 0.4511570562652039, 0.45253296741268323, 0.4539530100445132, 0.45540556706576446, 0.4568790682621385, 0.45836223614262345, 0.4598443030919177, 0.4613151938183058, 0.4627656698627394, 0.464187435389955, 0.46557320549910103, 0.46691673982547466, 0.4682128452665077, 0.4694573523007023, 0.470647069644909, 0.4717797219876262, 0.4728538753162918, 0.473868853989465, 0.47482465324449996, 0.47572185032097464, 0.4765615168528455, 0.4773451346626187, 0.478074516596478 ], [ 0.44370172698880506, 0.4424063396191418, 0.4412103470241064, 0.4401183247780203, 0.4391333899906864, 0.4382573802161192, 0.4374910984039165, 0.4368346041041026, 0.43628752624066514, 0.4358493699207033, 0.435519789404804, 0.43529880173227276, 0.43518692047082047, 0.4351851962318772, 0.43529515927122164, 0.43551866878873846, 0.43585768246067275, 0.43631396731515726, 0.43688877847538404, 0.4375825349769779, 0.438394521579791, 0.4393226423639917, 0.44036324639087443, 0.44151103855308066, 0.44275908082565285, 0.44409888137102943, 0.4455205621559604, 0.4470130905090367, 0.4485645567228469, 0.45016247844994955, 0.4517941130830541, 0.453446761199413, 0.45510804704532787, 0.45676616547886645, 0.4584100883613549, 0.4600297267591514, 0.4616160482569841, 0.4631611510641597, 0.46465829837338524, 0.4661019176323794, 0.467487570077039, 0.46881189613980767, 0.4700725422820871, 0.47126807449389935, 0.4723978832350512, 0.4734620840233424, 0.4744614172567222, 0.4753971502253209, 0.4762709836535521, 0.4770849645317629 ], [ 0.43692746673017346, 0.435523019013707, 0.4342466354897159, 0.4331022558113701, 0.43209173906010645, 0.4312151307166338, 0.4304710229798466, 0.4298569805598789, 0.4293699975951459, 0.42900694777906545, 0.4287649896624582, 0.42864189259428787, 0.4286362556497326, 0.4287476015563298, 0.4289763391244445, 0.4293235998497126, 0.42979096591953847, 0.4303801166120884, 0.43109242701099093, 0.43192855638335864, 0.4328880632088983, 0.43396907988159056, 0.43516807313574807, 0.43647970721341256, 0.4378968168224835, 0.4394104871934863, 0.4410102300488648, 0.44268423780630967, 0.4444196942600535, 0.44620311838339805, 0.448020718530558, 0.4498587367286287, 0.45170376637147397, 0.45354303087405584, 0.4553646152006653, 0.45715764623999605, 0.4589124214934619, 0.46062048832820646, 0.4622746780875328, 0.4638691006917691, 0.46539910609312757, 0.46686121918283324, 0.46825305460491273, 0.4695732175164125, 0.47082119574041087, 0.4719972480599904, 0.4731022926553233, 0.47413779893462277, 0.4751056852837731, 0.47600822458095743 ], [ 0.4292421640621181, 0.4277388916023084, 0.42639994784472657, 0.4252280888366303, 0.4242231552640358, 0.42338246847809907, 0.42270135608879056, 0.42217376698438475, 0.42179292739234037, 0.42155198562116936, 0.42144459392756334, 0.4214653815424537, 0.42161028275920404, 0.4218766971822989, 0.4222634744557738, 0.4227707315288218, 0.42339952521019975, 0.4241514149617737, 0.4250279594002256, 0.42603019403387804, 0.42715813708051764, 0.4284103650575001, 0.4297836909856591, 0.43127296668769555, 0.4328710182081949, 0.434568711281333, 0.43635513329028947, 0.43821787022437664, 0.4401433522369502, 0.44211723958665006, 0.4441248216743985, 0.446151404972292, 0.4481826701520216, 0.45020498393032893, 0.45220565642139426, 0.454173139636514, 0.456097166886622, 0.4579688360701051, 0.4597806421440761, 0.4615264655506998, 0.4632015241240983, 0.4648022961828118, 0.4663264222620061, 0.4677725923880287, 0.46914042505345477, 0.47043034319868815, 0.47164345161112187, 0.47278141926238765, 0.4738463692527087, 0.4748407782432391 ], [ 0.4205434829899072, 0.41895702195829526, 0.4175806309615495, 0.41641512270976117, 0.41545727766076057, 0.41470043033551357, 0.41413523307532296, 0.41375053804434697, 0.4135343283153664, 0.41347462535675455, 0.41356030342577116, 0.4137817508062554, 0.4141313324349668, 0.4146036267172095, 0.41519542944267696, 0.4159055377800784, 0.41673434551807853, 0.41768329540490934, 0.41875424434531267, 0.4199488015448323, 0.42126769822729754, 0.42271024069251967, 0.4242738872199342, 0.42595397512499905, 0.42774360887689605, 0.42963370535124357, 0.4316131795563585, 0.43366924464390444, 0.43578779426042247, 0.4379538333300641, 0.44015192472969733, 0.44236662325691156, 0.444582873885466, 0.4467863576503365, 0.4489637748356081, 0.45110306088105045, 0.45319353522177286, 0.455225986971745, 0.45719270395367895, 0.45908745316800736, 0.4609054215439644, 0.4626431259076685, 0.4642983007107203, 0.4658697713414707, 0.4673573199150437, 0.46876154940465836, 0.4700837509084749, 0.4713257777961908, 0.472489929486106, 0.47357884669358175 ], [ 0.4107190312183184, 0.40907099246709316, 0.40769060333575846, 0.40657569485468337, 0.4057185710130879, 0.4051068772672034, 0.40472470975954894, 0.4045538758799077, 0.404575205703625, 0.40476981276070007, 0.4051202109955496, 0.40561121114151955, 0.40623054188953234, 0.4069691667315981, 0.40782129376278836, 0.408784100767717, 0.40985721962739136, 0.4110420408477156, 0.41234090965067227, 0.413756288916309, 0.4152899612523208, 0.41694233318971335, 0.4187118901917908, 0.4205948335807765, 0.42258491170283197, 0.4246734397610576, 0.4268494875620898, 0.42910020323612835, 0.43141123443130813, 0.433767206509262, 0.4361522192765933, 0.4385503288013594, 0.44094598775184946, 0.4433244253614064, 0.4456719556507538, 0.44797620926544923, 0.4502262898168984, 0.45241285979563317, 0.45452816398272233, 0.45656599996571584, 0.45852164607695867, 0.4603917570378201, 0.462174237021675, 0.4638680989204466, 0.4654733174578093, 0.4669906825465443, 0.4684216580193077, 0.46976824963023767, 0.47103288507195606, 0.47221830770902445 ], [ 0.39964702379890577, 0.3979653779923518, 0.39662377258714937, 0.3956156533132848, 0.39492693217578, 0.39453727689221124, 0.3944217247833849, 0.39455248320234004, 0.3949007681905991, 0.3954385385597631, 0.39614000154295653, 0.39698279476505377, 0.3979487833738775, 0.39902444689622824, 0.40020086455535037, 0.40147333800051727, 0.40284071492046875, 0.4043044946419084, 0.40586780679917306, 0.4075343561942691, 0.4093074212610255, 0.411188980927608, 0.41317902660737144, 0.41527509457070544, 0.41747203143772194, 0.4197619843869861, 0.4221345899777376, 0.4245773226905178, 0.42707595707344037, 0.42961509561065786, 0.4321787173178498, 0.43475070840190544, 0.43731534472038497, 0.43985770493374177, 0.44236400208879373, 0.44482182915362484, 0.4472203203173997, 0.4495502345314429, 0.4518039708680366, 0.4539755270092538, 0.4560604128098105, 0.45805553067482857, 0.4599590337015139, 0.4617701713593095, 0.4634891310888043, 0.4651168827085379, 0.46665503102132394, 0.4681056805736473, 0.46947131519084334, 0.4707546937215452 ], [ 0.387198691761011, 0.3855178884770593, 0.384268073500032, 0.3834364224960271, 0.3829998695903345, 0.3829270289819429, 0.3831805518494678, 0.3837197014279303, 0.3845029240055569, 0.38549021408564355, 0.3866451112100716, 0.3879362156872572, 0.38933816306934177, 0.3908320468590044, 0.39240532190360444, 0.39405125536966357, 0.3957680174040437, 0.39755751952582835, 0.3994241156593115, 0.4013732788691324, 0.4034103568981819, 0.40553949257871375, 0.4077627727094277, 0.4100796432689665, 0.41248660246567304, 0.4149771587535046, 0.4175420208716512, 0.4201694727825513, 0.4228458787707567, 0.4255562626810494, 0.4282849093177278, 0.43101594392055576, 0.4337338557373354, 0.43642394250285377, 0.4390726628856755, 0.4416678928442855, 0.4441990888975841, 0.44665736644375265, 0.4490355045733569, 0.4513278905748254, 0.4535304178401895, 0.45564035046420776, 0.45765616677456905, 0.4595773925688036, 0.46140443314729035, 0.46313841145838275, 0.4647810179121516, 0.46633437574766595, 0.4678009243095474, 0.4691833212423667 ], [ 0.3732433302656967, 0.37160408722231625, 0.3705100501866403, 0.36993959721052316, 0.3698571870308405, 0.37021623871492726, 0.3709625922128675, 0.37203820172697055, 0.3733847246324836, 0.37494672092328674, 0.3766742553671619, 0.37852477991066796, 0.3804642541576698, 0.38246752898948405, 0.38451806949903516, 0.3866071286530403, 0.3887325044163042, 0.3908970227380283, 0.39310688867500176, 0.39537003931823383, 0.39769461609619583, 0.4000876515493832, 0.40255403836618603, 0.4050958185036831, 0.4077118002353137, 0.4103974837442815, 0.4131452538540054, 0.41594478333191914, 0.4187835825829514, 0.42164763108787706, 0.4245220314146105, 0.42739163629255256, 0.43024161119288284, 0.4330579073647897, 0.43582763197458363, 0.4385393119788752, 0.441183056181222, 0.4437506254893016, 0.4462354248799022, 0.4486324323117918, 0.45093808017708165, 0.453150104216646, 0.4552673734659937, 0.4572897130067111, 0.4592177292783063, 0.46105264560883313, 0.46279615356381076, 0.46445028377658065, 0.46601729817289034, 0.46749960398476137 ], [ 0.3576569711520091, 0.3561057042723019, 0.35524304081577246, 0.35503515309537254, 0.3554292634491484, 0.3563579937862672, 0.35774448238617285, 0.35950770038104185, 0.3615674517045564, 0.3638486576609564, 0.36628467384459684, 0.368819530487145, 0.37140910639938224, 0.37402133288075107, 0.3766355780829283, 0.37924139021807707, 0.38183678691437867, 0.3844262741197304, 0.3870187654293418, 0.38962555386534603, 0.39225846406128756, 0.3949282842392695, 0.39764354539320895, 0.40040968148997885, 0.40322857171309046, 0.4060984365301899, 0.4090140361417405, 0.4119671043743246, 0.41494694394374587, 0.417941109723775, 0.4209361137833135, 0.42391809750934095, 0.426873429984019, 0.4297892060101098, 0.432653630295722, 0.43545628536216824, 0.43818828927582254, 0.4408423552796584, 0.4434127690418185, 0.44589530092701174, 0.44828707086181163, 0.45058638241929705, 0.45279254104944816, 0.45490566921932973, 0.456926528826921, 0.45885635878623976, 0.46069673327962624, 0.46244944393542553, 0.46411640719194297, 0.46569959640753084 ], [ 0.34033562955304736, 0.3389235527479162, 0.3383800397303943, 0.3386543995253719, 0.3396700624837486, 0.34133122280658973, 0.34353047017927646, 0.34615647041204267, 0.349100903440989, 0.35226411603590524, 0.3555592168149037, 0.3589145739768403, 0.3622748430233796, 0.36560075000767467, 0.36886789821097743, 0.3720648704638909, 0.375190881840635, 0.3782532097467189, 0.38126459704759735, 0.3842407914724635, 0.38719835139199266, 0.39015281377875094, 0.3931172846748324, 0.39610147675048646, 0.39911118447001326, 0.4021481574844468, 0.4052103095608113, 0.40829218534488754, 0.41138560113795103, 0.41448037805010823, 0.41756509478849074, 0.420627800775111, 0.4236566459578948, 0.42664039951692034, 0.42956884410412466, 0.4324330442977492, 0.4352254971576918, 0.4379401791223983, 0.4405725072688231, 0.44311923459426844, 0.44557829894870254, 0.44794864400026085, 0.4502300285458852, 0.45242283790216936, 0.45452790827986445, 0.4565463721550779, 0.45847952985421897, 0.4603287499886353, 0.4620953991021151, 0.4637807989986368 ], [ 0.321213932038868, 0.31999593291560297, 0.31987221259351156, 0.32076871214680003, 0.32257589574148876, 0.32515904610242385, 0.32836976226368625, 0.332057081235143, 0.3360770218457045, 0.34029986080153807, 0.3446149333207371, 0.3489331079688829, 0.35318729368028406, 0.35733141944479446, 0.36133832494500256, 0.365196953021671, 0.3689091710356667, 0.3724864847643269, 0.3759468525425101, 0.3793117598302854, 0.38260367309770704, 0.38584395404534966, 0.38905127878465046, 0.3922405713042847, 0.39542242749640727, 0.3986029773356318, 0.40178411079793314, 0.40496397949457347, 0.40813768140560436, 0.4112980399248699, 0.41443639903542295, 0.41754337156229954, 0.4206094946959723, 0.42362576420264003, 0.42658403431261044, 0.4294772831923412, 0.4322997537174257, 0.43504698598065694, 0.43771576189705835, 0.44030398386825226, 0.4428105092495124, 0.4452349608067401, 0.4475775308783722, 0.4498387939182157, 0.4520195387723689, 0.45412062866486375, 0.45614289361709603, 0.45808705705452263, 0.4599536957772736, 0.4617432303737835 ], [ 0.3002898417130202, 0.2993233213360922, 0.29973395135666575, 0.301414955450958, 0.30421074016494215, 0.307933154728231, 0.3123789974424061, 0.31734609726987784, 0.3226462080649638, 0.32811397768997175, 0.3336120731613766, 0.3390330351151463, 0.3442986307988778, 0.34935747032806047, 0.3541815434035181, 0.3587621935657728, 0.363105914428481, 0.36723024394556325, 0.3711599510206195, 0.37492364889695795, 0.37855092467850326, 0.38207003749591373, 0.3855062047699892, 0.3888804647785333, 0.3922090745868176, 0.3955033771049159, 0.3987700518157365, 0.4020116523734719, 0.4052273315630324, 0.4084136595547287, 0.4115654534305545, 0.4146765523828542, 0.417740491401018, 0.4207510445174566, 0.4237026251412409, 0.42659054463853113, 0.42941114067034175, 0.43216179387199766, 0.43484085556015073, 0.43744751074974414, 0.4399816003747819, 0.4424434247351605, 0.4448335472854586, 0.44715261432443976, 0.44940120225943847, 0.4515797001792762, 0.4536882317003629, 0.45572661664044395, 0.45769437016980774, 0.45959073479399637 ], [ 0.2776565254058975, 0.27700044478408486, 0.27807557999610755, 0.2807285541906795, 0.28473866818419175, 0.28984415164376937, 0.2957690545109254, 0.3022462799573933, 0.3090343957373384, 0.31592783608188335, 0.32276137177403924, 0.32941025299499077, 0.33578744724524956, 0.34183916048143836, 0.3475395257742333, 0.35288506648992973, 0.35788932562891734, 0.3625779017331412, 0.3669840327536806, 0.37114480684762285, 0.3750980389802609, 0.3788798235374292, 0.3825227489235202, 0.38605473704909543, 0.3894984483692286, 0.39287117328575166, 0.39618511557108, 0.39944796501325613, 0.40266365574714813, 0.40583321351330404, 0.4089556080566182, 0.41202854400933, 0.4150491426280329, 0.41801448558807236, 0.42092200905977983, 0.42376975045557747, 0.4265564610564411, 0.42928160515962477, 0.4319452707033079, 0.43454801795784964, 0.4370906923366327, 0.4395742251818365, 0.44199944299625726, 0.44436690144721797, 0.44667675593881734, 0.44892867596376745, 0.4511218060899986, 0.4532547725464211, 0.4553257311297512, 0.45733244968352416 ], [ 0.25354373709375844, 0.2532580685300106, 0.25514576694877666, 0.25898559569945506, 0.2644636562678443, 0.27121674722636346, 0.27887377906843835, 0.2870879257979941, 0.29555706498832357, 0.30403359004219815, 0.31232626006662956, 0.32029690757234713, 0.32785429876227606, 0.3349467577542403, 0.3415545728983333, 0.34768277107498935, 0.35335456328389636, 0.35860559534690717, 0.3634790439922606, 0.3680215511726534, 0.3722799667608309, 0.37629885759954107, 0.38011873098701704, 0.3837749093869994, 0.38729698014525293, 0.3907087310242754, 0.39402847201349445, 0.3972696384863691, 0.4004415717748631, 0.40355038080550854, 0.4065998016472206, 0.40959198893876525, 0.4125281921493873, 0.41540928852551146, 0.41823616181149476, 0.42100993033437284, 0.4237320392546669, 0.42640423958049356, 0.4290284811039411, 0.4316067481231787, 0.4341408661351072, 0.4366323051286214, 0.4390820011801265, 0.4414902132295258, 0.44385642664209507, 0.44617930984490806, 0.4484567253221762, 0.4506857918580518, 0.45286299135167557, 0.45498431093883424 ], [ 0.2283738705774968, 0.2285193342786917, 0.23138739709535674, 0.23665573660264314, 0.24387591156663874, 0.25254629941394247, 0.2621751286366436, 0.2723228738005412, 0.28262377166056324, 0.29279157169217257, 0.30261552973852734, 0.31195142342996207, 0.32071071867159096, 0.32884967613746996, 0.3363592943851617, 0.34325645874824456, 0.3495763819766931, 0.35536628687350896, 0.36068022798283567, 0.3655749383547078, 0.3701065943731365, 0.3743284026958008, 0.37828892133552616, 0.3820310292111306, 0.38559145559659774, 0.3890007751338772, 0.3922837684813088, 0.39546004602823076, 0.398544834284872, 0.4015498322198389, 0.40448405748581184, 0.40735461882925783, 0.4101673692784948, 0.412927413169859, 0.41563945718380435, 0.41830801021309666, 0.42093744841356545, 0.4235319699355546, 0.42609546865759446, 0.4286313580202364, 0.43114237520525406, 0.43363039292188255, 0.436096261485263, 0.438539698251466, 0.4409592353449495, 0.44335223048022154, 0.4457149399843732, 0.4480426482349592, 0.45032984390219244, 0.45257043077676934 ], [ 0.2028410459032949, 0.20347800561439155, 0.20751117174845354, 0.21446541376741762, 0.22369904005571895, 0.23452703368977312, 0.2463132299180389, 0.2585199546883785, 0.2707236888059008, 0.28261043444937295, 0.29396168173279, 0.30463756295358696, 0.3145605045978873, 0.3237007446894037, 0.3320640880889158, 0.3396818225214343, 0.34660254867597423, 0.35288564143321344, 0.3585960805317713, 0.3638004303230743, 0.36856379135093087, 0.3729475826166656, 0.37700803908825026, 0.38079532404197963, 0.3843531620585278, 0.38771889903836076, 0.39092389396605703, 0.3939941465089886, 0.396951067164408, 0.3998123036996153, 0.4025925490652956, 0.40530427092368215, 0.4079583200161169, 0.4105643922254944, 0.4131313359099949, 0.41566731073020186, 0.41817981596467985, 0.42067561477831367, 0.4231605859633827, 0.4256395364650803, 0.4281160068787994, 0.43059209855801467, 0.43306834558841856, 0.4355436483095635, 0.4380152779540714, 0.44047895494827016, 0.4429289970235842, 0.4453585279597455, 0.44775973381458306, 0.45012415103490977 ], [ 0.17801856541356773, 0.17920144021689977, 0.1845825764499765, 0.19345788226654453, 0.20491740827312074, 0.21804866987943777, 0.23205996802956466, 0.24632513348099086, 0.2603807887464527, 0.2739034590275177, 0.28668199208805745, 0.29859195980924, 0.30957412825867775, 0.319617134174726, 0.32874383599863216, 0.3370006705182319, 0.34444940102354277, 0.351160750754082, 0.3572095250842068, 0.3626709206598436, 0.3676177953919214, 0.3721187298914585, 0.37623675023610503, 0.3800286064319556, 0.38354451384462085, 0.3868282699634086, 0.3899176599409766, 0.3928450648100031, 0.39563818868306155, 0.39832082710037864, 0.40091360844304524, 0.4034346535229448, 0.4059001140304316, 0.4083245670993865, 0.4107212594358518, 0.4131022090115284, 0.4154781842843912, 0.4178585896396909, 0.42025129094116775, 0.4226624167491122, 0.42509616917563353, 0.42755467400945113, 0.4300378933224466, 0.4325436160413129, 0.4350675337353039, 0.43760340090026273, 0.4401432719678136, 0.442677801635493, 0.4451965912061383, 0.4476885615511783 ], [ 0.15546794385945636, 0.1572268706050442, 0.16407920341095744, 0.17499753480943456, 0.18873081105923523, 0.2041175233196152, 0.22022563616146765, 0.2363689368642568, 0.25207129401478223, 0.2670201426178439, 0.2810249508972131, 0.2939842542899036, 0.30586060484958777, 0.3166618104378632, 0.32642692274237073, 0.3352157570751612, 0.34310103887692267, 0.35016251748859983, 0.3564825700076331, 0.3621429510767235, 0.36722244077729554, 0.3717952112697737, 0.37592977955099116, 0.3796884433559157, 0.38312711394937793, 0.3862954673165745, 0.38923733788007764, 0.3919912797384024, 0.3945912222186651, 0.39706715102984136, 0.39944575428987467, 0.40175098410066096, 0.4040044984074392, 0.40622596342632167, 0.40843321259831233, 0.41064227249910695, 0.41286727825184466, 0.4151203098920022, 0.41741118630515206, 0.4197472546573173, 0.42213321088572625, 0.4245709813589276, 0.4270596880447104, 0.4295957103925814, 0.43217284764033087, 0.4347825763218889, 0.43741439015633793, 0.4400562037781796, 0.442694798210141, 0.4453162846108688 ], [ 0.1372113564728352, 0.13951099908061285, 0.14777902237678978, 0.16059641488331466, 0.17634824562068063, 0.1936516937120629, 0.2114787638237357, 0.22912070758050807, 0.24611278419680732, 0.26216589196525464, 0.2771147449438724, 0.2908806942356033, 0.30344534632417874, 0.3148317434570849, 0.32509080560909714, 0.3342914716679997, 0.3425134827808094, 0.3498420842987311, 0.35636414394954913, 0.36216533368944204, 0.3673281262017736, 0.37193042886133887, 0.37604472683266305, 0.3797376384504749, 0.3830698044499347, 0.38609604178867774, 0.3888656962928262, 0.3914231293838538, 0.3938082753682406, 0.396057209113603, 0.39820267045946217, 0.4002745016498768, 0.4022999669443965, 0.40430393834646944, 0.40630894674870743, 0.4083351122901879, 0.410399979997763, 0.41251829573772236, 0.4147017624085535, 0.4169588168860546, 0.4192944646910218, 0.42171020232826184, 0.4242040477287148, 0.42677068840297017, 0.4294017460149707, 0.43208614622345853, 0.434810574686452, 0.4375599946297998, 0.44031819855013277, 0.44306836634674984 ], [ 0.12523920444225783, 0.12792841118490414, 0.13724610986356847, 0.15142795149264904, 0.1685754115449351, 0.18716274814088463, 0.2061177325143203, 0.2247338447540107, 0.242564563061745, 0.2593414377853564, 0.2749172995197652, 0.28922780042806306, 0.3022651680490299, 0.31405998392487505, 0.3246683141565724, 0.3341624964958313, 0.3426244877013057, 0.3501410423229611, 0.35680022550448187, 0.3626889137925537, 0.3678910405269561, 0.37248641320421305, 0.37654997871277, 0.38015144422664654, 0.38335518087165865, 0.38622034748901735, 0.3888011761273321, 0.3911473622787616, 0.3933045039280539, 0.3953145362054981, 0.3972161140945531, 0.39904490472249293, 0.4008337629898593, 0.40261277877555207, 0.4044091993436908, 0.4062472452977884, 0.40814785089839634, 0.4101283684283314, 0.4122022806211086, 0.4143789645872222, 0.4166635454175273, 0.41905686852645363, 0.4215556080773937, 0.4241525160088744, 0.42683680376570027, 0.4295946381430688, 0.43240972461833754, 0.435263946674014, 0.4381380279628491, 0.44101218541518233 ], [ 0.12037561892166888, 0.12320115443023928, 0.13293708326507728, 0.14766765665713094, 0.16537860352162784, 0.18449301915288888, 0.2039267914025041, 0.22297679224214612, 0.24120325296465042, 0.2583434613561478, 0.2742538778458767, 0.28887176994709746, 0.30218939706678355, 0.31423625754359646, 0.3250666361963746, 0.3347507422665363, 0.3433683483319807, 0.35100421121227376, 0.3577447847577492, 0.36367588246046123, 0.3688810478413361, 0.37344045999119996, 0.3774302498587208, 0.38092213532928976, 0.3839833035471806, 0.3866764803977531, 0.389060132497897, 0.3911887492212566, 0.39311315372701566, 0.39488079472624144, 0.3965359762315595, 0.3981199914683344, 0.3996711393739361, 0.4012246168537039, 0.4028122958038361, 0.4044624091062751, 0.4061991825217526, 0.40804245804045736, 0.41000735766713264, 0.41210403438075277, 0.41433754946137047, 0.4167079035941392, 0.4192102347675615, 0.42183518087067, 0.4245693909010965, 0.4273961573261371, 0.43029613436770586, 0.4332481031865309, 0.4362297449445231, 0.4392183859270326 ], [ 0.12145491030024502, 0.12418123617088243, 0.13374274349502574, 0.14828958894165417, 0.16585316776929757, 0.18487500084576636, 0.20427276912424902, 0.2233375316107226, 0.2416207814813999, 0.2588502492066253, 0.27487293872649704, 0.2896171627691118, 0.30306689917253826, 0.31524410867946695, 0.32619631273137173, 0.3359877500441116, 0.3446930354737638, 0.3523926062699165, 0.3591694645878557, 0.3651068703212549, 0.37028673696784586, 0.3747885523699597, 0.37868869488950435, 0.38206004909465924, 0.3849718468441198, 0.38748967262248846, 0.3896755788150008, 0.39158825995131913, 0.39328323726446096, 0.39481300830725674, 0.39622712238676366, 0.3975721520341985, 0.39889154362981144, 0.40022534585067115, 0.4016098313184135, 0.4030770427428021, 0.40465430788438644, 0.4063637759114281, 0.40822202989435774, 0.41023982580986956, 0.4124219980388911, 0.4147675563706001, 0.4172699820551024, 0.41991771283464985, 0.4226947913255833, 0.4255816393036886, 0.42855591331512094, 0.43159339476728314, 0.4346688697551793, 0.437756959396321 ], [ 0.12621953442277312, 0.12872691237907435, 0.13780235624769957, 0.1517727462971085, 0.1688007276751955, 0.1873848269845997, 0.20645320880404608, 0.2252872728833671, 0.24342241019522423, 0.26056946269244446, 0.27655976452852343, 0.2913077304075307, 0.3047852358023021, 0.31700379151610303, 0.32800194796834015, 0.337836296770815, 0.346575007365884, 0.354293184342296, 0.3610695492569998, 0.3669840937762503, 0.3721164489091492, 0.3765447843604016, 0.38034510140788774, 0.3835908172773768, 0.3863525621018407, 0.3886981239461955, 0.3906924856247563, 0.39239790168009403, 0.39387396735712066, 0.3951776358282412, 0.3963631469254013, 0.3974818411241617, 0.39858184656837126, 0.39970764370117917, 0.4008995299612392, 0.4021930238258145, 0.40361826084002506, 0.40519944200518593, 0.40695439553838714, 0.4088943061307727, 0.4110236521924886, 0.41334037304698457, 0.41583626724979506, 0.4184976030246759, 0.4213059048018801, 0.4242388678424521, 0.4272713468028508, 0.43037636373113825, 0.4335260855088656, 0.4366927288082414 ], [ 0.13315426858797266, 0.13541477410713382, 0.14391137480054697, 0.15716908469548607, 0.17350730369506412, 0.19149934370738658, 0.210092427698801, 0.22856119909570377, 0.24642530048971356, 0.26337815051223623, 0.2792346900251793, 0.2938947701785817, 0.3073176209720908, 0.3195038811719336, 0.33048280593460494, 0.3403030838635879, 0.3490262208632533, 0.3567217792419327, 0.3634639724140111, 0.36932925609448863, 0.37439465389156584, 0.37873662420245147, 0.3824303248935591, 0.38554916737942463, 0.38816457570037394, 0.3903458816813754, 0.3921602967112999, 0.39367290657118875, 0.3949466404442685, 0.39604217089264837, 0.3970177098446541, 0.3979286774603008, 0.39882723620950616, 0.39976170072910383, 0.4007758532463752, 0.40190821213489897, 0.4031913148140526, 0.40465108329654575, 0.4063063396218193, 0.4081685288221093, 0.4102416900142711, 0.4125226940445238, 0.4150017420271357, 0.41766309650075994, 0.42048599869713427, 0.4234457135154995, 0.4265146389444219, 0.42966341843505124, 0.4328620018028827, 0.43608061085107436 ], [ 0.1422964409411603, 0.14430265393934993, 0.15215843247257746, 0.16459359511264562, 0.18010252608024527, 0.1973518772092451, 0.21532003102476188, 0.23328095185538728, 0.25074103567227307, 0.26737706487025475, 0.2829876601500786, 0.29745792665404625, 0.31073419964913956, 0.32280599843254526, 0.3336930549716276, 0.34343594262153715, 0.3520892941349975, 0.35971690572618964, 0.3663882270201921, 0.37217587385214623, 0.37715389643409747, 0.38139660372859396, 0.3849777942133461, 0.38797027850040716, 0.39044560375447623, 0.39247390613334343, 0.3941238279538033, 0.3954624433495015, 0.3965551421558133, 0.39746542873484547, 0.3982546020969837, 0.39898129694580037, 0.3997008822288035, 0.4004647334596217, 0.40131941555687484, 0.40230583155871824, 0.40345840637109465, 0.4048043810526455, 0.40636329032758484, 0.408146683780454, 0.4101581308918395, 0.4123935245451856, 0.4148416706010067, 0.41748512645732616, 0.4203012324070148, 0.42326326805685965, 0.426341662633474, 0.42950519188855585, 0.43272210381631954, 0.4359611283580518 ], [ 0.15459835163463712, 0.15633053508812728, 0.16342758509645364, 0.17484231483931964, 0.18927763047948787, 0.20552634796082153, 0.22261984174089533, 0.23984227716198145, 0.25669060711839276, 0.2728251448565617, 0.28802681766819604, 0.30216414079598697, 0.31516871979639616, 0.32701731032067904, 0.33771871153522526, 0.3473041910002663, 0.3558204988196091, 0.3633247925932964, 0.3698809796741984, 0.37555711286760185, 0.3804235680350785, 0.38455179890691144, 0.3880135131121524, 0.3908801486079086, 0.3932225544921777, 0.3951107971466937, 0.39661402410890073, 0.3978003263144554, 0.39873654662949326, 0.39948799094926485, 0.4001180091913283, 0.4006874281858375, 0.4012538367754971, 0.4018707443455077, 0.40258665544928635, 0.4034441223437274, 0.40447885096481395, 0.40571894137927816, 0.40718433930281595, 0.4088865607296688, 0.4108287287221899, 0.41300593318710627, 0.4154058951804275, 0.41800989115693427, 0.42079387302560145, 0.42372970888081674, 0.42678646720911106, 0.4299316731363552, 0.4331324768217672, 0.43635668896469726 ], [ 0.17076607227798998, 0.17220462606215842, 0.17841673038231143, 0.18858609333081097, 0.20165325825014338, 0.21657523576472698, 0.23246778092899548, 0.24864465749320602, 0.26460267623157563, 0.2799885559040554, 0.2945649580536246, 0.3081816681401961, 0.3207528933822199, 0.33223994703310444, 0.3426382345770755, 0.351967550618247, 0.3602648898785908, 0.36757915949825526, 0.3739673268849378, 0.37949164904553273, 0.38421771303379726, 0.3882130797688072, 0.3915463701511226, 0.3942866667625122, 0.3965031292059461, 0.39826473862664, 0.39964009932788924, 0.40069723482444525, 0.4015033242881387, 0.40212433507547635, 0.4026245194138496, 0.40306575921979904, 0.40350676237887123, 0.4040021355269294, 0.4046013802998723, 0.4053478792433198, 0.4062779508894135, 0.4074200581007531, 0.40879424795363484, 0.41041188516624116, 0.4122757162421582, 0.41438027159233887, 0.41671258234762937, 0.4192531617960333, 0.4219771818650171, 0.42485576475832126, 0.42785730894497864, 0.4309487758749069, 0.4340968767692472, 0.4372691149537178 ], [ 0.19060709441407922, 0.19175252722760183, 0.19702157598552034, 0.20580833236892035, 0.21729079138507876, 0.23061248840335888, 0.24500335252388183, 0.25983195665025466, 0.2746117174564116, 0.288984948686819, 0.30269994623801927, 0.3155884419983427, 0.3275461638952988, 0.3385170684709979, 0.3484809573670936, 0.35744393653557655, 0.3654311652703687, 0.372481410696433, 0.37864300798348455, 0.38397090474934586, 0.3885245337922339, 0.39236631113682774, 0.39556059778065283, 0.39817299519778687, 0.4002698683179496, 0.4019180070941512, 0.4031843507264525, 0.40413570903510193, 0.4048384252929719, 0.4053579357996305, 0.40575819499056315, 0.4061009516685558, 0.40644488188846484, 0.4068446059698374, 0.40734963890486736, 0.40800334217614415, 0.4088419575519014, 0.4098938070648574, 0.411178736526398, 0.41270786269781795, 0.4144836586351135, 0.4165003813440282, 0.418744815213293, 0.42119727815325253, 0.423832818390183, 0.42662252029620995, 0.42953483755114424, 0.43253687991295475, 0.435595593536372, 0.43867879141521443 ], [ 0.21315281586859894, 0.2140285963569413, 0.21838555290299874, 0.22578743965747344, 0.23561982488355082, 0.24720892474012862, 0.2599141021114594, 0.2731803468100809, 0.2865572289011526, 0.2996970491758095, 0.3123429514772661, 0.3243137596158316, 0.3354890465969985, 0.3457959379313443, 0.3551980929750707, 0.36368681554697274, 0.3712740487219809, 0.37798695445307334, 0.38386378678243666, 0.3889507993080734, 0.3932999655567622, 0.3969673272587542, 0.400011817158657, 0.4024944290429728, 0.4044776283181956, 0.4060249125572507, 0.40720044417473955, 0.40806868827972437, 0.40869399937745265, 0.4091401124430386, 0.4094695081344987, 0.40974263912896974, 0.41001702452320865, 0.41034624076128057, 0.41077885854514107, 0.41135739288309936, 0.4121173448772846, 0.41308641653410194, 0.41428397241334985, 0.415720804553913, 0.41739923185589356, 0.4193135354872768, 0.4214507022482631, 0.42379142239181367, 0.4263112704185243, 0.42898198854950936, 0.4317727929527173, 0.4346516309404746, 0.43758633094247545, 0.4405456034568309 ], [ 0.23712030050113614, 0.2377633027559419, 0.24130083020922863, 0.24742261358345546, 0.2556786601403473, 0.26555409980739314, 0.27653497062228644, 0.28815308251330024, 0.30000931052576807, 0.3117805294984412, 0.3232164662337795, 0.3341314812348031, 0.3443945494796985, 0.35391928837140485, 0.36265493684197725, 0.37057863333676516, 0.3776890413099765, 0.38400122500240513, 0.38954261763625553, 0.3943499082717433, 0.3984666795649885, 0.40194164404712873, 0.40482734467275755, 0.4071792029243481, 0.4090548132795564, 0.4105133960817212, 0.41161533226819624, 0.41242171393008015, 0.4129938554464746, 0.41339272209106764, 0.41367824742435877, 0.41390852783117515, 0.41413890189444275, 0.414420942732775, 0.4148014109929711, 0.41532123233682156, 0.4160145733278109, 0.41690809139902796, 0.4180204269168082, 0.41936198858900803, 0.42093505956175686, 0.42273422379861825, 0.4247470847344706, 0.42695522461120444, 0.4293353363014554, 0.431860451365756, 0.4345011885776619, 0.43722695488540836, 0.4400070436106822, 0.44281159017653726 ], [ 0.26128555588201996, 0.26173583328700967, 0.26457217778954945, 0.2695738400723707, 0.27641351743316833, 0.2847038959788969, 0.2940424985871968, 0.30404654289698385, 0.31437510702241506, 0.32473989962754846, 0.33490765427481306, 0.34469726939926526, 0.35397417704092726, 0.3626436396348855, 0.3706440124611976, 0.37794053583579734, 0.38451991442952305, 0.39038575678832516, 0.39555484513920225, 0.4000541533123212, 0.40391850844790134, 0.4071887869026253, 0.4099105383152607, 0.412132939346067, 0.4139079875402663, 0.4152898548737697, 0.4163343295512731, 0.41709828387527703, 0.41763911614656446, 0.4180141263190968, 0.418279799063382, 0.4184909841285335, 0.41869998197078073, 0.41895556137361206, 0.4193019534046995, 0.4197778802804629, 0.4204156862326646, 0.4212406384365372, 0.42227045856590834, 0.4235151300008076, 0.42497700393577464, 0.4266512025684274, 0.4285262927158082, 0.4305851820125732, 0.43280617490262885, 0.43516411832713975, 0.43763156737075726, 0.44017990803049184, 0.4427803858383069, 0.4454050031382281 ], [ 0.28465887477245333, 0.28495345785308523, 0.2872077503351217, 0.29126355440100077, 0.2968823466522435, 0.3037743509475137, 0.3116285605636987, 0.32013841206060134, 0.3290204391972611, 0.33802559571129426, 0.3469443789615175, 0.35560742721850414, 0.36388321552696246, 0.3716741586599609, 0.3789120560508448, 0.38555348544334317, 0.39157550169996047, 0.3969718223515077, 0.40174956712646487, 0.4059265483182851, 0.4095290684285315, 0.41259016053039216, 0.41514819783283563, 0.4172457970674736, 0.4189289424892207, 0.4202462617368077, 0.4212483907460752, 0.4219873721899311, 0.4225160407456631, 0.4228873591985998, 0.4231536822084574, 0.4233659394016549, 0.4235727457426877, 0.4238194637606089, 0.42414725753695154, 0.42459219045914204, 0.42518442568394665, 0.42594758854326226, 0.426898343096878, 0.4280462211399024, 0.4293937228085683, 0.43093668602840396, 0.43266490041128775, 0.43456292271574076, 0.4366110378623159, 0.43878630294465415, 0.4410636117694839, 0.4434167232862301, 0.44581920726079033, 0.4482452728710718 ], [ 0.30652289062574145, 0.3066931690952259, 0.30847326469463493, 0.3117486486192114, 0.31634427819453975, 0.32204302618006675, 0.3286057397366395, 0.3357896632090934, 0.3433631523569782, 0.3511159046146285, 0.35886491782767194, 0.36645694087298125, 0.3737683601938113, 0.3807034127436926, 0.38719145252777126, 0.39318380810440956, 0.3986505958814217, 0.40357771558326505, 0.4079641516786473, 0.41181963298713753, 0.41516265532102437, 0.41801884235203435, 0.42041960256088257, 0.4224010310986766, 0.42400300184789513, 0.4252683951112028, 0.4262424091549015, 0.426971908826286, 0.42750477153172983, 0.42788920002354813, 0.4281729826570503, 0.42840269476917975, 0.42862284895921754, 0.4288750162677584, 0.42919695313404, 0.4296217789438579, 0.4301772544076094, 0.43088521077046577, 0.4317611734957932, 0.43281421202322273, 0.43404703085156415, 0.43545629863298646, 0.43703319364906484, 0.43876412833470047, 0.44063160425988707, 0.4426151431921464, 0.4446922396549643, 0.44683928507556964, 0.4490324219267215, 0.4512482967081867 ], [ 0.3264071574037711, 0.3264783231622332, 0.3278765988715635, 0.33051816881530494, 0.33427332059268766, 0.33897836413320637, 0.3444491478626371, 0.3504941699321932, 0.3569258141956248, 0.3635689300432875, 0.3702665934620708, 0.3768833154889855, 0.3833061878373508, 0.389444517169248, 0.39522845952837254, 0.4006070772312936, 0.40554613795007755, 0.4100258800651987, 0.4140388885631276, 0.4175881638720329, 0.4206854206301524, 0.42334962162897694, 0.4256057310175833, 0.42748365760174256, 0.42901735160188065, 0.43024401502843385, 0.4312033859032807, 0.4319370593253468, 0.4324878135391101, 0.43289891652284707, 0.4332133979380308, 0.43347328217107406, 0.4337187899883632, 0.4339875280541939, 0.43431369602082964, 0.4347273487719727, 0.43525375546712275, 0.43591289642358405, 0.4367191332874735, 0.4376810777997129, 0.4388016708860415, 0.4400784684779664, 0.4415041153628634, 0.4430669753472994, 0.44475187657487025, 0.44654092581526916, 0.44841434507285144, 0.4503512874491015, 0.45233059587323793, 0.45433147690034625 ], [ 0.34404291070894405, 0.34403435794956827, 0.34512750913616097, 0.3472603919680839, 0.350335788070144, 0.3542291192597417, 0.35879769494279173, 0.36389007896978154, 0.36935456584953635, 0.3750461184143422, 0.3808314908226944, 0.3865925605404891, 0.39222808811896975, 0.39765421905660764, 0.402804061766885, 0.40762664779743685, 0.41208552882278654, 0.4161572063017829, 0.4198295340328635, 0.42310018603215704, 0.42597524376715445, 0.42846792750516083, 0.4305974752216844, 0.4323881577542835, 0.4338684093690541, 0.4350700475614825, 0.4360275539534955, 0.43677738903316055, 0.4373573168407959, 0.43780572123345907, 0.4381609027230994, 0.43846035362024055, 0.43874001867552126, 0.43903355774507524, 0.43937163520759626, 0.4397812668815649, 0.44028525809685637, 0.44090176572882084, 0.4416440122236999, 0.4425201712981456, 0.44353343398608236, 0.4446822513512586, 0.44596073800177893, 0.44735920999326445, 0.4488648229487208, 0.4504622719430968, 0.45213451404957344, 0.4538634770793886, 0.4556307232560779, 0.45741804343821724 ], [ 0.3593176835118298, 0.35924377994988216, 0.36009430275058135, 0.3618230107061643, 0.3643561112119979, 0.36759760785699647, 0.3714357573158081, 0.3757498477405571, 0.3804166066995945, 0.38531573677372777, 0.39033429768469613, 0.3953698540191037, 0.4003324582014603, 0.4051456315534276, 0.40974654856204523, 0.41408563397584136, 0.4181257630132066, 0.4218412234819665, 0.42521656332385155, 0.42824541321245957, 0.43092934409560607, 0.43327679506288835, 0.4353020877188917, 0.43702452892610005, 0.43846759373721406, 0.4396581739514003, 0.44062587447559887, 0.4414023391258207, 0.4420205893149146, 0.4425143629147814, 0.44291744608346656, 0.4432629975445922, 0.4435828720999269, 0.44390695731568575, 0.4442625435314783, 0.4446737517781515, 0.44516104615465013, 0.4457408562475304, 0.44642533117687705, 0.4472222401273913, 0.44813502547726863, 0.44916300487577654, 0.4503017089933813, 0.4515433332836342, 0.4528772758437775, 0.4542907298875272, 0.4557692985987236, 0.4572976019959142, 0.4588598493954343, 0.4604403564363394 ], [ 0.3722369353381688, 0.37210789774206376, 0.3727661090732503, 0.37417680278553894, 0.3762831674669964, 0.3790100699671791, 0.3822686790089802, 0.38596147335591274, 0.3899871527592075, 0.39424506972097945, 0.39863893176723536, 0.40307965600976775, 0.40748736853212625, 0.4117926202831218, 0.4159369378556531, 0.4198728467449359, 0.42356350379692215, 0.42698206196073013, 0.43011087027190736, 0.4329405896664138, 0.43546928363412957, 0.4377015234925278, 0.43964753194626605, 0.441322375796743, 0.4427452090736092, 0.4439385612363762, 0.4449276611548611, 0.44573978603747183, 0.44640362505337094, 0.4469486497861462, 0.44740448751005296, 0.4478002981633351, 0.44816416128154973, 0.44852248443889875, 0.4488994492746184, 0.44931651432431374, 0.4497919951111095, 0.45034074095454496, 0.45097392467151987, 0.4516989560219595, 0.452519522927368, 0.4534357569142071, 0.4544445117604417, 0.45553973777765044, 0.4567129292137935, 0.4579536193389405, 0.45924989701723234, 0.46058891983731054, 0.46195740181515216, 0.46334205780526455 ], [ 0.3828942642183466, 0.3827170314042465, 0.38322311162594286, 0.3843862137778369, 0.3861618841620063, 0.3884901751830514, 0.39129905968067086, 0.39450823899541887, 0.39803299849888046, 0.40178781631378074, 0.40568951076901894, 0.409659800282869, 0.41362723026203824, 0.4175284857801729, 0.42130915275332603, 0.42492401499187465, 0.4283369833405543, 0.4315207504917402, 0.4344562551669459, 0.4371320256681529, 0.43954345785958776, 0.4416920681635829, 0.4435847491742849, 0.445233044552663, 0.4466524511837204, 0.44786175017271707, 0.4488823640394126, 0.44973773528004424, 0.4504527211011491, 0.4510530003349346, 0.45156449101282276, 0.45201278042553533, 0.4524225732912749, 0.45281716739328354, 0.4532179692217536, 0.45364406428342413, 0.45411185744056415, 0.4546347976799758, 0.45522319906425796, 0.4558841654746821, 0.4566216215152913, 0.45743644616182716, 0.4583267000306527, 0.4592879321164276, 0.4603135480006762, 0.4613952191926379, 0.46252331255138673, 0.46368731957729087, 0.46487626751040056, 0.4660790972832593 ], [ 0.3914494444836668, 0.3912285127491405, 0.3916143643797975, 0.39258704486570417, 0.3941111053656576, 0.396137579831642, 0.3986066020921169, 0.40145041036329215, 0.404596478545656, 0.4079705397474873, 0.41149931718496857, 0.41511283834286594, 0.4187462687314825, 0.4223412536994754, 0.4258467963048276, 0.42921972522288915, 0.43242482034402047, 0.43543466753393295, 0.4382293107933415, 0.44079576236262247, 0.4431274213126952, 0.4452234404500979, 0.44708807105080706, 0.4487300057274156, 0.45016173202828025, 0.4513989033519934, 0.4524597294772062, 0.45336438639701104, 0.4541344440741541, 0.4547923109997087, 0.45536069578484245, 0.455862088127236, 0.45631826400599107, 0.45674982247563, 0.4571757635525631, 0.4576131180534387, 0.4580766405703845, 0.4585785758891982, 0.4591285070578965, 0.45973329013855185, 0.46039707671405333, 0.4611214208700367, 0.4619054630793774, 0.46274617961889036, 0.4636386832093086, 0.46457655873584325, 0.46555221728087537, 0.4665572522435691, 0.467582782873732, 0.4686197728649603 ], [ 0.3981126141731221, 0.39785082811667977, 0.39814168530761174, 0.39897002435972667, 0.40030694475078893, 0.4021113282665515, 0.4043319352299393, 0.40690988283362783, 0.4097812974684735, 0.4128799444734695, 0.4161396708895567, 0.4194965408939584, 0.42289059097995446, 0.4262671757338789, 0.42957791087014774, 0.4327812461200185, 0.4358427166808635, 0.4387349295108942, 0.4414373416800428, 0.44393588424721664, 0.4462224785224156, 0.44829448355339996, 0.45015410535250494, 0.45180779051987935, 0.45326562002083287, 0.4545407132208164, 0.45564864799721244, 0.4566068998406954, 0.45743430124946116, 0.4581505222551291, 0.45877557338850156, 0.45932933353676697, 0.4598311066651575, 0.46029921296102144, 0.46075062129752253, 0.4612006307323544, 0.46166260884269056, 0.462147793930824, 0.46266516650455264, 0.4632213930452255, 0.4638208421299249, 0.464465669753666, 0.4651559675209191, 0.46588996455453574, 0.4666642717671904, 0.46747415573811646, 0.46831382892022144, 0.4691767432535181, 0.47005587537677784, 0.47094399334303955 ], [ 0.4031326191702258, 0.40283191691469744, 0.40304770177124327, 0.40376847829339824, 0.4049700805263444, 0.4066168941293245, 0.40866361999062, 0.4110574217592699, 0.4137402796304416, 0.41665137565032984, 0.4197293577268061, 0.4229143639137076, 0.42614972824043096, 0.42938332817493524, 0.4325685673346621, 0.43566501291125576, 0.4386387248172316, 0.44146232341117425, 0.44411484614391483, 0.44658144219551016, 0.4488529497123462, 0.45092539396832493, 0.4527994377473931, 0.45447980827569817, 0.45597471866599204, 0.4572952964116355, 0.458455027156461, 0.4594692188189976, 0.4603544891197308, 0.46112827853039473, 0.46180839046147976, 0.46241256091368205, 0.462958060599737, 0.46346133344365015, 0.4639376761425947, 0.4644009639208195, 0.46486342755418486, 0.4653354861067095, 0.46582563858500364, 0.46634041595255077, 0.4668843927959154, 0.467460255594994, 0.4680689222420191, 0.46870970539858103, 0.46938051066414294, 0.4700780594870417, 0.4707981263462871, 0.4715357799664602, 0.4722856191332159, 0.4730419949403295 ], [ 0.40678749512092843, 0.4064496011818202, 0.4066060472695216, 0.40724817028381577, 0.40835519671285436, 0.4098952705898472, 0.4118270138122882, 0.4141014805317468, 0.4166643435464776, 0.4194581481237289, 0.42242448470301064, 0.42550596106591215, 0.42864789037123185, 0.4317996479905037, 0.4349156828196852, 0.4379561949658414, 0.44088751036775536, 0.44368219424213406, 0.4463189502909453, 0.44878235277214146, 0.45106245529211675, 0.45315431484744534, 0.45505746331070246, 0.4567753520416844, 0.45831478918593177, 0.4596853838626271, 0.46089900704199693, 0.46196927553831313, 0.46291106317248204, 0.4637400416915257, 0.4644722533238133, 0.4651237167173661, 0.46571006825335187, 0.4662462411431484, 0.466746185111314, 0.46722262967131845, 0.46768689388981405, 0.46814874503480797, 0.4686163075984417, 0.4690960229201635, 0.46959265810666156, 0.4701093612849003, 0.47064775858760555, 0.47120808680940257, 0.4717893545191156, 0.47238952366628706, 0.4730057034292254, 0.47363434822140177, 0.47427145236239826, 0.4749127348537282 ], [ 0.4093752409592274, 0.40900228755675055, 0.4091118581626938, 0.40969749679305295, 0.41074083666798, 0.41221250495590844, 0.4140735679347998, 0.41627738738962994, 0.41877173190161254, 0.42150098049563095, 0.42440826887328725, 0.4274374552251184, 0.4305348171313476, 0.4336504272883009, 0.436739188977151, 0.4397615393063493, 0.4426838479958517, 0.44547855186730395, 0.44812407117829195, 0.4506045548490381, 0.4529094989356985, 0.4550332777475423, 0.4569746208983283, 0.4587360631733487, 0.46032338797915545, 0.46174507970322354, 0.46301179575345364, 0.46413586544914076, 0.4651308202767938, 0.46601095821953054, 0.4667909437859483, 0.46748544484387533, 0.4681088072336937, 0.46867476822252285, 0.46919621000426887, 0.4696849545147626, 0.47015160071256445, 0.4706054051115893, 0.47105420572254014, 0.4715043886903632, 0.47196089586618917, 0.4724272704138802, 0.47290573642767864, 0.47339730753373055, 0.47390191865713166, 0.47441857462696996, 0.4749455091037599, 0.4754803474531562, 0.47602026763276906, 0.4765621538561105 ], [ 0.41120341530862303, 0.4107984580894786, 0.4108710864766256, 0.41141657484908295, 0.41241825595725523, 0.4138483494288817, 0.4156693493177992, 0.417835844323969, 0.42029661390158585, 0.42299683463361265, 0.42588024235236865, 0.42889112167563614, 0.4319760294922939, 0.43508519612865876, 0.43817358236084586, 0.441201598811713, 0.4441355150848907, 0.4469475991934874, 0.4496160343463221, 0.4521246613562441, 0.4544625923502592, 0.45662373648978066, 0.4586062722112661, 0.46041209395350025, 0.4620462550623822, 0.4635164229448359, 0.4648323577884914, 0.4660054223473874, 0.46704812739555085, 0.4679737153854386, 0.4687957834922735, 0.46952794643166, 0.4701835390520156, 0.47077535857438463, 0.47131544634236283, 0.47181490893773487, 0.47228377842427316, 0.47273091124623556, 0.47316392490631326, 0.4735891709892827, 0.4740117424193699, 0.4744355120990425, 0.47486319934400295, 0.4752964598749392, 0.4757359946152026, 0.4761816722242451, 0.4766326601987008, 0.47708755950377557, 0.47754453804335034, 0.4780014588063289 ], [ 0.41257670190825113, 0.4121440841580066, 0.41218775986181616, 0.4127043631540946, 0.4136784433204188, 0.4150832462948766, 0.41688207792107845, 0.4190301220408742, 0.4214765530678657, 0.4241667718927824, 0.42704460432978963, 0.4300543278886458, 0.43314242870902314, 0.4362590292720798, 0.4393589635463471, 0.44240250597268277, 0.4453557825162438, 0.4481909058400126, 0.4508858834431368, 0.4534243488387217, 0.45579516312587476, 0.4579919291157708, 0.46001245371628074, 0.4618581874786324, 0.46353366369294996, 0.4650459535780143, 0.46640414914814615, 0.4676188813242228, 0.4687018777600087, 0.4696655625921067, 0.47052269876928543, 0.47128607263493894, 0.4719682198815164, 0.47258119173084706, 0.4731363600962316, 0.4736442604475856, 0.4741144710501966, 0.47455552712733506, 0.47497486828012286, 0.47537881718269853, 0.47577258717612075, 0.4761603159459073, 0.4765451220304667, 0.4769291805184953, 0.4773138139964471, 0.477699594637047, 0.4780864532982476, 0.47847379163616255, 0.47886059351806887, 0.47924553243281365 ], [ 0.41378243952319377, 0.41332795661354504, 0.4133491783996909, 0.41384380451825653, 0.4147973009009923, 0.41618364980136696, 0.41796670214401976, 0.4201020037137099, 0.4225389308027538, 0.4252229586544962, 0.4280978960720813, 0.4311079467905526, 0.43419949556221177, 0.4373225572470641, 0.4404318647386762, 0.4434876025169683, 0.4464558152783742, 0.44930853538128684, 0.4520236797832212, 0.45458476830487526, 0.456980512128987, 0.45920431597615646, 0.461253730660636, 0.46312988566013263, 0.46483692457790043, 0.4663814603248163, 0.46777206170263985, 0.4690187788874747, 0.47013271206159046, 0.4711256250313582, 0.472009603976347, 0.47279676036350693, 0.47349897639422894, 0.47412769100273144, 0.4746937242780189, 0.4752071381435104, 0.47567713112435867, 0.47611196501055913, 0.4765189211539896, 0.47690428400926127, 0.4772733493483737, 0.4776304543671552, 0.47797902668498315, 0.47832164904914204, 0.47866013642076666, 0.4789956220646968, 0.47932864930669544, 0.4796592657647921, 0.47998711710374736, 0.48031153769088203 ], [ 0.4150750967317524, 0.4146059258355933, 0.4146100397838421, 0.41508596526267433, 0.4160199325043938, 0.4173865987717935, 0.41915038693731915, 0.42126731010495644, 0.42368711563159467, 0.42635556855982015, 0.42921670418013874, 0.4322149070010764, 0.4352967115402736, 0.438412261676381, 0.44151640380668905, 0.4445694208149649, 0.44753743707217236, 0.4503925392955903, 0.4531126651391668, 0.4556813125051272, 0.4580871195047529, 0.46032335934998203, 0.4623873875258726, 0.4642800713408317, 0.46600522502898756, 0.46756906738063053, 0.4689797135983819, 0.4702467087745544, 0.47138060702226875, 0.472392597776458, 0.473294178988664, 0.4740968757383866, 0.4748120020420903, 0.47545046323689316, 0.47602259614220965, 0.47653804416963763, 0.47700566458864313, 0.47743346521184804, 0.47782856780606475, 0.4781971955473353, 0.47854468181777243, 0.4788754975973741, 0.47919329465076643, 0.4795009616661201, 0.47980069049047963, 0.48009404963891683, 0.480382062345868, 0.4806652865812858, 0.48094389467099175, 0.48121775043309334 ], [ 0.4166615674832761, 0.41618595858148866, 0.416177399484558, 0.41663504763103115, 0.41754585792496274, 0.41888527685359583, 0.4206185523178698, 0.42270253198876123, 0.4250877847640324, 0.4277208658525086, 0.430546555104826, 0.4335099253390435, 0.4365581353282536, 0.43964188342029636, 0.4427164963775436, 0.4457426599685524, 0.44868682126138454, 0.4515213073482227, 0.4542242124128934, 0.4567791062577878, 0.45917461438996593, 0.4614039141318417, 0.46346418427769837, 0.4653560385346994, 0.4670829660232689, 0.46865079586321934, 0.47006719753651505, 0.47134122435205383, 0.47248290390685266, 0.4735028768507955, 0.47441208339954777, 0.475221495773449, 0.4759418939426027, 0.4765836816133775, 0.47715673919689827, 0.4776703104702639, 0.47813291970804694, 0.4785523161740983, 0.47893544298680835, 0.479288427484003, 0.4796165903078045, 0.47992447050560133, 0.48021586400784394, 0.480493872907519, 0.4807609630418479, 0.48101902747497033, 0.48126945360942436, 0.48151319181875124, 0.48175082369406363, 0.48198262823050525 ], [ 0.41868965904987304, 0.41821642662375047, 0.41819888208743716, 0.4186366509069736, 0.41951744998774587, 0.420817744783148, 0.42250400808588534, 0.42453445842427295, 0.42686111828512335, 0.42943201797813, 0.4321933789959586, 0.4350916364262093, 0.4380751964137458, 0.44109586470150935, 0.44410991996599797, 0.4470788370546861, 0.44996968843146873, 0.4527552669469471, 0.4554139804213279, 0.45792956999902124, 0.46029070150099743, 0.462490473628573, 0.46452588014744295, 0.4663972560666602, 0.46810773098125125, 0.4696627065704809, 0.47106936994104853, 0.4723362501403037, 0.47347282171112137, 0.47448915653404095, 0.47539562329168616, 0.47620263257316353, 0.4769204247918183, 0.4775588976074292, 0.47812746932613065, 0.4786349747159815, 0.4790895897569882, 0.4794987819907947, 0.4798692833106507, 0.4802070822127158, 0.48051743270184266, 0.4808048772036659, 0.4810732809811534, 0.48132587569267715, 0.4815653098669303, 0.48179370421461254, 0.48201270985351374, 0.48222356769618646, 0.48242716743903924, 0.48262410479708967 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0844902 (SEM: 0)
x1: 0.374395
x2: 0.473328
x3: 0.253384
x4: 0.175281
x5: 0.91134
x6: 0.579642", "Arm 1_0
hartmann6: -0.0307088 (SEM: 0)
x1: 0.585993
x2: 0.236022
x3: 0.224513
x4: 0.497436
x5: 0.761981
x6: 0.86586", "Arm 2_0
hartmann6: -0.0835341 (SEM: 0)
x1: 0.260758
x2: 0.263249
x3: 0.332616
x4: 0.737915
x5: 0.67316
x6: 0.0666684", "Arm 3_0
hartmann6: -0.384019 (SEM: 0)
x1: 0.238416
x2: 0.290649
x3: 0.294604
x4: 0.639106
x5: 0.133313
x6: 0.860378", "Arm 4_0
hartmann6: -0.785275 (SEM: 0)
x1: 0.752805
x2: 0.562042
x3: 0.919162
x4: 0.332665
x5: 0.156489
x6: 0.836415", "Arm 5_0
hartmann6: -0.361091 (SEM: 0)
x1: 0.00784757
x2: 0.645909
x3: 0.94897
x4: 0.305871
x5: 0.0144034
x6: 0.754934", "Arm 6_0
hartmann6: -0.427215 (SEM: 0)
x1: 0.152215
x2: 0.449218
x3: 0.133706
x4: 0.510388
x5: 0.0822845
x6: 0.494617", "Arm 7_0
hartmann6: -0.0291483 (SEM: 0)
x1: 0.0326946
x2: 0.986456
x3: 0.40432
x4: 0.703495
x5: 0.102807
x6: 0.575572", "Arm 8_0
hartmann6: -0.061324 (SEM: 0)
x1: 0.503454
x2: 0.453209
x3: 0.413391
x4: 0.631017
x5: 0.679934
x6: 0.844067", "Arm 9_0
hartmann6: -0.200105 (SEM: 0)
x1: 0.375814
x2: 0.119286
x3: 0.98163
x4: 0.627615
x5: 0.510208
x6: 0.525394", "Arm 10_0
hartmann6: -0.0957961 (SEM: 0)
x1: 0.873167
x2: 0.450857
x3: 0.64219
x4: 0.0955072
x5: 0.387701
x6: 0.264634", "Arm 11_0
hartmann6: -0.576544 (SEM: 0)
x1: 0.213789
x2: 0.505108
x3: 0.611463
x4: 0.0242879
x5: 0.814381
x6: 0.708746", "Arm 12_0
hartmann6: -0.417972 (SEM: 0)
x1: 0.0985943
x2: 0.245195
x3: 0.109072
x4: 0.431905
x5: 0
x6: 0.695178", "Arm 13_0
hartmann6: -0.270188 (SEM: 0)
x1: 0.372133
x2: 0.286031
x3: 0.143069
x4: 0.529643
x5: 2.88188e-14
x6: 0.570268", "Arm 14_0
hartmann6: -1.14149 (SEM: 0)
x1: 0
x2: 0.367709
x3: 0.256513
x4: 0.360625
x5: 0.117116
x6: 0.655752", "Arm 15_0
hartmann6: -1.37966 (SEM: 0)
x1: 1.68014e-11
x2: 0.37561
x3: 0.302376
x4: 0.297549
x5: 0.136556
x6: 0.662402", "Arm 16_0
hartmann6: -1.55812 (SEM: 0)
x1: 0
x2: 0.389754
x3: 0.3532
x4: 0.241469
x5: 0.16101
x6: 0.670775", "Arm 17_0
hartmann6: -1.58217 (SEM: 0)
x1: 2.73201e-16
x2: 0.395481
x3: 0.398349
x4: 0.157199
x5: 0.190189
x6: 0.683941", "Arm 18_0
hartmann6: -1.58945 (SEM: 0)
x1: 9.25717e-17
x2: 0.392143
x3: 0.444687
x4: 0.222179
x5: 0.158972
x6: 0.642449", "Arm 19_0
hartmann6: -1.83 (SEM: 0)
x1: 5.73937e-17
x2: 0.418918
x3: 0.428562
x4: 0.235395
x5: 0.212135
x6: 0.709957", "Arm 20_0
hartmann6: -1.95432 (SEM: 0)
x1: 2.35232e-09
x2: 0.434061
x3: 0.471133
x4: 0.261458
x5: 0.262458
x6: 0.751427", "Arm 21_0
hartmann6: -1.63454 (SEM: 0)
x1: 1.23073e-17
x2: 0.423516
x3: 0.485925
x4: 0.25374
x5: 0.257668
x6: 0.848703", "Arm 22_0
hartmann6: -2.09437 (SEM: 0)
x1: 8.07667e-16
x2: 0.439797
x3: 0.487461
x4: 0.277821
x5: 0.315973
x6: 0.710409", "Arm 23_0
hartmann6: -1.85421 (SEM: 0)
x1: 7.2121e-17
x2: 0.4969
x3: 0.466788
x4: 0.26182
x5: 0.338495
x6: 0.675143" ], "type": "scatter", "x": [ 0.37439489364624023, 0.5859931083396077, 0.2607578504830599, 0.23841649945825338, 0.7528051491826773, 0.007847568951547146, 0.15221494901925325, 0.032694606110453606, 0.5034541748464108, 0.3758140420541167, 0.8731671664863825, 0.21378932800143957, 0.09859432709653, 0.37213269940779775, 0.0, 1.6801446219001503e-11, 0.0, 2.7320105922884477e-16, 9.25717039869366e-17, 5.739366266477024e-17, 2.3523167111013215e-09, 1.2307325359545354e-17, 8.076674496607118e-16, 7.212101339187558e-17 ], "xaxis": "x", "y": [ 0.47332763671875, 0.23602221813052893, 0.2632494177669287, 0.2906491430476308, 0.5620423462241888, 0.6459092097356915, 0.44921839982271194, 0.9864563643932343, 0.45320926886051893, 0.1192864440381527, 0.45085727609694004, 0.5051080957055092, 0.24519461280222607, 0.2860313080329631, 0.3677093875443307, 0.37561037690065663, 0.38975384423886666, 0.3954809232586543, 0.39214308122745667, 0.418918008657315, 0.4340612084842039, 0.4235164868113142, 0.43979729139056456, 0.49690038591059055 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0844902 (SEM: 0)
x1: 0.374395
x2: 0.473328
x3: 0.253384
x4: 0.175281
x5: 0.91134
x6: 0.579642", "Arm 1_0
hartmann6: -0.0307088 (SEM: 0)
x1: 0.585993
x2: 0.236022
x3: 0.224513
x4: 0.497436
x5: 0.761981
x6: 0.86586", "Arm 2_0
hartmann6: -0.0835341 (SEM: 0)
x1: 0.260758
x2: 0.263249
x3: 0.332616
x4: 0.737915
x5: 0.67316
x6: 0.0666684", "Arm 3_0
hartmann6: -0.384019 (SEM: 0)
x1: 0.238416
x2: 0.290649
x3: 0.294604
x4: 0.639106
x5: 0.133313
x6: 0.860378", "Arm 4_0
hartmann6: -0.785275 (SEM: 0)
x1: 0.752805
x2: 0.562042
x3: 0.919162
x4: 0.332665
x5: 0.156489
x6: 0.836415", "Arm 5_0
hartmann6: -0.361091 (SEM: 0)
x1: 0.00784757
x2: 0.645909
x3: 0.94897
x4: 0.305871
x5: 0.0144034
x6: 0.754934", "Arm 6_0
hartmann6: -0.427215 (SEM: 0)
x1: 0.152215
x2: 0.449218
x3: 0.133706
x4: 0.510388
x5: 0.0822845
x6: 0.494617", "Arm 7_0
hartmann6: -0.0291483 (SEM: 0)
x1: 0.0326946
x2: 0.986456
x3: 0.40432
x4: 0.703495
x5: 0.102807
x6: 0.575572", "Arm 8_0
hartmann6: -0.061324 (SEM: 0)
x1: 0.503454
x2: 0.453209
x3: 0.413391
x4: 0.631017
x5: 0.679934
x6: 0.844067", "Arm 9_0
hartmann6: -0.200105 (SEM: 0)
x1: 0.375814
x2: 0.119286
x3: 0.98163
x4: 0.627615
x5: 0.510208
x6: 0.525394", "Arm 10_0
hartmann6: -0.0957961 (SEM: 0)
x1: 0.873167
x2: 0.450857
x3: 0.64219
x4: 0.0955072
x5: 0.387701
x6: 0.264634", "Arm 11_0
hartmann6: -0.576544 (SEM: 0)
x1: 0.213789
x2: 0.505108
x3: 0.611463
x4: 0.0242879
x5: 0.814381
x6: 0.708746", "Arm 12_0
hartmann6: -0.417972 (SEM: 0)
x1: 0.0985943
x2: 0.245195
x3: 0.109072
x4: 0.431905
x5: 0
x6: 0.695178", "Arm 13_0
hartmann6: -0.270188 (SEM: 0)
x1: 0.372133
x2: 0.286031
x3: 0.143069
x4: 0.529643
x5: 2.88188e-14
x6: 0.570268", "Arm 14_0
hartmann6: -1.14149 (SEM: 0)
x1: 0
x2: 0.367709
x3: 0.256513
x4: 0.360625
x5: 0.117116
x6: 0.655752", "Arm 15_0
hartmann6: -1.37966 (SEM: 0)
x1: 1.68014e-11
x2: 0.37561
x3: 0.302376
x4: 0.297549
x5: 0.136556
x6: 0.662402", "Arm 16_0
hartmann6: -1.55812 (SEM: 0)
x1: 0
x2: 0.389754
x3: 0.3532
x4: 0.241469
x5: 0.16101
x6: 0.670775", "Arm 17_0
hartmann6: -1.58217 (SEM: 0)
x1: 2.73201e-16
x2: 0.395481
x3: 0.398349
x4: 0.157199
x5: 0.190189
x6: 0.683941", "Arm 18_0
hartmann6: -1.58945 (SEM: 0)
x1: 9.25717e-17
x2: 0.392143
x3: 0.444687
x4: 0.222179
x5: 0.158972
x6: 0.642449", "Arm 19_0
hartmann6: -1.83 (SEM: 0)
x1: 5.73937e-17
x2: 0.418918
x3: 0.428562
x4: 0.235395
x5: 0.212135
x6: 0.709957", "Arm 20_0
hartmann6: -1.95432 (SEM: 0)
x1: 2.35232e-09
x2: 0.434061
x3: 0.471133
x4: 0.261458
x5: 0.262458
x6: 0.751427", "Arm 21_0
hartmann6: -1.63454 (SEM: 0)
x1: 1.23073e-17
x2: 0.423516
x3: 0.485925
x4: 0.25374
x5: 0.257668
x6: 0.848703", "Arm 22_0
hartmann6: -2.09437 (SEM: 0)
x1: 8.07667e-16
x2: 0.439797
x3: 0.487461
x4: 0.277821
x5: 0.315973
x6: 0.710409", "Arm 23_0
hartmann6: -1.85421 (SEM: 0)
x1: 7.2121e-17
x2: 0.4969
x3: 0.466788
x4: 0.26182
x5: 0.338495
x6: 0.675143" ], "type": "scatter", "x": [ 0.37439489364624023, 0.5859931083396077, 0.2607578504830599, 0.23841649945825338, 0.7528051491826773, 0.007847568951547146, 0.15221494901925325, 0.032694606110453606, 0.5034541748464108, 0.3758140420541167, 0.8731671664863825, 0.21378932800143957, 0.09859432709653, 0.37213269940779775, 0.0, 1.6801446219001503e-11, 0.0, 2.7320105922884477e-16, 9.25717039869366e-17, 5.739366266477024e-17, 2.3523167111013215e-09, 1.2307325359545354e-17, 8.076674496607118e-16, 7.212101339187558e-17 ], "xaxis": "x2", "y": [ 0.47332763671875, 0.23602221813052893, 0.2632494177669287, 0.2906491430476308, 0.5620423462241888, 0.6459092097356915, 0.44921839982271194, 0.9864563643932343, 0.45320926886051893, 0.1192864440381527, 0.45085727609694004, 0.5051080957055092, 0.24519461280222607, 0.2860313080329631, 0.3677093875443307, 0.37561037690065663, 0.38975384423886666, 0.3954809232586543, 0.39214308122745667, 0.418918008657315, 0.4340612084842039, 0.4235164868113142, 0.43979729139056456, 0.49690038591059055 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:21.868915Z", "iopub.status.busy": "2022-09-28T16:17:21.868456Z", "iopub.status.idle": "2022-09-28T16:17:22.354925Z", "shell.execute_reply": "2022-09-28T16:17:22.354341Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:21] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.922112101555005, 0.9207797497167227, 0.9199083977559759, 0.9195144002205187, 0.9196130111493506, 0.9202182324279105, 0.9213426606212738, 0.9229973357753966, 0.9251915968162946, 0.9279329491843067, 0.9312269509490019, 0.935077123557094, 0.9394848923029718, 0.9444495594397891, 0.9499683096566627, 0.9560362438109555, 0.9626464329723561, 0.9697899818144617, 0.9774560889438497, 0.9856320923900259, 0.9943034912735541, 1.0034539392476054, 1.0130652109215905, 1.0231171481749854, 1.0335875980895286, 1.0444523573596587, 1.0556851389754347, 1.067257575603957, 1.0791392707493062, 1.0912979041233504, 1.1036993925615033, 1.1163081030814377, 1.1290871109114797, 1.141998492816405, 1.1550036448484597, 1.1680636135709024, 1.1811394305531435, 1.1941924412114768, 1.2071846205942585, 1.2200788702761372, 1.2328392919943687, 1.245431434953481, 1.2578225148137392, 1.269981603266427, 1.281879787806375, 1.2934903018702786, 1.3047886259493349, 1.3157525606357887, 1.3263622728477837, 1.3366003167126093 ], [ 0.9208198409813864, 0.9195255591728307, 0.9186970645516181, 0.91835077085573, 0.9185019683633185, 0.9191646693595646, 0.920351451206214, 0.9220733005183175, 0.924339463331764, 0.9271573074621459, 0.9305322041996082, 0.9344674366753102, 0.9389641413030017, 0.9440212864025233, 0.9496356884693636, 0.9558020619468647, 0.9625130935362072, 0.9697595280466104, 0.9775302505542955, 0.9858123499348332, 0.9945911518752636, 1.0038502148828867, 1.0135712896969034, 1.0237342496798711, 1.0343170059528588, 1.0452954251521853, 1.056643269024503, 1.0683321734872486, 1.0803316806954495, 1.0926093319719596, 1.1051308232868795, 1.117860219339695, 1.1307602179277043, 1.1437924535046826, 1.1569178276193564, 1.1700968540079446, 1.1832900071236134, 1.1964580644389167, 1.2095624346364697, 1.2225654655764613, 1.2354307275519116, 1.2481232687412591, 1.260609840921555, 1.2728590944280702, 1.2848417420686042, 1.2965306922612136, 1.3079011521009862, 1.318930701406999, 1.3295993390806904, 1.339889503339513 ], [ 0.9198695880213541, 0.9186197910622896, 0.9178403149570993, 0.9175475957057422, 0.9177569226988456, 0.9184822819691411, 0.9197361960924286, 0.9215295641503928, 0.9238715067911567, 0.9267692230845785, 0.9302278672157747, 0.934250453629847, 0.9388377985448959, 0.9439885034147115, 0.9496989818631231, 0.9559635261839494, 0.9627744035495941, 0.9701219668157107, 0.9779947615571771, 0.9863796107449099, 0.9952616616868162, 1.0046243861635216, 1.0144495330522636, 1.0247170416541267, 1.0354049317786704, 1.0464891919429344, 1.0579436888598583, 1.0697401195131129, 1.081848022121348, 1.0942348553731198, 1.1068661478968678, 1.11970571329727, 1.132715921088167, 1.1458580108156573, 1.1590924354885903, 1.1723792207422306, 1.1856783274758806, 1.1989500075711097, 1.212155144349646, 1.2252555714176039, 1.2382143653179054, 1.2509961089106225, 1.2635671236122372, 1.275895669575071, 1.2879521136189145, 1.2997090652856524, 1.3111414818174736, 1.3222267431974404, 1.332944698665545, 1.3432776863525366 ], [ 0.9192687273334395, 0.9180699463955815, 0.9173457513143077, 0.9171125605595459, 0.9173856225074487, 0.9181788573292935, 0.9195046945553722, 0.9213739095110375, 0.9237954636817822, 0.9267763560904838, 0.9303214945784299, 0.9344335969272077, 0.9391131314189991, 0.9443583041730228, 0.9501650961870096, 0.9565273467475339, 0.9634368726705287, 0.9708836061426362, 0.9788557294095119, 0.9873397835895317, 0.9963207321639993, 1.0057819669401717, 1.015705254313427, 1.0260706306219078, 1.036856265182259, 1.048038316306986, 1.059590807973054, 1.0714855525636642, 1.0836921390190657, 1.0961779973630232, 1.1089085417431817, 1.1218473864005543, 1.1349566233387518, 1.1481971472087535, 1.161529011847681, 1.1749118035021955, 1.1883050174336767, 1.2016684268084852, 1.2149624351141262, 1.2281484055447343, 1.241188962721654, 1.2540482637036483, 1.2666922365012208, 1.2790887852797383, 1.2912079621694903, 1.303022106153016, 1.314505949920378, 1.325636695912395, 1.3363940630397415, 1.3467603057918578 ], [ 0.9190235944025036, 0.9178824370501406, 0.9172198468804069, 0.9170521821895623, 0.9173946071201142, 0.9182609332098343, 0.9196634556948153, 0.9216127874166161, 0.9241176952536445, 0.9271849463923978, 0.9308191740693935, 0.9350227740277381, 0.9397958430787924, 0.9451361691138783, 0.9510392772584731, 0.957498529783438, 0.9645052688464034, 0.9720489828132857, 0.980117470850779, 0.9886969785227385, 0.9977722803043017, 1.0073266931191625, 1.0173420168773282, 1.02779841129188, 1.0386742303109828, 1.0499458438408478, 1.061587479418694, 1.073571113785913, 1.0858664369447375, 1.09844090126569, 1.1112598578280382, 1.1242867733010184, 1.1374835143950615, 1.150810683491723, 1.1642279881466366, 1.1776946280896492, 1.1911696854007379, 1.2046125061040605, 1.2179830640483285, 1.2312423003534085, 1.2443524337631373, 1.2572772389130837, 1.2699822908214204, 1.2824351748935472, 1.2946056624618352, 1.3064658524241393, 1.3179902799536114, 1.329155993572042, 1.3399426021406848, 1.35033229354595 ], [ 0.9191394066247466, 0.9180625137932343, 0.9174678711055234, 0.9173717313391739, 0.9177891281360866, 0.9187337183778332, 0.920217618538459, 0.9222512373852161, 0.9248431096359326, 0.9279997379270053, 0.9317254532917295, 0.9360223066062365, 0.9408900042201764, 0.9463258993151867, 0.9523250457787719, 0.9588803135647548, 0.9659825545926908, 0.9736207981218792, 0.9817824466934308, 0.9904534405236693, 0.9996183611393922, 1.0092604541509522, 1.0193615649081855, 1.0299019966768008, 1.0408603155724339, 1.0522131366533012, 1.0639349292189357, 1.0759978760977076, 1.0883718128865383, 1.1010242612754728, 1.1139205585444811, 1.1270240752674576, 1.1402965063800004, 1.1536982172407644, 1.1671886256238349, 1.1807266018893303, 1.1942708720434774, 1.2077804113252781, 1.2212148188644707, 1.2345346665646184, 1.2477018175492967, 1.260679711246794, 1.2734336135177633, 1.2859308312187343, 1.298140891317858, 1.3100356852093396, 1.3215895792696435, 1.3327794930087378, 1.3435849464256808, 1.3539880784001106 ], [ 0.9196202009924684, 0.9186142011123727, 0.9180938219297732, 0.9180751629785725, 0.918573078314394, 0.9196010209839218, 0.9211708809397349, 0.923292818170997, 0.9259750951654331, 0.929223915870343, 0.9330432816918438, 0.9374348780243887, 0.9423980062905354, 0.9479295753297468, 0.9540241612894724, 0.9606741367416181, 0.9678698584773843, 0.9755998914218069, 0.983851236275219, 0.9926095237757816, 1.0018591409080133, 1.0115832643224631, 1.0217637921327611, 1.0323811839291732, 1.0434142362076073, 1.054839832550403, 1.0666327122326362, 1.0787652970242452, 1.0912076055567113, 1.1039272708702321, 1.1168896630071894, 1.1300581073052203, 1.14339418161839, 1.1568580721217223, 1.1704089669287296, 1.1840054684640289, 1.1976060084098126, 1.2111692523228963, 1.2246544841919202, 1.2380219639930143, 1.2512332535952537, 1.2642515081608818, 1.2770417315356066, 1.2895709951132988, 1.3018086203729213, 1.3137263258024912, 1.3252983393093483, 1.336501477517736, 1.3473151936065781, 1.3577215955626813 ], [ 0.9204687796749396, 0.919540240190132, 0.9191003664354176, 0.9191650551103167, 0.9197489292321173, 0.9208651860123712, 0.9225254379941815, 0.9247395485225632, 0.9275154649960508, 0.9308590566392814, 0.9347739673950526, 0.9392614981997449, 0.9443205352080748, 0.9499475400785711, 0.9561366140065443, 0.9628796383231385, 0.9701664819570059, 0.9779852521301313, 0.986322552695162, 0.9951637080953362, 1.0044929126763473, 1.014293275728994, 1.0245467505836205, 1.035233957615435, 1.0463339312542446, 1.0578238352787044, 1.0696786957049422, 1.0818711959847924, 1.09437156718676, 1.1071475901393792, 1.1201647110931099, 1.1333862601489846, 1.1467737537989497, 1.160287259352566, 1.1738857988872144, 1.1875277724719298, 1.2011713836854907, 1.214775054053948, 1.2282978164450966, 1.241699680403767, 1.2549419647967484, 1.2679875949745234, 1.2808013630218396, 1.2933501506549745, 1.3056031150263525, 1.3175318382012573, 1.329110441445405, 1.3403156657571185, 1.351126920327502, 1.3615263008363345 ], [ 0.9216866648309011, 0.920842041431336, 0.9204887912914825, 0.920642557530447, 0.921317679004168, 0.9225270428828167, 0.9242819307467722, 0.9265918585105378, 0.9294644128043312, 0.9329050898824229, 0.9369171474016383, 0.9415014837653499, 0.9466565628907819, 0.952378402618086, 0.9586606410102401, 0.9654946857041723, 0.9728699378773464, 0.9807740666390014, 0.9891932955236196, 0.9981126544863981, 1.0075161516805047, 1.0173868304845162, 1.0277066971163644, 1.0384565285160363, 1.0496155932605347, 1.061161334485395, 1.0730690694841265, 1.0853117553666491, 1.0978598565184337, 1.1106813320604654, 1.1237417445324351, 1.1370044777282435, 1.1504310433056684, 1.1639814522539385, 1.177614627445982, 1.1912888359833327, 1.2049621236651102, 1.2185927378031143, 1.2321395282230148, 1.2455623193704364, 1.2588222489002632, 1.271882070000821, 1.2847064160786164, 1.2972620274109339, 1.3095179400660686, 1.3214456378846358, 1.3330191686811783, 1.3442152261162283, 1.3550131989389262, 1.3653951895286789 ], [ 0.9232740639833887, 0.9225196479877078, 0.9222589645141288, 0.9225073520878562, 0.92327881154187, 0.9245858645026588, 0.9264394061720967, 0.9288485519290932, 0.9318204794468784, 0.9353602715003025, 0.9394707692221095, 0.9441524505343941, 0.9494033525001613, 0.9552190576024807, 0.9615927606253641, 0.9685154237459392, 0.9759760130315368, 0.98396179214578, 0.99245863285769, 1.0014512917811278, 1.0109236026421566, 1.0208585448915555, 1.0312381710417187, 1.042043402032289, 1.0532537256577446, 1.064846851182367, 1.0767983795806952, 1.089081542917735, 1.101667051309953, 1.1145230667356874, 1.1276153046411523, 1.1409072501594533, 1.1543604671217782, 1.167934974537845, 1.1815896656048277, 1.1952827470920133, 1.20897218086201, 1.222616113412335, 1.2361732831043715, 1.2496033979302028, 1.2628674791860641, 1.2759281683203696, 1.2887499956052249, 1.3012996102580408, 1.3135459723248817, 1.3254605071233818, 1.3370172234045827, 1.3481927966829097, 1.3589666194366634, 1.3693208201162659 ], [ 0.9252298472119092, 0.9245717116955255, 0.9244093100975975, 0.9247576260908453, 0.9256302690182401, 0.9270393393458154, 0.9289952897602851, 0.931506780671969, 0.9345805308163652, 0.9382211670456455, 0.9424310821635441, 0.9472103151239248, 0.9525564727278777, 0.9584647141518416, 0.9649278170895881, 0.9719363355062961, 0.9794788440846298, 0.9875422457303991, 0.9961121004434917, 1.005172921891573, 1.0147083868052085, 1.0247014139305692, 1.0351340921792773, 1.045987466710173, 1.0572412196697647, 1.0688733020270065, 1.080859579793231, 1.0931735514963863, 1.1057861775600464, 1.118665841775669, 1.1317784456796927, 1.1450876218664219, 1.1585550433637546, 1.172140802709911, 1.185803834917471, 1.1995023615179696, 1.2131943370022693, 1.2268378832626767, 1.2403917015457273, 1.253815454684141, 1.2670701149372312, 1.280118274688221, 1.2929244186334472, 1.3054551570748767, 1.317679420608911, 1.3295686169879242, 1.3410967512921057, 1.3522405108421551, 1.3629793165427946, 1.3732953425906147 ], [ 0.9275515372456897, 0.9269954827092555, 0.9269367969988924, 0.9273900605245583, 0.928368439334373, 0.9298835583946964, 0.9319453724530062, 0.9345620325481697, 0.9377397478430737, 0.9414826456488377, 0.9457926372985122, 0.9506693033402043, 0.9561098170145239, 0.9621089280852838, 0.9686590274277037, 0.9757503045188661, 0.9833709949196242, 0.9915076952157176, 1.0001457033382295, 1.0092693286313694, 1.0188621137258236, 1.0289069217431606, 1.0393858661410376, 1.0502800911934524, 1.0615694407994007, 1.0732320742621948, 1.0852440949912538, 1.0975792513632616, 1.1102087520158137, 1.1231012165380605, 1.1362227624489023, 1.1495372141263398, 1.1630064102407836, 1.1765905827237193, 1.190248780919702, 1.2039393176867013, 1.2176202184443783, 1.2312496585558725, 1.2447863784015427, 1.258190068809498, 1.2714217220960478, 1.2844439459027523, 1.2972212384098138, 1.3097202244844341, 1.321909853005973, 1.3337615560957212, 1.345249371344925, 1.3563500284347254, 1.3670430018104978, 1.3773105313283311 ], [ 0.9302353132542313, 0.929786813846122, 0.929836943736807, 0.9303998345980204, 0.9314881603531696, 0.9331130189141074, 0.9352838140096588, 0.9380081345813605, 0.9412916304393398, 0.9451378857452155, 0.9495482965440343, 0.9545219645431947, 0.9600556253473034, 0.9661436332790536, 0.9727780241806713, 0.9799486700736533, 0.9876435247486655, 0.9958489393207358, 1.0045500062375905, 1.0137308754337344, 1.0233749829989456, 1.0334651437990958, 1.0439834836081723, 1.0549112178676758, 1.066228314903126, 1.0779131031563056, 1.0899418896569644, 1.1022886502063873, 1.114924834512744, 1.127819307875176, 1.1409384306405734, 1.1542462612047781, 1.1677048590664603, 1.181274660830404, 1.1949149026300734, 1.2085840655458089, 1.2222403248380036, 1.2358419882173315, 1.2493479123654136, 1.2627178902414413, 1.2759130043114695, 1.2888959427802977, 1.3016312773067502, 1.31408570166913, 1.3262282315382246, 1.338030366009399, 1.349466211921036, 1.3605125722978144, 1.3711490005391265, 1.381357822241854 ], [ 0.9332760287226098, 0.9329401802354493, 0.9331038394562754, 0.933780647775769, 0.9349827423939939, 0.9367206469007032, 0.9390031649730755, 0.9418372742135237, 0.9452280179218673, 0.949178395046114, 0.9536892529220041, 0.9587591933550972, 0.9643845089275689, 0.9705591710070376, 0.9772748911135869, 0.9845212707017981, 0.9922860402405014, 1.0005553685599926, 1.0093142024617907, 1.018546580986919, 1.0282358645477914, 1.038364829567508, 1.048915603138841, 1.0598694438475151, 1.071206405861306, 1.0829049453880788, 1.0949415365221833, 1.1072903569890178, 1.1199230873027444, 1.1328088454096714, 1.1459142586307896, 1.1592036592659414, 1.17263938086425, 1.186182128406055, 1.199791396058793, 1.213425909142532, 1.2270440710857566, 1.2406044004911934, 1.2540659473874547, 1.2673886810487425, 1.280533844363105, 1.2934642716778848, 1.306144668460827, 1.3185418521130283, 1.3306249539734984, 1.3423655830633827, 1.3537379525084294, 1.3647189699051567, 1.375288293193873, 1.3854283538869545 ], [ 0.9366672432825954, 0.9364487142983913, 0.936730181705385, 0.937524759837751, 0.9388440099047637, 0.9406978395673355, 0.9430944090883229, 0.9460400407797298, 0.9495391287623145, 0.9535940479954486, 0.9582050654697841, 0.9633702621725119, 0.9690854808637457, 0.9753443197897332, 0.98213819348338, 0.9894564762429638, 0.997286730687684, 1.0056150045425891, 1.014426158016008, 1.0237041682281445, 1.0334323522943578, 1.0435934602713561, 1.0541696122040594, 1.0651420844074564, 1.0764909805353373, 1.0881948447496057, 1.1002302823623094, 1.1125716473192169, 1.1251908396200612, 1.138057235040266, 1.151137749772005, 1.1643970273795345, 1.177797726078674, 1.1913008803992864, 1.2048663114507734, 1.2184530627360681, 1.2320198424041193, 1.245525457027695, 1.258929225859648, 1.2721913677789782, 1.285273355716329, 1.2981382352953557, 1.310750905845671, 1.3230783629561462, 1.3350899024592136, 1.3467572862643544, 1.3580548708693778, 1.3689596997241953, 1.3794515609387463, 1.389513012130053 ], [ 0.9404012677857567, 0.9403042554063393, 0.94070733040712, 0.9416230486725752, 0.9430623623446776, 0.9450345283402538, 0.9475470272176747, 0.950605488973838, 0.9542136221510196, 0.9583731440085917, 0.9630837128990699, 0.9683428693012783, 0.9741459982761058, 0.9804863314873654, 0.987355008690139, 0.9947412141346481, 1.0026323914190907, 1.0110145222489257, 1.0198724345570493, 1.0291900897426698, 1.0389507935025188, 1.0491372833403936, 1.0597316674957964, 1.0707152194406533, 1.0820680612425775, 1.0937687901363715, 1.1057941107310163, 1.1181185300002412, 1.130714157066034, 1.1435506302131946, 1.1565951746968701, 1.169812780128727, 1.1831664768960477, 1.1966176869058345, 1.2101266237738926, 1.223652719959929, 1.2371550620018694, 1.2505928189831332, 1.2639256530902396, 1.2771141042941903, 1.290119943728766, 1.3029064922762315, 1.3154389022980186, 1.327684401478938, 1.3396124984974, 1.351195150785705, 1.3624068950786086, 1.3732249418174767, 1.3836292348158292, 1.3936024779157081 ], [ 0.944469221310507, 0.9444974128487559, 0.9450253766569718, 0.9460650845217046, 0.9476268531950912, 0.9497192616273509, 0.9523490825160399, 0.9555212247588464, 0.95923868270621, 0.9635024888834633, 0.9683116695984908, 0.9736632076104761, 0.9795520220350145, 0.985970981123903, 0.992910965915581, 1.0003609994147347, 1.0083084455438067, 1.0167392656313068, 1.0256383015231163, 1.034989539396754, 1.044776302891699, 1.0549813316855714, 1.065586721486873, 1.0765737287001578, 1.087922470281923, 1.0996115692143, 1.111617804014766, 1.1239158162915268, 1.1364779166611747, 1.1492740112846986, 1.162271653573177, 1.175436211485059, 1.1887311316552354, 1.2021182772315406, 1.2155583157429444, 1.229011135287931, 1.2424362706161252, 1.2557933243745414, 1.2690423723212227, 1.282144344368765, 1.2950613758009153, 1.3077571249226352, 1.3201970548353843, 1.332348678078322, 1.3441817636446989, 1.3556685064616671, 1.3667836598826366, 1.377504632136415, 1.3878115480394864, 1.3976872776232359 ], [ 0.9488610982678336, 0.9490176400763819, 0.9496732241526566, 0.9508392183874731, 0.9525252848170557, 0.9547393052186658, 0.9574873250482936, 0.9607735124413787, 0.9646001278378304, 0.9689674999555767, 0.9738740058890821, 0.9793160572031888, 0.9852880994148128, 0.9917826376182446, 0.9987903038159573, 1.0062999792601928, 1.014298976332331, 1.022773269928659, 1.0317077514027566, 1.0410864642122002, 1.050892775003479, 1.06110944025056, 1.0717185462773555, 1.0827013251839985, 1.0940378740988461, 1.1057068236199894, 1.117685009078577, 1.1299471947824087, 1.14246588934119, 1.1552112738667897, 1.1681512485358831, 1.1812515896950984, 1.1944762007611067, 1.207787435639769, 1.2211464724448853, 1.2345137168013796, 1.247849216879297, 1.2611130756676805, 1.2742658492920071, 1.287268923089103, 1.3000848595534222, 1.3126777141527142, 1.3250133164402487, 1.3370595149558953, 1.3487863852019664, 1.360166400587671, 1.3711745667260826, 1.3817885198903403, 1.391988590823269, 1.4017578354628188 ], [ 0.9535658433860057, 0.9538533176739412, 0.9546386803925063, 0.9559326814575313, 0.9577443157906876, 0.9600807568445191, 0.9629473124209289, 0.9663473997393016, 0.9702825351155363, 0.9747523331789837, 0.979754511891599, 0.9852849029909283, 0.9913374724012044, 0.9979043602646116, 1.0049759533534204, 1.0125410013736695, 1.0205867815830503, 1.0290993037077665, 1.0380635322922276, 1.0474635911334138, 1.0572829093013945, 1.0675042735167581, 1.0781097670760735, 1.0890805973190054, 1.1003968358630067, 1.1120371125650823, 1.1239783115866522, 1.1361953153807633, 1.148660832071431, 1.1613453272668846, 1.1742170665915215, 1.1872422628764092, 1.2003853133809705, 1.213609107789128, 1.226875386406199, 1.2401451290137926, 1.2533789572462388, 1.2665375363401887, 1.2795819651297233, 1.2924741458900397, 1.3051771279296154, 1.3176554206667856, 1.3298752733452823, 1.3418049196195991, 1.3534147860585084, 1.3646776642518945, 1.3755688467259741, 1.3860662273235735, 1.396150367119827, 1.4058045273351651 ], [ 0.9585714321759946, 0.9589918422444023, 0.9599085543820606, 0.9613316918388465, 0.9632695766075742, 0.9657286704028414, 0.9687135416892797, 0.9722268560208869, 0.9762693849662804, 0.9808400278980297, 0.9859358415562359, 0.9915520748887213, 0.9976822109172313, 1.0043180221136718, 1.0114496490500193, 1.0190657117388724, 1.0271534576582126, 1.035698940214173, 1.0446872087822792, 1.0541024806136747, 1.0639282601793545, 1.074147375761846, 1.0847419162010379, 1.0956930695050537, 1.1069808844511275, 1.118583991178585, 1.1304793237163895, 1.142641885662297, 1.1550445915547147, 1.167658203953549, 1.1804513731110144, 1.193390774829904, 1.2064413340003883, 1.2195665166534104, 1.2327286717241723, 1.245889404291404, 1.2590099639994647, 1.2720516349614819, 1.284976116160913, 1.297745883894536, 1.3103245299716788, 1.3226770711570979, 1.3347702267415158, 1.3465726622053293, 1.3580551977781508, 1.3691909813610055, 1.3799556258271928, 1.3903273111981045, 1.4002868526301568, 1.4098177355642136 ], [ 0.9638649545401746, 0.9644197184068785, 0.9654687575417527, 0.9670215647483, 0.9690857892999627, 0.9716671848879526, 0.974769587073835, 0.9783949178526634, 0.9825432126050644, 0.9872126632079018, 0.9923996710381415, 0.9980989054406479, 1.0043033667705874, 1.0110044574057597, 1.0181920674623093, 1.0258546823836736, 1.0339795157203502, 1.0425526623424295, 1.0515592569897843, 1.0609836139391824, 1.0708093194197457, 1.0810192517363941, 1.0915955149274708, 1.1025192876373253, 1.1137706054768248, 1.1253281081052746, 1.1371687886213238, 1.1492677818226393, 1.1615982207743896, 1.1741311804404169, 1.1868357156182343, 1.1996789902535814, 1.212626487648681, 1.2256422864855314, 1.2386893856785595, 1.2517300612211246, 1.2647262396793921, 1.277639875174843, 1.290433319098043, 1.3030696740965042, 1.315513125907556, 1.327729248299739, 1.3396852777495531, 1.351350355557608, 1.3626957359604093, 1.3736949594813779, 1.3843239913417154, 1.3945613252589464, 1.4043880534268784, 1.4137879039085357 ], [ 0.9694326994818985, 0.9701226514257371, 0.9713044048297492, 0.9729868226106773, 0.9751768868451463, 0.9778796532160703, 0.981098238033818, 0.9848338357920104, 0.9890857626051713, 0.9938515189187114, 0.9991268642388434, 1.0049058977526089, 1.0111811415479157, 1.017943626938692, 1.0251829877074836, 1.0328875651676832, 1.0410445275216467, 1.049639999953243, 1.058659193759416, 1.0680865154306345, 1.0779056330931258, 1.0880994802966637, 1.0986501859543951, 1.1095389323216533, 1.1207457567865948, 1.132249324307331, 1.1440267030109628, 1.1560531749802292, 1.168302108516165, 1.1807449091850974, 1.1933510570095909, 1.2060882281288128, 1.218922492299254, 1.2318185731557632, 1.2447401560577869, 1.257650228128447, 1.2705114361608312, 1.2832864498590133, 1.2959383199600878, 1.3084308228449948, 1.3207287851148246, 1.3327983832071988, 1.3446074144443434, 1.356125536968423, 1.3673244768791593, 1.3781782015950363, 1.3886630590603062, 1.3987578829526273, 1.408444064535796, 1.4177055922620325 ], [ 0.9752602393571453, 0.9760856385496721, 0.9773999137303961, 0.979211302218079, 0.9815261289358042, 0.9843487669147859, 0.9876816329959303, 0.9915252170281976, 0.9958781400235692, 1.000737234395172, 1.0060976382313274, 1.0119528960331499, 1.0182950605214194, 1.025114793416386, 1.0324014663023415, 1.0401432643016015, 1.0483272941036337, 1.056939693702086, 1.0659657351015541, 1.0753899055166714, 1.0851959497817176, 1.0953668586648233, 1.1058847948066584, 1.116730958574943, 1.1278854075104745, 1.139326852286216, 1.1510324570512613, 1.1629776719157499, 1.1751361207723372, 1.1874795601994452, 1.1999779167003441, 1.2125994016037587, 1.2253106966417564, 1.2380771989820254, 1.2508633122858475, 1.2636327698426733, 1.2763489765199663, 1.288975357687979, 1.3014757050406114, 1.313814511050922, 1.325957285498521, 1.3378708489967606, 1.3495235997060941, 1.3608857504606546, 1.3719295343936733, 1.3826293778665453, 1.3929620401267646, 1.4029067196745295, 1.4124451278292491, 1.4215615304671756 ], [ 0.9813325127031678, 0.9822930578526715, 0.9837390996002271, 0.9856782570787153, 0.9881162118106739, 0.9910566738649185, 0.9945013853482665, 0.9984501598371254, 1.0029009533463547, 1.007849959800028, 1.0132917223501374, 1.0192192517997478, 1.0256241449638868, 1.0324966986182302, 1.039826017746075, 1.0476001188037454, 1.0558060285962594, 1.0644298767712244, 1.073456975673377, 1.0828718770850756, 1.0926583932702252, 1.102799571277977, 1.1132776149672776, 1.124073757593281, 1.135168096942262, 1.1465394125647568, 1.1581649888524326, 1.1700204678095278, 1.1820797517735238, 1.1943149702168605, 1.20669651759014, 1.2191931622863308, 1.2317722211517668, 1.2443997899993011, 1.257041018334534, 1.2696604157507974, 1.2822221778087275, 1.2946905202980021, 1.3070300122372598, 1.3192058995440554, 1.331184412828832, 1.3429330541406137, 1.3544208586816309, 1.3656186285151273, 1.3764991361400476, 1.3870372965314401, 1.397210306880097, 1.4069977538375353, 1.4163816886024805, 1.4253466706828775 ], [ 0.9876339052867452, 0.988728754114229, 0.9903052667635464, 0.9923704541514605, 0.9949293710855163, 0.9979850877064562, 1.0015386999013802, 1.005589377551506, 1.0101344463608664, 1.0151694961569866, 1.0206885065827804, 1.0266839805363495, 1.0331470767650932, 1.0400677353886878, 1.0474347930052128, 1.0552360863241668, 1.0634585439931963, 1.0720882650560477, 1.0811105797902, 1.0905100858070063, 1.1002706508596556, 1.1103753750471792, 1.1208065093654758, 1.131545334080842, 1.142572007602128, 1.1538654025759707, 1.1654029493786744, 1.177160507376471, 1.1891122814890185, 1.2012307965892437, 1.2134869362634484, 1.2258500465401916, 1.2382881001867103, 1.2507679135076284, 1.2632554053604035, 1.27571588717777, 1.2881143728758908, 1.3004158983078782, 1.3125858411003537, 1.3245902330534658, 1.3363960586294872, 1.3479715343057868, 1.3592863646795166, 1.3703119721759167, 1.3810216980439316, 1.3913909730467335, 1.4013974568979959, 1.4110211460805164, 1.420244450229222, 1.4290522377732175 ], [ 0.9941483295415033, 0.9953761219352482, 0.9970812955597403, 0.9992702651421513, 1.0019474776885549, 1.005115388879854, 1.0087744795757725, 1.0129233114968048, 1.0175586179804128, 1.0226754227053614, 1.0282671770434944, 1.034325905756661, 1.0408423513591731, 1.0478061094282896, 1.055205749823327, 1.063028921239385, 1.0712624379039826, 1.079892347097379, 1.088903974805438, 1.0982819451116752, 1.1080101681175196, 1.118071792245044, 1.1284491200584537, 1.1391234917400466, 1.1500751459120142, 1.1612830722172918, 1.1727248728120439, 1.18437665011327, 1.196212935885519, 1.2082066726697904, 1.2203292535487265, 1.2325506211934887, 1.2448394227405224, 1.2571632137091484, 1.269488702025133, 1.281782022182069, 1.2940090294443682, 1.3061356045180597, 1.3181279600406983, 1.329952941365111, 1.3415783152833192, 1.352973041461595, 1.3641075223850978, 1.3749538285247005, 1.3854858962450107, 1.3956796966882572, 1.4055133745141621, 1.4149673559704226, 1.4240244263245057, 1.4326697772124193 ], [ 1.0008593029345974, 1.0022181867618623, 1.0040497261436245, 1.0063597532776232, 1.0091521279026525, 1.0124287183445013, 1.0161894233294233, 1.0204322337862415, 1.0251533306780847, 1.0303472118258514, 1.0360068382734733, 1.0421237895156052, 1.0486884171437647, 1.0556899880702522, 1.0631168109545523, 1.0709563420081376, 1.0791952682199606, 1.0878195667800012, 1.0968145391725315, 1.1061648176799717, 1.1158543417740852, 1.125866302850608, 1.1361830582968167, 1.1467860196603423, 1.1576555238884854, 1.1687707001967689, 1.1801093472151027, 1.1916478351739734, 1.203361046056702, 1.2152223613024464, 1.2272037024768843, 1.2392756260396192, 1.2514074695068258, 1.2635675433006541, 1.2757233605429734, 1.2878418959596885, 1.2998898647688761, 1.3118340127323047, 1.3236414092526325, 1.3352797363206776, 1.3467175671237381, 1.3579246291251064, 1.368872047364709, 1.3795325645885446, 1.3898807355886578, 1.3998930938361218, 1.4095482891315463, 1.4188271955950218, 1.4277129898808307, 1.4361912000353456 ], [ 1.0077500259762757, 1.0092376847281064, 1.0111928401573507, 1.013620756884576, 1.0165247290366344, 1.019906065661086, 1.0237641171232745, 1.0280963418058522, 1.0328984092884022, 1.038164333092315, 1.0438866235644366, 1.0500564500394958, 1.0566638013653498, 1.063697635167138, 1.0711460084756834, 1.0789961849073362, 1.0872347157789082, 1.095847493923566, 1.1048197795020789, 1.1141361971598343, 1.1237807040939325, 1.1337365295540234, 1.1439860882804014, 1.1545108732114049, 1.1652913359038124, 1.1763067657581914, 1.1875351806556071, 1.1989532416087383, 1.2105362024930406, 1.222257903164213, 1.2340908107945743, 1.2460061106274103, 1.2579738440282942, 1.2699630890272973, 1.281942176646849, 1.2938789352026099, 1.3057409543519751, 1.3174958607960248, 1.3291115980521455, 1.3405567034560586, 1.3518005764044534, 1.3628137327271526, 1.3735680409284128, 1.3840369368340775, 1.3941956139175584, 1.404021187257465, 1.4134928297124418, 1.422591879494571, 1.4313019188885499, 1.4396088244018994 ], [ 1.0148034605565792, 1.016417142221589, 1.018492741416767, 1.021034971165204, 1.024046582365659, 1.0275283533088853, 1.0314791199902338, 1.0358958465900208, 1.0407737324272122, 1.0461063486400288, 1.0518857953036906, 1.0581028681322646, 1.0647472236327764, 1.0718075326064698, 1.079271613927848, 1.0871265430438501, 1.0953587320321303, 1.1039539798995428, 1.1128974929582571, 1.1221738757904056, 1.1317670939245204, 1.141660410328838, 1.1518362994113671, 1.1622763443232016, 1.1729611256197783, 1.1838701112199186, 1.194981558625291, 1.2062724402244605, 1.2177184011740136, 1.2292937570392715, 1.2409715354672373, 1.2527235630833202, 1.2645205959339219, 1.2763324894139727, 1.2881284018669272, 1.2998770249524045, 1.311546833382608, 1.3231063466220923, 1.3345243954955992, 1.3457703872315343, 1.356814563180202, 1.3676282442083543, 1.3781840595342667, 1.3884561555016681, 1.3984203814850669, 1.408054450772978, 1.417338074893906, 1.4262530704393597, 1.4347834380022306, 1.4429154133884023 ], [ 1.0220024090934188, 1.023738955861173, 1.0259314365277798, 1.0285840293279847, 1.0316989647491275, 1.0352765188914903, 1.039315047085638, 1.0438110571505996, 1.0487593187182982, 1.0541530020831658, 1.059983837517492, 1.066242284363082, 1.072917698768573, 1.079998489745636, 1.0874722550461842, 1.095325890778577, 1.1035456711707872, 1.1121172970333169, 1.1210259130816733, 1.1302560954178515, 1.139791811402903, 1.1496163551803658, 1.1597122634218933, 1.1700612174402232, 1.180643939419639, 1.1914400917974077, 1.2024281894458644, 1.2135855340327106, 1.2248881787428854, 1.2363109295795973, 1.247827387003418, 1.2594100290469539, 1.2710303345630751, 1.2826589431580564, 1.2942658467597976, 1.305820606715784, 1.3172925897719567, 1.3286512161709605, 1.3398662133260826, 1.350907868972629, 1.3617472782837285, 1.3723565800926094, 1.382709178040994, 1.3927799431437957, 1.4025453949095152, 1.4119838587799773, 1.4210755982524588, 1.4298029206260865, 1.4381502558726547, 1.446104208669406 ], [ 1.0293295946597358, 1.0311854732179428, 1.0334909159489045, 1.0362495837927392, 1.0394632098607834, 1.0431315963856238, 1.0472526510874798, 1.0518224623220744, 1.0568354095489811, 1.0622843028139188, 1.0681605424902147, 1.0744542888799817, 1.0811546307228195, 1.0882497422795163, 1.0957270202903873, 1.1035731943948492, 1.1117744070982467, 1.1203162616912286, 1.129183838436489, 1.1383616808132124, 1.147833754788099, 1.1575833851636605, 1.1675931741841088, 1.1778449087696505, 1.1883194638690224, 1.1989967102415446, 1.209855435271942, 1.2208732850293311, 1.2320267346796523, 1.2432910926566556, 1.2546405418966355, 1.266048219197846, 1.277486331618931, 1.2889263069703587, 1.300338973998372, 1.311694766856153, 1.3229639478878137, 1.3341168425599503, 1.3451240804857905, 1.3559568368161043, 1.3665870687443942, 1.3769877424309351, 1.3871330462471183, 1.3969985868492203, 1.4065615651937557, 1.415800930197706, 1.4246975083242641, 1.4332341079386755, 1.4413955978279778, 1.4491689598100936 ], [ 1.0367677418910264, 1.0387390741900606, 1.041153235538907, 1.044013387655154, 1.0473207893777232, 1.051074796952652, 1.055272902644388, 1.059910810997108, 1.0649825493942486, 1.070480606866512, 1.0763960927547298, 1.082718905215442, 1.0894378989351212, 1.0965410418883477, 1.104015552423274, 1.111848010094351, 1.1200244361074356, 1.1285303416344885, 1.1373507443471595, 1.1464701552192182, 1.1558725390054847, 1.165541252937408, 1.1754589691884163, 1.1856075875851748, 1.195968145808267, 1.2065207348042182, 1.217244427174333, 1.2281172258153799, 1.2391160390496732, 1.2502166869773843, 1.2613939419679783, 1.2726216042708764, 1.2838726118585568, 1.2951191819716685, 1.306332980518083, 1.3174853145320142, 1.328547342321969, 1.3394902956898358, 1.3502857086281856, 1.3609056471345282, 1.3713229351573804, 1.3815113721575862, 1.3914459382899083, 1.4011029837569988, 1.4104603994441098, 1.4194977664991526, 1.4281964830750886, 1.4365398669975495, 1.4445132336574644, 1.4521039489513123 ], [ 1.0442996581206492, 1.0463822525341142, 1.0489005981628796, 1.0518573760709766, 1.0552533938923505, 1.0590875891965699, 1.0633570698891357, 1.068057190915541, 1.0731816640250156, 1.0787226948164632, 1.0846711390747328, 1.0910166688435452, 1.0977479380240571, 1.1048527376368709, 1.112318132163497, 1.1201305703574775, 1.1282759662602282, 1.1367397485442352, 1.1455068784847517, 1.1545618386971859, 1.163888596253953, 1.1734705449679714, 1.1832904325703388, 1.1933302792518956, 1.2035712945601749, 1.2139937998759944, 1.2245771635558955, 1.235299755263252, 1.2461389250222008, 1.2570710111792756, 1.2680713798662695, 1.2791144968710049, 1.2901740311889374, 1.301222988072082, 1.312233868199554, 1.3231788487091416, 1.33402998125716, 1.3447594019884985, 1.35533954825746, 1.365743377090629, 1.3759445806756676, 1.385917794549778, 1.395638794613927, 1.405084679588478, 1.4142340360357726, 1.4230670835958354, 1.4315657986064485, 1.439714014804351, 1.4474975003258255, 1.4549040107364584 ], [ 1.0519083138994916, 1.0540976967190305, 1.0567154345447145, 1.0597637467847576, 1.0632430128253043, 1.0671517782182978, 1.0714867964590002, 1.0762431055601642, 1.0814141362859533, 1.0869918465511756, 1.092966874421663, 1.0993287006690091, 1.1060658111662298, 1.1131658496644754, 1.120615752614896, 1.1284018595066008, 1.1365099944055472, 1.1449255167046724, 1.1536333412869224, 1.1626179302014037, 1.1718632594974159, 1.1813527660610699, 1.1910692801946936, 1.2009949503039503, 1.2111111664146335, 1.221398489306208, 1.2318365917866987, 1.2424042180227797, 1.2530791658928608, 1.2638382961058112, 1.274657570416244, 1.2855121197833543, 1.2963763418803047, 1.30722402606469, 1.3180285028407164, 1.3287628140193517, 1.3393998992235474, 1.3499127940754612, 1.3602748353101788, 1.3704598681451086, 1.3804424514557019, 1.3901980566287, 1.3997032563536966, 1.4089359000492392, 1.4178752730849182, 1.426502237445355, 1.4347993519786595, 1.442750970874858, 1.4503433195238187, 1.4575645473997447 ], [ 1.0595769218589826, 1.0618683690394162, 1.0645804822907838, 1.0677150387282868, 1.071272012281111, 1.075249582443315, 1.0796441770578242, 1.0844505482768811, 1.0896618786707315, 1.0952699122785483, 1.1012651034796739, 1.1076367751738003, 1.1143732771031867, 1.1214621353292107, 1.1288901848609396, 1.1366436790746604, 1.144708371626594, 1.1530695687844648, 1.1617121522522786, 1.1706205744672604, 1.1797788299173362, 1.1891704072379732, 1.1987782277142656, 1.2085845763653142, 1.21857103204062, 1.228718402916561, 1.239006673440863, 1.2494149681390574, 1.2599215367928622, 1.2705037643780308, 1.281138207883672, 1.2918006608168364, 1.30246624491681, 1.313109527443445, 1.3237046614228432, 1.33422554546702, 1.3446459992430755, 1.3549399503425348, 1.3650816281703788, 1.375045760504678, 1.3848077685389526, 1.3943439564797395, 1.4036316921048304, 1.4126495750730503, 1.4213775901988723, 1.429797243354036, 1.4378916781255981, 1.4456457718391165, 1.4530462100399852, 1.4600815390076238 ], [ 1.0672890127845782, 1.0696775818163868, 1.0724788618817716, 1.0756942074658218, 1.0793232096178773, 1.0833637070068427, 1.0878118293786805, 1.0926620724993643, 1.097907401665678, 1.1035393788680985, 1.109548306930366, 1.1159233826628325, 1.1226528504363078, 1.129724147705952, 1.1371240348766196, 1.1448387033824556, 1.1528538577567882, 1.161154769562622, 1.1697263031208776, 1.1785529148406089, 1.1876186295152382, 1.1969069981537201, 1.2064010427618945, 1.2160831939965426, 1.225935227806725, 1.2359382070740015, 1.2460724338831333, 1.256317417418494, 1.2666518616220022, 1.2770536757148854, 1.2875000095413411, 1.2979673145110318, 1.3084314297718225, 1.3188676921997073, 1.3292510678986402, 1.3395563021897376, 1.3497580845489272, 1.359831224620167, 1.369750835271243, 1.3794925186477769, 1.3890325512920092, 1.3983480646008557, 1.407417217180502, 1.416219355994228, 1.4247351635821595, 1.4329467890457697, 1.4408379609278086, 1.4483940805727733, 1.4556022950164476, 1.4624515489169758 ], [ 1.0750285077751542, 1.0775090695183154, 1.0803941484289898, 1.0836846962555247, 1.0873799434863218, 1.091477412453581, 1.0959729611666096, 1.1008608569045257, 1.10613387676396, 1.111783430534434, 1.1177996996690973, 1.1241717849366752, 1.130887854745085, 1.1379352862078793, 1.1453007917778004, 1.152970525601658, 1.160930165491497, 1.1691649683562766, 1.1776597988960205, 1.1863991331586339, 1.1953670400823524, 1.2045471453312082, 1.2139225825588964, 1.2234759377184938, 1.233189192197031, 1.2430436704235726, 1.2530199972076892, 1.2630980694441707, 1.273257046008807, 1.2834753587162993, 1.2937307461708216, 1.3040003112734615, 1.314260602117798, 1.3244877150589451, 1.3346574179227622, 1.3447452906576505, 1.3547268802329218, 1.3645778662536197, 1.3742742335808067, 1.3837924482007085, 1.3931096326550185, 1.402203737507821, 1.411053705562582, 1.4196396258404693, 1.4279428746752931, 1.4359462416610949, 1.4436340385971247, 1.4509921900040375, 1.4580083042265375, 1.4646717245828262 ], [ 1.0827797854560282, 1.0853470557323677, 1.0883104380944866, 1.0916705016028554, 1.095426138200624, 1.0995745776151604, 1.1041114313023261, 1.109030764418931, 1.1143251931348084, 1.1199860029408943, 1.1260032821548842, 1.1323660637493536, 1.139062468073233, 1.1460798390878477, 1.1534048673961659, 1.1610236945331496, 1.1689219945657732, 1.177085030848153, 1.18549768760873, 1.1941444777539307, 1.203009529737808, 1.2120765574983683, 1.2213288182693272, 1.2307490635443386, 1.2403194886215785, 1.2500216860222788, 1.259836607694343, 1.2697445403202237, 1.2797250972890977, 1.2897572300140043, 1.2998192603247356, 1.30988893469898, 1.3199435001574775, 1.3299598007871156, 1.3399143931035948, 1.349783677845379, 1.3595440453142151, 1.3691720310452642, 1.3786444783940843, 1.3879387045550406, 1.3970326665600155, 1.4059051239307339, 1.4145357948570265, 1.422905503033108, 1.4309963125929817, 1.438791648934991, 1.4462764036054516, 1.4534370218151886, 1.4602615715814486, 1.4667397939127707 ], [ 1.090527743367662, 1.0931763140833715, 1.0962124082510676, 1.0996362323675763, 1.103446361496716, 1.1076397557255928, 1.112211803985824, 1.1171563941908518, 1.1224660071187942, 1.1281318299744172, 1.1341438842513654, 1.1404911615420734, 1.1471617604332238, 1.1541430176535823, 1.1614216272152869, 1.1689837423491867, 1.176815056462055, 1.1849008609863794, 1.1932260796897796, 1.201775280613512, 1.2105326682022235, 1.2194820592942097, 1.228606847426895, 1.2378899603718336, 1.2473138159660888, 1.2568602811844958, 1.2665106390383873, 1.276245567333512, 1.2860451326159121, 1.2958888018255341, 1.3057554733087413, 1.3156235279584776, 1.3254709003968217, 1.3352751693260843, 1.345013665480384, 1.3546635950301302, 1.3642021758369076, 1.373606783628507, 1.3828551049579436, 1.3919252937163622, 1.4007961279754986, 1.4094471640268738, 1.417858884649562, 1.4260128388640725, 1.4338917707065466, 1.4414797348760846, 1.4487621974604108, 1.4557261203235274, 1.4623600281347335, 1.4686540574229636 ], [ 1.098257852844002, 1.100982222403207, 1.1040853706779046, 1.1075671617176204, 1.1114258749748112, 1.1156582230830385, 1.1202593953499393, 1.1252231258925391, 1.130541783964212, 1.1362064826753235, 1.1422072011312907, 1.148532914135875, 1.1551717231440548, 1.162110982162971, 1.1693374128017013, 1.1768372036118468, 1.1845960901433967, 1.192599413632339, 1.2008321577945806, 1.20927896469019, 1.2179241319321619, 1.2267515945690515, 1.2357448957294719, 1.244887150569411, 1.2541610082243708, 1.2635486163671514, 1.2730315926464744, 1.2825910067740598, 1.2922073763813355, 1.3018606790252811, 1.3115303819288324, 1.3211954902351157, 1.3308346137735012, 1.3404260516113158, 1.349947893022361, 1.3593781329604908, 1.3686947996926486, 1.377876091924321, 1.386900522537906, 1.3957470659543982, 1.40439530611074, 1.4128255821091438, 1.4210191287290075, 1.4289582091874011, 1.4366262377809815, 1.444007890332366, 1.4510892006897955, 1.4578576418823768, 1.4643021909061789, 1.4704133764995535 ], [ 1.1059562069028754, 1.10875080967606, 1.11191531732309, 1.1154492714701543, 1.1193506767797359, 1.1236160198300236, 1.128240312101377, 1.1332171559846898, 1.1385388314815679, 1.1441964000572373, 1.1501798210528609, 1.1564780752803427, 1.1630792900044067, 1.1699708595217544, 1.1771395559866067, 1.1845716259663968, 1.1922528693591945, 1.2001686986517925, 1.2083041779185684, 1.2166440423345128, 1.225172700197807, 1.2338742204545317, 1.2427323094460738, 1.2517302810457769, 1.2608510245236961, 1.2700769744032383, 1.2793900862864576, 1.2887718221661524, 1.2982031481546314, 1.3076645468824204, 1.3171360460951154, 1.326597264239315, 1.33602747311272, 1.3454056769862097, 1.3547107070096707, 1.3639213292039263, 1.3730163639276265, 1.381974814394143, 1.3907760015976645, 1.3993997028849405, 1.40782629137221, 1.4160368734468078, 1.424013421701407, 1.4317389008168104, 1.4391973841287602, 1.4463741588781671, 1.4532558184440207, 1.4598303401878971, 1.4660871478888227, 1.4720171581092154 ], [ 1.1136095608775882, 1.116468795504006, 1.1196889583946181, 1.123269288600309, 1.1272075363207297, 1.1314999826779404, 1.136141482043428, 1.1411255258306827, 1.1464443255442145, 1.1520889117938093, 1.1580492450430335, 1.1643143331628105, 1.1708723504862364, 1.1777107530605184, 1.1848163851768945, 1.1921755729981314, 1.1997742021269104, 1.2075977771693784, 1.2156314626372693, 1.2238601057889544, 1.23226824314182, 1.2408400933230341, 1.2495595396205408, 1.2584101060326554, 1.2673749307988231, 1.2764367413467792, 1.285577834344863, 1.2947800641400866, 1.3040248423319096, 1.3132931506176972, 1.3225655683852382, 1.331822315853922, 1.3410433129091783, 1.3502082531595214, 1.3592966921914664, 1.3682881485193465, 1.3771622153333627, 1.385898680843945, 1.3944776548036124, 1.4028796986555745, 1.4110859567058742, 1.419078285735924, 1.4268393805580193, 1.4343528931600498, 1.441603543280483, 1.4485772184935817, 1.4552610621608442, 1.4616435479104744, 1.4677145396342222, 1.473465336331737 ], [ 1.12120536571112, 1.1241236220389863, 1.1273937527510765, 1.1310147139149764, 1.1349840210549753, 1.1392977696280115, 1.1439506765618188, 1.148936141774093, 1.154246327583978, 1.1598722529611378, 1.1658038987222081, 1.172030319164667, 1.1785397552948906, 1.1853197448039525, 1.1923572242826848, 1.1996386198205062, 1.2071499230429883, 1.2148767507275726, 1.2228043872998675, 1.2309178106576106, 1.2392017028106719, 1.2476404476964766, 1.2562181191883763, 1.2649184627398453, 1.2737248743016623, 1.2826203801291665, 1.2915876208906412, 1.3006088431293368, 1.3096659006574654, 1.318740267906211, 1.3278130666558305, 1.3368651069549071, 1.3458769424350912, 1.354828939659606, 1.3637013606288493, 1.3724744571170517, 1.3811285751396605, 1.3896442675551757, 1.398002412589335, 1.4061843359308828, 1.414171933983508, 1.4219477958618074, 1.4294953217851294, 1.436798835645323, 1.443843689696517, 1.4506163595310975, 1.4571045277590629, 1.4632971550911114, 1.4691845378315913, 1.4747583511069036 ], [ 1.128731794003314, 1.1317034785023363, 1.1350179307442785, 1.138673843074161, 1.1426685155470524, 1.1469978769301514, 1.1516565253444, 1.156637787479357, 1.1619337944117645, 1.1675355711975617, 1.173433136666285, 1.1796156092983792, 1.1860713147710527, 1.192787890754155, 1.1997523848344407, 1.2069513420234816, 1.2143708791121042, 1.221996744102402, 1.2298143599931755, 1.2378088532320115, 1.2459650680999346, 1.2542675691012417, 1.2627006340510916, 1.2712482409649386, 1.2798940520559527, 1.2886213981517711, 1.2974132666743066, 1.3062522960157383, 1.3151207787234236, 1.3240006754090647, 1.3328736407543593, 1.3417210624252192, 1.3505241131540384, 1.359263815725436, 1.3679211201219799, 1.3764769916647848, 1.384912508628124, 1.393208967521695, 1.4013479940205906, 1.4093116573803781, 1.4170825861001082, 1.4246440825856161, 1.431980234614364, 1.4390760215060836, 1.4459174130551533, 1.452491459475351, 1.458786370838956, 1.4647915847537925, 1.470497821306219, 1.4758971245969812 ], [ 1.1361777590430575, 1.139197318558109, 1.1425505098130775, 1.146235780291212, 1.1502502331661875, 1.1545896486703913, 1.1592485237523165, 1.1642201289791043, 1.1694965808314985, 1.175068926773535, 1.1809272398233528, 1.1870607188679256, 1.1934577907044817, 1.2001062097875885, 1.2069931519220842, 1.2141052986510141, 1.221428909803331, 1.2289498825273932, 1.2366537960724027, 1.2445259425156865, 1.2525513445014336, 1.2607147618000187, 1.2690006890773557, 1.2773933476593464, 1.2858766742835817, 1.2944343098578501, 1.3030495911129865, 1.3117055477719737, 1.3203849074876253, 1.3290701103571532, 1.3377433343323957, 1.3463865323354083, 1.354981481383381, 1.3635098435438162, 1.3719532380958708, 1.380293323878521, 1.3885118904688805, 1.396590956559249, 1.4045128736918793, 1.412260433365338, 1.4198169754444676, 1.427166495783972, 1.4342937510099136, 1.441184358489413, 1.4478248896521126, 1.454202955001743, 1.4603072793673821, 1.4661277661849175, 1.4716555498629504, 1.4768830355663396 ], [ 1.1435329271699024, 1.1465948709195861, 1.149981303241385, 1.153690445156396, 1.1577192208949227, 1.1620632794872012, 1.1667170333673247, 1.1716737129744674, 1.1769254356131773, 1.1824632861550297, 1.1882774065847639, 1.1943570909681696, 1.200690882190825, 1.207266666813786, 1.2140717646226178, 1.2210930098949182, 1.2283168220442306, 1.2357292640634103, 1.2433160880260226, 1.2510627677460635, 1.2589545194833265, 1.2669763122636823, 1.2751128699241423, 1.2833486673704635, 1.29166792374402, 1.3000545952411133, 1.308492370227971, 1.3169646690703618, 1.3254546507744356, 1.333945228141301, 1.3424190926982462, 1.3508587502083165, 1.3592465670979947, 1.3675648276981744, 1.3757958017807594, 1.383921821503167, 1.3919253665538849, 1.3997891560288216, 1.4074962453636464, 1.4150301265014553, 1.422374829388022, 1.4295150228553024, 1.4364361129757615, 1.4431243370411184, 1.449566851435498, 1.4557518118297836, 1.4616684443160468, 1.4673071063223162, 1.4726593363919989, 1.4777178921716727 ], [ 1.1507877238940674, 1.1538866436518538, 1.1573009225750792, 1.1610285731079475, 1.1650663577999283, 1.169409810991189, 1.174053276310193, 1.1789899590008848, 1.184211991452061, 1.189710509699327, 1.1954757381590544, 1.20149707947953, 1.2077632061949346, 1.214262150866023, 1.2209813915943128, 1.227907930192395, 1.2350283608517403, 1.2423289278275689, 1.2497955714047981, 1.25741396216363, 1.2651695242747856, 1.2730474491775234, 1.281032701494737, 1.2891100193979177, 1.2972639118432128, 1.3054786551617392, 1.3137382914154316, 1.3220266307432245, 1.330327259643005, 1.3386235567871931, 1.3468987175765466, 1.3551357882201542, 1.363317709708801, 1.3714273716404615, 1.3794476754743488, 1.3873616064442287, 1.3951523130605359, 1.4028031928792197, 1.4102979830165905, 1.417620853744622, 1.4247565034100858, 1.4316902528820517, 1.4384081377433455, 1.4448969964995868, 1.4511445531805036, 1.4571394928485928, 1.4628715287042824, 1.4683314596797996, 1.4735112176390492, 1.4784039035414516 ], [ 1.1579333342626579, 1.1610639226896198, 1.1645007742459732, 1.1682417101250318, 1.1722833477628318, 1.1766211225059027, 1.1812493239647053, 1.1861611461071027, 1.1913487495717654, 1.196803334147936, 1.2025152189177029, 1.2084739272288727, 1.2146682734920327, 1.221086448795158, 1.2277161025082357, 1.2345444173990079, 1.2415581762741694, 1.2487438187605002, 1.256087487502263, 1.2635750637261307, 1.2711921927660255, 1.2789243007077318, 1.286756603775567, 1.294674112421795, 1.3026616322846993, 1.3107037642552741, 1.3187849058452261, 1.3268892558955196, 1.335000824425216, 1.3431034491147253, 1.3511808195676545, 1.3592165101201052, 1.3671940215840304, 1.3750968319369337, 1.3829084556168894, 1.3906125107597003, 1.3981927934314022, 1.4056333576700555, 1.4129185999588119, 1.4200333466094932, 1.4269629424426598, 1.4336933391053017, 1.4402111813695473, 1.4465038898020968, 1.4525597382816624, 1.4583679249667683, 1.463918635473808, 1.4692030972108534, 1.4742136240199024, 1.4789436505028717 ], [ 1.1649616979961057, 1.1681187651223979, 1.1715730509805513, 1.1753222022429815, 1.1793627070907151, 1.1836899167658637, 1.188298080756149, 1.1931803947058168, 1.198329059635797, 1.2037353505839852, 1.2093896923800542, 1.2152817399817244, 1.2214004606475288, 1.2277342152219308, 1.234270835966927, 1.2409976986814915, 1.2479017872849407, 1.25496974957093, 1.2621879434262775, 1.2695424734111584, 1.2770192181736628, 1.2846038496867658, 1.2922818457209875, 1.3000384972835688, 1.3078589129549951, 1.3157280221369534, 1.3236305791989407, 1.3315511703870022, 1.339474225153728, 1.347384033301826, 1.355264769023061, 1.3631005225775124, 1.3708753400118898, 1.3785732709732281, 1.3861784243489046, 1.3936750311641826, 1.4010475139024459, 1.4082805611865266, 1.4153592065748555, 1.422268910086809, 1.4289956409770783, 1.4355259602299952, 1.4418471012390015, 1.4479470471732354, 1.4538146036081827, 1.4594394651086298, 1.464812274594284, 1.4699246744877026, 1.4747693488343483, 1.4793400557900214 ], [ 1.1718654999365086, 1.1750439878128813, 1.1785107185808186, 1.1822631804968995, 1.186297747628318, 1.190609701206201, 1.1951932636280431, 1.2000416442456627, 1.2051470956199595, 1.210500978506431, 1.2160938334866966, 1.2219154569093682, 1.2279549786716992, 1.2342009393751607, 1.240641364528132, 1.2472638337393338, 1.2540555432287928, 1.2610033604517625, 1.268093870151772, 1.2753134116957063, 1.2826481080609873, 1.2900838873111002, 1.2976064977855577, 1.3052015185266221, 1.3128543666586283, 1.3205503035249482, 1.328274441378144, 1.3360117523206487, 1.3437470810204215, 1.351465162494222, 1.359150645976663, 1.3667881255920284, 1.3743621782328188, 1.3818574087371331, 1.3892585021575878, 1.3965502826367318, 1.4037177781550527, 1.4107462902033816, 1.4176214672550544, 1.4243293807776252, 1.4308566024297409, 1.4371902810364394, 1.4433182179244934, 1.4492289392271798, 1.4549117638322193, 1.4603568657448471, 1.4655553297663029, 1.4704991995415966, 1.47518151720484, 1.4795963540394326 ] ], "zauto": true, "zmax": 1.4795963540394326, "zmin": -1.4795963540394326 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.08298631927909689, 0.08035719450961944, 0.07780199860189453, 0.07533244874648548, 0.07296026628644164, 0.07069692250168845, 0.06855333266439476, 0.06653950679534817, 0.06466417444758361, 0.06293441080501098, 0.061355300768917966, 0.0599296841885566, 0.05865802637267098, 0.057538451350417165, 0.05656696021925333, 0.05573783452954807, 0.05504419835833248, 0.05447868738354663, 0.05403415404188991, 0.05370432879970246, 0.053484360622704445, 0.053371174360506625, 0.0533636063088902, 0.05346230770011088, 0.053669434903700235, 0.05398817061858799, 0.05442213900999802, 0.05497478735771805, 0.055648806354755116, 0.05644565116943174, 0.05736520768744167, 0.058405626184111985, 0.059563321930689944, 0.06083312263075686, 0.06220852881308528, 0.06368204653547133, 0.0652455515823182, 0.06689064923320225, 0.06860900160217913, 0.07039260354183086, 0.07223399667371119, 0.07412641833782571, 0.07606388777070172, 0.07804123562935342, 0.08005408529903851, 0.0820987955622248, 0.08417237446811138, 0.08627237388514682, 0.08839677344438712, 0.09054386153837812 ], [ 0.0813864605377429, 0.07874313919861937, 0.07617839231655436, 0.0737043810913353, 0.07133325756022624, 0.06907688675894312, 0.06694650935447079, 0.06495235357550497, 0.0631032156873714, 0.06140604009002098, 0.05986554137705548, 0.0584839185324109, 0.057260712673205844, 0.05619285179244448, 0.05527490794806757, 0.05449956594419993, 0.05385827197955827, 0.05334200187519093, 0.052942067289907996, 0.05265086917525374, 0.05246251236935701, 0.052373212610512844, 0.05238145405164744, 0.05248788701691798, 0.05269498747644139, 0.05300652727016463, 0.053426924176312854, 0.05396055130013242, 0.05461108498601464, 0.05538095993439293, 0.05627098132871142, 0.057280119815555655, 0.05840549025187966, 0.059642493323672954, 0.06098508354560944, 0.06242611922250424, 0.06395774939484662, 0.06557179797691064, 0.06726011397156426, 0.06901486660189406, 0.07082877372415648, 0.0726952599314627, 0.07460854688479936, 0.07656368261951439, 0.0785565191231785, 0.0805836487122707, 0.08264230999382455, 0.08473027377458779, 0.08684571839871898, 0.08898710282075274 ], [ 0.0798484087435533, 0.07719405716864305, 0.07462303704998365, 0.07214793509191493, 0.06978131119740645, 0.06753539679980788, 0.06542172581061942, 0.06345070744833797, 0.061631162262599265, 0.05996985648813105, 0.058471083076768904, 0.05713634692138335, 0.05596421307781159, 0.05495036720314956, 0.054087916140021966, 0.05336792586316739, 0.05278015912206887, 0.05231394300927572, 0.051959074019934735, 0.05170665947453381, 0.05154980084382787, 0.05148404483098996, 0.051507558052844425, 0.05162101574377915, 0.05182722899534536, 0.05213056429207708, 0.05253623024855724, 0.053049517395290145, 0.053675076678247995, 0.054416311393734734, 0.0552749373983702, 0.056250740884329214, 0.057341536076768014, 0.058543301306976686, 0.059850454525639106, 0.061256220210186875, 0.06275303862502524, 0.06433297382371084, 0.06598808617851021, 0.06771074612562451, 0.06949387629359335, 0.07133111804606325, 0.07321692521467373, 0.07514659241983755, 0.07711622815754823, 0.07912268415770485, 0.08116345277675806, 0.08323654369703595, 0.08534035021402994, 0.08747351408216339 ], [ 0.07837352205996323, 0.07571110587830007, 0.07313684898461445, 0.07066373614535353, 0.0683047018920513, 0.06607230515558403, 0.06397832890214833, 0.062033314566735435, 0.060246054823129, 0.05862308409527686, 0.057168221379091076, 0.05588223031174206, 0.05476266250376671, 0.053803938548672624, 0.05299769620182113, 0.0523334000486949, 0.05179916797829287, 0.05138273494821761, 0.05107245108049395, 0.050858203495898736, 0.05073216031389065, 0.05068925850357618, 0.05072739019151236, 0.05084727914196109, 0.05105207514408843, 0.0513467245950642, 0.05173719748905447, 0.05222966233515848, 0.05282970037452362, 0.053541639173777474, 0.05436806496055764, 0.05530954615848152, 0.056364571863763306, 0.057529683176908576, 0.05879975621417752, 0.06016838535714567, 0.06162831384574912, 0.06317186445075904, 0.06479133303114222, 0.06647931959064261, 0.06822898285140078, 0.07003421402441098, 0.07188973280664707, 0.0737911136618876, 0.07573475345457235, 0.07771779293140112, 0.07973800480449349, 0.08179366063497066, 0.08388338761539983, 0.0860060248996027 ], [ 0.0769627808339917, 0.07429501180542337, 0.07172025736547233, 0.06925186427340806, 0.06690309834334371, 0.06468679586589479, 0.06261493299515437, 0.060698123572519753, 0.05894507131135762, 0.05736202015426805, 0.05595226362134683, 0.05471578530740059, 0.053649103202476255, 0.05274537651786045, 0.05199480489581448, 0.05138531030927229, 0.050903449273394755, 0.05053546617029701, 0.05026837504337059, 0.050090951217256215, 0.04999452565825097, 0.049973501000751486, 0.05002554358497445, 0.05015144497561511, 0.050354683907357284, 0.050640751089721395, 0.051016321735893835, 0.051488372208049984, 0.05206333700336301, 0.05274639072586209, 0.05354091830758036, 0.05444820869869669, 0.05546737699163534, 0.05659549240619125, 0.05782786893094076, 0.05915846407806585, 0.06058032931617912, 0.06208606154650105, 0.06366821567379434, 0.06531965097363787, 0.06703379622530768, 0.06880482899201194, 0.07062777235229446, 0.07249851779961701, 0.07441378626355205, 0.07637104072956193, 0.07836836419955986, 0.08040431612115066, 0.08247777920708785, 0.08458780697742273 ], [ 0.07561681568345884, 0.07294610127074076, 0.07037323941809348, 0.06791189514397927, 0.06557561317983857, 0.06337744701601769, 0.06132949980797115, 0.05944238848931004, 0.05772465955194763, 0.05618220474263058, 0.05481774354926357, 0.05363045132427326, 0.05261581144803154, 0.05176575321887377, 0.05106910438139873, 0.05051234352703648, 0.050080591921320194, 0.0497587464004011, 0.04953263236060824, 0.04939005197350257, 0.04932161687355618, 0.04932128295188098, 0.04938654222311806, 0.04951826727109399, 0.04972024222043974, 0.04999844625644129, 0.05036017844930636, 0.05081312427608296, 0.05136446402660152, 0.05202011146737905, 0.052784149213378956, 0.05365849827495107, 0.05464282769498702, 0.05573468119311612, 0.056929775771993624, 0.05822241497616716, 0.05960595722645308, 0.06107328561572171, 0.0626172367952175, 0.06423095998667375, 0.0659081901993056, 0.06764343081765078, 0.06943204916486675, 0.07127029441094132, 0.07315525064021833, 0.07508473951201096, 0.07705718722489839, 0.0790714698296464, 0.08112674963015136, 0.08322231368675514 ], [ 0.07433595087536135, 0.07166434802502439, 0.06909537349772597, 0.06664296080350104, 0.06432087411831414, 0.062142316120741226, 0.06011944285804111, 0.058262798111703984, 0.05658069838743116, 0.05507862111800117, 0.05375866856380369, 0.05261919207271229, 0.0516546595390131, 0.05085582921989833, 0.05021025642861241, 0.04970311237693807, 0.04931824665109614, 0.04903938679151625, 0.048851347437304286, 0.048741120058853275, 0.048698730823981275, 0.04871778438196043, 0.048795649911530334, 0.048933287081765954, 0.0491347484892267, 0.049406427493632686, 0.0497561432598938, 0.05019216650845732, 0.05072228923183978, 0.05135302962823748, 0.052089041125444144, 0.052932764603632165, 0.05388433030230885, 0.05494168570712131, 0.056100902682399145, 0.057356604128036046, 0.058702447910338615, 0.0601316119599903, 0.061637236173094606, 0.06321279081180672, 0.06485235480681971, 0.06655079902320485, 0.0683038784287473, 0.07010824317161357, 0.07196138220412124, 0.07386151479984722, 0.07580744560616383, 0.07779839816830322, 0.07983384046641999, 0.08191331415215648 ], [ 0.07312026368493522, 0.0704494383372532, 0.06788591111742832, 0.0654438304714939, 0.0631371161235692, 0.060979047153365246, 0.05898175384619667, 0.05715562719575989, 0.05550867994178153, 0.05404591583015184, 0.05276878449558619, 0.05167481124526538, 0.05075748742384921, 0.05000648428459687, 0.049408213107388, 0.04894670424429895, 0.048604728895052345, 0.048365050290200266, 0.048211672233014945, 0.04813095415938888, 0.04811248052311311, 0.04814960379911675, 0.048239619461073024, 0.048383572696730826, 0.04858573553249746, 0.04885282541197967, 0.04919305920987098, 0.04961514840669349, 0.05012734088810881, 0.05073660265387249, 0.051448009937490755, 0.05226439180506647, 0.053186229813576825, 0.05421179020892527, 0.05533744034840156, 0.05655808757784517, 0.057867676161613424, 0.059259684231575564, 0.06072757491017598, 0.062265170362557416, 0.06386693176453181, 0.06552814027913634, 0.06724498335464935, 0.06901455696553441, 0.07083479820218451, 0.07270436441017643, 0.0746224754003313, 0.07658873451827686, 0.0786029428919231, 0.08066491919942476 ], [ 0.07196965988960406, 0.06930085380597645, 0.0667438680183, 0.06431301130145176, 0.062022293925287, 0.059884997637690784, 0.05791314796049127, 0.05611690439793295, 0.05450390524351462, 0.053078627393431305, 0.05184184255928624, 0.05079026231261253, 0.049916458674379376, 0.04920912117434357, 0.04865366809940298, 0.0482331776975582, 0.047929556206629594, 0.04772482425224529, 0.04760238723124545, 0.0475481591929309, 0.0475514301397835, 0.04760539877956446, 0.047707331622623944, 0.047858350196859585, 0.048062886598910455, 0.048327879744414944, 0.048661807597653296, 0.049073662471785774, 0.049571976235694815, 0.05016398991467375, 0.05085503899199738, 0.051648194696986276, 0.05254416740194559, 0.05354144653239644, 0.05463662716808422, 0.05582485988739324, 0.057100357865438954, 0.058456901892530375, 0.0598882965629326, 0.06138874589734039, 0.06295313126636402, 0.06457718689117826, 0.06625757764833443, 0.06799189038327871, 0.06977855384048398, 0.07161670418940616, 0.07350601348098179, 0.07544649762671686, 0.07743831896300135, 0.07948159637839237 ], [ 0.0708839648522331, 0.06821797144386123, 0.0656681338339743, 0.06324886850025965, 0.06097421387778456, 0.058857384039959416, 0.05691022514638536, 0.05514259228943802, 0.05356168622570213, 0.052171413625623, 0.050971855133418766, 0.04995893518871454, 0.049124379453073616, 0.048456017054008475, 0.04793843931704449, 0.047553973827538, 0.047283884789222914, 0.04710967789089002, 0.04701437510034388, 0.046983631303177426, 0.04700658647672516, 0.04707637925089472, 0.0471902857401617, 0.047349487311980465, 0.047558508521604724, 0.047824398131311674, 0.04815574896453127, 0.04856166423504456, 0.04905077774971943, 0.049630422838851926, 0.05030602127325269, 0.051080731876838995, 0.0519553638931953, 0.05292852813563334, 0.05399697465294453, 0.05515605217119691, 0.05640022233296534, 0.05772356877191755, 0.05912025398440802, 0.06058489225034907, 0.062112821664529194, 0.06370027089462328, 0.06534442584251537, 0.06704340795408638, 0.06879617990699781, 0.07060239634611233, 0.07246221773767501, 0.07437610467996815, 0.07634460843905339, 0.0783681712985327 ], [ 0.06986302876478222, 0.06720017972265566, 0.0646575991128442, 0.06224976355209138, 0.05999068372912429, 0.05789344360782401, 0.055969644752239284, 0.05422877573243757, 0.052677548846824476, 0.05131927044571789, 0.05015333086582539, 0.04917490775668293, 0.04837496590381598, 0.04774060549212896, 0.047255763658167346, 0.04690222150492088, 0.0466608228463356, 0.046512781358808666, 0.04644094332669459, 0.04643088208847837, 0.04647172304043925, 0.04655662978487289, 0.04668291870378381, 0.04685180744847104, 0.0470678391504652, 0.04733805517193058, 0.0476710118734368, 0.048075748819014885, 0.04856081557538415, 0.04913345146407369, 0.04979898858093838, 0.05056051638076982, 0.05141881119166484, 0.052372502013235206, 0.05341841996477492, 0.054552065766255195, 0.05576812791435418, 0.057060991659188834, 0.058425192087738054, 0.05985578004119747, 0.06134858443134407, 0.06290036705982553, 0.06450887558948866, 0.06617280689739567, 0.06789169706730402, 0.0696657562822876, 0.07149566733911097, 0.07338236580386963, 0.07532681824163587, 0.07732981269499362 ], [ 0.06890684355244406, 0.06624700818819383, 0.0637112974446771, 0.061314208427615056, 0.059069678270210604, 0.05699061062340727, 0.05508831137117954, 0.053371856112847664, 0.05184743430703958, 0.05051773841275542, 0.049381484582963375, 0.04843315690864757, 0.0476630538746244, 0.047057682381912956, 0.046600496846196236, 0.04627292932436163, 0.04605561348368286, 0.045929679224352184, 0.04587798860173699, 0.045886194797841055, 0.045943529275222904, 0.046043253180445456, 0.046182744052592185, 0.04636322517693686, 0.04658917968711879, 0.0468675216408916, 0.04720661864818105, 0.047615272528659186, 0.048101764094549, 0.04867305500953287, 0.04933421514680535, 0.05008811147494566, 0.050935359524271716, 0.0518745068514131, 0.05290239463251806, 0.05401463134967748, 0.055206111530619155, 0.05647152041814493, 0.05780577884191631, 0.05920439796017749, 0.06066372822618938, 0.06218109929490805, 0.06375485699413316, 0.06538431000188424, 0.06706960290989296, 0.06881153441601692, 0.07061133992508745, 0.07247045719127675, 0.07439029205506795, 0.07637199901063393 ], [ 0.06801566770001413, 0.06535826696177348, 0.06282855916053184, 0.06044103249771519, 0.05820951792386813, 0.05614670454920957, 0.05426356984138347, 0.052568749931163915, 0.05106789745997889, 0.04976309678284188, 0.0486524225671851, 0.04772973059494901, 0.04698475356038432, 0.04640353960772555, 0.045969223496079535, 0.045663070663713015, 0.045465694720735195, 0.045358326742670714, 0.04532401182391226, 0.0453486213817106, 0.045421593438038116, 0.0455363430027788, 0.045690317748463036, 0.045884708305880005, 0.0461238554952173, 0.04641442582356718, 0.04676444843035756, 0.04718231833179915, 0.04767587014461037, 0.048251612855792235, 0.048914191178375165, 0.04966610639812574, 0.05050769488694463, 0.051437331586034085, 0.052451803565721, 0.05354678772407102, 0.054717366558858956, 0.055958524348722685, 0.05726557956795843, 0.05863452456215084, 0.06006225787056581, 0.06154670661018682, 0.06308684549662648, 0.0646826254651235, 0.0663348288756186, 0.0680448704102436, 0.06981456340298617, 0.07164587077724442, 0.07354065821992667, 0.0755004648647448 ], [ 0.06719015391154816, 0.0645341909719147, 0.06200917154257859, 0.05962955737243384, 0.05740905600030004, 0.05536012654787929, 0.05349340691323836, 0.05181709058034574, 0.050336302878203655, 0.04905254748671839, 0.04796330785543013, 0.04706188806033726, 0.046337558972130204, 0.04577603918677518, 0.045360292903909034, 0.04507157989342476, 0.044890656773827226, 0.04479901064447214, 0.044780006323438405, 0.04481984316872537, 0.04490824134686825, 0.04503880614983346, 0.0452090500317616, 0.045420083939963954, 0.045676020571528975, 0.04598315988002656, 0.046349048237746444, 0.04678151381931198, 0.04728777957189759, 0.047873740919075515, 0.048543469842791113, 0.04929897431404123, 0.05014020790643474, 0.05106529472515011, 0.05207091405225565, 0.053152779443464096, 0.054306147868029286, 0.055526303337018024, 0.056808972917952213, 0.058150647872905616, 0.059548796517952814, 0.06100196696007408, 0.06250978668304409, 0.06407287215787988, 0.06569266563753753, 0.06737121848729025, 0.06911094114978342, 0.07091433938996368, 0.07278375497868228, 0.07472112660138838 ], [ 0.066431473147576, 0.06377558219635013, 0.06125353875896145, 0.05887977307754015, 0.056667868555969836, 0.054630059229913853, 0.05277665580631704, 0.05111543140116865, 0.049651019053686594, 0.048384392417003035, 0.04731251232481446, 0.04642821878229343, 0.04572042672813068, 0.04517464640963912, 0.044773802952829046, 0.0444992856245074, 0.04433212542245437, 0.04425418544037044, 0.04424925164605096, 0.044303927950565564, 0.04440826336811215, 0.044556066632021954, 0.04474489275422718, 0.04497571570067574, 0.04525233039626837, 0.04558055341787813, 0.04596731171272601, 0.04641971896930689, 0.04694423724897837, 0.04754600653665162, 0.04822839897221245, 0.04899282208639346, 0.04983876221817888, 0.050764031175243654, 0.051765160266353194, 0.05283787774034767, 0.0539776075468813, 0.0551799365586062, 0.05644101065990231, 0.05775783441190996, 0.05912846221271969, 0.06055207984114715, 0.06202898366615442, 0.06356047078424763, 0.06514865728403926, 0.06679624410649433, 0.06850625085566046, 0.07028173759957089, 0.0721255333033502, 0.07403998717178281 ], [ 0.06574142734020655, 0.0630839416808448, 0.06056283296559795, 0.0581925069810332, 0.05598643862791959, 0.05395666224653985, 0.052113197693434754, 0.0504634461166919, 0.04901160957900705, 0.04775820628015327, 0.04669976182028319, 0.045828750820020546, 0.04513383959035111, 0.0446004421526251, 0.04421155685359571, 0.043948809827920036, 0.043793603778153105, 0.04372826026454452, 0.04373704974091343, 0.043807021220934446, 0.04392856740023132, 0.04409568754157535, 0.04430593774431247, 0.044560085782641624, 0.0448615146739963, 0.045215443499079536, 0.04562805248938062, 0.046105608406270995, 0.04665368309709956, 0.04727654234516704, 0.0479767559943937, 0.04875504847419677, 0.04961037712384645, 0.050540199581967274, 0.05154087464396678, 0.052608134576957094, 0.05373756975199693, 0.054925075919917264, 0.05616722736772906, 0.05746155280110765, 0.05880670322506093, 0.06020251138442335, 0.06164995024325133, 0.06315100371423069, 0.06470846673665702, 0.06632569416127712, 0.06800631894791886, 0.06975396003251982, 0.0715719389391695, 0.07346302188063576 ], [ 0.0651225421402366, 0.06246158183434387, 0.059939126401810976, 0.05756957490676579, 0.055366324286901115, 0.053341253690807874, 0.05150415121844929, 0.04986211960822617, 0.04841901688671112, 0.04717500395442851, 0.04612627729803812, 0.04526505609867619, 0.04457986713289573, 0.044056131682266686, 0.04367701480261145, 0.04342445927976517, 0.04328030271128132, 0.043227369612089624, 0.043250439224697464, 0.04333700875118398, 0.04347779576855109, 0.043666949160325534, 0.043901963607585165, 0.04418331825996416, 0.04451388508317352, 0.0448981747053065, 0.04534150418944573, 0.04584917847022549, 0.046425772665624664, 0.04707458587060913, 0.04779731090125421, 0.048593933588999695, 0.0494628453552875, 0.05040112898964846, 0.051404962943449366, 0.05247008473416822, 0.053592257806653935, 0.05476769573816076, 0.05599341005760818, 0.05726746071921697, 0.05858909981379286, 0.059958808649020805, 0.061378235740398066, 0.06285004872870353, 0.06437771708227888, 0.06596524490654285, 0.06761687441236709, 0.06933678063601259, 0.07112877686537478, 0.07299604795340138 ], [ 0.06457813059886108, 0.06191170871171756, 0.05938549311892453, 0.05701390222621392, 0.05481029779649645, 0.052786464562115394, 0.05095203786554, 0.049313918108512045, 0.04787572963727559, 0.046637396220117984, 0.04559490932462899, 0.04474035400888741, 0.0440622293427776, 0.04354606033496846, 0.0431752554662325, 0.04293212851537849, 0.04279898298965324, 0.042759154388936, 0.0427979169450883, 0.04290318195705043, 0.043065939165698945, 0.04328041751707626, 0.04354396600899526, 0.04385667904832006, 0.04422081347593591, 0.04464006445059012, 0.04511878170760574, 0.04566121295053897, 0.04627085503174596, 0.046949976215310094, 0.04769934699194965, 0.04851818746760841, 0.049404311738892336, 0.050354428447879095, 0.05136454442399092, 0.05243041521580969, 0.05354799077530711, 0.05471381397835728, 0.0559253413585279, 0.057181167247705056, 0.05848114311089936, 0.05982639263881186, 0.061219230056562296, 0.06266299432657675, 0.064161815729746, 0.06572033389001247, 0.06734338773443613, 0.06903569813237401, 0.07080156298608777, 0.07264458235520754 ], [ 0.06411231892589644, 0.06143846393187273, 0.05890606852100816, 0.05652960176253472, 0.05432244160719696, 0.0522963512848506, 0.05046090792487617, 0.048822923912938125, 0.04738591989012538, 0.04614972173614795, 0.045110256222865824, 0.044259606620978706, 0.04358635991769084, 0.043076236595431916, 0.04271295169869909, 0.04247922255768375, 0.04235782111138422, 0.042332568759645826, 0.0423891855834789, 0.042515927794683925, 0.04270397212276575, 0.04294753037754751, 0.04324370065898842, 0.043592083696540024, 0.043994213319813694, 0.04445286755797001, 0.04497133857325339, 0.04555274253635967, 0.046199442805297704, 0.04691264183483674, 0.04769217211099737, 0.048536488805212476, 0.049442841825895, 0.0504075864572878, 0.05142658177298533, 0.05249562434533856, 0.05361086971866501, 0.0547692032177363, 0.05596853252449166, 0.05720798524181389, 0.058488004278382154, 0.059810341892780824, 0.06117795962577498, 0.06259484632729193, 0.06406577026492356, 0.06559598400743546, 0.06719090241133492, 0.06885577451469478, 0.07059536935745027, 0.07241369366629445 ], [ 0.06373002656452732, 0.06104691676643045, 0.05850605545936214, 0.056121995446519704, 0.0539081864168611, 0.05187645001534336, 0.05003640962477077, 0.04839491646165486, 0.04695553173180014, 0.045718137354671944, 0.04467874898684442, 0.04382959025509883, 0.043159456148076106, 0.04265435204826229, 0.04229835290043131, 0.04207459501440487, 0.04196629779980222, 0.04195771527442231, 0.042034933407101564, 0.04218645302265181, 0.04240352364237766, 0.042680218103431575, 0.04301326016294614, 0.043401637680688554, 0.04384605220989804, 0.04434827057532213, 0.04491045287155808, 0.045534531746722264, 0.04622170852163658, 0.04697211347505287, 0.04778465358766311, 0.048657045660019896, 0.04958601051364315, 0.050567588243734606, 0.05159752661450075, 0.0526716942153685, 0.053786475185307416, 0.05493911091262159, 0.056127964041293034, 0.0573526898325752, 0.05861430857405215, 0.05991517998618397, 0.06125888648978305, 0.06265003695226398, 0.06409400629411387, 0.06559662917234586, 0.06716386780230997, 0.06880147468664335, 0.0705146704361238, 0.07230785491796524 ], [ 0.06343689488647167, 0.060742998941335564, 0.05819166745104604, 0.05579756816551939, 0.05357427753012685, 0.051533756781430747, 0.04968578341980265, 0.04803737997737179, 0.04659230010022708, 0.045350644516701046, 0.04430868023084664, 0.043458920754080595, 0.04279049339228331, 0.042289777454282994, 0.04194125507933696, 0.04172848496733914, 0.04163509547279426, 0.041645697984230415, 0.041746639755825425, 0.04192654072430968, 0.04217658554758657, 0.04249056681379375, 0.04286469708530513, 0.043297226289156596, 0.04378791686186423, 0.044337440930105776, 0.04494676971124827, 0.045616623316250535, 0.04634703847286778, 0.047137093541908745, 0.047984807641040794, 0.04888720781153538, 0.049840538849278006, 0.05084057730830366, 0.05188300518051501, 0.05296379918748469, 0.05407959680875253, 0.055228008113476036, 0.05640785138414897, 0.0576192991733892, 0.058863929144707824, 0.060144680605751004, 0.0614657231157399, 0.06283224810079285, 0.06425019816351213, 0.06572595173313758, 0.06726598275101195, 0.06887651602351043, 0.07056319850005298, 0.07233080493683275 ], [ 0.06323916185341552, 0.060533377890103685, 0.05797000283166324, 0.05556384538220931, 0.05332865859959967, 0.05127661985524532, 0.049417765063567994, 0.047759418543264494, 0.04630567810017542, 0.045057027717277404, 0.044010151258092815, 0.04315800515709045, 0.04249017606753874, 0.04199350679522968, 0.04165293114320913, 0.04145242667670412, 0.04137598103811833, 0.04140847305057564, 0.04153638970668381, 0.04174832715829415, 0.04203525177637108, 0.042390522566786604, 0.04280969749846348, 0.04329016369517415, 0.04383064499998529, 0.04443064940896224, 0.045089921891147244, 0.045807963884698204, 0.046583669081899454, 0.0474151074313098, 0.04829946852269037, 0.049233155283273676, 0.05021200242531924, 0.05123158336288322, 0.05228756486753968, 0.05337606977044572, 0.054494012990180266, 0.055639383339655554, 0.0568114514659296, 0.05801089190235779, 0.05923981405120375, 0.06050170283185382, 0.061801274804714805, 0.06314425995034836, 0.06453712302567531, 0.06598674149203525, 0.0675000592474081, 0.06908373655289743, 0.07074381638058896, 0.07248542578176853 ], [ 0.06314348389504072, 0.060425268510228135, 0.05784884829548973, 0.05542919095078582, 0.05318026672352976, 0.05111453548842234, 0.04924238543063166, 0.04757156321322823, 0.04610665396539294, 0.04484868285975272, 0.0437949120099938, 0.04293889192987718, 0.04227079533113344, 0.0417780182569441, 0.04144599009535146, 0.041259101474903276, 0.04120164513807837, 0.04125867075742451, 0.04141667556255509, 0.041664081124259844, 0.041991475926900224, 0.04239162927895631, 0.04285930312251025, 0.043390904372180863, 0.04398403173203457, 0.044636977182559226, 0.045348242712146755, 0.04611612676928383, 0.046938422629664425, 0.0478122540072001, 0.048734054476372225, 0.04969967967350253, 0.05070462738011032, 0.05174433193805153, 0.05281449621057228, 0.05391142566661968, 0.05503233374954419, 0.0561755940351383, 0.057340921584693304, 0.05852947256470043, 0.059743857250439694, 0.06098806687334977, 0.062267319490873496, 0.06358783426088487, 0.06495654722928199, 0.06638078490660632, 0.06786791431333872, 0.06942498953440063, 0.07105841486726502, 0.07277364320089935 ], [ 0.0631567107521563, 0.06042618864854924, 0.057836416105647166, 0.055402527975099126, 0.05313873975876213, 0.05105784531910228, 0.04917066231707395, 0.047485462863342924, 0.04600744556190598, 0.04473831947992259, 0.04367607408993756, 0.04281499652484164, 0.04214596740213345, 0.04165702408400592, 0.04133413602157797, 0.04116210277669079, 0.04112546993271469, 0.041209363256064356, 0.041400162684252055, 0.041685967280716614, 0.04205683285211308, 0.04250479066347431, 0.043023676619571974, 0.04360881522137173, 0.044256611914380475, 0.04496411125136372, 0.045728576436309676, 0.04654713830152967, 0.0474165493023831, 0.04833306234906878, 0.0492924376059696, 0.05029006528087555, 0.05132118088133703, 0.052381142462473246, 0.05346573703272109, 0.05457148473566697, 0.05569591350371468, 0.056837782379300664, 0.05799723765544805, 0.05917589177951333, 0.06037682030230779, 0.06160447698937595, 0.06286453161294102, 0.0641636389915854, 0.06550915154457697, 0.06690879086429312, 0.06837029635099669, 0.06990107049399862, 0.0715078406229621, 0.07319635569378832 ], [ 0.06328562369515768, 0.060543669115470086, 0.05794102580188361, 0.055492993086017274, 0.05321404519176427, 0.051117343098080414, 0.049214189484695275, 0.04751346102407907, 0.04602107112595413, 0.04473953166521892, 0.043667687752229026, 0.042800689445194766, 0.042130236479734635, 0.04164509078564306, 0.04133180679522559, 0.04117559360081806, 0.04116120530985622, 0.04127375935173809, 0.04149940313000583, 0.04182577950183299, 0.04224227317344868, 0.042740047696716466, 0.0433119037959496, 0.043952003849692785, 0.04465551501962886, 0.04541822534268927, 0.046236183521892675, 0.04710540471414937, 0.048021672335648656, 0.048980451412247314, 0.04997691432451712, 0.05100606692349048, 0.052062953401661095, 0.053142912678952076, 0.05424185728557876, 0.05535654708265805, 0.056484833669096665, 0.057625856005941015, 0.05878017287947117, 0.05994982283769579, 0.06113830695185889, 0.06235049414323433, 0.0635924529334416, 0.06487121737617442, 0.06619449858567247, 0.06757035655358588, 0.06900684958955138, 0.07051168041003564, 0.0720918583188418, 0.07375339585272508 ], [ 0.06353665178490357, 0.06078493434191719, 0.0581707477528383, 0.05570954236369655, 0.05341604916894394, 0.05130380907018088, 0.04938464028042515, 0.047668074249255364, 0.046160809303984245, 0.0448662476896901, 0.04378418951122349, 0.042910750074239244, 0.042238542393491445, 0.04175712722565778, 0.041453688128378394, 0.041313851094405975, 0.04132254759976966, 0.04146482057060514, 0.04172649184641622, 0.04209463959621984, 0.04255786642565855, 0.043106367318491205, 0.04373182790770949, 0.04442719719100293, 0.045186385322555846, 0.04600393752011544, 0.04687473038873176, 0.047793728079582556, 0.048755823906670485, 0.049755779878485513, 0.05078826376508286, 0.05184797235594785, 0.05292982154437956, 0.054029179233999816, 0.05514211562222206, 0.05626564655895464, 0.057397948600062206, 0.05853852829663074, 0.05968833257687319, 0.060849791408612484, 0.06202678810646491, 0.06322455664554806, 0.06444950920429868, 0.06570900091081594, 0.06701104236293615, 0.06836397377620307, 0.06977611732353574, 0.07125542603605335, 0.07280914821112774, 0.07444352538928366 ], [ 0.06391558405500063, 0.061156574053015625, 0.058533031433784764, 0.05606053416802829, 0.053754053040193275, 0.051627500982251974, 0.04969321577572919, 0.047961402168847644, 0.046439578022910225, 0.04513208650239387, 0.04403974649665941, 0.04315970998975787, 0.04248557416066244, 0.042007759316230756, 0.04171411947361621, 0.04159071263168141, 0.041622633648559726, 0.04179480970223447, 0.04209267480268883, 0.042502668636111594, 0.043012537463078836, 0.04361144387131544, 0.04428991403100019, 0.045039664664814176, 0.04585335787589944, 0.046724331580877014, 0.04764634796504181, 0.04861339346391698, 0.0496195526574611, 0.05065896658207306, 0.05172587473080596, 0.05281473060699559, 0.05392037388875728, 0.055038238314279696, 0.056164573111183155, 0.057296656651069665, 0.0584329833646497, 0.05957340818737942, 0.06071923644250582, 0.06187325080848371, 0.0630396707252767, 0.06422404324709322, 0.06543306797281623, 0.06667436228640558, 0.0679561766526404, 0.06928707297228076, 0.07067558173872912, 0.07212985562555804, 0.07365733784396729, 0.07526446290150324 ], [ 0.06442729706095587, 0.061664228740369594, 0.05903434482403222, 0.056553319057897664, 0.05423633140779641, 0.052097639353871475, 0.050150078317908235, 0.04840451276445777, 0.046869277583162526, 0.04554966741027352, 0.04444754392188057, 0.04356113130677777, 0.04288505345637727, 0.042410633216287956, 0.04212643111332267, 0.042018959840408925, 0.0420734831657277, 0.04227480076124844, 0.04260793342805026, 0.04305865003704739, 0.04361380948238416, 0.04426152046582995, 0.0449911444136499, 0.04579318075310322, 0.046659079691528556, 0.04758102704246056, 0.04855174023442579, 0.04956430603048941, 0.050612080155706035, 0.051688658325247924, 0.05278791826889677, 0.0539041241705278, 0.05503207903326825, 0.05616730699461886, 0.057306246356920144, 0.058446434642515074, 0.05958666881313387, 0.0607271264223772, 0.061869436520266274, 0.06301669236019912, 0.06417340125955596, 0.06534537031122452, 0.06653953004451456, 0.06776370157835261, 0.06902631621873916, 0.07033609965407042, 0.07170173563179494, 0.07313152593404652, 0.0746330642860194, 0.07621294128687746 ], [ 0.06507551674173633, 0.062312311650997584, 0.05967985192877154, 0.057193868563175904, 0.05486970857895157, 0.052721929256088165, 0.05076381806965906, 0.049006855476032875, 0.04746015500789527, 0.04612993351170003, 0.045019078603516526, 0.0441268840757092, 0.043449011755114966, 0.04297770917650177, 0.04270227166345435, 0.042609695632275124, 0.042685439105661235, 0.042914193737005966, 0.043280581398306484, 0.043769712399316894, 0.044367573234483114, 0.0450612413813209, 0.04583894783705649, 0.046690022711052194, 0.047604765600202326, 0.048574282206030044, 0.0495903235994484, 0.0506451564930805, 0.05173148338561314, 0.052842421781210916, 0.053971542876555825, 0.055112962872161116, 0.05626147480522194, 0.05741270560439503, 0.05856328175680334, 0.05971098720878216, 0.06085489848321595, 0.06199548410164874, 0.06313465794643586, 0.0642757789925062, 0.06542359278407273, 0.06658411310084579, 0.06776444544673882, 0.06897255727491443, 0.07021700314776586, 0.0715066161456234, 0.07285017952591567, 0.07425609458232081, 0.07573206154884664, 0.07728478999735608 ], [ 0.06586263086228691, 0.06310378722434093, 0.06047315267802041, 0.057986472066395185, 0.0556592083402801, 0.0535061597369169, 0.05154100026537975, 0.04977575653820465, 0.04822025041668876, 0.04688155527999887, 0.045763529376725114, 0.0448664964426903, 0.044187135837723386, 0.0437186196763871, 0.043450996529880735, 0.043371779713925855, 0.04346666476057416, 0.0437202845864094, 0.04411691498173316, 0.04464106352262985, 0.0452779039890991, 0.046013547662846016, 0.0468351666262431, 0.04773099972777128, 0.04869027917106745, 0.04970311617270504, 0.05076037978260937, 0.05185359566754029, 0.052974883016216626, 0.05411693897952947, 0.055273072124393384, 0.05643727985739777, 0.057604359974841465, 0.05877004346993975, 0.059931134323991546, 0.06108564194620284, 0.06223289287836573, 0.06337361003718307, 0.06450994988465107, 0.06564549033443319, 0.06678516483515964, 0.0679351408874655, 0.06910264423397217, 0.07029573307135653, 0.07152302977594954, 0.07279342063724947, 0.07411573670970469, 0.0754984308241918, 0.07694926674875749, 0.07847503622104246 ], [ 0.06678956372547598, 0.06404002064545972, 0.06141610351017076, 0.058933524476646, 0.05660780488841565, 0.05445391463420368, 0.052485833471869414, 0.05071604378689286, 0.04915497965587731, 0.047810475071262425, 0.04668727071041484, 0.04578664783108736, 0.045106253825509, 0.04464016355555928, 0.044379186103903345, 0.04431138612869124, 0.04442275389811064, 0.044697938106192554, 0.045120955002113224, 0.04567580382050286, 0.04634694498625021, 0.04711962599031266, 0.04798006391101583, 0.04891551004501762, 0.04991423051602504, 0.050965438273525704, 0.05205920850044855, 0.05318640305141881, 0.05433862176653983, 0.05550819057975044, 0.05668818912373753, 0.05787251455930509, 0.05905597388619364, 0.06023439406260265, 0.06140473774595079, 0.06256521214128541, 0.06371535904257526, 0.06485611542668024, 0.06598983571043171, 0.06712026887206711, 0.06825248599266319, 0.06939275635419638, 0.07054837301187027, 0.0717274316907617, 0.07293856984135846, 0.07419067555765405, 0.07549257857994614, 0.07685273749209721, 0.0782789381991322, 0.07977801861380011 ], [ 0.06785571899585151, 0.06512070618916137, 0.06250872865881947, 0.060035417666094014, 0.05771629152791321, 0.05556641575950974, 0.05359998491264563, 0.051829832639762784, 0.0502668908333421, 0.04891963603693051, 0.04779357819566851, 0.04689085779125391, 0.046210016611290455, 0.045745991100366395, 0.04549034647212519, 0.045431731264070734, 0.04555649625673292, 0.04584939864761989, 0.046294307444385584, 0.046874838265177396, 0.04757486918911312, 0.04837891628068395, 0.04927237141965507, 0.05024162235413855, 0.051274084469528976, 0.0523581765328394, 0.053483270408345426, 0.05463963934738224, 0.05581842256212011, 0.05701161662774988, 0.05821209765590523, 0.05941367264875705, 0.06061115421886226, 0.061800449984960155, 0.06297865632934192, 0.06414414564593693, 0.06529663650666563, 0.0664372371235961, 0.06756845392031607, 0.06869415883104804, 0.0698195110494512, 0.07095083130984536, 0.0720954293668231, 0.07326138808882891, 0.07445731039596631, 0.07569203799039832, 0.07697435322803681, 0.0783126773018375, 0.07971477888886021, 0.08118750734645924 ], [ 0.06905899024149495, 0.06634387440732355, 0.06374922289664958, 0.06129053746252811, 0.058983270394680425, 0.056842503678261526, 0.054882550594690396, 0.053116484030980085, 0.05155560899514203, 0.05020891332140331, 0.049082547272110866, 0.04817939478657239, 0.04749880084962697, 0.047036506794431866, 0.04678481838413023, 0.04673299565183098, 0.04686781813283238, 0.04717425406860289, 0.04763615350660578, 0.04823689328465098, 0.04895992194227821, 0.04978917758378536, 0.050709375156843255, 0.051706177387268876, 0.052766274255417085, 0.05387739992742729, 0.05502831501185358, 0.05620877769945467, 0.0574095213620298, 0.05862224975870117, 0.05983965495823793, 0.06105545793445702, 0.062264467770901485, 0.0634626525754539, 0.0646472134839766, 0.06581665238005444, 0.06697082400257656, 0.0681109637871001, 0.06923968395134966, 0.07036093188825025, 0.07147990680487254, 0.07260293269832555, 0.0737372881484037, 0.07489099597008624, 0.07607257840515509, 0.0772907860866057, 0.07855431127591182, 0.07987149761072267, 0.0812500595688444, 0.0826968248594222 ], [ 0.07039583309305211, 0.06770597115676684, 0.06513403779757677, 0.06269535733541196, 0.06040525349636945, 0.05827874569080489, 0.056330169404966685, 0.05457272336331703, 0.05301795829000806, 0.051675237560274014, 0.05055121618893025, 0.04964939705457489, 0.04896982674704689, 0.04850898383450145, 0.04825988905623292, 0.0482124341945276, 0.04835389240663368, 0.04866954681016799, 0.04914336255628715, 0.049758631853410173, 0.050498537885356784, 0.051346606080106785, 0.05228703352839374, 0.053304905207156576, 0.05438631714598499, 0.05551843188670515, 0.05668949177839729, 0.05788881245907174, 0.05910677383380469, 0.06033482017312709, 0.061565475461481306, 0.06279237533433644, 0.06401031311218527, 0.06521529464683178, 0.06640459489796621, 0.06757680824511211, 0.06873188437251378, 0.0698711420043182, 0.07099725369656451, 0.07211419622126534, 0.07322716274319675, 0.07434243494494078, 0.07546721545359002, 0.07660942329798477, 0.0777774575775064, 0.07897993690580399, 0.08022542431400935, 0.08152214893766417, 0.0828777367502579, 0.08429896266590584 ], [ 0.07186138849825294, 0.06920199598447868, 0.06665803679267691, 0.06424461153721471, 0.061976855078366914, 0.05986964809847562, 0.057937255274397796, 0.05619289167960412, 0.05464823020591951, 0.0533128771251091, 0.052193858172601436, 0.0512951698397999, 0.05061745512979137, 0.050157855901174025, 0.049910074051968505, 0.04986464441956675, 0.050009390440104856, 0.050330007705609525, 0.05081070699988808, 0.05143484929661244, 0.05218551814392595, 0.053045994571725597, 0.054000120418651806, 0.05503255345695451, 0.056128929694724224, 0.05727595446059971, 0.05846144524421179, 0.0596743471976331, 0.06090473812185322, 0.06214383483441957, 0.0633840078743035, 0.06461880707379138, 0.06584299689554962, 0.06705259769996634, 0.06824492726147457, 0.0694186358130445, 0.07057372755562762, 0.07171156181050277, 0.07283482771697963, 0.07394748750604052, 0.07505468485229003, 0.07616261657327103, 0.07727836795642559, 0.07840971418193524, 0.07956489257558888, 0.08075235263141056, 0.08198049271285732, 0.08325739387343509, 0.08459056213389535, 0.08598669065196664 ], [ 0.0734496438627883, 0.07082568408277139, 0.06831470022818273, 0.0659315254574579, 0.06369104918310912, 0.061607942344554, 0.059696312443444595, 0.05796928943661778, 0.056438553774687525, 0.05511383101075508, 0.05400239153943677, 0.053108605755519116, 0.052433609996933674, 0.05197513339899063, 0.05172751898435113, 0.051681946380360416, 0.05182683439341833, 0.05214837669595836, 0.05263114920262205, 0.05325872590872422, 0.05401424957916144, 0.05488092042633063, 0.05584238470907109, 0.05688302185602198, 0.05798814087499771, 0.05914410381133901, 0.06033839643975622, 0.061559665386330724, 0.06279773775587372, 0.06404363518573936, 0.06528958988029064, 0.06652906613867153, 0.0677567874775022, 0.06896876680301955, 0.07016233522253408, 0.07133616395290142, 0.07249027330063075, 0.07362602276243664, 0.07474607684159791, 0.07585434212356434, 0.07695587244694221, 0.0780567405935905, 0.07916387675120941, 0.08028487600465206, 0.08142777919222137, 0.08260083349088376, 0.08381224090800028, 0.08506990427550772, 0.08638118118680836, 0.0877526564411274 ], [ 0.07515361799917747, 0.07256971501669704, 0.07009636045124705, 0.06774807955169651, 0.06553946461132372, 0.06348491263436228, 0.061598296478479635, 0.059892570402953635, 0.05837932023132256, 0.05706828025786534, 0.05596685189445431, 0.05507966991266317, 0.054408267281246536, 0.05395088576339473, 0.05370246532392479, 0.05365482281231065, 0.05379700419059645, 0.05411577116394138, 0.054596168040351174, 0.055222110789896535, 0.05597694691611042, 0.0568439485506328, 0.05780671775834408, 0.05884949853431376, 0.05995740193097283, 0.06111655825609871, 0.06231421358449749, 0.06353878783225929, 0.06477990945234435, 0.06602843843373228, 0.06727648551146881, 0.068517431863455, 0.06974595040817261, 0.07095802728754443, 0.07215098026930154, 0.0733234696118307, 0.07447549634284849, 0.07560838283917828, 0.07672473098752888, 0.0778283539928713, 0.07892417902807826, 0.08001811933623645, 0.08111691605125788, 0.08222795182425735, 0.08335904024026002, 0.08451819686116592, 0.08571339938911761, 0.08695234574611174, 0.08824221965121741, 0.08958947341570285 ], [ 0.07696555652289776, 0.07442593240346697, 0.07199444825065002, 0.0696852849039895, 0.06751269165848571, 0.06549073534004475, 0.06363298697844025, 0.061952147103872604, 0.060459619105514735, 0.0591650508055081, 0.05807587593721358, 0.057196897028806176, 0.056529956104429895, 0.056073736786045165, 0.0558237295735299, 0.055772372634345146, 0.05590935728966093, 0.05622206594419608, 0.05669609544089011, 0.057315813536148626, 0.05806490029921363, 0.058926837241774895, 0.059885321237157424, 0.06092459433572702, 0.062029692020602004, 0.06318662016870727, 0.06438247496050391, 0.06560552085789849, 0.06684524045220308, 0.0680923673695392, 0.06933891024794178, 0.07057817260207151, 0.07180477050874193, 0.07301464766619589, 0.07420508557853929, 0.07537470539887621, 0.07652345729487472, 0.07765259302497458, 0.07876461767435664, 0.07986321714257852, 0.08095315894932639, 0.08204016518222222, 0.08313075789657645, 0.08423207892365454, 0.0853516877630968, 0.08649734291434985, 0.0876767735072302, 0.08889744927658669, 0.09016635764844017, 0.09148979684911251 ], [ 0.07887712620468126, 0.07638556111489134, 0.07399973501197041, 0.07173345228928224, 0.06960057972596514, 0.06761480628050094, 0.06578934487493367, 0.06413657745481353, 0.06266765220057344, 0.06139205131251015, 0.060317157996092836, 0.059447859965058664, 0.05878623126893795, 0.05833133212746597, 0.058079156603652746, 0.058022741356612936, 0.05815242854894448, 0.05845625672448141, 0.058920439423276204, 0.05952988513642708, 0.06026871424744447, 0.06112073707783931, 0.06206986911056799, 0.06310047190524538, 0.0641976188821559, 0.06534729282848341, 0.06653652641736463, 0.0677534986262377, 0.06898759940900925, 0.07022947308638043, 0.07147104834252807, 0.07270555996609507, 0.07392756489534147, 0.07513295292744392, 0.07631895073086266, 0.07748411658663668, 0.07862832256538413, 0.07975272058499204, 0.08085968894426686, 0.08195275644343414, 0.08303650203749667, 0.0841164290757688, 0.0851988145069053, 0.0862905349074682, 0.08739887273989447, 0.08853130775885164, 0.089695299841938, 0.09089807059064753, 0.0921463917046459, 0.09344638827443552 ], [ 0.08087959930390502, 0.07843941171968447, 0.07610255885557411, 0.07388244142097047, 0.0717925107901611, 0.06984603906607197, 0.06805583567119393, 0.06643391209102893, 0.06499110320927733, 0.06373666210971629, 0.06267785414297138, 0.061819583626321006, 0.0611640905157304, 0.06071075275028824, 0.0604560217575693, 0.06039350455624071, 0.06051418851769453, 0.06080678781866334, 0.061258177581732076, 0.06185387511144219, 0.062578528073946, 0.06341637573659122, 0.0643516591730129, 0.06536896711617526, 0.06645351385139227, 0.06759135294790831, 0.06876953531237294, 0.0699762221989706, 0.07120076395628162, 0.07243375406618878, 0.0736670660294447, 0.07489387835365025, 0.07610869064415726, 0.07730733180487101, 0.07848695974437486, 0.07964605080361954, 0.08078437638000639, 0.08190296389853788, 0.08300403934043067, 0.0840909489444667, 0.08516805840515891, 0.08624062885974153, 0.08731467013125362, 0.08839677301429304, 0.08949392377474602, 0.0906133053894927, 0.09176209126706825, 0.09294723814901645, 0.09417528548318226, 0.09545216869448012 ], [ 0.08296402160541437, 0.08057806519016796, 0.07829302705808762, 0.0761218819496995, 0.07407763956810581, 0.07217312464541607, 0.07042070810125783, 0.06883199127874087, 0.06741745132669826, 0.06618606319524109, 0.06514492143691808, 0.06429889150837763, 0.06365032369096266, 0.06319886144083231, 0.06294136913281322, 0.06287199232509358, 0.06298234883578382, 0.06326183405343068, 0.06369801204747756, 0.06427705738170633, 0.06498421178856277, 0.06580422428231589, 0.06672175111411432, 0.06772170111689099, 0.06878952064083155, 0.06991141924062681, 0.07107454201758913, 0.07226709706179417, 0.07347844714063123, 0.07469917414486284, 0.07592112334028639, 0.0771374326158792, 0.07834254999549597, 0.07953224091229212, 0.08070358526740579, 0.08185496317485233, 0.08298602755564076, 0.08409766137983009, 0.08519191734358803, 0.08627193807850449, 0.08734185558621213, 0.08840666943122406, 0.0894721042595254, 0.09054444837992924, 0.09163037637615279, 0.09273675992266178, 0.09387047205791946, 0.09503819102123162, 0.09624621028632506, 0.09750026154732867 ], [ 0.08512136040643757, 0.08279203392917939, 0.08056119067669926, 0.0784413620678583, 0.07644509625602523, 0.07458474804905862, 0.07287222441651563, 0.07131868790660566, 0.06993422569692039, 0.06872749844724668, 0.06770538975374184, 0.06687268252540389, 0.06623179149462388, 0.06578257999273603, 0.06552228340769713, 0.06544555180888059, 0.06554461164243115, 0.06580953354810455, 0.06622858273358062, 0.06678862186018823, 0.06747553482279776, 0.06827464272647422, 0.06917108946650215, 0.07015018192902576, 0.07119767739014739, 0.07230001708229557, 0.07344450953600129, 0.07461947008338587, 0.07581432404168752, 0.0770196809621139, 0.07822738635274554, 0.07943055584631321, 0.08062359518954769, 0.08180220789994677, 0.08296339111064863, 0.08410541908584383, 0.08522781317449112, 0.08633129658610726, 0.08741773230745706, 0.0884900427100197, 0.0895521098943189, 0.09060865654072084, 0.09166510794110982, 0.09272743691586034, 0.09380199440787058, 0.09489532961065572, 0.09601400444209249, 0.09716440792784174, 0.09835257652301313, 0.09958402650863266 ], [ 0.08734263083105644, 0.08507189767091348, 0.08289719020400585, 0.08083058393386178, 0.07888415156253031, 0.07706976267906843, 0.07539884338132408, 0.0738820984413598, 0.07252920339517262, 0.0713484795166789, 0.07034657028631143, 0.06952814260852391, 0.06889563843196983, 0.06844910150373633, 0.06818609921266668, 0.06810175116456724, 0.06818886551687606, 0.06843817307706146, 0.0688386397833499, 0.06937783205599152, 0.07004230740427478, 0.07081800441445064, 0.07169061088359213, 0.07264589508196957, 0.07366999161493305, 0.07474963910353956, 0.0758723713158124, 0.07702666625888853, 0.07820205918431578, 0.07938922573584307, 0.08058004091810804, 0.08176761851297253, 0.08294633429419651, 0.08411183510044606, 0.08526103466622145, 0.08639209617021772, 0.08750440078875907, 0.0885985011563984, 0.08967605853422, 0.09073976265327163, 0.09179323361039161, 0.09284090581288962, 0.09388789475482123, 0.09493984830907733, 0.09600278517406466, 0.09708292404938389, 0.09818650795261706, 0.09931962874829321, 0.10048805736531659, 0.10169708527090933 ], [ 0.08961900049041993, 0.08740841467680145, 0.08529137318818762, 0.08327948748464174, 0.08138434636039546, 0.07961732533696615, 0.07798936012631903, 0.07651068699933031, 0.07519055708622886, 0.07403693644039319, 0.07305620848209911, 0.07225289931360324, 0.07162944835985009, 0.07118604598093592, 0.0709205557015752, 0.07082853175632269, 0.07090333372514934, 0.07113633063528937, 0.07151717868738676, 0.07203415108858473, 0.07267449607047426, 0.07342480001074289, 0.07427133600345134, 0.075200383212151, 0.0761985078167999, 0.07725280144150193, 0.07835107704797133, 0.07948202514559247, 0.08063533481096453, 0.08180178460575768, 0.08297330829043019, 0.08414303952493257, 0.08530533876930695, 0.08645580454191196, 0.08759127020305818, 0.08870978660174579, 0.0898105903089233, 0.09089405678904403, 0.09196163773867676, 0.09301578193757906, 0.09405983929407472, 0.09509794829344596, 0.09613490773733466, 0.09717603444642635, 0.09822700943156319, 0.09929371585508194, 0.10038207283438975, 0.10149786971238146, 0.10264660576888594, 0.10383334042205572 ], [ 0.09194187365504523, 0.08979260990378324, 0.08773438611015057, 0.08577834564894032, 0.08393558979312636, 0.08221699673810222, 0.08063300858110739, 0.07919338924887782, 0.07790696003210508, 0.07678132350351663, 0.07582259062819914, 0.07503512908640145, 0.07442135241449409, 0.07398156884797644, 0.0737139053910649, 0.07361431683513683, 0.07367668196315022, 0.07389298119825888, 0.07425354281387304, 0.07474733965361789, 0.07536231577594266, 0.07608572261617798, 0.0769044467022907, 0.07780531489330177, 0.07877536766173956, 0.07980209535078199, 0.08087363606493596, 0.08197893661919699, 0.08310787971850103, 0.08425138136859339, 0.08540146262088273, 0.08655129934669359, 0.08769525302916421, 0.08882888472990061, 0.08994895356760779, 0.09105340033258462, 0.0921413163150803, 0.0932128970805271, 0.09426938079323252, 0.09531297076944649, 0.09634674221595069, 0.09737453355676257, 0.09840082333428378, 0.09943059434978598, 0.10046918743049511, 0.10152214791897562, 0.10259506861272473, 0.10369343337545157, 0.10482246593958122, 0.10598698847713978 ], [ 0.09430295681813841, 0.09221584255546417, 0.09021724354456455, 0.0883178346882907, 0.08652823033885344, 0.0848588128502544, 0.08331953269304364, 0.08191968321735683, 0.08066765634209179, 0.07957068896384752, 0.07863461326157033, 0.07786362672019988, 0.07726009896237486, 0.07682443182431938, 0.07655498628397589, 0.07644808500154786, 0.07649809296236947, 0.07669757195856648, 0.07703749847687123, 0.0775075299116216, 0.07809630148351342, 0.07879173595202081, 0.0795813498743073, 0.08045254320681694, 0.08139286277546211, 0.08239023391402518, 0.08343315790224187, 0.08451087543811664, 0.08561349815252384, 0.08673211116042848, 0.08785884997287745, 0.08898695493814773, 0.09011080591307645, 0.09122593924164032, 0.09232904846221984, 0.09341796957043325, 0.09449165119387921, 0.09555010972651455, 0.09659436934159739, 0.09762638685553944, 0.09864896164053588, 0.0996656311611408, 0.10068055320955263, 0.10169837649841071, 0.10272410189299498, 0.10376293717552977, 0.10482014877794377, 0.10590091434137912, 0.10701018021161623, 0.10815252802059697 ], [ 0.09669430789128389, 0.0946698557532478, 0.0927313779005244, 0.09088908357858394, 0.08915310441057082, 0.08753333233492658, 0.08603923242142104, 0.08467963368569258, 0.08346250379136791, 0.08239471651978178, 0.08148182371481551, 0.08072784558236695, 0.08013509422342563, 0.07970404468454761, 0.0794332654222039, 0.07931941602320387, 0.0793573147728965, 0.07954007295755787, 0.07985928748073211, 0.08030527923402486, 0.0808673622043955, 0.08153412768836465, 0.08229372904449031, 0.08313415472418627, 0.08404348033458517, 0.08501009367353354, 0.08602288960834731, 0.08707143406857076, 0.08814609816224787, 0.08923816450303304, 0.09033990833459868, 0.09144465608720034, 0.09254682374019095, 0.09364193692675038, 0.09472663421558623, 0.09579865452643395, 0.0968568092442964, 0.09790093933192913, 0.09893185762276235, 0.09995127651379072, 0.10096172146419398, 0.10196643102429274, 0.10296924454573213, 0.10397447922431059, 0.10498679866150327, 0.10601107565429445, 0.10705225238722614, 0.10811520155818907, 0.10920459217762053, 0.11032476380613326 ], [ 0.0991083713775359, 0.09714681110193445, 0.095268672988003, 0.09348370618628318, 0.09180156678136331, 0.09023166492781722, 0.08878298988717317, 0.08746391606969885, 0.08628199557859534, 0.0852437452914153, 0.08435443887013062, 0.08361791586617101, 0.08303642086732406, 0.08261048508866682, 0.08233886078868959, 0.08221851549645112, 0.08224468863753692, 0.08241100833159508, 0.0827096615836712, 0.08313160743347638, 0.08366682030259642, 0.08430454996574095, 0.08503358517415086, 0.08584250967147906, 0.0867199417443244, 0.08765475110694518, 0.08863624946349881, 0.08965435326251216, 0.09069971881840715, 0.09176385109078895, 0.09283918802843034, 0.09391916259303543, 0.0949982444891644, 0.09607196335257517, 0.09713691478849093, 0.09819075028431946, 0.09923215170828639, 0.10026079088722963, 0.10127727465759394, 0.10228307581320853, 0.10328045052952561, 0.10427234311424603, 0.10526227929747055, 0.1062542497019662, 0.10725258559078502, 0.1082618294356672, 0.10928660324354153, 0.11033147787873261, 0.11140084678842742, 0.11249880754984178 ], [ 0.10153800179512187, 0.09963931077482699, 0.09782148441194057, 0.0960938196368284, 0.09446550663816532, 0.0929454849674828, 0.0915422802796986, 0.09026382475545351, 0.08911726631446641, 0.08810877387610855, 0.08724334788278607, 0.08652464674702975, 0.08595484048573186, 0.08553450230571204, 0.08526254718897344, 0.08513622367733234, 0.08515116136882869, 0.08530147257576283, 0.08557990270017028, 0.08597802066857077, 0.0864864386094358, 0.08709504902798398, 0.0877932679939733, 0.08857027409339113, 0.08941523478283363, 0.09031751397581558, 0.09126685687064533, 0.09225354996534431, 0.09326855575559875, 0.09430362272361321, 0.09535137191477588, 0.09640536172661474, 0.09746013258548958, 0.09851123305180758, 0.0995552286590532, 0.10058969452764453, 0.1016131925577394, 0.1026252338357933, 0.10362622681311587, 0.1046174118429894, 0.10560078279683273, 0.10657899671037753, 0.10755527272043616, 0.10853328191705035, 0.10951703012427393, 0.11051073600114159, 0.11151870718621266, 0.11254521745885449, 0.11359438802654236, 0.1146700760453485 ], [ 0.10397647744598369, 0.1021404094878049, 0.1003826494508289, 0.09871205182590366, 0.09713735250804661, 0.0956670336011996, 0.09430917131789583, 0.09307126992880152, 0.09196008649113338, 0.09098145289798787, 0.09014010341638092, 0.08943951705511216, 0.0888817845625363, 0.08846750939686818, 0.08819575055064532, 0.0880640127159339, 0.08806828618128518, 0.08820313542262863, 0.08846183202231671, 0.08883652473918043, 0.08931843757473105, 0.08989808570054049, 0.09056549912583724, 0.09131044484394114, 0.09212263965823991, 0.09299194767421164, 0.09390855829209788, 0.09486314223811122, 0.09584698459440913, 0.096852094864568, 0.0978712948367971, 0.0988982854188392, 0.09992769377879167, 0.10095510210722002, 0.10197705918914336, 0.10299107580273081, 0.10399560479617662, 0.10499000657326732, 0.10597450066698116, 0.1069501041125349, 0.10791855744968018, 0.10888223938254707, 0.10984407138997154, 0.11080741388925203, 0.11177595588572192, 0.1127536003597289, 0.11374434792030615, 0.1147521814604555, 0.11578095465546889, 0.11683428713221129 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.27501 (SEM: 0)
x1: 0.374395
x2: 0.473328
x3: 0.253384
x4: 0.175281
x5: 0.91134
x6: 0.579642", "Arm 1_0
l2norm: 1.42382 (SEM: 0)
x1: 0.585993
x2: 0.236022
x3: 0.224513
x4: 0.497436
x5: 0.761981
x6: 0.86586", "Arm 2_0
l2norm: 1.11805 (SEM: 0)
x1: 0.260758
x2: 0.263249
x3: 0.332616
x4: 0.737915
x5: 0.67316
x6: 0.0666684", "Arm 3_0
l2norm: 1.18093 (SEM: 0)
x1: 0.238416
x2: 0.290649
x3: 0.294604
x4: 0.639106
x5: 0.133313
x6: 0.860378", "Arm 4_0
l2norm: 1.60069 (SEM: 0)
x1: 0.752805
x2: 0.562042
x3: 0.919162
x4: 0.332665
x5: 0.156489
x6: 0.836415", "Arm 5_0
l2norm: 1.40766 (SEM: 0)
x1: 0.00784757
x2: 0.645909
x3: 0.94897
x4: 0.305871
x5: 0.0144034
x6: 0.754934", "Arm 6_0
l2norm: 0.868767 (SEM: 0)
x1: 0.152215
x2: 0.449218
x3: 0.133706
x4: 0.510388
x5: 0.0822845
x6: 0.494617", "Arm 7_0
l2norm: 1.40513 (SEM: 0)
x1: 0.0326946
x2: 0.986456
x3: 0.40432
x4: 0.703495
x5: 0.102807
x6: 0.575572", "Arm 8_0
l2norm: 1.48415 (SEM: 0)
x1: 0.503454
x2: 0.453209
x3: 0.413391
x4: 0.631017
x5: 0.679934
x6: 0.844067", "Arm 9_0
l2norm: 1.43154 (SEM: 0)
x1: 0.375814
x2: 0.119286
x3: 0.98163
x4: 0.627615
x5: 0.510208
x6: 0.525394", "Arm 10_0
l2norm: 1.2679 (SEM: 0)
x1: 0.873167
x2: 0.450857
x3: 0.64219
x4: 0.0955072
x5: 0.387701
x6: 0.264634", "Arm 11_0
l2norm: 1.35678 (SEM: 0)
x1: 0.213789
x2: 0.505108
x3: 0.611463
x4: 0.0242879
x5: 0.814381
x6: 0.708746", "Arm 12_0
l2norm: 0.866921 (SEM: 0)
x1: 0.0985943
x2: 0.245195
x3: 0.109072
x4: 0.431905
x5: 0
x6: 0.695178", "Arm 13_0
l2norm: 0.92005 (SEM: 0)
x1: 0.372133
x2: 0.286031
x3: 0.143069
x4: 0.529643
x5: 2.88188e-14
x6: 0.570268", "Arm 14_0
l2norm: 0.88022 (SEM: 0)
x1: 0
x2: 0.367709
x3: 0.256513
x4: 0.360625
x5: 0.117116
x6: 0.655752", "Arm 15_0
l2norm: 0.882312 (SEM: 0)
x1: 1.68014e-11
x2: 0.37561
x3: 0.302376
x4: 0.297549
x5: 0.136556
x6: 0.662402", "Arm 16_0
l2norm: 0.900461 (SEM: 0)
x1: 0
x2: 0.389754
x3: 0.3532
x4: 0.241469
x5: 0.16101
x6: 0.670775", "Arm 17_0
l2norm: 0.918556 (SEM: 0)
x1: 2.73201e-16
x2: 0.395481
x3: 0.398349
x4: 0.157199
x5: 0.190189
x6: 0.683941", "Arm 18_0
l2norm: 0.915915 (SEM: 0)
x1: 9.25717e-17
x2: 0.392143
x3: 0.444687
x4: 0.222179
x5: 0.158972
x6: 0.642449", "Arm 19_0
l2norm: 0.981636 (SEM: 0)
x1: 5.73937e-17
x2: 0.418918
x3: 0.428562
x4: 0.235395
x5: 0.212135
x6: 0.709957", "Arm 20_0
l2norm: 1.05464 (SEM: 0)
x1: 2.35232e-09
x2: 0.434061
x3: 0.471133
x4: 0.261458
x5: 0.262458
x6: 0.751427", "Arm 21_0
l2norm: 1.12542 (SEM: 0)
x1: 1.23073e-17
x2: 0.423516
x3: 0.485925
x4: 0.25374
x5: 0.257668
x6: 0.848703", "Arm 22_0
l2norm: 1.05487 (SEM: 0)
x1: 8.07667e-16
x2: 0.439797
x3: 0.487461
x4: 0.277821
x5: 0.315973
x6: 0.710409", "Arm 23_0
l2norm: 1.05059 (SEM: 0)
x1: 7.2121e-17
x2: 0.4969
x3: 0.466788
x4: 0.26182
x5: 0.338495
x6: 0.675143" ], "type": "scatter", "x": [ 0.2533838748931885, 0.22451329231262207, 0.33261550310999155, 0.29460429307073355, 0.9191618338227272, 0.9489704379811883, 0.13370572216808796, 0.4043200071901083, 0.41339108161628246, 0.9816301614046097, 0.64218954090029, 0.6114632291719317, 0.10907232993093868, 0.1430691675902939, 0.2565125085510775, 0.3023763014175414, 0.35320028083937244, 0.3983490752583664, 0.4446872731002771, 0.42856198890575564, 0.4711333703261342, 0.48592545419283445, 0.4874611489908248, 0.4667884151002082 ], "xaxis": "x", "y": [ 0.17528089880943298, 0.4974359851330519, 0.7379147168248892, 0.6391059402376413, 0.3326647160574794, 0.30587126035243273, 0.5103877419605851, 0.7034951644018292, 0.6310172770172358, 0.6276150373741984, 0.09550720732659101, 0.024287891574203968, 0.4319053198182016, 0.5296434558732782, 0.3606252585961346, 0.2975488264698061, 0.2414688141608569, 0.1571991439102564, 0.22217898540000125, 0.23539539780620913, 0.26145817484988026, 0.2537403415837016, 0.277821049307002, 0.2618196578247364 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.27501 (SEM: 0)
x1: 0.374395
x2: 0.473328
x3: 0.253384
x4: 0.175281
x5: 0.91134
x6: 0.579642", "Arm 1_0
l2norm: 1.42382 (SEM: 0)
x1: 0.585993
x2: 0.236022
x3: 0.224513
x4: 0.497436
x5: 0.761981
x6: 0.86586", "Arm 2_0
l2norm: 1.11805 (SEM: 0)
x1: 0.260758
x2: 0.263249
x3: 0.332616
x4: 0.737915
x5: 0.67316
x6: 0.0666684", "Arm 3_0
l2norm: 1.18093 (SEM: 0)
x1: 0.238416
x2: 0.290649
x3: 0.294604
x4: 0.639106
x5: 0.133313
x6: 0.860378", "Arm 4_0
l2norm: 1.60069 (SEM: 0)
x1: 0.752805
x2: 0.562042
x3: 0.919162
x4: 0.332665
x5: 0.156489
x6: 0.836415", "Arm 5_0
l2norm: 1.40766 (SEM: 0)
x1: 0.00784757
x2: 0.645909
x3: 0.94897
x4: 0.305871
x5: 0.0144034
x6: 0.754934", "Arm 6_0
l2norm: 0.868767 (SEM: 0)
x1: 0.152215
x2: 0.449218
x3: 0.133706
x4: 0.510388
x5: 0.0822845
x6: 0.494617", "Arm 7_0
l2norm: 1.40513 (SEM: 0)
x1: 0.0326946
x2: 0.986456
x3: 0.40432
x4: 0.703495
x5: 0.102807
x6: 0.575572", "Arm 8_0
l2norm: 1.48415 (SEM: 0)
x1: 0.503454
x2: 0.453209
x3: 0.413391
x4: 0.631017
x5: 0.679934
x6: 0.844067", "Arm 9_0
l2norm: 1.43154 (SEM: 0)
x1: 0.375814
x2: 0.119286
x3: 0.98163
x4: 0.627615
x5: 0.510208
x6: 0.525394", "Arm 10_0
l2norm: 1.2679 (SEM: 0)
x1: 0.873167
x2: 0.450857
x3: 0.64219
x4: 0.0955072
x5: 0.387701
x6: 0.264634", "Arm 11_0
l2norm: 1.35678 (SEM: 0)
x1: 0.213789
x2: 0.505108
x3: 0.611463
x4: 0.0242879
x5: 0.814381
x6: 0.708746", "Arm 12_0
l2norm: 0.866921 (SEM: 0)
x1: 0.0985943
x2: 0.245195
x3: 0.109072
x4: 0.431905
x5: 0
x6: 0.695178", "Arm 13_0
l2norm: 0.92005 (SEM: 0)
x1: 0.372133
x2: 0.286031
x3: 0.143069
x4: 0.529643
x5: 2.88188e-14
x6: 0.570268", "Arm 14_0
l2norm: 0.88022 (SEM: 0)
x1: 0
x2: 0.367709
x3: 0.256513
x4: 0.360625
x5: 0.117116
x6: 0.655752", "Arm 15_0
l2norm: 0.882312 (SEM: 0)
x1: 1.68014e-11
x2: 0.37561
x3: 0.302376
x4: 0.297549
x5: 0.136556
x6: 0.662402", "Arm 16_0
l2norm: 0.900461 (SEM: 0)
x1: 0
x2: 0.389754
x3: 0.3532
x4: 0.241469
x5: 0.16101
x6: 0.670775", "Arm 17_0
l2norm: 0.918556 (SEM: 0)
x1: 2.73201e-16
x2: 0.395481
x3: 0.398349
x4: 0.157199
x5: 0.190189
x6: 0.683941", "Arm 18_0
l2norm: 0.915915 (SEM: 0)
x1: 9.25717e-17
x2: 0.392143
x3: 0.444687
x4: 0.222179
x5: 0.158972
x6: 0.642449", "Arm 19_0
l2norm: 0.981636 (SEM: 0)
x1: 5.73937e-17
x2: 0.418918
x3: 0.428562
x4: 0.235395
x5: 0.212135
x6: 0.709957", "Arm 20_0
l2norm: 1.05464 (SEM: 0)
x1: 2.35232e-09
x2: 0.434061
x3: 0.471133
x4: 0.261458
x5: 0.262458
x6: 0.751427", "Arm 21_0
l2norm: 1.12542 (SEM: 0)
x1: 1.23073e-17
x2: 0.423516
x3: 0.485925
x4: 0.25374
x5: 0.257668
x6: 0.848703", "Arm 22_0
l2norm: 1.05487 (SEM: 0)
x1: 8.07667e-16
x2: 0.439797
x3: 0.487461
x4: 0.277821
x5: 0.315973
x6: 0.710409", "Arm 23_0
l2norm: 1.05059 (SEM: 0)
x1: 7.2121e-17
x2: 0.4969
x3: 0.466788
x4: 0.26182
x5: 0.338495
x6: 0.675143" ], "type": "scatter", "x": [ 0.2533838748931885, 0.22451329231262207, 0.33261550310999155, 0.29460429307073355, 0.9191618338227272, 0.9489704379811883, 0.13370572216808796, 0.4043200071901083, 0.41339108161628246, 0.9816301614046097, 0.64218954090029, 0.6114632291719317, 0.10907232993093868, 0.1430691675902939, 0.2565125085510775, 0.3023763014175414, 0.35320028083937244, 0.3983490752583664, 0.4446872731002771, 0.42856198890575564, 0.4711333703261342, 0.48592545419283445, 0.4874611489908248, 0.4667884151002082 ], "xaxis": "x2", "y": [ 0.17528089880943298, 0.4974359851330519, 0.7379147168248892, 0.6391059402376413, 0.3326647160574794, 0.30587126035243273, 0.5103877419605851, 0.7034951644018292, 0.6310172770172358, 0.6276150373741984, 0.09550720732659101, 0.024287891574203968, 0.4319053198182016, 0.5296434558732782, 0.3606252585961346, 0.2975488264698061, 0.2414688141608569, 0.1571991439102564, 0.22217898540000125, 0.23539539780620913, 0.26145817484988026, 0.2537403415837016, 0.277821049307002, 0.2618196578247364 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:22.360347Z", "iopub.status.busy": "2022-09-28T16:17:22.360113Z", "iopub.status.idle": "2022-09-28T16:17:22.419855Z", "shell.execute_reply": "2022-09-28T16:17:22.419177Z" } }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.08449017179860988, -0.08449017179860988, -0.08449017179860988, -0.384019256079747, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -1.141489636036521, -1.3796587496391413, -1.5581197189908667, -1.5821746544697821, -1.5894461375155513, -1.829999301606317, -1.954321328644257, -1.954321328644257, -2.0943748594105864, -2.0943748594105864, -2.2323771549892437 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.37439489364624023
x2: 0.47332763671875
x3: 0.2533838748931885
x4: 0.17528089880943298
x5: 0.9113397598266602
x6: 0.5796416401863098", "
Parameterization:
x1: 0.5859931083396077
x2: 0.23602221813052893
x3: 0.22451329231262207
x4: 0.4974359851330519
x5: 0.7619805717840791
x6: 0.8658601893112063", "
Parameterization:
x1: 0.2607578504830599
x2: 0.2632494177669287
x3: 0.33261550310999155
x4: 0.7379147168248892
x5: 0.6731598814949393
x6: 0.06666841357946396", "
Parameterization:
x1: 0.23841649945825338
x2: 0.2906491430476308
x3: 0.29460429307073355
x4: 0.6391059402376413
x5: 0.1333130719140172
x6: 0.8603779263794422", "
Parameterization:
x1: 0.7528051491826773
x2: 0.5620423462241888
x3: 0.9191618338227272
x4: 0.3326647160574794
x5: 0.15648924745619297
x6: 0.8364148093387485", "
Parameterization:
x1: 0.007847568951547146
x2: 0.6459092097356915
x3: 0.9489704379811883
x4: 0.30587126035243273
x5: 0.01440344750881195
x6: 0.7549335518851876", "
Parameterization:
x1: 0.15221494901925325
x2: 0.44921839982271194
x3: 0.13370572216808796
x4: 0.5103877419605851
x5: 0.08228453062474728
x6: 0.4946174994111061", "
Parameterization:
x1: 0.032694606110453606
x2: 0.9864563643932343
x3: 0.4043200071901083
x4: 0.7034951644018292
x5: 0.1028065774589777
x6: 0.5755716748535633", "
Parameterization:
x1: 0.5034541748464108
x2: 0.45320926886051893
x3: 0.41339108161628246
x4: 0.6310172770172358
x5: 0.6799339661374688
x6: 0.8440674981102347", "
Parameterization:
x1: 0.3758140420541167
x2: 0.1192864440381527
x3: 0.9816301614046097
x4: 0.6276150373741984
x5: 0.5102081531658769
x6: 0.5253935623914003", "
Parameterization:
x1: 0.8731671664863825
x2: 0.45085727609694004
x3: 0.64218954090029
x4: 0.09550720732659101
x5: 0.3877014722675085
x6: 0.26463367976248264", "
Parameterization:
x1: 0.21378932800143957
x2: 0.5051080957055092
x3: 0.6114632291719317
x4: 0.024287891574203968
x5: 0.814380744472146
x6: 0.7087460737675428", "
Parameterization:
x1: 0.09859432709653
x2: 0.24519461280222607
x3: 0.10907232993093868
x4: 0.4319053198182016
x5: 0.0
x6: 0.6951781162056347", "
Parameterization:
x1: 0.37213269940779775
x2: 0.2860313080329631
x3: 0.1430691675902939
x4: 0.5296434558732782
x5: 2.881876113456553e-14
x6: 0.5702676455231518", "
Parameterization:
x1: 0.0
x2: 0.3677093875443307
x3: 0.2565125085510775
x4: 0.3606252585961346
x5: 0.11711588585347818
x6: 0.6557522699608415", "
Parameterization:
x1: 1.6801446219001503e-11
x2: 0.37561037690065663
x3: 0.3023763014175414
x4: 0.2975488264698061
x5: 0.13655560856437557
x6: 0.6624018941167843", "
Parameterization:
x1: 0.0
x2: 0.38975384423886666
x3: 0.35320028083937244
x4: 0.2414688141608569
x5: 0.1610103291081888
x6: 0.6707754603631101", "
Parameterization:
x1: 2.7320105922884477e-16
x2: 0.3954809232586543
x3: 0.3983490752583664
x4: 0.1571991439102564
x5: 0.19018854757487455
x6: 0.683940973301852", "
Parameterization:
x1: 9.25717039869366e-17
x2: 0.39214308122745667
x3: 0.4446872731002771
x4: 0.22217898540000125
x5: 0.15897216539533768
x6: 0.6424492701028753", "
Parameterization:
x1: 5.739366266477024e-17
x2: 0.418918008657315
x3: 0.42856198890575564
x4: 0.23539539780620913
x5: 0.21213519995780306
x6: 0.7099569747290959", "
Parameterization:
x1: 2.3523167111013215e-09
x2: 0.4340612084842039
x3: 0.4711333703261342
x4: 0.26145817484988026
x5: 0.26245778250591706
x6: 0.7514266932965366", "
Parameterization:
x1: 1.2307325359545354e-17
x2: 0.4235164868113142
x3: 0.48592545419283445
x4: 0.2537403415837016
x5: 0.25766814948060035
x6: 0.8487028074816089", "
Parameterization:
x1: 8.076674496607118e-16
x2: 0.43979729139056456
x3: 0.4874611489908248
x4: 0.277821049307002
x5: 0.31597270434921604
x6: 0.7104091599529982", "
Parameterization:
x1: 7.212101339187558e-17
x2: 0.49690038591059055
x3: 0.4667884151002082
x4: 0.2618196578247364
x5: 0.3384951258500018
x6: 0.6751426302101313", "
Parameterization:
x1: 3.360233643198171e-14
x2: 0.4026574838295572
x3: 0.5128966783389253
x4: 0.28919821838697746
x5: 0.3425065762199245
x6: 0.692797327605787" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.08449017179860988, -0.08449017179860988, -0.08449017179860988, -0.384019256079747, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -1.141489636036521, -1.3796587496391413, -1.5581197189908667, -1.5821746544697821, -1.5894461375155513, -1.829999301606317, -1.954321328644257, -1.954321328644257, -2.0943748594105864, -2.0943748594105864, -2.2323771549892437 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.08449017179860988, -0.08449017179860988, -0.08449017179860988, -0.384019256079747, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -0.7852745465346034, -1.141489636036521, -1.3796587496391413, -1.5581197189908667, -1.5821746544697821, -1.5894461375155513, -1.829999301606317, -1.954321328644257, -1.954321328644257, -2.0943748594105864, -2.0943748594105864, -2.2323771549892437 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.08449017179860988 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:22.423940Z", "iopub.status.busy": "2022-09-28T16:17:22.423484Z", "iopub.status.idle": "2022-09-28T16:17:22.458904Z", "shell.execute_reply": "2022-09-28T16:17:22.458125Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:22] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:22.461709Z", "iopub.status.busy": "2022-09-28T16:17:22.461474Z", "iopub.status.idle": "2022-09-28T16:17:22.742149Z", "shell.execute_reply": "2022-09-28T16:17:22.741545Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:22] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:22.745538Z", "iopub.status.busy": "2022-09-28T16:17:22.744846Z", "iopub.status.idle": "2022-09-28T16:17:22.760325Z", "shell.execute_reply": "2022-09-28T16:17:22.759696Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:22] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:22.763614Z", "iopub.status.busy": "2022-09-28T16:17:22.763174Z", "iopub.status.idle": "2022-09-28T16:17:27.390578Z", "shell.execute_reply": "2022-09-28T16:17:27.389955Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.0, 'x2': 0.352164, 'x3': 0.530324, 'x4': 0.293097, 'x5': 0.359929, 'x6': 0.691842}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-09-28T16:17:27.393555Z", "iopub.status.busy": "2022-09-28T16:17:27.393241Z", "iopub.status.idle": "2022-09-28T16:17:27.400127Z", "shell.execute_reply": "2022-09-28T16:17:27.399542Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:17:27.403276Z", "iopub.status.busy": "2022-09-28T16:17:27.403003Z", "iopub.status.idle": "2022-09-28T16:17:27.415124Z", "shell.execute_reply": "2022-09-28T16:17:27.414543Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-28 16:17:27] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-09-28T16:17:27.417964Z", "iopub.status.busy": "2022-09-28T16:17:27.417736Z", "iopub.status.idle": "2022-09-28T16:17:27.421831Z", "shell.execute_reply": "2022-09-28T16:17:27.421284Z" } }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.14" } }, "nbformat": 4, "nbformat_minor": 2 }