{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:13:29.291768Z", "iopub.status.busy": "2022-08-17T19:13:29.291497Z", "iopub.status.idle": "2022-08-17T19:13:31.212281Z", "shell.execute_reply": "2022-08-17T19:13:31.211593Z" } }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:13:31.274438Z", "iopub.status.busy": "2022-08-17T19:13:31.273769Z", "iopub.status.idle": "2022-08-17T19:13:31.278213Z", "shell.execute_reply": "2022-08-17T19:13:31.277579Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:13:31.281506Z", "iopub.status.busy": "2022-08-17T19:13:31.281267Z", "iopub.status.idle": "2022-08-17T19:13:31.293239Z", "shell.execute_reply": "2022-08-17T19:13:31.292561Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:13:31.296236Z", "iopub.status.busy": "2022-08-17T19:13:31.295992Z", "iopub.status.idle": "2022-08-17T19:13:31.300494Z", "shell.execute_reply": "2022-08-17T19:13:31.299743Z" } }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:13:31.303423Z", "iopub.status.busy": "2022-08-17T19:13:31.303200Z", "iopub.status.idle": "2022-08-17T19:15:42.303199Z", "shell.execute_reply": "2022-08-17T19:15:42.302596Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.913539, 'x2': 0.451657, 'x3': 0.036104, 'x4': 0.494959, 'x5': 0.926987, 'x6': 0.844505}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.000324, 0.0), 'l2norm': (1.690364, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.067058, 'x2': 0.745941, 'x3': 0.830122, 'x4': 0.15338, 'x5': 0.963321, 'x6': 0.665076}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.086691, 0.0), 'l2norm': (1.625997, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.776879, 'x2': 0.544803, 'x3': 0.893388, 'x4': 0.526455, 'x5': 0.024785, 'x6': 0.522538}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.096486, 0.0), 'l2norm': (1.499769, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.868321, 'x2': 0.616498, 'x3': 0.060225, 'x4': 0.784603, 'x5': 0.437796, 'x6': 0.648229}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.022653, 0.0), 'l2norm': (1.537903, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.029586, 'x2': 0.712975, 'x3': 0.673364, 'x4': 0.2787, 'x5': 0.546706, 'x6': 0.572797}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.455317, 0.0), 'l2norm': (1.291234, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.940208, 'x2': 0.376252, 'x3': 0.572658, 'x4': 0.951143, 'x5': 0.037581, 'x6': 0.675014}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.082058, 0.0), 'l2norm': (1.647793, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.532947, 'x2': 0.193913, 'x3': 0.037903, 'x4': 0.612183, 'x5': 0.84777, 'x6': 0.69808}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.005082, 0.0), 'l2norm': (1.379808, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.272457, 'x2': 0.745856, 'x3': 0.035041, 'x4': 0.044185, 'x5': 0.984514, 'x6': 0.436884}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.014331, 0.0), 'l2norm': (1.339347, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.855132, 'x2': 0.449664, 'x3': 0.376137, 'x4': 0.748953, 'x5': 0.242862, 'x6': 0.021097}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.019202, 0.0), 'l2norm': (1.302031, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.812203, 'x2': 0.185297, 'x3': 0.470112, 'x4': 0.351848, 'x5': 0.722785, 'x6': 0.24327}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.016111, 0.0), 'l2norm': (1.272953, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.733783, 'x2': 0.2324, 'x3': 0.691818, 'x4': 0.418272, 'x5': 0.918006, 'x6': 0.199997}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.012209, 0.0), 'l2norm': (1.459022, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.793316, 'x2': 0.409269, 'x3': 0.130285, 'x4': 0.66826, 'x5': 0.708578, 'x6': 0.215471}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:31] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.025104, 0.0), 'l2norm': (1.344957, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:43] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.029421, 'x2': 0.699927, 'x3': 0.607533, 'x4': 0.298354, 'x5': 0.467813, 'x6': 0.524664}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:43] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.660737, 0.0), 'l2norm': (1.201247, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:57] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.033918, 'x2': 0.697664, 'x3': 0.578632, 'x4': 0.293918, 'x5': 0.425533, 'x6': 0.503699}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:13:57] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.749792, 0.0), 'l2norm': (1.159258, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:09] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.030913, 'x2': 0.693369, 'x3': 0.536587, 'x4': 0.286185, 'x5': 0.353296, 'x6': 0.470318}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:09] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.81251, 0.0), 'l2norm': (1.094331, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:21] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.09437, 'x2': 0.726697, 'x3': 0.496596, 'x4': 0.333808, 'x5': 0.349024, 'x6': 0.464961}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:21] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.749924, 0.0), 'l2norm': (1.110422, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:32] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.034599, 'x2': 0.622082, 'x3': 0.517693, 'x4': 0.229542, 'x5': 0.365355, 'x6': 0.433537}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:32] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-0.917311, 0.0), 'l2norm': (1.015045, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:44] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.069015, 'x2': 0.570054, 'x3': 0.521212, 'x4': 0.182726, 'x5': 0.370583, 'x6': 0.38587}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:44] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-0.897126, 0.0), 'l2norm': (0.959689, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:49] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.022446, 'x2': 0.581894, 'x3': 0.437783, 'x4': 0.214504, 'x5': 0.383952, 'x6': 0.447136}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:49] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-0.997869, 0.0), 'l2norm': (0.961312, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:54] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.0, 'x2': 0.5153, 'x3': 0.408581, 'x4': 0.212934, 'x5': 0.370364, 'x6': 0.505413}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:14:55] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.355766, 0.0), 'l2norm': (0.932966, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:07] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.0, 'x2': 0.460474, 'x3': 0.427233, 'x4': 0.2176, 'x5': 0.322838, 'x6': 0.55308}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:07] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.796506, 0.0), 'l2norm': (0.923058, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:20] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.002666, 'x2': 0.396277, 'x3': 0.44834, 'x4': 0.226385, 'x5': 0.255893, 'x6': 0.613576}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:20] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.122029, 0.0), 'l2norm': (0.922636, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:25] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.0, 'x2': 0.355183, 'x3': 0.465979, 'x4': 0.15732, 'x5': 0.241953, 'x6': 0.658216}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:25] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.027234, 0.0), 'l2norm': (0.92727, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:30] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.0, 'x2': 0.35846, 'x3': 0.459722, 'x4': 0.3055, 'x5': 0.22781, 'x6': 0.620258}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:30] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.156137, 0.0), 'l2norm': (0.932623, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:42] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.055295, 'x2': 0.39286, 'x3': 0.418421, 'x4': 0.303079, 'x5': 0.20525, 'x6': 0.644548}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:42] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.063715, 0.0), 'l2norm': (0.939095, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:15:42.307323Z", "iopub.status.busy": "2022-08-17T19:15:42.306807Z", "iopub.status.idle": "2022-08-17T19:15:42.319077Z", "shell.execute_reply": "2022-08-17T19:15:42.318471Z" } }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:15:42.324181Z", "iopub.status.busy": "2022-08-17T19:15:42.322778Z", "iopub.status.idle": "2022-08-17T19:15:42.352955Z", "shell.execute_reply": "2022-08-17T19:15:42.352370Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:42] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.91, 'x2': 0.45, 'x3': 0.04, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.07, 'x2': 0.75, 'x3': 0.83, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.78, 'x2': 0.54, 'x3': 0.89, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.87, 'x2': 0.62, 'x3': 0.06, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.03, 'x2': 0.71, 'x3': 0.67, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.94, 'x2': 0.38, 'x3': 0.57, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.53, 'x2': 0.19, 'x3': 0.04, '...
70Sobol7COMPLETED{'7_0': {'x1': 0.27, 'x2': 0.75, 'x3': 0.04, '...
80Sobol8COMPLETED{'8_0': {'x1': 0.86, 'x2': 0.45, 'x3': 0.38, '...
90Sobol9COMPLETED{'9_0': {'x1': 0.81, 'x2': 0.19, 'x3': 0.47, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.73, 'x2': 0.23, 'x3': 0.69, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.79, 'x2': 0.41, 'x3': 0.13, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.03, 'x2': 0.7, 'x3': 0.61, '...
131GPEI13COMPLETED{'13_0': {'x1': 0.03, 'x2': 0.7, 'x3': 0.58, '...
141GPEI14COMPLETED{'14_0': {'x1': 0.03, 'x2': 0.69, 'x3': 0.54, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.09, 'x2': 0.73, 'x3': 0.5, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.03, 'x2': 0.62, 'x3': 0.52, ...
171GPEI17COMPLETED{'17_0': {'x1': 0.07, 'x2': 0.57, 'x3': 0.52, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.02, 'x2': 0.58, 'x3': 0.44, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.0, 'x2': 0.52, 'x3': 0.41, '...
201GPEI20COMPLETED{'20_0': {'x1': 0.0, 'x2': 0.46, 'x3': 0.43, '...
211GPEI21COMPLETED{'21_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.45, 'x...
221GPEI22COMPLETED{'22_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.47, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.46, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.06, 'x2': 0.39, 'x3': 0.42, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.91, 'x2': 0.45, 'x3': 0.04, '... \n", "1 {'1_0': {'x1': 0.07, 'x2': 0.75, 'x3': 0.83, '... \n", "2 {'2_0': {'x1': 0.78, 'x2': 0.54, 'x3': 0.89, '... \n", "3 {'3_0': {'x1': 0.87, 'x2': 0.62, 'x3': 0.06, '... \n", "4 {'4_0': {'x1': 0.03, 'x2': 0.71, 'x3': 0.67, '... \n", "5 {'5_0': {'x1': 0.94, 'x2': 0.38, 'x3': 0.57, '... \n", "6 {'6_0': {'x1': 0.53, 'x2': 0.19, 'x3': 0.04, '... \n", "7 {'7_0': {'x1': 0.27, 'x2': 0.75, 'x3': 0.04, '... \n", "8 {'8_0': {'x1': 0.86, 'x2': 0.45, 'x3': 0.38, '... \n", "9 {'9_0': {'x1': 0.81, 'x2': 0.19, 'x3': 0.47, '... \n", "10 {'10_0': {'x1': 0.73, 'x2': 0.23, 'x3': 0.69, ... \n", "11 {'11_0': {'x1': 0.79, 'x2': 0.41, 'x3': 0.13, ... \n", "12 {'12_0': {'x1': 0.03, 'x2': 0.7, 'x3': 0.61, '... \n", "13 {'13_0': {'x1': 0.03, 'x2': 0.7, 'x3': 0.58, '... \n", "14 {'14_0': {'x1': 0.03, 'x2': 0.69, 'x3': 0.54, ... \n", "15 {'15_0': {'x1': 0.09, 'x2': 0.73, 'x3': 0.5, '... \n", "16 {'16_0': {'x1': 0.03, 'x2': 0.62, 'x3': 0.52, ... \n", "17 {'17_0': {'x1': 0.07, 'x2': 0.57, 'x3': 0.52, ... \n", "18 {'18_0': {'x1': 0.02, 'x2': 0.58, 'x3': 0.44, ... \n", "19 {'19_0': {'x1': 0.0, 'x2': 0.52, 'x3': 0.41, '... \n", "20 {'20_0': {'x1': 0.0, 'x2': 0.46, 'x3': 0.43, '... \n", "21 {'21_0': {'x1': 0.0, 'x2': 0.4, 'x3': 0.45, 'x... \n", "22 {'22_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.47, '... \n", "23 {'23_0': {'x1': 0.0, 'x2': 0.36, 'x3': 0.46, '... \n", "24 {'24_0': {'x1': 0.06, 'x2': 0.39, 'x3': 0.42, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:42.357786Z", "iopub.status.busy": "2022-08-17T19:15:42.356390Z", "iopub.status.idle": "2022-08-17T19:15:42.756404Z", "shell.execute_reply": "2022-08-17T19:15:42.755753Z" } }, "outputs": [ { "data": { "text/plain": [ "{'x1': 1.000815292059094e-18,\n", " 'x2': 0.35845967662583755,\n", " 'x3': 0.4597224593824701,\n", " 'x4': 0.3055004268695108,\n", " 'x5': 0.2278103481026188,\n", " 'x6': 0.620257672968856}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:42.761345Z", "iopub.status.busy": "2022-08-17T19:15:42.759877Z", "iopub.status.idle": "2022-08-17T19:15:42.767032Z", "shell.execute_reply": "2022-08-17T19:15:42.766472Z" } }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.9326241954331911, 'hartmann6': -2.1561343229047205}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:42.771629Z", "iopub.status.busy": "2022-08-17T19:15:42.770469Z", "iopub.status.idle": "2022-08-17T19:15:42.777609Z", "shell.execute_reply": "2022-08-17T19:15:42.777057Z" } }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:42.782134Z", "iopub.status.busy": "2022-08-17T19:15:42.780966Z", "iopub.status.idle": "2022-08-17T19:15:43.345780Z", "shell.execute_reply": "2022-08-17T19:15:43.345173Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:42] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.8959180420737684, -0.8916991951248235, -0.8852678446461675, -0.8766530483916439, -0.8659075306950089, -0.8531065304006828, -0.8383461559027231, -0.8217413236476554, -0.8034233701369913, -0.7835374347867574, -0.7622397120453561, -0.7396946665836452, -0.716072296211022, -0.6915455147369418, -0.6662877126480072, -0.6404705384805865, -0.6142619292176447, -0.5878244047510341, -0.5613136299770628, -0.53487723872328, -0.508653906504968, -0.4827726539739938, -0.4573523596250326, -0.4325014585707229, -0.40831780367142123, -0.38488866570176156, -0.36229085028746866, -0.3405909108354479, -0.319845438449021, -0.3001014117618012, -0.28139659167573683, -0.26375994811672543, -0.24721210810273225, -0.23176581662785833, -0.2174264040570968, -0.20419225583241946, -0.19205528221794893, -0.1810013874510682, -0.17101093890697422, -0.16205923763570051, -0.15411699184280647, -0.14715079456461888, -0.1411236060072386, -0.13599523990494944, -0.13172285197806322, -0.12826142731614099, -0.1255642624471457, -0.12358343710307307, -0.1222702703283719, -0.12157575561071987 ], [ -0.9350622786865079, -0.9307406637265834, -0.9240348739115289, -0.9149765163982158, -0.9036234272247554, -0.8900583295450268, -0.874386926520608, -0.8567355218684528, -0.8372482769206547, -0.8160842208647472, -0.7934141308277486, -0.7694173915948233, -0.7442789324718884, -0.7181863228281801, -0.6913270899335722, -0.6638863044176219, -0.6360444613148084, -0.6079756691636146, -0.5798461465763701, -0.5518130153479609, -0.5240233715124905, -0.49661361058010717, -0.46970898015714657, -0.4434233318751568, -0.4178590446213763, -0.3931070920984452, -0.3692472294232579, -0.3463482755533702, -0.3244684706265593, -0.30365588970339386, -0.28394889685620206, -0.26537662602600764, -0.24795947756237663, -0.23170962185341348, -0.21663150390737895, -0.20272234509520232, -0.18997264040518913, -0.1783666513755613, -0.1678828962308938, -0.15849463954907428, -0.15017038396557214, -0.1428743659878109, -0.13656705702599536, -0.1312056693994793, -0.12674466554944908, -0.12313626719460435, -0.12033095990195841, -0.11827798765508257, -0.11692583156498648, -0.1162226668921299 ], [ -0.9747549258493982, -0.9703446864779327, -0.9633709266720867, -0.9538679841215105, -0.9418992194660414, -0.9275554552672985, -0.9109527673263229, -0.8922297415845809, -0.8715443281179671, -0.849070431828329, -0.8249943778155492, -0.7995113794589346, -0.7728221209435113, -0.7451295455960975, -0.7166359191678804, -0.6875402150567268, -0.6580358479251135, -0.6283087642822707, -0.5985358839430021, -0.5688838750325507, -0.5395082372471891, -0.5105526630588708, -0.48214864399894164, -0.454415288550568, -0.42745931901426637, -0.4013752165298556, -0.37624548586637185, -0.3521410143448218, -0.3291215021444148, -0.30723594414901295, -0.2865231463674792, -0.2670122628001829, -0.24872334143029062, -0.23166787079092938, -0.2158493212701873, -0.2012636778989041, -0.18789996371683343, -0.17574075479650325, -0.16476268947837636, -0.15493697521308492, -0.14622989654474872, -0.13860332720808477, -0.13201524814410748, -0.1264202716393501, -0.12177016999348533, -0.11801440536932173, -0.11510065600227726, -0.11297533290852768, -0.11158408071668269, -0.11087225626039698 ], [ -1.0147118966093753, -1.0102296435082236, -1.0029976170248052, -0.9930530575496255, -0.9804652616436922, -0.9653337686039395, -0.9477858062703914, -0.927973133863514, -0.9060684405329156, -0.8822614663284633, -0.8567550082936001, -0.829760960320012, -0.8014965140038481, -0.7721806219645673, -0.7420307977288798, -0.7112602996993923, -0.6800757226764554, -0.6486750000014067, -0.6172458031743272, -0.5859643138244495, -0.5549943348786828, -0.524486703160318, -0.4945789638188669, -0.46539526728084557, -0.4370464511999762, -0.40963027263638396, -0.3832317589796206, -0.35792364963697576, -0.33376690403382864, -0.3108112549098485, -0.28909578920821677, -0.2686495420549032, -0.2494920924377405, -0.23163415223626554, -0.2150781432070697, -0.19981875933397147, -0.18584351449837, -0.1731332775668487, -0.1616627985709217, -0.15140123052779653, -0.14231265153715744, -0.13435659108914044, -0.1274885631366227, -0.1216606066191186, -0.1168218320406954, -0.11291897068497936, -0.10989692135211371, -0.10769928830993714, -0.10626890355610763, -0.10554832648686796 ], [ -1.054602761680929, -1.0500677967562462, -1.042590956945849, -1.0322125383019907, -1.0190081682156678, -1.0030867029235175, -0.9845872795210104, -0.9636756899472327, -0.9405402680605639, -0.9153874883491745, -0.8884374673823852, -0.8599195396468563, -0.8300680515857599, -0.7991184853083115, -0.767303990055915, -0.7348523679110008, -0.7019835323905099, -0.6689074356205772, -0.6358224421612797, -0.6029141150981113, -0.5703543722150759, -0.5383009661660532, -0.5068972417328196, -0.47627212467946967, -0.4465402996444062, -0.41780253833596565, -0.39014614353942173, -0.3636454787669487, -0.3383625575840123, -0.3143476706298326, -0.2916400321009737, -0.27026843101990256, -0.2502518760143511, -0.23160022562447757, -0.21431479933107933, -0.1983889675032831, -0.18380872118628194, -0.17055322493190872, -0.1585953575411977, -0.14790224648187844, -0.13843580176763726, -0.13015325423945723, -0.12300770158603636, -0.11694866330232301, -0.1119226434098668, -0.1078736974701674, -0.10474399849812055, -0.10247439503122713, -0.10100495392888376, -0.10027548045621348 ], [ -1.094049001938691, -1.0894835616193688, -1.0817796971736358, -1.0709808801324485, -1.0571694267996974, -1.0404640669043155, -1.0210165497430428, -0.9990074909758331, -0.9746416896793206, -0.9481431512844636, -0.9197500397991651, -0.8897097562470375, -0.8582743044423053, -0.825696065000347, -0.7922240581569083, -0.7581007388251404, -0.7235593355080805, -0.6888217192881371, -0.6540967703439035, -0.6195791968739718, -0.5854487541161053, -0.5518698083217703, -0.5189911910239497, -0.4869462917302032, -0.4558533414262208, -0.4258158442968588, -0.39692312034773575, -0.3692509267950571, -0.3428621309877057, -0.3178074121577467, -0.2941259734743768, -0.27184624976399013, -0.2509865999318622, -0.23155597663699973, -0.21355456914376936, -0.19697441845330377, -0.1818000066904626, -0.16800882512182969, -0.15557192691620125, -0.14445447165790515, -0.13461626857575582, -0.12601232445258503, -0.11859340035536459, -0.11230657891795814, -0.10709584124620752, -0.10290264995204745, -0.0996665326743561, -0.09732565893184886, -0.09581740238073233, -0.09507888050270175 ], [ -1.1326233412471929, -1.1280528603219233, -1.1201447537794293, -1.1089457367188733, -1.0945451082016158, -1.0770719489307292, -1.0566912267927897, -1.0335990560752213, -1.0080173852558765, -0.9801883917475194, -0.9503688432220043, -0.9188246497186475, -0.885825785160246, -0.8516417074207013, -0.8165373579222555, -0.7807697786410303, -0.7445853486029157, -0.7082176143614582, -0.6718856694447041, -0.6357930255325476, -0.6001269119910926, -0.5650579390177577, -0.5307400617409515, -0.49731078700963594, -0.46489157033485984, -0.4335883567561226, -0.40349222576340815, -0.37468010646704236, -0.3472155347944038, -0.32114942955620734, -0.29652086880852735, -0.2733578521328002, -0.2516780383693614, -0.2314894520513312, -0.21279115532317588, -0.19557388545104842, -0.17982066102558686, -0.16550736244779374, -0.15260329407141449, -0.1410717362630567, -0.1308704955138943, -0.12195245958753831, -0.11426616264862277, -0.10775636265023802, -0.10236463032171716, -0.09802994627573047, -0.09468930038597412, -0.0922782859132788, -0.09073167998748788, -0.08998400196591749 ], [ -1.1698505401217274, -1.1653039363963906, -1.1572200962512365, -1.1456489703921966, -1.1306870342514366, -1.1124740717518506, -1.091188724840709, -1.0670431051079938, -1.0402767951233223, -1.011150566535916, -0.9799401145180926, -0.9469300614844394, -0.9124084257058279, -0.8766616902959676, -0.8399705512646319, -0.8026063740552837, -0.764828348396359, -0.7268813019572478, -0.6889941136167134, -0.6513786558267511, -0.6142291909650127, -0.577722147040052, -0.5420162020982223, -0.5072526128557094, -0.4735557303857656, -0.4410336533393596, -0.4097789766256659, -0.37986960040139955, -0.35136957046714373, -0.3243299267313072, -0.29878954135643576, -0.2747759326745865, -0.2523060450805357, -0.23138698898663318, -0.21201673859426712, -0.19418478867057098, -0.17787277460122197, -0.1630550625403725, -0.14969931828346994, -0.13776706434838082, -0.1272142345364463, -0.11799173394831186, -0.11004601018856675, -0.10331963858848048, -0.09775192108729691, -0.09327949534909197, -0.08983694811706655, -0.08735742497414478, -0.0857732277023644, -0.08501639029176633 ], [ -1.2052100967988304, -1.200720074931926, -1.1924955358853617, -1.1805895507133197, -1.1651058183715506, -1.1461949942591174, -1.1240496307967482, -1.0988980854358665, -1.0709977842956588, -1.0406282229479729, -1.008084047090534, -0.9736684954152834, -0.9376874158966235, -0.9004439946256912, -0.8622342703649732, -0.8233434525958909, -0.7840430179010742, -0.7445885290818687, -0.7052181022324726, -0.6661514371810003, -0.6275893241535021, -0.5897135421850206, -0.5526870709056539, -0.5166545454080602, -0.48174289283332283, -0.44806209829065624, -0.415706056229139, -0.3847534711147534, -0.3552687781264598, -0.3273030605990109, -0.3008949462238721, -0.2760714687318558, -0.2528488860803449, -0.2312334501769992, -0.21122212694638515, -0.19280326905926998, -0.17595724678331826, -0.16065704499412303, -0.14686883618675528, -0.13455254014320017, -0.12366238060601564, -0.11414744787321407, -0.10595227380802152, -0.09901742264241287, -0.09328009754210609, -0.08867475962158877, -0.0851337533302865, -0.08258793014136434, -0.08096726138276611, -0.0802014308342377 ], [ -1.2381413627257423, -1.2337447325441278, -1.2254219094996284, -1.2132288231023851, -1.197276238521778, -1.1777255940160942, -1.154783286748628, -1.1286938303806526, -1.0997323409421442, -1.068196792213088, -1.034400428773148, -0.9986646479586334, -0.9613125751758173, -0.9226634719445135, -0.8830280407326342, -0.8427046295137257, -0.8019762934300713, -0.7611086402212357, -0.7203483681612376, -0.6799223975621252, -0.6400374968175754, -0.6008803090928877, -0.5626176941225056, -0.5253973095897152, -0.489348367084839, -0.4545825078795047, -0.4211947532310411, -0.3892644923995772, -0.35885647896273337, -0.3300218124219616, -0.30279888766384905, -0.27721429975848627, -0.2532836960261609, -0.2310125714216955, -0.21039700713860976, -0.1914243559012822, -0.17407388058036544, -0.15831735534908764, -0.14411964037246716, -0.1314392417776824, -0.12022886825592194, -0.11043599408474614, -0.10200343578376281, -0.0948699463256335, -0.08897082722637262, -0.08423855537364167, -0.08060341851010766, -0.0779941511460075, -0.07633856145724771, -0.0755641394142973 ], [ -1.2680516225942775, -1.2637896226496208, -1.2554191911710246, -1.242998659211303, -1.2266454255194745, -1.2065312779267403, -1.1828759923802394, -1.1559397095698842, -1.1260146208638733, -1.0934164684928094, -1.0584762943877255, -1.0215327760854807, -0.9829253840351722, -0.9429884960519344, -0.9020465202781821, -0.8604100119412159, -0.8183727219965289, -0.7762094856652264, -0.7341748429671751, -0.6925022783137991, -0.6514039689176009, -0.6110709395030904, -0.5716735314128295, -0.5333621060750844, -0.4962679147964547, -0.46050407821960715, -0.42616662911696446, -0.3933355812912646, -0.3620759952187011, -0.3324390178162287, -0.3044628795297576, -0.2781738370382409, -0.25358705444874613, -0.23070742006852107, -0.20953029975432041, -0.19004223143807375, -0.17222156860067034, -0.1560390830275401, -0.1414585389079247, -0.12843725102637893, -0.11692663930583025, -0.10687279029023866, -0.09821703345272803, -0.09089653678520737, -0.08484492237874608, -0.07999289908412732, -0.07626890624510918, -0.07359976020439063, -0.07191129392752282, -0.07112897966161003 ], [ -1.2943276971434474, -1.2902463078679731, -1.2818880661954273, -1.2693129949111426, -1.2526443345501481, -1.2320633425292464, -1.207802196182059, -1.180135583252044, -1.14937159176844, -1.1158424698616682, -1.07989573510703, -1.0418859958501334, -1.0021677247144067, -0.9610891125582379, -0.9189870385413046, -0.8761831220829973, -0.8329807747542501, -0.7896631415962169, -0.7464918080658168, -0.7037061467443388, -0.6615231835168295, -0.6201378731975228, -0.5797236872917818, -0.5404334301281941, -0.5024002128723717, -0.46573852727116755, -0.4305453720150474, -0.39690139422713905, -0.3648720168358247, -0.3345085296197718, -0.30584912774609946, -0.27891988688545544, -0.25373566869195674, -0.23030095473521717, -0.2086106109408909, -0.18865058821753666, -0.17039856811216036, -0.15382456486260188, -0.13889149688446856, -0.1255557413414745, -0.11376768487313438, -0.10347228179073797, -0.09460962825430219, -0.08711555741145427, -0.08092225662097408, -0.07595890413999407, -0.07215231941989664, -0.06942761871704728, -0.06770886622185668, -0.06691971034272082 ], [ -1.3163515751282473, -1.312501797360464, -1.3042254421997161, -1.2915831946504843, -1.2747028908838982, -1.2537738180502567, -1.2290389465661873, -1.2007857658648275, -1.1693364173529823, -1.13503775962761, -1.0982518874519949, -1.0593474867314985, -1.0186922675119408, -0.9766465927856578, -0.9335583214534662, -0.8897588114501437, -0.845559981801725, -0.8012523060277905, -0.757103598918897, -0.7133584596437466, -0.6702382424193514, -0.6279414385142621, -0.5866443678734432, -0.5465020935762598, -0.5076494866461487, -0.47020238182490914, -0.43425877652120226, -0.3999000351799462, -0.3671920698868974, -0.3361864753074827, -0.3069216022954612, -0.2794235599369971, -0.2537071406319484, -0.22977666721068601, -0.20762676511458888, -0.18724306631308102, -0.16860285478244663, -0.15167566585531922, -0.13642385335535057, -0.12280313896783324, -0.11076315764549893, -0.100248011013637, -0.09119683787313981, -0.08354440730049151, -0.07722173590758852, -0.07215672698363662, -0.06827482588608924, -0.06549968346459356, -0.0637538176413297, -0.0629592625462082 ], [ -1.333520436839562, -1.3299585005420167, -1.3218442208619408, -1.3092375222894592, -1.29226903393057, -1.2711339554307233, -1.2460836925082628, -1.217416018683956, -1.1854645351829614, -1.1505881235260356, -1.1131609488064604, -1.073563411084038, -1.0321742858099985, -0.9893641595980529, -0.9454901631267145, -0.9008919293958529, -0.8558886594987976, -0.8107771540876025, -0.7658306610566591, -0.7212983934912445, -0.6774055824320955, -0.6343539433295393, -0.5923224509482652, -0.5514683334276413, -0.511928211261542, -0.47381932061374943, -0.4372407724066369, -0.4022748089957284, -0.36898802909237716, -0.3374325591262434, -0.30764715569148904, -0.2796582293380541, -0.25348078496223075, -0.22911927856677572, -0.20656839426904122, -0.18581374911561416, -0.16683253640858808, -0.14959412069355038, -0.13406059910449442, -0.12018734422884547, -0.10792354294037376, -0.09721274376033295, -0.08799342240004426, -0.08019957149926271, -0.0737613165880322, -0.06860555638321297, -0.06465662206609069, -0.061836947461561986, -0.06006774021178518, -0.059269643138133654 ], [ -1.3452711576158598, -1.342058612434219, -1.3341973737558792, -1.3217447141253844, -1.3048315955192376, -1.2836562254656432, -1.2584752348289645, -1.2295933087894917, -1.197352110471542, -1.1621192417603963, -1.1242778290006639, -1.0842171427601364, -1.0423244913201548, -0.9989784852020758, -0.9545436620476955, -0.9093663870614059, -0.8637718992619112, -0.8180623516235046, -0.7725156874757175, -0.7273852008093447, -0.6828996400924735, -0.6392637306564924, -0.5966590074580874, -0.5552448666129085, -0.5151597596499934, -0.47652246848377156, -0.43943341145723613, -0.4039759414862108, -0.3702176064660379, -0.33821134989878293, -0.30799663640192043, -0.27960049260474196, -0.25303845912677286, -0.22831545400289766, -0.20542655213494404, -0.18435768908629885, -0.16508630069353725, -0.14758191238756357, -0.13180669361305375, -0.11771599314719705, -0.10525887035495307, -0.0943786354970837, -0.08501340927978818, -0.07709670817834768, -0.07055805804909188, -0.06532363456585222, -0.061316925449915405, -0.058459406592794805, -0.05667122216928466, -0.05587185775247894 ], [ -1.3511089376543035, -1.3483125622404963, -1.340805921535213, -1.328641206901704, -1.3119465101556054, -1.290919270718017, -1.2658172163319032, -1.2369476806189397, -1.2046561847701662, -1.1693150644575758, -1.1313127529824616, -1.0910441416544576, -1.0489022605626763, -1.005271375423753, -0.9605214855425871, -0.915004132777895, -0.8690493863389204, -0.8229638464139949, -0.7770295044251008, -0.731503303498005, -0.6866172551608423, -0.6425789841446679, -0.5995725902583022, -0.5577597332179193, -0.5172808621686267, -0.47825652598446244, -0.4407887130980497, -0.40496218060450256, -0.37084574183795194, -0.33849348973678445, -0.3079459403245539, -0.27923108676223557, -0.2523653598611544, -0.2273544958142043, -0.20419431626063672, -0.18287142962274722, -0.16336386584469453, -0.145641659076179, -0.12966739430912588, -0.11539673434964381, -0.10277894271267018, -0.0917574160893847, -0.0822702371058982, -0.0742507544317823, -0.0676281932582361, -0.06232829513252924, -0.058273982467720975, -0.055386040030934836, -0.053583803531149776, -0.052785844146857275 ], [ -1.3506390642168324, -1.3483305164696517, -1.3412897805801394, -1.3295609500051766, -1.313265250610717, -1.2925946743529324, -1.2678029993048057, -1.2391950915524355, -1.207115394873786, -1.171936410198095, -1.1340477963767421, -1.0938465316886643, -1.0517283945636928, -1.0080808709391818, -0.9632774814103746, -0.9176734429350679, -0.8716025320934488, -0.8253749930142106, -0.7792763263993868, -0.7335668009043967, -0.6884815399775942, -0.6442310528470588, -0.6010020953837963, -0.5589587635802244, -0.5182437384552223, -0.4789796158423257, -0.4412702675337823, -0.40520219163124066, -0.37084581980870834, -0.33825675770995556, -0.30747694209522414, -0.27853570482890616, -0.2514507395355826, -0.22622897186497992, -0.2028673388463476, -0.18135348675541646, -0.1616664001722542, -0.14377697734027128, -0.12764856839449668, -0.11323749338399536, -0.10049355620587519, -0.08936056862940689, -0.0797768956642857, -0.07167602987021493, -0.06498719814854692, -0.05963600046801121, -0.05554507620569937, -0.052634790618687255, -0.05082393159423371, -0.050030405346674134 ], [ -1.3435999656575242, -1.3418550840216774, -1.3353996118649263, -1.3242659289873533, -1.3085636208852036, -1.2884737027409017, -1.2642401372546366, -1.236159495624955, -1.2045696487933972, -1.1698382980350763, -1.1323520020891524, -1.0925061750971434, -1.0506963495661816, -1.0073108428774409, -0.9627248444016293, -0.9172958543321388, -0.8713603509721513, -0.8252315341514695, -0.7791979820645555, -0.7335230611905847, -0.688444939318628, -0.6441770665033743, -0.6009090055264369, -0.5588075104838668, -0.5180177684412863, -0.4786647341239373, -0.4408545010822503, -0.40467566464656135, -0.370200642343417, -0.3374869264538439, -0.3065782512468212, -0.2775056643125668, -0.25028849751241544, -0.22493523846580105, -0.20144430825542525, -0.17980475512769156, -0.15999687731440682, -0.14199279058133596, -0.1257569575854185, -0.11124669648460372, -0.09841268544264337, -0.08719947774341641, -0.07754603931846771, -0.0693863168385217, -0.06264984044178012, -0.05726236102147808, -0.05314651811450821, -0.05022253111148456, -0.04840890395309372, -0.04762313179741795 ], [ -1.3298946949552144, -1.3287923563867063, -1.3230468213116855, -1.3126745922062424, -1.2977681737548465, -1.2784914018241036, -1.255071971502387, -1.227791890173513, -1.1969766830109188, -1.1629841612010783, -1.1261934537024454, -1.0869948401121468, -1.0457807434527189, -1.0029380763213367, -0.958841998469174, -0.9138510441907353, -0.8683035121299574, -0.8225149725813434, -0.776776731203108, -0.7313550867916362, -0.6864912290498169, -0.6424016360740864, -0.5992788477237871, -0.55729250820907, -0.5165905879429179, -0.47730071026212717, -0.4395315226986457, -0.40337406498033374, -0.3689030969128588, -0.33617835888352293, -0.3052457461131517, -0.27613838514532213, -0.24887760755679827, -0.22347382160514123, -0.19992728754375222, -0.17822880661410145, -0.1583603371967911, -0.14029555415857342, -0.12400036895350874, -0.10943342842729242, -0.09654660949558302, -0.08528552496156838, -0.07559005284383069, -0.06739489793303632, -0.06063019018845106, -0.05522212036300611, -0.05109360924619388, -0.04816500343102981, -0.046354787765596206, -0.045580302771724424 ], [ -1.3096168818507854, -1.309237332342907, -1.304327825937533, -1.2948844179567973, -1.2809766730175505, -1.262744706568418, -1.240393298303244, -1.2141835900515714, -1.1844231000090177, -1.1514548742759616, -1.1156465543280478, -1.0773800013753445, -1.037041935534378, -0.9950158629507964, -0.9516754053236068, -0.9073790256754293, -0.862466062294283, -0.8172539339839341, -0.7720363563698855, -0.7270824034751651, -0.6826362548206787, -0.6389174811606613, -0.5961217382698312, -0.5544217557082722, -0.5139685247914597, -0.4748926062654747, -0.43730549301780786, -0.4013009763968426, -0.36695647639327333, -0.33433430617771914, -0.3034828504594198, -0.27443764500515233, -0.24722235158531486, -0.22184962869985098, -0.19832190372852837, -0.1766320566368566, -0.1567640289889104, -0.138693374675809, -0.12238777035970805, -0.10780750407527928, -0.09490595969264903, -0.08363011307188672, -0.07392105286296613, -0.06571453524743187, -0.05894157777018838, -0.05352909310420362, -0.04940055946236921, -0.046476720720640574, -0.04467630638026099, -0.043916759426103846 ], [ -1.2830662261449457, -1.283488834734668, -1.2795378313982664, -1.2711841050330115, -1.2584684096635714, -1.241500769607092, -1.2204567551601724, -1.1955708385287473, -1.1671274473740274, -1.1354505780589088, -1.1008928748242182, -1.0638249662271393, -1.0246256502097288, -0.9836733013685498, -0.9413386815342601, -0.8979791866197064, -0.8539344610602491, -0.8095232495290263, -0.7650413245012682, -0.7207603184905663, -0.6769272938397607, -0.6337648951843151, -0.5914719461763737, -0.5502243701556588, -0.5101763325478265, -0.4714615199107861, -0.4341944862473539, -0.39847201127119386, -0.3643744277560835, -0.33196688602772123, -0.3013005332360639, -0.272413593446201, -0.24533234195689008, -0.22007197370547255, -0.19663737119867586, -0.17502378211861175, -0.15521742054023635, -0.13719600847835411, -0.12092927616615556, -0.10637943998143728, -0.09350167625487538, -0.08224460736125472, -0.07255081363763483, -0.06435738100359001, -0.05759648996067579, -0.05219604724773608, -0.0480803571623144, -0.04517082573670761, -0.04338668783230737, -0.04264574495934981 ], [ -1.2507481525452593, -1.2520486092211418, -1.249169040892118, -1.2420506787937151, -1.2307001464174787, -1.2151918349391493, -1.1956668284560614, -1.172328218130972, -1.145433317291099, -1.11528373223607, -1.0822143806852662, -1.046582444023374, -1.0087570042721294, -0.969109851243285, -0.9280077101667485, -0.8858059601533426, -0.8428437911399781, -0.7994406725263575, -0.7558939684640233, -0.712477521445179, -0.6694410284791874, -0.6270100461819509, -0.5853864780356142, -0.5447494159614126, -0.5052562273617576, -0.46704379687011693, -0.4302298486515754, -0.3949142900072159, -0.3611805302411008, -0.32909674035663466, -0.2987170293219752, -0.270082521555426, -0.24322232808413669, -0.21815441063519325, -0.19488634378722092, -0.17341598524885327, -0.15373206829703057, -0.13581473333086547, -0.11963601729333839, -0.10516032031776312, -0.09234486834524813, -0.08114018867559791, -0.07149061257822875, -0.06333481540612751, -0.056606400399706436, -0.05123452786371541, -0.04714458698981261, -0.04425890360276863, -0.04249747379885904, -0.04177871101269015 ], [ -1.2133529104165408, -1.2155999936445014, -1.2138889951228715, -1.2081276888375088, -1.1982844490779119, -1.1843940377687687, -1.1665594677653586, -1.1449493897380163, -1.1197914522504295, -1.0913627463254316, -1.0599786645385783, -1.025981385173619, -0.9897289018277249, -0.9515851941378255, -0.9119118528946878, -0.871061260732253, -0.8293712872041024, -0.7871613715813577, -0.7447298227996801, -0.7023521501536436, -0.6602802402117696, -0.6187422076312782, -0.5779427651208117, -0.5380639775302678, -0.4992662849704238, -0.46168969884513644, -0.4254550921288859, -0.3906655209073263, -0.3574075281014894, -0.3257523925222311, -0.2957572971154998, -0.26746639963660185, -0.24091179719062294, -0.21611438321385168, -0.19308460161412838, -0.1718231079510555, -0.15232135168802796, -0.13456209662333973, -0.1185198985320094, -0.10416155976140895, -0.09144657999812889, -0.08032762069883359, -0.07075099786767736, -0.06265721416386427, -0.05598153700550579, -0.0506546247248002, -0.046603198273559965, -0.04375075181275401, -0.04201829203353291, -0.04132509346099644 ], [ -1.1717119034532781, -1.1749640633778236, -1.1744972616782219, -1.1701831634261497, -1.1619495727842586, -1.1497897840578362, -1.1337673748138666, -1.1140155439226065, -1.0907314542890953, -1.064166907986986, -1.0346169520571493, -1.0024078533737208, -0.9678855208556956, -0.9314050649293119, -0.8933218563720842, -0.8539842066308736, -0.813727633809388, -0.7728705851604396, -0.7317114394014503, -0.6905265949817854, -0.6495694520849952, -0.6090701086945558, -0.5692356092220642, -0.530250604635762, -0.4922783036834094, -0.45546161449797373, -0.41992439399731335, -0.3857727387955527, -0.35309626581087067, -0.32196934348777917, -0.292452245715095, -0.2645922102923527, -0.2384243923372194, -0.21397271045587463, -0.1912505898899976, -0.17026161222850938, -0.15100008560506473, -0.13345155253582996, -0.11759325461518477, -0.1033945741181791, -0.09081747213112967, -0.07981694117632188, -0.07034148751960279, -0.06233365463925766, -0.0557305949579463, -0.05046469222354688, -0.04646423222722684, -0.04365411521891516, -0.04195659972869692, -0.041292064757207814 ], [ -1.126733796727443, -1.131035883200114, -1.1318632504670727, -1.1290502556072273, -1.1224839515143263, -1.1121167855721183, -1.0979739701338962, -1.0801544041596307, -1.0588257069719553, -1.0342149482531622, -1.0065969369982877, -0.9762817078060722, -0.9436024068347465, -0.9089043326484623, -0.8725355228791041, -0.8348390181120767, -0.79614676736668, -0.7567750423945245, -0.717021179169934, -0.6771614474468748, -0.6374498510038831, -0.5981176739968844, -0.5593736073362181, -0.5214043098074608, -0.48437527969793437, -0.4484319327806501, -0.41370080102542617, -0.38029078309963416, -0.34829439255955463, -0.3177889627164921, -0.28883777864988147, -0.2614911169078138, -0.2357871822421132, -0.21175293839306447, -0.1894048365426262, -0.16874945061938607, -0.14978403314341648, -0.13249700869032732, -0.11686842426145527, -0.10287037680799704, -0.09046743783846511, -0.0796170934642263, -0.0702702155032271, -0.06237157554956785, -0.05586040948919835, -0.05067103513087945, -0.04673352079367743, -0.04397439821517213, -0.04231740934327344, -0.04168427369745542 ], [ -1.0793293072207601, -1.0847097496137768, -1.0868538144265132, -1.085558819444331, -1.0806729365552639, -1.0721106756369598, -1.0598621703085596, -1.0439951065890078, -1.0246500565158714, -1.0020310729946738, -0.976393635830701, -0.9480317309418334, -0.9172653364050329, -0.8844290968503494, -0.8498625817935497, -0.8139022564317278, -0.7768751252377983, -0.7390939123998971, -0.7008535952803239, -0.6624290901345581, -0.624073891249203, -0.5860194773936968, -0.5484753178256457, -0.5116293307451092, -0.475648668037141, -0.4406807201993197, -0.406854253900807, -0.37428061139895646, -0.34305491600663846, -0.31325724104369407, -0.2849537113676987, -0.25819751682692516, -0.23302982596421523, -0.20948059614190895, -0.18756928302846199, -0.167305458112057, -0.1486893475664881, -0.1317123093362016, -0.11635726765997911, -0.10259912534852988, -0.0904051739310483, -0.0797355203024378, -0.07054354582382172, -0.06277641012762147, -0.05637560741602432, -0.051277578151900594, -0.04741437410225191, -0.04471437008827828, -0.04310301186637344, -0.04250358657570552 ], [ -1.030339158970342, -1.0368077479528655, -1.0402642922711614, -1.0404704952181831, -1.0372390175773616, -1.030450976125905, -1.0200662916883187, -1.0061259143754246, -0.9887469987067226, -0.9681131611137728, -0.9444620797526779, -0.9180722872183749, -0.889250435544579, -0.8583197953666419, -0.8256103627148184, -0.7914506865349121, -0.756161369673827, -0.7200501055654909, -0.6834080682575119, -0.6465074578170062, -0.6096000051970587, -0.5729162528838327, -0.5366654452546616, -0.5010358824793691, -0.4661956120801092, -0.43229335179626827, -0.3994595555669616, -0.3678075509686994, -0.3374346912674065, -0.30842347842408147, -0.28084262505928287, -0.2547480336784925, -0.23018368052601096, -0.20718239937636784, -0.18576656745594794, -0.1659487015356148, -0.1477319770255866, -0.1311106865823486, -0.1160706572286232, -0.10258964621880051, -0.09063773580549972, -0.08017774568105451, -0.07116567925789374, -0.06355121627963456, -0.057278259778219986, -0.05228554044863387, -0.048507276488853, -0.04587388224497435, -0.04431271496913214, -0.04374884592053507 ], [ -0.980481002953379, -0.9880272008325732, -0.9927676964023358, -0.9944306459619693, -0.9927972337841842, -0.9877204145720362, -0.9791354457248329, -0.967061660188424, -0.9515969921132545, -0.9329076783582708, -0.9112155072593633, -0.8867844525856393, -0.8599079067295271, -0.8308972065474172, -0.8000717754169625, -0.767750966463629, -0.7342475485326244, -0.6998626966725935, -0.6648823098567377, -0.6295744651880143, -0.5941878199990392, -0.5589507846057052, -0.5240713047915282, -0.4897371116555907, -0.4561163155157235, -0.4233582390646923, -0.3915944023339178, -0.360939587938538, -0.33149292946926723, -0.3033389787907786, -0.2765487194985038, -0.25118050399424774, -0.2272809006803736, -0.20488544573347628, -0.18401930085536228, -0.16469782432637536, -0.1469270675762404, -0.1307042132813394, -0.1160179736148973, -0.10284896863772242, -0.09117010486523025, -0.08094697277399332, -0.0721382794847285, -0.06469632923636259, -0.05856755980194672, -0.05369313802999631, -0.05000961261960768, -0.04744961746153087, -0.04594261477325645, -0.04541566411570952 ], [ -0.930326007954646, -0.9389175673471234, -0.9448920191223349, -0.9479462103090481, -0.9478337591717643, -0.9443844553619597, -0.9375142234915417, -0.927225751900401, -0.9136018929447858, -0.8967945853764341, -0.8770117333693943, -0.8545037902159845, -0.8295511277508103, -0.8024527711166162, -0.7735167472052408, -0.7430520917742365, -0.7113624417812293, -0.6787410746474767, -0.645467224819065, -0.6118034975504242, -0.5779942023304289, -0.5442644386460932, -0.5108197814218364, -0.4778464302183202, -0.44551170363995174, -0.41396477744428967, -0.3833375810110693, -0.3537457818173568, -0.3252898012590154, -0.2980558175499326, -0.2721167225755483, -0.24753300955997087, -0.22435357731190458, -0.2026164447112273, -0.18234937602364687, -0.16357042358692409, -0.14628839936378468, -0.13050329073748268, -0.11620663864967107, -0.10338189765959915, -0.09200479767259273, -0.08204372592728915, -0.07346014540194301, -0.06620906224995204, -0.06023955045359186, -0.05549533693066033, -0.051915445241068614, -0.049434891234708234, -0.0479854198405506, -0.04749626902092874 ], [ -0.8803059861723612, -0.889887684965169, -0.8970266329369846, -0.9013905685667073, -0.9027088868544523, -0.9007923729874212, -0.8955420516015427, -0.8869481194857206, -0.8750818312207838, -0.8600834608179023, -0.8421487933573447, -0.8215157379128054, -0.7984519570110966, -0.7732439463212682, -0.7461877204943849, -0.7175811016067631, -0.6877175178619842, -0.6568811731541325, -0.6253434261895509, -0.5933602114987546, -0.5611703380257531, -0.5289945103424055, -0.49703493041919067, -0.4654753525964672, -0.4344814797832726, -0.40420160419078655, -0.37476741059137875, -0.34629487389396213, -0.3188851955986587, -0.29262573539355274, -0.2675909047984464, -0.2438429993900773, -0.22143295481197, -0.2004010195209313, -0.18077734406849288, -0.1625824926461924, -0.14582788759273158, -0.13051620149376875, -0.1166417143086762, -0.10419065453748999, -0.0931415437220936, -0.08346556253192172, -0.0751269543640678, -0.06808347893226407, -0.06228692397278557, -0.0576836782936504, -0.054215364336631655, -0.051819523628819364, -0.050430344359604584, -0.049979417136261306 ], [ -0.8307424025030683, -0.841234878658879, -0.8494500021929059, -0.855028714496199, -0.8576789664885, -0.857195677836471, -0.8534681446325412, -0.8464769354176611, -0.8362840532292061, -0.8230198694335981, -0.8068692470283247, -0.7880582381779123, -0.7668420412947917, -0.7434944973933759, -0.7182991860735423, -0.6915420661039845, -0.6635055462569952, -0.6344638433252806, -0.60467947281998, -0.5744007166279773, -0.5438599169601193, -0.5132724549090169, -0.4828362833385407, -0.4527318965915902, -0.42312263286302987, -0.39415521848778917, -0.3659604764500963, -0.3386541338732192, -0.31233767494731607, -0.28709919662074346, -0.2630142343946458, -0.24014653472858688, -0.21854875890386277, -0.1982631107130272, -0.17932188704448965, -0.1617479562793216, -0.1455551743557406, -0.13074875230163874, -0.11732559188595137, -0.10527460769450625, -0.09457705431409946, -0.08520687637642754, -0.07713109701062759, -0.07031025691406634, -0.06469891201181677, -0.060246192867226545, -0.056896424025228765, -0.054589796734899276, -0.05326308439624716, -0.05285038691663324 ], [ -0.7818842832540491, -0.7931832110793015, -0.8023668695853095, -0.80905226387062, -0.8129284400507555, -0.813776671301091, -0.8114763172099166, -0.8059996358122926, -0.797400287339757, -0.7857993499235083, -0.7713711574015333, -0.7543301190357777, -0.7349190131882587, -0.7133989023288171, -0.6900406469026046, -0.6651179150404583, -0.6389015499868814, -0.6116551449447454, -0.5836316742189585, -0.5550710343488111, -0.5261983566618422, -0.4972229621297768, -0.46833783993671896, -0.4397195423801649, -0.41152840028789345, -0.38390897476097624, -0.35699067250015115, -0.3308884630460233, -0.30570364682437623, -0.2815246328461429, -0.2584276942163609, -0.23647767823259197, -0.2157286557868025, -0.19622450201091807, -0.1779994065980306, -0.16107831794138971, -0.14547733009150332, -0.13120402544492815, -0.11825778893962047, -0.10663011123386923, -0.09630489880285809, -0.08725880805919506, -0.07946161852471711, -0.07287665687682698, -0.06746127959227155, -0.0631674172371206, -0.05994217859214157, -0.05772850816989605, -0.05646588665656571, -0.05609106070407577 ], [ -0.7339440962137972, -0.745920310719253, -0.7559450538318752, -0.7636153591807668, -0.7686040600197617, -0.770680243811464, -0.7697137513418988, -0.7656682520615166, -0.7585884796491857, -0.7485856191581807, -0.7358229962834126, -0.7205030369852813, -0.7028558549088839, -0.683129526868276, -0.661581975016629, -0.6384743130198278, -0.6140654942711322, -0.5886081010965376, -0.5623451229021594, -0.5355075824760243, -0.5083128809540474, -0.48096374278334164, -0.45364765246955324, -0.42653668517287807, -0.39978764342934786, -0.37354242242316477, -0.34792853625271924, -0.3230597474191416, -0.29903675122179907, -0.27594787578650326, -0.2538697670155306, -0.2328680357872303, -0.2129978522091735, -0.19430447860510353, -0.17682373914565663, -0.16058242955369406, -0.14559867504496693, -0.13188224850306463, -0.11943486372161571, -0.10825046026549301, -0.09831549701749098, -0.089609270743773, -0.0821042740591349, -0.07576660412065728, -0.0705564294453207, -0.06642851774454217, -0.0633328229732053, -0.06121512530238471, -0.06001771381707677, -0.05968009871233537 ], [ -0.6871262023142232, -0.6996278550996694, -0.7103472672496555, -0.7188669910846754, -0.7248467642153609, -0.7280443302747333, -0.7283191925188466, -0.7256247597429949, -0.719994992347486, -0.7115295642581434, -0.7003795565376376, -0.6867345530094838, -0.670811445477972, -0.6528449748281782, -0.6330798945421761, -0.6117645850196236, -0.5891459349901761, -0.5654653160747938, -0.5409554936659561, -0.515838334714272, -0.49032318829039223, -0.46460582772597997, -0.4388678543021871, -0.4132764725094291, -0.3879845563399569, -0.3631309351793722, -0.33884083675629617, -0.31522643330825434, -0.2923874455920085, -0.270411767551419, -0.24937608229735203, -0.22934644749763106, -0.2103788352689212, -0.1925196181533217, -0.1758059986897535, -0.16026638537865423, -0.14592072239728526, -0.13278078414543437, -0.12085044847120441, -0.11012596413174924, -0.10059622859367612, -0.09224309162812705, -0.08504169833042763, -0.0789608823065957, -0.0739636160279491, -0.07000752105772357, -0.06704543636057891, -0.06502603860054468, -0.0638945045741608, -0.06359320300231097 ], [ -0.6416465961847462, -0.6545046363427336, -0.6657567374153918, -0.6749779937881925, -0.6818187431282522, -0.6860259167995232, -0.6874470900540999, -0.686022882175528, -0.6817738631904886, -0.6747859312906256, -0.6651961614320943, -0.6531800299787452, -0.6389403600002566, -0.622698027069984, -0.6046843047569602, -0.5851346615484334, -0.5642838086457082, -0.5423618121715498, -0.5195911059805967, -0.4961842636896644, -0.47234240760973367, -0.4482541476511768, -0.42409495573864986, -0.40002689174644696, -0.3761986062161421, -0.3527455536661598, -0.3297903584467897, -0.30744328297866513, -0.2858027558823822, -0.2649559249525682, -0.244979207115189, -0.22593881438390934, -0.20789124134613135, -0.19088370580128888, -0.17495453977342673, -0.16013353314498413, -0.14644223651199706, -0.13389423343268825, -0.12249539491486983, -0.11224413065092775, -0.1031316520737422, -0.0951422617285026, -0.08825368175658765, -0.08243743157485495, -0.07765926130471645, -0.07387964344151943, -0.07105432099648934, -0.06913490625413776, -0.06806952070733685, -0.06780346393568126 ], [ -0.5977424469193647, -0.6107798739123839, -0.6223935291549647, -0.6321590363087103, -0.6397217313516871, -0.6448186350918528, -0.6472839429629507, -0.6470429517801026, -0.6441001104834507, -0.6385250750385894, -0.6304388974069122, -0.6200014142164746, -0.6074002904852919, -0.5928418125838404, -0.5765433267668126, -0.5587271334957722, -0.5396156286067028, -0.5194274958330206, -0.49837478002582525, -0.4766606959009998, -0.45447804912992196, -0.4320081642910299, -0.4094202282289605, -0.3868709687097793, -0.36450459781649897, -0.34245295797394265, -0.32083581626941116, -0.2997612601047457, -0.27932615430706453, -0.25961662668694135, -0.24070855566373361, -0.22266803994889273, -0.20555183634323704, -0.18940775740453752, -0.1742750260060204, -0.16018458854990303, -0.1471593927242001, -0.13521463908608988, -0.12435801830598059, -0.11458994750512386, -0.10590381968104678, -0.09828627969764558, -0.09171753874218547, -0.08617173662057553, -0.08161735796072467, -0.07801770458514512, -0.07533142231632373, -0.07351307663106055, -0.07251376820101652, -0.0722817767049524 ], [ -0.5556682787249132, -0.568711607840175, -0.5805151229195015, -0.590662935924307, -0.5988004962358038, -0.6046569843347355, -0.6080529650920252, -0.6088968165949276, -0.6071747115314124, -0.6029378535953587, -0.5962892862692133, -0.5873715727642135, -0.5763559674432812, -0.5634332665037249, -0.5488062800514478, -0.5326837542257923, -0.5152755386360355, -0.496788801420766, -0.4774251171515259, -0.45737827873719145, -0.4368327079391152, -0.4159623584818903, -0.3949300212227705, -0.37388695322957294, -0.35297276279103124, -0.33231549107593245, -0.3120318388977152, -0.2922274941783648, -0.2729975224444868, -0.25442678913755, -0.2365903887190432, -0.21955406149903844, -0.20337458478298986, -0.188100130267149, -0.17377058455113797, -0.16041783409491805, -0.14806601983105627, -0.13673176984537472, -0.1264244209499944, -0.11714624149031216, -0.10889266827251909, -0.10165257003367556, -0.09540854842393343, -0.09013728512591201, -0.08580994067270808, -0.08239260698795003, -0.0798468119525595, -0.07813007071689104, -0.07719647531710994, -0.07699731166199386 ], [ -0.5156785052771736, -0.5285683583751344, -0.5403983911087289, -0.5507681540625258, -0.5593287318499904, -0.565805009757296, -0.570005499206266, -0.5718216738640993, -0.5712204320246178, -0.5682330227916138, -0.5629428548721953, -0.5554737065196187, -0.5459791453401669, -0.5346334740983326, -0.5216242227309427, -0.5071460583406574, -0.49139592935550347, -0.4745692541810058, -0.45685698092405946, -0.4384433679624605, -0.4195043580729294, -0.4002064387730082, -0.3807058979477016, -0.36114839713193697, -0.3416687956980225, -0.3223911683310368, -0.30342896610970804, -0.28488527864051383, -0.26685316127902664, -0.2494159976717591, -0.23264787374565032, -0.21661394488930102, -0.20137078340216186, -0.18696669829992657, -0.17344202419941368, -0.16082938019031623, -0.14915390324471534, -0.13843346371947407, -0.12867887276911316, -0.11989409291403197, -0.11207646353008704, -0.10521695260835806, -0.09930044480230438, -0.09430607362342514, -0.09020760282701612, -0.08697385877127017, -0.08456921210428381, -0.08295410382079049, -0.08208560780153584, -0.08191801962442102 ], [ -0.4780029812456037, -0.4906013143717869, -0.502310212273454, -0.5127500052609997, -0.521582726798701, -0.5285335457368439, -0.5334021852736304, -0.536064983353816, -0.5364700372264026, -0.5346282131198918, -0.5306023574145097, -0.5244963509717211, -0.516444981685865, -0.5066050957561129, -0.49514815302829895, -0.4822541264011775, -0.46810660150684014, -0.4528889080138287, -0.43678111859834023, -0.4199577685274784, -0.40258616881066145, -0.38482520485292626, -0.36682452900410667, -0.34872406915803345, -0.33065378697149445, -0.31273362885319367, -0.2950736210994493, -0.27777406781418756, -0.2609258168284149, -0.24461056491697297, -0.22890117931215315, -0.21386201789044346, -0.19954923547499398, -0.18601106843361792, -0.17328809411738733, -0.1614134656144085, -0.15041312570792076, -0.14030600673838722, -0.1311042251836988, -0.12281328110708833, -0.11543227311691029, -0.10895413911105123, -0.1033659318669018, -0.09864913657071805, -0.09478003480679342, -0.09173011655123375, -0.08946653858129172, -0.08795262467686471, -0.08714840029880333, -0.08701115227969247 ], [ -0.44282547709751974, -0.45501889683353247, -0.4664794382120526, -0.4768517921786545, -0.48581343107342445, -0.49309458431624476, -0.4984904357632136, -0.5018653342075752, -0.503150464328767, -0.5023371072541005, -0.4994675623320489, -0.49462535655581297, -0.48792581663789336, -0.4795075934933969, -0.46952537971062247, -0.45814384618572646, -0.44553271152961266, -0.43186281042097596, -0.4173030162560073, -0.40201788066324556, -0.3861658669618742, -0.36989807083484233, -0.35335733678690073, -0.33667769243395734, -0.31998403420907573, -0.30339200790480725, -0.28700803593714674, -0.2709294506359316, -0.25524469950429673, -0.24003359443990363, -0.22536758250333477, -0.21131002103024304, -0.19791644474620268, -0.18523481705491934, -0.1733057618026122, -0.16216277552313496, -0.1518324233723145, -0.1423345245890395, -0.13368233529483198, -0.12588273769182912, -0.11893644518963475, -0.11283823266700477, -0.10757719998189696, -0.10313707506458336, -0.09949656059930367, -0.09662972560552874, -0.09450644038924005, -0.09309285057832029, -0.09235188350189383, -0.09224377820157026 ], [ -0.4102713235981981, -0.4219713502418062, -0.4330788414554846, -0.4432648297528776, -0.45222553791744013, -0.4597004963703548, -0.465484764026776, -0.46943457760520846, -0.47146714018524905, -0.4715560504785037, -0.46972407026023755, -0.46603471526293705, -0.46058375650345185, -0.4534913072213174, -0.444894838730456, -0.4349432417774223, -0.42379191505354785, -0.4115987932438298, -0.39852119895562993, -0.38471339803867793, -0.37032474458000947, -0.35549831344841687, -0.3403699310481041, -0.3250675271931663, -0.3097107420631177, -0.2944107319181172, -0.2792701257575387, -0.26438309259706605, -0.24983548572030578, -0.23570503630090417, -0.22206157431633328, -0.20896725976776187, -0.19647681192513144, -0.18463772864434852, -0.17349049173715275, -0.16306875787628794, -0.15339953753421176, -0.14450336691800025, -0.13639447971012475, -0.12908098659481448, -0.12256507100258118, -0.11684320923076674, -0.11190642212554602, -0.10774056391752196, -0.1043266517135002, -0.10164123672784209, -0.09965681578276964, -0.09834227912337601, -0.09766338837294031, -0.09758327665846855 ], [ -0.3804047327766648, -0.3915461842858844, -0.40221844274303237, -0.41211956639436137, -0.42096660632183946, -0.4285116953278937, -0.4345537362563219, -0.43894482862546413, -0.4415916577455905, -0.44245282280619047, -0.4415334036816172, -0.4388780313688545, -0.434563480584382, -0.42869148796869627, -0.42138221117974667, -0.41276852500702443, -0.4029912049212027, -0.39219496258130915, -0.380525253886447, -0.368125762676134, -0.3551364608936268, -0.34169215159577365, -0.3279214102223217, -0.3139458495881094, -0.29987964390614813, -0.2858292562614274, -0.27189332218345874, -0.2581626493404202, -0.24472030000189948, -0.23164172890481005, -0.21899495460878082, -0.2068407474163393, -0.19523282150452065, -0.18421802308513024, -0.17383651017351026, -0.16412192287285554, -0.15510154593022785, -0.1467964676392436, -0.13922174089935224, -0.13238655334555471, -0.126294413905932, -0.12094336292354335, -0.11632621212710337, -0.11243081932314403, -0.10924040082549147, -0.10673388248406268, -0.1048862878974941, -0.10366916017364569, -0.10305101160888097, -0.10299779403390485 ], [ -0.35323304851551857, -0.36377147022166284, -0.37394738716014764, -0.3834856005845879, -0.3921249779716078, -0.3996325214436268, -0.40581418254575796, -0.41052154321995404, -0.41365429760315764, -0.41515911497025976, -0.41502582324684834, -0.41328193014116255, -0.40998637761216533, -0.40522320830741165, -0.39909559277765644, -0.3917204712992483, -0.3832239205925867, -0.3737372612271701, -0.3633938656691599, -0.3523265981742633, -0.3406658063323373, -0.32853778293674996, -0.31606362126166665, -0.3033583938602443, -0.29053059295425976, -0.2776817784664877, -0.26490638731990235, -0.2522916646281549, -0.23991768380315576, -0.22785742844283624, -0.21617691418829943, -0.20493533360350552, -0.19418521156658697, -0.18397256268476797, -0.17433704585174947, -0.1653121142367565, -0.15692516169529136, -0.14919766878225216, -0.1421453531861575, -0.13577833045369403, -0.13010129131628612, -0.12511370176809833, -0.12081003131220325, -0.11718001355647245, -0.1142089417067842, -0.11187799960474298, -0.11016462694253892, -0.1090429153178355, -0.10848403001551754, -0.10845665094693013 ], [ -0.328714722384057, -0.3386234587042152, -0.34826076145960433, -0.35737722151457396, -0.36573364825793814, -0.3731132377286368, -0.3793313472495684, -0.38424206256127297, -0.3877413395770339, -0.38976702459604856, -0.39029639794001353, -0.38934202135895485, -0.386946637446369, -0.3831777366289311, -0.3781222382083617, -0.37188157091835305, -0.36456730780514235, -0.3562974155956611, -0.3471931164462087, -0.33737632288091246, -0.32696758744053145, -0.3160845009290518, -0.30484047263212066, -0.2933438293918661, -0.28169717597165733, -0.2699969655322468, -0.25833323558499277, -0.24678947113156424, -0.23544256267638525, -0.22436283234777593, -0.21361410647664802, -0.20325381766915607, -0.1933331236836684, -0.18389703428891102, -0.17498454073283554, -0.16662874547394568, -0.15885699239170015, -0.15169099976839873, -0.14514699988932622, -0.1392358901157983, -0.13396340073479085, -0.12933028478833786, -0.12533253447064074, -0.12196162761546869, -0.11920480637398345, -0.11704538852164648, -0.11546311006585752, -0.114434496091944, -0.11393325521458686, -0.11393069170469028 ], [ -0.3067686202150444, -0.31603587806175315, -0.32510855213675566, -0.3337616389155594, -0.341777385770743, -0.34895573685401843, -0.35512302239772214, -0.36013817832677864, -0.3638962128393845, -0.3663290429235583, -0.3674041217556241, -0.36712143293334576, -0.36550945133210494, -0.3626206022976808, -0.35852663627569054, -0.3533142116769783, -0.3470808676581767, -0.33993148064756507, -0.331975235253924, -0.3233230984662177, -0.31408576097972113, -0.30437199633742446, -0.2942873834254082, -0.28393333775578206, -0.2734063998425756, -0.26279773345134444, -0.2521927917166462, -0.24167111455092255, -0.23130622611751733, -0.22116560625033016, -0.2113107144949295, -0.20179704988398495, -0.1926742336272685, -0.1839861055807958, -0.17577082864754878, -0.16806099813493125, -0.1608837555279503, -0.154260908106282, -0.14820905731326217, -0.14273973975804166, -0.13785958519314268, -0.13357049577206404, -0.12986985039033583, -0.1267507370089821, -0.12420221463576253, -0.12220960520091051, -0.12075481402740207, -0.11981667608146584, -0.11937132381057325, -0.11939257122951952 ], [ -0.2872832208426537, -0.29590931539500154, -0.30440498841870733, -0.3125680095763015, -0.3202011330408831, -0.32712102007598015, -0.3331658734630539, -0.3382011786109021, -0.3421232537158721, -0.3448606207256514, -0.34637345636996286, -0.34665153429587664, -0.34571112335615306, -0.3435912838891677, -0.34034993319973145, -0.3360599614177289, -0.3308055898294794, -0.32467908720977834, -0.3177779000740883, -0.31020220999604176, -0.3020529027587039, -0.2934299169419737, -0.28443093052903223, -0.2751503406853091, -0.265678492068849, -0.25610111146380565, -0.24649891022454862, -0.23694732034138516, -0.22751633448803993, -0.21827042493919735, -0.20926852060755607, -0.20056402555796876, -0.19220486616039362, -0.18423355750950648, -0.1766872828407957, -0.1695979823861663, -0.16299245041284283, -0.1568924410543403, -0.15131478495220285, -0.14627151967003227, -0.14177003731673077, -0.13781325283969026, -0.13439979605588603, -0.13152422973498046, -0.1291772950094855, -0.1273461841540725, -0.1260148394516516, -0.12516427555216536, -0.12477292152934383, -0.12481697783491208 ], [ -0.2701249755608735, -0.2781198512687878, -0.2860373169392254, -0.2936961663694307, -0.30091846231580627, -0.3075371333201704, -0.31340262587651824, -0.3183881081934278, -0.3223929412896288, -0.32534436559676383, -0.32719755041513227, -0.32793429047279216, -0.3275607003989926, -0.32610426311500035, -0.32361055023925517, -0.320139871536135, -0.3157640427296653, -0.31056339773181274, -0.30462411832045333, -0.2980359134207812, -0.29089005082851815, -0.2832777247010199, -0.2752887303083393, -0.2670104113661467, -0.2585268430725754, -0.24991821442214263, -0.24126037549780194, -0.23262451855816496, -0.2240769653693367, -0.21567903706629749, -0.20748698666314314, -0.1995519780329525, -0.1919200986613223, -0.1846323966844413, -0.17772493561156588, -0.17122886266969556, -0.16517048886770613, -0.1595713806354444, -0.15444846423322367, -0.14981414504008284, -0.14567644431792592, -0.14203915613001217, -0.1389020268000224, -0.13626095868296906, -0.13410823914905468, -0.13243279463662716, -0.13122046849938662, -0.1304543202464309, -0.1301149427362317, -0.13018079301037577 ], [ -0.25514553144857344, -0.2625265926220878, -0.26987356699448334, -0.2770244984535807, -0.2838194130654339, -0.2901067743838474, -0.29574924582043327, -0.3006283456710191, -0.30464773710190757, -0.3077350687196292, -0.30984243839533965, -0.31094567057527084, -0.31104266554867244, -0.31015110045968625, -0.30830574662744564, -0.3055556293985321, -0.30196120785348, -0.29759170177990885, -0.2925226484202656, -0.2868337345303134, -0.28060692096108686, -0.2739248566864364, -0.26686956568612963, -0.2595213819290117, -0.2519581035341312, -0.2442543358774918, -0.2364809940509151, -0.22870493698232147, -0.2209887081932469, -0.21339036124544952, -0.2059633511677893, -0.19875647638787852, -0.19181385880446783, -0.18517495254506572, -0.1788745746010662, -0.17294295287638706, -0.16740578919223648, -0.16228433643550677, -0.15759549030432263, -0.15335189698452556, -0.14956207858870885, -0.14623057832185427, -0.14335812713633722, -0.14094183314956021, -0.13897539438014117, -0.1374493344831632, -0.13635126020888344, -0.135666138350087, -0.13537658905429417, -0.13546319162150644 ], [ -0.24218776159215477, -0.2489780131429739, -0.2557691609940661, -0.26241676135805375, -0.2687773975227383, -0.27471415920856307, -0.28010161358787267, -0.2848299294612952, -0.28880792823896567, -0.2919649641500069, -0.29425165833786215, -0.295639609315724, -0.2961202661736888, -0.295703179946966, -0.294413847995402, -0.2922913446926265, -0.28938589823809424, -0.28575653567416576, -0.28146888170815587, -0.27659316497952025, -0.2712024594372469, -0.26537116870527133, -0.25917374717433983, -0.2526836421765333, -0.2459724359944096, -0.23910916371306085, -0.23215978225353467, -0.22518676669599152, -0.2182488117194692, -0.21140061828436157, -0.20469274829364864, -0.19817153269524512, -0.19187902119019967, -0.18585296429030385, -0.18012682085004272, -0.17472978632909053, -0.16968683888251157, -0.1650188018983737, -0.16074242278855677, -0.15687046868001964, -0.1534118401544704, -0.15037170435929315, -0.14775164869078872, -0.14554985587275338, -0.1437613006719104, -0.14237796776771516, -0.1413890894939962, -0.1407814013608144, -0.14053941250980007, -0.1406456876095351 ], [ -0.23109066613029938, -0.23731714663721176, -0.24357238299722672, -0.24972778135331675, -0.2556550751643118, -0.2612309739860343, -0.26634143948808353, -0.2708853133078017, -0.2747771018934267, -0.2779488190728172, -0.28035088145591425, -0.28195213148666587, -0.2827391197446656, -0.28271480944972843, -0.28189687429624755, -0.2803157509386326, -0.27801258592569983, -0.2750371895117933, -0.27144608020756805, -0.2673006773374473, -0.2626656760329839, -0.25760762072650556, -0.2521936793035572, -0.24649061018661855, -0.24056390811988027, -0.23447711062599635, -0.22829124537222117, -0.22206439846575643, -0.2158513845433544, -0.20970350107125502, -0.2036683512536474, -0.19778972215338708, -0.1921075069029104, -0.1866576621117449, -0.18147219367423717, -0.17657916608466995, -0.1720027320306874, -0.1677631804270575, -0.16387700215019807, -0.16035697352951828, -0.1572122581466382, -0.15444852770129058, -0.15206810264780823, -0.1500701130247596, -0.14845067943779877, -0.1472031135650328, -0.1463181368921106, -0.14578411570834304, -0.1455873097595477, -0.14571213140485983 ] ], "zauto": true, "zmax": 1.3511089376543035, "zmin": -1.3511089376543035 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.4260851850705401, 0.42566898274346937, 0.42551589383409405, 0.4256074823314668, 0.42591901303838964, 0.426420383409024, 0.4270772445086276, 0.4278522336964514, 0.4287062410103209, 0.42959963805931045, 0.43049341062437857, 0.43135015184161585, 0.43213488957689533, 0.4328157375666631, 0.43336437382899073, 0.43375636104303583, 0.4339713318277152, 0.43399306721789443, 0.43380949940128866, 0.43341267024073954, 0.4327986755141495, 0.4319676213185983, 0.4309236137815106, 0.4296747961296445, 0.4282334383340476, 0.4266160741226156, 0.4248436684627968, 0.4229417862632007, 0.4209407209546557, 0.4188755310855352, 0.41678592574862017, 0.414715937444479, 0.4127133258215449, 0.4108286692640404, 0.4091141244101416, 0.4076218659446979, 0.4064022581720357, 0.4055018515936345, 0.4049613357658444, 0.4048136068349519, 0.4050821175456241, 0.4057796647147047, 0.4069077336367783, 0.40845646485906645, 0.41040524463116695, 0.4127238568092073, 0.41537408146277816, 0.4183115914734486, 0.42148798626509965, 0.42485281020812027 ], [ 0.4193739321430726, 0.41895057608730474, 0.41883044155975313, 0.41899274939470443, 0.41940938826019447, 0.42004602738117686, 0.4208634524166621, 0.4218190274579483, 0.4228681865522686, 0.4239658681348972, 0.4250678225455564, 0.42613174324953534, 0.42711819353211933, 0.4279913199862627, 0.42871936059406074, 0.4292749679288089, 0.4296353769083676, 0.429782451931396, 0.42970265061273627, 0.4293869411875326, 0.42883070835156295, 0.4280336780725502, 0.426999885828458, 0.4257377048005599, 0.4242599407604121, 0.422583988819745, 0.42073203413396654, 0.41873126463275534, 0.4166140498481333, 0.41441802731640087, 0.4121860286875095, 0.40996577379238947, 0.40780926486240354, 0.4057718270163247, 0.4039107664075217, 0.40228365396817456, 0.40094628824404455, 0.39995044051003453, 0.39934153181174975, 0.3991564258467131, 0.3994215350099669, 0.4001514234849754, 0.40134804986879224, 0.4030007274387361, 0.40508680319111734, 0.407572980634647, 0.41041714900288806, 0.4135705423751766, 0.41698003984867155, 0.4205904303434747 ], [ 0.41220607432317974, 0.4117776621524859, 0.41169730175731556, 0.4119416258044015, 0.4124787536394158, 0.41326962017242075, 0.414269567356726, 0.41543007656932907, 0.4167005224125338, 0.41802984286622513, 0.4193680433975521, 0.420667479218647, 0.4218838864878581, 0.422977157018154, 0.42391187033045963, 0.42465761108776057, 0.4251891092689686, 0.42548624553587094, 0.42553396590427084, 0.42532214877430197, 0.42484546413467855, 0.42410325962826473, 0.4230995012407364, 0.42184278760147703, 0.4203464461796213, 0.4186287070100959, 0.4167129351879732, 0.41462788774085757, 0.41240794457804797, 0.4100932484889933, 0.407729677639881, 0.4053685682084692, 0.40306610751140753, 0.40088233191916783, 0.39887969098315473, 0.39712117988813256, 0.3956680944537988, 0.39457752111023087, 0.3938997299945938, 0.3936756817605893, 0.39393487702183916, 0.3946937637289988, 0.3959548703204886, 0.3977067568858209, 0.39992478547603444, 0.4025726206352698, 0.40560429822650257, 0.40896665596689996, 0.4126019068964664, 0.4164501542452516 ], [ 0.40458230059613753, 0.4041509154312045, 0.40411745517345216, 0.40445569621626754, 0.4051295540107051, 0.4060946704232656, 0.4073003091751945, 0.40869140667904624, 0.4102106306356146, 0.4118003193609617, 0.4134042053341901, 0.4149688609040996, 0.41644483738687876, 0.41778749743817933, 0.418957562814971, 0.41992141511474895, 0.42065119641811183, 0.4211247610727982, 0.4213255303361116, 0.4212422992545518, 0.42086904071151665, 0.4202047453869719, 0.4192533285295249, 0.4180236248308388, 0.4165294811339888, 0.4147899430864605, 0.4128295162577765, 0.4106784651215844, 0.40837309557216206, 0.4059559498152937, 0.4034758287072644, 0.400987548706742, 0.3985513417964859, 0.39623182030781195, 0.3940964571530582, 0.3922135764789646, 0.3906499083079221, 0.38946782765252874, 0.38872246414623635, 0.3884589196745619, 0.3887098555867468, 0.38949369784640053, 0.3908136550241235, 0.39265765672747344, 0.39499921395829124, 0.39779909799069824, 0.40100765004710837, 0.40456748376530344, 0.40841633073966643, 0.41248980207285973 ], [ 0.3965072900160308, 0.39607494335719173, 0.3960957497309843, 0.39654033367863534, 0.3973679243309089, 0.3985282521510661, 0.3999638059225661, 0.4016122583050318, 0.40340887772948314, 0.4052887736374352, 0.40718886300889967, 0.40904949058943146, 0.4108156766389205, 0.4124380002194376, 0.4138731512551937, 0.4150842009490768, 0.41604064889266734, 0.4167183080971873, 0.4170990879037616, 0.4171707306666275, 0.4169265521414676, 0.4163652280889406, 0.41549066077752467, 0.414311948645801, 0.41284347006681665, 0.41110507770642657, 0.40912238335770756, 0.4069270947090764, 0.40455734612998856, 0.4020579467566359, 0.3994804532051722, 0.39688296416961594, 0.394329533627568, 0.3918891122354164, 0.38963395604170337, 0.3876374894715237, 0.3859716741191556, 0.3847040103360072, 0.38389437413170385, 0.38359195281045094, 0.38383257329274983, 0.3846367048999263, 0.3860083593344244, 0.38793501162323385, 0.39038854443139387, 0.3933270980568093, 0.396697612537973, 0.40043879239141367, 0.40448421349272146, 0.4087653200034008 ], [ 0.3879896681091137, 0.38755825681566264, 0.387640883722996, 0.3882046920306157, 0.38920368545855166, 0.39058099593399026, 0.39227157090704023, 0.3942050394947134, 0.39630853279320777, 0.39850927490187693, 0.4007368159386154, 0.40292483547500896, 0.40501249596611644, 0.4069453660737099, 0.40867596178054955, 0.41016396975415054, 0.4113762247323585, 0.41228651334119765, 0.4128752730450214, 0.4131292486261459, 0.4130411607853956, 0.41260943262332955, 0.4118380099042762, 0.4107362998152992, 0.40931923997699554, 0.4076074943607683, 0.40562775535955686, 0.4034131117796379, 0.40100342176142595, 0.39844560910287363, 0.3957937834964332, 0.3931090730347573, 0.39045905500133476, 0.38791668282987707, 0.38555863715882, 0.3834630794005055, 0.38170685614075983, 0.3803622860254426, 0.3794937458967122, 0.37915434327513214, 0.3793829995992286, 0.3802022581604028, 0.38161706680905494, 0.38361467560016194, 0.3861656534853588, 0.3892258932424798, 0.3927393666341021, 0.3966413303867265, 0.40086167333045153, 0.4053281290754278 ], [ 0.3790418598358664, 0.37861314925044276, 0.37876531055650786, 0.3794616327724211, 0.38065028635867565, 0.3822670367566109, 0.3842384445077353, 0.38648524915347077, 0.3889256603079712, 0.391478337069215, 0.3940649098775416, 0.3966119720237389, 0.39905253064765994, 0.40132695392119444, 0.4033834813398106, 0.4051783797723617, 0.4066758326281355, 0.40784764683707586, 0.40867285536893033, 0.4091372839118591, 0.4092331403443433, 0.4089586752377689, 0.40831795071788046, 0.4073207431359481, 0.4059825915598551, 0.4043249885524912, 0.40237569175988547, 0.40016911459925647, 0.39774673252236065, 0.3951574193994046, 0.3924576089048245, 0.389711161767252, 0.3869888156718225, 0.3843671053239706, 0.3819266702815408, 0.37974992058130236, 0.37791810440130275, 0.3765079121307951, 0.3755878449094355, 0.37521465482702315, 0.3754302080060504, 0.3762591135817592, 0.3777073940367935, 0.3797623529492765, 0.3823936469378664, 0.38555542009728744, 0.3891892415117398, 0.39322751984502585, 0.3975970593074823, 0.4022224603967 ], [ 0.3696798907025631, 0.3692555379954665, 0.36948512004342443, 0.3703276418308134, 0.3717247474450648, 0.3736039713463435, 0.37588255066651893, 0.37847141732410167, 0.3812790299104901, 0.3842147859808388, 0.387191852275538, 0.39012934335991595, 0.3929538551017867, 0.39560041282463054, 0.39801292536049043, 0.40014424957019173, 0.40195597045538717, 0.4034179947360479, 0.404508044605092, 0.40521112587357894, 0.4055190322391593, 0.405429935339131, 0.4049480983172361, 0.4040837381901843, 0.4028530485614395, 0.401278378487984, 0.39938854511565025, 0.3972192370556386, 0.394813442992573, 0.3922218171066656, 0.3895028719436095, 0.3867228738428226, 0.38395531044674036, 0.38127980937066164, 0.3787804169041897, 0.3765431991794718, 0.37465320557168946, 0.3731909295040152, 0.3722285025344789, 0.37182594426804005, 0.3720278408180013, 0.3728608190016621, 0.3743321136090961, 0.3764293983551617, 0.3791218910670294, 0.3823625837400968, 0.3860913212869482, 0.39023838147338824, 0.3947281989292847, 0.399482919168464 ], [ 0.3599232245796113, 0.35950485725069686, 0.35981998496880346, 0.36082282245486563, 0.3624476869207517, 0.36461290078001485, 0.36722533646887195, 0.3701851227714568, 0.3733900954300242, 0.37673968714130524, 0.38013808030605967, 0.3834965633379255, 0.386735122207043, 0.389783358277984, 0.39258085420576627, 0.3950771184131696, 0.39723123307913516, 0.3990113171996934, 0.40039389991396956, 0.4013632828228972, 0.4019109548066976, 0.40203510907066764, 0.40174029929517246, 0.4010372589360577, 0.39994289391467486, 0.3984804432667654, 0.3966797841999741, 0.3945778373239927, 0.39221900509180513, 0.3896555530788524, 0.3869478219908161, 0.38416414173267655, 0.3813803121233224, 0.3786785233496985, 0.3761456184796544, 0.3738706542958839, 0.3719417958272032, 0.37044267881581955, 0.3694484800337182, 0.3690220277424845, 0.36921033987010804, 0.37004197478618434, 0.3715255090024581, 0.373649324798307, 0.37638272317799126, 0.3796782091660547, 0.3834746624845315, 0.3877010311783662, 0.3922801755562977, 0.3971325352410537 ], [ 0.3497947640458794, 0.3493841272246085, 0.34979329337856974, 0.3509710776956626, 0.3528435338636744, 0.35531865023797393, 0.35829177352310954, 0.36165115314020896, 0.3652830957468601, 0.36907637538165655, 0.3729257138433335, 0.3767342930329118, 0.38041536791931113, 0.3838931124947749, 0.38710285819428125, 0.38999088539633187, 0.39251391437717836, 0.3946384208562647, 0.39633987865647535, 0.3976020110815614, 0.3984161145283358, 0.39878050246283375, 0.39870010431849956, 0.3981862409121397, 0.39725658437570266, 0.39593529530310295, 0.3942533120937171, 0.3922487471239937, 0.3899673218476714, 0.387462749508306, 0.38479695216609816, 0.38203998168462816, 0.37926950685955785, 0.3765697365582817, 0.37402967723840347, 0.37174067682603046, 0.3697932864676781, 0.3682735720028041, 0.36725911529647975, 0.36681504144460664, 0.36699046679645064, 0.3678157628309363, 0.3693009612708578, 0.3714354929601394, 0.37418928169809645, 0.37751504087194304, 0.38135148197962576, 0.385627065251736, 0.3902639109753173, 0.39518153605275885 ], [ 0.33932116622981195, 0.33892034768015294, 0.33943260582102935, 0.3408006085967652, 0.34294103764543066, 0.345750256692968, 0.349110792357531, 0.35289786011930624, 0.35698531323047716, 0.3612506085647789, 0.36557860534409153, 0.3698641949531729, 0.37401388303617916, 0.3779465098199284, 0.3815933137394851, 0.38489753293496703, 0.3878137132754185, 0.39030686057369324, 0.3923515448383814, 0.39393103872171503, 0.39503655145097316, 0.3956666027985485, 0.39582656769460894, 0.39552840933608974, 0.39479060558949264, 0.39363825888243276, 0.3921033628005214, 0.3902251789642341, 0.3880506558513448, 0.385634798299101, 0.3830408747355942, 0.38034033218891294, 0.3776122814279026, 0.3749424217388119, 0.3724213025346127, 0.37014187164943363, 0.3681963388143056, 0.36667248262771096, 0.36564963780574544, 0.3651946964603632, 0.3653585180623671, 0.3661731453425175, 0.3676501561285009, 0.36978034982888913, 0.37253479618506946, 0.3758670993942432, 0.37971658977377054, 0.3840120737211509, 0.38867575890331746, 0.3936270160746639 ], [ 0.32853362847523193, 0.3281453605260362, 0.3287705667702461, 0.3303448368725717, 0.33277415841243785, 0.33594178365255806, 0.3397159840471469, 0.3439577216767095, 0.3485274839176952, 0.353290826579379, 0.3581224599884891, 0.3629089349443526, 0.3675501223604146, 0.3719597405019941, 0.37606518860283444, 0.37980691833432767, 0.38313753356789393, 0.3860207662425084, 0.38843043840847413, 0.39034949006352965, 0.3917691291026131, 0.39268814212192293, 0.3931123909852479, 0.3930545079692876, 0.3925337901768848, 0.39157628034583464, 0.3902150052737123, 0.3884903244949109, 0.38645032095134274, 0.3841511434014668, 0.3816571894254201, 0.3790410014576771, 0.37638274081825657, 0.37376911162306375, 0.37129163330793946, 0.36904421166462814, 0.3671200348670586, 0.3656079184345218, 0.36458832942534986, 0.364129415879085, 0.36428342869722846, 0.3650839278232191, 0.3665441009766429, 0.3686563963218206, 0.37139350336874294, 0.3747105444024118, 0.37854819823578045, 0.3828363951094792, 0.3874982048632602, 0.39245358167760647 ], [ 0.31746925373795465, 0.31709727510221497, 0.3178463410438273, 0.3196437950001945, 0.3223833511274074, 0.3259334455631245, 0.3301465253282811, 0.33486804710820006, 0.3399442816995504, 0.345228431524025, 0.3505849418835906, 0.3558921523753441, 0.3610435799477865, 0.36594817141644825, 0.3705298453032937, 0.37472659251129875, 0.3784893455286308, 0.38178076999031585, 0.3845740865023678, 0.38685199586884883, 0.3886057558849579, 0.38983444019910013, 0.39054439670955854, 0.3907489120786823, 0.3904680781824382, 0.3897288441457744, 0.38856522308918406, 0.3870186054926013, 0.3851381115360059, 0.3829808940914301, 0.380612284372654, 0.3781056568348578, 0.37554188308632097, 0.37300825149907574, 0.37059675520385116, 0.3684017003867525, 0.36651666033846647, 0.36503089427379526, 0.36402545218709814, 0.3635692794579967, 0.36371569480092386, 0.36449962139371195, 0.36593589199375126, 0.36801882871350217, 0.3707231382598208, 0.37400599719334265, 0.37781006410142315, 0.382067072078054, 0.3867016349161008, 0.39163493681297484 ], [ 0.30617299487441835, 0.3058224310190342, 0.3067075199222952, 0.30874589514408657, 0.31181712195757055, 0.31577289273550163, 0.3204481581614127, 0.3256716458236697, 0.3312746973775456, 0.3370979185081623, 0.3429956107138812, 0.34883826181104155, 0.354513513975337, 0.3599260472060758, 0.3649967642969446, 0.36966158296597873, 0.3738700587600012, 0.3775839923067761, 0.3807761208549341, 0.3834289560444134, 0.38553380438346163, 0.3870899902346411, 0.3881042897220631, 0.3885905749351473, 0.3885696588642517, 0.3880693210704382, 0.38712448121912785, 0.3857774719978892, 0.38407834499222404, 0.3820851240003565, 0.37986390212798554, 0.37748866492367084, 0.375040715903736, 0.37260758793647464, 0.37028134907163557, 0.3681562583561081, 0.36632579690805633, 0.3648791880015542, 0.36389761654775504, 0.3634504459480649, 0.3635917876242234, 0.3643577858462364, 0.36576492660326493, 0.36780956752383326, 0.3704687356075187, 0.37370208157865986, 0.3774547468582952, 0.3816608161301435, 0.3862470050844421, 0.39113626352765085 ], [ 0.2946999866476362, 0.2943776741203386, 0.2954122371071672, 0.29770978363260564, 0.30113353730321407, 0.3055163220670485, 0.31067388797334705, 0.3164171371216063, 0.3225620147509395, 0.32893659243153694, 0.3353854616515503, 0.34177189701679983, 0.3479783678351582, 0.3539059500233944, 0.3594730914563609, 0.3646140662484613, 0.36927734666601997, 0.3734240373616873, 0.3770264567592744, 0.380066911008042, 0.3825366816487422, 0.3844352337970615, 0.38576964290304977, 0.38655423164473657, 0.38681040185843096, 0.38656663801047003, 0.38585864770150047, 0.3847295908556792, 0.38323033305234416, 0.3814196411188469, 0.37936422267013914, 0.3771384987181191, 0.37482399364002045, 0.3725082341993604, 0.3702830734983127, 0.3682424001653044, 0.3664792584994347, 0.36508248790320574, 0.36413307996084804, 0.3637005331954523, 0.3638395394398808, 0.36458734371548795, 0.36596207101712047, 0.36796221101065585, 0.3705673125369942, 0.3737397918776486, 0.37742763226187437, 0.38156767046239304, 0.3860891396975785, 0.3909171623688555 ], [ 0.28311781117230145, 0.28283244944004204, 0.2840309624766485, 0.2866057247048331, 0.2904011220497893, 0.29522886339385546, 0.3008838839238663, 0.3071584345441828, 0.3138529785229281, 0.32078353122407977, 0.32778579345812153, 0.3347167811673798, 0.34145472215686595, 0.34789789414207384, 0.35396291831899235, 0.3595828618017793, 0.36470536996618264, 0.36929095361630854, 0.373311492502274, 0.37674897850500644, 0.3795945008495978, 0.3818474652840026, 0.38351503413588145, 0.38461177088913734, 0.3851594689645421, 0.3851871382556094, 0.38473111393252996, 0.3838352400162642, 0.3825510658155387, 0.3809379777665803, 0.37906317452736077, 0.37700138217346635, 0.3748342026149714, 0.3726489960339409, 0.3705372213262738, 0.3685922002654975, 0.3669063319386286, 0.3655678603571688, 0.36465738108138795, 0.36424434793161975, 0.36438389084860345, 0.3651142642347857, 0.3664552019310668, 0.3684073622264359, 0.3709529189560807, 0.37405721769759065, 0.37767129686023065, 0.3817349939527317, 0.38618032782794537, 0.39093486568832087 ], [ 0.2715079503883742, 0.2712699170941066, 0.2726471513251084, 0.2755156891591478, 0.27969835100049295, 0.28498350367293085, 0.29114392602748884, 0.29795284752656526, 0.3051956996401418, 0.31267744007219594, 0.3202261378013166, 0.3276938308118841, 0.33495564473304873, 0.3419079672751321, 0.3484662387473181, 0.35456271146825136, 0.3601443749531104, 0.365171139382644, 0.369614306922087, 0.37345532676704185, 0.37668481463243103, 0.3793018125836557, 0.38131326488891915, 0.38273368616136183, 0.38358499712430727, 0.3838964995869944, 0.38370495515679026, 0.3830547219666346, 0.38199789097822684, 0.38059434955162036, 0.3789116869278363, 0.3770248467280493, 0.37501542885875994, 0.3729705510794275, 0.37098120258839823, 0.3691400609542685, 0.3675387999141703, 0.36626498562208065, 0.3653987347430566, 0.36500937652242044, 0.36515240690138184, 0.3658670311090745, 0.36717455301967544, 0.36907778618852904, 0.37156154580521616, 0.37459415478111385, 0.3781297856073045, 0.3821113827460903, 0.3864738784718851, 0.391147427074979 ], [ 0.2599654536886818, 0.2597860729813771, 0.2613557216171016, 0.26453115463145765, 0.269110818071557, 0.27485774750627706, 0.2815217340818511, 0.28885727851364495, 0.296635912301959, 0.304653130076479, 0.3127310806819049, 0.32071839925118645, 0.3284883977605846, 0.3359365137648573, 0.3429775982914022, 0.3495433706469394, 0.3555801935081273, 0.36104721494498077, 0.3659148666287078, 0.3701636821301385, 0.373783392483974, 0.37677225867256514, 0.3791366062588768, 0.3808905323576349, 0.38205575740740133, 0.38266159283164153, 0.3827449904561957, 0.3823506308666281, 0.38153099663365886, 0.3803463639133786, 0.3788646342997967, 0.3771609205107613, 0.37531679759695225, 0.3734191392676621, 0.37155847985782187, 0.3698268786817337, 0.36831531520763433, 0.367110707509561, 0.3662927154704547, 0.3659305527458847, 0.3660800735459192, 0.3667814086217858, 0.3680573913147212, 0.36991293988831864, 0.37233545768840504, 0.37529619721683727, 0.3787524301541663, 0.38265019140163703, 0.38692733152641917, 0.39151661858385756 ], [ 0.24859583599148644, 0.24848585917325508, 0.25025836675831087, 0.2537477048901523, 0.2587253005894438, 0.26492739400705784, 0.2720807315916978, 0.27992223197467253, 0.28821143814938693, 0.29673658510324863, 0.3053160167707158, 0.31379674949071995, 0.32205161949671046, 0.32997598667128697, 0.337484560974006, 0.3445086251233076, 0.35099374272877915, 0.3568979396082944, 0.3621902999710804, 0.3668499061802509, 0.3708650551170879, 0.3742326955063742, 0.3769580427635045, 0.379054337586648, 0.3805427200119525, 0.38145219146165316, 0.38181963364073146, 0.3816898456711609, 0.3811155506987623, 0.3801573118781299, 0.37888328708858404, 0.37736874437589096, 0.3756952587849653, 0.37394951900391893, 0.3722216919303773, 0.37060332682813846, 0.3691848282017882, 0.3680525849621286, 0.3672859062588174, 0.3669539712566206, 0.36711303864044204, 0.3678041699053306, 0.3690516910767991, 0.370862550727879, 0.37322663744513257, 0.376118014119457, 0.3794969294450029, 0.3833123959925524, 0.3875050891680429, 0.3920103232474112 ], [ 0.23750857414642987, 0.23747564230297954, 0.2394551497096757, 0.2432559973396415, 0.24862045062049806, 0.2552573377543778, 0.262871314726454, 0.2711838352291818, 0.27994514689489514, 0.28893895603814695, 0.29798219306158275, 0.3069221061945974, 0.31563230669386383, 0.32400876249347493, 0.3319662497668205, 0.33943545074110976, 0.3463607026691714, 0.35269831521029343, 0.35841534478020615, 0.36348871780673375, 0.3679046126252101, 0.37165803131318637, 0.37475251221171557, 0.3771999483647464, 0.3790204856242043, 0.3802424767841337, 0.3809024655082281, 0.3810451670674092, 0.38072340336188837, 0.37999793900330187, 0.37893715533485334, 0.37761649247674, 0.3761175884165019, 0.3745270515735008, 0.3729348216684629, 0.371432104770116, 0.37010891199841167, 0.3690512848282245, 0.3683383472627277, 0.3680393771259935, 0.36821112417488705, 0.36889561098495977, 0.3701186267689165, 0.37188906437958696, 0.37419916477241233, 0.37702563597995375, 0.380331522996211, 0.384068636742559, 0.38818031423488014, 0.3926042799572363 ], [ 0.226807344166445, 0.2268522905988272, 0.22903273381257813, 0.2331296048408902, 0.2388547718116619, 0.245890178120957, 0.25392048945231976, 0.2626547594805954, 0.2718372791553916, 0.28125029031906085, 0.29071177059967396, 0.30007092691378734, 0.30920314862961984, 0.3180053840225796, 0.32639234771705805, 0.33429363217486346, 0.3416516257733725, 0.3484200747763197, 0.35456312100991194, 0.3600546705584952, 0.3648779823534561, 0.3690253984950961, 0.3724981652302635, 0.3753063126782587, 0.377468572480889, 0.3790123163571187, 0.37997349635136324, 0.38039656088227447, 0.380334311163747, 0.3798476519599142, 0.37900518091952135, 0.37788255411358357, 0.37656156428798504, 0.3751288752229335, 0.37367437268667036, 0.37228912119086116, 0.37106295594677313, 0.3700817885670801, 0.36942475770823013, 0.36916140368953987, 0.3693490790581585, 0.37003081539959437, 0.37123384404169363, 0.37296891428261986, 0.3752304742639564, 0.37799768971871056, 0.38123619065148395, 0.3849003702734758, 0.38893602372487707, 0.39328310866826255 ], [ 0.21657817546268576, 0.21669023380962876, 0.21905082971026754, 0.22341146831604045, 0.22945370982125562, 0.23683447392172008, 0.245221640720666, 0.2543156670637641, 0.2638585799333085, 0.27363425237544364, 0.2834639703438761, 0.2932002835668442, 0.3027209482288923, 0.31192383195998247, 0.3207230449373008, 0.329046228013241, 0.33683278250333615, 0.34403279149947186, 0.3506064059078648, 0.3565235157694875, 0.3617635789485241, 0.3663155246433794, 0.3701776840118843, 0.37335772359940983, 0.37587257013586894, 0.3777483193688663, 0.3790201189339305, 0.37973200784252037, 0.37993668494321586, 0.3796951676019249, 0.379076291825418, 0.37815599821267, 0.3770163466815714, 0.3757442091212034, 0.37442960492961613, 0.3731636710249075, 0.372036295153196, 0.37113348681599706, 0.37053460891483353, 0.37030963768778424, 0.3705166494744249, 0.3711997413750443, 0.3723875729516293, 0.3740926670827504, 0.37631153583759275, 0.37902561347601255, 0.38220289810344704, 0.38580013988442624, 0.3897653763438075, 0.39404060706724825 ], [ 0.20687761269956254, 0.20702894685179724, 0.20952957176806813, 0.21410182214159176, 0.22039871841201344, 0.2280553640507274, 0.23672690601706123, 0.2461093489496692, 0.25594608258476237, 0.2660253662747581, 0.27617355899770435, 0.28624737361312214, 0.2961269512868388, 0.3057104814136757, 0.3149104509938237, 0.32365128871141347, 0.3318680565541203, 0.3395058451711125, 0.3465195871996068, 0.3528740780497886, 0.35854406541590544, 0.36351432735093897, 0.36777970106166624, 0.371345051294544, 0.3742251806630517, 0.37644468744427834, 0.3780377721244054, 0.3790479848823938, 0.37952789453579094, 0.37953864727572556, 0.379149372739958, 0.37843638758043857, 0.3774821446999827, 0.3763738817656567, 0.3752019371948403, 0.37405772659727926, 0.3730314073915255, 0.3722093018044105, 0.37167119410796895, 0.37148765977659176, 0.37171761374723084, 0.3724062738272038, 0.3735837177684045, 0.37526416768618326, 0.377446068449882, 0.3801129479613001, 0.3832349704183289, 0.3867710317427995, 0.39067120846626746, 0.39487936084086195 ], [ 0.19772347217556135, 0.19786388589429504, 0.20044116150128358, 0.20515103839563828, 0.2116216416816114, 0.21947061450889227, 0.2283448289547875, 0.23793980958651317, 0.24800340021229084, 0.2583302844304155, 0.26875288168118494, 0.27913212396740283, 0.2893498480613277, 0.2993033449857254, 0.30890194070742877, 0.31806518521577976, 0.32672215706326146, 0.3348114403273433, 0.34228143069066197, 0.34909073522275813, 0.35520852478981235, 0.3606147701353778, 0.3653003415336151, 0.3692669803648947, 0.3725271633137546, 0.37510388055298555, 0.3770303421366811, 0.3783496150577288, 0.379114179583442, 0.37938537967779834, 0.3792327304246296, 0.37873303718582546, 0.3779692785737882, 0.3770292099637881, 0.3760036577518738, 0.37498449777657883, 0.37406234398627813, 0.37332401348888844, 0.37284987728933305, 0.3727112458186932, 0.3729679668371657, 0.37366642261025507, 0.37483809785174566, 0.37649884863455885, 0.37864893972876035, 0.3812738432499859, 0.38434571772349957, 0.3878254260909689, 0.39166491282054283, 0.39580974780553985 ], [ 0.1890910453277941, 0.18914407885280948, 0.19170915634514316, 0.19646071498650453, 0.20300747285464518, 0.2109547511560451, 0.21994550417311115, 0.22967808520915756, 0.23990694585938313, 0.2504342086000655, 0.2610983344661991, 0.2717635954998753, 0.28231200462356415, 0.292638034411922, 0.30264575917764774, 0.31224778440370177, 0.3213653096131685, 0.3299287782817859, 0.33787871881820175, 0.3451665264822013, 0.35175505482970365, 0.35761897021056055, 0.36274487613967316, 0.3671312420049401, 0.370788179412886, 0.3737371056815626, 0.3760103225235204, 0.3776505225405265, 0.3787102195124964, 0.3792510826803344, 0.37934314201044284, 0.3790638223697445, 0.37849676120490267, 0.3777303682515063, 0.37685609833461287, 0.3759664302321919, 0.3751525755531781, 0.3745019796885191, 0.37409571812035564, 0.37400592963839246, 0.3742934558142869, 0.3750058659505934, 0.37617603321845516, 0.37782138944931687, 0.37994392692638523, 0.3825309443744453, 0.3855564630549351, 0.3889831793515897, 0.392764781407293, 0.39684844322900675 ], [ 0.1809180952365899, 0.1807796743437523, 0.18321845172872236, 0.18789561764399834, 0.19440757103708167, 0.20235284425267303, 0.2113743505760628, 0.2211756167584019, 0.23151868977089515, 0.24221293316864032, 0.2531016525312361, 0.26405049012227905, 0.27493915899642374, 0.28565661051420954, 0.2960989927893177, 0.30616952049639284, 0.3157794263706711, 0.32484934569653245, 0.3333106970877885, 0.3411068114816293, 0.3481937043179156, 0.3545404807569165, 0.3601294176112858, 0.3649557887491522, 0.3690275030203199, 0.37236461335513327, 0.3749987385192487, 0.37697241915741475, 0.37833840995487344, 0.3791588918666531, 0.37950457385576936, 0.3794536437356864, 0.3790905238289123, 0.37850439053839846, 0.37778742873152915, 0.37703281271474454, 0.3763324352089812, 0.3757744422827105, 0.37544067188747193, 0.3754041307264275, 0.37572667154545036, 0.3764570433944866, 0.37762947563113286, 0.37926292085912544, 0.38136102600835503, 0.38391283255962133, 0.38689413774797615, 0.3902693899487001, 0.39399395221830863, 0.3980165523758558 ], [ 0.173122238695809, 0.17266241216381284, 0.1748380639520038, 0.17930768981031842, 0.1856637959375144, 0.19350388955616382, 0.20247418883500826, 0.2122847758466608, 0.2227050887677605, 0.23355022697784172, 0.24466580837194749, 0.25591560609070996, 0.26717344677831634, 0.27831917951606566, 0.28923774308452693, 0.2998201747219238, 0.3099655478832361, 0.31958310198727513, 0.32859411148286155, 0.3369332744743065, 0.34454956433016376, 0.3514065861007834, 0.35748252763459065, 0.3627698088058872, 0.3672745245959833, 0.37101575871808223, 0.37402482060111913, 0.37634443392907996, 0.3780278820062834, 0.3791380954736118, 0.3797466523862658, 0.379932650324754, 0.37978140605181177, 0.3793829413192159, 0.3788302247473802, 0.3782171598043479, 0.3776363374682869, 0.37717660742616604, 0.3769205600770205, 0.3769420477269934, 0.37730390039247336, 0.37805600265974276, 0.37923388784414636, 0.3808579725192874, 0.3829335013284904, 0.38545120646188125, 0.38838861897094323, 0.39171191132943955, 0.3953781111177374, 0.3993375088731538 ], [ 0.1656323403990989, 0.1646996792855666, 0.16645633034821194, 0.1705708781577437, 0.1766417864279432, 0.18427186068703025, 0.19311383140558241, 0.2028850418330802, 0.2133610150496647, 0.22435967041608235, 0.23572484840233163, 0.24731369891824873, 0.2589892759414297, 0.27061777516607055, 0.2820690436965148, 0.29321890289575053, 0.3039521047700855, 0.31416513537980706, 0.3237684406586539, 0.33268792070811126, 0.340865710669222, 0.3482603570238093, 0.3548465317701754, 0.360614425152428, 0.3655689368101993, 0.3697287561586151, 0.3731253919877164, 0.3758021822364116, 0.3778132894426302, 0.37922266639273466, 0.3801029605488627, 0.38053431548254524, 0.38060302349788216, 0.3803999867405073, 0.38001895518618783, 0.37955452946071483, 0.3790999441284846, 0.3787446812520927, 0.37857200130072033, 0.37865651370762266, 0.37906193606896804, 0.3798392024938237, 0.3810250728283172, 0.3826413635354145, 0.3846948705329089, 0.3871779913640129, 0.39006998884740407, 0.3933387815773578, 0.3969431069919576, 0.40083488483585705 ], [ 0.15843028681164703, 0.15685800191195484, 0.15802412075982733, 0.16162245348695706, 0.1672694698387526, 0.1745811412254336, 0.18322058927636917, 0.1929128808120815, 0.20343725267252025, 0.21460987271521437, 0.22626679781696543, 0.2382519662932792, 0.25041128716383876, 0.26259175310578625, 0.274643740115441, 0.2864247444045007, 0.2978032719232737, 0.3086621217347363, 0.31890073393068674, 0.32843656059062926, 0.33720557837469717, 0.34516212851990385, 0.3522782790957759, 0.35854288216195207, 0.36396046266316284, 0.3685500368834037, 0.3723439214647589, 0.3753865617839579, 0.37773338169879705, 0.37944963548695554, 0.38060922723461577, 0.38129345318349833, 0.38158961906739475, 0.38158948793757286, 0.38138752509911217, 0.38107892597312265, 0.3807574396394337, 0.380513033945795, 0.38042948421395456, 0.3805820018429945, 0.38103504534842564, 0.38184046822222195, 0.38303615047231326, 0.38464523187616684, 0.38667601715935773, 0.3891225630701761, 0.39196589426861483, 0.3951757394122079, 0.39871263930479106, 0.40253026022795374 ], [ 0.15159392286725465, 0.1492074754685901, 0.1495988561990191, 0.1525051733677376, 0.15757666118775993, 0.16445348264790235, 0.1728148183248344, 0.1823941022470372, 0.19297069522339427, 0.2043523229369075, 0.2163588453498066, 0.22881224661159325, 0.24153335847507704, 0.2543435656609355, 0.2670691730119102, 0.27954648995168846, 0.29162638045974937, 0.3031776721764132, 0.3140892769621988, 0.3242711403183862, 0.33365425519335673, 0.34219000118058474, 0.34984904609796036, 0.35662000179307374, 0.3625079759796101, 0.3675331150408267, 0.37172919228964435, 0.3751422629080997, 0.3778293803874995, 0.37985734917352415, 0.38130147395783365, 0.3822442575550053, 0.3827739968350927, 0.3829832303033457, 0.38296700226114383, 0.3828209274253733, 0.3826390661221077, 0.3825116522441338, 0.3825227510803493, 0.3827479572831486, 0.3832522688196455, 0.3840882847157454, 0.3852948679659385, 0.3868963882026468, 0.38890261361296746, 0.39130926424451995, 0.3940991782800932, 0.3972439889263356, 0.40070617050888097, 0.4044412929908741 ], [ 0.14533084122132162, 0.14195888329060422, 0.14138373014518443, 0.14340721569088588, 0.14773462056982659, 0.15404655229684563, 0.16204710170165448, 0.1714793183683031, 0.18211755957230896, 0.19375169391047573, 0.20617408688897434, 0.21917374059353925, 0.23253713871299994, 0.24605324636964548, 0.2595199939148211, 0.27275035232823575, 0.2855770178874412, 0.2978554168350791, 0.3094651504122157, 0.3203101849159018, 0.33031813421897904, 0.33943895159300064, 0.3476432875683122, 0.3549207049709092, 0.36127788232705016, 0.3667368864298088, 0.3713335543862879, 0.3751159938610477, 0.3781431861380275, 0.3804836588888213, 0.3822141834365321, 0.3834184446002612, 0.3841856300918381, 0.3846088914195417, 0.3847836399291029, 0.38480566034349767, 0.3847690496689555, 0.3847640202483907, 0.38487463926439675, 0.38517660880947296, 0.385735215300143, 0.38660358884248763, 0.3878214076332779, 0.38941415769597276, 0.39139301597461584, 0.3937553706299315, 0.39648593470191196, 0.3995583574007118, 0.40293719907769915, 0.4065801161766192 ], [ 0.13999569367022158, 0.1354886499147673, 0.13376036263808894, 0.13470091344686383, 0.13809841444689316, 0.14369755492003075, 0.1512412142903443, 0.1604846825039918, 0.17119052372486784, 0.18311822572055303, 0.19601838002550404, 0.20963407280191731, 0.22370756400020422, 0.23798902017559923, 0.2522447222613284, 0.26626337343783, 0.27986012186894893, 0.29287849332157245, 0.30519067264061533, 0.3166966135496035, 0.3273223997060183, 0.3370181907654488, 0.34575599749410196, 0.3535274525106278, 0.3603416810627601, 0.3662233282020498, 0.37121076234144157, 0.3753544479703795, 0.37871546024418784, 0.3813640998654298, 0.3833785573595994, 0.3848435712923604, 0.38584902540436544, 0.3864884355712186, 0.38685728952267584, 0.38705122073587234, 0.38716402259535465, 0.3872855385109354, 0.387499495591815, 0.38788137968395203, 0.3884964730314492, 0.38939818726234104, 0.3906268196114689, 0.3922088374604807, 0.394156756955146, 0.3964696307412568, 0.39913410547570893, 0.4021259603541096, 0.4054120009341945, 0.408952162682024 ], [ 0.13608355270168584, 0.13034467436259722, 0.12730994109463345, 0.12697819546226982, 0.1292524320121158, 0.13397342465220405, 0.14094408566944874, 0.14993783998312993, 0.16069804493108034, 0.17293891967577005, 0.18635302273301488, 0.20062401552234796, 0.21544083959729526, 0.23051005153900547, 0.24556476173908548, 0.26037001456433034, 0.2747251734444775, 0.28846409214783486, 0.30145380498049307, 0.3135923233791702, 0.32480597074444395, 0.3350465545719202, 0.3442885720456968, 0.35252656911650465, 0.35977271788567866, 0.36605463733945337, 0.37141345377369567, 0.3759020764889275, 0.3795836494344525, 0.3825301291889, 0.3848209333956783, 0.38654160146270244, 0.38778241131738483, 0.38863690285186375, 0.3892002710038808, 0.3895676095511022, 0.3898320104118718, 0.3900825513490638, 0.3904022350434223, 0.39086597084486935, 0.3915387124888494, 0.3924738758716695, 0.3937121567620116, 0.39528084740394637, 0.3971937147155093, 0.39945145579422925, 0.4020426957361984, 0.4049454462816457, 0.40812890848606964, 0.41155548295278704 ], [ 0.13418484029045671, 0.1272128040480156, 0.12279949816583778, 0.12106021030032064, 0.1220400637728608, 0.1257123632956764, 0.13196991830566082, 0.14061712643774374, 0.15137405190739267, 0.1638960276472148, 0.17780261576133746, 0.19270669449648498, 0.2082374907105962, 0.2240557363669744, 0.23986188139145076, 0.2553992276604103, 0.27045375962544654, 0.28485201992829, 0.29845794851352847, 0.3111692743811073, 0.3229138232663566, 0.33364595698108795, 0.3433432651957852, 0.35200356901786334, 0.3596422552614354, 0.3662899329768298, 0.37199038486240854, 0.37679877280015317, 0.3807800473426357, 0.3840075047372576, 0.386561431770582, 0.3885277785307616, 0.38999680259377345, 0.39106163577428743, 0.39181673705736175, 0.39235621298529527, 0.3927720093825698, 0.3931520047411965, 0.3935780636229111, 0.394124134691123, 0.3948544982657743, 0.3958222782690673, 0.39706832964370864, 0.3986205932686323, 0.40049397729062725, 0.4026907807289828, 0.40520162849884317, 0.4080068438000789, 0.4110781505180899, 0.41438057909773873 ], [ 0.134885843489858, 0.12681299410832808, 0.12108691063276861, 0.1179245690022445, 0.1175191950596584, 0.12000306612942928, 0.12539200344954687, 0.13354475731666748, 0.14416544714540327, 0.15684668436481, 0.17112809654594038, 0.18654682704075157, 0.20267068264772337, 0.21911531983610003, 0.2355505053070541, 0.25170006673420814, 0.2673386445445071, 0.2822870579425861, 0.2964072591823632, 0.309597371638077, 0.32178705056712514, 0.3329332709999564, 0.34301657647155787, 0.3520377840031697, 0.3600151188515994, 0.3669817391025875, 0.37298360130033137, 0.3780776121313038, 0.38233000692914526, 0.38581489324105794, 0.3886128970688373, 0.39080985110365846, 0.3924954689238917, 0.39376195740424375, 0.3947025320988715, 0.39540981742652925, 0.39597413486612554, 0.39648170701460206, 0.39701283121423225, 0.39764010047517084, 0.3984267678483254, 0.39942535940678087, 0.40067663753082405, 0.40220899894825407, 0.40403836204653854, 0.4061685589638941, 0.408592205461223, 0.41129198195407385, 0.4142422281016529, 0.41741073491481157 ], [ 0.13862522569618263, 0.1297212546878594, 0.12291534339568382, 0.11849059906242003, 0.11676041026761301, 0.11800999234448925, 0.12239626559571601, 0.12986210956679495, 0.140122427505584, 0.15272487131210344, 0.16713968739693832, 0.18283496085844844, 0.19932181353276304, 0.21617428712269307, 0.23303383509377648, 0.24960621625397011, 0.2656553366299876, 0.28099629685034977, 0.295488640253258, 0.3090301849258327, 0.32155154988159124, 0.33301137201346986, 0.3433921667263312, 0.3526967700675565, 0.3609452958926221, 0.36817254085256623, 0.37442577008331185, 0.3797628166442822, 0.3842504280180723, 0.38796279370750225, 0.3909801896885984, 0.3933876788470339, 0.39527381225660063, 0.39672928496120335, 0.39784551237917554, 0.39871310983777314, 0.3994202778201599, 0.4000511182805552, 0.40068393098760763, 0.4013895605667486, 0.4022298814201046, 0.4032565156623672, 0.4045098760005718, 0.4060186099967662, 0.4077994953602772, 0.4098578009838291, 0.4121880902361684, 0.41477540714888894, 0.4175967576971334, 0.42062278092888933 ], [ 0.1455656705649163, 0.13618810257555689, 0.1286653587820112, 0.12330617362039216, 0.12049078346841757, 0.12061020698101498, 0.12394396576284951, 0.13053673416523476, 0.14015478932203973, 0.15234439101243427, 0.16654078060845262, 0.1821656084051134, 0.19868638522531973, 0.21564214131661005, 0.232648622162956, 0.24939379272304515, 0.26562981355124143, 0.281164399503213, 0.295852732710994, 0.3095903018584761, 0.3223067120846739, 0.33396039262331756, 0.34453409744319025, 0.35403109312674175, 0.3624719360110531, 0.36989174920231244, 0.37633791711177467, 0.3818681204351091, 0.3865486385270377, 0.3904528496426947, 0.39365986331075026, 0.39625322396286916, 0.398319631645014, 0.3999476348867925, 0.401226263149531, 0.40224358194505533, 0.4030851724580049, 0.40383255839521837, 0.40456162414185914, 0.40534108771908384, 0.406231106635411, 0.4072821016345572, 0.4085338803493998, 0.41001512907041554, 0.4117433171042918, 0.4137250272736417, 0.4159566921912177, 0.4184256838718826, 0.42111167848933767, 0.4239882018252977 ], [ 0.15555426291693536, 0.14606756233814466, 0.1382277924235446, 0.13233934019394517, 0.12879587643622753, 0.12802811321610907, 0.13038581683252107, 0.1360029455666162, 0.1447276070865738, 0.15615747338928537, 0.1697441157176668, 0.18490044064551733, 0.20107327983879766, 0.21777846009093074, 0.23461077850164375, 0.2512411509748387, 0.2674086413303035, 0.2829112472621106, 0.29759709429543324, 0.3113566078094786, 0.32411576914360685, 0.3358303869387285, 0.3464812626911567, 0.3560701241483372, 0.36461620974517456, 0.3721533994839044, 0.3787277984610016, 0.3843956878539274, 0.38922176498729605, 0.3932775998591539, 0.3966402410610961, 0.3993909101971981, 0.40161373147132134, 0.4033944527453447, 0.4048191265634893, 0.4059727345754849, 0.4069377562083135, 0.40779270148298774, 0.4086106470470444, 0.40945783169665917, 0.41039238042939397, 0.4114632319792076, 0.41270934200223286, 0.41415922189250004, 0.415830852401074, 0.41773198416064267, 0.4198608074580476, 0.42220694528064795, 0.4247527006367887, 0.4274744742199529 ], [ 0.16818826744425813, 0.1588973143103632, 0.15108754116672254, 0.14504282569496105, 0.14113435106028865, 0.1397785350098565, 0.1413380504220567, 0.1459998555280969, 0.15369542573564957, 0.1641081565403768, 0.17675317046026506, 0.19107715648747445, 0.20653662039279544, 0.22264255190871357, 0.23897828570379803, 0.2552014959469736, 0.271038656207155, 0.2862767860688713, 0.3007548423375243, 0.3143557449577273, 0.32699936342370206, 0.33863649869169077, 0.34924378287393437, 0.3588193843435999, 0.36737940245157596, 0.3749548433260206, 0.3815890778862056, 0.38733569233900456, 0.3922566493971808, 0.39642068552820514, 0.39990187630806023, 0.4027783091105778, 0.4051308105909315, 0.40704168631392484, 0.40859344184851193, 0.4098674688295849, 0.4109426956026932, 0.41189421933831855, 0.41279195360420784, 0.4136993405099438, 0.41467218760464924, 0.4157576947070944, 0.41699373328478906, 0.41840843033531583, 0.4200200906701897, 0.4218374680593934, 0.4238603698782756, 0.42608055519063837, 0.4284828658738495, 0.43104651687723716 ], [ 0.18293284341914634, 0.17405569797025852, 0.16652794735127424, 0.16060626015341864, 0.15662203308954262, 0.15494778404146944, 0.15591999607947218, 0.15974083569819714, 0.16640411766718383, 0.17568333256581958, 0.18718189832880516, 0.20041273480814556, 0.214871598998146, 0.23008667887419554, 0.24564410575314233, 0.26119644243415885, 0.2764614883315162, 0.2912165400681937, 0.3052910685646499, 0.31855930528950244, 0.3309333964209828, 0.3423573570420698, 0.3528018563769531, 0.36225977839043927, 0.37074246982326475, 0.37827657980731916, 0.3849013972866562, 0.3906665981550433, 0.39563032070560605, 0.3998574948515165, 0.4034183576090123, 0.4063870948747967, 0.4088405580354104, 0.41085701384974993, 0.41251489764627625, 0.4138915532298715, 0.4150619577105611, 0.416097445034104, 0.4170644571526176, 0.41802336498257797, 0.4190274108206599, 0.4201218280817507, 0.4213431918982618, 0.42271904488496737, 0.4242678268670878, 0.42599911728059214, 0.42791417679840393, 0.4300067534183797, 0.432264100515985, 0.43466814229982403 ], [ 0.1992265999478382, 0.1908991553919734, 0.18381172980630284, 0.1781920695560091, 0.17432684027710757, 0.17253465836366094, 0.1731079653882353, 0.17623859120945556, 0.18195662356304468, 0.1901100472311046, 0.20039137332113516, 0.2123940073756711, 0.22567313437309078, 0.23979373061701845, 0.25436041852958563, 0.26903173677246905, 0.2835238901517945, 0.29760850972493547, 0.3111075422087862, 0.32388712135721626, 0.33585140809329395, 0.3469368688852276, 0.35710717763102084, 0.3663487797058849, 0.37466708575759766, 0.3820832312322145, 0.38863132584072957, 0.3943561150409389, 0.39931097805309523, 0.40355619161120476, 0.40715739463349687, 0.41018419603805584, 0.41270887611849943, 0.4148051414143485, 0.4165469039912345, 0.4180070684410778, 0.4192563234012016, 0.42036194831298457, 0.42138665948141407, 0.4223875309552536, 0.4234150338897872, 0.42451224155407496, 0.42571424507056366, 0.4270478170588297, 0.4285313471665362, 0.43017505642569637, 0.43198147855174385, 0.43394617810400654, 0.4360586601312912, 0.43830341529678696 ], [ 0.21654683073840794, 0.20884098725075778, 0.2022791041679783, 0.1970607210824546, 0.19342926590928855, 0.19165039957211058, 0.1919688339675859, 0.19455358870867817, 0.19945060752311816, 0.20656130808771048, 0.21565415827800727, 0.22640148837931925, 0.2384257276038255, 0.2513410825069022, 0.26478361071656165, 0.2784289401007033, 0.2920001646597964, 0.3052691897057753, 0.318054281658946, 0.33021574029870554, 0.34165088036896957, 0.3522889926503465, 0.362086627570071, 0.37102335137109704, 0.37909801657468956, 0.3863255305080069, 0.39273407642463143, 0.39836272850021864, 0.4032593975710122, 0.40747904502318705, 0.41108210574307097, 0.41413306655770366, 0.4166991537409172, 0.418849091791869, 0.4206519057217468, 0.42217575033046834, 0.42348676204595187, 0.4246479412065629, 0.42571808430142927, 0.42675079554518797, 0.4277936140778434, 0.42888729598700726, 0.43006528852992243, 0.4313534272146855, 0.4327698752875713, 0.4343253108454801, 0.43602335095638395, 0.43786118678774205, 0.43983039069064994, 0.44191784693854574 ], [ 0.23443835981133823, 0.22738112583744594, 0.2213794908172437, 0.2166066716725566, 0.21326711799999865, 0.21157918872600193, 0.21174320866717738, 0.21390167502258212, 0.21810369507072647, 0.2242858568462478, 0.23227554307192963, 0.24181373523726676, 0.252588123567448, 0.2642665949310404, 0.27652447399247865, 0.28906309546663417, 0.30162026952819676, 0.31397453281528853, 0.32594524766178007, 0.33739024529153777, 0.34820221717484434, 0.35830463033675164, 0.3676476277582084, 0.37620416470936696, 0.38396649952845485, 0.3909430777191677, 0.39715580221740887, 0.40263765740984714, 0.40743064183502564, 0.4115839595389987, 0.41515241992068974, 0.4181949989718966, 0.4207735202098572, 0.42295142082297027, 0.4247925772685024, 0.426360174441112, 0.42771561313067596, 0.428917461194584, 0.4300204638887732, 0.43107463720248207, 0.4321244738613828, 0.43320829405987893, 0.43435777140689635, 0.4355976589200236, 0.4369457306206929, 0.4384129423429332, 0.4400038021603379, 0.4417169279524424, 0.44354575860366163, 0.4454793773739799 ], [ 0.2525202150885234, 0.24610895296610472, 0.24066967976406875, 0.23635170147815507, 0.2333255918057563, 0.23176940815620578, 0.23184505453738688, 0.23366942941742563, 0.237288139129688, 0.24265973601187404, 0.2496550401628582, 0.2580707929974894, 0.26765254875177175, 0.27812024803819907, 0.28919116706894665, 0.30059739899774673, 0.3120972670039361, 0.32348144339061463, 0.3345750828259502, 0.3452372761607278, 0.355358890186668, 0.364859565786407, 0.37368438954773214, 0.3818005579788354, 0.389194216109398, 0.3958675610931692, 0.4018362433946193, 0.4071270626636412, 0.4117759348437025, 0.4158260962702939, 0.41932650617490136, 0.4223304090355986, 0.42489402132620513, 0.4270753126023026, 0.42893285795733377, 0.43052474719827055, 0.4319075451100761, 0.4331353062897336, 0.4342586565127882, 0.4353239596512195, 0.4363725939990416, 0.43744036381100976, 0.4385570705022268, 0.43974626324087823, 0.44102518097229726, 0.4424048880395878, 0.443890594638423, 0.44548214264438757, 0.4471746281189277, 0.44895912503405244 ], [ 0.2704818513331994, 0.2646951585778002, 0.25980032814989057, 0.2559253422377439, 0.25321193439488127, 0.2518046763118449, 0.2518334431578272, 0.25339245521146053, 0.25652096625219983, 0.26119080934795685, 0.2673040939195644, 0.2747011936559837, 0.283176283471161, 0.2924962702160658, 0.3024192211109652, 0.312709692075007, 0.3231498554064901, 0.33354647043068864, 0.3437343723790665, 0.35357736461294664, 0.362967354661195, 0.37182241819410894, 0.380084295968895, 0.38771566982203426, 0.39469743898526644, 0.40102612700435725, 0.4067114865100337, 0.4117743272351709, 0.41624456608049437, 0.4201594821650549, 0.42356215140833114, 0.42650003204592263, 0.42902367307532147, 0.43118552093455537, 0.43303880498712416, 0.43463648900704205, 0.4360302832432595, 0.4372697191780139, 0.4384012961139304, 0.4394677145385575, 0.44050721516448094, 0.4415530440909927, 0.44263306335940394, 0.4437695222575063, 0.4449789983909291, 0.4462725094305287, 0.4476557874683728, 0.44912969909715594, 0.45069078666389306, 0.45233190045124694 ], [ 0.2880756127287848, 0.28288073400342895, 0.27850073956872506, 0.2750448481832424, 0.27263053792722053, 0.2713749388988365, 0.271381778952599, 0.27272609937279524, 0.27544008639219925, 0.27950345851939284, 0.2848407390650296, 0.29132584787690746, 0.29879257188229524, 0.307048337904598, 0.31588856522779807, 0.3251094877724685, 0.3345182560886942, 0.3439399729136559, 0.3532218925420922, 0.3622353055613103, 0.3708757076070475, 0.3790618027165895, 0.3867337894392506, 0.3938512652005857, 0.4003909835420518, 0.4063446176866417, 0.4117166228450313, 0.4165222460266008, 0.42078570227105755, 0.42453851682863386, 0.4278180211680229, 0.4306659847126513, 0.43312736237766, 0.43524913918750613, 0.43707925665008984, 0.43866561045275937, 0.4400551148005795, 0.4412928347245049, 0.4424211933289901, 0.443479265617697, 0.44450217367878003, 0.4455205991916204, 0.44656042818560765, 0.4476425397337037, 0.4487827450660538, 0.4499918769658164, 0.4512760219805172, 0.4526368807639736, 0.45407223554990883, 0.4555764990046657 ], [ 0.30510850474926565, 0.30046629972598216, 0.2965652730394005, 0.29349829906473013, 0.2913626070421295, 0.29025300972857393, 0.29025214510392483, 0.29141927636823983, 0.2937798850571895, 0.29731835140645213, 0.301975355641067, 0.30765047724770894, 0.31420925605909517, 0.3214931345087768, 0.32933043091645287, 0.33754673728698253, 0.3459736653492794, 0.3544554399226181, 0.3628533002566919, 0.37104796055171635, 0.3789405148004877, 0.3864521938129557, 0.3935233413147348, 0.40011190771505667, 0.4061916872926416, 0.411750458951434, 0.4167881369505056, 0.42131499668886174, 0.4253500104261496, 0.4289193068172529, 0.4320547544065361, 0.4347926610981361, 0.43717257774045704, 0.43923619326563784, 0.4410263104503842, 0.44258589459525055, 0.44395719161718517, 0.4451809166172714, 0.44629551834969433, 0.4473365286415463, 0.44833600822476727, 0.44932210128167294, 0.4503187100751503, 0.451345298334445, 0.4524168278143373, 0.4535438270570533, 0.4547325854320451, 0.4559854596535708, 0.4573012748089155, 0.45867579799652236 ], [ 0.32143443090979346, 0.31730269281825474, 0.31384200098132525, 0.31113110301858676, 0.3092504013700127, 0.3082766337496046, 0.3082755475218028, 0.30929365102441037, 0.3113505516018178, 0.3144334263608185, 0.3184947694428934, 0.3234538420505214, 0.329201464087854, 0.33560718175492277, 0.3425275724489345, 0.34981450919153134, 0.35732249417132134, 0.3649145425944154, 0.37246643927540724, 0.37986944051355115, 0.38703164051152483, 0.3938782818026957, 0.40035129016873694, 0.4064082821760052, 0.4120212470499883, 0.4171750563644888, 0.4218659114944522, 0.4260998027026921, 0.42989102560329884, 0.4332607799458941, 0.43623586112655677, 0.4388474454046008, 0.44112996442744673, 0.44312006241579843, 0.4448556294489359, 0.4463749060301513, 0.44771565689243165, 0.4489144152603683, 0.45000580199205426, 0.451021926708663, 0.4519918797748417, 0.45294132451892877, 0.45389219821477916, 0.45486252808648364, 0.4558663651152194, 0.4569138340528201, 0.45801129322631084, 0.4591615929574025, 0.46036441721613425, 0.46161668989638516 ], [ 0.3369472116778412, 0.3332828813100639, 0.3302233636920904, 0.3278352704093178, 0.32618506020097654, 0.32533486194473477, 0.3253369516891523, 0.3262276471006435, 0.32802165004654743, 0.33070788971075554, 0.33424766836296965, 0.33857545941942807, 0.34360219305158013, 0.34922043968352634, 0.3553106678452461, 0.36174773186234693, 0.36840688954476924, 0.37516888013179206, 0.38192383197692975, 0.38857396718355075, 0.3950352055619786, 0.40123784406364604, 0.40712651322069654, 0.4126596052449979, 0.4178083436739171, 0.42255563239240596, 0.426894789298071, 0.430828240552651, 0.4343662269328884, 0.4375255546327059, 0.44032840866495143, 0.44280123714007397, 0.4449737084380731, 0.4468777399242436, 0.4485465957239609, 0.45001405155950486, 0.45131362620622306, 0.4524778812334297, 0.453537792887615, 0.45452220183394476, 0.4554573476486153, 0.4563664951946484, 0.45726965917920387, 0.4581834312769075, 0.45912091134341815, 0.4600917406921455, 0.46110223151224816, 0.4621555826616829, 0.4632521686625837, 0.4643898860876339 ], [ 0.3515743954207608, 0.3483350289051693, 0.3456384088492002, 0.34354077078226714, 0.34209703842458833, 0.3413575430841311, 0.34136384225703476, 0.34214417858172624, 0.34370928967443404, 0.3460492920166955, 0.34913220325716027, 0.35290437748608167, 0.3572927891454426, 0.36220880496506663, 0.36755289739738023, 0.37321970157529666, 0.37910288260419744, 0.38509941729031655, 0.39111305587134904, 0.39705687725059824, 0.40285496457777203, 0.4084433008556131, 0.4137700207362383, 0.4187951636484771, 0.42349006445960424, 0.4278364991986655, 0.43182568095079893, 0.4354571787534574, 0.4387378123801425, 0.4416805592929761, 0.44430349703728117, 0.44662879476234363, 0.4486817609860641, 0.45048995068862, 0.45208233280980215, 0.45348851873445656, 0.45473805290228625, 0.45585976782456583, 0.4568812071210265, 0.4578281213436665, 0.45872404203263284, 0.45958993943618687, 0.4604439685036483, 0.46130130611713127, 0.462174080163908, 0.4630713881622532, 0.46399940000734446, 0.464961536304656, 0.4659587110072206, 0.4669896249288546 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.000324392 (SEM: 0)
x1: 0.913539
x2: 0.451657
x3: 0.0361037
x4: 0.494959
x5: 0.926987
x6: 0.844505", "Arm 10_0
hartmann6: -0.0122085 (SEM: 0)
x1: 0.733783
x2: 0.2324
x3: 0.691818
x4: 0.418272
x5: 0.918006
x6: 0.199997", "Arm 11_0
hartmann6: -0.025104 (SEM: 0)
x1: 0.793316
x2: 0.409269
x3: 0.130285
x4: 0.66826
x5: 0.708578
x6: 0.215471", "Arm 12_0
hartmann6: -0.660737 (SEM: 0)
x1: 0.0294209
x2: 0.699927
x3: 0.607533
x4: 0.298354
x5: 0.467813
x6: 0.524664", "Arm 13_0
hartmann6: -0.749792 (SEM: 0)
x1: 0.0339181
x2: 0.697664
x3: 0.578632
x4: 0.293918
x5: 0.425533
x6: 0.503699", "Arm 14_0
hartmann6: -0.81251 (SEM: 0)
x1: 0.0309133
x2: 0.693369
x3: 0.536587
x4: 0.286185
x5: 0.353296
x6: 0.470318", "Arm 15_0
hartmann6: -0.749924 (SEM: 0)
x1: 0.0943699
x2: 0.726697
x3: 0.496596
x4: 0.333808
x5: 0.349024
x6: 0.464961", "Arm 16_0
hartmann6: -0.917311 (SEM: 0)
x1: 0.0345985
x2: 0.622082
x3: 0.517693
x4: 0.229542
x5: 0.365355
x6: 0.433537", "Arm 17_0
hartmann6: -0.897126 (SEM: 0)
x1: 0.0690146
x2: 0.570054
x3: 0.521212
x4: 0.182726
x5: 0.370583
x6: 0.38587", "Arm 18_0
hartmann6: -0.997869 (SEM: 0)
x1: 0.0224459
x2: 0.581894
x3: 0.437783
x4: 0.214504
x5: 0.383952
x6: 0.447136", "Arm 19_0
hartmann6: -1.35577 (SEM: 0)
x1: 1.227e-17
x2: 0.5153
x3: 0.408581
x4: 0.212934
x5: 0.370364
x6: 0.505413", "Arm 1_0
hartmann6: -0.0866908 (SEM: 0)
x1: 0.0670579
x2: 0.745941
x3: 0.830122
x4: 0.15338
x5: 0.963321
x6: 0.665076", "Arm 20_0
hartmann6: -1.79651 (SEM: 0)
x1: 5.76228e-17
x2: 0.460474
x3: 0.427233
x4: 0.2176
x5: 0.322838
x6: 0.55308", "Arm 21_0
hartmann6: -2.12203 (SEM: 0)
x1: 0.00266606
x2: 0.396277
x3: 0.44834
x4: 0.226385
x5: 0.255893
x6: 0.613576", "Arm 22_0
hartmann6: -2.02723 (SEM: 0)
x1: 2.97138e-18
x2: 0.355183
x3: 0.465979
x4: 0.15732
x5: 0.241953
x6: 0.658216", "Arm 23_0
hartmann6: -2.15614 (SEM: 0)
x1: 1.00082e-18
x2: 0.35846
x3: 0.459722
x4: 0.3055
x5: 0.22781
x6: 0.620258", "Arm 2_0
hartmann6: -0.0964861 (SEM: 0)
x1: 0.776879
x2: 0.544803
x3: 0.893388
x4: 0.526455
x5: 0.0247847
x6: 0.522538", "Arm 3_0
hartmann6: -0.0226533 (SEM: 0)
x1: 0.868321
x2: 0.616498
x3: 0.060225
x4: 0.784603
x5: 0.437796
x6: 0.648229", "Arm 4_0
hartmann6: -0.455317 (SEM: 0)
x1: 0.0295862
x2: 0.712975
x3: 0.673364
x4: 0.2787
x5: 0.546706
x6: 0.572797", "Arm 5_0
hartmann6: -0.0820583 (SEM: 0)
x1: 0.940208
x2: 0.376252
x3: 0.572658
x4: 0.951143
x5: 0.0375807
x6: 0.675014", "Arm 6_0
hartmann6: -0.00508165 (SEM: 0)
x1: 0.532947
x2: 0.193913
x3: 0.037903
x4: 0.612183
x5: 0.84777
x6: 0.69808", "Arm 7_0
hartmann6: -0.0143312 (SEM: 0)
x1: 0.272457
x2: 0.745856
x3: 0.0350414
x4: 0.0441846
x5: 0.984514
x6: 0.436884", "Arm 8_0
hartmann6: -0.0192023 (SEM: 0)
x1: 0.855132
x2: 0.449664
x3: 0.376137
x4: 0.748953
x5: 0.242862
x6: 0.0210967", "Arm 9_0
hartmann6: -0.0161106 (SEM: 0)
x1: 0.812203
x2: 0.185297
x3: 0.470112
x4: 0.351848
x5: 0.722785
x6: 0.24327" ], "type": "scatter", "x": [ 0.9135386347770691, 0.7337829982861876, 0.7933162953704596, 0.02942091033674606, 0.0339181322098983, 0.030913331319184927, 0.09436994425524847, 0.03459851662454937, 0.06901455588860919, 0.022445891448422878, 1.2270045866631363e-17, 0.06705788988620043, 5.76227517504468e-17, 0.002666055860965702, 2.971375399718648e-18, 1.000815292059094e-18, 0.7768792184069753, 0.8683210778981447, 0.0295861829072237, 0.9402077402919531, 0.5329465735703707, 0.2724571879953146, 0.8551319520920515, 0.8122031195089221 ], "xaxis": "x", "y": [ 0.45165741443634033, 0.23239983338862658, 0.4092694194987416, 0.6999267532650528, 0.6976643181539205, 0.6933691073100374, 0.7266974168411402, 0.6220815194320153, 0.5700538669109682, 0.5818942118229382, 0.5152998038428113, 0.7459413688629866, 0.46047354211965513, 0.396276904826305, 0.3551830077687591, 0.35845967662583755, 0.5448026554659009, 0.6164981173351407, 0.7129745045676827, 0.376251932233572, 0.19391339737921953, 0.7458564909175038, 0.4496642220765352, 0.1852972898632288 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.000324392 (SEM: 0)
x1: 0.913539
x2: 0.451657
x3: 0.0361037
x4: 0.494959
x5: 0.926987
x6: 0.844505", "Arm 10_0
hartmann6: -0.0122085 (SEM: 0)
x1: 0.733783
x2: 0.2324
x3: 0.691818
x4: 0.418272
x5: 0.918006
x6: 0.199997", "Arm 11_0
hartmann6: -0.025104 (SEM: 0)
x1: 0.793316
x2: 0.409269
x3: 0.130285
x4: 0.66826
x5: 0.708578
x6: 0.215471", "Arm 12_0
hartmann6: -0.660737 (SEM: 0)
x1: 0.0294209
x2: 0.699927
x3: 0.607533
x4: 0.298354
x5: 0.467813
x6: 0.524664", "Arm 13_0
hartmann6: -0.749792 (SEM: 0)
x1: 0.0339181
x2: 0.697664
x3: 0.578632
x4: 0.293918
x5: 0.425533
x6: 0.503699", "Arm 14_0
hartmann6: -0.81251 (SEM: 0)
x1: 0.0309133
x2: 0.693369
x3: 0.536587
x4: 0.286185
x5: 0.353296
x6: 0.470318", "Arm 15_0
hartmann6: -0.749924 (SEM: 0)
x1: 0.0943699
x2: 0.726697
x3: 0.496596
x4: 0.333808
x5: 0.349024
x6: 0.464961", "Arm 16_0
hartmann6: -0.917311 (SEM: 0)
x1: 0.0345985
x2: 0.622082
x3: 0.517693
x4: 0.229542
x5: 0.365355
x6: 0.433537", "Arm 17_0
hartmann6: -0.897126 (SEM: 0)
x1: 0.0690146
x2: 0.570054
x3: 0.521212
x4: 0.182726
x5: 0.370583
x6: 0.38587", "Arm 18_0
hartmann6: -0.997869 (SEM: 0)
x1: 0.0224459
x2: 0.581894
x3: 0.437783
x4: 0.214504
x5: 0.383952
x6: 0.447136", "Arm 19_0
hartmann6: -1.35577 (SEM: 0)
x1: 1.227e-17
x2: 0.5153
x3: 0.408581
x4: 0.212934
x5: 0.370364
x6: 0.505413", "Arm 1_0
hartmann6: -0.0866908 (SEM: 0)
x1: 0.0670579
x2: 0.745941
x3: 0.830122
x4: 0.15338
x5: 0.963321
x6: 0.665076", "Arm 20_0
hartmann6: -1.79651 (SEM: 0)
x1: 5.76228e-17
x2: 0.460474
x3: 0.427233
x4: 0.2176
x5: 0.322838
x6: 0.55308", "Arm 21_0
hartmann6: -2.12203 (SEM: 0)
x1: 0.00266606
x2: 0.396277
x3: 0.44834
x4: 0.226385
x5: 0.255893
x6: 0.613576", "Arm 22_0
hartmann6: -2.02723 (SEM: 0)
x1: 2.97138e-18
x2: 0.355183
x3: 0.465979
x4: 0.15732
x5: 0.241953
x6: 0.658216", "Arm 23_0
hartmann6: -2.15614 (SEM: 0)
x1: 1.00082e-18
x2: 0.35846
x3: 0.459722
x4: 0.3055
x5: 0.22781
x6: 0.620258", "Arm 2_0
hartmann6: -0.0964861 (SEM: 0)
x1: 0.776879
x2: 0.544803
x3: 0.893388
x4: 0.526455
x5: 0.0247847
x6: 0.522538", "Arm 3_0
hartmann6: -0.0226533 (SEM: 0)
x1: 0.868321
x2: 0.616498
x3: 0.060225
x4: 0.784603
x5: 0.437796
x6: 0.648229", "Arm 4_0
hartmann6: -0.455317 (SEM: 0)
x1: 0.0295862
x2: 0.712975
x3: 0.673364
x4: 0.2787
x5: 0.546706
x6: 0.572797", "Arm 5_0
hartmann6: -0.0820583 (SEM: 0)
x1: 0.940208
x2: 0.376252
x3: 0.572658
x4: 0.951143
x5: 0.0375807
x6: 0.675014", "Arm 6_0
hartmann6: -0.00508165 (SEM: 0)
x1: 0.532947
x2: 0.193913
x3: 0.037903
x4: 0.612183
x5: 0.84777
x6: 0.69808", "Arm 7_0
hartmann6: -0.0143312 (SEM: 0)
x1: 0.272457
x2: 0.745856
x3: 0.0350414
x4: 0.0441846
x5: 0.984514
x6: 0.436884", "Arm 8_0
hartmann6: -0.0192023 (SEM: 0)
x1: 0.855132
x2: 0.449664
x3: 0.376137
x4: 0.748953
x5: 0.242862
x6: 0.0210967", "Arm 9_0
hartmann6: -0.0161106 (SEM: 0)
x1: 0.812203
x2: 0.185297
x3: 0.470112
x4: 0.351848
x5: 0.722785
x6: 0.24327" ], "type": "scatter", "x": [ 0.9135386347770691, 0.7337829982861876, 0.7933162953704596, 0.02942091033674606, 0.0339181322098983, 0.030913331319184927, 0.09436994425524847, 0.03459851662454937, 0.06901455588860919, 0.022445891448422878, 1.2270045866631363e-17, 0.06705788988620043, 5.76227517504468e-17, 0.002666055860965702, 2.971375399718648e-18, 1.000815292059094e-18, 0.7768792184069753, 0.8683210778981447, 0.0295861829072237, 0.9402077402919531, 0.5329465735703707, 0.2724571879953146, 0.8551319520920515, 0.8122031195089221 ], "xaxis": "x2", "y": [ 0.45165741443634033, 0.23239983338862658, 0.4092694194987416, 0.6999267532650528, 0.6976643181539205, 0.6933691073100374, 0.7266974168411402, 0.6220815194320153, 0.5700538669109682, 0.5818942118229382, 0.5152998038428113, 0.7459413688629866, 0.46047354211965513, 0.396276904826305, 0.3551830077687591, 0.35845967662583755, 0.5448026554659009, 0.6164981173351407, 0.7129745045676827, 0.376251932233572, 0.19391339737921953, 0.7458564909175038, 0.4496642220765352, 0.1852972898632288 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:43.353815Z", "iopub.status.busy": "2022-08-17T19:15:43.353568Z", "iopub.status.idle": "2022-08-17T19:15:43.761613Z", "shell.execute_reply": "2022-08-17T19:15:43.760990Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:43] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0591888155752314, 1.0524395831163893, 1.0460448148392831, 1.0400385438224218, 1.0344549054207588, 1.0293278904809482, 1.0246910745622135, 1.020577324116933, 1.017018481288894, 1.01404502980436, 1.0116857453533854, 1.0099673348658444, 1.0089140701433954, 1.0085474223627784, 1.0088857049485593, 1.0099437331432393, 1.0117325091921265, 1.0142589423297221, 1.0175256126423382, 1.0215305873591507, 1.0262672971958033, 1.0317244790761035, 1.0378861899353236, 1.044731894405333, 1.0522366270222465, 1.0603712271995835, 1.06910264261455, 1.0783942939679583, 1.0882064914957539, 1.098496891413022, 1.1092209789659468, 1.1203325642023987, 1.1317842770527105, 1.1435280497604146, 1.1555155768684424, 1.167698745496938, 1.180030031177203, 1.1924628567323883, 1.204951913434197, 1.2174534448572258, 1.2299254945429838, 1.2423281188852262, 1.2546235666926446, 1.2667764268035506, 1.2787537450210817, 1.2905251115730556, 1.3020627203095254, 1.3133414009377637, 1.3243386257445369, 1.3350344924449347 ], [ 1.0577853969001672, 1.051010675811208, 1.044594090374316, 1.0385700977815664, 1.0329732641527403, 1.0278380132521137, 1.0231983503961661, 1.019087562463395, 1.0155378956468457, 1.0125802134443422, 1.0102436383539046, 1.0085551818131049, 1.0075393680542384, 1.0072178586867033, 1.0076090858873366, 1.008727902986702, 1.0105852618842048, 1.0131879270131443, 1.016538235436979, 1.0206339120557038, 1.0254679478464057, 1.0310285476031846, 1.037299151845602, 1.0442585354922203, 1.0518809835824987, 1.0601365417950637, 1.0689913367879629, 1.0784079585796662, 1.0883458945061892, 1.098762002036397, 1.1096110062458562, 1.1208460073137474, 1.1324189841246493, 1.144281281818227, 1.156384073632549, 1.1686787902156806, 1.1811175123195252, 1.1936533251126402, 1.206240634072312, 1.2188354435040412, 1.2313955992685452, 1.243880997419083, 1.2562537603310098, 1.2684783816893757, 1.2805218414994781, 1.292353692166138, 1.3039461166761817, 1.3152739600115713, 1.3263147350943059, 1.3370486047865746 ], [ 1.056761509551077, 1.049972587495848, 1.0435453732371487, 1.0375147022041433, 1.0319155224142502, 1.026782638813319, 1.0221504320371555, 1.0180525524640083, 1.0145215911817749, 1.0115887303847555, 1.0092833767375813, 1.0076327823801223, 1.006661659459256, 1.0063917953016004, 1.0068416765026127, 1.0080261311979153, 1.0099559994878984, 1.0126378422961695, 1.016073698771313, 1.0202609016485313, 1.0251919587866154, 1.0308545074500428, 1.037231345905806, 1.044300544634456, 1.0520356369675647, 1.060405886282702, 1.0693766240429017, 1.0789096500602207, 1.0889636836086005, 1.0994948517416099, 1.1104571997584591, 1.1218032085040197, 1.1334843041875227, 1.1454513485145603, 1.1576550997840371, 1.1700466387267927, 1.182577755789453, 1.1952012989495857, 1.2078714828119295, 1.2205441606755667, 1.233177061598968, 1.2457299944102533, 1.2581650203095143, 1.2704465953553428, 1.2825416838355328, 1.2944198433560634, 1.3060532824614743, 1.3174168917093574, 1.3284882493284629, 1.3392476028528981 ], [ 1.0561244091837976, 1.0493328884690147, 1.042906545463171, 1.0368805455277015, 1.0312901670299939, 1.0261705414341042, 1.0215563670960008, 1.0174815975941955, 1.0139791062046655, 1.0110803290557988, 1.008814890571828, 1.0072102160144993, 1.0062911372248677, 1.0060794989868929, 1.0065937746916038, 1.0078487010595616, 1.0098549424497045, 1.0126187956162835, 1.0161419455714822, 1.0204212824183636, 1.025448787653397, 1.031211496578345, 1.037691541224881, 1.0448662756955311, 1.0527084831382563, 1.0611866607331009, 1.0702653761084422, 1.079905685619127, 1.0900656021321702, 1.1007005977301296, 1.1117641254572526, 1.1232081442107003, 1.1349836322081428, 1.1470410769532657, 1.1593309328415666, 1.171804040955452, 1.1844120086783607, 1.197107549153133, 1.2098447821640983, 1.2225794987697887, 1.2352693921211184, 1.2478742565962209, 1.2603561568938542, 1.2726795682345722, 1.284811488442609, 1.2967215224798547, 1.3083819399844148, 1.3197677065036126, 1.3308564893604784, 1.3416286394037222 ], [ 1.0558799629503004, 1.049097691379854, 1.0426839601714952, 1.0366742139870138, 1.0311040074427185, 1.0260087410859866, 1.0214233704204685, 1.017382088776493, 1.0139179856243468, 1.0110626828896407, 1.008845952951532, 1.0072953232704966, 1.006435673964446, 1.006288836064568, 1.0068731995377114, 1.0082033413332572, 1.0102896845522225, 1.0131382001971696, 1.0167501627235545, 1.0211219697134408, 1.0262450344466438, 1.0321057580462836, 1.0386855853702264, 1.0459611460564822, 1.053904479215921, 1.062483337253317, 1.0716615612237756, 1.0813995170939952, 1.0916545795055583, 1.102381647497425, 1.1135336755548264, 1.1250622036276736, 1.1369178714695762, 1.1490509055446028, 1.1614115703322336, 1.1739505795223446, 1.1866194657812028, 1.1993709101239356, 1.2121590333208454, 1.2249396522759954, 1.2376705041647773, 1.2503114405734763, 1.2628245932021105, 1.2751745120663502, 1.2873282766850491, 1.2992555805155288, 1.3109287888947165, 1.322322970920436, 1.3334159060075057, 1.3441880662183978 ], [ 1.0560325836339828, 1.049271580299816, 1.0428823653089418, 1.036900609773336, 1.0313620880430407, 1.0263024097156395, 1.0217567241080403, 1.017759397959174, 1.0143436679555287, 1.0115412706663847, 1.0093820536446079, 1.0078935727776293, 1.007100682424233, 1.0070251263773058, 1.0076851391469073, 1.0090950683230446, 1.0112650296894192, 1.014200607149904, 1.0179026092583658, 1.0223668931313041, 1.027584264784608, 1.0335404625770923, 1.0402162276393436, 1.0475874621041472, 1.0556254727807988, 1.0642972947103084, 1.0735660858534413, 1.0833915811013004, 1.093730591092716, 1.104537529348982, 1.1157649504181086, 1.127364082363361, 1.139285339064843, 1.1514788011217743, 1.1638946580754663, 1.1764836085493509, 1.1891972181449881, 1.2019882371868953, 1.2148108815856602, 1.2276210803231615, 1.2403766926281918, 1.2530376971175048, 1.265566354305402, 1.2779273431369644, 1.2900878716912023, 1.3020177619676134, 1.3136895086932188, 1.3250783123125258, 1.3361620866817705, 1.346921442413072 ], [ 1.0565851768646959, 1.0498575539189479, 1.0435048426412625, 1.0375628856465524, 1.0320676182456947, 1.0270547966509396, 1.022559698135899, 1.018616793899189, 1.0152593962253202, 1.0125192825634508, 1.0104263003589802, 1.0090079578621023, 1.008289007664346, 1.0082910313078821, 1.0090320348630957, 1.0105260667277345, 1.012782869884976, 1.0158075812793843, 1.0196004906659535, 1.0241568701634258, 1.0294668838047354, 1.0355155837429035, 1.042282996642311, 1.0497443003934752, 1.0578700878244112, 1.0666267106631784, 1.0759766937100126, 1.0858792061187796, 1.0962905741053994, 1.1071648176698163, 1.1184541934524463, 1.1301097269242386, 1.1420817197106174, 1.1543202215985988, 1.1667754610308028, 1.179398231931018, 1.192140237938978, 1.2049543972246064, 1.2177951119627144, 1.230618506473445, 1.2433826372976609, 1.2560476774315796, 1.268576075891268, 1.2809326929208664, 1.2930849106056874, 1.305002718424753, 1.3166587733404962, 1.3280284343067066, 1.3390897714990884, 1.3498235510595613 ], [ 1.0575391026497494, 1.0508569842596978, 1.0445527635597198, 1.0386623977636416, 1.0332219222929753, 1.0282671753619352, 1.023833494097379, 1.0199553829336865, 1.0166661558873251, 1.0139975553736338, 1.0119793514853215, 1.0106389270983844, 1.0100008557692854, 1.0100864810651413, 1.010913507610637, 1.012495615581303, 1.0148421114260961, 1.0179576280537155, 1.021841887381515, 1.026489536909327, 1.0318900698401494, 1.038027835350396, 1.044882142143405, 1.052427454673152, 1.0606336776425085, 1.069466520728608, 1.0788879320802038, 1.0888565861045554, 1.0993284086591577, 1.1102571213525338, 1.1215947866256757, 1.13329233686369, 1.1453000738879002, 1.157568129352585, 1.1700468811089633, 1.1826873247446736, 1.195441402664951, 1.2082622949534065, 1.2211046768521487, 1.2339249472900018, 1.2466814318432513, 1.2593345622227845, 1.2718470331591505, 1.2841839366085557, 1.2963128726225641, 1.3082040360175757, 1.3198302780932232, 1.3311671429968104, 1.3421928788222965, 1.3528884240829433 ], [ 1.0588941521756996, 1.0522695919870146, 1.0460257629203153, 1.0401986780949122, 1.034824410328137, 1.0299388133093805, 1.025577213987294, 1.0217740769133201, 1.0185626421693557, 1.015974539593743, 1.0140393833167387, 1.0127843521150512, 1.012233762758489, 1.0124086452759227, 1.0133263307926403, 1.0150000641166526, 1.0174386543671339, 1.020646177415479, 1.0246217435414076, 1.0293593423600325, 1.034847774736563, 1.041070678201702, 1.0480066485646782, 1.0556294563052446, 1.0639083522064592, 1.0728084527903827, 1.0822911926001082, 1.092314827401325, 1.10283497020771, 1.1138051410145606, 1.125177311598498, 1.136902428871631, 1.1489309038990816, 1.1612130582694578, 1.1736995242823942, 1.1863415996033277, 1.1990915600541125, 1.211902935806694, 1.224730756506101, 1.2375317700887818, 1.2502646387118936, 1.2628901136852873, 1.2753711899251001, 1.2876732394256332, 1.2997641226542396, 1.3116142765991738, 1.3231967783708307, 1.33448738367366, 1.3454645400266798, 1.3561093752245992 ], [ 1.060648540506593, 1.054093439022819, 1.0479217317150542, 1.042169427328294, 1.0368725717499152, 1.0320669660133155, 1.0277878553005286, 1.0240695897044612, 1.0209452584150944, 1.0184463001072364, 1.016602093640831, 1.0154395347299137, 1.0149826059572675, 1.0152519493322032, 1.016264452384581, 1.01803286038088, 1.0205654284150143, 1.0238656276215456, 1.027931919356467, 1.0327576097375137, 1.0383307944063411, 1.0446343998965124, 1.0516463238341527, 1.0593396717130463, 1.067683083523174, 1.0766411393576305, 1.0861748294972886, 1.096242071582963, 1.1067982555946703, 1.117796796788603, 1.1291896777784898, 1.1409279636681122, 1.1529622782852857, 1.1652432345250077, 1.1777218167651915, 1.1903497174810314, 1.2030796330050098, 1.2158655246637358, 1.2286628514183047, 1.2414287790232692, 1.254122369074455, 1.2667047495776718, 1.2791392671675756, 1.2913916200284001, 1.3034299699786935, 1.3152250320481809, 1.3267501401075317, 1.3379812875985124, 1.3488971430407428, 1.359479040666161 ], [ 1.062798915439126, 1.0563249387593425, 1.0502368289057444, 1.0445705286298415, 1.0393619912551935, 1.034646895787762, 1.0304603329282453, 1.0268364627803663, 1.0238081459710502, 1.021406551036585, 1.0196607422944615, 1.0185972540061219, 1.0182396584043811, 1.0186081370338325, 1.0197190667036202, 1.021584632995788, 1.0242124854748123, 1.0276054492454905, 1.0317613070641756, 1.0366726646531772, 1.0423269091607217, 1.0487062669745622, 1.055787962618815, 1.0635444756245787, 1.0719438874680136, 1.0809503062673844, 1.090524353207806, 1.1006236918747065, 1.111203580099502, 1.1222174238440819, 1.1336173142839177, 1.145354532572966, 1.1573800114249533, 1.169644747938144, 1.182100167169294, 1.1946984400434615, 1.2073927617630575, 1.2201375978228266, 1.2328889042633164, 1.245604327343148, 1.2582433858916822, 1.270767637674983, 1.2831408294973419, 1.2953290296448623, 1.3073007407014021, 1.3190269906796057, 1.3304814007054697, 1.3416402280493225, 1.352482383989408, 1.3629894267253866 ], [ 1.0653403823893175, 1.0589588837270902, 1.0529655122518786, 1.0473960820607433, 1.0422863873297903, 1.0376719148501028, 1.033587527494857, 1.0300671194619357, 1.0271432450758495, 1.0248467240932178, 1.0232062278493625, 1.0222478522017386, 1.0219946850314843, 1.0224663779778553, 1.023678733969298, 1.0256433237898452, 1.0283671461383903, 1.0318523461313538, 1.0360960067108556, 1.041090025767331, 1.0468210889172611, 1.0532707439137343, 1.0604155779002806, 1.0682274935578684, 1.076674075091125, 1.0857190303703657, 1.0953226917441117, 1.105442555369081, 1.116033837660521, 1.1270500278984663, 1.1384434182629113, 1.1501655964842912, 1.1621678914201976, 1.174401767444261, 1.1868191686779799, 1.1993728180457621, 1.2120164784352307, 1.2247051838376009, 1.237395447509241, 1.2500454524257045, 1.262615227135332, 1.275066808027937, 1.287364387337479, 1.2994744450584583, 1.3113658624005702, 1.3230100143663288, 1.3343808393926393, 1.3454548846143366, 1.3562113260592215, 1.3666319638658628 ], [ 1.0682665447959094, 1.061988490130316, 1.056100587459725, 1.0506384588762536, 1.0456376722922145, 1.04113345176676, 1.0371603589271983, 1.0337519463974514, 1.0309403851017984, 1.0287560684920989, 1.0272271981621872, 1.0263793569554727, 1.0262350775018436, 1.0268134160559645, 1.0281295434157522, 1.030194366383226, 1.0330141944433842, 1.0365904668034627, 1.0409195543913983, 1.0459926496659462, 1.051795754081472, 1.0583097688933902, 1.0655106899790847, 1.0733699019152518, 1.0818545611870742, 1.0909280535844974, 1.1005505069863597, 1.1106793382018945, 1.1212698116336097, 1.1322755884608007, 1.1436492478604614, 1.1553427662451006, 1.1673079460390687, 1.179496791312307, 1.1918618327473243, 1.2043564081969942, 1.2169349071034534, 1.2295529872997872, 1.242167771548581, 1.2547380291185501, 1.2672243453258545, 1.2795892797419641, 1.2917975120082894, 1.3038159730470535, 1.31561395892706, 1.3271632246486553, 1.3384380555226305, 1.3494153144893777, 1.3600744645263447, 1.3703975661163483 ], [ 1.0715695591513992, 1.065405458237432, 1.059633274496237, 1.054288374382456, 1.0494060323703611, 1.0450211394862199, 1.0411678832398528, 1.0378793999537839, 1.0351874014586355, 1.033121779319638, 1.0317101911907167, 1.030977635549466, 1.0309460229073695, 1.0316337535301598, 1.0330553136056944, 1.0352209034646218, 1.0381361126431774, 1.0418016569989268, 1.0462131924820546, 1.051361218329981, 1.057231079325125, 1.0638030724446135, 1.0710526580305306, 1.0789507699641316, 1.0874642137610835, 1.0965561365456236, 1.1061865489892018, 1.116312876918548, 1.126890519722402, 1.1378733940914485, 1.1492144449707387, 1.1608661105475313, 1.1727807339836747, 1.1849109205546666, 1.197209843977619, 1.209631509301526, 1.222130981460967, 1.2346645885308192, 1.2471901072584213, 1.259666936157877, 1.2720562589068165, 1.284321198458248, 1.2964269604733705, 1.3083409635268777, 1.3200329530299144, 1.331475095860582, 1.3426420531470726, 1.3535110293643522, 1.3640617967468565, 1.3742766948786267 ], [ 1.0752402034307433, 1.0692000472281047, 1.063553289475094, 1.0583349775332456, 1.0535800257334897, 1.0493229225812863, 1.0455974098114107, 1.0424361343936732, 1.0398702755737923, 1.0379291502417232, 1.036639801360406, 1.0360265758489628, 1.0361107001515797, 1.0369098636497256, 1.0384378219509423, 1.0407040337150504, 1.0437133458093262, 1.0474657419411637, 1.051956169234699, 1.0571744553003106, 1.0631053251241234, 1.0697285226838589, 1.0770190368698935, 1.0849474255061893, 1.0934802255718008, 1.1025804326884288, 1.1122080290908625, 1.1223205370793654, 1.1328735746854584, 1.1438213921042353, 1.1551173712394063, 1.166714476040898, 1.1785656474566422, 1.1906241428576967, 1.2028438248369975, 1.2151794076721893, 1.2275866712062806, 1.2400226515628776, 1.252445816410473, 1.2648162300120775, 1.277095710625574, 1.2892479804215355, 1.3012388062499027, 1.3130361284352376, 1.3246101742942225, 1.335933553143956, 1.3469813300574132, 1.3577310763700217, 1.3681628958114573, 1.378259426020269 ], [ 1.0792679573966133, 1.0733611627719757, 1.0678489401558526, 1.0627659550402635, 1.0581466959447166, 1.0540251808135936, 1.0504346358620797, 1.0474071480902947, 1.0449732936783596, 1.0431617456898885, 1.041998865953449, 1.0415082876454937, 1.041710496916449, 1.0426224237946649, 1.044257054429363, 1.046623078296649, 1.0497245850473107, 1.053560825949732, 1.0581260541177397, 1.063409455720329, 1.0693951810805866, 1.0760624800878347, 1.0833859409572149, 1.091335825526146, 1.0998784885359956, 1.1089768633057615, 1.1185909924253645, 1.1286785800507502, 1.1391955423921045, 1.1500965351542614, 1.1613354408324148, 1.1728658043816753, 1.184641212078022, 1.1966156144374935, 1.2087435989857835, 1.220980621860717, 1.2332832084616998, 1.2456091328031351, 1.2579175833466447, 1.270169320479437, 1.2823268280551594, 1.2943544589743097, 1.3062185729338254, 1.317887663328924, 1.3293324698190443, 1.3405260731630395, 1.351443969435568, 1.3620641215021854, 1.3723669865168222, 1.3823355191034064 ], [ 1.08364109303224, 1.0778764553618805, 1.0725072328196175, 1.0675676474642075, 1.0630916979675207, 1.0591128657743392, 1.0556637944576404, 1.052775943620932, 1.050479219698556, 1.048801587220724, 1.0477686655449419, 1.0474033176903526, 1.047725239695247, 1.0487505607589855, 1.0504914661850755, 1.0529558566185115, 1.0561470580282935, 1.0600635970635992, 1.0646990555620799, 1.0700420159299189, 1.0760761057836088, 1.0827801457447268, 1.090128398893242, 1.098090914558477, 1.1066339534211411, 1.1157204759237551, 1.1253106723229296, 1.1353625108508107, 1.1458322807007468, 1.15667510898583, 1.1678454352054344, 1.1792974325353374, 1.1909853716100278, 1.2028639284547784, 1.2148884430031335, 1.2270151376349328, 1.2392013062107545, 1.2514054833620343, 1.2635876017997827, 1.2757091427281433, 1.287733281664443, 1.2996250295179608, 1.311351366934536, 1.322881368774604, 1.3341863151284408, 1.3452397853715063, 1.356017732274088, 1.366498533948239, 1.3766630223046061, 1.3864944875935246 ], [ 1.088346773197063, 1.0827324272575147, 1.077513988107428, 1.0727251745702495, 1.068399433668444, 1.0645696471623314, 1.0612678121761214, 1.0585246974050004, 1.0563694773984391, 1.0548293486253753, 1.053929132445371, 1.053690871713426, 1.054133429480463, 1.055272100022226, 1.057118244094785, 1.0596789616849591, 1.0629568163682286, 1.0669496254561524, 1.0716503291773831, 1.0770469500234956, 1.0831226500494002, 1.0898558894505865, 1.0972206844213248, 1.1051869565658563, 1.113720960543426, 1.1227857717857763, 1.1323418126201608, 1.142347393447794, 1.1527592460719833, 1.1635330288863006, 1.1746237881504342, 1.185986365409431, 1.1975757474169735, 1.2093473607834597, 1.221257318173512, 1.2332626256993688, 1.2453213620513082, 1.2573928390921714, 1.2694377515993343, 1.2814183211509078, 1.2932984363809057, 1.305043789397778, 1.3166220063320497, 1.3280027688475804, 1.33915792298701, 1.3500615718145446, 1.3606901488201342, 1.371022469807021, 1.3810397618644954, 1.3907256689226377 ], [ 1.0933711565216924, 1.0879145458180655, 1.0828539633350411, 1.0782225671672463, 1.074053193710402, 1.070378065235793, 1.0672284725817114, 1.0646344346048946, 1.06262433703317, 1.0612245545585053, 1.0604590614020148, 1.0603490371428161, 1.0609124762728974, 1.0621638116246865, 1.0641135633764616, 1.0667680265888495, 1.0701290109440875, 1.0741936463144865, 1.0789542667633303, 1.0843983834288047, 1.0905087534168971, 1.0972635474367587, 1.1046366137201493, 1.1125978301978239, 1.121113531500172, 1.130146992702428, 1.139658948424029, 1.1496081243918097, 1.1599517591750024, 1.1706460965171588, 1.1816468332318313, 1.1929095133930543, 1.2043898657136642, 1.2160440866729807, 1.2278290763618755, 1.2397026366723636, 1.2516236422507077, 1.2635521937816014, 1.2754497611425188, 1.2872793213278526, 1.2990054933260566, 1.3105946697504, 1.3220151432252756, 1.333237224409004, 1.34423334806361, 1.354978163656348, 1.365448607454841, 1.3756239538108146, 1.3854858441853075, 1.395018293345804 ], [ 1.0986995065553768, 1.0934073610129693, 1.088510978827231, 1.0840429027051406, 1.080035302819445, 1.0765196861064614, 1.073526581838804, 1.0710852052679054, 1.0692231021210346, 1.0679657779149072, 1.0673363174050534, 1.067355000995128, 1.0680389265237484, 1.069401646430574, 1.0714528317412855, 1.0741979754258453, 1.0776381482692778, 1.0817698202328314, 1.0865847591813729, 1.0920700166768729, 1.0982080072579832, 1.104976683348529, 1.1123498029234555, 1.1202972817148698, 1.1287856165809127, 1.137778362259076, 1.147236640638349, 1.1571196603640557, 1.1673852253005184, 1.1779902131200588, 1.1888910097572511, 1.2000438910688451, 1.2114053489750953, 1.222932364780738, 1.2345826365633372, 1.2463147700270507, 1.2580884429477432, 1.269864552499672, 1.2816053527972164, 1.293274587443531, 1.304837619257063, 1.3162615570387441, 1.327515377487648, 1.3385700392654534, 1.349398585728174, 1.3599762328902032, 1.3702804396269925, 1.3802909578187232, 1.3899898609616923, 1.3993615506245713 ], [ 1.1043163032471206, 1.099194624991192, 1.0944680459360314, 1.0901684420643618, 1.0863272656146536, 1.0829752568104638, 1.0801421331375125, 1.0778562581141382, 1.0761442924756046, 1.075030831842343, 1.0745380362539134, 1.0746852583900646, 1.0754886788047866, 1.0769609579719823, 1.0791109162489063, 1.0819432538377423, 1.0854583232743866, 1.0896519666991102, 1.094515428992905, 1.1000353556821456, 1.106193881305533, 1.1129688098107393, 1.1203338837545394, 1.1282591340050208, 1.1367112967775097, 1.1456542807187347, 1.1550496639094197, 1.1648571995070256, 1.1750353095362882, 1.1855415490403365, 1.1963330271229284, 1.2073667767689236, 1.2186000709696734, 1.229990687811925, 1.2414971311455787, 1.2530788158183972, 1.2646962271616773, 1.2763110636346096, 1.2878863696971956, 1.2993866635809614, 1.310778062136347, 1.3220284027261118, 1.3331073604368657, 1.3439865577914067, 1.354639663649148, 1.3650424779937018, 1.3751729997025897, 1.385011475042625, 1.3945404254151585, 1.4037446536897955 ], [ 1.1102053549704445, 1.1052594117496533, 1.100707494605795, 1.0965807652158435, 1.0929099104920372, 1.089724857459146, 1.087054467051442, 1.0849262089201335, 1.0833658202958452, 1.0823969530644173, 1.08204081447232, 1.0823158082421473, 1.0832371842852382, 1.0848167065513084, 1.087062349726058, 1.0899780363187996, 1.0935634259967595, 1.0978137686424003, 1.1027198313833968, 1.1082679076773063, 1.1144399134198375, 1.1212135710993711, 1.1285626784812044, 1.1364574535363523, 1.1448649427893869, 1.1537494764518648, 1.1630731511167918, 1.1727963198018527, 1.1828780699564685, 1.193276672660766, 1.2039499903461028, 1.2148558354139323, 1.2259522774216687, 1.2371979013113037, 1.2485520228690132, 1.2599748698472828, 1.2714277378687016, 1.2828731295468356, 1.2942748835767965, 1.3055982983227459, 1.3168102520986622, 1.3278793202493488, 1.3387758875126408, 1.3494722530789243, 1.3599427252552647, 1.3701637026145423, 1.380113738853742, 1.3897735891783065, 1.399126236758362, 1.408156898572755 ], [ 1.1163499094802136, 1.1115842351556005, 1.1072110986046317, 1.103260903737639, 1.099763529420141, 1.0967480482097969, 1.0942424254659835, 1.0922732010584528, 1.0908651568278838, 1.0900409740218386, 1.0898208861257421, 1.0902223337896704, 1.091259629853013, 1.092943643696997, 1.095281515187125, 1.0982764091573913, 1.1019273215742618, 1.1062289480430876, 1.1111716240520062, 1.1167413442127503, 1.1229198647619814, 1.1296848898440655, 1.1370103378362573, 1.144866679538844, 1.153221335859524, 1.1620391191356845, 1.1712826999014878, 1.1809130800664447, 1.190890054311514, 1.201172643988946, 1.2117194916499712, 1.2224892090177801, 1.2334406761310137, 1.2445332938431726, 1.255727195323601, 1.26698342432473, 1.2782640886754466, 1.2895324968908433, 1.300753284285942, 1.3118925329555944, 1.3229178878334464, 1.3337986690915844, 1.3445059796007475, 1.355012805138061, 1.3652941045101634, 1.3753268866928208, 1.3850902723758156, 1.3945655378334472, 1.4037361397114327, 1.4125877200407795 ], [ 1.1227327624036185, 1.1181511638288453, 1.1139601968367874, 1.110189468519542, 1.1068680119086212, 1.1040240092655744, 1.1016844972594313, 1.0998750563801811, 1.0986194878301625, 1.0979394821565158, 1.0978542850152249, 1.0983803666492509, 1.0995311028548347, 1.1013164763104646, 1.103742808037695, 1.1068125293161695, 1.1105240044425153, 1.1148714141653637, 1.119844708336205, 1.1254296342299543, 1.1316078441284265, 1.1383570822384508, 1.1456514470507553, 1.1534617211507354, 1.1617557566540897, 1.1704989012793874, 1.1796544479808746, 1.1891840903567898, 1.1990483668757574, 1.2092070792817624, 1.219619674081654, 1.2302455803316754, 1.2410445014430187, 1.251976662828071, 1.2630030204132487, 1.274085437042365, 1.2851868345049104, 1.2962713284801202, 1.3073043523789085, 1.3182527742556585, 1.3290850090093511, 1.3397711262941656, 1.3502829531138072, 1.3605941690812275, 1.3706803918010313, 1.3805192497269307, 1.3900904400773515, 1.3993757698594718, 1.4083591786598961, 1.4170267425245204 ], [ 1.1293363621020684, 1.124941931661316, 1.120935809463524, 1.1173467713471659, 1.1142029718234792, 1.1115316725844535, 1.109358954452612, 1.1077094152285314, 1.10660585674568, 1.1060689654080167, 1.1061169915393154, 1.1067654339717268, 1.1080267373806079, 1.1099100108465092, 1.112420776886337, 1.1155607606206224, 1.1193277287039254, 1.1237153870205348, 1.1287133448462894, 1.1343071511573561, 1.1404784060555277, 1.1472049469904608, 1.1544611057957437, 1.1622180288065067, 1.1704440488419736, 1.1791050949925368, 1.1881651242987272, 1.1975865588165693, 1.207330712360687, 1.2173581933526139, 1.2276292734351804, 1.238104215433943, 1.248743558339899, 1.259508360728751, 1.2703604069810008, 1.2812623825453227, 1.2921780252156712, 1.303072259077653, 1.3139113166690672, 1.3246628533111249, 1.3352960558193516, 1.345781746165414, 1.356092479320569, 1.3662026335679485, 1.3760884910474884, 1.3857283061586503, 1.3951023596211678, 1.4041929963967308, 1.4129846462173412, 1.4214638260721362 ], [ 1.1361429099825704, 1.1319380430268275, 1.1281187478730441, 1.1247129394106912, 1.1217478661204818, 1.119249844421693, 1.1172439780363799, 1.1157538649149865, 1.1148012950775494, 1.1144059436305584, 1.1145850641954576, 1.1153531889875254, 1.1167218427515038, 1.1186992786107561, 1.1212902445210753, 1.124495789327171, 1.128313117286093, 1.1327354992448082, 1.1377522473645016, 1.1433487583437136, 1.149506627541132, 1.1562038333474993, 1.1634149877947189, 1.1711116459819217, 1.1792626637570247, 1.187834590552111, 1.196792082638509, 1.2060983215735317, 1.2157154233625755, 1.2256048258051602, 1.2357276444126035, 1.2460449908145934, 1.2565182512604303, 1.2671093262076893, 1.2777808346887956, 1.2884962889057119, 1.2992202452452954, 1.3099184377174642, 1.320557898902022, 1.3311070721215996, 1.3415359170177192, 1.3518160092360025, 1.361920633698388, 1.3718248700539761, 1.3815056683852274, 1.3909419130794287, 1.4001144728990091, 1.4090062356237378, 1.4176021261158807, 1.4258891072053097 ], [ 1.143134455573733, 1.1391208719998531, 1.1354897178370755, 1.1322680221137607, 1.1294821049329782, 1.1271573182295969, 1.125317773119499, 1.1239860564542354, 1.123182939956219, 1.122927086152169, 1.1232347562182854, 1.1241195257574694, 1.125592015386658, 1.1276596437446715, 1.130326411047064, 1.1335927215153248, 1.1374552527941597, 1.141906879756494, 1.1469366588220924, 1.1525298770659798, 1.158668168008072, 1.1653296931623371, 1.17248938535888, 1.18011924677264, 1.1881886917781272, 1.196664922493703, 1.205513323447114, 1.2146978613834456, 1.2241814769328443, 1.233926456606929, 1.2438947762034087, 1.2540484098494313, 1.264349602212714, 1.2747611044554352, 1.2852463769603455, 1.2957697635002172, 1.3062966422733235, 1.3167935591517572, 1.327228347757434, 1.3375702398243141, 1.347789967968407, 1.357859861683482, 1.3677539362695672, 1.3774479735790388, 1.3869195929663765, 1.3961483106398012, 1.4051155856906856, 1.4138048513565473, 1.4222015304883087, 1.4302930346783942 ], [ 1.1502929859024127, 1.1464717551468435, 1.1430294154612906, 1.139992089852302, 1.1373851527686556, 1.1352329777792727, 1.1335586733998066, 1.1323838097294914, 1.1317281392709353, 1.1316093160823872, 1.1320426182272167, 1.1330406792973156, 1.134613235539074, 1.1367668957316701, 1.1395049413754583, 1.1428271648554098, 1.146729752965593, 1.1512052224436853, 1.1562424129240947, 1.1618265409679802, 1.1679393166128738, 1.17455912130628, 1.1816612433080869, 1.1892181638790158, 1.1971998850639867, 1.2055742878852218, 1.214307508508794, 1.2233643196059516, 1.2327085047652389, 1.2423032153731985, 1.252111301696521, 1.2620956126905987, 1.2722192619894424, 1.2824458602547997, 1.2927397162842071, 1.303066010802848, 1.313390947617226, 1.323681886834784, 1.3339074642909567, 1.3440377003683772, 1.3540441002510288, 1.363899746516788, 1.3735793839802457, 1.383059495944647, 1.3923183705465552, 1.4013361556755355, 1.4100949009892785, 1.4185785857701976, 1.4267731317244514, 1.434666400251637 ], [ 1.1576005089045696, 1.1539720776692484, 1.1507186157699425, 1.147865324682909, 1.1454366208343505, 1.1434558906451018, 1.1419452352447053, 1.1409252075443383, 1.1404145450162553, 1.1404299022377027, 1.1409855879924709, 1.1420933124431623, 1.1437619505387568, 1.145997328340059, 1.1488020392564124, 1.1521752972134687, 1.1561128334411745, 1.1606068428243035, 1.1656459845611962, 1.1712154402312611, 1.1772970303251935, 1.183869387940693, 1.1909081858381294, 1.1983864105748243, 1.2062746752104114, 1.214541560319805, 1.22315397195923, 1.2320775049434738, 1.2412768003626127, 1.2507158876463105, 1.2603585035217149, 1.27016838266865, 1.2801095174631816, 1.290146386622023, 1.300244154562603, 1.310368844704039, 1.3204874906815571, 1.3305682695599703, 1.3405806207212194, 1.3504953533276043, 1.3602847443032797, 1.3699226277955305, 1.3793844762040401, 1.3886474721862714, 1.3976905706017317, 1.406494549150496, 1.4150420464672737, 1.4233175866096925, 1.4313075891786353, 1.4390003646802807 ], [ 1.1650391307724075, 1.1616033528585517, 1.1585382539576274, 1.1558681030022067, 1.1536163507160813, 1.151805392402982, 1.1504563218746073, 1.1495886792154024, 1.1492201956858235, 1.1493665397097823, 1.1500410685489655, 1.1512545908987095, 1.1530151461975136, 1.1553278068662312, 1.1581945099175806, 1.1616139243349666, 1.1655813602500371, 1.1700887252033205, 1.1751245316275343, 1.1806739581564767, 1.1867189654817272, 1.1932384653451589, 1.2002085390011312, 1.2076026992760578, 1.2153921883841092, 1.2235463021154396, 1.2320327300628067, 1.2408179013087193, 1.2498673255000992, 1.2591459204467526, 1.2686183191618579, 1.27824915141363, 1.2880032971304725, 1.2978461111455921, 1.3077436205640682, 1.3176626973344838, 1.3275712093408745, 1.3374381535157238, 1.3472337741973008, 1.3569296693462705, 1.3664988864460943, 1.3759160090797742, 1.3851572344174368, 1.394200441243783, 1.4030252477441338, 1.411613058061322, 1.419947096616709, 1.4280124293242207, 1.4357959710752994, 1.4432864791923528 ], [ 1.1725911272770524, 1.169347294968123, 1.1664694994911016, 1.163981070511602, 1.1619044897940174, 1.1602611620413585, 1.159071178280855, 1.1583530744820216, 1.1581235886440955, 1.1583974201686347, 1.1591869959148884, 1.1605022478843785, 1.162350407951824, 1.1647358253986326, 1.1676598131547191, 1.1711205285566566, 1.1751128940332647, 1.1796285623961833, 1.1846559303261288, 1.190180202218452, 1.1961835048311482, 1.20264505124907, 1.2095413506596695, 1.2168464584758059, 1.2245322596041648, 1.2325687763055788, 1.2409244912649995, 1.249566676279001, 1.258461717410051, 1.2675754285084408, 1.2768733465518394, 1.2863210041254418, 1.295884176354097, 1.3055291014883268, 1.315222675953164, 1.3249326258605956, 1.3346276576997869, 1.3442775911612164, 1.3538534768876043, 1.3633277014820617, 1.3726740814659337, 1.3818679471853126, 1.3908862170168432, 1.3997074616928522, 1.4083119581941281, 1.416681732459374, 1.4248005901234724, 1.4326541345973454, 1.4402297720067383, 1.4475167027793274 ], [ 1.1802390092109187, 1.177185885714723, 1.1744938233530082, 1.172185209848874, 1.170281558873808, 1.168803289175951, 1.1677694975869684, 1.1671977285661541, 1.1671037434374414, 1.1675012929908692, 1.1684018976303254, 1.169814639720975, 1.1717459731811237, 1.174199555627024, 1.1771761084642547, 1.1806733101763611, 1.1846857276476368, 1.1892047896425566, 1.1942188055399061, 1.1997130311007023, 1.2056697814817259, 1.2120685899683568, 1.2188864090981562, 1.2260978491102161, 1.233675447125681, 1.2415899592801845, 1.2498106673056522, 1.2583056908752437, 1.2670422974057778, 1.275987201920519, 1.285106850914569, 1.294367685789289, 1.3037363831550415, 1.313180070963452, 1.3226665208632047, 1.3321643182629344, 1.3416430122722884, 1.3510732479774539, 1.3604268834400028, 1.369677093472168, 1.378798461739597, 1.3877670621752265, 1.3965605301427, 1.4051581233300747, 1.4135407720240762, 1.4216911182278895, 1.4295935430371718, 1.4372341817612675, 1.4446009264426491, 1.4516834156567688 ], [ 1.1879655821682131, 1.1851014346962463, 1.1825930587904234, 1.1804619013336062, 1.1787285125723757, 1.1774123337033395, 1.176531479589441, 1.1761025192214822, 1.1761402569853174, 1.1766575182509313, 1.177664943242856, 1.1791707935516138, 1.181180775965828, 1.18369788850212, 1.1867222935406285, 1.1902512227958724, 1.1942789184305833, 1.198796613931378, 1.2037925574050794, 1.2092520787411187, 1.2151577006627852, 1.2214892921286853, 1.2282242609406089, 1.235337780878047, 1.2428030473343599, 1.250591554391549, 1.2586733856379033, 1.2670175108687771, 1.275592081134953, 1.2843647153826632, 1.293302773082318, 1.3023736086460473, 1.3115448049398826, 1.320784384653437, 1.3300609995643615, 1.3393440987275969, 1.3486040772767907, 1.357812407841535, 1.366941756595131, 1.375966085720365, 1.384860743697704, 1.3936025443662545, 1.4021698352578613, 1.4105425553167534, 1.418702281828888, 1.4266322662138833, 1.4343174582782552, 1.4417445185788278, 1.4489018186785365, 1.455779429268248 ], [ 1.1957540009284622, 1.1930766340556613, 1.1907494559691647, 1.1887929773036758, 1.187226793015848, 1.18606937853396, 1.185337882202152, 1.1850479165775483, 1.185213351534248, 1.1858461125271964, 1.1869559877498514, 1.1885504482549452, 1.1906344853637851, 1.1932104698295032, 1.196278037205154, 1.1998340036630448, 1.2038723160886153, 1.2083840396135423, 1.2133573848579262, 1.2187777760394514, 1.224627959819882, 1.230888153360034, 1.237536228627268, 1.2445479286426744, 1.2518971101723713, 1.2595560064575917, 1.2674955030225776, 1.275685419450581, 1.2840947902906308, 1.2926921389228458, 1.301445739198558, 1.3103238608799306, 1.3192949962088039, 1.3283280662094683, 1.3373926064611839, 1.34645893297843, 1.3554982894610297, 1.3644829775127607, 1.373386471501437, 1.3821835195971954, 1.3908502322457073, 1.3993641589792913, 1.407704354105424, 1.415851431489801, 1.4237876084047774, 1.431496738261559, 1.4389643319891727, 1.4461775678567719, 1.4531252896420912, 1.459797993207511 ], [ 1.2035878187307094, 1.2010946077387268, 1.198945730945579, 1.1971607705216603, 1.1957583773972706, 1.1947560760211258, 1.194170066487853, 1.1940150265246112, 1.194303916175583, 1.1950477883691364, 1.1962556088762712, 1.1979340894456798, 1.2000875381006066, 1.2027177306733075, 1.205823807601426, 1.2094021997872528, 1.2134465869027105, 1.2179478908974748, 1.222894306637538, 1.2282713705857897, 1.2340620672739355, 1.240246972063539, 1.2468044274267982, 1.2537107487797996, 1.2609404548611725, 1.268466516850525, 1.2762606199315274, 1.2842934308672234, 1.2925348653809579, 1.3009543497006346, 1.3095210714684817, 1.3182042162566814, 1.3269731870584078, 1.3357978052375388, 1.3446484924230222, 1.3534964336516748, 1.3623137226522812, 1.371073490511624, 1.3797500190869485, 1.3883188404684204, 1.3967568236030332, 1.4050422489252186, 1.4131548715534445, 1.4210759733504439, 1.4287884039389291, 1.4362766106327525, 1.44352665719074, 1.4505262313220995, 1.4572646409566277, 1.463732799423636 ], [ 1.2114510317294367, 1.2091389556903935, 1.207165109356915, 1.2055481571098667, 1.2043058199103427, 1.20345468865776, 1.2030100358999825, 1.2029856283080627, 1.203393542632808, 1.2042439881575047, 1.2055451389329708, 1.2073029793054264, 1.2095211663983356, 1.2122009132580134, 1.215340896291766, 1.218937190391488, 1.222983234727056, 1.2274698316036536, 1.2323851800098264, 1.2377149445581292, 1.2434423594729171, 1.2495483661620685, 1.2560117817850633, 1.2628094951726558, 1.2699166855386532, 1.2773070587221038, 1.2849530952653667, 1.292826304505099, 1.3008974790375871, 1.309136944396353, 1.3175147994991636, 1.326001144311892, 1.334566292152217, 1.3431809650283801, 1.3518164712959082, 1.3604448656554549, 1.3690390920677862, 1.3775731105137998, 1.3860220086888726, 1.3943620997212882, 1.4025710068860102, 1.4106277360947328, 1.4185127367253025, 1.426207951147328, 1.4336968531333916, 1.4409644752347737, 1.4479974251531154, 1.4547838911535722, 1.461313636631793, 1.4675779840543304 ], [ 1.2193281189121403, 1.2171937933169774, 1.215391365205703, 1.2139385944375878, 1.2128522885293467, 1.2121481245545453, 1.2118404702870047, 1.2119422069159458, 1.2124645559244729, 1.213416912975229, 1.214806691872219, 1.2166391818456253, 1.2189174215144565, 1.2216420928953902, 1.2248114387218636, 1.2284212060945718, 1.2324646190888573, 1.2369323823902578, 1.241812717322726, 1.2470914307932712, 1.2527520167348387, 1.25877578863154, 1.2651420407133507, 1.2718282344739218, 1.2788102063596891, 1.2860623918598935, 1.2935580608426338, 1.3012695588607723, 1.3091685492998288, 1.3172262516402837, 1.3254136717178107, 1.333701820627399, 1.342061919759592, 1.3504655903051677, 1.358885026350304, 1.3672931513531705, 1.3756637583097027, 1.3839716342662238, 1.3921926700255713, 1.400303955942738, 1.4082838646488596, 1.4161121214161279, 1.4237698627182773, 1.431239683384165, 1.4385056726105596, 1.4455534390108387, 1.452370124836264, 1.4589444095161521, 1.4652665027166705, 1.4713281272058483 ], [ 1.2272040777376831, 1.2252437865134715, 1.2236088550779234, 1.2223161543397603, 1.2213815970514998, 1.2208199681487024, 1.2206447551358468, 1.2208679807564238, 1.2215000404109084, 1.2225495469981897, 1.224023186039179, 1.2259255840785281, 1.2282591934316505, 1.231024196328801, 1.2342184313857294, 1.2378373450849118, 1.241873970570914, 1.2463189355454056, 1.2511605003978148, 1.2563846269449483, 1.2619750773063805, 1.2679135415525264, 1.2741797918779945, 1.2807518602282508, 1.287606235597328, 1.2947180766681214, 1.3020614351240867, 1.309609484845652, 1.3173347523219059, 1.3252093439428898, 1.3332051663561952, 1.3412941367237894, 1.349448380442141, 1.3576404146285581, 1.3658433163719743, 1.374030875350474, 1.3821777308989531, 1.3902594939539914, 1.3982528545109443, 1.4061356753160204, 1.413887072508806, 1.4214874838584528, 1.4289187251301667, 1.4361640350050053, 1.4432081088774074, 1.4500371217857946, 1.4566387407003438, 1.4630021263997142, 1.4691179252119526, 1.4749782509668512 ], [ 1.2350644557277468, 1.23327418252222, 1.2318025480943984, 1.2306655519979153, 1.2298782327610605, 1.2294545065269347, 1.2294070064566194, 1.2297469250388402, 1.2304838616416094, 1.231625677816709, 1.2331783630139788, 1.2351459134641496, 1.2375302270289608, 1.2403310167781776, 1.2435457459176809, 1.2471695864478907, 1.2511954035685338, 1.2556137673628223, 1.2604129926986691, 1.2655792075933852, 1.271096449528129, 1.2769467884046142, 1.2831104740519685, 1.2895661054624477, 1.296290818307444, 1.3032604868017896, 1.3104499356775121, 1.3178331579181433, 1.3253835339952047, 1.333074048627547, 1.340877501523181, 1.348766709121253, 1.3567146949795232, 1.3646948670986598, 1.3726811810900952, 1.380648288639457, 1.3885716711641805, 1.3964277588978748, 1.404194035854004, 1.411849131238496, 1.4193728979136333, 1.4267464784880965, 1.4339523595449328, 1.4409744144435992, 1.4477979350629042, 1.4544096528019788, 1.4607977491342434, 1.4669518560173245, 1.472863046497848, 1.478523815909622 ], [ 1.24289537821502, 1.2412708368542724, 1.2399580518533273, 1.2389721707659211, 1.2383273800190564, 1.238036751683465, 1.238112091640969, 1.2385637911958391, 1.239400684338473, 1.240629913012509, 1.2422568028501102, 1.2442847519112004, 1.2467151349761985, 1.249547225883526, 1.2527781402583713, 1.256402800737728, 1.2604139264512964, 1.264802048069094, 1.269555549181358, 1.2746607341505343, 1.2801019218925098, 1.2858615643361746, 1.2919203876135719, 1.298257553387359, 1.3048508371673404, 1.311676820038782, 1.318711089949855, 1.3259284486001706, 1.333303120040724, 1.340808957327326, 1.3484196439409781, 1.3561088871662592, 1.3638506011611902, 1.3716190780164017, 1.379389145646804, 1.3871363118509652, 1.39483689428713, 1.4024681364364295, 1.4100083098505616, 1.4174368031196147, 1.4247341980602146, 1.4318823336331046, 1.4388643580725937, 1.4456647696673266, 1.452269446588267, 1.4586656661279276, 1.4648421137020136, 1.470788881974082, 1.4764974604948695, 1.4819607162973547 ], [ 1.2506835724235308, 1.2492202364712233, 1.2480616345827813, 1.2472220831779124, 1.2467149400314477, 1.2465524589771957, 1.246745646564525, 1.2473041226174886, 1.2482359867798278, 1.2495476932432268, 1.2512439359414278, 1.253327546537555, 1.2557994075239671, 1.2586583826802413, 1.26190126698438, 1.2655227578358264, 1.2695154491221146, 1.2738698492445297, 1.2785744237194394, 1.283615662405614, 1.2889781707946248, 1.2946447841693833, 1.3005967028165186, 1.3068136459057988, 1.3132740211579421, 1.3199551070405633, 1.3268332439839097, 1.333884031007512, 1.3410825241987225, 1.3484034336759723, 1.3558213159840158, 1.3633107592773448, 1.3708465591173957, 1.3784038832030319, 1.3859584238375366, 1.3934865373795071, 1.4009653703076854, 1.4083729718373614, 1.4156883932548825, 1.4228917742903957, 1.4299644169378665, 1.436888847169425, 1.4436488649947328, 1.4502295833003962, 1.456617455883472, 1.4628002950771941, 1.4687672793632234, 1.474508951376539, 1.4800172067368509, 1.4852852741819986 ], [ 1.258416388031213, 1.2571095193953146, 1.2561002436869144, 1.2554020683359084, 1.2550275470038859, 1.254988142003075, 1.255294089150804, 1.2559542669121189, 1.2569760717920093, 1.2583653020276784, 1.2601260516917263, 1.2622606173397113, 1.2647694193093153, 1.2676509396929205, 1.270901678851373, 1.2745161321069707, 1.2784867879453408, 1.2828041486700181, 1.287456773997737, 1.2924313475694895, 1.2977127658017338, 1.3032842479370912, 1.309127465602733, 1.3152226896762869, 1.321548951822063, 1.328084217720356, 1.3348055687884706, 1.3416893890964623, 1.3487115542152628, 1.355847618893458, 1.3630730007252736, 1.3703631573231123, 1.3776937549149357, 1.385040826719849, 1.392380919885026, 1.399691230168375, 1.4069497239046995, 1.414135247085801, 1.4212276216125528, 1.4282077289405004, 1.4350575814477062, 1.4417603819146378, 1.4483005715338546, 1.4546638668745389, 1.4608372862251418, 1.4668091657355562, 1.4725691657848865, 1.478108268015591, 1.483418763500455, 1.4884942325446602 ], [ 1.2660818143436123, 1.264926490890379, 1.2640615208405341, 1.2634996258415248, 1.263252580854313, 1.2633310840523337, 1.2637446295709323, 1.2645013848636852, 1.2656080745092464, 1.267069872379148, 1.268890304116485, 1.271071161879096, 1.2736124332598915, 1.276512246202675, 1.2797668315763135, 1.2833705048482984, 1.2873156680081965, 1.2915928325344792, 1.2961906637814549, 1.301096046698577, 1.3062941722989936, 1.3117686437889144, 1.3175016007779738, 1.3234738595385185, 1.3296650668928653, 1.3360538650036156, 1.3426180641396392, 1.349334820399229, 1.356180815394748, 1.363132435033906, 1.370165944758681, 1.3772576589044858, 1.3843841021958894, 1.3915221617757616, 1.398649228547344, 1.4057433269716784, 1.4127832327887504, 1.4197485784081243, 1.4266199459383084, 1.4333789479935148, 1.4400082965365977, 1.4464918600958712, 1.4528147097407995, 1.4589631542276327, 1.4649247647403758, 1.4706883896628322, 1.4762441598298106, 1.481583484723286, 1.4866990401040678, 1.4915847476006818 ], [ 1.2736684941912557, 1.2726596363365805, 1.2719338137637024, 1.2715029864100016, 1.2713781766256729, 1.2715693463049567, 1.272085277220233, 1.272933456221031, 1.2741199670280583, 1.2756493904002897, 1.2775247144744548, 1.2797472570643929, 1.2823166016549212, 1.2852305487239235, 1.2884850838713462, 1.2920743640202548, 1.2959907226820824, 1.300224694947797, 1.3047650624857403, 1.3095989184057695, 1.3147117514035085, 1.3200875481456213, 1.3257089124185528, 1.3315571991598256, 1.3376126611444388, 1.343854605826613, 1.3502615596538898, 1.3568114370843571, 1.3634817115510425, 1.3702495857256365, 1.3770921586255884, 1.3839865873688084, 1.3909102416884216, 1.397840849655493, 1.4047566333990527, 1.4116364339413716, 1.4184598245670528, 1.425207212406455, 1.4318599281313562, 1.4384003038326956, 1.4448117392791677, 1.451078756847602, 1.4571870454783884, 1.4631234940504352, 1.468876214597672, 1.4744345558098089, 1.4797891072792118, 1.484931694976448, 1.4898553684614064, 1.494554380364795 ], [ 1.2811657346520793, 1.280298130908084, 1.2797061847916418, 1.2794011192859924, 1.279393230720015, 1.279691772874915, 1.2803048445889278, 1.2812392824300314, 1.2825005600582213, 1.2840926959302452, 1.2860181710060772, 1.2882778580912908, 1.29087096438751, 1.293794988717555, 1.2970456947385485, 1.3006171012514507, 1.304501490459214, 1.308689434719986, 1.3131698419932387, 1.3179300197946904, 1.322955757073769, 1.3282314230212873, 1.3337400814225302, 1.339463618811095, 1.345382884368882, 1.3514778392737279, 1.3577277130298644, 1.3641111642353514, 1.3706064432464888, 1.3771915542886795, 1.3838444147269309, 1.390543009434252, 1.3972655384658785, 1.4039905565438953, 1.410697103162136, 1.4173648224194648, 1.4239740719666365, 1.4305060206985918, 1.4369427350341328, 1.4432672537964335, 1.4494636518424475, 1.4555170926905987, 1.4614138704700719, 1.4671414415679973, 1.47268844638901, 1.4780447216710226, 1.483201303825875, 1.4881504237972127, 1.4928854939521383, 1.497401087548661 ], [ 1.2885635146940173, 1.287831846154479, 1.2873684163449086, 1.2871837365684007, 1.2872874040615814, 1.287687992813989, 1.2883929481285827, 1.2894084864041488, 1.2907395016575294, 1.2923894803210831, 1.2943604258442254, 1.2966527945924553, 1.2992654444678269, 1.3021955975665405, 1.305438818038531, 1.308989006118128, 1.3128384090543652, 1.3169776493865892, 1.3213957706917976, 1.3260803005830768, 1.3310173303754906, 1.3361916104707579, 1.3415866601604274, 1.3471848902252348, 1.3529677364310506, 1.3589158018025926, 1.3650090054054282, 1.3712267352907572, 1.3775480032579719, 1.3839515991642037, 1.3904162426503297, 1.396920730348544, 1.4034440768734375, 1.4099656481616714, 1.4164652859993785, 1.4229234228472214, 1.42932118632881, 1.4356404929797886, 1.441864131056668, 1.4479758323737157, 1.4539603332734707, 1.4598034249440488, 1.4654919933786417, 1.4710140493345947, 1.4763587486960192, 1.481516403680227, 1.4864784853578668, 1.4912376179828923, 1.4957875656528938, 1.5001232118439476 ], [ 1.2958524898310364, 1.2952513535833718, 1.2949110133999062, 1.2948412945454026, 1.295051122289355, 1.2955484191720874, 1.2963400062080581, 1.2974315094210322, 1.2988272731305897, 1.3005302814150894, 1.302542089159124, 1.3048627640494472, 1.3074908408085912, 1.3104232888455012, 1.3136554943551464, 1.3171812577122681, 1.320992806778712, 1.3250808264819827, 1.3294345047298644, 1.3340415944102888, 1.3388884908973222, 1.3439603241553768, 1.3492410642182855, 1.3547136385310579, 1.3603600593936331, 1.366161559548802, 1.3720987338198438, 1.37815168463251, 1.3843001692527497, 1.3905237466333327, 1.396801921883562, 1.4031142865468842, 1.4094406530803691, 1.4157611821642653, 1.4220565017164688, 1.4283078167333563, 1.4344970093144096, 1.440606728445327, 1.4466204693070528, 1.452522642043634, 1.458298630059495, 1.4639348380279724, 1.4694187298809807, 1.474738857118165, 1.4798848778269011, 1.4848475668462642, 1.4896188175415475, 1.494191635684322, 1.4985601259576928, 1.5027194716286945 ], [ 1.3030239938879553, 1.3025479253424481, 1.302325203059712, 1.3023649921398004, 1.302675573077863, 1.3032642452100927, 1.3041372342506548, 1.3052996052315073, 1.3067551821713055, 1.3085064757952543, 1.3105546206020482, 1.3128993225232695, 1.3155388183418635, 1.3184698479260955, 1.3216876401919413, 1.325185913528924, 1.32895689121267, 1.3329913320849034, 1.3372785765128208, 1.3418066073521262, 1.3465621253405926, 1.3515306380524774, 1.356696561260278, 1.3620433312911202, 1.3675535267418175, 1.3732089977392312, 1.378991000808674, 1.384880337347453, 1.3908574936946558, 1.3969027808404522, 1.4029964719228474, 1.409118935809949, 1.4152507652510056, 1.4213728982890117, 1.4274667318504026, 1.4335142266522647, 1.4394980027854984, 1.4454014255358139, 1.4512086811879357, 1.4569048427189117, 1.462475925422737, 1.4679089326214998, 1.4731918917097377, 1.4783138808517404, 1.4832650467092379, 1.488036613622646, 1.4926208847056779, 1.4970112353430935, 1.5012020996063549, 1.5051889501232552 ], [ 1.3100700379744008, 1.309713532103607, 1.3096029313287827, 1.3097467665679523, 1.3101527006878857, 1.3108274378640294, 1.3117766371473625, 1.3130048314708542, 1.3145153533334855, 1.3163102683872752, 1.3183903181198897, 1.3207548727695924, 1.3234018955276727, 1.3263279189740371, 1.3295280345523999, 1.332995895722155, 1.3367237352255925, 1.340702396683957, 1.3449213804889089, 1.3493689036933851, 1.3540319733358892, 1.3588964723642176, 1.36394725706895, 1.3691682647038, 1.3745426297692316, 1.38005280727589, 1.385680701192231, 1.3914077962201072, 1.3972152910346936, 1.4030842311692968, 1.4089956398172208, 1.4149306449553096, 1.4208706013588932, 1.4267972062660628, 1.4326926076508377, 1.4385395042705842, 1.444321236854444, 1.4500218699899787, 1.455626264439305, 1.461120139770743, 1.466490127325734, 1.4717238136536845, 1.4768097746407356, 1.4817376006342542, 1.4864979129257567, 1.4910823720036008, 1.4954836780256249, 1.4996955639931449, 1.5037127821329215, 1.507531084014172 ], [ 1.3169833067756107, 1.316740838258607, 1.3167368572015867, 1.3169792863218182, 1.31747519785499, 1.3182307285658212, 1.3192509990479453, 1.3205400384699522, 1.3221007159223903, 1.3239346795011138, 1.3260423042239116, 1.3284226498176013, 1.3310734293296236, 1.3339909894099142, 1.3371703029741997, 1.3406049747989786, 1.344287260412126, 1.34820809843419, 1.3523571562980325, 1.35672288903449, 1.361292610566165, 1.3660525767089071, 1.3709880788495719, 1.3760835470586794, 1.381322661215788, 1.3866884685813914, 1.3921635061475952, 1.397729926044261, 1.4033696222692589, 1.4090643570494241, 1.414795885219532, 1.4205460751244339, 1.4262970246972746, 1.4320311715365714, 1.4377313959881035, 1.4433811164262453, 1.4489643761156543, 1.454465921212399, 1.4598712696282683, 1.4651667706304983, 1.4703396551792438, 1.4753780771167075, 1.4802711454154895, 1.4850089477709922, 1.4895825658855222, 1.4939840828422037, 1.4982065830071964, 1.5022441449307582, 1.5060918277429798, 1.5097456515597996 ] ], "zauto": true, "zmax": 1.5097456515597996, "zmin": -1.5097456515597996 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.11162338131011262, 0.10914406165539292, 0.1067152382056208, 0.10434284680885549, 0.10203266529677976, 0.09979029056361131, 0.09762111647201036, 0.0955303122112865, 0.0935228010715064, 0.09160324011375053, 0.08977600187371988, 0.08804515995958044, 0.08641448108804593, 0.08488742661171968, 0.08346716677929807, 0.08215661069698127, 0.08095845410893854, 0.07987524561955003, 0.07890946984651952, 0.07806364332701102, 0.07734041603000873, 0.07674266843210387, 0.07627359180195069, 0.07593673820445425, 0.07573602734294585, 0.07567570007633208, 0.07576021328674583, 0.0759940772651034, 0.07638164399967971, 0.0769268614684545, 0.07763301400347926, 0.07850247106685296, 0.0795364659505171, 0.08073492222289773, 0.08209633998467018, 0.08361774727765037, 0.08529471546275459, 0.08712143197080141, 0.08909082008398765, 0.09119469347256012, 0.09342393290763293, 0.09576867351274611, 0.09821849265118035, 0.1007625906532112, 0.103389958738953, 0.10608953046788651, 0.10885031472441957, 0.11166150958478242, 0.11451259740996081, 0.11739342220710056 ], [ 0.110133449805143, 0.10760744177361528, 0.10513235702792871, 0.10271433172253387, 0.10035935449192836, 0.09807323963155838, 0.09586159977311445, 0.09372981765087639, 0.09168301701389682, 0.08972603341057771, 0.08786338641276879, 0.08609925576802774, 0.08443746484158572, 0.08288147537136341, 0.08143439783027605, 0.08009902139560152, 0.07887786652150625, 0.07777326131298279, 0.07678744031085136, 0.07592266104060477, 0.07518133002639102, 0.07456612637259104, 0.07408010808465557, 0.07372678476188556, 0.07351014084541385, 0.07343459671753136, 0.0735049006579192, 0.0737259524189917, 0.07410256786169664, 0.07463920219158124, 0.07533965532294651, 0.07620678561549533, 0.07724225719242765, 0.07844634157454296, 0.07981778744475068, 0.08135376437056088, 0.08304987865643346, 0.08490025327284152, 0.0868976596355196, 0.08903368700730263, 0.091298935193629, 0.09368321750393073, 0.09617576309772287, 0.0987654103303274, 0.10144078518665604, 0.10419046110630968, 0.10700309834142491, 0.10986756241794396, 0.11277302231339321, 0.1157090296698898 ], [ 0.10872615170388898, 0.10615647530629611, 0.10363813669719239, 0.10117746771188948, 0.09878066490923994, 0.09645375903935516, 0.0942025825570747, 0.09203273471124683, 0.08994954432121276, 0.08795803118791405, 0.08606286812718818, 0.08426834675488235, 0.08257835124431605, 0.08099634512173634, 0.07952537654731394, 0.07816810723482556, 0.07692686901547369, 0.07580374994372907, 0.07480070877451112, 0.0739197127516188, 0.07316288925561032, 0.07253267748959731, 0.07203196276198648, 0.07166417392099754, 0.07143332495414098, 0.07134398527561123, 0.07140116985448136, 0.07161014944981915, 0.07197619147540371, 0.07250425160878798, 0.07319864334290532, 0.07406271585861077, 0.07509856931139941, 0.07630683128023283, 0.0776865099463171, 0.07923493022955679, 0.08094775027999049, 0.08281904868125722, 0.08484146815597166, 0.08700639954674087, 0.0893041900010974, 0.09172436098963975, 0.09425582436718706, 0.09688708757514868, 0.0996064418689841, 0.10240212989186413, 0.10526249089496889, 0.10817608341077742, 0.1111317862581025, 0.11411887946267209 ], [ 0.10740274802124251, 0.10479259996763926, 0.10223420029515141, 0.09973406958116125, 0.09729860677177778, 0.09493405522646553, 0.09264646528598992, 0.09044165278856857, 0.08832515366257686, 0.08630217572867922, 0.08437755009446325, 0.08255568590486348, 0.0808405335445759, 0.07923556244512013, 0.07774376017037231, 0.07636765918360393, 0.07510939642135904, 0.07397080838315255, 0.07295356088339666, 0.07205930806171931, 0.07128987007531289, 0.0706474137078399, 0.07013461576991716, 0.0697547866513889, 0.06951193172210193, 0.06941073218132175, 0.0694564345350418, 0.0696546484076442, 0.07001106429914204, 0.07053111404828923, 0.0712196049733141, 0.07208036229699316, 0.07311591288003283, 0.0743272370025109, 0.07571360543033438, 0.07727250827598367, 0.07899967216267947, 0.0808891543863511, 0.08293349786947336, 0.0851239287308837, 0.08745057875130631, 0.08990271713684386, 0.09246897899469, 0.09513758119639408, 0.09789651937296952, 0.10073374241568302, 0.10363730295075425, 0.10659548381917482, 0.10959690168300149, 0.1126305895774073 ], [ 0.10616384075395857, 0.10351656723845801, 0.10092145808715208, 0.09838521323665408, 0.09591442558147063, 0.09351554398260434, 0.09119483125418403, 0.088958316411469, 0.08681174128376772, 0.0847605027670347, 0.08280959345490041, 0.08096354501571112, 0.07922638027534526, 0.077601581256254, 0.07609208110903844, 0.07470028764961686, 0.07342814482571344, 0.07227723572042784, 0.07124892664327687, 0.07034454663748713, 0.06956559076110697, 0.06891392946826806, 0.0683920012928654, 0.0680029629885917, 0.06775077147674616, 0.06764017624333733, 0.06767660935987965, 0.06786597225593562, 0.06821433193585837, 0.06872755203512927, 0.06941089342666112, 0.0702686231304494, 0.07130366834487857, 0.07251734515219094, 0.07390918061556802, 0.07547683490316442, 0.07721611897714549, 0.07912109488954046, 0.0811842405837268, 0.08339665924257929, 0.08574831401177316, 0.08822827146514643, 0.09082494059008508, 0.0935262976571972, 0.09632009064100235, 0.09919401963653157, 0.10213589189328755, 0.10513375168701738, 0.1081759863467937, 0.11125141044308992 ], [ 0.10500940541799907, 0.10232847390704629, 0.09970013803530517, 0.09713126522471467, 0.09462863082824281, 0.09219887857287183, 0.08984847446992164, 0.08758365330358313, 0.08541035773564364, 0.08333417139401582, 0.08136024898633817, 0.07949324835866364, 0.07773727127892993, 0.07609582126470209, 0.07457178764517398, 0.07316746489410558, 0.07188461479078764, 0.07072457596887394, 0.06968842087470281, 0.06877715427455795, 0.0679919406897585, 0.06733434127448334, 0.06680653477151247, 0.06641149360599376, 0.06615308623675806, 0.06603608155315926, 0.06606604056977092, 0.06624909401100894, 0.06659161953951238, 0.06709984655560361, 0.0677794268168943, 0.06863501348671472, 0.06966988887061283, 0.07088567284396136, 0.07228213186256861, 0.07385709512766837, 0.07560647243307421, 0.07752435919649937, 0.07960320891117366, 0.08183405157524191, 0.08420673778479774, 0.08671019109275642, 0.08933265497818096, 0.09206192460524916, 0.09488555701530668, 0.09779105626569452, 0.10076603224919374, 0.10379833354134871, 0.10687615571883398, 0.1099881272718045 ], [ 0.10393884311368756, 0.10122781433568011, 0.09856983828420708, 0.09597193555763887, 0.09344104939835032, 0.0909840041057851, 0.0886074555019599, 0.08631783236553102, 0.08412126877016377, 0.08202352873647561, 0.080029926477016, 0.07814524763338311, 0.07637367902855141, 0.07471875625073703, 0.0731833394520889, 0.07176962768069337, 0.07047922051824639, 0.06931323254444534, 0.06827246116081126, 0.06735760179886625, 0.06656949702833823, 0.06590939842988444, 0.06537921350946628, 0.06498170587025864, 0.06472061680276249, 0.06460068149164255, 0.06462752338266019, 0.06480742487893504, 0.06514698914997333, 0.06565272330626905, 0.06633058434482426, 0.06718553380729893, 0.06822114426219367, 0.06943929150799885, 0.07083995313925318, 0.07242111976488348, 0.07417881241263359, 0.07610719030874993, 0.07819872797929366, 0.080444439182436, 0.08283412663396848, 0.0853566397085951, 0.08800012627049497, 0.09075226876274549, 0.09360049821990996, 0.09653218276227915, 0.09953478935102185, 0.10259601919024343, 0.10570391825150514, 0.10884696507331813 ], [ 0.10295105107929098, 0.10021355244118367, 0.09752960063629344, 0.0949063528697958, 0.09235090274117232, 0.08987023720697662, 0.08747118433892448, 0.08516035058729295, 0.0829440473537358, 0.08082820827416924, 0.07881830065701864, 0.07691923686199684, 0.07513529377694352, 0.07347005058829272, 0.07192635630572371, 0.07050633853812567, 0.06921146342991101, 0.0680426531980692, 0.06700046232061661, 0.06608530635521048, 0.06529772918317339, 0.06463868612130498, 0.06410981313669196, 0.06371364793011791, 0.06345376852855637, 0.06333482042548942, 0.06336241444976952, 0.06354289329267218, 0.06388298245740713, 0.06438935789221079, 0.06506817429690666, 0.06592460262158187, 0.06696242190099687, 0.06818370047542739, 0.0695885874613461, 0.07117522024699201, 0.07293974063256826, 0.07487640283261841, 0.07697775150288287, 0.07923484681151857, 0.08163751530866285, 0.08417460876477398, 0.08683425721303938, 0.08960410641779598, 0.09247153348799345, 0.09542383719612309, 0.09844840173860712, 0.10153283425273224, 0.10466507748632539, 0.10783349969904331 ], [ 0.10204450981309562, 0.09928421140805749, 0.0965780029641991, 0.09393315976382316, 0.09135690554183087, 0.08885636859872816, 0.08643852766886038, 0.08411014604890263, 0.08187769363934318, 0.07974725824453907, 0.077724449665239, 0.075814302645283, 0.0740211873250396, 0.07234873811442011, 0.07079981335058141, 0.06937649824892388, 0.06808016205087417, 0.06691157663174539, 0.06587109810867234, 0.06495890544231103, 0.0641752812780811, 0.06352091134319168, 0.06299717101730093, 0.06260636292733335, 0.062351869286624485, 0.06223818844244958, 0.06227083691725606, 0.06245611487262372, 0.0628007516632687, 0.06331146531775074, 0.0639944817647204, 0.06485506393043786, 0.06589709686306208, 0.06712276420090627, 0.06853233646997099, 0.07012407624529089, 0.07189425202875423, 0.07383724353108795, 0.07594571634875777, 0.0782108432178296, 0.08062255097404841, 0.08316977582718055, 0.08584071355932575, 0.08862305510688323, 0.09150420132736659, 0.09447145345890132, 0.0975121778627458, 0.10061394517030392, 0.1037646450272682, 0.10695257832680531 ], [ 0.10121738403192417, 0.09843797825026845, 0.09571326750370483, 0.09305062508793466, 0.09045738239639015, 0.08794078478171, 0.08550793640246859, 0.08316573236961734, 0.08092077768518928, 0.0787792942235978, 0.0767470192989461, 0.0748291020342813, 0.07303000651448942, 0.0713534331499985, 0.06980227129448766, 0.06837859640760933, 0.06708372345577901, 0.06591832448741816, 0.06488261234918559, 0.06397658460719101, 0.06320031256993035, 0.06255425096644467, 0.06203953580792078, 0.06165823303435939, 0.061413500487893666, 0.06130963181758739, 0.06135196326375106, 0.06154664151716775, 0.06190027009810917, 0.06241946911661052, 0.06311039514347895, 0.0639782717832516, 0.06502697695463612, 0.06625872148947753, 0.0676738385365705, 0.06927068787116394, 0.07104566640710602, 0.07299330758431723, 0.07510644812687733, 0.0773764402137067, 0.07979338917782894, 0.08234640024403468, 0.08502382158757237, 0.08781347455843626, 0.09070286498186442, 0.09367937193493985, 0.09673041233999277, 0.09984358117738576, 0.10300676817966399, 0.10620825259477332 ], [ 0.10046763404277097, 0.09767281956412335, 0.09493338110462497, 0.09225676891452758, 0.08965039789625537, 0.08712160378804337, 0.08467758787694818, 0.08232534839198631, 0.08007159791220221, 0.07792266791202221, 0.07588440391888003, 0.07396205752212243, 0.07216018435731995, 0.07048255976997082, 0.06893212560663993, 0.06751098192274509, 0.06622043582878114, 0.06506111588698396, 0.06403315435979297, 0.0631364314978563, 0.06237086664650449, 0.06173673138900739, 0.06123495178561434, 0.06086736183723083, 0.06063687038888819, 0.060547510023199864, 0.06060434915933465, 0.06081326607506169, 0.06118060287879282, 0.06171273465350327, 0.062415600366492005, 0.06329424535316831, 0.06435242000817985, 0.06559226761144442, 0.0670141191959228, 0.06861639849165974, 0.07039562795506103, 0.07234651908980731, 0.07446212674333015, 0.07673404696628125, 0.0791526401289035, 0.08170726415166271, 0.08438650609438256, 0.0871784034805041, 0.09007064941156384, 0.09305077772020273, 0.09610632616119674, 0.09922497700959206, 0.10239467547741277, 0.10560372711939175 ], [ 0.099793133574536, 0.09698660421861269, 0.09423622284689209, 0.09154949523768334, 0.0889338946836431, 0.08639681902659914, 0.08394553611214275, 0.08158711568868623, 0.0793283469406063, 0.07717564262498981, 0.07513493314365007, 0.07321155667711882, 0.07141015444627838, 0.06973458281977003, 0.06818785581087711, 0.06677213192413879, 0.0654887577972727, 0.064338377291898, 0.06332110855702325, 0.062436783433756575, 0.061685234124369964, 0.06106660249311947, 0.0605816392836553, 0.06023195576462337, 0.06002019061078365, 0.05995006135581936, 0.06002628249639679, 0.06025434968821107, 0.06064020835696448, 0.06118984154229828, 0.061908822310009416, 0.0628018784829045, 0.0638725117641789, 0.06512270160424964, 0.06655270965998594, 0.06816098676730145, 0.06994417345652681, 0.0718971782885244, 0.07401331551534289, 0.07628448381089283, 0.07870136986403585, 0.08125366343271652, 0.08393027332726968, 0.08671953637610601, 0.08960941362320302, 0.09258766983473615, 0.09564203390793442, 0.09876033902678737, 0.10193064242436449, 0.10514132540450377 ], [ 0.09919178977443079, 0.09637722834306053, 0.0936196939948938, 0.09092672692197709, 0.08830583350118548, 0.08576444464694298, 0.08330986283912284, 0.08094919577024522, 0.07868927567705526, 0.07653656515536209, 0.07449705257609429, 0.07257614298167242, 0.07077855326277473, 0.06910822307124534, 0.06756825477815409, 0.06616089625475317, 0.06488757881358237, 0.06374901894913051, 0.06274538650355017, 0.06187653387242699, 0.061142271608198365, 0.060542666465356665, 0.06007833014155869, 0.059750662503042756, 0.059562013625393304, 0.059515735587200545, 0.05961610749121491, 0.05986813398205401, 0.0602772354928063, 0.06084886379790123, 0.06158808581367525, 0.0624991801282732, 0.06358528471982257, 0.06484812291002139, 0.06628782101978643, 0.06790281858513501, 0.06968986251171733, 0.0716440709989222, 0.07375905108010872, 0.07602705416788759, 0.0784391559012748, 0.08098544894608194, 0.08365523966010763, 0.08643724149045422, 0.08931975961571811, 0.09229086275328884, 0.09533853929125032, 0.09845083600939428, 0.10161597862505996, 0.10482247421955683 ], [ 0.09866166092799712, 0.09584273780826566, 0.0930818450826727, 0.09038653724106872, 0.08776432905685388, 0.08522265564721719, 0.08276882183320701, 0.08040993871311623, 0.07815284641541048, 0.07600402364715944, 0.07396948687702264, 0.0720546846532734, 0.07026439538625745, 0.06860263951145648, 0.06707261877322317, 0.06567669586458397, 0.06441642631381111, 0.06329265098458081, 0.06230565179989719, 0.061455365630652334, 0.06074164245265051, 0.06016452504373154, 0.05972452020094616, 0.05942282742608575, 0.05926149181860163, 0.05924345444276281, 0.059372485451503046, 0.05965300104543312, 0.06008978192737124, 0.0606876247244121, 0.06145096585249323, 0.062383517979316426, 0.06348795309025958, 0.06476565540102555, 0.0662165550599251, 0.0678390425824371, 0.06962995606751883, 0.07158462896585574, 0.07369698496134625, 0.07595966731842771, 0.07836419175628305, 0.08090111376115701, 0.08356020285445775, 0.08633061762243936, 0.08920107637098523, 0.09216001922023871, 0.09519575838243718, 0.09829661429516391, 0.10145103618635982, 0.10464770647898233 ], [ 0.09820106750751507, 0.09538144345208428, 0.09262099499306176, 0.08992727244048278, 0.08730777566097221, 0.0847699161458707, 0.08232096936303651, 0.07996801532565075, 0.07771786627286732, 0.07557698188636865, 0.0735513745434452, 0.07164650960534023, 0.06986720840528246, 0.06821756404843901, 0.06670088187547657, 0.06531965693896347, 0.06407559961517517, 0.06296971720449358, 0.062002454015749504, 0.06117388529656883, 0.06048395218134916, 0.059932716702289626, 0.05952060929592784, 0.05924863772967128, 0.059118527370735426, 0.059132768977479426, 0.05929456135935692, 0.05960765064128987, 0.060076082672244104, 0.06070389711154883, 0.06149479827086523, 0.062451837717225116, 0.0635771376240123, 0.06487167406885316, 0.06633512874059488, 0.06796580830642816, 0.06976062444738747, 0.0717151245346701, 0.0738235624217772, 0.07607899980575498, 0.07847343008393251, 0.08099791796791614, 0.08364274907518407, 0.08639758434541026, 0.08925161459682941, 0.09219371101875731, 0.09521256799057892, 0.09829683534161034, 0.10143523797517721, 0.10461668159989167 ], [ 0.09780869237392145, 0.09499202455519909, 0.09223583719463932, 0.08954766012200222, 0.0869349570390068, 0.08440508979694224, 0.08196527427759115, 0.07962252587814868, 0.07738359344946816, 0.0752548819120928, 0.07324236565829555, 0.07135149712564996, 0.0695871173659265, 0.06795337767958648, 0.06645368299284919, 0.0650906681345495, 0.06386621708523593, 0.0627815323337343, 0.06183725665136649, 0.061033643177217635, 0.0603707623686944, 0.059848727144892096, 0.05946791175611438, 0.059229136972462786, 0.05913379530728831, 0.05918389576470885, 0.0593820176018339, 0.059731175228617775, 0.06023460909619765, 0.060895527437310935, 0.061716828824086675, 0.06270083486315976, 0.06384905673668582, 0.06516201075598063, 0.06663908911004948, 0.0682784846361849, 0.0700771638056771, 0.07203088022572854, 0.07413422107003217, 0.07638067995177454, 0.07876275097739154, 0.08127203956951053, 0.08389938600765151, 0.08663499764888093, 0.08946858570053647, 0.09238950243671197, 0.0953868749989561, 0.09844973241663371, 0.10156712316596773, 0.10472822136491926 ], [ 0.09748366632806069, 0.0946736164997934, 0.0919255287995289, 0.08924689883929146, 0.0866451354367648, 0.08412752719810751, 0.08170120232496096, 0.07937307975504207, 0.0771498104617368, 0.07503770892937844, 0.0730426764718712, 0.07117012007025347, 0.06942487256260699, 0.0678111220147454, 0.0663323595370636, 0.06499135526435056, 0.0637901712983023, 0.06273021787883985, 0.06181235487576335, 0.06103703514558207, 0.06040447997749226, 0.05991487067181311, 0.059568535406543756, 0.059366108169508346, 0.05930863766556654, 0.05939762918182301, 0.05963501095709734, 0.06002302721521748, 0.060564070497922104, 0.06126047393082264, 0.062114287831399266, 0.06312706407493862, 0.06429966668329985, 0.06563212000104364, 0.06712349867296626, 0.06877185809671657, 0.07057420087217188, 0.07252647386744188, 0.07462359111805358, 0.07685947893951282, 0.07922714061745113, 0.08171873846391754, 0.08432569087349592, 0.08703878149439208, 0.08984827704116416, 0.0927440498653418, 0.0957157013072271, 0.09875268210106664, 0.10184440663524098, 0.10498035857343856 ], [ 0.09722563570142786, 0.09442587911152046, 0.09168975876462807, 0.08902472507008405, 0.08643811605742519, 0.08393712625003949, 0.08152877064208425, 0.07921984202996209, 0.07701686051535567, 0.07492601497906481, 0.072953097710958, 0.07110343508253156, 0.06938181898717002, 0.06779244548225093, 0.06633886831207969, 0.06502397541172217, 0.06384999576999102, 0.062818541960965, 0.06193069022280677, 0.06118709540099705, 0.060588132885785566, 0.060134054626597884, 0.05982514235344442, 0.059661839267818324, 0.05964484247208511, 0.05977514258705123, 0.06005400393115946, 0.06048288708089085, 0.06106332381508198, 0.06179676051403423, 0.06268438872445087, 0.06372698049365455, 0.06492474198413548, 0.06627719332045695, 0.06778307727921185, 0.06944029557709827, 0.07124586965640241, 0.07319592277482329, 0.07528568116049957, 0.07750949316804659, 0.07986086613882216, 0.08233252074586055, 0.08491646203822359, 0.08760406545126823, 0.09038617504350172, 0.0932532104302351, 0.09619527846822284, 0.09920228574143243, 0.10226404824973317, 0.10537039530108838 ], [ 0.09703480926938861, 0.09424904286300578, 0.09152879234167519, 0.08888145464304482, 0.08631428394415337, 0.08383436270062805, 0.08144856987840111, 0.07916354479518582, 0.0769856453889979, 0.07492090048441248, 0.07297495672500326, 0.07115302221021333, 0.06945981037134083, 0.06789948902752357, 0.06647564060903001, 0.06519123993505276, 0.06404865543435224, 0.06304967814043694, 0.062195580168536824, 0.061487200872059646, 0.060925054877145626, 0.060509452301465205, 0.060240618415521016, 0.06011879855903686, 0.06014433487211589, 0.06031770454383808, 0.06063951445883053, 0.061110453379603316, 0.06173120877956979, 0.06250235976341541, 0.06342425924557554, 0.064496917541699, 0.0657198964136185, 0.06709221858869001, 0.06861229412469118, 0.07027786262617856, 0.0720859495432215, 0.07403283531622837, 0.07611403732421432, 0.07832430574214155, 0.08065763499858576, 0.08310729234143496, 0.08566586415469127, 0.08832531940338663, 0.09107708825355004, 0.0939121528076024, 0.09682114618875462, 0.0997944559556046, 0.1028223279864148, 0.10589496743831467 ], [ 0.09691198244023054, 0.09414393087905236, 0.0914434897544427, 0.08881799670519892, 0.0862746115936454, 0.08382028947791416, 0.08146175302693245, 0.07920546297635774, 0.07705758544555764, 0.07502395544601692, 0.0731100367069044, 0.07132087897029335, 0.06966107505613227, 0.06813472110101737, 0.06674538423215995, 0.06549608233502584, 0.06438928032325249, 0.06342690630452047, 0.06261038924465578, 0.06194071728908897, 0.0614185130802176, 0.061044119627548306, 0.06081768806248818, 0.060739257475410945, 0.060808817407040076, 0.06102634559497577, 0.061391817008295414, 0.06190518437344543, 0.06256633436119768, 0.06337502642695195, 0.06433082235702507, 0.06543301380155248, 0.06668055296844087, 0.06807198907714315, 0.06960541102421122, 0.07127839560645183, 0.0730879607337371, 0.07503052405233172, 0.07710186873564724, 0.07929711929768334, 0.08161073072857836, 0.08403649389226668, 0.08656755907083691, 0.0891964780667584, 0.09191526371635919, 0.09471546431708511, 0.09758824951677365, 0.1005245037286254, 0.10351492309475495, 0.10655011233363858 ], [ 0.09685853740591083, 0.0941119555095575, 0.09143529801783076, 0.08883583938324618, 0.08632063680795028, 0.08389650481908886, 0.08156999165127266, 0.079347356222681, 0.07723454452548323, 0.07523716450985767, 0.07336045902876709, 0.07160927709510471, 0.06998804450995938, 0.06850073573871326, 0.06715084960253888, 0.06594139177196932, 0.06487486706930974, 0.06395328412280168, 0.06317817394661482, 0.06255062260602803, 0.062071316415360234, 0.061740596345140716, 0.06155851679366438, 0.06152490294068306, 0.06163940082769821, 0.061901515225536365, 0.062310632140984104, 0.0628660251036032, 0.06356684660247475, 0.06441210764057641, 0.06540064896740153, 0.06653110710613375, 0.06780187713927065, 0.06921107291551265, 0.07075648446233732, 0.07243553229945562, 0.07424521909040878, 0.07618208037208832, 0.07824213750753575, 0.08042085704656161, 0.08271312102280311, 0.08511321225739027, 0.0876148175894889, 0.09021105037390507, 0.09289449189262554, 0.09565724980595834, 0.09849103061766558, 0.10138722243792062, 0.10433698409289192, 0.10733133677740489 ], [ 0.09687641872411673, 0.09415508911087152, 0.09150621579283894, 0.08893700739054226, 0.08645441152514169, 0.08406509058636827, 0.08177540174522042, 0.07959138018778628, 0.07751872438645034, 0.07556278222859844, 0.07372853700646657, 0.07202059262549025, 0.07044315787605833, 0.06900003017417376, 0.06769457973270815, 0.06652973559344444, 0.0655079752530219, 0.06463131969104358, 0.06390133541642552, 0.06331914467783466, 0.06288544426213308, 0.06260053240339128, 0.06246434236897605, 0.062476480447220366, 0.06263626551341946, 0.06294276723321743, 0.06339484030400849, 0.0639911528239008, 0.06473020768065388, 0.06561035649688589, 0.06662980595422276, 0.06778661621899143, 0.06907869087092977, 0.07050375749215279, 0.07205933821002491, 0.07374271018124046, 0.07555085722296787, 0.07748041530133783, 0.07952761601388912, 0.08168823318482157, 0.08395753797506256, 0.08633026741652129, 0.0888006101152558, 0.09136221126719546, 0.09400819738335095, 0.0967312195007533, 0.09952351236075581, 0.1023769661736476, 0.10528320717367193, 0.10823368314951486 ], [ 0.09696808462768114, 0.09427580958746201, 0.09165873217550465, 0.08912399293585958, 0.08667842357913468, 0.08432852347720916, 0.08208044288117053, 0.0799399720264422, 0.07791253493117294, 0.07600318644490786, 0.07421661099365301, 0.07255712151051585, 0.07102865723901824, 0.06963477943610909, 0.06837866445984969, 0.06726309427019637, 0.06629044495954663, 0.06546267451118704, 0.06478131149250038, 0.0642474467451743, 0.06386173025068037, 0.06362437515554509, 0.06353517041144267, 0.06359350266271911, 0.06379838701519351, 0.06414850531008816, 0.06464224967019616, 0.06527776849209053, 0.06605301175255222, 0.0669657724288273, 0.06801372092258075, 0.06919442958167958, 0.07050538475812364, 0.07194398441384418, 0.07350752018700601, 0.07519314409544578, 0.07699782159995867, 0.07891827437358784, 0.0809509175417969, 0.08309179709346795, 0.08533653341994152, 0.08768027646349172, 0.09011767683913575, 0.09264287573952681, 0.09524951470136048, 0.09793076465529174, 0.10067937229647647, 0.10348772081643767, 0.10634790146462889, 0.10925179222934107 ], [ 0.09713643521647615, 0.09447702217940263, 0.09189574132771733, 0.08939966237435212, 0.08699549449082701, 0.08468956304149813, 0.08248779553751903, 0.08039571615790518, 0.07841844762852254, 0.07656071875353829, 0.07482687550362685, 0.07322089332332107, 0.07174638826363629, 0.07040662470551466, 0.06920451783569927, 0.06814262967550275, 0.06722315832745412, 0.06644792114256134, 0.0658183336237661, 0.06533538692234572, 0.06499962757184612, 0.06481114345400098, 0.064769559764689, 0.06487404790144655, 0.0651233488101454, 0.06551581060934865, 0.06604943853428356, 0.06672195368788666, 0.06753085596665799, 0.0684734859480717, 0.06954708048415488, 0.0707488171774275, 0.07207584374050735, 0.07352528939546968, 0.07509425690386001, 0.07677979546891905, 0.07857885650580664, 0.08048823595922434, 0.08250450824520959, 0.08462395779563862, 0.08684251444443648, 0.08915569847318564, 0.0915585801079637, 0.09404575680223153, 0.0966113499787712, 0.0992490212655249, 0.10195200683429613, 0.10471316736114618, 0.10752505042518656, 0.11037996183871006 ], [ 0.09738471956306137, 0.09476195991746827, 0.09222043584815286, 0.08976714207363137, 0.0874086574476004, 0.08515112146515634, 0.08300022249002673, 0.08096119722845824, 0.07903884022130489, 0.0772375213908273, 0.07556120902729073, 0.07401349510235282, 0.07259761952285919, 0.07131648995741025, 0.07017269423493652, 0.06916850306189375, 0.06830586192600065, 0.06758637248635035, 0.06701126535898615, 0.06658136778855796, 0.06629707099300661, 0.06615830271227588, 0.0661645104700401, 0.06631466017444185, 0.06660725300918977, 0.06704036133829187, 0.06761168192594273, 0.06831860255394706, 0.06915827643851204, 0.0701276979104479, 0.07122377267624529, 0.07244337654251048, 0.073783397611967, 0.07524075848024224, 0.07681241673097755, 0.07849534391148003, 0.08028648504010977, 0.08218270239939521, 0.08418070873994622, 0.0862769959032659, 0.0884677651575168, 0.09074886519926337, 0.0931157428689884, 0.09556341030243623, 0.09808643068702022, 0.10067892321595756, 0.10333458640916601, 0.10604673782485405, 0.10880836738447085, 0.11161220108504473 ], [ 0.09771642463167883, 0.09513406607678442, 0.09263618271707788, 0.09022968790747771, 0.08792102053943189, 0.08571612091706726, 0.0836204208549426, 0.08163884769495815, 0.07977584099084388, 0.07803537964488391, 0.07642101638856794, 0.0749359157738748, 0.07358289138755962, 0.07236443791540062, 0.07128275404805444, 0.0703397530816475, 0.06953705941696979, 0.06887599091940683, 0.06835752909926139, 0.06798228105593364, 0.06775043878765434, 0.06766174248165016, 0.06771545451185383, 0.06791034996353783, 0.06824472764619155, 0.0687164430120661, 0.06932296157880405, 0.07006142882376235, 0.07092875048155045, 0.07192167599633366, 0.0730368776355007, 0.07427101837637988, 0.07562080294417278, 0.07708300808406261, 0.07865449008687249, 0.08033216958377642, 0.08211299553714602, 0.08399389204759507, 0.08597169294113606, 0.08804306997701554, 0.0902044608438579, 0.09245200286635642, 0.09478147757644168, 0.09718827012867146, 0.0996673461222428, 0.10221324690948648, 0.10482010308520932, 0.1074816646867732, 0.11019134576544976, 0.11294228043970048 ], [ 0.09813514973413665, 0.09559686280022141, 0.09314638648251168, 0.09079054358482451, 0.08853562103292428, 0.08638734483041645, 0.08435087173490177, 0.08243079751502151, 0.08063118050794832, 0.07895557801510261, 0.07740709195912071, 0.07598841930161873, 0.07470190211946896, 0.07354957207964685, 0.07253318443620631, 0.07165423764778563, 0.07091397626269699, 0.07031337673622427, 0.06985311813050604, 0.06953354191221911, 0.06935460696148643, 0.06931584709124707, 0.0694163385781308, 0.06965468430034405, 0.07002901914075882, 0.07053703862335955, 0.07117604974083407, 0.07194304009071918, 0.07283475920294723, 0.07384780460182241, 0.0749787047978318, 0.07622399196975041, 0.0775802583751309, 0.07904419227090208, 0.08061259110045944, 0.08228235171605881, 0.08405043930401905, 0.0859138383417126, 0.08786949023158484, 0.08991422313619268, 0.09204467991555994, 0.09425724992521915, 0.09654800980821979, 0.09891267740094112, 0.10134658160599982, 0.10384464971943476, 0.10640141238025698, 0.10901102515735914, 0.11166730488098742, 0.11436377819996685 ], [ 0.0986444709773143, 0.09615381078085486, 0.09375434503001388, 0.09145279361316556, 0.08925527692185226, 0.08716728974955561, 0.08519369440604954, 0.08333873305742982, 0.08160605797221172, 0.07999877696499176, 0.07851951001206985, 0.07717045191825457, 0.07595343519521497, 0.07486998710928404, 0.07392137527460017, 0.0731086372511211, 0.07243259132160242, 0.07189382783724069, 0.07149268300939729, 0.07122919947121786, 0.07110307997620108, 0.07111364188966526, 0.07125978039553917, 0.07153994746952096, 0.07195215174307149, 0.07249398168256717, 0.07316265146483947, 0.07395506603146754, 0.0748678994861787, 0.07589767955806911, 0.07704087039820413, 0.07829394644167852, 0.07965345126011039, 0.08111603700465507, 0.0826784819560133, 0.08433768565504478, 0.08609064293116264, 0.08793439975817469, 0.08986599515395659, 0.09188239422519831, 0.09398041788919513, 0.09615667476432137, 0.09840750023761302, 0.10072890686595383, 0.1031165491579196, 0.10556570454738796, 0.10807127113795123, 0.11062778168092871, 0.11322943233026428, 0.1158701240401372 ], [ 0.09924780073859431, 0.09680816542831176, 0.09446310373215623, 0.09221921702321462, 0.0900824421409448, 0.0880580242801016, 0.08615051158085456, 0.08436377155855833, 0.08270102799699668, 0.08116491534412779, 0.07975754614921139, 0.07848058583908929, 0.07733532832343383, 0.07632276569539559, 0.0754436457588444, 0.07469851229937789, 0.0740877248674149, 0.07361145720272043, 0.07326967604927802, 0.07306210466009576, 0.07298817740990397, 0.07304699327828368, 0.07323727628445373, 0.07355735014707489, 0.07400513259605528, 0.07457815215271751, 0.07527358723175978, 0.0760883245671546, 0.07701903164317675, 0.07806223631025187, 0.07921440620181346, 0.08047202089382904, 0.08183163079306645, 0.08328989827361269, 0.08484361837204442, 0.08648971820191154, 0.08822523600487969, 0.09004728230433386, 0.09195298688035537, 0.09393943617543639, 0.09600360622257646, 0.09814229624468493, 0.10035206772603458, 0.102629193060671, 0.10496961692977473, 0.10736893246059967, 0.10982237308851882, 0.11232481998401161, 0.11487082399821419, 0.11745464037481783 ], [ 0.09994824757774926, 0.09756283523618613, 0.09527531394840366, 0.09309214799436503, 0.09101907163069055, 0.08906106121630801, 0.08722233149949624, 0.08550635630238282, 0.083915912143951, 0.08245314157425718, 0.08111963132958068, 0.07991649905662397, 0.07884448148358801, 0.07790401669316527, 0.07709531367430206, 0.07641840361149424, 0.07587316933257578, 0.07545935179950601, 0.0751765352232276, 0.07502411498114568, 0.07500125465973745, 0.07510683991363401, 0.07533943719733245, 0.07569726470317281, 0.07617818112046569, 0.07677969537533795, 0.07749899770140545, 0.0783330096571477, 0.0792784484359879, 0.08033189928541253, 0.08148988918486645, 0.08274895510032383, 0.08410570099334697, 0.08555683911022459, 0.08709921269917133, 0.08872979901224289, 0.09044569309493157, 0.0922440743379938, 0.09412215897922598, 0.09607714263473088, 0.09810613746721046, 0.1002061087449273, 0.10237381532124167, 0.10460575801517, 0.10689813907132062, 0.10924683491560574, 0.11164738340083841, 0.11409498574768714, 0.11658452250830954, 0.119110582166189 ], [ 0.10074848210324615, 0.09842024806630956, 0.09619310169811236, 0.0940733491870846, 0.0920665018827897, 0.0901772481001687, 0.08840945149220356, 0.08676617628314148, 0.08524973778552773, 0.08386177468721422, 0.08260333779071312, 0.08147498843185594, 0.08047689889827733, 0.0796089469665165, 0.07887079726437565, 0.07826196353715222, 0.07778184794811037, 0.07742975607506832, 0.07720488899665709, 0.0771063164641041, 0.07713293728950184, 0.0772834344535007, 0.07755623284204684, 0.07794946689735291, 0.07846096390445785, 0.07908824637214078, 0.07982855435329105, 0.08067888597384434, 0.08163605225589314, 0.08269674078723194, 0.08385758203156284, 0.08511521208218784, 0.08646632632386429, 0.08790771960852382, 0.08943630998092865, 0.09104914453641179, 0.09274338751241214, 0.09451629209931094, 0.09636515862163726, 0.09828728262693606, 0.10027989698455723, 0.10234011232029251, 0.10446486000041695, 0.1066508414631343, 0.10889448703502083, 0.11119192654175793, 0.11353897311220748, 0.11593112066676407, 0.11836355474738731, 0.12083117564242962 ], [ 0.10165061411984014, 0.0993822307402199, 0.09721795184032113, 0.09516390290781628, 0.09322535170035212, 0.09140668034149542, 0.08971138629856777, 0.0881421125388637, 0.0867007051278435, 0.08538829444547344, 0.08420539427747609, 0.08315201151734947, 0.08222775829893193, 0.08143195821792541, 0.08076373896253058, 0.08022210512963591, 0.07980598712564889, 0.07951426462240187, 0.07934576577299836, 0.07929924596888928, 0.07937335202141434, 0.07956657901125284, 0.07987722749301245, 0.08030336821984271, 0.0808428201552574, 0.08149314548544953, 0.08225166294689189, 0.08311547838752173, 0.0840815294043313, 0.08514663938323629, 0.08630757543345939, 0.0875611045676301, 0.08890404294509957, 0.09033329392634094, 0.09184587191628807, 0.09343891034743629, 0.09510965353648192, 0.09685543343532478, 0.09867363340722339, 0.1005616420308759, 0.10251680052668549, 0.10453634768787903, 0.10661736618375353, 0.10875673380664506, 0.11095108270390211, 0.11319676893484469, 0.11548985389361886, 0.11782609831668617, 0.12020096881536325, 0.12260965619306695 ], [ 0.10265608587991527, 0.10044990667753352, 0.0983506122786, 0.09636412423890704, 0.09449544673254592, 0.09274863968182732, 0.09112682293782066, 0.08963221175297933, 0.08826618160486581, 0.08702935821524473, 0.08592172660251192, 0.08494275144925385, 0.08409150016731505, 0.08336675993951377, 0.0827671407587058, 0.08229115801879455, 0.08193729038852961, 0.0817040112860744, 0.08158979498374123, 0.08159310089966063, 0.08171234168425161, 0.08194584204648596, 0.08229179573950575, 0.08274822770246182, 0.08331296712314341, 0.08398363534199293, 0.08475765033845484, 0.08563224733133853, 0.08660451306974984, 0.08767142990701257, 0.08882992485933724, 0.09007691857750096, 0.09140936944429129, 0.09282430873808697, 0.09431886383503765, 0.09589026762034683, 0.09753585352060086, 0.09925303675314885, 0.10103928343524522, 0.10289207004421642, 0.10480883632675861, 0.10678693509513089, 0.10882358241483368, 0.11091581149764694, 0.1130604332009855, 0.11525400545121528, 0.11749281321704484, 0.11977285992470278, 0.12208987049056622, 0.12443930550048582 ], [ 0.10376558546148795, 0.10162361537792497, 0.0995910216180341, 0.09767349903100592, 0.09587576998109308, 0.09420155932741915, 0.09265360242057862, 0.09123368623953859, 0.08994272148032678, 0.08878084109375221, 0.0877475187082871, 0.0868416988139904, 0.08606192972586058, 0.08540649031493884, 0.08487350231972367, 0.08446102165329085, 0.0841671043339416, 0.08398984524845585, 0.0839273906238645, 0.08397792754386627, 0.08413965583293788, 0.08441074893587103, 0.08478931091876526, 0.08527333638726957, 0.08586067904289273, 0.0865490329559631, 0.08733592866692068, 0.08821874420439312, 0.08919472927980912, 0.09026103948039155, 0.09141477635361016, 0.0926530288918052, 0.09397291204808579, 0.09537159845542573, 0.09684634036496677, 0.09839447984699623, 0.10001344639782946, 0.10170074217298819, 0.10345391604414252, 0.1052705284935824, 0.10714810997097361, 0.10908411571486848, 0.11107588017577326, 0.11312057407696315, 0.11521516684037485, 0.11735639662933492, 0.11954074967003588, 0.12176444986620279, 0.12402345907151135, 0.12631348778014415 ], [ 0.10497898325160296, 0.1029028563742083, 0.10093826241716355, 0.09909064827733166, 0.09736443903867206, 0.09576301562912751, 0.09428872719900126, 0.09294293816517009, 0.09172610744940549, 0.09063789505748533, 0.08967728906415141, 0.08884274453541088, 0.08813232512680623, 0.0875438381504521, 0.08707495480951223, 0.08672330895891883, 0.08648656998158645, 0.0863624879242386, 0.0863489116406164, 0.086443783068292, 0.08664511267777963, 0.08695094239727874, 0.08735930283089083, 0.08786817134080503, 0.08847543663425574, 0.08917887404198939, 0.08997613390911861, 0.09086474367562501, 0.09184212252313202, 0.09290560608344055, 0.09405247775575643, 0.09528000270668469, 0.09658546061061986, 0.09796617356195685, 0.0994195262616016, 0.10094297644589559, 0.10253405448752058, 0.10419035206700322, 0.10590950071603973, 0.1076891418100663, 0.10952689019228243, 0.11142029401451706, 0.11336679356814203, 0.11536368185343167, 0.11740806941749668, 0.11949685561226084, 0.1216267079284641, 0.12379405049817917, 0.1259950622759609, 0.1282256848520813 ], [ 0.1062952933037344, 0.104286258981239, 0.10239054080589395, 0.10061331898335796, 0.09895870942655298, 0.09742974486607156, 0.09602839207151088, 0.09475560489475196, 0.09361141035650693, 0.09259502258376717, 0.09170497733818665, 0.09093927839740899, 0.09029554634152992, 0.08977116044155369, 0.08936338532852559, 0.08906947582498781, 0.08888675554947695, 0.08881266741390836, 0.0888447966577189, 0.0889808693476627, 0.08921873110236916, 0.08955631201930729, 0.0899915843053761, 0.09052251893770255, 0.09114704688286882, 0.09186302912120263, 0.09266823814338551, 0.09356035191321649, 0.0945369597164036, 0.0955955779989529, 0.09673367334662814, 0.0979486892175562, 0.09923807290829983, 0.10059929946242759, 0.10202988974595417, 0.10352742062974679, 0.10508952604823293, 0.10671388856586284, 0.10839822190789036, 0.11014024564176787, 0.11193765378479849, 0.11378807953096477, 0.1156890585181366, 0.1176379930943533, 0.11963211990121483, 0.12166848279965374, 0.1237439127539821, 0.1258550158061503, 0.12799816975664527, 0.13016952966214024 ], [ 0.10771266005933407, 0.10577157783644135, 0.10394519189499031, 0.10223840032734971, 0.10065500216054846, 0.0991976825910722, 0.09786803536165355, 0.0966666217153201, 0.09559306283265534, 0.09464616024863676, 0.09382403672499125, 0.0931242886563233, 0.09254414047475813, 0.09208059175385969, 0.0917305487603141, 0.09149093393049416, 0.09135876895694325, 0.09133122961485891, 0.09140567288902621, 0.09157963914402642, 0.09185083382299934, 0.09221709432819399, 0.09267634826302232, 0.0932265691033507, 0.09386573468492083, 0.09459179276831423, 0.09540263653458547, 0.09629609135051902, 0.09726991269178, 0.09832179386634582, 0.09944938123893197, 0.10065029407112779, 0.10192214586754295, 0.10326256422375592, 0.10466920654997186, 0.1061397696236945, 0.10767199162987684, 0.10926364610547816, 0.11091252795170899, 0.11261643235582598, 0.11437312803053436, 0.11618032660030886, 0.11803565022117599, 0.11993659960762748, 0.12188052456528256, 0.12386459890997242, 0.12588580132223154, 0.12794090327610966, 0.13002646473037913, 0.13213883781533625 ], [ 0.10922836968054203, 0.10735571298049798, 0.1055987091908601, 0.10396196277687803, 0.10244895267661155, 0.1010620221830171, 0.09980240661249061, 0.09867029789208494, 0.09766494266418188, 0.09678476813722539, 0.09602752796738566, 0.09539045915830185, 0.0948704404563452, 0.09446414304167712, 0.0941681654154107, 0.09397914611858738, 0.09389385008590422, 0.09390922680151367, 0.09402244074920754, 0.0942308767223929, 0.09453212421048016, 0.09492394619284072, 0.09540423819576747, 0.09597098340959796, 0.0966222090866, 0.09735594845521708, 0.09817021113372733, 0.09906296366001274, 0.10003212042194984, 0.10107554410091762, 0.10219105382101631, 0.10337643858149745, 0.10462947325343301, 0.10594793442476408, 0.10732961363718754, 0.10877232601567557, 0.11027391288213349, 0.11183223760425873, 0.11344517459887175, 0.11511059203331417, 0.11682632930538298, 0.11859017079915118, 0.12039981768970999, 0.12225285969566073, 0.12414674865726787, 0.1260787756647506, 0.12804605319851597, 0.13004550340075666, 0.1320738532083505, 0.1341276366730615 ], [ 0.1108388841294359, 0.10903475215493369, 0.10734679523714352, 0.10577931695662929, 0.10433547754283176, 0.10301728875148645, 0.10182564677534889, 0.10076040200670236, 0.09982046196770332, 0.09900392142596569, 0.09830821187035735, 0.09773026133784564, 0.09726665517795631, 0.09691378874217842, 0.0966680041217074, 0.09652570477970619, 0.09648344403249948, 0.09653798560340386, 0.09668633668351341, 0.09692575589322164, 0.09725374009671808, 0.09766799508140972, 0.09816639563241204, 0.09874694051979822, 0.09940770743207054, 0.10014681203016834, 0.10096237418499936, 0.1018524932315042, 0.10281523285287571, 0.1038486151120686, 0.10495062225839877, 0.10611920430762249, 0.10735229004354255, 0.10864779900902569, 0.110003652212356, 0.11141777962454295, 0.11288812302977555, 0.11441263335786274, 0.1159892622196718, 0.11761594793504217, 0.11929059684579249, 0.12101106111185429, 0.12277511447405437, 0.12458042762155531, 0.1264245448249365, 0.12830486339729588, 0.13021861734358964, 0.13216286627728344, 0.13413449035109531, 0.1361301915940571 ], [ 0.11253989522566264, 0.11080403216566423, 0.10918442998801564, 0.10768508849171225, 0.10630885498968128, 0.10505742434420753, 0.10393137689121253, 0.10293025276401538, 0.10205265868823135, 0.10129640111998188, 0.10065863787702777, 0.10013603934943104, 0.09972495007403895, 0.09942154192350405, 0.09922195131505618, 0.09912239453577673, 0.09911925731397325, 0.09920915692880013, 0.09938897724011903, 0.09965587886422671, 0.10000728818708704, 0.10044086991126223, 0.1009544883420933, 0.1015461626453436, 0.10221402090586636, 0.1029562570703282, 0.10377109387338423, 0.10465675374194486, 0.10561143855951483, 0.1066333181515202, 0.10772052650054645, 0.10887116406851909, 0.11008330421446438, 0.11135500154994545, 0.11268430014731752, 0.11406923977192823, 0.11550785870233991, 0.11699819218336606, 0.11853826607599575, 0.12012608578081266, 0.12175962097785252, 0.12343678711436513, 0.12515542485992795, 0.1269132789228816, 0.12870797767992878, 0.1305370150179042, 0.13239773563708038, 0.1342873248389054, 0.13620280354140393, 0.13814102895776295 ], [ 0.11432639526785594, 0.11265821561526723, 0.111105952998891, 0.10967330478168975, 0.10836281518854374, 0.10717588048146692, 0.10611279151014587, 0.10517281186114857, 0.10435428748211859, 0.10365478157877026, 0.10307122699220678, 0.10260008732409745, 0.1022375178693074, 0.10197951793322711, 0.10182206726654847, 0.10176124099337865, 0.10179329935242241, 0.10191475061796411, 0.10212238753254535, 0.10241329931114147, 0.10278486265141167, 0.1032347161350088, 0.10376072290339987, 0.10436092655167957, 0.1050335048533797, 0.10577672528335837, 0.10658890543746184, 0.10746838045761888, 0.10841347855856828, 0.10942250480565685, 0.11049373248302209, 0.11162540076677059, 0.11281571700435278, 0.11406286170327996, 0.11536499433512314, 0.11672025823600812, 0.11812678319472755, 0.11958268472166442, 0.12108605944225434, 0.12263497651636943, 0.1242274654128557, 0.1258615007359637, 0.1275349850849689, 0.1292457311155872, 0.13099144405648877, 0.13276970591910014, 0.13457796253425322, 0.13641351437101565, 0.13827351186115605, 0.14015495568884126 ], [ 0.11619276043333356, 0.11459137904672168, 0.11310515538791999, 0.11173748966715973, 0.11049063635763888, 0.1093657143282602, 0.10836275350417739, 0.10748077602376588, 0.10671790762871439, 0.10607151308219871, 0.10553834795846988, 0.10511471832732659, 0.1047966397328623, 0.10457998741964415, 0.10446063089945111, 0.10443454753189307, 0.10449791163629661, 0.1046471575778471, 0.10487901711002053, 0.10519053286895765, 0.10557905120167942, 0.1060421984075629, 0.1065778449588885, 0.10718406235471316, 0.10785907699562328, 0.10860122491089705, 0.10940891040505688, 0.11028057080564847, 0.11121464857513044, 0.11220957117531247, 0.1132637383073755, 0.11437551554039695, 0.11554323291371538, 0.11676518686158495, 0.11803964375416771, 0.11936484345556113, 0.120739001536507, 0.12216030911037616, 0.1236269296475872, 0.125136992528394, 0.1266885834826828, 0.1282797324091929, 0.1299083993429431, 0.13157245953371863, 0.13326968870305203, 0.13499774956258082, 0.1367541806100715, 0.13853638808335839, 0.1403416417634192, 0.1421670750944561 ], [ 0.11813284306482483, 0.11659710854450273, 0.1151753776402659, 0.11387076218478417, 0.11268524311687712, 0.11161968525097024, 0.1106738874372884, 0.1098466658676795, 0.10913596618269081, 0.10853899824020327, 0.10805238609417919, 0.10767232502570256, 0.10739473741613896, 0.10721541982721089, 0.10713017476272002, 0.10713492209205118, 0.10722578685229285, 0.10739916194679601, 0.1076517459716164, 0.10798055790342662, 0.10838293158344903, 0.10885649377854238, 0.10939913007389516, 0.11000894296446233, 0.11068420630186167, 0.111423319777619, 0.1122247664526845, 0.11308707555357855, 0.11400879192350202, 0.11498845271194603, 0.11602457116708677, 0.1171156268053521, 0.11826006079949052, 0.1194562751614737, 0.12070263419645431, 0.12199746675289352, 0.12333906796753402, 0.12472569947115025, 0.1261555873487885, 0.1276269175027158, 0.1291378284162989, 0.1306864016352596, 0.1322706505473971, 0.1338885082377667, 0.13553781531487533, 0.13721630864311385, 0.1389216118818663, 0.1406512286321074, 0.1424025388403734, 0.14417279892349866 ], [ 0.12014006907910879, 0.11866859906155729, 0.11730960964371333, 0.1160659360085573, 0.11493930398557366, 0.11393034902810122, 0.11303866920465, 0.11226290979137044, 0.11160087509790388, 0.11104966151423779, 0.11060580459112525, 0.11026543236462756, 0.1100244171418952, 0.10987851854780412, 0.10982351169981333, 0.10985529580019376, 0.10996998005941049, 0.11016394554017363, 0.11043388310212846, 0.11077680902171334, 0.11119006098115146, 0.11167127791817003, 0.1122183676878175, 0.11282946662072733, 0.11350289490145925, 0.11423711128619038, 0.11503067009218407, 0.11588218268890953, 0.11679028496920611, 0.1177536115404169, 0.1187707767028699, 0.11984036171733832, 0.12096090743150689, 0.12213091105144364, 0.1233488257079338, 0.12461306146866223, 0.12592198656605041, 0.12727392782149127, 0.12866716952091092, 0.1300999503040924, 0.1315704579425277, 0.13307682217240555, 0.13461710599972138, 0.13618929608820912, 0.1377912929685042, 0.13942090186527145, 0.14107582493048149, 0.14275365560251693, 0.14445187569334964, 0.14616785565281204 ], [ 0.12220753704211061, 0.12079875412745712, 0.11950058979865505, 0.11831561668281958, 0.11724532545904058, 0.11629014753882354, 0.11544951019581531, 0.1147219216119534, 0.11410508150290245, 0.1135960114913016, 0.11319119835155927, 0.11288674274166095, 0.11267850609043212, 0.11256224888676393, 0.1125337546333443, 0.11258893505968463, 0.1127239136997967, 0.11293508649175055, 0.11321915952726445, 0.11357316537108596, 0.11399446041171975, 0.11448070645596023, 0.1150298402253669, 0.11564003456273793, 0.11630965503952852, 0.11703721531441197, 0.11782133408188773, 0.11866069582629726, 0.11955401691946481, 0.12050001792454937, 0.12149740234240268, 0.12254484149790065, 0.12364096483902443, 0.12478435462566825, 0.12597354382160011, 0.12720701596487224, 0.12848320586419484, 0.12980050013024302, 0.13115723677678662, 0.13255170339048394, 0.13398213364456776, 0.13544670219688346, 0.13694351824719334, 0.13847061821713583, 0.14002595814893198, 0.14160740649131548, 0.1432127379537824, 0.1448396290681792, 0.1464856560082804, 0.1481482950944996 ], [ 0.12432811589312966, 0.12298028308566393, 0.12174090057881184, 0.12061229430914339, 0.11959574066004916, 0.11869149229530984, 0.11789883474004528, 0.11721617110269893, 0.11664113067978994, 0.11617069583692984, 0.11580134063641229, 0.11552917425591996, 0.11535008233073436, 0.11525985991549464, 0.1152543307189826, 0.1153294485048968, 0.11548137794836906, 0.11570655366903243, 0.1160017175176298, 0.11636393538670403, 0.11679059578421304, 0.11727939311518155, 0.11782829904762697, 0.11843552550274741, 0.11909948273039264, 0.11981873564647012, 0.12059196116542795, 0.121417908708996, 0.12229536546363726, 0.12322312734264555, 0.12419997602778927, 0.1252246619551882, 0.12629589269647487, 0.1274123258847786, 0.128572565651244, 0.12977516146798962, 0.1310186083262949, 0.13230134729725504, 0.13362176570488274, 0.13497819636576275, 0.13636891559179987, 0.1377921398917241, 0.1392460215244706, 0.14072864323850467, 0.14223801266558048, 0.14377205691982642, 0.14532861798260133, 0.14690544943345804, 0.14850021502437544, 0.1501104894971028 ], [ 0.12649453881311618, 0.12520579355182235, 0.12402305847909076, 0.12294842990757875, 0.12198299109914965, 0.12112684068407757, 0.12037915003579139, 0.11973824696471105, 0.11920172159289696, 0.1187665490621846, 0.11842922291689428, 0.11818589264780067, 0.11803249899651194, 0.11796490116085546, 0.11797899093623997, 0.11807078997377407, 0.11823652762113106, 0.11847269812680544, 0.1187760972352485, 0.11914383930112704, 0.11957335694982316, 0.12006238597488458, 0.12060893857936696, 0.12121126824267846, 0.12186782944863886, 0.12257723527601914, 0.12333821546990055, 0.12414957712499342, 0.12501016956609362, 0.12591885444964768, 0.12687448157318174, 0.12787587039861026, 0.1289217968959747, 0.1300109850118106, 0.131142101868205, 0.1323137557037727, 0.13352449556781965, 0.13477281186025972, 0.13605713695447408, 0.13737584532822775, 0.13872725283854703, 0.14010961499039692, 0.1415211242489659, 0.14295990661715585, 0.14442401783336445, 0.14591143963376693, 0.14742007656599934, 0.14894775383921396, 0.1504922166537552, 0.15205113137936702 ], [ 0.1286994912700158, 0.12746787733459544, 0.1263395968324395, 0.12531653419770764, 0.124399600566348, 0.12358876421913235, 0.12288310814083009, 0.12228091206768485, 0.1217797550383255, 0.12137663338461756, 0.12106808838832783, 0.12085033753595739, 0.12071940343241824, 0.12067123494773761, 0.12070181599995948, 0.12080725843061917, 0.12098387660647489, 0.12122824258482223, 0.12153722182307186, 0.12190799042666611, 0.12233803576268988, 0.12282514288948759, 0.12336736965339319, 0.12396301348669445, 0.12461057292341586, 0.12530870665911933, 0.12605619265195211, 0.12685188933348, 0.127694700509228, 0.12858354501928704, 0.12951733173401506, 0.13049494000896153, 0.13151520534006736, 0.13257690966077806, 0.13367877551546764, 0.13481946322917399, 0.13599757016676217, 0.13721163122414196, 0.13846011980528486, 0.13974144869422964, 0.14105397041279713, 0.1423959768447401, 0.14376569808949433, 0.14516130067021996, 0.14658088535136307, 0.14802248491400025, 0.14948406228990332, 0.15096350946809997, 0.1524586475640824, 0.15396722838748486 ], [ 0.13093569179935216, 0.12975918858076904, 0.12868314047874463, 0.1277092380133662, 0.1268382405997092, 0.12607000847690816, 0.12540355990298455, 0.1248371510293951, 0.12436837464960306, 0.12399427305779712, 0.12371145963361951, 0.12351624352649575, 0.12340475195018984, 0.12337304507987837, 0.12341721930717328, 0.12353349557170268, 0.12371829056210949, 0.12396826967795807, 0.12428038169009006, 0.12465187596833678, 0.1250803039170192, 0.12556350684269954, 0.12609959286373212, 0.12668690565988777, 0.12732398786707316, 0.1280095417702489, 0.12874238966679022, 0.1295214358963939, 0.1303456320974541, 0.13121394678805948, 0.13212533991441447, 0.133078742588153, 0.13407304186882527, 0.13510707015450799, 0.1361795985311471, 0.13728933330229764, 0.1384349148720601, 0.1396149181766966, 0.14082785394235928, 0.1420721701727652, 0.14334625342556567, 0.14464842960352967, 0.1459769641520125, 0.1473300617047246, 0.14870586534584776, 0.15010245575127507, 0.15151785053166922, 0.1529500041246633, 0.15439680857507704, 0.15585609550482307 ], [ 0.13319596456227908, 0.13207251337358333, 0.1310464717075005, 0.13011935396430568, 0.1292917873275815, 0.12856354467897038, 0.12793360094780373, 0.12740021037871727, 0.12696100110916061, 0.1266130826006134, 0.12635316092709747, 0.12617765672509135, 0.126082820749035, 0.1260648424241192, 0.12611994748638922, 0.1262444816770973, 0.12643497843504947, 0.12668820953071536, 0.12700121854093332, 0.12737133791758862, 0.12779619111709048, 0.12827368180429377, 0.1288019725134369, 0.1293794553408871, 0.13000471727159896, 0.1306765026228101, 0.1313936748502205, 0.13215517963302026, 0.13296001076554226, 0.13380717996584376, 0.13469569129391615, 0.13562452047988907, 0.1365925991162724, 0.13759880338334735, 0.1386419467628169, 0.13972077605543784, 0.14083396995195901, 0.1419801394069243, 0.14315782912163708, 0.14436551954336183, 0.14560162891852252, 0.14686451508406947, 0.1481524768299842, 0.1494637548051715, 0.15079653205936822, 0.15214893440832822, 0.15351903087441487, 0.15490483448859926, 0.15630430374389526, 0.15771534496772335 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.69036 (SEM: 0)
x1: 0.913539
x2: 0.451657
x3: 0.0361037
x4: 0.494959
x5: 0.926987
x6: 0.844505", "Arm 10_0
l2norm: 1.45902 (SEM: 0)
x1: 0.733783
x2: 0.2324
x3: 0.691818
x4: 0.418272
x5: 0.918006
x6: 0.199997", "Arm 11_0
l2norm: 1.34496 (SEM: 0)
x1: 0.793316
x2: 0.409269
x3: 0.130285
x4: 0.66826
x5: 0.708578
x6: 0.215471", "Arm 12_0
l2norm: 1.20125 (SEM: 0)
x1: 0.0294209
x2: 0.699927
x3: 0.607533
x4: 0.298354
x5: 0.467813
x6: 0.524664", "Arm 13_0
l2norm: 1.15926 (SEM: 0)
x1: 0.0339181
x2: 0.697664
x3: 0.578632
x4: 0.293918
x5: 0.425533
x6: 0.503699", "Arm 14_0
l2norm: 1.09433 (SEM: 0)
x1: 0.0309133
x2: 0.693369
x3: 0.536587
x4: 0.286185
x5: 0.353296
x6: 0.470318", "Arm 15_0
l2norm: 1.11042 (SEM: 0)
x1: 0.0943699
x2: 0.726697
x3: 0.496596
x4: 0.333808
x5: 0.349024
x6: 0.464961", "Arm 16_0
l2norm: 1.01504 (SEM: 0)
x1: 0.0345985
x2: 0.622082
x3: 0.517693
x4: 0.229542
x5: 0.365355
x6: 0.433537", "Arm 17_0
l2norm: 0.959689 (SEM: 0)
x1: 0.0690146
x2: 0.570054
x3: 0.521212
x4: 0.182726
x5: 0.370583
x6: 0.38587", "Arm 18_0
l2norm: 0.961312 (SEM: 0)
x1: 0.0224459
x2: 0.581894
x3: 0.437783
x4: 0.214504
x5: 0.383952
x6: 0.447136", "Arm 19_0
l2norm: 0.932966 (SEM: 0)
x1: 1.227e-17
x2: 0.5153
x3: 0.408581
x4: 0.212934
x5: 0.370364
x6: 0.505413", "Arm 1_0
l2norm: 1.626 (SEM: 0)
x1: 0.0670579
x2: 0.745941
x3: 0.830122
x4: 0.15338
x5: 0.963321
x6: 0.665076", "Arm 20_0
l2norm: 0.923058 (SEM: 0)
x1: 5.76228e-17
x2: 0.460474
x3: 0.427233
x4: 0.2176
x5: 0.322838
x6: 0.55308", "Arm 21_0
l2norm: 0.922636 (SEM: 0)
x1: 0.00266606
x2: 0.396277
x3: 0.44834
x4: 0.226385
x5: 0.255893
x6: 0.613576", "Arm 22_0
l2norm: 0.92727 (SEM: 0)
x1: 2.97138e-18
x2: 0.355183
x3: 0.465979
x4: 0.15732
x5: 0.241953
x6: 0.658216", "Arm 23_0
l2norm: 0.932623 (SEM: 0)
x1: 1.00082e-18
x2: 0.35846
x3: 0.459722
x4: 0.3055
x5: 0.22781
x6: 0.620258", "Arm 2_0
l2norm: 1.49977 (SEM: 0)
x1: 0.776879
x2: 0.544803
x3: 0.893388
x4: 0.526455
x5: 0.0247847
x6: 0.522538", "Arm 3_0
l2norm: 1.5379 (SEM: 0)
x1: 0.868321
x2: 0.616498
x3: 0.060225
x4: 0.784603
x5: 0.437796
x6: 0.648229", "Arm 4_0
l2norm: 1.29123 (SEM: 0)
x1: 0.0295862
x2: 0.712975
x3: 0.673364
x4: 0.2787
x5: 0.546706
x6: 0.572797", "Arm 5_0
l2norm: 1.64779 (SEM: 0)
x1: 0.940208
x2: 0.376252
x3: 0.572658
x4: 0.951143
x5: 0.0375807
x6: 0.675014", "Arm 6_0
l2norm: 1.37981 (SEM: 0)
x1: 0.532947
x2: 0.193913
x3: 0.037903
x4: 0.612183
x5: 0.84777
x6: 0.69808", "Arm 7_0
l2norm: 1.33935 (SEM: 0)
x1: 0.272457
x2: 0.745856
x3: 0.0350414
x4: 0.0441846
x5: 0.984514
x6: 0.436884", "Arm 8_0
l2norm: 1.30203 (SEM: 0)
x1: 0.855132
x2: 0.449664
x3: 0.376137
x4: 0.748953
x5: 0.242862
x6: 0.0210967", "Arm 9_0
l2norm: 1.27295 (SEM: 0)
x1: 0.812203
x2: 0.185297
x3: 0.470112
x4: 0.351848
x5: 0.722785
x6: 0.24327" ], "type": "scatter", "x": [ 0.036103688180446625, 0.6918177753686905, 0.13028471637517214, 0.6075326538488266, 0.5786322872671363, 0.536587345820458, 0.4965959592381611, 0.5176926868513877, 0.5212123579656817, 0.43778262726721706, 0.4085813247088046, 0.8301220880821347, 0.42723315075017915, 0.4483399152602926, 0.46597864217170787, 0.4597224593824701, 0.8933879937976599, 0.0602249950170517, 0.6733638839796185, 0.572657972574234, 0.03790299966931343, 0.03504142723977566, 0.37613670155406, 0.4701121710240841 ], "xaxis": "x", "y": [ 0.49495935440063477, 0.41827157512307167, 0.6682604653760791, 0.29835389521529543, 0.2939183465800109, 0.2861848319536658, 0.3338080776238236, 0.22954162735814057, 0.18272645166681675, 0.2145035705197551, 0.21293384183498437, 0.153380136936903, 0.21760028712547938, 0.22638495589311708, 0.15732042339315605, 0.3055004268695108, 0.5264546629041433, 0.7846030127257109, 0.27870048489421606, 0.9511425057426095, 0.6121826218441129, 0.04418458975851536, 0.7489525564014912, 0.3518475294113159 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.69036 (SEM: 0)
x1: 0.913539
x2: 0.451657
x3: 0.0361037
x4: 0.494959
x5: 0.926987
x6: 0.844505", "Arm 10_0
l2norm: 1.45902 (SEM: 0)
x1: 0.733783
x2: 0.2324
x3: 0.691818
x4: 0.418272
x5: 0.918006
x6: 0.199997", "Arm 11_0
l2norm: 1.34496 (SEM: 0)
x1: 0.793316
x2: 0.409269
x3: 0.130285
x4: 0.66826
x5: 0.708578
x6: 0.215471", "Arm 12_0
l2norm: 1.20125 (SEM: 0)
x1: 0.0294209
x2: 0.699927
x3: 0.607533
x4: 0.298354
x5: 0.467813
x6: 0.524664", "Arm 13_0
l2norm: 1.15926 (SEM: 0)
x1: 0.0339181
x2: 0.697664
x3: 0.578632
x4: 0.293918
x5: 0.425533
x6: 0.503699", "Arm 14_0
l2norm: 1.09433 (SEM: 0)
x1: 0.0309133
x2: 0.693369
x3: 0.536587
x4: 0.286185
x5: 0.353296
x6: 0.470318", "Arm 15_0
l2norm: 1.11042 (SEM: 0)
x1: 0.0943699
x2: 0.726697
x3: 0.496596
x4: 0.333808
x5: 0.349024
x6: 0.464961", "Arm 16_0
l2norm: 1.01504 (SEM: 0)
x1: 0.0345985
x2: 0.622082
x3: 0.517693
x4: 0.229542
x5: 0.365355
x6: 0.433537", "Arm 17_0
l2norm: 0.959689 (SEM: 0)
x1: 0.0690146
x2: 0.570054
x3: 0.521212
x4: 0.182726
x5: 0.370583
x6: 0.38587", "Arm 18_0
l2norm: 0.961312 (SEM: 0)
x1: 0.0224459
x2: 0.581894
x3: 0.437783
x4: 0.214504
x5: 0.383952
x6: 0.447136", "Arm 19_0
l2norm: 0.932966 (SEM: 0)
x1: 1.227e-17
x2: 0.5153
x3: 0.408581
x4: 0.212934
x5: 0.370364
x6: 0.505413", "Arm 1_0
l2norm: 1.626 (SEM: 0)
x1: 0.0670579
x2: 0.745941
x3: 0.830122
x4: 0.15338
x5: 0.963321
x6: 0.665076", "Arm 20_0
l2norm: 0.923058 (SEM: 0)
x1: 5.76228e-17
x2: 0.460474
x3: 0.427233
x4: 0.2176
x5: 0.322838
x6: 0.55308", "Arm 21_0
l2norm: 0.922636 (SEM: 0)
x1: 0.00266606
x2: 0.396277
x3: 0.44834
x4: 0.226385
x5: 0.255893
x6: 0.613576", "Arm 22_0
l2norm: 0.92727 (SEM: 0)
x1: 2.97138e-18
x2: 0.355183
x3: 0.465979
x4: 0.15732
x5: 0.241953
x6: 0.658216", "Arm 23_0
l2norm: 0.932623 (SEM: 0)
x1: 1.00082e-18
x2: 0.35846
x3: 0.459722
x4: 0.3055
x5: 0.22781
x6: 0.620258", "Arm 2_0
l2norm: 1.49977 (SEM: 0)
x1: 0.776879
x2: 0.544803
x3: 0.893388
x4: 0.526455
x5: 0.0247847
x6: 0.522538", "Arm 3_0
l2norm: 1.5379 (SEM: 0)
x1: 0.868321
x2: 0.616498
x3: 0.060225
x4: 0.784603
x5: 0.437796
x6: 0.648229", "Arm 4_0
l2norm: 1.29123 (SEM: 0)
x1: 0.0295862
x2: 0.712975
x3: 0.673364
x4: 0.2787
x5: 0.546706
x6: 0.572797", "Arm 5_0
l2norm: 1.64779 (SEM: 0)
x1: 0.940208
x2: 0.376252
x3: 0.572658
x4: 0.951143
x5: 0.0375807
x6: 0.675014", "Arm 6_0
l2norm: 1.37981 (SEM: 0)
x1: 0.532947
x2: 0.193913
x3: 0.037903
x4: 0.612183
x5: 0.84777
x6: 0.69808", "Arm 7_0
l2norm: 1.33935 (SEM: 0)
x1: 0.272457
x2: 0.745856
x3: 0.0350414
x4: 0.0441846
x5: 0.984514
x6: 0.436884", "Arm 8_0
l2norm: 1.30203 (SEM: 0)
x1: 0.855132
x2: 0.449664
x3: 0.376137
x4: 0.748953
x5: 0.242862
x6: 0.0210967", "Arm 9_0
l2norm: 1.27295 (SEM: 0)
x1: 0.812203
x2: 0.185297
x3: 0.470112
x4: 0.351848
x5: 0.722785
x6: 0.24327" ], "type": "scatter", "x": [ 0.036103688180446625, 0.6918177753686905, 0.13028471637517214, 0.6075326538488266, 0.5786322872671363, 0.536587345820458, 0.4965959592381611, 0.5176926868513877, 0.5212123579656817, 0.43778262726721706, 0.4085813247088046, 0.8301220880821347, 0.42723315075017915, 0.4483399152602926, 0.46597864217170787, 0.4597224593824701, 0.8933879937976599, 0.0602249950170517, 0.6733638839796185, 0.572657972574234, 0.03790299966931343, 0.03504142723977566, 0.37613670155406, 0.4701121710240841 ], "xaxis": "x2", "y": [ 0.49495935440063477, 0.41827157512307167, 0.6682604653760791, 0.29835389521529543, 0.2939183465800109, 0.2861848319536658, 0.3338080776238236, 0.22954162735814057, 0.18272645166681675, 0.2145035705197551, 0.21293384183498437, 0.153380136936903, 0.21760028712547938, 0.22638495589311708, 0.15732042339315605, 0.3055004268695108, 0.5264546629041433, 0.7846030127257109, 0.27870048489421606, 0.9511425057426095, 0.6121826218441129, 0.04418458975851536, 0.7489525564014912, 0.3518475294113159 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:43.770091Z", "iopub.status.busy": "2022-08-17T19:15:43.769444Z", "iopub.status.idle": "2022-08-17T19:15:43.834142Z", "shell.execute_reply": "2022-08-17T19:15:43.833413Z" } }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.0003243921355275973, -0.08669078839690729, -0.09648608492594463, -0.09648608492594463, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.6607372671300652, -0.7497918853045514, -0.8125102082354753, -0.8125102082354753, -0.9173110896792622, -0.9173110896792622, -0.997869060149819, -1.355765916621055, -1.7965063842027238, -2.1220293137446187, -2.1220293137446187, -2.156136863878389, -2.156136863878389 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.9135386347770691
x2: 0.45165741443634033
x3: 0.036103688180446625
x4: 0.49495935440063477
x5: 0.9269871115684509
x6: 0.8445050716400146", "
Parameterization:
x1: 0.06705788988620043
x2: 0.7459413688629866
x3: 0.8301220880821347
x4: 0.153380136936903
x5: 0.9633211614564061
x6: 0.6650755507871509", "
Parameterization:
x1: 0.7768792184069753
x2: 0.5448026554659009
x3: 0.8933879937976599
x4: 0.5264546629041433
x5: 0.024784662760794163
x6: 0.5225377567112446", "
Parameterization:
x1: 0.8683210778981447
x2: 0.6164981173351407
x3: 0.0602249950170517
x4: 0.7846030127257109
x5: 0.4377955552190542
x6: 0.6482294108718634", "
Parameterization:
x1: 0.0295861829072237
x2: 0.7129745045676827
x3: 0.6733638839796185
x4: 0.27870048489421606
x5: 0.5467061251401901
x6: 0.5727969901636243", "
Parameterization:
x1: 0.9402077402919531
x2: 0.376251932233572
x3: 0.572657972574234
x4: 0.9511425057426095
x5: 0.037580748088657856
x6: 0.6750141773372889", "
Parameterization:
x1: 0.5329465735703707
x2: 0.19391339737921953
x3: 0.03790299966931343
x4: 0.6121826218441129
x5: 0.8477701712399721
x6: 0.6980803143233061", "
Parameterization:
x1: 0.2724571879953146
x2: 0.7458564909175038
x3: 0.03504142723977566
x4: 0.04418458975851536
x5: 0.9845144832506776
x6: 0.4368838034570217", "
Parameterization:
x1: 0.8551319520920515
x2: 0.4496642220765352
x3: 0.37613670155406
x4: 0.7489525564014912
x5: 0.24286160059273243
x6: 0.021096663549542427", "
Parameterization:
x1: 0.8122031195089221
x2: 0.1852972898632288
x3: 0.4701121710240841
x4: 0.3518475294113159
x5: 0.7227854384109378
x6: 0.24327023699879646", "
Parameterization:
x1: 0.7337829982861876
x2: 0.23239983338862658
x3: 0.6918177753686905
x4: 0.41827157512307167
x5: 0.918006194755435
x6: 0.1999965626746416", "
Parameterization:
x1: 0.7933162953704596
x2: 0.4092694194987416
x3: 0.13028471637517214
x4: 0.6682604653760791
x5: 0.7085781442001462
x6: 0.2154714735224843", "
Parameterization:
x1: 0.02942091033674606
x2: 0.6999267532650528
x3: 0.6075326538488266
x4: 0.29835389521529543
x5: 0.467813060218767
x6: 0.5246638963889718", "
Parameterization:
x1: 0.0339181322098983
x2: 0.6976643181539205
x3: 0.5786322872671363
x4: 0.2939183465800109
x5: 0.42553262967858896
x6: 0.5036988989625519", "
Parameterization:
x1: 0.030913331319184927
x2: 0.6933691073100374
x3: 0.536587345820458
x4: 0.2861848319536658
x5: 0.3532962264288378
x6: 0.4703180377467387", "
Parameterization:
x1: 0.09436994425524847
x2: 0.7266974168411402
x3: 0.4965959592381611
x4: 0.3338080776238236
x5: 0.34902361651251207
x6: 0.46496147562561607", "
Parameterization:
x1: 0.03459851662454937
x2: 0.6220815194320153
x3: 0.5176926868513877
x4: 0.22954162735814057
x5: 0.3653545680910271
x6: 0.433537368412643", "
Parameterization:
x1: 0.06901455588860919
x2: 0.5700538669109682
x3: 0.5212123579656817
x4: 0.18272645166681675
x5: 0.3705826198412697
x6: 0.3858695941424847", "
Parameterization:
x1: 0.022445891448422878
x2: 0.5818942118229382
x3: 0.43778262726721706
x4: 0.2145035705197551
x5: 0.3839521582244619
x6: 0.44713611314352425", "
Parameterization:
x1: 1.2270045866631363e-17
x2: 0.5152998038428113
x3: 0.4085813247088046
x4: 0.21293384183498437
x5: 0.37036449916195563
x6: 0.5054129874260056", "
Parameterization:
x1: 5.76227517504468e-17
x2: 0.46047354211965513
x3: 0.42723315075017915
x4: 0.21760028712547938
x5: 0.32283825814543665
x6: 0.5530804372008755", "
Parameterization:
x1: 0.002666055860965702
x2: 0.396276904826305
x3: 0.4483399152602926
x4: 0.22638495589311708
x5: 0.25589349416801155
x6: 0.6135755475578063", "
Parameterization:
x1: 2.971375399718648e-18
x2: 0.3551830077687591
x3: 0.46597864217170787
x4: 0.15732042339315605
x5: 0.24195258567469063
x6: 0.65821563267981", "
Parameterization:
x1: 1.000815292059094e-18
x2: 0.35845967662583755
x3: 0.4597224593824701
x4: 0.3055004268695108
x5: 0.2278103481026188
x6: 0.620257672968856", "
Parameterization:
x1: 0.05529513409128939
x2: 0.39286007989304617
x3: 0.41842089069924965
x4: 0.3030785177479662
x5: 0.20524989475818617
x6: 0.6445482977461923" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.0003243921355275973, -0.08669078839690729, -0.09648608492594463, -0.09648608492594463, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.6607372671300652, -0.7497918853045514, -0.8125102082354753, -0.8125102082354753, -0.9173110896792622, -0.9173110896792622, -0.997869060149819, -1.355765916621055, -1.7965063842027238, -2.1220293137446187, -2.1220293137446187, -2.156136863878389, -2.156136863878389 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.0003243921355275973, -0.08669078839690729, -0.09648608492594463, -0.09648608492594463, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.4553174903841534, -0.6607372671300652, -0.7497918853045514, -0.8125102082354753, -0.8125102082354753, -0.9173110896792622, -0.9173110896792622, -0.997869060149819, -1.355765916621055, -1.7965063842027238, -2.1220293137446187, -2.1220293137446187, -2.156136863878389, -2.156136863878389 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.0003243921355275973 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:43.838339Z", "iopub.status.busy": "2022-08-17T19:15:43.838107Z", "iopub.status.idle": "2022-08-17T19:15:43.876918Z", "shell.execute_reply": "2022-08-17T19:15:43.876218Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:43] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:43.880013Z", "iopub.status.busy": "2022-08-17T19:15:43.879785Z", "iopub.status.idle": "2022-08-17T19:15:44.258652Z", "shell.execute_reply": "2022-08-17T19:15:44.257968Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:44] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:44.261943Z", "iopub.status.busy": "2022-08-17T19:15:44.261704Z", "iopub.status.idle": "2022-08-17T19:15:44.274328Z", "shell.execute_reply": "2022-08-17T19:15:44.273598Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:44] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:44.277793Z", "iopub.status.busy": "2022-08-17T19:15:44.277570Z", "iopub.status.idle": "2022-08-17T19:15:49.390427Z", "shell.execute_reply": "2022-08-17T19:15:49.389824Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.0, 'x2': 0.35008, 'x3': 0.443404, 'x4': 0.254367, 'x5': 0.195192, 'x6': 0.574563}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true, "execution": { "iopub.execute_input": "2022-08-17T19:15:49.395293Z", "iopub.status.busy": "2022-08-17T19:15:49.394093Z", "iopub.status.idle": "2022-08-17T19:15:49.403677Z", "shell.execute_reply": "2022-08-17T19:15:49.403107Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:15:49.408578Z", "iopub.status.busy": "2022-08-17T19:15:49.407386Z", "iopub.status.idle": "2022-08-17T19:15:49.422983Z", "shell.execute_reply": "2022-08-17T19:15:49.422399Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 08-17 19:15:49] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-08-17T19:15:49.426502Z", "iopub.status.busy": "2022-08-17T19:15:49.426078Z", "iopub.status.idle": "2022-08-17T19:15:49.433028Z", "shell.execute_reply": "2022-08-17T19:15:49.432458Z" } }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.13" } }, "nbformat": 4, "nbformat_minor": 2 }