{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:16] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.850006, 'x2': 0.76179, 'x3': 0.315696, 'x4': 0.066734, 'x5': 0.735019, 'x6': 0.515815}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.006575, 0.0), 'l2norm': (1.487706, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.043553, 'x2': 0.271424, 'x3': 0.384739, 'x4': 0.324967, 'x5': 0.513624, 'x6': 0.312266}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.620567, 0.0), 'l2norm': (0.830972, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.19224, 'x2': 0.632054, 'x3': 0.100307, 'x4': 0.919172, 'x5': 0.736001, 'x6': 0.768069}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.001625, 0.0), 'l2norm': (1.556604, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.525476, 'x2': 0.863703, 'x3': 0.686721, 'x4': 0.9207, 'x5': 0.651213, 'x6': 0.121777}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.659552, 0.0), 'l2norm': (1.66742, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.224889, 'x2': 0.158277, 'x3': 0.404255, 'x4': 0.52086, 'x5': 0.294674, 'x6': 0.464602}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-1.396005, 0.0), 'l2norm': (0.901683, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.247425, 'x2': 0.188518, 'x3': 0.217416, 'x4': 0.81642, 'x5': 0.920121, 'x6': 0.775914}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.009804, 0.0), 'l2norm': (1.503075, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.179999, 'x2': 0.167114, 'x3': 0.995151, 'x4': 0.674075, 'x5': 0.20554, 'x6': 0.59145}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.309888, 0.0), 'l2norm': (1.377349, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.868609, 'x2': 0.926798, 'x3': 0.365419, 'x4': 0.793795, 'x5': 0.306812, 'x6': 0.180303}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.03842, 0.0), 'l2norm': (1.582314, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.128604, 'x2': 0.61249, 'x3': 0.93022, 'x4': 0.186771, 'x5': 0.111331, 'x6': 0.850688}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.787522, 0.0), 'l2norm': (1.424058, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.782812, 'x2': 0.22904, 'x3': 0.296612, 'x4': 0.713423, 'x5': 0.943379, 'x6': 0.655494}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.000983, 0.0), 'l2norm': (1.606811, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.512458, 'x2': 0.432795, 'x3': 0.57399, 'x4': 0.711118, 'x5': 0.144828, 'x6': 0.135688}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.397421, 0.0), 'l2norm': (1.150854, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.531558, 'x2': 0.98588, 'x3': 0.958956, 'x4': 0.366984, 'x5': 0.101068, 'x6': 0.807794}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:17] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.062056, 0.0), 'l2norm': (1.723813, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:23] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.197965, 'x2': 0.145229, 'x3': 0.402411, 'x4': 0.46014, 'x5': 0.217291, 'x6': 0.509765}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:23] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.764366, 0.0), 'l2norm': (0.860826, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:29] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.171488, 'x2': 0.136352, 'x3': 0.393499, 'x4': 0.403711, 'x5': 0.160123, 'x6': 0.55306}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:29] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.810351, 0.0), 'l2norm': (0.835068, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:35] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.184576, 'x2': 0.084301, 'x3': 0.416101, 'x4': 0.444417, 'x5': 0.132553, 'x6': 0.479758}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:35] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.192425, 0.0), 'l2norm': (0.812133, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:42] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.177896, 'x2': 0.166541, 'x3': 0.390051, 'x4': 0.402515, 'x5': 0.174901, 'x6': 0.564798}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:42] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.974135, 0.0), 'l2norm': (0.850369, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:48] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.168495, 'x2': 0.186258, 'x3': 0.376545, 'x4': 0.397065, 'x5': 0.22146, 'x6': 0.616453}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:48] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.460644, 0.0), 'l2norm': (0.889712, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:55] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.14928, 'x2': 0.18773, 'x3': 0.363237, 'x4': 0.383717, 'x5': 0.25928, 'x6': 0.671505}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:22:55] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.749904, 0.0), 'l2norm': (0.924582, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:01] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.149205, 'x2': 0.192005, 'x3': 0.358198, 'x4': 0.379943, 'x5': 0.26876, 'x6': 0.752812}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:01] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.618359, 0.0), 'l2norm': (0.985266, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:07] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.104355, 'x2': 0.201331, 'x3': 0.343253, 'x4': 0.341127, 'x5': 0.297936, 'x6': 0.672868}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:07] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.92292, 0.0), 'l2norm': (0.909468, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:13] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.041349, 'x2': 0.229878, 'x3': 0.285343, 'x4': 0.360005, 'x5': 0.287942, 'x6': 0.669468}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:14] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.552324, 0.0), 'l2norm': (0.892567, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:20] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.12806, 'x2': 0.194817, 'x3': 0.376268, 'x4': 0.282182, 'x5': 0.314409, 'x6': 0.669244}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:20] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.137867, 0.0), 'l2norm': (0.906807, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:27] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.179306, 'x2': 0.136724, 'x3': 0.379285, 'x4': 0.225713, 'x5': 0.327444, 'x6': 0.674723}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:27] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-3.128371, 0.0), 'l2norm': (0.898954, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:33] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.1188, 'x2': 0.161427, 'x3': 0.435081, 'x4': 0.243633, 'x5': 0.325744, 'x6': 0.677939}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:33] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.16419, 0.0), 'l2norm': (0.92441, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:39] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.172496, 'x2': 0.228954, 'x3': 0.425386, 'x4': 0.247758, 'x5': 0.337602, 'x6': 0.677576}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:39] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.145412, 0.0), 'l2norm': (0.947415, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:39] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.85, 'x2': 0.76, 'x3': 0.32, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.04, 'x2': 0.27, 'x3': 0.38, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.19, 'x2': 0.63, 'x3': 0.1, 'x...
30Sobol3COMPLETED{'3_0': {'x1': 0.53, 'x2': 0.86, 'x3': 0.69, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.22, 'x2': 0.16, 'x3': 0.4, 'x...
50Sobol5COMPLETED{'5_0': {'x1': 0.25, 'x2': 0.19, 'x3': 0.22, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.18, 'x2': 0.17, 'x3': 1.0, 'x...
70Sobol7COMPLETED{'7_0': {'x1': 0.87, 'x2': 0.93, 'x3': 0.37, '...
80Sobol8COMPLETED{'8_0': {'x1': 0.13, 'x2': 0.61, 'x3': 0.93, '...
90Sobol9COMPLETED{'9_0': {'x1': 0.78, 'x2': 0.23, 'x3': 0.3, 'x...
100Sobol10COMPLETED{'10_0': {'x1': 0.51, 'x2': 0.43, 'x3': 0.57, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.53, 'x2': 0.99, 'x3': 0.96, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.2, 'x2': 0.15, 'x3': 0.4, 'x...
131GPEI13COMPLETED{'13_0': {'x1': 0.17, 'x2': 0.14, 'x3': 0.39, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.18, 'x2': 0.08, 'x3': 0.42, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.18, 'x2': 0.17, 'x3': 0.39, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.17, 'x2': 0.19, 'x3': 0.38, ...
171GPEI17COMPLETED{'17_0': {'x1': 0.15, 'x2': 0.19, 'x3': 0.36, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.15, 'x2': 0.19, 'x3': 0.36, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.1, 'x2': 0.2, 'x3': 0.34, 'x...
201GPEI20COMPLETED{'20_0': {'x1': 0.04, 'x2': 0.23, 'x3': 0.29, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.13, 'x2': 0.19, 'x3': 0.38, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.18, 'x2': 0.14, 'x3': 0.38, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.12, 'x2': 0.16, 'x3': 0.44, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.17, 'x2': 0.23, 'x3': 0.43, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.85, 'x2': 0.76, 'x3': 0.32, '... \n", "1 {'1_0': {'x1': 0.04, 'x2': 0.27, 'x3': 0.38, '... \n", "2 {'2_0': {'x1': 0.19, 'x2': 0.63, 'x3': 0.1, 'x... \n", "3 {'3_0': {'x1': 0.53, 'x2': 0.86, 'x3': 0.69, '... \n", "4 {'4_0': {'x1': 0.22, 'x2': 0.16, 'x3': 0.4, 'x... \n", "5 {'5_0': {'x1': 0.25, 'x2': 0.19, 'x3': 0.22, '... \n", "6 {'6_0': {'x1': 0.18, 'x2': 0.17, 'x3': 1.0, 'x... \n", "7 {'7_0': {'x1': 0.87, 'x2': 0.93, 'x3': 0.37, '... \n", "8 {'8_0': {'x1': 0.13, 'x2': 0.61, 'x3': 0.93, '... \n", "9 {'9_0': {'x1': 0.78, 'x2': 0.23, 'x3': 0.3, 'x... \n", "10 {'10_0': {'x1': 0.51, 'x2': 0.43, 'x3': 0.57, ... \n", "11 {'11_0': {'x1': 0.53, 'x2': 0.99, 'x3': 0.96, ... \n", "12 {'12_0': {'x1': 0.2, 'x2': 0.15, 'x3': 0.4, 'x... \n", "13 {'13_0': {'x1': 0.17, 'x2': 0.14, 'x3': 0.39, ... \n", "14 {'14_0': {'x1': 0.18, 'x2': 0.08, 'x3': 0.42, ... \n", "15 {'15_0': {'x1': 0.18, 'x2': 0.17, 'x3': 0.39, ... \n", "16 {'16_0': {'x1': 0.17, 'x2': 0.19, 'x3': 0.38, ... \n", "17 {'17_0': {'x1': 0.15, 'x2': 0.19, 'x3': 0.36, ... \n", "18 {'18_0': {'x1': 0.15, 'x2': 0.19, 'x3': 0.36, ... \n", "19 {'19_0': {'x1': 0.1, 'x2': 0.2, 'x3': 0.34, 'x... \n", "20 {'20_0': {'x1': 0.04, 'x2': 0.23, 'x3': 0.29, ... \n", "21 {'21_0': {'x1': 0.13, 'x2': 0.19, 'x3': 0.38, ... \n", "22 {'22_0': {'x1': 0.18, 'x2': 0.14, 'x3': 0.38, ... \n", "23 {'23_0': {'x1': 0.12, 'x2': 0.16, 'x3': 0.44, ... \n", "24 {'24_0': {'x1': 0.17, 'x2': 0.23, 'x3': 0.43, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.11879979599197747,\n", " 'x2': 0.16142730373374714,\n", " 'x3': 0.4350805061035148,\n", " 'x4': 0.2436327925388976,\n", " 'x5': 0.3257439389979177,\n", " 'x6': 0.6779391031701999}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.9244070391650415, 'hartmann6': -3.164188701851531}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:40] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.9428315445653646, -1.971013796468306, -1.9952536039002584, -2.015237102299383, -2.030694754643711, -2.0414106069034985, -2.047230086395799, -2.0480657205986335, -2.0439002811012212, -2.034787065248922, -2.0208472912359556, -2.002264858266652, -1.9792789615132027, -1.9521752083039463, -1.9212759346146753, -1.886930374539697, -1.8495052181931675, -1.809375943721371, -1.7669191609862156, -1.7225060796090632, -1.6764971205253962, -1.6292376265947124, -1.581054588355805, -1.5322542792442904, -1.4831206850805265, -1.4339146114047119, -1.3848733564831737, -1.3362108455632125, -1.2881181317875476, -1.2407641800412375, -1.1942968611205511, -1.1488440944334626, -1.1045150875931435, -1.061401630523272, -1.0195794099416766, -0.9791093172947194, -0.9400387294036718, -0.902402746317673, -0.8662253752294468, -0.831520652892456, -0.7982937018778468, -0.7665417183184924, -0.7362548905929626, -0.7074172497829516, -0.6800074537647142, -0.6539995075305367, -0.6293634228346873, -0.6060658205663988, -0.5840704794103676, -0.5633388343967732 ], [ -1.967622207412199, -1.9965707428539974, -2.0214881648268976, -2.042046809486461, -2.0579647827315677, -2.069015870422904, -2.0750379193657924, -2.0759389981180054, -2.0717007839318375, -2.0623788531752494, -2.0480998487893975, -2.0290558100122253, -2.0054962169884707, -1.9777184742378324, -1.946057606341133, -1.9108758748674162, -1.8725528835733303, -1.831476565977952, -1.7880352850989918, -1.7426111421736707, -1.695574495829019, -1.6472796312337687, -1.5980614822053518, -1.5482332903030966, -1.4980850777246801, -1.4478828113287245, -1.397868140670324, -1.348258601728119, -1.2992481886911362, -1.2510082077603637, -1.2036883386536126, -1.1574178408407922, -1.1123068521151454, -1.0684477367047764, -1.0259164486417038, -0.9847738835102793, -0.9450671980284866, -0.9068310822464978, -0.8700889735690807, -0.8348542054238438, -0.8011310863081934, -0.7689159072523675, -0.7381978775256558, -0.7089599897703756, -0.6811798167468005, -0.6548302425768808, -0.6298801318409544, -0.6062949401578677, -0.5840372700060944, -0.5630673755558548 ], [ -1.9898347941817744, -2.0194887700924777, -2.0450313913574703, -2.066121972680174, -2.0824669073310917, -2.0938302139811227, -2.100042487873244, -2.1010074961482452, -2.096705804068321, -2.087195073332469, -2.0726070038836406, -2.0531412393615653, -2.0290568538525626, -2.000662223244121, -1.9683041290012537, -1.9323568576745522, -1.8932118909733653, -1.8512685847199672, -1.8069260553454587, -1.7605763530690421, -1.712598905220744, -1.6633561539382082, -1.613190279291873, -1.5624208828620778, -1.5113435017330412, -1.4602288248953705, -1.4093224907164292, -1.3588453537896132, -1.3089941208800069, -1.2599422678900802, -1.2118411620394625, -1.164821325248647, -1.1189937856744807, -1.0744514742488167, -1.0312706318218128, -0.989512200093336, -0.9492231759748706, -0.9104379144410395, -0.8731793694053233, -0.8374602657976515, -0.8032841989407685, -0.7706466596211582, -0.7395359850241771, -0.7099342370378472, -0.6818180104014187, -0.6551591738501558, -0.6299255478438144, -0.6060815227126477, -0.5835886211529459, -0.5624060089893275 ], [ -2.0092842962650526, -2.039574082733613, -2.065681621131356, -2.087254211077201, -2.1039873848131085, -2.1156360569770296, -2.1220240193616635, -2.123050952594742, -2.118696282616509, -2.109019487247842, -2.0941568221944094, -2.0743148216706175, -2.0497612562074354, -2.020814429357109, -1.9878317332593007, -1.9511982769725873, -1.9113162058897082, -1.8685951109739705, -1.8234437329756812, -1.7762630223634241, -1.7274405210080186, -1.6773459758558396, -1.626328065243479, -1.57471210527792, -1.5227986005623202, -1.4708625068381698, -1.4191530806641253, -1.3678942015880386, -1.317285064258108, -1.2675011506419933, -1.218695405250755, -1.170999548455873, -1.1245254742763973, -1.0793666891843212, -1.0355997574345936, -0.9932857261642731, -0.9524715100760847, -0.9131912210136996, -0.8754674322579875, -0.8393123710403513, -0.804729035695276, -0.7717122361672818, -0.740249558346397, -0.7103222540201662, -0.6819060591770343, -0.654971944044152, -0.6294867986510649, -0.6054140579293928, -0.5827142704302987, -0.561345614701774 ], [ -2.0258029878924564, -2.0566505890868747, -2.0832552403136564, -2.105253461001169, -2.1223309828883474, -2.134234452391337, -2.1407814268681853, -2.1418677726775686, -2.1374717370359835, -2.1276542648021604, -2.112555527682306, -2.0923880546445166, -2.06742720803649, -2.0379999612106987, -2.0044729645789596, -1.9672407592895684, -1.926714775860877, -1.8833135140717396, -1.837454094772928, -1.7895452265032623, -1.7399815370039073, -1.6891391676638465, -1.637372502844019, -1.5850118953302859, -1.5323622476331253, -1.4797023131433815, -1.427284589377225, -1.3753356864049076, -1.32405706600658, -1.2736260602406155, -1.2241970912168592, -1.175903026390864, -1.1288566152645028, -1.0831519637773956, -1.0388660118103392, -0.9960599870943683, -0.954780815486305, -0.9150624731292027, -0.8769272705784367, -0.8403870626621216, -0.8054443807766276, -0.7720934866060951, -0.7403213480009398, -0.7101085390457215, -0.6814300672716862, -0.6542561315935529, -0.628552814933685, -0.6042827156908801, -0.5814055222588712, -0.5598785347374773 ], [ -2.03924396782957, -2.07056368433678, -2.097590682278119, -2.119952154980001, -2.1373252963731018, -2.1494494886490223, -2.1561367419625226, -2.1572794365686248, -2.1528545890859165, -2.142924183278385, -2.1276315313266063, -2.1071940847992026, -2.0818934954710344, -2.0520639477459213, -2.0180798082827893, -1.9803434905301422, -1.9392741862913145, -1.8952978566894372, -1.8488386593675015, -1.8003118388585326, -1.7501180165614394, -1.6986387682796655, -1.646233354312308, -1.5932364585247563, -1.5399567925823892, -1.486676426583131, -1.4336507160455767, -1.3811087064600682, -1.3292539094074143, -1.2782653577183645, -1.2282988605541263, -1.1794883920786574, -1.131947559190104, -1.0857711043643237, -1.0410364089473272, -0.9978049702177544, -0.9561238322889674, -0.9160269565337489, -0.8775365218123324, -0.8406641484912981, -0.8054120431795396, -0.771774063392416, -0.7397367030912565, -0.709280001325675, -0.6803783771127582, -0.6530013942910864, -0.6271144604499167, -0.6026794642066787, -0.5796553551331175, -0.5579986705488023 ], [ -2.049484426510897, -2.081183758119567, -2.108552151077602, -2.131209126303504, -2.148824788457566, -2.161132415413568, -2.1679392678950244, -2.1691346213908917, -2.1646941998892206, -2.154680526244834, -2.1392391540833398, -2.1185912258654405, -2.0930232032227183, -2.0628748452449175, -2.0285265276948787, -1.9903868313495718, -1.9488810626917312, -1.9044410954790627, -1.8574966985868755, -1.8084683642827246, -1.7577615626653993, -1.7057623024802824, -1.6528338580436501, -1.5993145151053054, -1.5455161892114577, -1.491723775742395, -1.4381950998781874, -1.3851613462742314, -1.3328278612762416, -1.281375234209565, -1.2309605779057318, -1.1817189416180442, -1.133764801446081, -1.0871935841171754, -1.0420831893712428, -0.9984954842681331, -0.9564777495510695, -0.9160640638597404, -0.8772766162149629, -0.8401269409214762, -0.8046170719815198, -0.7707406163962381, -0.7384837474614419, -0.7078261204334875, -0.6787417138333929, -0.6511996002450624, -0.6251646508085869, -0.6005981777648487, -0.5774585194176435, -0.5557015717815984 ], [ -2.056428489470712, -2.0884092638514016, -2.116032895115768, -2.1389130550935485, -2.156714367367753, -2.169165300887877, -2.176069262360632, -2.1773128529462555, -2.1728704371681546, -2.162804519990548, -2.1472618964286463, -2.126466037020823, -2.1007065884457297, -2.0703271033724175, -2.0357121259855298, -1.997274582907175, -1.955444150793734, -1.910656986882822, -1.8633469803643543, -1.8139385301921576, -1.7628407678285347, -1.7104430998329465, -1.657111926391485, -1.6031883861166079, -1.548986978864781, -1.4947949243324794, -1.4408721235225879, -1.3874516018896152, -1.3347403261824824, -1.2829203008594745, -1.2321498637184916, -1.1825651135024968, -1.1342814143212934, -1.0873949325557415, -1.0419841713892086, -0.9981114762485073, -0.9558244913012676, -0.9151575528540858, -0.876133010150699, -0.8387624678108955, -0.8030479471061153, -0.7689829655547058, -0.7365535360466757, -0.7057390879704692, -0.676513313697017, -0.6488449443523929, -0.6226984591425624, -0.5980347326353435, -0.5748116244012725, -0.5529845153040586 ], [ -2.060009496557719, -2.092169194991868, -2.1199578635827185, -2.1429852785055297, -2.1609123147352123, -2.173464035054308, -2.1804409672958385, -2.1817275124020474, -2.177296611932749, -2.167210159981361, -2.151615123837416, -2.130735847366383, -2.1048634344085704, -2.074343346607524, -2.0395623597881336, -2.000935840512996, -1.9588960195962186, -1.9138816492766564, -1.8663291994079767, -1.8166655947200385, -1.7653024082251003, -1.712631382906669, -1.6590211357237372, -1.6048148927744552, -1.5503291062893865, -1.4958528104034712, -1.4416475821571968, -1.3879479860060044, -1.3349623934090467, -1.2828740829910665, -1.231842540599642, -1.1820048917532489, -1.1334774111102763, -1.086357064463944, -1.0407230482923624, -0.9966383000707012, -0.9541509594515403, -0.913295766145477, -0.8740953850109865, -0.8365616526206701, -0.8006967425371223, -0.7664942488247509, -0.7339401890525493, -0.7030139293036217, -0.6736890345853487, -0.6459340486031419, -0.6197132071844468, -0.5949870897719644, -0.5717132133919038, -0.5498465733826144 ], [ -2.0601915972430382, -2.092424834887674, -2.120285600057206, -2.1433818096848656, -2.161372404019506, -2.173980515288239, -2.18100482510952, -2.182328045161185, -2.1779216438870526, -2.1678463016403033, -2.1522480589503084, -2.131350633631701, -2.105444805644984, -2.074876005085468, -2.040031248412305, -2.0013263864960935, -1.959194344365985, -1.9140747428881073, -1.866405060684646, -1.816613340125237, -1.765112353082677, -1.7122950984448901, -1.6585314849516948, -1.6041660477226733, -1.5495165487878362, -1.494873318344214, -1.4404992030535495, -1.3866299995662803, -1.3334752647533878, -1.281219408035719, -1.2300229850098052, -1.1800241247278225, -1.1313400351179002, -1.0840685419088236, -1.0382896259579013, -0.9940669320743355, -0.9514492293480703, -0.9104718087392436, -0.8711578083785809, -0.833519460803001, -0.7975592593297285, -0.7632710430749436, -0.730641001857785, -0.6996486034944229, -0.6702674468651735, -0.6424660447046372, -0.6162085403846715, -0.5914553630872441, -0.568163825745267, -0.5462886700031591 ], [ -2.0569705747240192, -2.0891706814144975, -2.1170092639299023, -2.140094447388752, -2.1580850848842683, -2.170703887755268, -2.1777487562691853, -2.1791012523798754, -2.1747313450864603, -2.1646979165842453, -2.14914499437989, -2.128294177758758, -2.1024341427343183, -2.071908342667956, -2.0371020341520265, -1.9984295836898824, -1.9563227354917614, -1.911220236915987, -1.863558988048828, -1.8137667263054207, -1.7622561664686147, -1.7094204707647238, -1.6556299037981754, -1.601229521322699, -1.546537743563992, -1.4918456701899705, -1.4374170036133045, -1.3834884591446681, -1.3302705537380644, -1.2779486788834924, -1.2266843769160851, -1.17661675308611, -1.1278639677990183, -1.080524764269511, -1.034679996344372, -0.9903941294337588, -0.9477166944107972, -0.9066836800943513, -0.8673188546387447, -0.8296350099433367, -0.7936351261884401, -0.7593134559197343, -0.7266565288485693, -0.6956440798072383, -0.6662499031816359, -0.6384426377134872, -0.6121864858847903, -0.5874418722235719, -0.5641660448492453, -0.5423136244471685 ], [ -2.050373853122758, -2.082434492887788, -2.1101567185474885, -2.1331509084338607, -2.1510776603805892, -2.163660768101456, -2.1706984207241984, -2.172071588997494, -2.1677487493003196, -2.1577864470963974, -2.1423256653541753, -2.1215844503974597, -2.095847649413974, -2.0654548410504674, -2.0307875578418444, -1.9922567382402074, -1.9502910857318614, -1.9053267396273115, -1.857798436548415, -1.808132185329465, -1.7567393844721737, -1.704012262229913, -1.6503204972972738, -1.596008870939953, -1.5413958025439891, -1.4867726267004922, -1.4324034793979241, -1.3785256725968433, -1.325350449527862, -1.273064026694345, -1.2218288421063201, -1.1717849421987805, -1.1230514518335717, -1.075728082531821, -1.0298966435373516, -0.9856225284637155, -0.9429561571843241, -0.9019343583801627, -0.8625816828774352, -0.8249116417105138, -0.7889278658549311, -0.7546251869066586, -0.7219906397434698, -0.6910043894881409, -0.661640585986258, -0.6338681495884942, -0.6076514923527959, -0.5829511789116365, -0.5597245312307602, -0.5379261813582087 ], [ -2.0404596889269575, -2.0722764533501437, -2.0997896807040983, -2.122613973809833, -2.140413443844101, -2.152914424423375, -2.1599164424008244, -2.161300444079856, -2.1570334599334045, -2.1471692294211455, -2.131844751402527, -2.1112731891815097, -2.085733941647311, -2.055560911267827, -2.0211300234971974, -1.9828469084665952, -1.941135415589788, -1.8964273740366138, -1.8491537935990803, -1.7997375444142187, -1.7485874570825906, -1.6960937316449534, -1.6426245186398094, -1.5885235263771484, -1.534108508674563, -1.4796704929174425, -1.425473617452799, -1.371755458776879, -1.3187277417903047, -1.2665773397813707, -1.2154674841028394, -1.1655391162244308, -1.1169123266186307, -1.0696878355566992, -1.0239484802558916, -0.9797606809151342, -0.9371758650536417, -0.8962318353119926, -0.8569540705965806, -0.819356954263128, -0.7834449260608192, -0.749213556908054, -0.7166505473481107, -0.6857366518330538, -0.6564465318912548, -0.6287495418224912, -0.6026104508994041, -0.577990106191129, -0.5548460401117347, -0.5331330266731634 ], [ -2.027315594937085, -2.0587875077741353, -2.086001983258433, -2.108579700120321, -2.126189945391519, -2.138562968742068, -2.145500637377022, -2.146884436692043, -2.1426800410405655, -2.132938001221997, -2.1177905136671265, -2.097444670950694, -2.072172952369968, -2.042301923069733, -2.008200141258363, -1.9702661492679345, -1.9289172075318446, -1.884579191536102, -1.8376778630983286, -1.788631572937165, -1.73784535158823, -1.6857062883246965, -1.6325800687737968, -1.5788085302967276, -1.5247080928060448, -1.4705689274548857, -1.416654734246949, -1.3632030106604707, -1.310425705829752, -1.2585101678740862, -1.207620304957862, -1.1578978931137107, -1.109463975416698, -1.0624203075492598, -1.0168508140406889, -0.9728230274824697, -0.9303894898523213, -0.8895891008042263, -0.8504484025003326, -0.81298279438442, -0.7771976743385808, -0.7430895050334706, -0.7106468060801805, -0.6798510739111374, -0.6506776322421263, -0.6230964165714739, -0.5970726965202368, -0.5725677399651438, -0.5495394229119888, -0.5279427889419849 ], [ -2.0110560871988064, -2.0420869650206006, -2.0689170546499662, -2.0911748039370504, -2.108536196615468, -2.1207366632533162, -2.127581346085449, -2.1289528182887274, -2.1248155302791574, -2.1152165582240845, -2.1002826187303114, -2.080213715725269, -2.055274118723879, -2.0257815706051416, -1.9920956613393679, -1.954606201275132, -1.9137222363942101, -1.8698621300050804, -1.8234449387250955, -1.7748831596383405, -1.7245768235466776, -1.6729088476836351, -1.6202415282769937, -1.5669140387186398, -1.5132407957454856, -1.4595105595732742, -1.4059861417397714, -1.3529046048661078, -1.3004778505014212, -1.2488935038263662, -1.1983160166012066, -1.1488879218654355, -1.1007311851860617, -1.0539486074982864, -1.008625243676965, -0.9648298088935583, -0.9226160515828175, -0.8820240775358875, -0.8430816143453389, -0.8058052092564765, -0.7702013565358578, -0.7362675528565145, -0.7039932810189145, -0.6733609236679982, -0.6443466096118635, -0.6169209959702033, -0.5910499897446932, -0.5666954125655618, -0.5438156123767252, -0.5223660257174442 ], [ -1.991819878312961, -2.0223195034202863, -2.048684760075116, -2.0705533712220268, -2.0876093696319504, -2.0995944973892406, -2.106318020958027, -2.107664124007913, -2.1035962033888116, -2.094157674184178, -2.079469246418964, -2.0597230034240566, -2.03517391772547, -2.006129627529475, -1.972939341783308, -1.935982659651794, -1.8956589250150162, -1.8523775411173333, -1.8065494879061161, -1.7585801389543452, -1.7088633721597957, -1.6577769033312413, -1.6056787348084827, -1.5529045933469436, -1.4997662257916704, -1.4465504230173913, -1.3935186493376088, -1.3409071642351886, -1.2889275345803832, -1.2377674475706157, -1.1875917467750212, -1.1385436254015544, -1.0907459218825712, -1.0443024728791483, -0.9992994877208197, -0.9558069160900589, -0.9138797874514035, -0.8735595063735987, -0.8348750925837812, -0.7978443584217364, -0.7624750194307401, -0.7287657362292562, -0.6967070876497584, -0.6662824764957413, -0.6374689702360473, -0.6102380795991823, -0.5845564784135022, -0.5603866682180653, -0.5376875911920782, -0.5164151948598427 ], [ -1.9697666612660956, -1.999651737192742, -2.025477775079399, -2.0468930726177805, -2.063590877885587, -2.075320225498123, -2.081895257079037, -2.0832022535529675, -2.0792037598327413, -2.06993943949074, -2.055523620438972, -2.0361398248644935, -2.012032854884627, -1.9834991802418993, -1.9508764247287695, -1.914532685310345, -1.8748562779609483, -1.8322463316389663, -1.787104484675102, -1.7398277993335889, -1.6908029084348106, -1.6404013402748205, -1.5889759274901896, -1.5368581842447044, -1.4843565277852944, -1.4317552204608834, -1.3793139136520933, -1.3272676836850774, -1.275827460311167, -1.225180759744452, -1.1754926458522545, -1.1269068543798195, -1.0795470257084196, -1.0335180013711986, -0.9889071482595575, -0.945785682099012, -0.9042099683672321, -0.8642227844184419, -0.8258545312412525, -0.7891243870998835, -0.7540413983852949, -0.7206055054276089, -0.6888085028853184, -0.6586349357155903, -0.6300629327221162, -0.6030649803434414, -0.5776086397490683, -0.5536572105086917, -0.5311703441403834, -0.5101046107682613 ], [ -1.9450736355925828, -1.9742685104239956, -1.9994876718659151, -2.0203910762782025, -2.036682158709916, -2.048118069728595, -2.054518470855925, -2.0557721828280053, -2.051841122892663, -2.0427612003231337, -2.0286401296785206, -2.0096524189659792, -1.9860320408993484, -1.9580634576059377, -1.9260717235636893, -1.890412346299315, -1.8514614681592754, -1.8096067823510011, -1.7652394455693572, -1.718747119690199, -1.6705081755784699, -1.6208870230219303, -1.5702304872169432, -1.5188651277657979, -1.4670953850727289, -1.4152024369298246, -1.3634436518169968, -1.3120525328278374, -1.2612390556712831, -1.2111903148288232, -1.1620714029148296, -1.1140264590590419, -1.0671798323378772, -1.0216373156880583, -0.9774874142061807, -0.9348026192130595, -0.8936406659400832, -0.8540457582144007, -0.8160497481444493, -0.7796732626160575, -0.7449267714888651, -0.7118115948215834, -0.6803208483390203, -0.6504403277662859, -0.6221493336720774, -0.5954214391534525, -0.5702252031213922, -0.5465248321653499, -0.5242807940346808, -0.5034503857171558 ], [ -1.917931923212815, -1.9463690800456925, -1.9709208927975261, -1.9912598440050866, -2.0071003323018575, -2.0182082887389856, -2.0244094299857283, -2.0255955087768625, -2.0217280523683514, -2.0128392889397464, -1.9990302202407533, -1.9804660632914357, -1.9573695088762637, -1.9300123939215332, -1.898706441843073, -1.8637936948518485, -1.8256371675993446, -1.7846121228446843, -1.741098235453919, -1.695472791074116, -1.648104970318082, -1.5993512001527384, -1.549551508421261, -1.4990267901349308, -1.4480768804007638, -1.3969793244858664, -1.345988737443003, -1.2953366516865052, -1.2452317593189943, -1.1958604657369798, -1.147387681284063, -1.0999577879077678, -1.0536957275206724, -1.008708167814047, -0.9650847094715447, -0.922899106009212, -0.8822104738105259, -0.8430644753570726, -0.8054944632293699, -0.769522576237845, -0.7351607821196704, -0.702411863685219, -0.6712703471997931, -0.6417233732206685, -0.6137515111499185, -0.5873295194780231, -0.5624270541433984, -0.5390093276738951, -0.517037721856423, -0.4964703566424544 ], [ -1.8885430070576879, -1.916163332930604, -1.93999476743054, -1.9597229770205602, -1.9750739117855172, -1.9858227932488166, -1.991801819787649, -1.992906014045964, -1.9890967553948067, -1.9804027267619815, -1.966918233308656, -1.9487990839174056, -1.9262564267604538, -1.8995490668682067, -1.868974851736777, -1.834861693623379, -1.7975587217488727, -1.757427948805816, -1.7148367180343946, -1.6701510877870076, -1.6237302201845436, -1.5759217724629866, -1.5270582425935812, -1.4774541911680916, -1.4274042452771187, -1.37718178346996, -1.327038200890869, -1.2772026580883202, -1.227882224145314, -1.179262333491175, -1.1315074851790716, -1.084762122946758, -1.0391516436051542, -0.9947834899446606, -0.9517482922437275, -0.9101210295186913, -0.8699621878385292, -0.8313188983545745, -0.7942260422045314, -0.7587073132015454, -0.7247762322828042, -0.6924371101435154, -0.6616859563973094, -0.6325113350576796, -0.6048951671977446, -0.5788134823835162, -0.5542371209491632, -0.5311323894460263, -0.509461671698589, -0.48918399788238 ], [ -1.8571153047136555, -1.8838681584809434, -1.9069337030769737, -1.9260112492526171, -1.9408387091885975, -1.9512009590891495, -1.9569370010972147, -1.9579454097015998, -1.9541876548984285, -1.9456890590726852, -1.9325373447600773, -1.9148789353631657, -1.8929133483176903, -1.8668861444613938, -1.8370809552976846, -1.8038111027780364, -1.7674112674269022, -1.7282295698540022, -1.686620328097806, -1.6429376548715044, -1.597529974619763, -1.5507354745481285, -1.5028784564641253, -1.454266525015803, -1.4051885294912991, -1.3559131675430214, -1.3066881572703917, -1.257739886853495, -1.2092734567221857, -1.1614730368480701, -1.114502470272242, -1.0685060627937693, -1.0236095073994322, -0.9799209002145601, -0.9375318123089325, -0.8965183884933465, -0.856942450245262, -0.8188525851038625, -0.7822852093038639, -0.7472655941224811, -0.7138088494560814, -0.6819208605904272, -0.6515991760513902, -0.6228338458919414, -0.5956082108535076, -0.5698996435993495, -0.5456802437132872, -0.5229174884424815, -0.5015748412859183, -0.481612320532844 ], [ -1.8238609650364825, -1.8497040706860703, -1.8719656486022216, -1.8903589332482766, -1.9046340475211243, -1.91458575265817, -1.9200600789038793, -1.9209593788495753, -1.9172454413373448, -1.9089404485806036, -1.8961257338748398, -1.8789384762397736, -1.8575666247580118, -1.8322424577048229, -1.8032352382274306, -1.770843429372669, -1.735386886588186, -1.6971993710963837, -1.6566216394565807, -1.613995277194524, -1.5696573670189746, -1.5239360195880811, -1.4771467480510743, -1.4295896353573454, -1.3815472231740893, -1.3332830405096365, -1.2850406863433181, -1.2370433816617739, -1.1894939106788147, -1.142574877440858, -1.0964492115799005, -1.0512608650075013, -1.0071356493759034, -0.9641821718429417, -0.9224928338552898, -0.8821448641831486, -0.8432013632359254, -0.8057123407449749, -0.7697157332314278, -0.7352383913220607, -0.7022970299857003, -0.6708991371973296, -0.6410438384612318, -0.6127227161037382, -0.5859205833443765, -0.5606162139329816, -0.5367830286566492, -0.5143897403270341, -0.49340095900252556, -0.4737777592233663 ], [ -1.788992950817874, -1.8138921458216555, -1.835318900603327, -1.8530004908357296, -1.8666993541815176, -1.8762202473239995, -1.8814163638075734, -1.8821940068713403, -1.8785154969530191, -1.8704001201413465, -1.8579230756733263, -1.8412125362519718, -1.820445072317387, -1.7958397924070335, -1.7676516062567607, -1.7361640244769407, -1.7016818757367358, -1.6645242616968174, -1.6250179951362633, -1.58349168987598, -1.540270600889802, -1.4956722543394307, -1.450002861905096, -1.4035544812437482, -1.3566028630100868, -1.3094059124822806, -1.2622026883184256, -1.2152128604578776, -1.1686365521351798, -1.1226544961843996, -1.077428442359063, -1.0331017595956147, -0.9898001845132636, -0.9476326746251366, -0.9066923315022142, -0.8670573653375799, -0.8287920779226501, -0.791947845936953, -0.7565640906696739, -0.7226692238611667, -0.6902815623172334, -0.6594102063612276, -0.6300558791065557, -0.6022117250155438, -0.5758640673203588, -0.5509931246760774, -0.5275736879506664, -0.5055757583828152, -0.4849651485028007, -0.46570404725546055 ], [ -1.7527224472964473, -1.7766513161835236, -1.7972192929929482, -1.8141676704301126, -1.8272711788970177, -1.8363445758947599, -1.8412482739945266, -1.8418926491714926, -1.8382407470582967, -1.8303092149424305, -1.8181674187797612, -1.8019348394726264, -1.7817769628603524, -1.7578999682449554, -1.7305445719956662, -1.699979394411183, -1.6664941947507501, -1.6303932707256443, -1.5919892558949693, -1.5515974815797142, -1.5095310069218328, -1.466096366450884, -1.4215900411782558, -1.3762956270150803, -1.3304816521646365, -1.2843999814420324, -1.2382847384468785, -1.1923516744979628, -1.1467979148068483, -1.1018020163602107, -1.0575242774920999, -1.0141072454681401, -0.971676375065784, -0.9303407977534264, -0.8901941673949997, -0.8513155542711056, -0.8137703645148049, -0.7776112667612132, -0.7428791118930553, -0.7096038352431501, -0.6778053335216057, -0.6474943111143253, -0.6186730923014333, -0.5913363974249866, -0.5654720821507816, -0.5410618397751047, -0.5180818670770448, -0.49650349456044585, -0.47629378211253715, -0.45741608116960975 ], [ -1.7152566159689082, -1.7381960380167325, -1.7578877869950649, -1.7740870272248297, -1.786580652308142, -1.7951933359575898, -1.799792696156667, -1.8002932574099515, -1.7966589626904088, -1.788904082417973, -1.777092481293967, -1.7613353205321265, -1.7417873779054671, -1.7186422485383845, -1.6921267378590172, -1.6624947728065231, -1.6300211418624875, -1.5949953360930038, -1.557715711109892, -1.5184841323008933, -1.477601209769715, -1.4353621798323957, -1.3920534490925631, -1.3479497857518656, -1.3033121203958828, -1.2583859038593654, -1.2133999614869875, -1.1685657797369067, -1.1240771613368774, -1.0801101880101796, -1.036823434265494, -0.9943583812088213, -0.9528399852710615, -0.912377362773457, -0.8730645571066721, -0.8349813607964314, -0.798194169754377, -0.7627568515039165, -0.7287116131009624, -0.6960898578412968, -0.6649130226811111, -0.6351933906311521, -0.6069348742619379, -0.5801337679275452, -0.5547794674305478, -0.5308551566633001, -0.5083384613218112, -0.4872020701463782, -0.4674143243426663, -0.4489397759182864 ], [ -1.676796696471904, -1.698734333823627, -1.7175384593696765, -1.732977862195013, -1.74485137995258, -1.7529934425885079, -1.7572788006446727, -1.7576261613700679, -1.7540005146458522, -1.7464140136186461, -1.734925372709698, -1.7196378463840976, -1.7006959433516877, -1.6782811023142388, -1.6526066003635487, -1.623911981716958, -1.5924572850606475, -1.5585173179520109, -1.5223761836729157, -1.484322216799316, -1.444643434606374, -1.4036235665994006, -1.3615386865010497, -1.3186544409605907, -1.2752238469979145, -1.2314856149836035, -1.187662944680721, -1.1439627373391568, -1.1005751659052345, -1.0576735470941478, -1.0154144625418202, -0.9739380808435854, -0.933368637485882, -0.893815035098139, -0.8553715318143943, -0.8181184906417415, -0.7821231674559571, -0.7474405195053831, -0.7141140200634509, -0.6821764681185681, -0.6516507847390555, -0.6225507900275958, -0.5948819564214242, -0.5686421355455213, -0.5438222569337131, -0.5204069977462462, -0.49837542318029404, -0.4777015976388016, -0.4583551669365378, -0.4403019119198017 ], [ -1.6375364464182904, -1.658466195598953, -1.6763768723509285, -1.6910505608432875, -1.702297750756895, -1.7099624066363845, -1.7139262891943834, -1.714112286031893, -1.7104865607621076, -1.703059401158129, -1.6918847310414658, -1.6770583374004933, -1.6587149435271968, -1.6370243221412204, -1.612186683853149, -1.5844275939016101, -1.5539926654099958, -1.521142254662984, -1.4861463487816629, -1.449279794601136, -1.4108179747347616, -1.3710329966910164, -1.330190426019101, -1.288546566036625, -1.2463462649755568, -1.2038212159371642, -1.1611887050602192, -1.1186507578110836, -1.0763936313269948, -1.0345876013940458, -0.9933869951522463, -0.9529304243597683, -0.9133411785148009, -0.8747277419396767, -0.8371844037894052, -0.8007919346479278, -0.7656183077779396, -0.7317194471024592, -0.6991399875678813, -0.6679140366474013, -0.6380659283929251, -0.6096109636510058, -0.5825561318544401, -0.5569008112241962, -0.5326374453092284, -0.5097521946002853, -0.4882255625236783, -0.46803299549699207, -0.44914545695312447, -0.43152997535046356 ], [ -1.5976608997592265, -1.617582325917776, -1.6345987988785269, -1.6485053024265632, -1.6591236286286142, -1.6663070058813052, -1.6699440422025529, -1.6699617715309425, -1.6663276358605317, -1.659050297854621, -1.6481792508330806, -1.6338032676999101, -1.616047799153068, -1.5950714872278862, -1.5710619980069127, -1.5442313952209052, -1.51481127535584, -1.4830478679068264, -1.4491972760557932, -1.4135209981460186, -1.3762818333216662, -1.3377402391213824, -1.2981511770797924, -1.2577614558491357, -1.2168075604764912, -1.1755139410967472, -1.1340917238703072, -1.0927378007506356, -1.051634251796858, -1.0109480534702102, -0.9708310279746089, -0.931419991629282, -0.8928370640133644, -0.855190103817621, -0.8185732416856014, -0.7830674846104356, -0.7487413705211816, -0.715651655441813, -0.6838440189741912, -0.6533537768122298, -0.6242065915304061, -0.5964191750160446, -0.569999977654643, -0.5449498607634963, -0.5212627498393256, -0.4989262669826424, -0.4779223414279873, -0.4582277974881501, -0.43981491945221207, -0.422651993099985 ], [ -1.5573454180636401, -1.5762631876356046, -1.592389270557347, -1.6055311042487115, -1.6155213895107716, -1.6222223099626076, -1.6255291258336526, -1.62537295658389, -1.6217226061641505, -1.614585338020216, -1.6040065689736476, -1.5900685153215133, -1.5728878840711225, -1.5526127512245071, -1.5294188033014111, -1.503505135976392, -1.475089805236251, -1.4444053141435444, -1.4116941956196523, -1.3772048225808076, -1.3411875450194146, -1.3038912223272665, -1.265560190561188, -1.2264316798387376, -1.1867336772487354, -1.146683215615547, -1.10648505782454, -1.066330739632031, -1.0263979302840558, -0.9868500691864552, -0.9478362376837903, -0.9094912271741578, -0.8719357678551676, -0.8352768859950351, -0.7996083614625703, -0.7650112611119263, -0.7315545273418593, -0.6992956046235097, -0.6682810899431311, -0.6385473958958824, -0.6101214175772672, -0.5830211964525508, -0.5572565760578845, -0.5328298457268866, -0.5097363695765639, -0.4879651987653325, -0.46749966559350364, -0.4483179583936103, -0.43039367639361925, -0.4136963638669189 ], [ -1.5167550055211174, -1.5346783296052489, -1.5499219126477075, -1.5623051626477884, -1.5716712633982055, -1.5778910170895313, -1.5808661162051376, -1.5805316826385418, -1.5768579462613543, -1.5698509810842651, -1.5595524703868615, -1.5460385273793658, -1.5294176495156375, -1.5098279275822493, -1.4874336616126593, -1.4624215527886832, -1.434996643907614, -1.4053781723803451, -1.3737954818009255, -1.3404841140786505, -1.3056821770856455, -1.2696270554493858, -1.232552506569311, -1.194686161520048, -1.1562474319410394, -1.1174458095064885, -1.0784795339529403, -1.0395345985121245, -1.0007840574316658, -0.9623875985053518, -0.9244913436374176, -0.8872278419408374, -0.8507162222962198, -0.8150624753238098, -0.7803598380648862, -0.7466892581111572, -0.7141199172969107, -0.6827097982603375, -0.6525062801072247, -0.623546752023014, -0.5958592359534588, -0.5694630114049238, -0.544369237012788, -0.5205815648116553, -0.4980967441434544, -0.4769052128935056, -0.4569916742876985, -0.43833565785447326, -0.42091206339076814, -0.4046916869069801 ], [ -1.4760438569350451, -1.492985954633638, -1.5073585295459326, -1.5189924517479603, -1.5277409404536295, -1.5334830602690717, -1.5361266975700063, -1.5356108754849052, -1.5319072958353455, -1.5250210359314764, -1.514990373801557, -1.5018857628589957, -1.4858080215995417, -1.4668858416014379, -1.4452727448748088, -1.4211436378951672, -1.3946911143597074, -1.366121653009036, -1.3356518428562003, -1.3035047484198028, -1.269906504674729, -1.2350832077396918, -1.1992581446657666, -1.1626493853714674, -1.12546774255237, -1.0879150915895344, -1.050183032060858, -1.0124518651603676, -0.9748898567538876, -0.9376527534873876, -0.9008835188530857, -0.8647122569730371, -0.8292562936948373, -0.7946203870798149, -0.7608970422303754, -0.7281669084341592, -0.6964992396323865, -0.6659524021252313, -0.6365744161217438, -0.6084035201693102, -0.5814687496267378, -0.5557905221637998, -0.5313812247827401, -0.5082457980797218, -0.48638231442136914, -0.4657825474343247, -0.4464325307287209, -0.42831310413560864, -0.4114004459698142, -0.39566658996717563 ], [ -1.4353551079718878, -1.4513326963185227, -1.4648489050221467, -1.4757455421874701, -1.4838854017525909, -1.4891554423193445, -1.491469492967761, -1.4907703625018793, -1.4870312545683206, -1.4802564251498833, -1.4704810581429653, -1.45777037548353, -1.4422180368352675, -1.4239439168215724, -1.4030913726302103, -1.379824130124322, -1.3543229221191924, -1.3267820090525584, -1.2974057014910065, -1.266404987821729, -1.2339943512294271, -1.200388839638488, -1.165801432350995, -1.130440728840391, -1.0945089693407217, -1.0582003838861227, -1.021699856378902, -0.9851818829488457, -0.948809799020774, -0.9127352467669285, -0.8770978535953449, -0.8420250926363104, -0.8076322974884802, -0.7740228054711197, -0.7412882060424967, -0.7095086736786121, -0.6787533671959145, -0.6490808801215822, -0.6205397291741427, -0.5931688701539178, -0.5669982325195267, -0.5420492656259165, -0.5183354910196225, -0.4958630563394063, -0.474631287275576, -0.4546332347268296, -0.4358562147907614, -0.41828233956750205, -0.40188903697907463, -0.38664955794288547 ], [ -1.3948207580307133, -1.4098535729322097, -1.4225307834071377, -1.432704604301591, -1.4402469377197442, -1.4450522616407124, -1.4470400885801828, -1.4461568864223027, -1.4423773761592664, -1.4357051506179392, -1.4261725919148935, -1.4138401004150807, -1.398794681291027, -1.381147963592652, -1.3610337488949802, -1.3386052008234, -1.31403179274736, -1.287496129233146, -1.2591907486741867, -1.2293150014982082, -1.1980720822515556, -1.1656662763638517, -1.132300464938858, -1.098173914605665, -1.0634803650509437, -1.0284064147617455, -0.9931301958893978, -0.9578203219411896, -0.9226350870187552, -0.8877218922677557, -0.8532168737615021, -0.8192447058864494, -0.7859185551220562, -0.7533401606350176, -0.721600020099393, -0.6907776614104917, -0.6609419833205376, -0.6321516503631004, -0.6044555296570707, -0.5778931592239471, -0.5524952392718269, -0.5282841394732777, -0.505274416585763, -0.4834733378393614, -0.4628814063636665, -0.4434928855682988, -0.4252963198582672, -0.4082750493881856, -0.39240771677045605, -0.3776687637832419 ], [ -1.354561737931754, -1.368672088763318, -1.380530000540491, -1.3899975631853954, -1.3969553205228915, -1.4013048940972797, -1.4029712164923744, -1.4019042799466108, -1.3980803257206769, -1.391502424961189, -1.3822004307208662, -1.3702303109239091, -1.3556729008689477, -1.3386321390234046, -1.3192328695673026, -1.297618308270085, -1.2739472744716345, -1.2483912915400426, -1.221131652111975, -1.1923565339719095, -1.1622582390377552, -1.1310306130069436, -1.0988666880276152, -1.0659565762910854, -1.0324856294089984, -0.9986328672815756, -0.964569671084451, -0.930458728013351, -0.8964532104052537, -0.862696168590404, -0.8293201150629987, -0.7964467770150971, -0.7641869946893869, -0.7326407441236779, -0.7018972644634228, -0.6720352719205657, -0.6431232445027557, -0.6152197637030253, -0.5883739013317677, -0.5626256415218807, -0.5380063295977521, -0.5145391409430986, -0.49223956422050474, -0.47111589428994205, -0.45116973095750057, -0.4323964802802208, -0.41478585558445225, -0.3983223756534251, -0.3829858577349554, -0.3687519031426074 ], [ -1.3146880969072812, -1.3279004559831398, -1.3389607362869074, -1.3477403763495301, -1.3541281002156296, -1.3580323000544359, -1.3593830643451248, -1.3581337693308053, -1.3542621685382485, -1.3477709369627304, -1.3386876513747636, -1.3270642141296078, -1.3129757527636001, -1.2965190496208232, -1.2778105732369351, -1.256984195229258, -1.2341886826289972, -1.2095850561502468, -1.1833439005060329, -1.1556427045659075, -1.1266632980758216, -1.0965894390131252, -1.0656045925022113, -1.0338899294582327, -1.0016225614219683, -0.9689740178375748, -0.9361089635405818, -0.9031841475314907, -0.8703475691481796, -0.8377378443676194, -0.8054837529608095, -0.7737039463664441, -0.7425067962074698, -0.7119903641298279, -0.6822424748946777, -0.6533408762296505, -0.625353470693962, -0.5983386066167687, -0.5723454169340606, -0.5474141964066177, -0.5235768092013262, -0.5008571201305951, -0.4792714439555046, -0.4588290080671079, -0.4395324245767581, -0.4213781683888709, -0.40435705822189605, -0.38845473781308604, -0.37365215471875257, -0.359926034232704 ], [ -1.2752992858933745, -1.287639912942923, -1.297925863561911, -1.3060374080714263, -1.311870998016224, -1.3153414293673724, -1.3163836842058259, -1.3149543789417941, -1.3110327620009865, -1.304621222719066, -1.2957452945704775, -1.2844531581793461, -1.2708146710984876, -1.2549199704998888, -1.2368777104043893, -1.2168130060280937, -1.1948651638678944, -1.1711852773923048, -1.1459337651518209, -1.119277921567879, -1.0913895415511536, -1.0624426694237221, -1.032611511294867, -1.0020685388502102, -0.9709828020675393, -0.9395184590945198, -0.9078335236648521, -0.8760788240925266, -0.8443971630541353, -0.8129226639464571, -0.7817802874354728, -0.7510855007080828, -0.7209440817023123, -0.6914520410332378, -0.6626956452701488, -0.6347515264955809, -0.6076868645503086, -0.5815596299253692, -0.5564188768109987, -0.5323050772823995, -0.5092504889436874, -0.48727954953148167, -0.4664092929816043, -0.44664978228278396, -0.4280045550870105, -0.41047107853318543, -0.394041210090484, -0.3787016614660357, -0.364434462775419, -0.3512174242712329 ], [ -1.2364845167061864, -1.2479811176690114, -1.2575173719171686, -1.2649818778686972, -1.2702783736109027, -1.2733277007494959, -1.2740694767050107, -1.2724634125275789, -1.2684902262436681, -1.2621521179895812, -1.2534727915996595, -1.2424970265519797, -1.2292898228106444, -1.2139351578136033, -1.1965344085479834, -1.1772045015821264, -1.1560758597288803, -1.1332902157302862, -1.1089983613471235, -1.083357895125636, -1.0565310246643704, -1.0286824702330324, -0.99997750688396, -0.9705801724301436, -0.9406516593921475, -0.9103489006414124, -0.8798233512456306, -0.849219963080268, -0.8186763441304118, -0.7883220910097507, -0.7582782809542478, -0.7286571082585649, -0.6995616496490594, -0.6710857432613022, -0.6433139665528231, -0.616321699487436, -0.5901752605473329, -0.5649321044547784, -0.5406410718274858, -0.5173426822815841, -0.49506946368252724, -0.4738463112933986, -0.45369087146282727, -0.434613945225231, -0.41661990775906155, -0.3997071400776142, -0.3838684696315102, -0.3690916167057834, -0.35535964362363504, -0.3426514038489281 ], [ -1.1983231792274658, -1.2090045980921786, -1.2178168467097845, -1.224656363672448, -1.2294337466673406, -1.2320755353600426, -1.2325257299729362, -1.2307469904751187, -1.226721472564954, -1.220451270660657, -1.2119584539838657, -1.2012846984102465, -1.1884905328955895, -1.1736542338602345, -1.156870413009365, -1.1382483530322802, -1.1179101511261547, -1.095988732311929, -1.0726257933147085, -1.0479697338471887, -1.022173626078346, -0.9953932655645444, -0.9677853386276598, -0.9395057326787075, -0.9107080077986471, -0.8815420403732108, -0.8521528429891355, -0.822679559276663, -0.7932546279756185, -0.7640031071832944, -0.7350421474314168, -0.7064806008205081, -0.6784187527775206, -0.6509481629537546, -0.6241516022043925, -0.5981030733569691, -0.5728679044659298, -0.5485029043618765, -0.5250565714525441, -0.5025693478504184, -0.48107391193868654, -0.4605955034081035, -0.44115227558184644, -0.4227556704857638, -0.40541081262051026, -0.38911691776120905, -0.3738677133675876, -0.3596518673550704, -0.34645342207935914, -0.33425223044833663 ], [ -1.1608853011444884, -1.1707812431533349, -1.1788959876507366, -1.185133343191944, -1.1894103557763973, -1.191658927576168, -1.191827196103171, -1.1898806255592165, -1.1858027719216582, -1.1795956954554985, -1.1712800080336134, -1.1608945569674376, -1.1484957610276498, -1.1341566270477659, -1.1179654861765336, -1.100024496916496, -1.080447967247744, -1.0593605503381505, -1.0368953677682957, -1.0131921112196554, -0.9883951686824056, -0.962651814988075, -0.9361104994193541, -0.908919255806951, -0.8812242533278815, -0.8531684995132033, -0.8248907009989288, -0.7965242824607623, -0.7681965600276612, -0.7400280622697922, -0.7121319895506468, -0.6846138010327809, -0.6575709178214961, -0.6310925304999931, -0.6052594995307455, -0.5801443375539108, -0.5558112633967398, -0.5323163185238514, -0.5097075376263733, -0.48802516600381485, -0.46730191728623305, -0.44756326584115935, -0.4288277688882072, -0.411107413895452, -0.3944079872567079, -0.37872946055756707, -0.3640663909469726, -0.35040833226075985, -0.3377402536171268, -0.32604296224471385 ], [ -1.1242320370414105, -1.1333728213269358, -1.140817153057303, -1.1464757596043251, -1.150271740777088, -1.152142038727419, -1.152038690739474, -1.1499298225908308, -1.1458003487179957, -1.1396523559270344, -1.1315051592137642, -1.1213950306321347, -1.1093746142668401, -1.0955120514585444, -1.0798898498421539, -1.0626035370061522, -1.0437601443831794, -1.0234765692692949, -1.0018778627663592, -0.9790954892310879, -0.9552655988903285, -0.9305273500985871, -0.9050213117382835, -0.8788879699351819, -0.8522663569645821, -0.8252928142683579, -0.7980998961179646, -0.7708154157942115, -0.7435616322891667, -0.7164545724866276, -0.6896034815152632, -0.6631103924274713, -0.6370698054494506, -0.6115684666726374, -0.5866852361080408, -0.5624910353993184, -0.539048866090584, -0.5164138900837523, -0.4946335647228164, -0.4737478257469142, -0.45378931211268303, -0.4347836273644662, -0.41674963280697297, -0.39969976819886655, -0.38364039603764666, -0.36857216575467877, -0.3544903942992397, -0.34138545968149137, -0.3292432040880935, -0.31804534320307587 ], [ -1.0884161756955284, -1.0968325152749419, -1.1036339184069592, -1.10873760006303, -1.1120723368534176, -1.1135798020646805, -1.113215703923036, -1.1109506899465187, -1.106770987698425, -1.100678761359877, -1.0926921737614241, -1.082845154216912, -1.0711868830161169, -1.0577810131138556, -1.0427046578495127, -1.0260471800247262, -1.007908822105064, -0.9883992196132603, -0.9676358400271956, -0.9457423879005263, -0.922847213801461, -0.8990817603867789, -0.8745790738845467, -0.8494724038252159, -0.8238939083726526, -0.7979734773417947, -0.7718376801617222, -0.7456088417980167, -0.7194042460721793, -0.6933354629393065, -0.66750779409612, -0.6420198297437709, -0.6169631083546278, -0.5924218708057749, -0.5684729001540157, -0.5451854385465478, -0.5226211732012169, -0.5008342839707983, -0.4798715456574659, -0.45977247890846995, -0.44056954415606664, -0.42228837363048355, -0.40494803695259973, -0.38856133619259414, -0.3731351265613263, -0.3586706590903763, -0.3451639417680419, -0.33260611565082066, -0.32098384248342415, -0.31027970035656915 ], [ -1.053482656281876, -1.0612054632819923, -1.0673916398046666, -1.0719644775992165, -1.074858070928705, -1.0760185294197955, -1.0754050125595844, -1.0729905532116164, -1.068762644021664, -1.0627235684817304, -1.054890467268028, -1.0452951397362862, -1.0339835895869196, -1.0210153321659217, -1.0064624881778046, -0.9904086943952166, -0.9729478660294133, -0.954182847690712, -0.9342239903663306, -0.9131876907370771, -0.8911949266929311, -0.8683698193934957, -0.8448382479780566, -0.8207265383808341, -0.7961602429415211, -0.7712630228667618, -0.7461556412904355, -0.7209550708399395, -0.6957737163299702, -0.6707187505152203, -0.6458915587402559, -0.6213872867979817, -0.5972944852948732, -0.5736948432529433, -0.5506630034786643, -0.5282664523184334, -0.5065654767210307, -0.4856131819679973, -0.4654555639486788, -0.4461316303937426, -0.42767356599580564, -0.4101069368061897, -0.3934509296818607, -0.3777186228555405, -0.3629172839138213, -0.34904869159938956, -0.3361094779173621, -0.3240914870393705, -0.3129821474822385, -0.302764854011202 ], [ -1.019469085832546, -1.026529299830827, -1.0321280147407406, -1.0361942088046585, -1.038666952739419, -1.0394965119045287, -1.0386452867886016, -1.0360885631173318, -1.0318150485588435, -1.0258271798599048, -1.0181411919122663, -1.008786948281678, -0.9978075406663491, -0.9852586721366439, -0.971207845448768, -0.9557333829131602, -0.9389233080316495, -0.9208741213096875, -0.901689503325333, -0.8814789774168408, -0.8603565624319394, -0.8384394431109025, -0.8158466821225343, -0.7926979938081362, -0.7691125955652376, -0.7452081487393886, -0.7210997970659985, -0.6968993072473156, -0.6727143132499385, -0.648647663412202, -0.624796867469672, -0.6012536391228439, -0.5781035287445419, -0.5554256401997696, -0.5332924254639969, -0.5117695507076734, -0.4909158276971358, -0.4707832046798095, -0.4514168113161987, -0.43285505264254165, -0.41512974745517406, -0.3982663068703669, -0.38228394911135277, -0.3671959467970609, -0.3530099031533436, -0.33972805364337755, -0.3273475895316822, -0.3158609998722681, -0.30525642836475675, -0.29551804147214455 ], [ -0.9864062517400507, -0.9928346891674287, -0.9978736340474859, -1.0014573812507641, -1.0035296545672592, -1.0040446086213355, -1.002967684184716, -1.0002762916202226, -0.9959603021442295, -0.9900223325562308, -0.9824778157337241, -0.9733548561614204, -0.9626938766659172, -0.9505470689825575, -0.9369776664560335, -0.922059061805179, -0.905873796286528, -0.888512448686411, -0.8700724533651445, -0.8506568761587827, -0.8303731754690324, -0.8093319735398651, -0.7876458599548483, -0.7654282460206527, -0.7427922851469506, -0.7198498707831544, -0.6967107200879635, -0.673481548411433, -0.6502653369462318, -0.6271606936050361, -0.6042613053227157, -0.5816554785572251, -0.559425763742968, -0.5376486587910277, -0.516394386377985, -0.4957267396600129, -0.4757029911312216, -0.45637385955676757, -0.43778353019878213, -0.41996972387065656, -0.4029638106646236, -0.38679096447054184, -0.3714703546209628, -0.3570153711491577, -0.3434338802313288, -0.3307285064075609, -0.3188969381497737, -0.3079322532849149, -0.2978232607057978, -0.2885548547290757 ], [ -0.9543186243486765, -0.9601458469929927, -0.9646525202785394, -0.9677779059381579, -0.9694700749694531, -0.9696868187391368, -0.9683964271202699, -0.9655783113889151, -0.9612234539387873, -0.95533467205852, -0.9479266887911857, -0.9390260099514041, -0.9286706123852786, -0.9169094542054015, -0.9038018227335839, -0.8894165400105872, -0.8738310488269507, -0.8571304042117991, -0.8394061961831761, -0.8207554293791954, -0.8012793840753485, -0.7810824812119213, -0.7602711715919737, -0.7389528665578763, -0.7172349243989147, -0.6952237036525794, -0.6730236914801878, -0.6507367125366578, -0.6284612212954217, -0.6062916786840375, -0.5843180121567702, -0.5626251569771795, -0.5412926754860593, -0.5203944504538646, -0.4999984482168822, -0.48016654712254525, -0.46095442680843934, -0.4424115139601441, -0.42458098038701, -0.4074997894800798, -0.39119878733782465, -0.3757028350365539, -0.3610309786654582, -0.34719665383194664, -0.33420792137003663, -0.32206773095857355, -0.3107742092883501, -0.3003209693227835, -0.29069743709318807, -0.2818891923746212 ], [ -0.9232248457583624, -0.9284810465220713, -0.9324826488550393, -0.93517355120708, -0.9365058829971549, -0.936440833450916, -0.934949359795538, -0.9320127551541213, -0.927623060272097, -0.9217833077251261, -0.9145075922790868, -0.9058209663392353, -0.89575916466416, -0.8843681674629832, -0.8717036154019109, -0.857830093722567, -0.8428203054815546, -0.8267541557823608, -0.8097177697758201, -0.7918024671996002, -0.7731037154058557, -0.7537200813199382, -0.7337522007352691, -0.7133017809423418, -0.6924706500727019, -0.6713598638580585, -0.6500688778873356, -0.6286947909928822, -0.607331663187764, -0.5860699096594809, -0.5649957707278462, -0.544190856401023, -0.5237317632009831, -0.5036897602510935, -0.48413054118733634, -0.4651140382276815, -0.4466942946654341, -0.42891939209598773, -0.4118314287993542, -0.39546654584474106, -0.37985499762636166, -0.3650212636572949, -0.3509841985239197, -0.33775721692892113, -0.3253485107250218, -0.31376129477007675, -0.302994078327824, -0.2930409586121159, -0.283891932942532, -0.27553322586312423 ], [ -0.8931382018881586, -0.8978531060815779, -0.9013764492684246, -0.9036564554933689, -0.9046490403549275, -0.9043185653019652, -0.9026384824248713, -0.8995918523710722, -0.8951717213331902, -0.8893813469968042, -0.8822342677052699, -0.8737542136846923, -0.863974863742576, -0.852939455183946, -0.840700258574862, -0.8273179322574732, -0.8128607740614172, -0.7974038893937303, -0.7810282958066193, -0.7638199842712267, -0.7458689567999136, -0.7272682588648312, -0.7081130233832286, -0.688499541016123, -0.6685243692926119, -0.6482834907542208, -0.6278715280244785, -0.6073810215405712, -0.5869017737078129, -0.5665202615023117, -0.5463191180805683, -0.526376682765741, -0.5067666178614134, -0.48755759007460575, -0.46881301388037067, -0.45059085389391684, -0.43294348319297915, -0.41591759451259025, -0.3995541612779461, -0.3838884455141369, -0.36895004974520007, -0.3547630100468353, -0.3413459274323598, -0.3287121347223805, -0.3168698959747289, -0.30582263543804733, -0.2955691928506965, -0.2861041017505379, -0.27741788730684624, -0.26949738004966606 ], [ -0.8640670756265829, -0.8682698562117761, -0.8713412844206079, -0.8732336171096373, -0.8739062997532165, -0.8733266531818036, -0.8714704608781809, -0.8683224414632167, -0.8638765939111005, -0.8581364064717681, -0.8511149240871088, -0.842834673084661, -0.8333274459244924, -0.8226339525714824, -0.8108033484932586, -0.7978926521993465, -0.7839660675332332, -0.7690942275421484, -0.7533533776593143, -0.7368245161615978, -0.7195925094685691, -0.7017451989121464, -0.6833725142329881, -0.6645656073649568, -0.645416018167804, -0.6260148817706664, -0.6064521851935294, -0.5868160790034229, -0.567192248001869, -0.5476633433766505, -0.5283084774124029, -0.5092027807525266, -0.4904170213362744, -0.4720172834843468, -0.45406470514945385, -0.4366152710541791, -0.41971965927246957, -0.403423138737681, -0.3877655151449262, -0.37278112272751907, -0.3584988594004004, -0.3449422627573888, -0.332129624370493, -0.32007413976166554, -0.30878409130026907, -0.2982630611288368, -0.2885101710460112, -0.27952034609251974, -0.2712845984094556, -0.2637903277839184 ], [ -0.8360153795503559, -0.839734584885547, -0.8423799068375041, -0.8439073598865804, -0.8442796783620542, -0.8434669419315209, -0.8414471107402107, -0.8382064565856725, -0.8337398790641454, -0.8280510986288563, -0.8211527218236048, -0.8130661774433341, -0.8038215258638032, -0.7934571471139367, -0.7820193162900596, -0.7695616775067492, -0.7561446296517312, -0.7418346387037609, -0.7267034922613715, -0.7108275122297255, -0.6942867413662578, -0.6771641186615165, -0.6595446574150509, -0.6415146384527465, -0.6231608293200999, -0.6045697385699664, -0.5858269125299587, -0.5670162802574564, -0.5482195508286852, -0.5295156657060857, -0.5109803077130253, -0.4926854671301889, -0.4746990646135666, -0.45708463000886135, -0.43990103568151195, -0.4232022826693883, -0.40703733776657636, -0.39145001953056413, -0.37647893114080433, -0.3621574379967374, -0.3485136879039681, -0.3355706716407827, -0.32334632161120935, -0.3118536461699484, -0.3011008970491449, -0.2910917671329931, -0.28182561562394604, -0.2732977174373068, -0.2654995334643586, -0.2584189981733651 ], [ -0.8089829672359476, -0.8122464600025328, -0.8144908910291725, -0.8156757740439692, -0.8157669058072754, -0.8147369360516123, -0.8125658552859172, -0.809241388387577, -0.8047592841449576, -0.7991234935407472, -0.7923462324692319, -0.7844479276284727, -0.7754570473835146, -0.7654098223229543, -0.754349862903148, -0.7423276838855025, -0.7294001471414652, -0.7156298357744671, -0.7010843733660869, -0.6858357025022668, -0.6699593366075751, -0.6535335985659734, -0.6366388587053226, -0.6193567835497188, -0.6017696053820049, -0.5839594211898652, -0.5660075280680712, -0.5479938006822314, -0.5299961150194566, -0.5120898213990457, -0.4943472686186481, -0.47683738018237676, -0.4596252827993399, -0.4427719867462835, -0.4263341172404952, -0.4103636956469632, -0.39490796912129245, -0.38000928713974225, -0.36570502326311694, -0.3520275403973512, -0.33900419772969825, -0.32665739741914357, -0.3150046689927837, -0.30405878924147967, -0.29382793521938644, -0.2843158677389266, -0.27552214252561136, -0.2674423459691333, -0.26006835219285085, -0.2533885979782393 ] ], "zauto": true, "zmax": 2.182328045161185, "zmin": -2.182328045161185 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.34920307516088606, 0.3376834173330802, 0.32702432821073096, 0.31737965096432136, 0.30891140349120655, 0.30178646890843375, 0.29617106319505904, 0.2922226647432543, 0.2900796157871184, 0.2898493763582517, 0.29159719647094134, 0.29533739962276284, 0.3010292194393643, 0.3085781736177704, 0.31784264563818815, 0.32864421569179886, 0.3407797413510502, 0.3540333003838579, 0.36818664995239525, 0.38302751780163174, 0.39835559348924804, 0.41398643930946405, 0.4297537027447307, 0.4455100420284158, 0.4611271337671322, 0.4764950608536123, 0.4915213060896008, 0.5061295140791792, 0.5202581346181471, 0.5338590243224377, 0.5468960573069671, 0.5593437777800294, 0.5711861152126151, 0.5824151745234588, 0.5930301082077958, 0.6030360736343036, 0.61244327623208, 0.6212660975836756, 0.6295223062665701, 0.6372323484723985, 0.6444187148694882, 0.6511053797875288, 0.6573173085458188, 0.6630800285864287, 0.6684192599887432, 0.6733606009164025, 0.6779292635701613, 0.6821498562819496, 0.6860462074797757, 0.689641227374871 ], [ 0.33936782351578315, 0.3274253438719959, 0.31635239223253897, 0.3063102182722399, 0.297470557544019, 0.29001241942420203, 0.2841162384038033, 0.2799548995602591, 0.27768178484228917, 0.2774169787362973, 0.2792338228085475, 0.2831486015252957, 0.28911581488464255, 0.2970302074953661, 0.30673499034141355, 0.31803427589458894, 0.3307071740316426, 0.34452128296877677, 0.3592440933491499, 0.3746516752112794, 0.3905346639697074, 0.40670192629803226, 0.4229824182622508, 0.4392257346053958, 0.45530176724895727, 0.4710997931110436, 0.4865272218643948, 0.5015081626376993, 0.5159819156351474, 0.5299014573401671, 0.5432319626249061, 0.5559493902837056, 0.5680391475466743, 0.579494842043777, 0.5903171251232132, 0.6005126274754949, 0.6100929860896841, 0.619073960297504, 0.6274746338107822, 0.6353166990828858, 0.6426238199358849, 0.6494210681363254, 0.6557344294386052, 0.6615903745231586, 0.6670154902215817, 0.6720361664316375, 0.676678334173827, 0.6809672503218267, 0.6849273246469374, 0.6885819849479913 ], [ 0.3303649326168584, 0.3180353719766073, 0.30658151976458037, 0.2961713227711809, 0.2869856472865732, 0.27921525487570853, 0.2730547057605687, 0.26869248466325263, 0.2662973964181851, 0.2660025302698137, 0.26788947065580443, 0.2719762357376258, 0.27821200340244534, 0.28647998461733437, 0.29660755704355257, 0.30838103614127377, 0.32156189643560035, 0.3359017893767201, 0.3511547828396372, 0.36708630315642043, 0.38347898728019186, 0.4001360085641705, 0.4168825226609152, 0.43356581372435604, 0.4500545989328055, 0.46623782472597664, 0.4820231840354408, 0.49733550557739453, 0.5121151113211758, 0.5263162013583422, 0.5399053014348792, 0.5528597932115855, 0.5651665378413614, 0.5768205976062905, 0.5878240567667877, 0.5981849405636538, 0.6079162299383001, 0.6170349686667026, 0.6255614590422581, 0.6335185418762447, 0.6409309563448461, 0.6478247750595686, 0.6542269096502191, 0.6601646821121676, 0.6656654571731153, 0.6707563309725406, 0.6754638714145573, 0.679813905648335, 0.6838313502465021, 0.6875400797886431 ], [ 0.32232150419928807, 0.30965206053714917, 0.2978622461329286, 0.28712573679432485, 0.27763156464466243, 0.2695813664374298, 0.2631831243290424, 0.25864044283824106, 0.2561372730789269, 0.2558195350642585, 0.25777685051004934, 0.26202865531714575, 0.26851842713420426, 0.27711756966547557, 0.2876376544049181, 0.29984764992402985, 0.3134922665314185, 0.32830839424686986, 0.3440380228307202, 0.36043729035399613, 0.37728209072144814, 0.39437099411003224, 0.41152625443908, 0.4285935535292909, 0.4454409685420506, 0.46195750075981395, 0.4780513880549155, 0.4936483410421303, 0.5086897877066936, 0.5231311758524836, 0.5369403606879187, 0.5500960915305664, 0.5625866037037944, 0.5744083170853284, 0.5855646401044645, 0.5960648764523648, 0.6059232308823478, 0.6151579099540505, 0.6237903132592871, 0.6318443104724224, 0.6393455994484049, 0.6463211405233907, 0.6527986621437252, 0.6588062329521627, 0.6643718954914591, 0.6695233567420231, 0.6742877307898875, 0.6786913290219205, 0.6827594933653766, 0.6865164682272019 ], [ 0.3153628344730777, 0.30241288482173095, 0.29034500006573166, 0.2793373648289161, 0.26958580230456086, 0.2613013568372897, 0.25470396349205293, 0.2500109799170007, 0.24742032689922266, 0.24708981980112713, 0.2491164479799773, 0.25352069758332685, 0.2602403564470135, 0.26913550175372597, 0.2800028950145865, 0.2925956164188487, 0.3066433848078096, 0.3218702224319836, 0.33800787534694327, 0.3548048387834495, 0.3720316501641399, 0.38948338473342325, 0.4069802389448528, 0.42436690502231084, 0.4415112403165923, 0.45830256710345163, 0.4746498146306643, 0.49047963099765063, 0.50573453828629, 0.520371170976902, 0.5343586178138183, 0.5476768758199965, 0.560315418734702, 0.5722718786481519, 0.5835508377524089, 0.5941627261696768, 0.6041228213333582, 0.6134503441525387, 0.6221676470662202, 0.6302994890302376, 0.637872392450213, 0.644914077067243, 0.6514529658155901, 0.657517757702654, 0.6631370628108955, 0.6683390945890727, 0.6731514146858115, 0.6776007256817315, 0.6817127071965294, 0.6855118909841647 ], [ 0.30960741459586016, 0.29644845248441837, 0.28417346193161075, 0.2729636917146429, 0.2630199729624777, 0.25456065667274785, 0.24781529483830456, 0.2430125843498014, 0.24036214747793927, 0.24003183160291017, 0.24212478488817102, 0.24666218221021377, 0.2535766995326316, 0.262718562400184, 0.27387191125028176, 0.28677655666781954, 0.30114996305123526, 0.3167058745306862, 0.33316805867538457, 0.3502792252818368, 0.367805995463295, 0.38554100929017443, 0.4033031437151911, 0.42093658108094106, 0.43830923931804827, 0.45531089287477927, 0.47185118471187143, 0.48785764527144965, 0.5032737818719607, 0.518057270777142, 0.5321782663341377, 0.5456178317484144, 0.5583664908773696, 0.5704228978232228, 0.5817926198848753, 0.5924870289085185, 0.6025222958903452, 0.6119184836428019, 0.6206987323482411, 0.6288885328523626, 0.6365150825819265, 0.6436067190056319, 0.650192425596569, 0.656301405302768, 0.6619627165918518, 0.6672049672084776, 0.6720560608702634, 0.6765429922297288, 0.6806916855468447, 0.6845268726492832 ], [ 0.30516109573769784, 0.2918756042172191, 0.27947645127033455, 0.2681463241180109, 0.25808891095151487, 0.24952716116455087, 0.24269703902602616, 0.2378350836228903, 0.2351591992578404, 0.2348444219571297, 0.2369983056115369, 0.24164242163481692, 0.24870559457520944, 0.2580307864130125, 0.2693929725771997, 0.2825224798894347, 0.2971281663722522, 0.31291669566655367, 0.3296064567888793, 0.346936357947599, 0.3646705315189162, 0.3826001481827602, 0.4005433695894425, 0.41834420129224464, 0.4358707585070727, 0.45301326649861945, 0.46968198635076774, 0.4858051730867114, 0.5013271223254534, 0.5162063322508669, 0.5304137913559681, 0.5439313937902248, 0.5567504798231072, 0.5688704969486387, 0.5802977763551516, 0.5910444192480591, 0.601127287516171, 0.6105670933154664, 0.6193875822395533, 0.6276148048292196, 0.6352764712415028, 0.6424013839563971, 0.6490189434534023, 0.6551587218465318, 0.6608500995296087, 0.6661219599566041, 0.671002437766356, 0.6755187155585396, 0.6796968647391424, 0.683561725979875 ], [ 0.3021109062280411, 0.2887900002849645, 0.2763590749712209, 0.2650004995645472, 0.2549183797650334, 0.2463370575484771, 0.23949497261481836, 0.2346320781156185, 0.231970140969924, 0.23168769510824047, 0.23389449969018056, 0.23861234392221709, 0.24576812040032198, 0.2552011326350042, 0.2666817582444088, 0.27993560641382365, 0.2946673042403591, 0.3105800860465817, 0.32738978422222076, 0.3448335450314794, 0.36267439163280063, 0.38070288744102865, 0.39873695639139906, 0.4166206305976571, 0.4342222371304136, 0.4514323411059269, 0.46816163055605725, 0.4843388454112988, 0.4999088031873231, 0.5148305455495545, 0.5290756144202089, 0.5426264582516409, 0.55547496519119, 0.5676211181549677, 0.5790717662121372, 0.5898395065642847, 0.5999416714837682, 0.6093994147073433, 0.6182368919081861, 0.626480529972954, 0.6341583798916307, 0.6412995481336101, 0.6479337014418427, 0.6540906400345732, 0.6597999342661262, 0.6650906198676758, 0.6699909469682429, 0.674528178186973, 0.6787284311915058, 0.6826165612353059 ], [ 0.3005192392372168, 0.2872591196836128, 0.2748943210833766, 0.2636050588721126, 0.2535932404519555, 0.24508109008671958, 0.2383051372484797, 0.23350375048594138, 0.23089753071085226, 0.2306643131989927, 0.23291361701241392, 0.23766738437560853, 0.24485294882610906, 0.25431022363649425, 0.2658102562728975, 0.2790793030534862, 0.29382256396299933, 0.3097437491334369, 0.32655906865492057, 0.34400596114120585, 0.36184767625136216, 0.3798749591257121, 0.39790589005512716, 0.4157846482007643, 0.43337971050511837, 0.45058180306936707, 0.4673017909102636, 0.4834686090204527, 0.49902728793736556, 0.5139370985628885, 0.5281698253865258, 0.541708169135373, 0.554544275890508, 0.566678387927107, 0.57811761085828, 0.5888747914975963, 0.5989675008985308, 0.6084171171356829, 0.6172480025016467, 0.6254867698850458, 0.6331616331684135, 0.6403018365446357, 0.6469371577043561, 0.6530974798996693, 0.6588124279458686, 0.6641110632859337, 0.6690216333139998, 0.6735713702361164, 0.6777863348409228, 0.6816913006612413 ], [ 0.30041924685856547, 0.28731677039955084, 0.2751165318443547, 0.26399473151602143, 0.2541484261853902, 0.24579416517123936, 0.2391621283845569, 0.23448404830070427, 0.23197429105001285, 0.23180578317063402, 0.23408538254629535, 0.23883518403199733, 0.24598542998976272, 0.2553810192400482, 0.2667990378273979, 0.2799718352117247, 0.2946100442498069, 0.31042178845821883, 0.32712660351530665, 0.34446427502211613, 0.3621996069629047, 0.3801243028051964, 0.39805697891239633, 0.41584206722940986, 0.4333481183323104, 0.4504658271348172, 0.4671059735099558, 0.48319738668304485, 0.49868499149783374, 0.5135279650765696, 0.527698015824285, 0.5411777878152739, 0.5539593890235976, 0.5660430396440811, 0.5774358357638235, 0.5881506232629488, 0.5982049767178186, 0.6076202780859787, 0.6164208899941573, 0.6246334184982809, 0.6322860602287579, 0.6394080288750716, 0.6460290560036749, 0.6521789612452914, 0.6578872869343994, 0.6631829923368131, 0.668094202662554, 0.6726480081323603, 0.6768703084491732, 0.6807856981229962 ], [ 0.3018122016789632, 0.2889601072421734, 0.27701805219927805, 0.26615640164115284, 0.25656483245963696, 0.2484509004716915, 0.24203437328668964, 0.23753579874142777, 0.23515880128005204, 0.2350676852964497, 0.2373645146689047, 0.24207152174401245, 0.24912401572923917, 0.258375758201396, 0.26961470123507525, 0.2825842682204391, 0.2970050541660967, 0.31259334104344216, 0.32907485637925216, 0.3461937806244204, 0.3637178362120389, 0.38144051788863187, 0.3991814196664966, 0.4167853912798496, 0.43412103354036763, 0.45107886311875245, 0.46756935009120154, 0.4835209476576092, 0.4988781808979512, 0.5135998298574441, 0.5276572239127457, 0.5410326540461234, 0.5537179040123235, 0.5657128983919186, 0.57702446398829, 0.5876652002611948, 0.5976524541220601, 0.6070073942449581, 0.6157541799710472, 0.6239192198536777, 0.6315305148840632, 0.638617081443675, 0.6452084490454315, 0.6513342279498351, 0.6570237417738765, 0.662305720249916, 0.6672080473395418, 0.6717575599649434, 0.6759798926896998, 0.6798993637645823 ], [ 0.3046673000418543, 0.2921497481756493, 0.28054978258171975, 0.2700302403471766, 0.26077117803189875, 0.25296834324216155, 0.2468277754750352, 0.24255524377033108, 0.24034015303572892, 0.24033534975151072, 0.24263644658033498, 0.2472657121325379, 0.25416505319078303, 0.2631999956468889, 0.27417312588799186, 0.28684299978497, 0.30094403314013324, 0.31620400664068277, 0.3323575207419531, 0.34915516683390585, 0.36636901047775267, 0.3837952775764143, 0.4012551044815748, 0.41859404539646816, 0.4356808392125056, 0.45240577448427666, 0.46867886937610076, 0.48442799966523115, 0.4995970534127257, 0.5141441568608562, 0.5280399954647226, 0.5412662417371551, 0.5538140944805585, 0.5656829299093099, 0.5768790628561636, 0.5874146149485175, 0.5973064858969891, 0.6065754236113395, 0.6152451886095425, 0.623341808039295, 0.630892914546208, 0.6379271651764722, 0.6444737354808587, 0.6505618839836478, 0.6562205821898078, 0.6614782053240033, 0.6663622790249223, 0.6708992772587562, 0.6751144667682754, 0.6790317934416887 ], [ 0.30892394810991053, 0.29681297509840276, 0.28562552910086053, 0.2755154543852829, 0.266651383744408, 0.2592151413612372, 0.2533967018549634, 0.24938466039371635, 0.24735197651712176, 0.24743824485050633, 0.24973151986914488, 0.25425388635517326, 0.2609546115226003, 0.2697126832101244, 0.2803477540549679, 0.2926363696249236, 0.30632971363935274, 0.3211698211235476, 0.3369025469160674, 0.3532868200148608, 0.3701005192262406, 0.3871436613147258, 0.4042396417493157, 0.4212351639863477, 0.43799934237403554, 0.4544223215248944, 0.470413641856139, 0.4859004991168514, 0.5008259899336092, 0.5151473989324137, 0.5288345598317575, 0.5418683084903892, 0.5542390370492134, 0.5659453529209477, 0.5769928431077312, 0.5873929423305879, 0.5971619022271054, 0.6063198581105835, 0.6148899893040082, 0.6228977687581979, 0.6303702974707608, 0.6373357191016054, 0.6438227101070044, 0.6498600406716448, 0.655476201696749, 0.6606990930961819, 0.6655557686586847, 0.670072232752608, 0.6742732841813379, 0.6781824025459703 ], [ 0.3144961253047413, 0.3028494041841394, 0.29212924785749694, 0.28247936641349863, 0.2740557050984746, 0.26702484139480015, 0.2615593885091343, 0.257829586245372, 0.25599094527024574, 0.2561690083283591, 0.2584436863634502, 0.2628365545548458, 0.2693042783420026, 0.2777398346151505, 0.287981024993433, 0.29982397053669707, 0.31303854734738346, 0.32738309188472003, 0.34261668336612794, 0.3585083397965187, 0.37484321233325074, 0.391426257809134, 0.40808398937856033, 0.4246648660416701, 0.44103877629617183, 0.457095955242465, 0.4727455739398284, 0.4879141622830627, 0.5025439709422138, 0.5165913396491988, 0.5300251136471167, 0.5428251335090203, 0.5549808128383803, 0.5664898115213712, 0.5773568078290043, 0.5875923698647975, 0.5972119250467468, 0.6062348251385324, 0.6146835035769255, 0.6225827213371666, 0.6299588972447503, 0.6368395184218415, 0.6432526264109799, 0.649226374422212, 0.6547886510858156, 0.6599667660509847, 0.6647871927458107, 0.6692753636037885, 0.673455513067908, 0.6773505637080355 ], [ 0.3212780989093216, 0.310138115598379, 0.2999238081557715, 0.29076800054234814, 0.2828132631112532, 0.27621037844322527, 0.27111425151639534, 0.2676766335088104, 0.2660355962575425, 0.2663026366396632, 0.268549365187048, 0.2727964608718693, 0.2790074667602556, 0.28708892549770987, 0.2968967136764916, 0.3082469536589315, 0.3209291357789322, 0.3347191868917829, 0.34939088307764626, 0.3647248138422802, 0.38051476772822584, 0.3965718158075188, 0.4127265442820972, 0.4288299074601454, 0.44475311310194043, 0.460386865958867, 0.47564021105146403, 0.4904391479189904, 0.5047251333312522, 0.5184535510585006, 0.5315922001300544, 0.5441198344764037, 0.5560247743838125, 0.5673036018737329, 0.5779599465872652, 0.5880033650728441, 0.5974483139174956, 0.6063132155147513, 0.6146196141538169, 0.6223914193658004, 0.6296542329551091, 0.6364347557978339, 0.6427602702503701, 0.6486581938442357, 0.6541556998228201, 0.6592793999873222, 0.6640550852536916, 0.6685075192763702, 0.6726602804681168, 0.6765356477408807 ], [ 0.3291506495163144, 0.3185451418576587, 0.3088598647035264, 0.3002164132729191, 0.2927438404135462, 0.28657725616633095, 0.2818542719585775, 0.2787088057372438, 0.2772622281490692, 0.27761256310270926, 0.27982327721953415, 0.28391376019719167, 0.28985356480937235, 0.2975617261529072, 0.3069112653555439, 0.31773780036560856, 0.32985047995927125, 0.34304338033876397, 0.3571059089568228, 0.3718313638195519, 0.38702335510451724, 0.4025001866893597, 0.4180975032838904, 0.4336695768684882, 0.4490895897242578, 0.4642492159215815, 0.4790577377138317, 0.49344087286632904, 0.5073394393325716, 0.5207079456435602, 0.5335131674467103, 0.5457327507022888, 0.5573538680825318, 0.5683719454437494, 0.578789468578118, 0.5886148758732966, 0.5978615393628521, 0.6065468344875221, 0.6146912973972883, 0.62231786759522, 0.6294512130104369, 0.6361171340888877, 0.6423420431372409, 0.6481525148990497, 0.6535749041509809, 0.658635025959255, 0.6633578941202035, 0.66776751321815, 0.6718867196676493, 0.675737067067755 ], [ 0.33798705445896776, 0.32793039425921905, 0.3187837451283107, 0.3106575126172145, 0.30366754917433986, 0.2979339306634825, 0.29357792690778334, 0.29071679287133567, 0.2894563837914559, 0.28988216673413436, 0.292049827411799, 0.29597711315782366, 0.30163856504845077, 0.3089642794684378, 0.31784295243545063, 0.32812853368159767, 0.3396491844533819, 0.3522170513132752, 0.3656375816171477, 0.37971753166079303, 0.39427126740293905, 0.4091253114606511, 0.4241213102433386, 0.4391176967473188, 0.4539903441280016, 0.4686324788650257, 0.4829540768352397, 0.49688091707841164, 0.5103534245182154, 0.5233253972831943, 0.535762686701416, 0.5476418774533586, 0.5589490003506754, 0.5696782994224558, 0.5798310673179934, 0.5894145576086207, 0.5984409787456509, 0.6069265717386133, 0.6148907717229031, 0.622355452250398, 0.6293442501916379, 0.6358819684637976, 0.641994053309941, 0.6477061424922721, 0.653043680484256, 0.6580315965266201, 0.6626940412339845, 0.6670541772939756, 0.6711340196867794, 0.6749543207719244 ], [ 0.3476582941806683, 0.33815343622276256, 0.3295437319832537, 0.32192875445940344, 0.3154118188723233, 0.31009895480762717, 0.3060963678854452, 0.3035060989945782, 0.302419895414556, 0.30291175163808765, 0.3050300573617381, 0.30879063489561726, 0.31417198456904644, 0.3211137091145405, 0.3295184449569114, 0.3392569129904247, 0.3501751570813156, 0.36210280835690994, 0.3748612938495608, 0.38827118939563227, 0.4021582613192736, 0.41635804551261923, 0.43071902697821535, 0.44510460354778075, 0.4593940642003366, 0.47348281135903225, 0.48728203034191503, 0.5007179734701809, 0.5137309903936567, 0.5262744044307089, 0.5383133086551882, 0.5498233350455227, 0.5607894344998601, 0.5712046939772639, 0.5810692085523904, 0.5903890200104002, 0.599175129157233, 0.6074425858162363, 0.6152096581807309, 0.6224970815383964, 0.6293273851908486, 0.6357242955241535, 0.6417122125447584, 0.6473157567099478, 0.6525593825031415, 0.6574670548994073, 0.6620619846149807, 0.6663664178256486, 0.6704014758687981, 0.6741870403138392 ], [ 0.35803720309577863, 0.34907785814601006, 0.3409945647510591, 0.33387665644562803, 0.3278158024022031, 0.3229051729497855, 0.31923734000646037, 0.3169006808051235, 0.31597430365535867, 0.3165218626643756, 0.3185849981916522, 0.3221774093985414, 0.32728061169011824, 0.33384219678771443, 0.34177694795068503, 0.3509706155604022, 0.3612857040080913, 0.37256837994482755, 0.3846556075515051, 0.3973817884961106, 0.41058443735496924, 0.42410867305701994, 0.43781050308944636, 0.45155900398717563, 0.46523756606362776, 0.47874438927416885, 0.49199240811894485, 0.5049088005511753, 0.5174342082925072, 0.5295217691275277, 0.5411360382085442, 0.5522518559799645, 0.5628532049345017, 0.5729320855324961, 0.5824874326181078, 0.5915240869417373, 0.6000518314192169, 0.6080844980953889, 0.6156391490950769, 0.6227353328783897, 0.6293944156728938, 0.6356389868848085, 0.6414923364856775, 0.6469780017502947, 0.652119380229552, 0.6569394054401133, 0.6614602814172134, 0.6657032719943352, 0.6696885404388808, 0.6734350348867585 ], [ 0.36900150964066963, 0.3605742806078489, 0.3530003036948991, 0.34635941812859183, 0.3407326611099455, 0.33620161003621624, 0.3328466619690407, 0.33074406427119185, 0.3299617163975361, 0.3305540386333547, 0.33255649105926155, 0.3359805374331452, 0.3408098967029758, 0.346998765399137, 0.35447235690796053, 0.3631296870300847, 0.37284816411344723, 0.3834893129308854, 0.394904907890159, 0.4069428847103712, 0.4194525774884167, 0.43228902525073964, 0.4453162628307973, 0.4584096339720594, 0.4714572381305679, 0.4843606555782248, 0.4970351005810427, 0.5094091411327838, 0.5214241046178273, 0.5330332674987872, 0.5442009068761602, 0.5549012740591385, 0.5651175355905474, 0.5748407153920462, 0.5840686624861122, 0.5928050616741866, 0.6010584991802035, 0.6088415912299299, 0.6161701805159452, 0.6230626032433993, 0.6295390277644175, 0.6356208645358402, 0.6413302461595961, 0.6466895755009606, 0.6517211392651959, 0.6564467839047633, 0.6608876503003004, 0.6650639632935953, 0.6689948718436466, 0.6726983353276751 ], [ 0.38043586390609935, 0.37252217862150705, 0.3654358631669393, 0.35924808548278825, 0.35403030445508055, 0.3498537643380538, 0.34678809351537354, 0.34489885674797643, 0.3442440807493938, 0.34486999330221424, 0.3468064413775754, 0.35006262002591265, 0.35462378883614937, 0.3604495437441323, 0.3674739662517952, 0.37560765557634174, 0.3847413504827413, 0.3947506416222131, 0.4055011971298782, 0.41685396444051265, 0.4286699302832088, 0.4408141710043143, 0.45315906806172707, 0.4655866763077324, 0.47799030840833395, 0.49027544056392935, 0.5023600605260023, 0.5141745774977233, 0.5256614023044102, 0.5367742906345414, 0.5474775256552274, 0.5577450008542314, 0.5675592504696431, 0.5769104636118649, 0.5857955090796482, 0.5942169906732323, 0.6021823472065237, 0.6097030071122661, 0.6167936042453682, 0.6234712589868867, 0.6297549268431656, 0.6356648152686944, 0.6412218682983022, 0.6464473176642764, 0.6513622983310516, 0.6559875257584088, 0.6603430316741311, 0.6644479546822477, 0.668320381646335, 0.6719772354687479 ], [ 0.39223303177104635, 0.3848107885894369, 0.37818756722718117, 0.37242670653861165, 0.36759112067549576, 0.3637429186628245, 0.3609422672783412, 0.3592453742794849, 0.35870161109394294, 0.35934997146765807, 0.3612152403239711, 0.36430437833220436, 0.3686036676620246, 0.3740770890636153, 0.38066622011239293, 0.38829170376051153, 0.39685609812038747, 0.40624773991598256, 0.4163451674023235, 0.4270216545238208, 0.4381494832253987, 0.44960369151145735, 0.46126515012697966, 0.4730229196353287, 0.48477591247792673, 0.4964339304140037, 0.5079181707660911, 0.5191613012687264, 0.5301071990081664, 0.5407104387728484, 0.5509356035324274, 0.5607564769004028, 0.5701551655304121, 0.5791211890139942, 0.5876505661467483, 0.5957449193396488, 0.6034106132907585, 0.6106579395766115, 0.6175003553485285, 0.6239537816229008, 0.6300359645597091, 0.6357659014843258, 0.6411633321068166, 0.6462482943399991, 0.651040743245254, 0.6555602308961593, 0.6598256443139343, 0.6638549980781931, 0.667665277744561, 0.6712723298073545 ], [ 0.4042944569856589, 0.397339360432917, 0.3911530511137873, 0.3857918581752565, 0.38131112612745055, 0.37776493353101764, 0.3752051716565602, 0.37367988265598095, 0.3732308753669259, 0.3738907804531063, 0.3756798477338689, 0.3786028924707225, 0.38264683173123165, 0.3877791992374608, 0.3939478937269364, 0.401082232370464, 0.4090951919660373, 0.41788656961364345, 0.4273467089023488, 0.43736042311925455, 0.44781079070578583, 0.4585825771619173, 0.46956512807809825, 0.4806546617339734, 0.491755956346037, 0.5027834732210555, 0.5136619842228969, 0.5243267839506472, 0.5347235683346803, 0.5448080560202345, 0.5545454200674892, 0.563909587346341, 0.5728824529233882, 0.5814530474976721, 0.5896166878915354, 0.5973741338314262, 0.6047307686978588, 0.6116958174455217, 0.618281611326644, 0.6245029062249134, 0.6303762591688323, 0.6359194658085151, 0.6411510601976641, 0.6460898770352047, 0.6507546755226223, 0.6551638231365906, 0.6593350368717147, 0.663285178858287, 0.6670301026984565, 0.6705845463918719 ], [ 0.41653037821361033, 0.4100169805812269, 0.4042407686596719, 0.39925183146448534, 0.3950988389780691, 0.3918288369018411, 0.3894865002455724, 0.38811276364556513, 0.38774284536845904, 0.38840379864739205, 0.39011183664749094, 0.3928697599057383, 0.3966648440285338, 0.4014675080765843, 0.40723098456488477, 0.4138920716299917, 0.4213728987151282, 0.42958351142060003, 0.43842500162980264, 0.44779288342843226, 0.4575804373796889, 0.467681800190741, 0.4779946460419604, 0.488422374802848, 0.4988757811162171, 0.5092742223182541, 0.5195463319345209, 0.5296303411089464, 0.539474075899118, 0.5490346970891271, 0.5582782437490638, 0.5671790342700006, 0.5757189704447959, 0.583886782235259, 0.5916772436543201, 0.5990903839146069, 0.6061307126950664, 0.6128064739974127, 0.6191289394951707, 0.6251117493913587, 0.6307703064678098, 0.6361212271122989, 0.6411818515480064, 0.6459698141817205, 0.6505026738698454, 0.6547976029302778, 0.6588711328748363, 0.6627389540859411, 0.6664157660075932, 0.6699151738664627 ], [ 0.4288596554157561, 0.4227621406323432, 0.4173692953733203, 0.41272567337321536, 0.40887407604433224, 0.40585540406644294, 0.4037080522272201, 0.4024667804611054, 0.4021610767472498, 0.4028131226025786, 0.4044355621750482, 0.4070293417317606, 0.4105819104294941, 0.415066046474579, 0.4204394979470497, 0.426645519719845, 0.43361427015933685, 0.4412649278059439, 0.4495083172138421, 0.45824980263383036, 0.4673922159135623, 0.47683862111813446, 0.4864947701450128, 0.49627115904789976, 0.5060846450869644, 0.5158596247324561, 0.5255288013687922, 0.53503358900093, 0.544324206820998, 0.5533595214156081, 0.5621066909128232, 0.5705406603148115, 0.5786435510004536, 0.5864039808385183, 0.5938163450996019, 0.600880082704353, 0.6075989474263664, 0.6139802994941889, 0.6200344295544458, 0.6257739240789283, 0.6312130789223023, 0.6363673657655893, 0.6412529545256367, 0.6458862933990631, 0.6502837469836981, 0.6544612918409101, 0.6584342679028974, 0.6622171832774176, 0.6658235692557574, 0.6692658816921584 ], [ 0.4412094224255325, 0.43550217614999603, 0.4304665541967936, 0.426142209085032, 0.42256678954529187, 0.41977583361129595, 0.4178022774011992, 0.41667552490714643, 0.41642009305689154, 0.4170539238814552, 0.41858652818436665, 0.42101717770644725, 0.4243333827101522, 0.4285098725186931, 0.43350823985052545, 0.4392773265805078, 0.44575433563791195, 0.45286656918146656, 0.46053363138176384, 0.4686699025891876, 0.47718709028528217, 0.4859966849918685, 0.4950121871773072, 0.5041510148920547, 0.5133360439208862, 0.5224967678569712, 0.5315700924861414, 0.5405007970312601, 0.5492417052112903, 0.5577536133616099, 0.5660050227806552, 0.5739717205645897, 0.581636248704744, 0.5889872960569915, 0.5960190425557121, 0.6027304801074864, 0.60912473015502, 0.6152083740228365, 0.6209908088379534, 0.6264836390111018, 0.6317001108952476, 0.6366545962304774, 0.6413621282642792, 0.6458379929408069, 0.6500973762325493, 0.6541550675080264, 0.6580252177687853, 0.6617211506391423, 0.6652552231533078, 0.6686387326634659 ], [ 0.45351464786585294, 0.44817265745256263, 0.4434690415852884, 0.4394391147987004, 0.4361160031347971, 0.4335305669442809, 0.4317110016939069, 0.43068207225261307, 0.4304639934623033, 0.4310710331163616, 0.43250997193448054, 0.43477859729720636, 0.4378644239409786, 0.4417438206740367, 0.44638167894455344, 0.45173169462357216, 0.45773726097535095, 0.46433290201466576, 0.47144612259200663, 0.47899952119211037, 0.4869130046761998, 0.49510595750940956, 0.5034992450932073, 0.5120169646601653, 0.5205878916708485, 0.5291466004293701, 0.5376342622966398, 0.5459991426732785, 0.5541968292485026, 0.5621902299156446, 0.5699493805283682, 0.5774511015703615, 0.5846785399109162, 0.5916206279573695, 0.5982714882946985, 0.6046298077202886, 0.6106982006738492, 0.6164825785455077, 0.6219915382547816, 0.6272357808130835, 0.6322275682676596, 0.6369802254183003, 0.6415076909415961, 0.645824120999631, 0.649943547010238, 0.653879587986331, 0.6576452166971901, 0.6612525778606666, 0.6647128556466776, 0.6680361869691762 ], [ 0.46571765817528177, 0.46071678166586943, 0.45632109599958115, 0.4525620738009807, 0.44946886947899045, 0.4470682629526877, 0.4453843350020164, 0.44443783803134, 0.4442452735776825, 0.4448177395685166, 0.4461596575216612, 0.44826752378513, 0.4511288424598221, 0.45472138728724193, 0.4590129066462076, 0.46396133566298553, 0.46951552140360386, 0.4756164113677552, 0.48219861085397464, 0.4891921868118902, 0.4965245861733815, 0.5041225434352443, 0.5119138711589737, 0.5198290528490996, 0.5278025854887567, 0.5357740450794641, 0.5436888704807604, 0.5514988776118489, 0.5591625276050143, 0.5666449793738333, 0.5739179601794564, 0.5809594881199084, 0.5877534789278329, 0.5942892667841748, 0.6005610656050844, 0.606567393835599, 0.612310482443413, 0.6177956826958366, 0.6230308874888071, 0.6280259774903683, 0.6327923011410521, 0.6373421955822118, 0.6416885538177451, 0.6458444418156084, 0.6498227677920494, 0.6536360045736703, 0.6572959646915627, 0.6608136267293513, 0.6641990104323089, 0.6674610972019408 ], [ 0.4777676552334177, 0.4730847923098996, 0.46897422721025356, 0.4654640252865353, 0.4625798496103778, 0.4603449192656989, 0.4587797453275978, 0.4579016151051221, 0.45772383453381627, 0.4582547807460424, 0.4594968549753699, 0.4614454532697862, 0.4640880836535373, 0.4674037507710203, 0.47136270353342435, 0.47592660216247495, 0.4810491150667232, 0.48667691088487286, 0.4927509736468458, 0.4992081439891847, 0.5059827785143818, 0.5130084217940889, 0.5202193983174723, 0.5275522510630187, 0.5349469755045023, 0.5423480195846752, 0.549705039316462, 0.5569734150149971, 0.564114544377297, 0.5710959359517094, 0.5778911305613196, 0.5844794796873944, 0.5908458094013054, 0.5969799967904993, 0.6028764834660739, 0.6085337480461269, 0.6139537567409886, 0.6191414084860293, 0.6241039885618623, 0.6288506423435777, 0.6333918787286038, 0.6377391108861381, 0.6419042402214198, 0.6458992878280735, 0.6497360761905263, 0.6534259624844975, 0.6569796235055091, 0.6604068910410037, 0.6637166354057861, 0.6669166939017581 ], [ 0.4896202462472849, 0.4852334376214278, 0.4813865102619462, 0.47810450204589755, 0.4754100026466909, 0.4733231219221114, 0.4718612754403901, 0.47103876325072164, 0.47086615040407265, 0.4713494920646287, 0.47248947688076853, 0.47428058433558723, 0.47671036100771547, 0.47975891509170115, 0.4833987088187369, 0.48759469779820774, 0.4923048298529705, 0.4974808794803005, 0.5030695629710011, 0.5090138572768745, 0.5152544346872747, 0.5217311249704437, 0.5283843249842387, 0.5351562901070809, 0.5419922592389673, 0.5488413829818453, 0.5556574409946807, 0.5623993482445132, 0.5690314604281826, 0.5755236962238844, 0.5818514985858128, 0.587995659528997, 0.5939420333226854, 0.5996811622422653, 0.6052078374650167, 0.6105206156805093, 0.6156213097728175, 0.620514469685386, 0.6252068673989125, 0.6297069978859279, 0.6340246059667526, 0.6381702471735736, 0.6421548890171267, 0.6459895574278478, 0.6496850315993243, 0.6532515889937686, 0.6566988008833686, 0.6600353775123814, 0.6632690607934245, 0.6664065614212084 ], [ 0.5012369939383878, 0.4971254697368418, 0.4935220399129416, 0.49044904654543314, 0.48792636953212176, 0.4859714020198817, 0.4845988766311088, 0.4838205230835722, 0.4836445644239939, 0.48407508703402347, 0.48511134449997584, 0.48674707326127736, 0.4889699055575926, 0.4917609611097434, 0.49509468370562404, 0.4989389648406428, 0.5032555676184263, 0.5080008346955477, 0.5131266383059045, 0.5185815114267674, 0.5243118885623149, 0.5302633824960322, 0.5363820285167116, 0.5426154380858771, 0.5489138174476103, 0.555230821199891, 0.5615242246923854, 0.5677564111749934, 0.5738946793079223, 0.5799113838061376, 0.5857839267844355, 0.5914946201315042, 0.5970304403870925, 0.6023826975427287, 0.6075466383061163, 0.6125210029669852, 0.6173075533087024, 0.6219105871863136, 0.6263364535402706, 0.6305930797925062, 0.6346895218022763, 0.638635544848178, 0.6424412424453891, 0.6461166981977112, 0.6496716943209015, 0.6531154689629676, 0.6564565230028141, 0.6597024756527125, 0.6628599669493445, 0.6659346041217123 ], [ 0.5125849893190002, 0.5087291819877997, 0.5053504376741951, 0.5024686926048954, 0.5001014335746509, 0.4982636784006021, 0.49696783575687314, 0.49622342862606544, 0.49603668741563917, 0.4964100414884278, 0.4973415580186874, 0.4988243915047974, 0.5008463135520864, 0.5033893895637314, 0.506429857132661, 0.5099382420446809, 0.5138797247896689, 0.5182147467332505, 0.5228998238602519, 0.5278885197688274, 0.5331325197983313, 0.5385827450870038, 0.5441904482590539, 0.5499082399474164, 0.5556910057827912, 0.5614966851693374, 0.5672868947348683, 0.5730273897859504, 0.5786883658173643, 0.5842446088775737, 0.5896755084037894, 0.5949649492147497, 0.6001011009814478, 0.6050761240070505, 0.609885809840704, 0.6145291743848837, 0.6190080199370209, 0.6233264811819281, 0.6274905686218161, 0.6315077213550606, 0.6353863795246718, 0.6391355851654783, 0.6427646185898696, 0.646282675868574, 0.6496985913926404, 0.6530206079597791, 0.6562561953346261, 0.6594119168173389, 0.6624933420515874, 0.6655050031459268 ], [ 0.5236364462818479, 0.5200179794512477, 0.5168464025748646, 0.5141395000641679, 0.5119126418932457, 0.5101787677948403, 0.5089482749875706, 0.5082287966164372, 0.5080248759051141, 0.5083375594353157, 0.5091639492660796, 0.5104967652767997, 0.5123239743078153, 0.514628540518384, 0.5173883421762746, 0.5205762852251633, 0.524160625658304, 0.5281054935688695, 0.5323715942728571, 0.5369170481256955, 0.5416983218132729, 0.5466712003587233, 0.5517917504410825, 0.5570172309055318, 0.5623069143017205, 0.5676227926224967, 0.5729301499893815, 0.5781979939683303, 0.583399344927327, 0.588511389077588, 0.593515505512946, 0.5983971807794211, 0.6031458264669618, 0.6077545162564482, 0.6122196590164122, 0.6165406241389859, 0.6207193345080626, 0.6247598414363315, 0.6286678946836608, 0.6324505193357706, 0.6361156099131655, 0.6396715506143399, 0.643126869085289, 0.6464899295600796, 0.6497686696495872, 0.652970383489627, 0.6561015524252775, 0.6591677229414548, 0.6621734301905501, 0.6651221642563067 ], [ 0.5343683159067796, 0.5309699774639811, 0.5279892973106085, 0.5254421313201297, 0.523341974268577, 0.5216999469953527, 0.5205247073895909, 0.5198222747650648, 0.519595771697701, 0.5198451023153461, 0.5205665991934879, 0.5217526804569848, 0.5233915629726472, 0.5254670759702504, 0.5279586122664516, 0.5308412425427552, 0.5340860035345611, 0.5376603555326966, 0.5415287902539458, 0.5456535585218475, 0.5499954793632617, 0.5545147884687078, 0.5591719842824432, 0.5639286336205097, 0.5687481047345219, 0.5735962031426183, 0.5784416934122647, 0.5832566976560549, 0.5880169682677606, 0.5927020380795268, 0.5972952555494757, 0.6017837158218982, 0.6061581006613579, 0.6104124415169554, 0.6145438205054178, 0.618552024081504, 0.6224391637355013, 0.6262092773324264, 0.6298679237666933, 0.6334217825033008, 0.6368782683455808, 0.640245170431425, 0.6435303230304323, 0.646741314210238, 0.6498852368831853, 0.6529684851637638, 0.6559965973997558, 0.658974145729013, 0.6619046706054352, 0.6647906574776613 ], [ 0.5447619181137581, 0.5415676233031436, 0.538762762705843, 0.5363614606393081, 0.5343755485841728, 0.5328145548687644, 0.5316856351342525, 0.530993435066716, 0.5307398886673611, 0.5309239673900978, 0.531541406098061, 0.5325844394328056, 0.5340415857230513, 0.5358975144578155, 0.5381330277689598, 0.5407251771130198, 0.5436475247050048, 0.5468705467885907, 0.5503621640715725, 0.5540883749102452, 0.5580139599740448, 0.5621032235566783, 0.566320736349626, 0.5706320469145446, 0.5750043336045388, 0.5794069745198246, 0.5838120195006634, 0.5881945545345563, 0.5925329548210864, 0.5968090278020649, 0.6010080515851047, 0.6051187173457683, 0.6091329865510424, 0.6130458753184199, 0.6168551790427677, 0.6205611507175329, 0.6241661462618329, 0.6276742497318806, 0.6310908906115432, 0.6344224644891168, 0.6376759673665164, 0.6408586526346991, 0.6439777184040009, 0.6470400314214294, 0.6500518922663445, 0.6530188449270544, 0.6559455322673453, 0.6588355973435734, 0.6616916290821508, 0.6645151495250038 ], [ 0.554802588579121, 0.5517973371473254, 0.5491543549503313, 0.5468862092506954, 0.5450032546365379, 0.5435136250017439, 0.5424231803853633, 0.541735401709636, 0.5414512359994896, 0.5415689043949277, 0.5420836938282408, 0.542987759414839, 0.5442699675141691, 0.5459158086392362, 0.5479074050418811, 0.5502236304860924, 0.5528403504349859, 0.5557307808186601, 0.5588659539297204, 0.5622152718499114, 0.5657471218809358, 0.5694295251045006, 0.5732307884392503, 0.5771201321057151, 0.5810682677630447, 0.5850479071563701, 0.5890341863240566, 0.5930049957443366, 0.5969412118484171, 0.6008268298179389, 0.6046490013656953, 0.6083979842180298, 0.612067012297364, 0.6156520972127271, 0.6191517726962055, 0.6225667941687801, 0.6258998057663895, 0.6291549869767493, 0.6323376905827591, 0.6354540829168315, 0.6385107965285297, 0.641514604275987, 0.6444721225898444, 0.64738955025149, 0.6502724475074708, 0.6531255587504116, 0.6559526803834299, 0.6587565739058224, 0.6615389227709871, 0.664300330229326 ], [ 0.5644793393645607, 0.5616491694584307, 0.5591552015667896, 0.5570086011436692, 0.5552184103718246, 0.553791542337144, 0.5527327416760385, 0.55204450598948, 0.5517269700229029, 0.5517777624435913, 0.5521918519351288, 0.5529614043143203, 0.5540756747624107, 0.555520958717897, 0.5572806215803979, 0.5593352215872058, 0.5616627328076805, 0.5642388670856269, 0.5670374858954057, 0.5700310862948902, 0.573191340067773, 0.5764896620831396, 0.5798977829179889, 0.5833883017060647, 0.5869351976418692, 0.5905142821386153, 0.5941035778522107, 0.5976836152199351, 0.6012376414802629, 0.6047517410920128, 0.6082148699042883, 0.6116188082726519, 0.6149580405644227, 0.6182295701813645, 0.6214326804090151, 0.6245686521431236, 0.6276404499061944, 0.6306523876017127, 0.6336097851991674, 0.6365186270272192, 0.6393852315959735, 0.6422159418902064, 0.6450168438939603, 0.6477935197499509, 0.650550840460757, 0.6532928014490783, 0.6560224026666902, 0.6587415733377716, 0.6614511399057493, 0.664150834384673 ], [ 0.5737845322920758, 0.5711164728859426, 0.5687596733798027, 0.5667240361206218, 0.5650174364899321, 0.5636457192383609, 0.5626126708060627, 0.5619199629359032, 0.561567069088873, 0.5615511614622333, 0.5618670019426862, 0.5625068443438518, 0.5634603672293468, 0.564714656243936, 0.5662542522176565, 0.5680612767227232, 0.5701156408355759, 0.5723953363083454, 0.5748768019305178, 0.5775353522275718, 0.5803456513017653, 0.5832822118671025, 0.5863198984474554, 0.5894344141860846, 0.5926027525075982, 0.5958035976473712, 0.5990176614600405, 0.6022279475989117, 0.605419937835918, 0.6085816987496648, 0.6117039101022624, 0.6147798188743355, 0.6178051251044536, 0.6207778073933431, 0.623697897215302, 0.6265672120685982, 0.6293890580319855, 0.632167912508617, 0.6349090978562145, 0.637618456241369, 0.64030203543027, 0.6429657943527082, 0.6456153361703326, 0.6482556752720282, 0.6508910431479158, 0.6535247365091933, 0.6561590093840783, 0.6587950092971181, 0.6614327560989495, 0.6640711606215175 ], [ 0.5827135646257762, 0.5801955876056271, 0.5779650708253938, 0.5760307779479422, 0.5743995468362256, 0.5730762880420964, 0.5720639670126344, 0.5713635661397732, 0.5709740277556014, 0.5708921842156726, 0.5711126856452882, 0.5716279391526887, 0.5724280749029456, 0.5735009541833098, 0.57483223250769, 0.576405487170793, 0.5782024139211539, 0.5802030921371655, 0.5823863126471013, 0.5847299576643109, 0.5872114186254059, 0.5898080352804231, 0.5924975382823086, 0.5952584777020828, 0.5980706211826792, 0.6009153075923342, 0.6037757447705413, 0.6066372430058525, 0.6094873790086097, 0.6123160881558047, 0.6151156855567208, 0.6178808189346601, 0.6206083584020244, 0.6232972299139147, 0.6259482005288853, 0.628563624603046, 0.631147160714881, 0.6337034694794861, 0.6362379024740311, 0.6387561922691725, 0.6412641530513091, 0.6437674005386407, 0.6462710988579822, 0.6487797407879567, 0.6512969663286914, 0.6538254229822941, 0.6563666694865703, 0.6589211231079302, 0.6614880490413965, 0.6640655890554888 ], [ 0.5912645670421139, 0.5888855396328622, 0.586771323755659, 0.584929656425228, 0.5833664531095377, 0.5820858083705465, 0.5810899864515867, 0.5803793985994902, 0.5799525678885018, 0.579806086338969, 0.5799345726663336, 0.5803306415839782, 0.5809848968718889, 0.5818859602390779, 0.5830205463704308, 0.5843735916590124, 0.5859284403286606, 0.5876670873844027, 0.5895704735505091, 0.5916188234919815, 0.5937920155037895, 0.5960699687148893, 0.5984330327864762, 0.6008623650632071, 0.6033402810452301, 0.6058505657068026, 0.6083787353823661, 0.6109122424597416, 0.6134406177695394, 0.6159555481812001, 0.6184508893903956, 0.6209226161297301, 0.6233687140078223, 0.625789018858601, 0.6281850108566127, 0.6305595717269374, 0.6329167141534198, 0.6352612929685797, 0.6375987078924997, 0.6399346074750092, 0.6422746034863335, 0.6446240043025663, 0.6469875748599443, 0.6493693295346423, 0.6517723628854808, 0.6541987216320614, 0.656649319598413, 0.6591238957074088, 0.6616210135410768, 0.6641380995593711 ], [ 0.599438114168847, 0.597187752098957, 0.5951807044740931, 0.593423782887841, 0.5919220832043198, 0.5906789883374522, 0.5896961659450971, 0.5889735583622961, 0.5885093652668504, 0.5883000227757634, 0.5883401854935104, 0.5886227201001637, 0.5891387201051773, 0.5898775512611162, 0.5908269358401934, 0.5919730816764474, 0.5933008588335162, 0.5947940233107748, 0.5964354837111419, 0.5982076036011461, 0.6000925296743093, 0.6020725339718881, 0.6041303574128584, 0.6062495417371766, 0.6084147375962902, 0.6106119778014384, 0.6128289065035569, 0.6150549571613547, 0.6172814744008739, 0.6195017771476459, 0.6217111626173908, 0.623906852807711, 0.6260878869912688, 0.6282549653395488, 0.6304102501871603, 0.6325571325678958, 0.6346999725057443, 0.6368438221165873, 0.6389941408587235, 0.6411565122529246, 0.6433363710698434, 0.6455387493566579, 0.6477680487596572, 0.6500278454234231, 0.6523207323540597, 0.6546482025824159, 0.6570105748241962, 0.6594069616858727, 0.6618352788886464, 0.6642922925533067 ], [ 0.6072369481552061, 0.6051057697664974, 0.6031975541181875, 0.6015182791188216, 0.6000723130324503, 0.5988624193642513, 0.5978897605765593, 0.5971538983939488, 0.5966527909688647, 0.596382789721656, 0.5963386409092682, 0.596513498620913, 0.5968989567288977, 0.5974851072248327, 0.5982606313483174, 0.5992129280803997, 0.6003282821319185, 0.6015920707700729, 0.6029890059803154, 0.6045034058250934, 0.6061194866617706, 0.6078216662794419, 0.6095948670944961, 0.6114248083214071, 0.6132982764607159, 0.6152033644274795, 0.6171296710609278, 0.6190684544804544, 0.6210127346602609, 0.6229573425752631, 0.6248989152347236, 0.626835837798266, 0.6287681357110516, 0.6306973213644745, 0.6326262011587481, 0.6345586499920962, 0.6364993611072577, 0.6384535798694326, 0.6404268304106412, 0.6424246441365644, 0.6444522988418794, 0.646514576617187, 0.648615547866521, 0.6507583876166382, 0.6529452289322529, 0.6551770567154671, 0.6574536435360265, 0.6597735274929063, 0.6621340305300824, 0.6645313141985206 ], [ 0.614665715817108, 0.6126449972144596, 0.6108280227248094, 0.6092200199204962, 0.6078247119915756, 0.6066443246838072, 0.605679595108315, 0.6049297805338213, 0.6043926672550293, 0.6040645816383327, 0.6039404072167358, 0.604013613006845, 0.6042762988786455, 0.6047192637311699, 0.6053321014121701, 0.6061033278524504, 0.6070205409222713, 0.6080706122624397, 0.6092399080204998, 0.6105145332483068, 0.6118805928749316, 0.6133244607931931, 0.6148330477677423, 0.6163940586096812, 0.6179962293402437, 0.6196295358198082, 0.6212853664602143, 0.6229566530694828, 0.6246379555005198, 0.626325497500051, 0.6280171529045347, 0.6297123830441761, 0.6314121278450935, 0.6331186546239034, 0.6348353699152149, 0.6365666008308272, 0.6383173533905917, 0.6400930559601263, 0.6418992963522338, 0.6437415612731808, 0.6456249866053941, 0.6475541265091775, 0.6495327485072395, 0.6515636606136624, 0.6536485752281609, 0.6557880129985526, 0.6579812482341717, 0.6602262958137395, 0.6625199379580456, 0.6648577878108336 ], [ 0.621730719902121, 0.6198124511742087, 0.6180798234076988, 0.616537389727759, 0.6151883024117277, 0.6140343218035961, 0.6130758294191468, 0.6123118436386291, 0.6117400379390514, 0.6113567631953044, 0.6111570769715076, 0.6111347837471959, 0.6112824905389354, 0.6115916823117203, 0.6120528209210538, 0.6126554701493822, 0.6133884478193218, 0.6142400041397567, 0.6151980235452904, 0.6162502454967491, 0.6173844981694999, 0.6185889377806699, 0.6198522855661458, 0.6211640541402832, 0.6225147551433335, 0.6238960806607172, 0.6253010518209081, 0.6267241291705936, 0.6281612808107796, 0.6296100057836238, 0.6310693117630958, 0.632539647668063, 0.6340227933372954, 0.6355217098415616, 0.6370403553211328, 0.6385834723918582, 0.6401563541236218, 0.6417645963258377, 0.643413844341671, 0.645109542726592, 0.6468566960465554, 0.6486596485679644, 0.6505218898328111, 0.6524458920436397, 0.6544329838688159, 0.6564832637811496, 0.6585955544382665, 0.6607673979858966, 0.6629950906019697, 0.6652737531815034 ], [ 0.6284396849594528, 0.6266165274708184, 0.6249620010784024, 0.6234800536723976, 0.6221733333624596, 0.6210431992725873, 0.6200897382523115, 0.6193117861334592, 0.618706953373215, 0.6182716561554321, 0.6180011551099289, 0.6178896046082157, 0.6179301159935767, 0.618114838042571, 0.6184350574271757, 0.6188813209989695, 0.6194435804404592, 0.6201113583472141, 0.6208739332560836, 0.6217205396564032, 0.6226405777338716, 0.623623826595354, 0.6246606540695389, 0.6257422159017809, 0.6268606372596488, 0.6280091699115268, 0.6291823191897387, 0.6303759358470452, 0.6315872691028548, 0.6328149784956897, 0.6340591035583844, 0.6353209917638711, 0.6366031866086829, 0.6379092790675142, 0.6392437269257538, 0.6406116476377299, 0.6420185913256613, 0.643470301286999, 0.6449724698769022, 0.6465304978440939, 0.6481492650975438, 0.649832920456757, 0.6515846971952888, 0.6534067601499607, 0.6553000888814045, 0.6572643998973329, 0.6592981093650425, 0.6613983361294962, 0.6635609433052896, 0.6657806153070234 ], [ 0.6348015381993007, 0.6330667829439701, 0.6314847160799868, 0.6300587434624819, 0.6287910691733504, 0.6276827080828575, 0.6267335055687379, 0.6259421632110733, 0.6253062702170148, 0.6248223412833696, 0.62448586244854, 0.6242913471030137, 0.6242324046318076, 0.6243018241030639, 0.6244916749870386, 0.624793426123381, 0.6251980831218825, 0.6256963431782379, 0.6262787650202848, 0.6269359504808738, 0.6276587331189483, 0.6284383684598042, 0.6292667198532679, 0.630136433683836, 0.6310410977143661, 0.6319753766896807, 0.6329351199383465, 0.6339174365505934, 0.6349207347338955, 0.6359447231102389, 0.6369903729769523, 0.6380598418642807, 0.6391563600472856, 0.6402840829671628, 0.6414479137464473, 0.6426533011012424, 0.6439060189168428, 0.6452119345160543, 0.6465767731690849, 0.6480058866325873, 0.6495040334355043, 0.6510751782368915, 0.6527223168695342, 0.6544473326763773, 0.6562508884882655, 0.6581323571434158, 0.6600897918882005, 0.6621199364108298, 0.6642182727319847, 0.6663791037916736 ], [ 0.6408262055992321, 0.6391737326085191, 0.6376590429997497, 0.6362850583481552, 0.6350535929388115, 0.6339653679668551, 0.6330200337433799, 0.6322161988792078, 0.6315514661341005, 0.6310224753511863, 0.6306249545442771, 0.6303537806779407, 0.6302030519068631, 0.6301661729814062, 0.6302359551726899, 0.6304047314481046, 0.6306644867900957, 0.6310070025712142, 0.6314240128620009, 0.6319073695419553, 0.6324492121872746, 0.6330421379879547, 0.6336793664489319, 0.6343548933832939, 0.6350636287197967, 0.6358015129152994, 0.636565607266614, 0.6373541541281736, 0.6381666039296925, 0.6390036069169316, 0.6398669686731893, 0.6407595696831802, 0.6416852504374791, 0.64264866480589, 0.6436551055904238, 0.6447103072585609, 0.6458202318080641, 0.6469908444780043, 0.6482278865509127, 0.6495366527479218, 0.6509217806722948, 0.6523870593910791, 0.653935263561993, 0.6555680185354282, 0.6572857006326254, 0.6590873753822493, 0.6609707749651746, 0.6629323145565064, 0.6649671457519815, 0.667069243904841 ], [ 0.646524423375842, 0.6449486621822065, 0.6434967848006243, 0.6421712813247569, 0.6409736251646491, 0.639904288746193, 0.6389627677480169, 0.6381476129734963, 0.6374564694952074, 0.636886123264686, 0.6364325558720219, 0.6360910084954879, 0.6358560562453449, 0.6357216940448376, 0.6356814348977601, 0.6357284208838165, 0.6358555465407079, 0.6360555934924594, 0.636321374333804, 0.6366458829492585, 0.6370224476975574, 0.6374448832818302, 0.6379076366949183, 0.6384059224041021, 0.6389358419327279, 0.6394944832074604, 0.6400799954587298, 0.6406916360704854, 0.6413297865506823, 0.6419959357097098, 0.6426926291614639, 0.6434233853700476, 0.6441925796202758, 0.6450052984550786, 0.6458671682561785, 0.6467841627007737, 0.6477623947577945, 0.6488078996429848, 0.6499264156846576, 0.6511231703195401, 0.6524026784087931, 0.6537685597210054, 0.65522338177261, 0.6567685332682524, 0.6584041321861214, 0.6601289711669173, 0.6619405013654895, 0.6638348543955551, 0.6658069005266571, 0.6678503399596731 ], [ 0.651907564797633, 0.650403455968726, 0.6490103022743895, 0.6477302105907667, 0.6465643575845765, 0.6455130067643257, 0.644575534348058, 0.643750463147809, 0.643035504070994, 0.6424276052541097, 0.6419230092115321, 0.6415173186448894, 0.6412055716719811, 0.6409823271713777, 0.6408417606923807, 0.6407777709629046, 0.6407840964703366, 0.6408544409366722, 0.6409826058113699, 0.6411626272182055, 0.6413889141682707, 0.6416563843354972, 0.6419605933196754, 0.6422978531198162, 0.6426653355218898, 0.643061156273723, 0.6434844362719565, 0.6439353365108583, 0.6444150642249016, 0.644925848476811, 0.6454708843772832, 0.6460542461452314, 0.6466807702973838, 0.6473559113579218, 0.6480855735619264, 0.648875923045206, 0.6497331859183975, 0.6506634383643831, 0.6516723954260154, 0.6527652054228494, 0.653946256918163, 0.6552190048328979, 0.6565858216713528, 0.6580478789048861, 0.6596050623955537, 0.6612559243910411, 0.6629976731596758, 0.6648261998426113, 0.666736140664388, 0.6687209713426845 ], [ 0.6569874821772067, 0.6555504399470482, 0.6542123586830122, 0.6529750061422731, 0.6518393020411845, 0.6508053363054542, 0.6498723962163336, 0.6490390017367667, 0.6483029485911853, 0.6476613589766693, 0.6471107400521321, 0.646647050541073, 0.6462657758567285, 0.6459620120940267, 0.64573055902382, 0.6455660218803848, 0.6454629212759492, 0.6454158100398901, 0.6454193952060499, 0.6454686628028454, 0.64555900257989, 0.6456863293694437, 0.6458471974622894, 0.6460389041985823, 0.6462595789498217, 0.6465082538055117, 0.6467849125779312, 0.6470905151955753, 0.647426995160551, 0.647797228483371, 0.6482049733619865, 0.6486547808177376, 0.6491518775111725, 0.6497020230017327, 0.6503113447475187, 0.6509861551196157, 0.6517327555805682, 0.6525572338975685, 0.6534652607784237, 0.6544618925888218, 0.6555513867995422, 0.6567370365033626, 0.658021029732829, 0.6594043384212891, 0.6608866407204003, 0.6624662790757978, 0.6641402550412119, 0.6659042603610891, 0.667752742455711, 0.6696790011787563 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0065748 (SEM: 0)
x1: 0.850006
x2: 0.76179
x3: 0.315696
x4: 0.0667344
x5: 0.735019
x6: 0.515815", "Arm 1_0
hartmann6: -0.620567 (SEM: 0)
x1: 0.0435526
x2: 0.271424
x3: 0.384739
x4: 0.324967
x5: 0.513624
x6: 0.312266", "Arm 2_0
hartmann6: -0.00162505 (SEM: 0)
x1: 0.19224
x2: 0.632054
x3: 0.100307
x4: 0.919172
x5: 0.736001
x6: 0.768069", "Arm 3_0
hartmann6: -0.659552 (SEM: 0)
x1: 0.525476
x2: 0.863703
x3: 0.686721
x4: 0.9207
x5: 0.651213
x6: 0.121777", "Arm 4_0
hartmann6: -1.396 (SEM: 0)
x1: 0.224889
x2: 0.158277
x3: 0.404255
x4: 0.52086
x5: 0.294674
x6: 0.464602", "Arm 5_0
hartmann6: -0.00980417 (SEM: 0)
x1: 0.247425
x2: 0.188518
x3: 0.217416
x4: 0.81642
x5: 0.920121
x6: 0.775914", "Arm 6_0
hartmann6: -0.309888 (SEM: 0)
x1: 0.179999
x2: 0.167114
x3: 0.995151
x4: 0.674075
x5: 0.20554
x6: 0.59145", "Arm 7_0
hartmann6: -0.0384203 (SEM: 0)
x1: 0.868609
x2: 0.926798
x3: 0.365419
x4: 0.793795
x5: 0.306812
x6: 0.180303", "Arm 8_0
hartmann6: -0.787522 (SEM: 0)
x1: 0.128604
x2: 0.61249
x3: 0.93022
x4: 0.186771
x5: 0.111331
x6: 0.850688", "Arm 9_0
hartmann6: -0.000983201 (SEM: 0)
x1: 0.782812
x2: 0.22904
x3: 0.296612
x4: 0.713423
x5: 0.943379
x6: 0.655494", "Arm 10_0
hartmann6: -0.397421 (SEM: 0)
x1: 0.512458
x2: 0.432795
x3: 0.57399
x4: 0.711118
x5: 0.144828
x6: 0.135688", "Arm 11_0
hartmann6: -0.0620562 (SEM: 0)
x1: 0.531558
x2: 0.98588
x3: 0.958956
x4: 0.366984
x5: 0.101068
x6: 0.807794", "Arm 12_0
hartmann6: -1.76437 (SEM: 0)
x1: 0.197965
x2: 0.145229
x3: 0.402411
x4: 0.46014
x5: 0.217291
x6: 0.509765", "Arm 13_0
hartmann6: -1.81035 (SEM: 0)
x1: 0.171488
x2: 0.136352
x3: 0.393499
x4: 0.403711
x5: 0.160123
x6: 0.55306", "Arm 14_0
hartmann6: -1.19243 (SEM: 0)
x1: 0.184576
x2: 0.0843012
x3: 0.416101
x4: 0.444417
x5: 0.132553
x6: 0.479758", "Arm 15_0
hartmann6: -1.97414 (SEM: 0)
x1: 0.177896
x2: 0.166541
x3: 0.390051
x4: 0.402515
x5: 0.174901
x6: 0.564798", "Arm 16_0
hartmann6: -2.46064 (SEM: 0)
x1: 0.168495
x2: 0.186258
x3: 0.376545
x4: 0.397065
x5: 0.22146
x6: 0.616453", "Arm 17_0
hartmann6: -2.7499 (SEM: 0)
x1: 0.14928
x2: 0.18773
x3: 0.363237
x4: 0.383717
x5: 0.25928
x6: 0.671505", "Arm 18_0
hartmann6: -2.61836 (SEM: 0)
x1: 0.149205
x2: 0.192005
x3: 0.358198
x4: 0.379943
x5: 0.26876
x6: 0.752812", "Arm 19_0
hartmann6: -2.92292 (SEM: 0)
x1: 0.104355
x2: 0.201331
x3: 0.343253
x4: 0.341127
x5: 0.297936
x6: 0.672868", "Arm 20_0
hartmann6: -2.55232 (SEM: 0)
x1: 0.0413486
x2: 0.229878
x3: 0.285343
x4: 0.360005
x5: 0.287942
x6: 0.669468", "Arm 21_0
hartmann6: -3.13787 (SEM: 0)
x1: 0.12806
x2: 0.194817
x3: 0.376268
x4: 0.282182
x5: 0.314409
x6: 0.669244", "Arm 22_0
hartmann6: -3.12837 (SEM: 0)
x1: 0.179306
x2: 0.136724
x3: 0.379285
x4: 0.225713
x5: 0.327444
x6: 0.674723", "Arm 23_0
hartmann6: -3.16419 (SEM: 0)
x1: 0.1188
x2: 0.161427
x3: 0.435081
x4: 0.243633
x5: 0.325744
x6: 0.677939" ], "type": "scatter", "x": [ 0.8500059843063354, 0.04355258867144585, 0.19224035553634167, 0.525476130656898, 0.2248887661844492, 0.24742478970438242, 0.17999933287501335, 0.8686089878901839, 0.12860394082963467, 0.7828124966472387, 0.5124581437557936, 0.5315583599731326, 0.1979645843635403, 0.17148814233997936, 0.1845760464708392, 0.17789571565036708, 0.16849479454503996, 0.1492800435027863, 0.14920486220555912, 0.10435477628719056, 0.041348560966521945, 0.12805965082741697, 0.17930557714398054, 0.11879979599197747 ], "xaxis": "x", "y": [ 0.7617895603179932, 0.2714243056252599, 0.632053722627461, 0.8637028364464641, 0.1582772321999073, 0.18851820845156908, 0.1671135611832142, 0.9267976386472583, 0.6124901017174125, 0.22904012445360422, 0.43279509898275137, 0.9858796512708068, 0.1452290194340706, 0.1363517190045183, 0.08430116762382639, 0.16654135632099584, 0.18625765922415782, 0.18773013182981066, 0.19200478471287452, 0.20133127981777924, 0.2298782573249003, 0.19481654630430054, 0.1367237125073871, 0.16142730373374714 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0065748 (SEM: 0)
x1: 0.850006
x2: 0.76179
x3: 0.315696
x4: 0.0667344
x5: 0.735019
x6: 0.515815", "Arm 1_0
hartmann6: -0.620567 (SEM: 0)
x1: 0.0435526
x2: 0.271424
x3: 0.384739
x4: 0.324967
x5: 0.513624
x6: 0.312266", "Arm 2_0
hartmann6: -0.00162505 (SEM: 0)
x1: 0.19224
x2: 0.632054
x3: 0.100307
x4: 0.919172
x5: 0.736001
x6: 0.768069", "Arm 3_0
hartmann6: -0.659552 (SEM: 0)
x1: 0.525476
x2: 0.863703
x3: 0.686721
x4: 0.9207
x5: 0.651213
x6: 0.121777", "Arm 4_0
hartmann6: -1.396 (SEM: 0)
x1: 0.224889
x2: 0.158277
x3: 0.404255
x4: 0.52086
x5: 0.294674
x6: 0.464602", "Arm 5_0
hartmann6: -0.00980417 (SEM: 0)
x1: 0.247425
x2: 0.188518
x3: 0.217416
x4: 0.81642
x5: 0.920121
x6: 0.775914", "Arm 6_0
hartmann6: -0.309888 (SEM: 0)
x1: 0.179999
x2: 0.167114
x3: 0.995151
x4: 0.674075
x5: 0.20554
x6: 0.59145", "Arm 7_0
hartmann6: -0.0384203 (SEM: 0)
x1: 0.868609
x2: 0.926798
x3: 0.365419
x4: 0.793795
x5: 0.306812
x6: 0.180303", "Arm 8_0
hartmann6: -0.787522 (SEM: 0)
x1: 0.128604
x2: 0.61249
x3: 0.93022
x4: 0.186771
x5: 0.111331
x6: 0.850688", "Arm 9_0
hartmann6: -0.000983201 (SEM: 0)
x1: 0.782812
x2: 0.22904
x3: 0.296612
x4: 0.713423
x5: 0.943379
x6: 0.655494", "Arm 10_0
hartmann6: -0.397421 (SEM: 0)
x1: 0.512458
x2: 0.432795
x3: 0.57399
x4: 0.711118
x5: 0.144828
x6: 0.135688", "Arm 11_0
hartmann6: -0.0620562 (SEM: 0)
x1: 0.531558
x2: 0.98588
x3: 0.958956
x4: 0.366984
x5: 0.101068
x6: 0.807794", "Arm 12_0
hartmann6: -1.76437 (SEM: 0)
x1: 0.197965
x2: 0.145229
x3: 0.402411
x4: 0.46014
x5: 0.217291
x6: 0.509765", "Arm 13_0
hartmann6: -1.81035 (SEM: 0)
x1: 0.171488
x2: 0.136352
x3: 0.393499
x4: 0.403711
x5: 0.160123
x6: 0.55306", "Arm 14_0
hartmann6: -1.19243 (SEM: 0)
x1: 0.184576
x2: 0.0843012
x3: 0.416101
x4: 0.444417
x5: 0.132553
x6: 0.479758", "Arm 15_0
hartmann6: -1.97414 (SEM: 0)
x1: 0.177896
x2: 0.166541
x3: 0.390051
x4: 0.402515
x5: 0.174901
x6: 0.564798", "Arm 16_0
hartmann6: -2.46064 (SEM: 0)
x1: 0.168495
x2: 0.186258
x3: 0.376545
x4: 0.397065
x5: 0.22146
x6: 0.616453", "Arm 17_0
hartmann6: -2.7499 (SEM: 0)
x1: 0.14928
x2: 0.18773
x3: 0.363237
x4: 0.383717
x5: 0.25928
x6: 0.671505", "Arm 18_0
hartmann6: -2.61836 (SEM: 0)
x1: 0.149205
x2: 0.192005
x3: 0.358198
x4: 0.379943
x5: 0.26876
x6: 0.752812", "Arm 19_0
hartmann6: -2.92292 (SEM: 0)
x1: 0.104355
x2: 0.201331
x3: 0.343253
x4: 0.341127
x5: 0.297936
x6: 0.672868", "Arm 20_0
hartmann6: -2.55232 (SEM: 0)
x1: 0.0413486
x2: 0.229878
x3: 0.285343
x4: 0.360005
x5: 0.287942
x6: 0.669468", "Arm 21_0
hartmann6: -3.13787 (SEM: 0)
x1: 0.12806
x2: 0.194817
x3: 0.376268
x4: 0.282182
x5: 0.314409
x6: 0.669244", "Arm 22_0
hartmann6: -3.12837 (SEM: 0)
x1: 0.179306
x2: 0.136724
x3: 0.379285
x4: 0.225713
x5: 0.327444
x6: 0.674723", "Arm 23_0
hartmann6: -3.16419 (SEM: 0)
x1: 0.1188
x2: 0.161427
x3: 0.435081
x4: 0.243633
x5: 0.325744
x6: 0.677939" ], "type": "scatter", "x": [ 0.8500059843063354, 0.04355258867144585, 0.19224035553634167, 0.525476130656898, 0.2248887661844492, 0.24742478970438242, 0.17999933287501335, 0.8686089878901839, 0.12860394082963467, 0.7828124966472387, 0.5124581437557936, 0.5315583599731326, 0.1979645843635403, 0.17148814233997936, 0.1845760464708392, 0.17789571565036708, 0.16849479454503996, 0.1492800435027863, 0.14920486220555912, 0.10435477628719056, 0.041348560966521945, 0.12805965082741697, 0.17930557714398054, 0.11879979599197747 ], "xaxis": "x2", "y": [ 0.7617895603179932, 0.2714243056252599, 0.632053722627461, 0.8637028364464641, 0.1582772321999073, 0.18851820845156908, 0.1671135611832142, 0.9267976386472583, 0.6124901017174125, 0.22904012445360422, 0.43279509898275137, 0.9858796512708068, 0.1452290194340706, 0.1363517190045183, 0.08430116762382639, 0.16654135632099584, 0.18625765922415782, 0.18773013182981066, 0.19200478471287452, 0.20133127981777924, 0.2298782573249003, 0.19481654630430054, 0.1367237125073871, 0.16142730373374714 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:40] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9451237351289872, 0.9384476021954815, 0.9322790390656581, 0.9266566130214209, 0.9216181116887956, 0.9172001746637417, 0.9134379044111401, 0.9103644601366663, 0.9080106389807465, 0.906404449550423, 0.9055706835737272, 0.9055304924634077, 0.9063009769677366, 0.9078947999845761, 0.9103198350136873, 0.9135788653791539, 0.9176693517166843, 0.9225832864460403, 0.9283071530684859, 0.9348220043680164, 0.9421036667446046, 0.9501230685958673, 0.9588466803424445, 0.9682370442880488, 0.9782533658342211, 0.988852134774932, 0.9999877466426192, 1.0116130986170462, 1.0236801410365928, 1.0361403726566367, 1.0489452743308265, 1.0620466810355744, 1.075397095848862, 1.0889499517001002, 1.1026598276917676, 1.116482626890577, 1.130375722015431, 1.1442980746743407, 1.1582103329137454, 1.1720749109657733, 1.1858560542820842, 1.1995198922579688, 1.2130344804818467, 1.2263698338826496, 1.239497951773282, 1.2523928354838114, 1.2650304990273002, 1.2773889730335528, 1.2894483020157943, 1.3011905349019517 ], [ 0.9429621277083777, 0.9362203285057266, 0.9299913599743292, 0.9243145941971467, 0.919228630788868, 0.9147709180621842, 0.9109773527579061, 0.907881862294062, 0.9055159741078458, 0.9039083772384645, 0.903084481916216, 0.9030659837439127, 0.9038704402969406, 0.9055108698397001, 0.9079953844501727, 0.9113268729851343, 0.9155027524279675, 0.9205148082372345, 0.9263491441062729, 0.9329862579465388, 0.9404012534814797, 0.9485641862154142, 0.9574405304712119, 0.9669917430922154, 0.9771758915942793, 0.9879483114718972, 0.9992622591680166, 1.0110695328977986, 1.0233210413872096, 1.0359673088959167, 1.048958912280842, 1.0622468515523618, 1.0757828591638474, 1.0895196553325435, 1.103411157391426, 1.11741265094291, 1.13148092980635, 1.1455744107165606, 1.1596532276427576, 1.1736793095786844, 1.1876164447676631, 1.2014303335900869, 1.2150886317501317, 1.2285609849329304, 1.241819055738089, 1.25483654340632, 1.2675891966236583, 1.2800548194985748, 1.2922132706557754, 1.3040464552748718 ], [ 0.9412839700541462, 0.934486553033153, 0.928206860508455, 0.9224850233929449, 0.9173604051120968, 0.9128712120716, 0.9090540820672698, 0.9059436549454152, 0.9035721304272224, 0.9019688184918977, 0.901159688148812, 0.9011669209993665, 0.9020084769741668, 0.90369768135095, 0.90624284484287, 0.9096469321311504, 0.9139072981392593, 0.919015514453413, 0.9249573090041194, 0.931712638906838, 0.9392559084435932, 0.9475563321368261, 0.9565784288018677, 0.9662826193938071, 0.9766258923308849, 0.9875624965890641, 0.9990446253621196, 1.0110230601149508, 1.0234477542675608, 1.0362683453797896, 1.0494345929784077, 1.06289674527053, 1.0766058417917939, 1.090513960857268, 1.1045744210265576, 1.1187419451868226, 1.132972794738628, 1.1472248800629348, 1.1614578521601626, 1.1756331792009458, 1.1897142107614358, 1.2036662317411502, 1.2174565073593677, 1.231054320167416, 1.2444309996661027, 1.257559944850555, 1.27041663979568, 1.2829786622298225, 1.2952256849143737, 1.307139469552901 ], [ 0.9401054319921444, 0.9332630635018753, 0.9269429361437155, 0.9211858898597716, 0.9160319995245747, 0.9115201743709546, 0.9076877347925144, 0.9045699712915638, 0.9021996909647318, 0.9006067573211507, 0.8998176294646996, 0.899854906928625, 0.9007368870651731, 0.9024771433077237, 0.9050841352432729, 0.90856086536768, 0.9129046021586582, 0.9181066934128636, 0.9241524956998588, 0.9310214432285935, 0.9386872711643417, 0.9471183949359312, 0.9562784307731305, 0.9661268273758535, 0.9766195679585867, 0.9877098982009713, 0.9993490389757621, 1.01148685133186, 1.02407243235268, 1.0370546315693512, 1.050382486768115, 1.064005584473039, 1.0778743541070863, 1.0919403063209747, 1.1061562258900413, 1.1204763285451804, 1.1348563896224453, 1.1492538508320063, 1.1636279099673446, 1.1779395971033928, 1.1921518398007565, 1.206229519033116, 1.220139516953985, 1.2338507571772221, 1.2473342379227899, 1.2605630581400462, 1.2735124365406574, 1.2861597233340638, 1.2984844043543577, 1.310468097197176 ], [ 0.9394412308681223, 0.9325651460925863, 0.9262154310633252, 0.9204335813692734, 0.915260327148665, 0.910735221040689, 0.9068962029593141, 0.9037791470305471, 0.9014173967204644, 0.8998412945389418, 0.8990777127442279, 0.899149591367575, 0.9000754900044976, 0.9018691607516786, 0.9045391520209124, 0.908088457085892, 0.9125142267840248, 0.9178075714521017, 0.923953480574539, 0.9309308870660986, 0.9387128947382659, 0.9472671725337786, 0.9565565003641254, 0.9665394334828373, 0.9771710399352708, 0.9884036615672717, 1.000187653403557, 1.0124720666021438, 1.025205253241461, 1.038335383757029, 1.0518108778663975, 1.065580756512054, 1.079594925882207, 1.093804405625595, 1.108161512787012, 1.1226200114913927, 1.1371352365474288, 1.1516641972844313, 1.1661656662769044, 1.1806002562355806, 1.194930487264403, 1.209120845872831, 1.2231378365457126, 1.2369500262575677, 1.2505280820273588, 1.2638448014043877, 1.276875135627632, 1.289596205092244, 1.3019873066809953, 1.3140299124752217 ], [ 0.939304466523819, 0.9324064095970857, 0.9260384507556211, 0.920242684469588, 0.9150604364627314, 0.910531839697676, 0.9066953865873202, 0.9035874634522335, 0.9012418740513404, 0.8996893593793462, 0.8989571207964491, 0.899068353061304, 0.9000417933746371, 0.9018912927989691, 0.9046254182549174, 0.9082470973728154, 0.912753324730166, 0.9181349550901811, 0.9243766144416692, 0.9314567594767849, 0.9393479079708038, 0.9480170461827161, 0.9574261980387446, 0.9675331201215304, 0.9782920721578651, 0.9896546082668923, 1.0015703396828421, 1.0139876320412802, 1.0268542154141473, 1.040117699374807, 1.053725996198653, 1.0676276621360794, 1.0817721699184024, 1.0961101261928132, 1.110593446435931, 1.1251754979071935, 1.139811218969878, 1.1544572209897916, 1.1690718772032873, 1.1836154014876585, 1.1980499188597395, 1.2123395287241154, 1.2264503613311581, 1.240350627525107, 1.2540106616097282, 1.2674029569913943, 1.2805021941463768, 1.2932852603831504, 1.3057312608253961, 1.3178215200274985 ], [ 0.9397064638873592, 0.9327986175985404, 0.9264241830319582, 0.9206257935093534, 0.915445307429323, 0.910923371780231, 0.9070989611851467, 0.9040088992691373, 0.9016873701363817, 0.9001654281933722, 0.8994705143153061, 0.8996259854773062, 0.9006506638385506, 0.9025584106632888, 0.9053577314953838, 0.90905142272447, 0.9136362763989845, 0.9191028686474978, 0.9254354642906988, 0.9326120718801277, 0.9406046758322619, 0.9493796547988002, 0.9588983713857085, 0.969117894543174, 0.9799917994979874, 0.9914709852637124, 1.0035044564418691, 1.016040030522161, 1.029024949112724, 1.0424063871468052, 1.0561318656467842, 1.0701495804755745, 1.084408662311043, 1.0988593830164521, 1.1134533218354041, 1.1281435023531783, 1.142884508567687, 1.1576325860576149, 1.1723457322832163, 1.186983778539032, 1.2015084649624024, 1.215883509219565, 1.2300746689669146, 1.2440497978477378, 1.2577788945750923, 1.2712341445240534, 1.284389953180418, 1.297222970751547, 1.3097121072318818, 1.3218385372341046 ], [ 0.9406566262817424, 0.9337515321831642, 0.9273827314398778, 0.9215933329498345, 0.9164256617989244, 0.9119208098405613, 0.9081181609638511, 0.9050548986781873, 0.9027655049040525, 0.901281259480949, 0.9006297496395016, 0.9008343974750843, 0.9019140116190713, 0.9038823676721217, 0.9067478218967363, 0.9105129656540125, 0.9151743349238549, 0.9207221990472056, 0.9271404622537205, 0.9344067154287197, 0.9424924690932059, 0.951363580189183, 0.9609808586352243, 0.9713008126631202, 0.9822764732412899, 0.9938582326070051, 1.0059946398819382, 1.018633113420671, 1.0317205488930965, 1.045203819160771, 1.0590301741284052, 1.0731475554902536, 1.0875048435796733, 1.1020520528102604, 1.1167404898350672, 1.1315228855740445, 1.146353509320141, 1.1611882705729766, 1.1759848121938727, 1.190702596929066, 1.205302988245985, 1.2197493256825256, 1.2340069944319736, 1.2480434885975555, 1.2618284673865152, 1.2753338034275346, 1.2885336223566786, 1.3014043328103195, 1.3139246459839224, 1.326075583967891 ], [ 0.9421623025129433, 0.9352727726525589, 0.9289219650257027, 0.9231533974958848, 0.9180097928015432, 0.9135326158549439, 0.909761584698267, 0.9067341636178272, 0.904485048517813, 0.9030456555485306, 0.9024436238060767, 0.9027023414653005, 0.9038405021718093, 0.9058716957414685, 0.9088040357647569, 0.9126398285508454, 0.917375294405048, 0.9230003630554564, 0.9294985767123779, 0.9368471407331163, 0.9450171570024698, 0.9539740563697181, 0.9636782175050724, 0.9740857294600263, 0.9851492342039094, 0.9968187796305185, 1.0090426227292384, 1.0217679414243452, 1.0349414349674966, 1.048509811129156, 1.062420170990756, 1.0766203086421826, 1.0910589447803463, 1.1056859117948752, 1.1204523049513413, 1.1353106108434061, 1.1502148210429997, 1.1651205361490131, 1.1799850633128324, 1.1947675087694194, 1.209428865834992, 1.2239320981381525, 1.2382422174289758, 1.2523263550737835, 1.2661538262255023, 1.2796961856140303, 1.29292727389873, 1.3058232535522822, 1.3183626333000342, 1.3305262802262754 ], [ 0.9442286706370377, 0.9373676925208003, 0.9310473881946786, 0.9253116143562841, 0.9202034192188393, 0.9157645663668552, 0.9120350310323335, 0.9090524781653317, 0.9068517336772096, 0.9054642615013269, 0.9049176591501737, 0.9052351828722743, 0.9064353103521499, 0.9085313449203165, 0.9115310621701074, 0.9154364001458147, 0.9202432000195759, 0.9259410156014566, 0.9325130238075572, 0.9399360775411152, 0.9481809397222278, 0.9572127186323292, 0.9669914938625361, 0.9774730891938824, 0.9886099254856929, 1.000351880335194, 1.012647091604703, 1.0254426626805435, 1.0386852505255975, 1.052321537035461, 1.06629859702307, 1.0805641823070797, 1.0950669424191701, 1.1097566003420745, 1.1245840981307085, 1.1395017234135343, 1.1544632242772719, 1.1694239171893641, 1.184340790461539, 1.199172604234738, 1.2138799869515606, 1.22842552765052, 1.2427738630542398, 1.2568917582397796, 1.2707481796060598, 1.2843143588456045, 1.297563846658932, 1.3104725550095688, 1.323018786805987, 1.3351832520212086 ], [ 0.9468586410260829, 0.9400392777463598, 0.933762034020752, 0.9280710314809535, 0.9230095682988777, 0.9186196296883845, 0.9149413693954889, 0.9120125723880997, 0.9098681114153253, 0.9085394118350795, 0.9080539394844112, 0.9084347248206193, 0.9096999329014936, 0.9118624836227074, 0.9149297217867695, 0.9189031349015038, 0.923778121011519, 0.9295438203529837, 0.9361830401896951, 0.9436723144202621, 0.951982139415069, 0.9610774098383935, 0.9709180460949731, 0.9814597696783474, 0.9926549574402216, 1.0044534989410234, 1.0168035923045453, 1.029652436410287, 1.0429468019317305, 1.0566334839745795, 1.0706596519426748, 1.084973117953611, 1.099522545489403, 1.1142576171986567, 1.1291291766802096, 1.144089354872903, 1.159091687993136, 1.174091231046069, 1.1890446687971983, 1.2039104246223187, 1.2186487667106782, 1.233221910535462, 1.2475941162059303, 1.2617317791826912, 1.2756035128048653, 1.2891802211028598, 1.3024351604308273, 1.315343988541624, 1.3278847998483942, 1.3400381457791568 ], [ 0.950052780965039, 0.9432880686784615, 0.9370663837867143, 0.9314320349304495, 0.9264284911439542, 0.9220978793988956, 0.9184804515496006, 0.9156140316613774, 0.9135334576466723, 0.9122700333933327, 0.9118510084021874, 0.912299100591721, 0.9136320739329536, 0.9158623763581507, 0.9189968367216844, 0.9230364156937093, 0.9279760080159782, 0.9338043044714499, 0.9405037387580747, 0.9480505594135414, 0.9564150696752596, 0.96556206199278, 0.9754514413937889, 0.9860389948849381, 0.9972772372428818, 1.0091162561994635, 1.0215044919451195, 1.0343894094763604, 1.047718047998267, 1.061437452268387, 1.0754950034759996, 1.0898386723968225, 1.1044172172544842, 1.1191803453459228, 1.1340788529580217, 1.1490647536320129, 1.1640914010344898, 1.1791136097686812, 1.1940877753735004, 1.208971993370071, 1.2237261763573954, 1.2383121676745947, 1.2526938499091171, 1.2668372464437196, 1.280710614236329, 1.2942845260776763, 1.3075319406549395, 1.3204282588636886, 1.332951364962511, 1.345081651365946 ], [ 0.9538092625373997, 0.9471121076177562, 0.9409583148223872, 0.9353922976541418, 0.930457613118773, 0.9261964470515236, 0.9226490671723082, 0.9198532555326359, 0.9178437354502722, 0.9166516108563445, 0.9163038373579246, 0.9168227432905014, 0.9182256148900089, 0.9205243525980372, 0.9237251970983109, 0.927828517427815, 0.9328286537925559, 0.9387138174453067, 0.9454660674188929, 0.953061401147939, 0.9614700016493136, 0.9706566698766931, 0.980581438904223, 0.9912003289079032, 1.0024661741914163, 1.014329445821993, 1.026739005712416, 1.0396427522141696, 1.0529881433969426, 1.0667226048491487, 1.080793841122693, 1.0951500744601694, 1.1097402334933597, 1.1245141107137162, 1.139422502651, 1.1544173420620598, 1.169451827602261, 1.1844805535784717, 1.1994596403895774, 1.2143468649768856, 1.2291017898448249, 1.2436858888062612, 1.2580626674263775, 1.2721977760916765, 1.2860591136568418, 1.2996169196900833, 1.3128438534366738, 1.325715057753896, 1.3382082064514684, 1.350303533712327 ], [ 0.9581238350218508, 0.9515069132384079, 0.9454330779048513, 0.9399467609550364, 0.9350915205799681, 0.9309095154401277, 0.9274409449398495, 0.9247234678081797, 0.9227916151324677, 0.9216762173931055, 0.9214038670190496, 0.9219964373964875, 0.9234706751474095, 0.9258378747020155, 0.9291036342089634, 0.9332676832509817, 0.9383237706218664, 0.9442596084002497, 0.9510568858248621, 0.958691385299433, 0.9671332411153292, 0.9763473699198072, 0.986294071531021, 0.9969297615386953, 1.0082077694208345, 1.0200791282014454, 1.0324932940034672, 1.0453987580675035, 1.0587435396611535, 1.0724755684319232, 1.0865429763448604, 1.1008943231526218, 1.1154787778104, 1.1302462739635748, 1.1451476525668562, 1.160134800012058, 1.1751607863686857, 1.190180005580976, 1.2051483176031907, 1.220023191294659, 1.2347638462370727, 1.249331391306859, 1.2636889577057924, 1.2778018241350577, 1.2916375318383881, 1.3051659873145023, 1.3183595506046473, 1.3311931072080865, 1.3436441218843456, 1.35569267288226 ], [ 0.962989822455368, 0.9564654824345582, 0.9504833046480246, 0.945087648884138, 0.9403219839333661, 0.9362283521477566, 0.9328467985093544, 0.9302147769308964, 0.9283665508403549, 0.9273326090431273, 0.9271391204207353, 0.9278074509411331, 0.9293537625183811, 0.9317887050291377, 0.9351172015307985, 0.9393383160390745, 0.9444451884893389, 0.9504250273386776, 0.9572591665953543, 0.9649232135652657, 0.9733873238887188, 0.9826166314882128, 0.992571833051435, 1.0032098913388352, 1.0144847950157394, 1.0263483054432676, 1.0387506330169107, 1.0516410091825104, 1.0649681451198618, 1.078680587117348, 1.092726989247229, 1.1070563269753597, 1.1216180732902183, 1.1363623543915267, 1.1512400968501935, 1.1662031735441183, 1.1812045520484395, 1.19619844656985, 1.2111404728166364, 1.2259878041744, 1.2406993270036928, 1.2552357926176665, 1.2695599634097146, 1.2836367506010313, 1.297433341120485, 1.3109193111989141, 1.3240667243617565, 1.3368502116571803, 1.3492470321840173, 1.3612371123056055 ], [ 0.9683981464478632, 0.9619783194784985, 0.9560990444975249, 0.9508045148177972, 0.9461380158015045, 0.9421413815642008, 0.9388544148583637, 0.9363142832436765, 0.9345549093422009, 0.933606377393746, 0.9334943814377232, 0.9342397408736909, 0.935858005496697, 0.9383591636666779, 0.9417474550740648, 0.9460212771326202, 0.951173166972361, 0.9571898444937267, 0.9640523166378087, 0.971736062186913, 0.9802113278473243, 0.9894435598440707, 0.9993939704140141, 1.0100202063725197, 1.0212770626705343, 1.0331171776250467, 1.0454916583408214, 1.0583506070793458, 1.0716435424613782, 1.0853197267569792, 1.0993284197974673, 1.1136190822180394, 1.1281415482592494, 1.1428461836951629, 1.1576840394156478, 1.1726070067781549, 1.1875679774502717, 1.202521008098985, 1.2174214887755166, 1.2322263129712545, 1.246894046870741, 1.261385095133825, 1.2756618604818264, 1.2896888943678635, 1.3034330360433106, 1.3168635373842634, 1.3299521709292712, 1.3426733187300777, 1.3550040398612588, 1.3669241147965796 ], [ 0.974337373782022, 0.9680334917421454, 0.9622678302052884, 0.9570843185950674, 0.9525259620309833, 0.9486342922722462, 0.945448780838295, 0.9430062277131586, 0.9413401440169711, 0.9404801518264048, 0.9404514278929406, 0.9412742188954654, 0.9429634525375655, 0.945528460360861, 0.948972815391672, 0.9532942740444605, 0.9584848027072871, 0.9645306705908078, 0.9714126029220844, 0.9791060063553416, 0.9875812900387693, 0.9968043012653351, 1.0067368734374802, 1.017337456138553, 1.0285617763504404, 1.040363475296318, 1.0526946768498093, 1.065506463856875, 1.078749259458462, 1.0923731256855658, 1.1063279992990473, 1.1205638861163711, 1.1350310322373909, 1.1496800859423486, 1.164462259218998, 1.1793294937661747, 1.1942346332314002, 1.2091316013402709, 1.223975584278676, 1.238723214968477, 1.2533327565282104, 1.2677642820720014, 1.2819798479625355, 1.2959436576322, 1.3096222130944715, 1.322984451289005, 1.3360018624647723, 1.3486485879440417, 1.3609014948652418, 1.3727402259048143 ], [ 0.9807937878155815, 0.9746167106577631, 0.9689747700146651, 0.9639115318671073, 0.9594696224443481, 0.9556901757507319, 0.9526122426781427, 0.9502721753396774, 0.948703005434546, 0.9479338405207816, 0.9479893059744132, 0.9488890616704914, 0.9506474194250882, 0.9532730789612461, 0.9567689872259408, 0.9611323114643424, 0.9663545060278942, 0.9724214519010111, 0.9793136578570703, 0.9870065276723757, 0.9954707085094886, 1.0046725325320218, 1.0145745465048535, 1.0251361013344173, 1.036313957216065, 1.048062857737301, 1.0603360373962445, 1.0730856451890554, 1.0862630847783352, 1.0998192843591885, 1.113704915254603, 1.1278705786042025, 1.1422669764030233, 1.1568450786427245, 1.1715562938231276, 1.1863526463775884, 1.201186961823207, 1.2160130586409408, 1.2307859448151781, 1.245462016395093, 1.2599992551860173, 1.2743574225874328, 1.2884982465665127, 1.3023855987359199, 1.3159856584764333, 1.3292670610227795, 1.3422010264530708, 1.3547614666379506, 1.3669250674656577, 1.3786713440998295 ], [ 0.987751482230381, 0.9817114360867986, 0.9762026642478584, 0.97126826874477, 0.96695039765386, 0.9632896917389201, 0.9603246925602262, 0.9580912258531021, 0.9566217792592167, 0.9559448987066261, 0.9560846318312182, 0.9570600483381544, 0.9588848644983547, 0.9615671909867476, 0.9651094104920839, 0.9695081769076623, 0.9747545165970097, 0.9808340093813708, 0.987727034056107, 0.9954090758219021, 1.0038511019915224, 1.0130200102109965, 1.0228791400278474, 1.0333888214380218, 1.0445069227908261, 1.0561893607249828, 1.068390545622538, 1.0810637518737314, 1.0941614169661067, 1.1076353832326409, 1.121437100124038, 1.135517804260582, 1.1498286911889377, 1.1643210884720059, 1.1789466356535203, 1.1936574733468663, 1.2084064413506193, 1.2231472841931075, 1.2378348616564308, 1.2524253614128862, 1.2668765107408233, 1.2811477842354004, 1.2952006044024786, 1.3089985319763393, 1.3225074427260664, 1.335695687437609, 1.3485342317285154, 1.3609967724340146, 1.3730598275595294, 1.3847027972727344 ], [ 0.995192475249165, 0.9892990018280334, 0.9839321435477805, 0.9791344384057401, 0.9749474578698941, 0.9714112552960327, 0.9685637761953598, 0.9664402442670402, 0.9650725424055976, 0.9644886131281049, 0.9647119070143473, 0.9657609093786518, 0.9676487729241233, 0.9703830765159991, 0.9739657178769849, 0.9783929336443659, 0.9836554285281648, 0.9897385909380996, 0.9966227768354391, 1.0042836528640864, 1.0126925965981264, 1.0218171501566868, 1.031621513746228, 1.042067054070046, 1.0531127963833298, 1.0647158719427943, 1.0768319031709337, 1.0894153223168674, 1.102419631013638, 1.115797615203212, 1.1295015320776387, 1.1434832841652844, 1.1576945921674733, 1.1720871740843195, 1.1866129344946879, 1.2012241650020963, 1.2158737548959344, 1.2305154098786169, 1.2451038760743698, 1.259595166260809, 1.2739467851811206, 1.2881179507770104, 1.3020698081507742, 1.3157656329822331, 1.3291710209940573, 1.342254059913717, 1.3549854802851065, 1.3673387815175297, 1.3792903298033117, 1.390819425047056 ], [ 1.0030968420720672, 0.9973587596275286, 0.9921418256744461, 0.9874879160124226, 0.9834379294024567, 0.9800312404791656, 0.9773051154001162, 0.975294104204111, 0.9740294290739864, 0.9735383928410808, 0.9738438361348608, 0.9749636732045617, 0.9769105341444987, 0.9796915340691037, 0.9833081780999662, 0.9877563972651757, 0.9930266987171804, 0.9991044080986526, 1.0059699836695362, 1.0135993878538063, 1.0219645063858565, 1.0310336040072978, 1.040771799341664, 1.0511415350326125, 1.062103017666134, 1.0736146073650308, 1.0856331472972331, 1.0981142347127946, 1.1110124439708375, 1.1242815166157096, 1.1378745340554985, 1.1517440860373862, 1.1658424444030344, 1.1801217477444779, 1.1945341992838387, 1.2090322778509153, 1.2235689602264959, 1.2380979522004465, 1.2525739252607302, 1.2669527556887425, 1.2811917628298843, 1.2952499433215015, 1.3090881980209805, 1.3226695482550708, 1.3359593378159338, 1.3489254169062619, 1.3615383040621891, 1.3737713220560466, 1.3856007040006708, 1.3970056664175134 ], [ 1.0114428629787249, 1.0058682387572375, 1.0008084874881829, 0.9963047280760682, 0.9923970944263979, 0.989124195569284, 0.9865225398816931, 0.9846259373801297, 0.9834648991293107, 0.9830660577592365, 0.9834516369547288, 0.9846389992994733, 0.9866402996775728, 0.9894622647015048, 0.9931061077236722, 0.9975675760366493, 1.0028371154373612, 1.0089001308334022, 1.0157373210760734, 1.0233250693744802, 1.0316358732305293, 1.0406387969930846, 1.0502999266984647, 1.0605828044868766, 1.0714488219452827, 1.08285755890248, 1.0947670643198781, 1.1071340856274927, 1.1199142595043283, 1.1330622797118775, 1.1465320566926358, 1.160276880557995, 1.1742495951811203, 1.1884027873864964, 1.2026889922276036, 1.2170609132294583, 1.2314716551691025, 1.2458749662919975, 1.2602254866089213, 1.274478998898613, 1.2885926791067672, 1.3025253428747101, 1.3162376848841637, 1.3296925075425587, 1.3428549352698296, 1.3556926103377425, 1.3681758659473522, 1.3802778721274556, 1.39197475021841, 1.4032456522693453 ], [ 1.0202071843124751, 1.0148033180181697, 1.0099072485754004, 1.0055592482828544, 1.001798599545861, 0.9986630648623352, 0.9961883226915309, 0.9944073831144684, 0.9933500020514077, 0.9930421174720114, 0.993505334622366, 0.9947564886294016, 0.9968073107315829, 0.9996642180971422, 1.0033282370911925, 1.0077950577906822, 1.0130552065184326, 1.0190943160087247, 1.0258934705061653, 1.033429604043495, 1.041675931401379, 1.0506023909665922, 1.0601760776005889, 1.0703616442361388, 1.0811216553324035, 1.0924168835078345, 1.104206550487675, 1.116448522049168, 1.1290994718179868, 1.1421150300112717, 1.155449931316249, 1.1690581724263405, 1.1828931856424039, 1.1969080312754032, 1.2110556087793258, 1.2252888846683143, 1.2395611341994468, 1.2538261933222927, 1.2680387172930174, 1.2821544424373457, 1.296130447678427, 1.3099254125172566, 1.3234998681014352, 1.336816437816877, 1.3498400635038121, 1.362538212994315, 1.3748810642991747, 1.3868416615762127, 1.3983960381409533, 1.4095233023575706 ], [ 1.0293649894259302, 1.0241384069160266, 1.019411762908031, 1.0152243997935657, 1.0116146687727048, 1.0086194122311596, 1.0062734141368948, 1.004608832232476, 1.0036546303844909, 1.0034360337831396, 1.0039740329299094, 1.0052849634528969, 1.0073801867060537, 1.0102658902372337, 1.0139430178926612, 1.018407328136803, 1.0236495686003904, 1.029655747302756, 1.0364074774196634, 1.0438823719794135, 1.052054465522755, 1.0608946402258381, 1.0703710345953656, 1.0804494151766824, 1.0910934971330866, 1.1022652079035637, 1.1139248975573333, 1.1260315073411684, 1.1385427123410405, 1.1514150547127533, 1.1646040814476248, 1.178064496578067, 1.1917503334197264, 1.2056151487477533, 1.2196122380793912, 1.2336948694960583, 1.2478165325146837, 1.261931198175433, 1.2759935865234353, 1.2899594378362729, 1.3037857841386415, 1.3174312176469396, 1.3308561527321812, 1.3440230777530737, 1.3568967927081508, 1.3694446281526882, 1.381636640340767, 1.3934457772481053, 1.404848010189776, 1.4158224263262853 ], [ 1.038890176637436, 1.033846632770631, 1.0292944149980485, 1.0252718601727748, 1.0218163167703325, 1.0189636420137549, 1.0167476694247621, 1.0151996603689502, 1.0143477574349304, 1.014216461439064, 1.0148261567107792, 1.0161927101486237, 1.0183271674493564, 1.0212355644080542, 1.024918862580984, 1.0293730082211594, 1.0345891033244485, 1.040553669918149, 1.0472489844712949, 1.0546534581800961, 1.0627420395916924, 1.0714866173651658, 1.080856402682993, 1.0908182737427894, 1.1013370699919791, 1.1123758315115944, 1.1238959878201764, 1.1358575079583397, 1.1482190280195728, 1.1609379727188125, 1.173970684944891, 1.1872725730032638, 1.2007982808012208, 1.2145018824486162, 1.2283371000078607, 1.2422575414256063, 1.2562169548203816, 1.2701694950339535, 1.2840699984390436, 1.2978742622336792, 1.311539324691084, 1.325023742962554, 1.3382878649778849, 1.351294091720182, 1.3640071256819075, 1.3763942007038563, 1.3884252877878573, 1.4000732710441732, 1.4113140879047457, 1.4221268283011235 ], [ 1.0487555413342888, 1.0439000306671584, 1.0395265172313124, 1.0356722654200368, 1.0323735586456082, 1.0296652133527204, 1.0275800660457866, 1.0261484466086572, 1.0253976551250927, 1.025351462955297, 1.0260296612871427, 1.0274476809332753, 1.0296163050243123, 1.0325414910558037, 1.0362243107645606, 1.0406610066646511, 1.0458431545418954, 1.0517579136458854, 1.0583883419427833, 1.065713752696555, 1.0737100898810776, 1.0823503021158585, 1.091604697081093, 1.1014412609925623, 1.1118259319059884, 1.1227228221925851, 1.1340943936883865, 1.1459015965277606, 1.1581039872786665, 1.170659842782528, 1.183526283678223, 1.1966594174039376, 1.210014505962744, 1.223546159868516, 1.2372085568735975, 1.2509556823339711, 1.2647415871999184, 1.2785206593692946, 1.2922479042567858, 1.3058792307080578, 1.319371738661078, 1.332684005109343, 1.345776364872011, 1.3586111823823228, 1.3711531101725292, 1.3833693290264153, 1.3952297640271478, 1.40670727015921, 1.4177777809866312, 1.428420414471165 ], [ 1.0589329595582948, 1.0542697334345852, 1.050078505438103, 1.0463954100661301, 1.043255613204613, 1.0406928449162591, 1.038738907920638, 1.0374231746708287, 1.0367720895004497, 1.0368086954463693, 1.0375522074115084, 1.0390176535971345, 1.0412156049597232, 1.04415200751503, 1.0478281248820418, 1.0522405895072031, 1.057381552099241, 1.063238911674916, 1.0697966045778342, 1.0770349302263489, 1.0849308933190365, 1.093458545105963, 1.1025893086881466, 1.1122922751005953, 1.122534459624418, 1.1332810128628605, 1.1444953884204474, 1.156139476469994, 1.1681737175857487, 1.1805572126513555, 1.193247842745556, 1.2062024090058359, 1.2193767980382808, 1.232726174523315, 1.2462051997528636, 1.2597682729929447, 1.2733697916274582, 1.2869644257501107, 1.300507402977278, 1.3139547995392877, 1.3272638339992737, 1.340393160117986, 1.3533031553366912, 1.3659562010349817, 1.3783169501292662, 1.3903525767716134, 1.4020330020292235, 1.4133310887062867, 1.424222798210717, 1.434687302867218 ], [ 1.0693935707068958, 1.0649261592252968, 1.0609201302571039, 1.0574104409311404, 1.0544310973845739, 1.0520147079256135, 1.0501920145680441, 1.0489914153817244, 1.0484384933034923, 1.0485555697685562, 1.0493613031848303, 1.0508703522554392, 1.0530931219168749, 1.0560356049548618, 1.0596993254393252, 1.0640813818588069, 1.0691745796544652, 1.074967636404237, 1.0814454395307795, 1.088589336515046, 1.0963774402800575, 1.1047849357080466, 1.113784375367509, 1.1233459532752856, 1.133437746630556, 1.144025919001092, 1.1550748847684413, 1.1665474418946713, 1.1784048856177627, 1.1906071178568678, 1.2031127659076064, 1.2158793205872465, 1.2288632997852027, 1.2420204394876788, 1.2553059113538534, 1.2686745639633197, 1.2820811838077035, 1.2954807717296943, 1.3088288305709692, 1.3220816600554164, 1.3351966552252994, 1.3481326049237146, 1.3608499867718404, 1.3733112547549928, 1.3854811148891708, 1.3973267835395133, 1.4088182219487635, 1.4199283396600761, 1.4306331591247126, 1.440911934227023 ], [ 1.080107957350871, 1.075839194733203, 1.0720206424276488, 1.068686042856887, 1.0658682104548691, 1.0635986064920657, 1.061906894870491, 1.0608204907871321, 1.06036411699466, 1.060559384697608, 1.0614244174046628, 1.0629735357741752, 1.0652170191946282, 1.0681609553536526, 1.0718071826310978, 1.0761533226149267, 1.0811928927012207, 1.0869154831566048, 1.0933069804741848, 1.1003498196950536, 1.1080232515620114, 1.116303613782278, 1.125164597349194, 1.1345774986201003, 1.1445114475765372, 1.1549336048213539, 1.1658093251503685, 1.177102292396584, 1.1887746360505742, 1.2007870430145393, 1.213098877423016, 1.2256683186697663, 1.2384525239514768, 1.25140781789292, 1.2644899088051664, 1.2776541290686108, 1.2908556959624362, 1.3040499887847892, 1.3171928380883877, 1.3302408230756326, 1.343151573467923, 1.355884072334075, 1.36839895631346, 1.3806588093177097, 1.392628445106665, 1.4042751731483507, 1.4155690410319692, 1.4264830456757205, 1.4369933050378685, 1.4470791824130507 ], [ 1.0910463205712058, 1.086978372579361, 1.0833489707423798, 1.0801906154457666, 1.077534907440979, 1.0754121452908645, 1.0738509062262447, 1.0728776216857165, 1.0725161612772607, 1.0727874408211113, 1.0737090710619421, 1.075295063116793, 1.077555604393896, 1.0804969144632506, 1.0841211844651453, 1.0884265968802809, 1.093407416080339, 1.0990541354603685, 1.1053536652634568, 1.1122895466521403, 1.1198421810108605, 1.127989066707372, 1.1367050366950093, 1.145962489280897, 1.155731603074726, 1.1659805280952056, 1.1766755492528789, 1.1877812246838941, 1.1992605072114333, 1.2110748605699058, 1.2231843823434871, 1.2355479434780268, 1.2481233508927474, 1.2608675362253194, 1.2737367707894773, 1.2866869047019127, 1.29967362685201, 1.3126527417922766, 1.3255804595114458, 1.3384136942040767, 1.351110368382314, 1.3636297188258761, 1.3759326008056652, 1.3879817866459674, 1.3997422539619964, 1.4111814578483004, 1.4222695800374812, 1.4329797468784848, 1.4432882073140743, 1.4531744623377048 ], [ 1.1021786496152195, 1.0983130418657983, 1.0948738919460932, 1.0918924404819004, 1.08939906196545, 1.0874228854397805, 1.0859914008162015, 1.0851300613967683, 1.0848618952904197, 1.085207139969466, 1.0861829148232145, 1.0878029458454415, 1.0900773542635107, 1.0930125169307876, 1.0966110009691912, 1.100871569204448, 1.1057892475089872, 1.1113554415241496, 1.11755808931603, 1.1243818383601332, 1.1318082386413006, 1.1398159465288853, 1.148380934734409, 1.1574767020553844, 1.1670744746367094, 1.177143390569664, 1.1876506629155927, 1.198561721734265, 1.209840341232474, 1.2214487617806156, 1.2333478174855914, 1.2454970786173252, 1.257855015423826, 1.2703791867294396, 1.2830264539005225, 1.2957532186369516, 1.3085156816801522, 1.321270118822024, 1.3339731703787536, 1.346582140364329, 1.3590553017751086, 1.371352204514459, 1.3834339824045863, 1.3952636553416304, 1.4068064218860146, 1.4180299364556492, 1.4289045639361353, 1.439403603227563, 1.4495034704563794, 1.4591838328113833 ], [ 1.113474885030504, 1.1098125313067937, 1.1065641923253817, 1.103759840215292, 1.101428619242134, 1.0995984900137514, 1.0982958612730762, 1.0975452190880675, 1.097368765036193, 1.0977860762092397, 1.0988138002000059, 1.1004653973629002, 1.1027509403630418, 1.1056769773542234, 1.1092464603859076, 1.113458735534198, 1.1183095867908233, 1.1237913230075032, 1.1298928968990545, 1.1366000471281867, 1.1438954576291278, 1.1517589307174176, 1.1601675707432375, 1.169095973144439, 1.1785164114546698, 1.1883990143177336, 1.198711926965438, 1.2094214562657721, 1.220492203505447, 1.2318871927439812, 1.2435680039760313, 1.2554949195854943, 1.2676270904051616, 1.2799227249762157, 1.292339303014081, 1.304833812022667, 1.3173630045900213, 1.3298836731018524, 1.3423529382892305, 1.354728548009965, 1.3669691827734909, 1.3790347645913201, 1.3908867656230743, 1.402488512672082, 1.413805482788557, 1.4248055840642726, 1.435459414273952, 1.4457404886274599, 1.4556254270097562, 1.4650940912580124 ], [ 1.124905074728539, 1.1214463046625756, 1.1183888210627433, 1.1157613270184734, 1.1135917402665567, 1.1119068608786653, 1.1107320281903894, 1.1100907759729643, 1.110004496334219, 1.110492123773821, 1.1115698509291456, 1.1132508865848987, 1.1155452643462316, 1.1184597070547846, 1.121997547902626, 1.1261587049196495, 1.1309397019556535, 1.136333727326404, 1.1423307214488398, 1.1489174868001968, 1.1560778162726126, 1.1637926378702368, 1.1720401735637749, 1.180796108120496, 1.1900337613525622, 1.1997242563644772, 1.209836678065377, 1.2203382200141375, 1.2311943221080455, 1.2423688051414918, 1.2538240099401081, 1.265520948552732, 1.2774194733792348, 1.2894784678453595, 1.3016560599297649, 1.3139098579067028, 1.3261972062653755, 1.3384754589111987, 1.3507022663481558, 1.3628358734386954, 1.3748354243756618, 1.3866612715182227, 1.3982752845930002, 1.4096411563157234, 1.420724699665086, 1.4314941308303264, 1.4419203303762986, 1.4519770737173556, 1.461641221042618, 1.4708928569707909 ], [ 1.1364395226434836, 1.1331841084089573, 1.1303170356174532, 1.1278657450711727, 1.1258569383179735, 1.1243162684855086, 1.1232680216967434, 1.1227347972305868, 1.1227371958066814, 1.1232935260667116, 1.124419539264799, 1.126128201178916, 1.1284295082358184, 1.1313303519067637, 1.1348344319215888, 1.1389422153498485, 1.1436509358498106, 1.1489546260731978, 1.1548441766525739, 1.1613074170604762, 1.168329215905726, 1.1758915996192485, 1.18397388810695, 1.1925528439960544, 1.2016028298209034, 1.2110959664518584, 1.22100228717938, 1.2312898848750617, 1.2419250534206858, 1.2528724278094991, 1.264095129115954, 1.2755549207077428, 1.2872123809706655, 1.2990270959976056, 1.3109578737034497, 1.3229629790575523, 1.3350003887763562, 1.3470280629384552, 1.3590042305134644, 1.3708876856157626, 1.3826380912591614, 1.3942162873456971, 1.4055845994251597, 1.416707144283018, 1.4275501275662497, 1.4380821274258488, 1.4482743566566576, 1.458100894340714, 1.4675388770321056, 1.4765686396466622 ], [ 1.1480489297825982, 1.144996111679329, 1.1423185394504942, 1.1400424047106514, 1.1381932087645057, 1.1367954759922425, 1.135872458843703, 1.1354458417580084, 1.1355354523068626, 1.1361589883542673, 1.1373317698479948, 1.1390665228723935, 1.1413732017673062, 1.1442588525829478, 1.1477275182222038, 1.151780182830226, 1.1564147509298333, 1.16162605597784, 1.1674058936013072, 1.1737430764046466, 1.1806235090506836, 1.188030283279295, 1.1959437919965668, 1.2043418597491224, 1.213199884807498, 1.2224909869832188, 1.2321861559688894, 1.2422543972998044, 1.2526628761345873, 1.2633770618752742, 1.2743608784158862, 1.285576865256632, 1.2969863540310178, 1.3085496635878853, 1.3202263151059073, 1.331975267151663, 1.3437551693359633, 1.3555246323524577, 1.3672425116708526, 1.3788682019124439, 1.3903619388316952, 1.4016851057225947, 1.4128005408219004, 1.4236728417677762, 1.4342686623041483, 1.4445569951860984, 1.4545094337525484, 1.4641004031782838, 1.4733073514732293, 1.4821108904415958 ], [ 1.159704527520281, 1.1568530385259572, 1.1543636123570034, 1.152261209941385, 1.1505701528974142, 1.149313858657304, 1.1485145679309952, 1.1481930709896087, 1.1483684400331189, 1.1490577752490405, 1.1502759719236348, 1.1520355150405763, 1.1543463061998398, 1.1572155255530856, 1.1606475290808815, 1.164643779363783, 1.1692028064982152, 1.1743201953391402, 1.1799885958778864, 1.1861977549280205, 1.1929345686773207, 1.2001831562737226, 1.2079249539962469, 1.216138827918875, 1.2248012011162686, 1.2338861903797866, 1.2433657477478297, 1.2532098038702433, 1.2633864127016043, 1.2738618994138138, 1.284601015064539, 1.2955671021599202, 1.306722274878315, 1.3180276166771514, 1.329443396651469, 1.3409293046648214, 1.3524447041373775, 1.3639489005444196, 1.3754014231501264, 1.3867623172082537, 1.3979924436963225, 1.4090537834843895, 1.419909742542636, 1.4305254542437653, 1.440868073935484, 1.450907059735201, 1.4606144320493453, 1.4699650029256135, 1.4789365654688447, 1.4875100337420468 ], [ 1.171378202982977, 1.1687262924892985, 1.1664232335391482, 1.164492779373501, 1.1629580961780324, 1.1618415189602307, 1.1611643002305936, 1.1609463571569156, 1.1612060234873602, 1.1619598127713344, 1.1632221991367524, 1.165005421049625, 1.1673193121162064, 1.1701711612322947, 1.1735656025036085, 1.1775045337100691, 1.1819870610267933, 1.187009467488541, 1.1925652032838787, 1.198644897061561, 1.2052363884465882, 1.212324782299461, 1.2198925245991954, 1.2279194983760195, 1.236383136497047, 1.2452585470894482, 1.25451864748332, 1.2641343037864816, 1.2740744751250712, 1.284306363553899, 1.2947955721013844, 1.3055062740744234, 1.3164013966047001, 1.3274428206692765, 1.3385915987464494, 1.349808190136957, 1.3610527129806549, 1.3722852112289234, 1.3834659343090472, 1.3945556268914614, 1.4055158259543898, 1.4163091621201571, 1.4268996618924406, 1.437253046845611, 1.4473370249320192, 1.4571215678803695, 1.4665791672751856, 1.4756850606098708, 1.4844174178301512, 1.4927574791426852 ], [ 1.1830426163257808, 1.1805880733618836, 1.1784691973801094, 1.1767085606009444, 1.1753282009192878, 1.1743493974250026, 1.1737924389599983, 1.1736763906122125, 1.1740188635508426, 1.1748357937696632, 1.17614123504505, 1.1779471706996187, 1.1802633476344886, 1.1830971346887011, 1.1864534059294969, 1.1903344482544869, 1.1947398919631933, 1.1996666628852666, 1.2051089551859737, 1.2110582248176207, 1.2175032042950744, 1.2244299396038274, 1.2318218493949917, 1.2396598053482135, 1.2479222311824745, 1.2565852168561853, 1.2656226444282206, 1.2750063228938362, 1.2847061307583998, 1.2946901666832067, 1.3049249097821165, 1.3153753917963575, 1.3260053833788525, 1.3367775962022006, 1.347653901774232, 1.3585955669171297, 1.369563505006353, 1.380518541371304, 1.3914216907571986, 1.4022344444046735, 1.412919064047749, 1.4234388798630353, 1.4337585890164026, 1.4438445508520357, 1.4536650738905585, 1.4631906886579702, 1.472394399075715, 1.4812519039703966, 1.4897417796138939, 1.4978456145422068 ], [ 1.1946713096341157, 1.1924114859143609, 1.1904742216989048, 1.1888809377775857, 1.1876525730911984, 1.1868093787033946, 1.1863707048509151, 1.1863547852572698, 1.1867785233076695, 1.1876572848076763, 1.1890047018237155, 1.1908324915178672, 1.1931502929897386, 1.1959655240477445, 1.199283258737346, 1.203106125573951, 1.2074342259540296, 1.2122650722407342, 1.2175935454691724, 1.2234118732485297, 1.2297096289043705, 1.236473752886527, 1.2436885968335523, 1.2513359895764236, 1.2593953231590613, 1.2678436560988866, 1.2766558309256753, 1.2858046035758182, 1.295260783275191, 1.3049933827584852, 1.3149697796927893, 1.325155890762532, 1.3355163599602273, 1.3460147622810217, 1.356613823387427, 1.3672756550626772, 1.3779620055466095, 1.3886345232355586, 1.39925503175812, 1.4097858140913462, 1.420189903097301, 1.4304313755545106, 1.4404756463393888, 1.450289758797927, 1.459842666489838, 1.4691055004069706, 1.4780518145888728, 1.4866578020325816, 1.4949024722891524, 1.5027677825598436 ], [ 1.2062388071135364, 1.2041706402372472, 1.2024120481024563, 1.2009833319326901, 1.1999043626677386, 1.199194392151618, 1.1988718572922568, 1.198954180723273, 1.199457571848021, 1.2003968322573995, 1.201785169343424, 1.203634021477587, 1.2059528974351785, 1.2087492319293083, 1.2120282583212862, 1.2157928989623787, 1.220043673328437, 1.2247786241811431, 1.2299932623507803, 1.2356805311871282, 1.2418307920036724, 1.2484318317190135, 1.2554688932967166, 1.2629247286206202, 1.270779672404524, 1.279011734961126, 1.287596711391911, 1.2965083050651536, 1.3057182639851797, 1.3151965295625312, 1.3249113980978282, 1.3348296957943135, 1.3449169682358315, 1.3551376850389658, 1.3654554599124846, 1.3758332857623867, 1.3862337838791774, 1.3966194657134494, 1.406953005315623, 1.4171975201738303, 1.4273168578813604, 1.437275885732604, 1.447040779904941, 1.4565793102675588, 1.4658611160339345, 1.4748579664741919, 1.4835439998518851, 1.4918959328816062, 1.4998932326467893, 1.5075182434151506 ], [ 1.2177207061737267, 1.2158407432614262, 1.2142575339254338, 1.2129902934062602, 1.212057856740315, 1.2114785059182482, 1.211269789800714, 1.2114483397320566, 1.2120296841021196, 1.2130280652235572, 1.214456261787431, 1.2163254198362738, 1.2186448946959543, 1.221422105722433, 1.2246624051633834, 1.2283689620294114, 1.2325426617041013, 1.23718202211573, 1.2422831275724413, 1.2478395816694454, 1.2538424808138404, 1.2602804097229774, 1.2671394596862213, 1.274403269538797, 1.2820530883969383, 1.290067858501619, 1.2984243162033304, 1.3070971092477068, 1.3160589290021039, 1.3252806569095235, 1.3347315250610348, 1.3443792911794934, 1.3541904284291164, 1.3641303303132366, 1.3741635305646283, 1.3842539374621767, 1.394365081513516, 1.404460374988737, 1.4145033814022916, 1.4244580927105144, 1.4342892116816617, 1.443962436546196, 1.4534447445837437, 1.462704670697738, 1.4717125762513978, 1.480440902530652, 1.4888644022840933, 1.496960342082463, 1.5047086680255204, 1.5120921278887933 ], [ 1.2290937589803126, 1.2273981809651984, 1.2259867351713172, 1.2248775856897387, 1.2240885645169204, 1.223637013454085, 1.2235396184791423, 1.2238122390082196, 1.2244697347507025, 1.2255257929983097, 1.226992759152604, 1.2288814730929305, 1.2312011136548162, 1.2339590530969344, 1.237160723070685, 1.2408094933575682, 1.2449065645629065, 1.2494508760527974, 1.2544390306282118, 1.259865237622773, 1.265721276145017, 1.271996479951921, 1.2786777449133544, 1.2857495592879833, 1.2931940562456299, 1.3009910874314516, 1.3091183160189714, 1.3175513276920865, 1.3262637582746333, 1.3352274371573636, 1.3444125461014615, 1.353787793296718, 1.3633206026511524, 1.3729773181801237, 1.382723423089105, 1.3925237727711335, 1.4023428405356007, 1.4121449744980392, 1.421894663714121, 1.4315568113282646, 1.441097012196635, 1.450481832089672, 1.459679085129543, 1.4686581055363457, 1.4773900090383054, 1.4858479384941428, 1.4940072874996646, 1.5018458951988571, 1.5093442054354655, 1.516485383997353 ], [ 1.2403359440477262, 1.2388205907626644, 1.237576979845897, 1.2366222599309482, 1.2359732933030427, 1.2356465113467132, 1.2356577621433247, 1.236022152177096, 1.23675388438551, 1.2378660949533318, 1.2393706912820293, 1.2412781934725492, 1.2435975814695082, 1.246336149781022, 1.249499371475037, 1.2530907730212388, 1.2571118215317947, 1.2615618260480914, 1.2664378546673654, 1.271734669409026, 1.2774446806805064, 1.28355792294324, 1.290062052689169, 1.296942369183574, 1.3041818577370652, 1.3117612546823212, 1.319659132862061, 1.3278520063274772, 1.3363144530671498, 1.345019254842944, 1.353937553488149, 1.3630390232234493, 1.3722920586092313, 1.3816639776632256, 1.3911212394554355, 1.4006296751928675, 1.4101547314740575, 1.419661724064237, 1.4291161002339856, 1.438483707410988, 1.4477310655908997, 1.4568256406025593, 1.4657361148861612, 1.4744326518964708, 1.482887149592722, 1.4910734777755636, 1.4989676933923668, 1.5065482275256612, 1.5137960378093582, 1.5206947206685546 ], [ 1.2514265274817054, 1.2500869235996053, 1.2490069311055927, 1.2482027193996896, 1.2476902146123325, 1.247484967458583, 1.2476020129096974, 1.2480557232437257, 1.2488596563140262, 1.2500264010684876, 1.2515674224488975, 1.2534929078016082, 1.2558116168594378, 1.2585307372480383, 1.261655747373708, 1.2651902885041588, 1.2691360478793445, 1.273492654774596, 1.2782575915365335, 1.2834261216532916, 1.2889912368292664, 1.2949436247624293, 1.301271658866547, 1.3079614105956103, 1.3149966844091336, 1.3223590748738263, 1.3300280450158788, 1.3379810248562052, 1.3461935290601197, 1.3546392927495468, 1.3632904246775865, 1.37211757707631, 1.3810901315089772, 1.3901763999713528, 1.3993438403053737, 1.4085592847421553, 1.4177891801145392, 1.4269998379978652, 1.4361576927640876, 1.4452295652617628, 1.4541829295437776, 1.4629861797258172, 1.4716088936452396, 1.4800220894877119, 1.488198470973042, 1.496112656097095, 1.5037413839178204, 1.5110636935978459, 1.518061070041451, 1.5247175511338733 ], [ 1.2623461135499126, 1.2611774953562538, 1.260256639724173, 1.2595987733049716, 1.2592189196699242, 1.2591317784908636, 1.2593515962176536, 1.2598920294750673, 1.2607660026840335, 1.2619855616373787, 1.263561724914571, 1.2655043351032558, 1.2678219118213194, 1.2705215085275128, 1.2736085751019979, 1.2770868281960968, 1.2809581314039422, 1.2852223873836384, 1.2898774441164886, 1.2949190174861114, 1.300340632233842, 1.3061335830700547, 1.3122869172969813, 1.3187874397703243, 1.3256197404683825, 1.3327662444308979, 1.3402072834423053, 1.347921188597585, 1.3558844027948262, 1.3640716122046257, 1.3724558958136193, 1.3810088921714807, 1.389700982447609, 1.3985014888091887, 1.4073788869707133, 1.4163010315556175, 1.425235392675426, 1.4341493018885356, 1.4430102054568401, 1.451785922567319, 1.460444905911602, 1.4689565016972532, 1.477291205781806, 1.4854209121697128, 1.4933191496141398, 1.500961301574934, 1.5083248043955961, 1.5153893184006133, 1.5221368668168545, 1.5285519380973127 ], [ 1.2730766843611723, 1.2720740272666424, 1.2713075855040465, 1.2707916794948386, 1.2705404637348727, 1.270567816288496, 1.2708872194884795, 1.2715116327775382, 1.2724533589181408, 1.2737239050515836, 1.2753338402921033, 1.2772926516926564, 1.2796086005232954, 1.2822885808761317, 1.2853379826720286, 1.2887605612083988, 1.292558315458994, 1.296731377402467, 1.3012779146886038, 1.3061940489110078, 1.3114737916074095, 1.317108999833468, 1.3230893527600658, 1.3294023502626269, 1.336033333960735, 1.3429655306906176, 1.3501801180033168, 1.3576563110056397, 1.3653714696962103, 1.3733012258686146, 1.3814196286161162, 1.389699307436802, 1.3981116518732932, 1.406627006512281, 1.4152148800165947, 1.4238441666766084, 1.4324833787627826, 1.4411008877477722, 1.4496651722477556, 1.4581450703029633, 1.4665100333629622, 1.4747303790477677, 1.4827775394097393, 1.4906243010259677, 1.4982450328305674, 1.5056158972041405, 1.512715039557162, 1.5195227515798733, 1.5260216035921756, 1.5321965420947272 ], [ 1.2836016285611933, 1.2827596752036108, 1.2821427074132972, 1.2817641757444067, 1.2816373988661285, 1.2817754624278317, 1.2821911088809963, 1.2828966189540512, 1.283903685776492, 1.2852232829289814, 1.28686552794284, 1.2888395429781423, 1.2911533145754774, 1.2938135545102378, 1.2968255638898665, 1.3001931027323703, 1.3039182673477465, 1.3080013779020774, 1.312440878555122, 1.3172332524992458, 1.3223729540666058, 1.3278523598015473, 1.3336617400244084, 1.3397892519698984, 1.3462209551126512, 1.352940848842471, 1.3599309322632145, 1.3671712855854459, 1.3746401723659332, 1.38231416169989, 1.3901682693669821, 1.3981761168399474, 1.4063101069621227, 1.414541614974158, 1.4228411934190421, 1.4311787892829415, 1.439523971545438, 1.4478461671222473, 1.456114902986322, 1.4643000520440146, 1.472372080110585, 1.4803022910632206, 1.488063066943974, 1.495628099446953, 1.5029726088795676, 1.5100735463862405, 1.5169097750371938, 1.5234622254011072, 1.5297140215243983, 1.5356505738907371 ], [ 1.2939057590985927, 1.2932190478383396, 1.2927464224058554, 1.2925004995334113, 1.2924937949750317, 1.2927386308715547, 1.2932470338738435, 1.294030624522431, 1.2951004986908492, 1.2964671022018739, 1.2981401000065844, 1.300128241564866, 1.3024392242793914, 1.3050795570144442, 1.3080544258799987, 1.3113675645828504, 1.315021131737971, 1.3190155975852398, 1.3233496425526399, 1.3280200700292395, 1.3330217355436074, 1.3383474942808116, 1.3439881685227602, 1.3499325361858507, 1.3561673411917692, 1.362677325979269, 1.3694452860794737, 1.376452146354505, 1.3836770582436762, 1.3910975171639794, 1.3986894990535348, 1.406427614908788, 1.4142852820302025, 1.4222349105479526, 1.4302481036444172, 1.438295869726537, 1.446348844631518, 1.4543775217760175, 1.4623524879804706, 1.4702446625104106, 1.4780255366675108, 1.485667411027499, 1.4931436271582978, 1.5004287903704048, 1.5074989797783285, 1.5143319417323098, 1.520907262574821, 1.5272065167575852, 1.5332133866876774, 1.5389137512988615 ], [ 1.3039753202705953, 1.3034382138531435, 1.3031046330687808, 1.3029863964195623, 1.3030952492321695, 1.3034427787220932, 1.3040403196728405, 1.3048988510671355, 1.3060288843231893, 1.307440344108164, 1.30914244300742, 1.3111435516097278, 1.3134510658173115, 1.3160712734024504, 1.319009222008274, 1.322268590929319, 1.325851569104201, 1.3297587417996257, 1.3339889884513985, 1.3385393940407968, 1.3434051762151882, 1.3485796301079829, 1.3540540924846844, 1.3598179264581474, 1.365858527605129, 1.3721613519075448, 1.3787099655615005, 1.3854861163624024, 1.3924698260916664, 1.399639503095252, 1.4069720740460312, 1.414443133706914, 1.4220271113481358, 1.4296974523120454, 1.4374268130585341, 1.4451872678638065, 1.452950525185253, 1.4606881515450012, 1.4683718006221276, 1.4759734450723727, 1.483465608408788, 1.490821594072185, 1.4980157085987484, 1.5050234755647887, 1.5118218367814733, 1.5183893370642647, 1.5247062888656593, 1.5307549131915597, 1.5365194535725115, 1.5419862604599535 ], [ 1.3137979844143017, 1.3134046985569408, 1.313204724426478, 1.3132091173165672, 1.313428884116509, 1.3138749053421865, 1.3145578476964748, 1.3154880673665765, 1.3166755045866247, 1.3181295703251519, 1.319859026282287, 1.3218718596865282, 1.324175154655129, 1.3267749621185767, 1.3296761705043088, 1.3328823795240416, 1.3363957795091608, 1.3402170387822383, 1.3443452015328774, 1.3487775985740913, 1.3535097731869072, 1.3585354240169965, 1.3638463666764857, 1.3694325153438909, 1.3752818852671909, 1.3813806166835307, 1.3877130202949755, 1.3942616440986473, 1.4010073610678684, 1.4079294769187989, 1.415005856968412, 1.42221307088613, 1.429526553955187, 1.436920783285203, 1.444369467250803, 1.451845746271637, 1.4593224028953138, 1.4667720789952727, 1.4741674977464967, 1.481481687888853, 1.488688207625413, 1.4957613653297455, 1.5026764340548764, 1.5094098566600844, 1.5159394382233677, 1.522244522321329, 1.5283061477782418, 1.5341071826563772, 1.5396324326190123, 1.5448687213653864 ] ], "zauto": true, "zmax": 1.5448687213653864, "zmin": -1.5448687213653864 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.1133457434582509, 0.10926953843949305, 0.10524130880866758, 0.10128145328557346, 0.09741190006154042, 0.09365603386735215, 0.0900385491713102, 0.08658520402075208, 0.08332244660513595, 0.08027688816703055, 0.07747460425645693, 0.07494026440119698, 0.07269611965200651, 0.07076091645533195, 0.06914884690549056, 0.06786867687780547, 0.0669231992104046, 0.06630912715668721, 0.0660174737494251, 0.06603437140417753, 0.06634220068052538, 0.06692084522687083, 0.06774888646077397, 0.068804592835299, 0.07006662621884269, 0.07151445864229758, 0.07312854768385746, 0.07489034882326986, 0.07678224835771807, 0.0787874872797155, 0.08089012351141375, 0.08307505494944926, 0.08532810439872755, 0.08763615242506775, 0.08998729593367717, 0.09237100792793178, 0.09477827580943606, 0.09720170007211551, 0.09963554092068864, 0.10207570620553302, 0.10451967948808574, 0.1069663917012497, 0.10941604360485914, 0.11186988901872226, 0.11432999065513384, 0.1167989613000795, 0.11927970315456744, 0.12177515741448762, 0.1242880747415127, 0.12682081529999886 ], [ 0.11108084262494519, 0.10690222960844982, 0.10276870611459395, 0.09870089031382001, 0.09472105755085011, 0.09085310924029351, 0.08712247371078384, 0.08355590989633264, 0.08018117925049216, 0.07702654906231851, 0.07412009510786226, 0.07148878771630073, 0.06915737671789637, 0.06714713793175223, 0.06547460062678735, 0.06415042644502603, 0.06317863325213076, 0.06255633142956328, 0.06227405881091514, 0.06231668110230566, 0.06266470515993977, 0.06329577464085813, 0.06418610602671077, 0.06531167473884276, 0.06664905014583747, 0.06817587135632656, 0.06987102665100821, 0.07171463636914555, 0.07368794349067906, 0.075773197565935, 0.07795358786925757, 0.08021325078748288, 0.08253735102934713, 0.08491221912528722, 0.08732551895608302, 0.08976641715960648, 0.09222572907684777, 0.09469602136685958, 0.09717165794345634, 0.0996487823896382, 0.10212523587315032, 0.10460041452897836, 0.10707507419908581, 0.10955109332699518, 0.11203120672798562, 0.11451872393354957, 0.11701724588544557, 0.11953039299199274, 0.1220615560539259, 0.1246136794583033 ], [ 0.10893668040934841, 0.1046623684189295, 0.10043020595964332, 0.09626091631562707, 0.09217698617392898, 0.08820267857153893, 0.08436398718350226, 0.0806885004748429, 0.07720513532641841, 0.0739436928837179, 0.07093418875839747, 0.06820592135966999, 0.0657862727440354, 0.06369929014210253, 0.06196416970092466, 0.06059384041923218, 0.05959389575904895, 0.05896210919495813, 0.058688679816233706, 0.05875720079473854, 0.059146177743659746, 0.05983080816129503, 0.06078470792384531, 0.06198133510732611, 0.06339497886347663, 0.06500130374835532, 0.0667775313004802, 0.06870238573211324, 0.07075593314072602, 0.07291941777126422, 0.07517516060502588, 0.07750654767295657, 0.07989810556130333, 0.08233564236911114, 0.08480642331998248, 0.08729934902405855, 0.08980510827180421, 0.092316283778865, 0.09482739669676743, 0.09733488283555786, 0.09983699982657568, 0.10233366965896971, 0.10482626511892504, 0.10731735168962295, 0.10981039848858033, 0.1123094728699209, 0.11481893343853163, 0.11734313545999965, 0.11988616108916698, 0.1224515846158129 ], [ 0.10692152218683579, 0.10255919727137063, 0.09823614306511382, 0.09397307766995071, 0.08979256203586726, 0.08571905670434568, 0.08177893257897814, 0.07800040353613318, 0.07441333641256406, 0.07104888179112533, 0.0679388613961016, 0.0651148521468056, 0.06260693284876305, 0.0604421163479657, 0.058642579432968994, 0.057223909737888046, 0.0561936761200139, 0.05555064552571902, 0.05528487749164828, 0.0553787353736881, 0.05580862606309925, 0.05654710942216961, 0.05756497093993612, 0.05883293015192257, 0.060322812108296146, 0.06200817071640502, 0.06386447013712664, 0.06586898478065459, 0.0680005775705021, 0.07023948061871248, 0.07256715376577294, 0.07496625042577938, 0.0774206853580821, 0.07991577775115656, 0.08243843386029659, 0.08497733315352814, 0.08752308703707395, 0.09006834690724555, 0.09260784654728284, 0.09513837161558718, 0.09765865562836713, 0.10016920727554017, 0.10267207815801141, 0.10517058318719108, 0.10766898801948843, 0.11017217905251708, 0.11268533170859292, 0.11521359200387295, 0.1177617848156987, 0.12033415994074483 ], [ 0.10504239004134765, 0.10060062384501539, 0.09619543358658336, 0.09184743205906079, 0.08757912373789434, 0.08341500238971411, 0.07938161801130689, 0.0755075821311504, 0.07182346527618177, 0.06836152295467429, 0.06515517076747054, 0.06223812327006183, 0.05964312775694205, 0.05740027850664452, 0.05553499912017247, 0.05406592103925564, 0.05300302323730233, 0.05234646006290055, 0.052086423912141806, 0.05220415696939437, 0.05267391980939847, 0.053465477010406895, 0.05454657648842667, 0.055884994563883614, 0.05744992186929034, 0.05921267723804951, 0.061146886622150995, 0.06322832884285833, 0.06543464358473851, 0.06774504905720045, 0.07014015550586142, 0.07260190553343103, 0.07511363221897834, 0.07766020292757198, 0.08022820775644107, 0.08280615243113978, 0.08538462194346552, 0.08795639007157852, 0.09051645904572812, 0.09306202189778125, 0.09559234701452482, 0.09810859004572073, 0.10061354270726092, 0.10311133130259828, 0.1056070800557306, 0.10810655564435856, 0.11061580964459974, 0.11314083495241854, 0.11568725067388544, 0.11826002758600206 ], [ 0.10330484718882921, 0.09879295972206928, 0.09431525937782033, 0.0898921691280587, 0.08554602000940568, 0.08130118413174872, 0.07718419392967779, 0.07322381986183911, 0.0694510613521701, 0.0658989835007067, 0.06260230787086779, 0.05959664728886132, 0.05691727695082107, 0.054597378783008126, 0.052665803760401246, 0.05114456974155381, 0.05004650946331078, 0.04937361224873995, 0.049116555366324505, 0.0492556527568779, 0.04976304527331787, 0.0506056033395999, 0.051747874689928634, 0.05315452130677696, 0.054791954062590825, 0.05662915007343429, 0.05863782787976528, 0.06079223164909823, 0.06306876106789759, 0.06544562001866616, 0.06790258121690426, 0.07042089863172839, 0.07298335429486517, 0.07557440140741178, 0.07818035721199824, 0.08078960132613, 0.08339274315418801, 0.08598273200765842, 0.08855489348026908, 0.09110688437764593, 0.09363856575045597, 0.09615179937029245, 0.09865017750573632, 0.10113869928129551, 0.10362340934215794, 0.10611101603056265, 0.1086085067803588, 0.11112277792451068, 0.11366029459593223, 0.11622679397161412 ], [ 0.10171281514945532, 0.09714069319226905, 0.09260078637931285, 0.08811326285637906, 0.08370018314429263, 0.07938566103873457, 0.07519602808433319, 0.0711599787158682, 0.06730865459379724, 0.06367560066745398, 0.06029649339430895, 0.057208509830692596, 0.05444919051275572, 0.05205467607965153, 0.05005730074986354, 0.048482724337806316, 0.04734704760439041, 0.04665457411911036, 0.04639689622638411, 0.046553693086011746, 0.04709511330768538, 0.04798512238935551, 0.04918497584012459, 0.05065610306005182, 0.05236202651974476, 0.054269297673965884, 0.05634766990596719, 0.058569817049988634, 0.06091088047527149, 0.06334804540290308, 0.065860254610605, 0.06842809155083295, 0.07103381452887667, 0.07366149762339759, 0.07629722637670784, 0.07892930001134041, 0.081548401306553, 0.0841477063783302, 0.08672291722454364, 0.08927220904110006, 0.09179609176665672, 0.09429719122760613, 0.09677995989393501, 0.09925033084240338, 0.10171533117301326, 0.10418267285006293, 0.10666033968141221, 0.10915618883606606, 0.11167758389883582, 0.11423107402758098 ], [ 0.1002684384336929, 0.09564631524994954, 0.09105494145933642, 0.08651418649213043, 0.08204576687914342, 0.07767342625989623, 0.07342313553971463, 0.06932329643513381, 0.06540491303802014, 0.06170166778242974, 0.058249799697786334, 0.05508763831098745, 0.05225461039847757, 0.04978953917168023, 0.04772814182522674, 0.04609984302461899, 0.04492434897022451, 0.04420875347137196, 0.04394605930659028, 0.044115714190840316, 0.044686127382313645, 0.04561846653163508, 0.046870700080926614, 0.04840097832888033, 0.05016987338073022, 0.05214145224541973, 0.054283454212798746, 0.056566945135450034, 0.05896578194869519, 0.061456116958424734, 0.06401606086957237, 0.06662553631989807, 0.0692662983982233, 0.07192207172629468, 0.07457874701484296, 0.07722458526934135, 0.07985038857286482, 0.08244960845277283, 0.08501837402704872, 0.08755543155682058, 0.0900619946164585, 0.09254151009478477, 0.0949993499974346, 0.09744244279012526, 0.09987886092831251, 0.10231738325059493, 0.10476705197179643, 0.1072367439714797, 0.10973477485064936, 0.11226855183758204 ], [ 0.09897200999122287, 0.09431021642988757, 0.0896782711257051, 0.08509572095049008, 0.08058388915084444, 0.07616606531247336, 0.07186773032792687, 0.06771680643972361, 0.06374390479271773, 0.05998251402286064, 0.056469030608329876, 0.05324247632780639, 0.05034369174052365, 0.04781376772183714, 0.04569153477307488, 0.04401013733266091, 0.04279309943074362, 0.042050732854644834, 0.041777984280254574, 0.04195457968136552, 0.04254758240116541, 0.04351561041818582, 0.044813468981729006, 0.04639606868612181, 0.048221021746312834, 0.05024987618585073, 0.05244831221799127, 0.05478574173033564, 0.057234697043738736, 0.059770268006638955, 0.06236971714434302, 0.06501230437257625, 0.06767929293407685, 0.07035408063218239, 0.07302239480559562, 0.07567249618063862, 0.07829534867879513, 0.08088472511055539, 0.08343723028324139, 0.08595223264928839, 0.08843170326637576, 0.09087996689798505, 0.09330337495740142, 0.0957099139814137, 0.09810876653611193, 0.10050984387021152, 0.10292331109301091, 0.10535912597605802, 0.10782661151068942, 0.11033408005652887 ], [ 0.09782196748457092, 0.09313066844987332, 0.08846890143999413, 0.08385588331280684, 0.07931251620461173, 0.07486157880027389, 0.07052796513098872, 0.06633896792727066, 0.062324587665367824, 0.05851782031489036, 0.054954831972230174, 0.05167486523945321, 0.04871964783472723, 0.04613201656849253, 0.043953489878943326, 0.04222070686811428, 0.04096106096203908, 0.04018841485506149, 0.03990019083015865, 0.04007698762521244, 0.040685053652304626, 0.0416808540509205, 0.04301628234918135, 0.04464313940068844, 0.04651611976142856, 0.048594237764504125, 0.05084106765863058, 0.05322430748899296, 0.05571510633764248, 0.05828744375186022, 0.06091770216254526, 0.06358446427657706, 0.06626850333172957, 0.0689529059086094, 0.07162326225377132, 0.07426786691700814, 0.07687788534265608, 0.07944745542741226, 0.08197370486968765, 0.08445667477530429, 0.0868991476157069, 0.08930638371689625, 0.09168577545409956, 0.09404643255890027, 0.09639871553446695, 0.09875373705432478, 0.10112285318610348, 0.10351716707100271, 0.10594706707154271, 0.1084218192625946 ], [ 0.09681496576579021, 0.0921038987833455, 0.08742261125279116, 0.08278999330918352, 0.07822651416626501, 0.07375440723960829, 0.06939791278520464, 0.06518358171517855, 0.06114063058989782, 0.057301311519460385, 0.053701215916959, 0.050379363013969, 0.047377835615934505, 0.044740639944564564, 0.04251144449333669, 0.04072999859621466, 0.039427446271793676, 0.038621403804041214, 0.03831225271489733, 0.03848210263345179, 0.03909702733205538, 0.04011186774328417, 0.04147597381681602, 0.04313824813586337, 0.04505055322611472, 0.04716936778534051, 0.049456106321668004, 0.05187667663609813, 0.054400766909725985, 0.05700118107252361, 0.05965337536214617, 0.06233523014406668, 0.06502702290539421, 0.06771153936202623, 0.07037425539515652, 0.07300353110858844, 0.07559077164294112, 0.07813052297414892, 0.08062048274373412, 0.08306141571824974, 0.08545697102168487, 0.08781340436396436, 0.09013921361553666, 0.09244470059764835, 0.09474147598978298, 0.09704192769992029, 0.0993586756318181, 0.10170403716442822, 0.10408952750118233, 0.1065254171467687 ], [ 0.09594602521827401, 0.09122425885874329, 0.08653302124970978, 0.08189088323933369, 0.07731787827812156, 0.07283567558568048, 0.0684678184450076, 0.06424003732855713, 0.06018063632083329, 0.05632092756667843, 0.05269564527442938, 0.0493432010094927, 0.046305543984553076, 0.04362728079135849, 0.04135364562615631, 0.039527008010295524, 0.038181998146169016, 0.03734004642651474, 0.03700488710374725, 0.037160766434319314, 0.03777427852725361, 0.038799255269668924, 0.04018295348439117, 0.04187164603464105, 0.04381447671433759, 0.045965391134372514, 0.048283581074745154, 0.050733073012859634, 0.05328200180638014, 0.055901918266767193, 0.0585672974804296, 0.06125528651186695, 0.0639456578593119, 0.06662090485182905, 0.06926641089269599, 0.07187063319921809, 0.0744252550900214, 0.07692527435552221, 0.07936900686158471, 0.08175799386832402, 0.08409680893896676, 0.08639276636439461, 0.08865553829474396, 0.09089669261917184, 0.09312916818665339, 0.09536670808030229, 0.09762327500622416, 0.0999124749788452, 0.1022470159231754, 0.1046382262478911 ], [ 0.0952087495717489, 0.09048447852974326, 0.08579189056142093, 0.0811492424556714, 0.07657613088228178, 0.07209364963756706, 0.06772461768176082, 0.06349389302861663, 0.05942877871112388, 0.05555950612459305, 0.05191974040945769, 0.048546983238952235, 0.04548264487808651, 0.04277143016933157, 0.04045958245354457, 0.03859157106818187, 0.03720515795284669, 0.03632552320235667, 0.035960030552112825, 0.036095616644010994, 0.036700072544619565, 0.037726853769540755, 0.039121601886267975, 0.04082824819362038, 0.04279333763161677, 0.04496828181460549, 0.047309978766636805, 0.04978047437825937, 0.052346251808227995, 0.05497752815319691, 0.057647741759625684, 0.060333276487917954, 0.0630133925889215, 0.06567030181561036, 0.06828931933120694, 0.07085903326439119, 0.07337144574524843, 0.07582205230875644, 0.07820983775601907, 0.08053717555597813, 0.08280962504430238, 0.08503562667118357, 0.0872261009608106, 0.08939396206723274, 0.09155356196540636, 0.09372008623616217, 0.09590892667286956, 0.09813505897579286, 0.10041245500008017, 0.10275355790851355 ], [ 0.09459560120999996, 0.08987599193190589, 0.08518950249767919, 0.0805540736711766, 0.07598886032290376, 0.07151437064864145, 0.06715268047030816, 0.06292774238415438, 0.05886580293383781, 0.05499592287047215, 0.05135055792439981, 0.047966090154668774, 0.04488309418361353, 0.04214598286041857, 0.039801545056571054, 0.03789587651862173, 0.036469497341441545, 0.03555118898990532, 0.035152099748692885, 0.035262289230375235, 0.035851328246134795, 0.036872867254282286, 0.0382713726902081, 0.03998869812102407, 0.04196889313977414, 0.044160824497091106, 0.0465190215826552, 0.04900345198937235, 0.05157885438742357, 0.05421403952426439, 0.05688136224313322, 0.05955642186755504, 0.06221796679023648, 0.0648479444460147, 0.06743163124830504, 0.06995778427959126, 0.07241876864059452, 0.07481062668596765, 0.07713306598075717, 0.07938935135318896, 0.08158609330923997, 0.08373293098160163, 0.08584211334121943, 0.08792798803120473, 0.0900064130251452, 0.09209411217160625, 0.0942080010632624, 0.09636451383873043, 0.09857896368986145, 0.10086496933290492 ], [ 0.0940982176191798, 0.08938931393321287, 0.08471511292715943, 0.0800932273478598, 0.07554235777553374, 0.07108241346777319, 0.06673471180911876, 0.06252228028596751, 0.05847028034616013, 0.05460655700583259, 0.05096228347334937, 0.047572605345015756, 0.04447708301378091, 0.04171958290463101, 0.0393471112787867, 0.03740702342005513, 0.03594226997555478, 0.03498505150501888, 0.03455034863556069, 0.034631627047451825, 0.03520066632227702, 0.03621175186316089, 0.03760851687632276, 0.03933093587258949, 0.041320629970754225, 0.043523896069096644, 0.04589282207617387, 0.04838521174881034, 0.0509639837292805, 0.05359648835046382, 0.05625396765642997, 0.058911230184182095, 0.061546525108630935, 0.06414156231101925, 0.06668161609122382, 0.06915565583038322, 0.0715564577718925, 0.07388066343143705, 0.07612875999769343, 0.07830496607409412, 0.0804170126500128, 0.08247581496604543, 0.0844950366240642, 0.08649055336172505, 0.08847983052733512, 0.0904812352446985, 0.09251331096101914, 0.09459404763103074, 0.09674018417347882, 0.09896658011037784 ], [ 0.09370775001757967, 0.08901444290209566, 0.08435743013236971, 0.07975397404848096, 0.07522230028142236, 0.07078170146914381, 0.06645272288491279, 0.06225745761087678, 0.05821997610592432, 0.054366901850515056, 0.050728112988380966, 0.047337487968238966, 0.04423350823394662, 0.041459377644632915, 0.03906214158102162, 0.0370901841794608, 0.0355886468531837, 0.03459297479995652, 0.03412194576009551, 0.03417255999223222, 0.03471904900216783, 0.03571659702393893, 0.03710820642611458, 0.038832078233210214, 0.040827422583444656, 0.04303792663599884, 0.045413172368183104, 0.047908735622184354, 0.050485666108014776, 0.05310982623867021, 0.05575133949341823, 0.05838423661706765, 0.06098629500414967, 0.06353902454724498, 0.06602774159828698, 0.06844167624020953, 0.07077406739164904, 0.0730222104424189, 0.0751874310875696, 0.07727496637194872, 0.07929374006836369, 0.08125602509815213, 0.08317699148465102, 0.0850741448480314, 0.08696666792115106, 0.0888746857827341, 0.09081848379075536, 0.09281771446557317, 0.09489063449157056, 0.09705341431139597 ], [ 0.09341520460703456, 0.08874126480508533, 0.08410509412778434, 0.07952357364068093, 0.07501442708379058, 0.07059631009477844, 0.0662889848682666, 0.06211361123008629, 0.05809318383497303, 0.05425313402175797, 0.050622085570336685, 0.047232694290927565, 0.04412239776997401, 0.041333744610081186, 0.038913779752067286, 0.03691181984451329, 0.0353750561977857, 0.034342033530984445, 0.033835230844707825, 0.03385516915969612, 0.03437858691277166, 0.035361642812433376, 0.03674675799049435, 0.03847036436259777, 0.04046922796630427, 0.04268437540868228, 0.04506283318581607, 0.04755791339892203, 0.05012878029240006, 0.052739811545089145, 0.05536003233159048, 0.05796272893337426, 0.06052524920164731, 0.06302895062635355, 0.06545924199915008, 0.06780566592379547, 0.07006197704977593, 0.07222617979601487, 0.07430049732906839, 0.07629125017485563, 0.07820862844098678, 0.08006634693835356, 0.08188117830527501, 0.08367236619104448, 0.08546092895245229, 0.087268873978377, 0.08911835292703929, 0.09103079752073934, 0.0930260824007911, 0.09512176419692368 ], [ 0.09321176820249051, 0.08855993556082803, 0.08394712620307597, 0.0793898042474748, 0.07490516212463054, 0.07051119908307678, 0.06622688915442933, 0.06207247255873907, 0.05806990449982937, 0.054243485756890704, 0.05062067223988372, 0.0472330035887803, 0.04411698859033576, 0.04131462544555331, 0.0388730287811805, 0.03684245935333612, 0.035272099765473484, 0.034203476536953846, 0.03366262541343145, 0.033653451693013016, 0.03415508807430943, 0.03512457310075849, 0.03650365899620543, 0.03822692563018101, 0.04022862341869132, 0.04244706661277986, 0.044826698759964936, 0.0473185650654121, 0.04987996217591757, 0.05247381710047176, 0.05506810188442052, 0.057635410056157, 0.06015271450453375, 0.06260127519909456, 0.06496664713469101, 0.0672387377896991, 0.0694118692549196, 0.07148480774832455, 0.07346073019574985, 0.07534710336140843, 0.07715545599457423, 0.07890102938275873, 0.08060229744949644, 0.08228035487603344, 0.08395818109964127, 0.08565979933959161, 0.08740936220293219, 0.08923020735083906, 0.09114393601477638, 0.09316957156286011 ], [ 0.09308910285813574, 0.08846122256060374, 0.08387332499986376, 0.079341421564009, 0.07488214632193535, 0.07051282843165672, 0.06625165865315456, 0.06211798657834774, 0.05813278611391022, 0.05431931847110298, 0.050703996290076186, 0.0473173972211491, 0.04419527402007431, 0.04137924609335608, 0.03891663971320098, 0.03685873893701666, 0.035256706208949995, 0.034154938342068605, 0.03358283315701769, 0.033547439105897574, 0.03403003489901049, 0.03498831261738235, 0.03636316891513302, 0.03808719429218346, 0.040092038450478616, 0.042313266683991616, 0.04469274286412084, 0.047179277815185244, 0.04972835212178072, 0.05230150416673512, 0.054865718991403925, 0.05739296311378909, 0.05985989702875778, 0.062247741174118104, 0.06454224991817614, 0.06673374474331625, 0.06881716195788141, 0.07079207650113233, 0.07266266930200825, 0.0744376105638632, 0.07612983559141556, 0.07775619416292465, 0.07933695998506926, 0.08089519440248731, 0.0824559689037928, 0.08404546409577299, 0.08568997785248665, 0.08741489042426852, 0.08924364670302064, 0.09119682255682428 ], [ 0.09303959796711761, 0.0884367915148282, 0.08387459257036471, 0.07936852886854125, 0.07493465643610113, 0.07058963103346406, 0.06635087893955761, 0.062236905895377226, 0.058267784605722926, 0.054465853810386634, 0.05085663749119141, 0.047469938810956035, 0.04434096282592884, 0.041511157660711714, 0.03902823592854541, 0.03694460744486129, 0.035313407065467, 0.03418176393221073, 0.03358218003039346, 0.03352451258954426, 0.033991836370272976, 0.03494218724954726, 0.03631537234987294, 0.038041846724455375, 0.04005059474248463, 0.042274432644023176, 0.04465268905259234, 0.0471320112106732, 0.04966614665569223, 0.052215330490676566, 0.05474564218333505, 0.05722849527289711, 0.059640302991133085, 0.06196230237323439, 0.064180495218691, 0.06628565876115168, 0.06827338146262625, 0.07014408429837636, 0.07190299270425358, 0.07356002829104794, 0.07512959278962404, 0.07663022034884184, 0.07808407942697759, 0.07951631328951506, 0.08095421946455689, 0.08242628365473838, 0.08396110172926087, 0.08558624235528055, 0.08732711917240925, 0.08920595115767757 ], [ 0.09305657256399731, 0.08847943044339256, 0.08394318138010072, 0.07946284800744326, 0.07505390047358382, 0.07073233220501067, 0.06651484069436822, 0.06241915383097433, 0.058464544240941364, 0.05467256724872838, 0.05106803439513214, 0.04768018137767921, 0.04454388909445294, 0.04170064996857951, 0.0391987349080637, 0.03709176369023607, 0.03543479716321507, 0.034277495835374545, 0.033655124555336306, 0.03357992589256311, 0.03403634900870537, 0.03498242948086312, 0.03635665959606428, 0.038087254937374804, 0.04010052864952664, 0.04232660819587554, 0.044702384058139255, 0.04717245173013092, 0.04968893765275361, 0.05221087711195986, 0.05470353462823265, 0.0571378470110654, 0.05949004232707447, 0.06174142348006625, 0.06387827819356383, 0.06589186977916124, 0.06777846416472862, 0.06953935238488969, 0.07118083143355027, 0.07271410923761397, 0.07415510181368302, 0.07552409336287572, 0.07684523449371904, 0.07814586143991763, 0.07945563135005228, 0.08080548604925877, 0.08222647839177205, 0.08374851896698918, 0.08539912225030535, 0.0872022450118977 ], [ 0.09313442465867866, 0.08858320794783747, 0.08407286008539523, 0.07961789044733433, 0.07523319080237337, 0.07093412050354592, 0.066736702590981, 0.06265797245921188, 0.058716522764539654, 0.0549332815760976, 0.051332537462481294, 0.047943172607467145, 0.044799964883042685, 0.041944651237036744, 0.03942620040210766, 0.03729947272554257, 0.03562133150443178, 0.03444366999000605, 0.033804069264075705, 0.03371664453107951, 0.034166751076447816, 0.03511209081969485, 0.036489677802216215, 0.03822547514658463, 0.04024321458735063, 0.04247047850365176, 0.044841880136231034, 0.047300118809908705, 0.04979583844748429, 0.05228699132853338, 0.054738121270125124, 0.057119761344806314, 0.05940800855958203, 0.061584269753658875, 0.0636351436954366, 0.06555239525548001, 0.06733297728314482, 0.06897905837306037, 0.07049801727446721, 0.07190236637710001, 0.07320956775835429, 0.07444170672269543, 0.07562499117480634, 0.07678905242211001, 0.07796603589235099, 0.07918948985183437, 0.08049308605867057, 0.08190923564273876, 0.08346769113195153, 0.08519424449134583 ], [ 0.09326872796562923, 0.08874356735204178, 0.084259001460289, 0.07982903431449971, 0.07546800443930808, 0.07119068410817836, 0.06701249530974339, 0.062949884599738, 0.0590209008193555, 0.05524601282871712, 0.051649181048636215, 0.0482591440210162, 0.045110780672836664, 0.0422462384563018, 0.03971526734934938, 0.03757391692890989, 0.03588062119187807, 0.03468908104523401, 0.03403862338572231, 0.033944634215691785, 0.03439288213633842, 0.03534045206435941, 0.03672282395457249, 0.038463827759634875, 0.040484829841607034, 0.04271111322951012, 0.04507524739526189, 0.04751823683038275, 0.049989406208276736, 0.052445751155475874, 0.05485118829584081, 0.057175912529576094, 0.059395932238109586, 0.06149278192922492, 0.06345338049598777, 0.06526999262658718, 0.06694024940184938, 0.06846718553600975, 0.0698592521191494, 0.07113026410807491, 0.07229924139926538, 0.07339010219337934, 0.07443116933238647, 0.07545445668511722, 0.07649471591012975, 0.07758824580851603, 0.0787714969940815, 0.08007954083614419, 0.0815445071764493, 0.08319412110643898 ], [ 0.09345627911857102, 0.08895736159308631, 0.08449859975989678, 0.08009351788258984, 0.07575594508422205, 0.07150013257058647, 0.06734099299635728, 0.06329450399779821, 0.05937831924472131, 0.05561262302448495, 0.05202124053596137, 0.048632962996181354, 0.045482945356466485, 0.042613862190690036, 0.040076253480265285, 0.03792720303877651, 0.03622635271754437, 0.035028640000632924, 0.03437443383751973, 0.034279706141899, 0.034730143836726714, 0.03568201430031775, 0.03706934936765247, 0.03881412578014062, 0.04083570624117537, 0.0430574331799176, 0.045410142950155975, 0.04783339285584393, 0.05027537464660103, 0.0526922606556819, 0.055047430434004986, 0.05731079648021282, 0.05945830739477789, 0.06147163327805834, 0.06333800504764896, 0.06505016727661724, 0.06660640143652583, 0.06801057670683101, 0.06927218570573782, 0.07040632147832387, 0.07143354998059252, 0.07237963025282122, 0.07327503452471514, 0.07415422547670517, 0.07505466102793311, 0.07601552105376974, 0.07707618610288929, 0.07827454256430544, 0.07964523414408452, 0.0812180141821024 ], [ 0.09369510029961158, 0.08922283583436734, 0.08479022710248002, 0.08041036236659511, 0.0760966237884147, 0.07186282566822536, 0.0677234795724638, 0.06369422754420426, 0.059792485161219946, 0.05603832799368869, 0.0524556302190555, 0.04907341001459946, 0.04592723382721731, 0.04306035808862046, 0.04052403238007935, 0.038376100807431125, 0.036676905990131334, 0.035481898635070556, 0.03483165777711234, 0.03474199081646813, 0.035198031035641945, 0.0361551355930363, 0.03754613472598634, 0.03929160337659268, 0.041309412481704534, 0.04352143644228574, 0.045857165445378746, 0.04825500216986047, 0.05066221348669816, 0.05303428777322779, 0.05533415361571608, 0.05753148688884487, 0.05960219185282673, 0.061528066805447285, 0.06329663008581785, 0.06490106873826619, 0.066340268185714, 0.06761888036511025, 0.06874738670866816, 0.06974210982021611, 0.07062512370633393, 0.07142400809672392, 0.07217138998276428, 0.07290421840665409, 0.07366273092956753, 0.07448909605994244, 0.0754257571078301, 0.07651355681075735, 0.07778977960555306, 0.07928629450820365 ], [ 0.09398440321737787, 0.08953956578394798, 0.0851339393719238, 0.08078023755837598, 0.07649147536027022, 0.0722811305411061, 0.0681634355845384, 0.06415383999103044, 0.060269682080601274, 0.05653110000619276, 0.05296218540070307, 0.04959232727816125, 0.04645758971544429, 0.04360179283301163, 0.04107671523327268, 0.03894056023670393, 0.037253719186294484, 0.03607129201440287, 0.03543313291974486, 0.03535410167902072, 0.03581835770767716, 0.036780377774906066, 0.038172196657232975, 0.03991359961709285, 0.04192161471827696, 0.044117223869737494, 0.04642902736325976, 0.04879460727156098, 0.051160534429772905, 0.05348175926662414, 0.05572084314690802, 0.057847263295018006, 0.059836884154437525, 0.06167161213597146, 0.06333921454724085, 0.06483326855938211, 0.06615320079583348, 0.06730437599894015, 0.06829819084576487, 0.06915212484934459, 0.06988969422270255, 0.07054024764257615, 0.07113853744209477, 0.07172399983585138, 0.0723396886093035, 0.0730308338123945, 0.07384304385583024, 0.0748202340925584, 0.07600243710941929, 0.07742371046899171 ], [ 0.09432452068541053, 0.08990835986338129, 0.08553114204394313, 0.08120528333852031, 0.07694352652864923, 0.07275912641532298, 0.0686661683678421, 0.06468005744809152, 0.06081821367117309, 0.057100997798764944, 0.05355286374398951, 0.050203675638676754, 0.047090021833030966, 0.04425618509170527, 0.041754185270619144, 0.03964205759361475, 0.03797946028979605, 0.036820171485164886, 0.036202330964964204, 0.03613908360849502, 0.036613276426827095, 0.037578659130572345, 0.038967013407339025, 0.040698073795920005, 0.04268877988081578, 0.04485987692914535, 0.04713958790371211, 0.04946504430845098, 0.05178237014392617, 0.05404613301850206, 0.05621861238348038, 0.058269121558529015, 0.06017348355197567, 0.061913684866276, 0.06347769408917067, 0.06485941563493929, 0.06605874232350539, 0.06708166705462021, 0.06794041009210615, 0.06865351268627608, 0.06924583951320697, 0.06974842257916604, 0.07019807031692456, 0.07063666206222918, 0.07111005640061843, 0.0716665694167152, 0.07235503126448263, 0.07322250607516834, 0.0743118495431544, 0.07565935686242271 ], [ 0.09471681186776405, 0.09033113295577214, 0.08598442560409626, 0.08168889894723994, 0.07745713021664875, 0.07330227395178415, 0.06923840541215624, 0.06528103250404943, 0.061447807066643795, 0.05775945308489948, 0.05424089853549811, 0.050922536939637095, 0.04784143759031697, 0.04504215383303084, 0.042576550671731626, 0.04050185449844123, 0.038876112646681636, 0.03775075991941226, 0.03716124646289654, 0.037118309970068666, 0.03760325448837023, 0.038569364742877525, 0.03994880323436756, 0.04166206524650825, 0.04362681445614094, 0.045764262757989504, 0.048002806194145486, 0.05027952434615014, 0.052540363684706, 0.054739677050608136, 0.05683955465507062, 0.058809184014106015, 0.06062434566911889, 0.06226707683624745, 0.06372549677926166, 0.06499376974877069, 0.06607217316565936, 0.06696723393349754, 0.06769189064282677, 0.0682656319863295, 0.06871455121838092, 0.06907124359752483, 0.06937446090294101, 0.06966842923169325, 0.0700017410359006, 0.07042575928404726, 0.070992529024323, 0.07175228085857432, 0.07275071970686087, 0.07402639191596948 ], [ 0.09516354676596889, 0.09081075872305172, 0.0864973791872417, 0.0822355105162481, 0.07803767854180321, 0.07391706421141166, 0.06988786860411882, 0.06596584174672117, 0.06216900022508066, 0.058518542810382115, 0.05503993955295768, 0.05176410654209551, 0.04872847118558894, 0.04597757022410701, 0.043562616998428796, 0.04153930216456502, 0.0399631410243957, 0.03888222794853082, 0.03832844296316678, 0.03830955861362501, 0.03880522993334438, 0.039768618092938086, 0.041132932362393654, 0.04282024585263996, 0.04474976002739639, 0.046843864313325934, 0.049031693314100504, 0.05125069232656136, 0.05344691877400053, 0.05557469583294673, 0.05759603119279859, 0.05948003573848458, 0.06120245503100629, 0.06274535403147942, 0.06409695662682015, 0.06525162212453675, 0.06620993119825243, 0.06697884757696067, 0.06757191527722246, 0.06800944212242344, 0.06831860761515884, 0.06853341722933469, 0.06869440817154679, 0.06884799885589582, 0.06904537457843547, 0.06934082700036051, 0.06978952653375403, 0.0704448087075492, 0.07135518579028928, 0.07256141918059886 ], [ 0.09566777488983398, 0.09135090663049869, 0.08707438997543755, 0.08285032603444815, 0.07869130564299273, 0.07461066064983514, 0.07062284561876359, 0.06674397563062276, 0.0629925382083436, 0.05939027884762704, 0.05596322287701818, 0.05274273103180588, 0.04976638053333829, 0.04707831236798813, 0.044728509994872614, 0.04277035747675427, 0.041255940427664305, 0.04022912239196429, 0.0397175042329071, 0.039725516198869985, 0.040231184769298524, 0.041187929406167084, 0.04253064107957315, 0.0441837257680886, 0.046068679574100366, 0.04810974619290671, 0.05023735393233064, 0.05238973830356792, 0.05451337249713783, 0.05656275508217844, 0.0584999380383831, 0.06029402336867907, 0.0619207456393794, 0.06336218895961107, 0.06460664808922921, 0.06564862275374406, 0.06648892309105442, 0.06713485658579618, 0.06760045902496596, 0.06790672143790197, 0.06808175024816855, 0.06816077887730376, 0.06818592783964031, 0.06820559233870058, 0.06827333137669084, 0.06844615455694109, 0.0687821670874886, 0.06933764758518576, 0.07016378553781044, 0.07130345636403382 ], [ 0.09623318241506135, 0.09195586899901748, 0.08772043489724062, 0.08353908577966201, 0.07942459022095893, 0.07539054640613219, 0.07145177387139347, 0.06762485039021439, 0.0639288040439168, 0.06038594915286822, 0.05702281531982838, 0.05387105263847209, 0.0509680951771412, 0.048357230517741163, 0.04608658476649688, 0.04420647466857658, 0.042764753661953536, 0.0418003453980858, 0.041336090681017235, 0.04137290390862642, 0.04188731630189431, 0.04283338715890993, 0.044148238778166066, 0.045759246954679256, 0.047590852961691514, 0.04956975909580215, 0.051628206419314544, 0.05370563747019636, 0.05574925647459109, 0.05771396247809158, 0.05956200238965857, 0.061262561381778775, 0.0627914101528909, 0.06413066467870761, 0.06526867610140806, 0.06620004695575947, 0.06692575747188471, 0.067453376823722, 0.06779732512387648, 0.06797914001875784, 0.06802768516229855, 0.06797921614679535, 0.06787719433813602, 0.06777171588316334, 0.06771841259274586, 0.06777669972224219, 0.06800731142615511, 0.0684691893771286, 0.06921596359508524, 0.07029244306637933 ], [ 0.09686394157084699, 0.09263038270715263, 0.0884408703426235, 0.08430781531766425, 0.08024426670031506, 0.07626418820596106, 0.07238285163705113, 0.06861736113567757, 0.06498730954703942, 0.06151554424725912, 0.05822897852786858, 0.055159319496580234, 0.0523434907085552, 0.04982341524322315, 0.04764472813798024, 0.045853987072667135, 0.04449417016261645, 0.043598785713454546, 0.0431856869002748, 0.043252297127897056, 0.04377387233307232, 0.04470545821774491, 0.04598683663567977, 0.04754883656021799, 0.04931935499378532, 0.05122805518709854, 0.05320945062815305, 0.05520458396805859, 0.05716170693611118, 0.05903636036152272, 0.060791160624903924, 0.062395494981823806, 0.063825244518311, 0.06506259582839118, 0.06609596625766254, 0.0669200457918445, 0.06753594517984375, 0.06795142985670329, 0.0681812090386725, 0.06824723621236291, 0.06817895910638143, 0.06801343324079293, 0.06779518461391451, 0.06757567926043595, 0.0674122415108913, 0.06736627683840227, 0.06750072100860768, 0.06787677032517674, 0.06855014005904872, 0.06956730235825313 ], [ 0.09756455556680184, 0.09337944961759352, 0.0892412249452413, 0.08516258739367998, 0.08115695302906026, 0.07723872716872053, 0.07342368969544436, 0.06972949359522014, 0.06617626893716416, 0.06278729858773277, 0.059589690187212885, 0.056614907303235894, 0.053898941800744615, 0.05148182268785909, 0.049406102278259444, 0.047714010329026176, 0.04644321086260166, 0.04562157585787706, 0.04526198757602456, 0.04535857218959666, 0.045885584573965, 0.046799345001777196, 0.04804258733595074, 0.049549911603768364, 0.05125302661738985, 0.05308493941904196, 0.05498281818347639, 0.05688965929651725, 0.058755067800777806, 0.06053547613972289, 0.062194064505501925, 0.06370056661364401, 0.0650310757589883, 0.06616791551682001, 0.06709960581727722, 0.06782093365193258, 0.06833312351996756, 0.06864409175712023, 0.06876875773046409, 0.0687293707253587, 0.06855579198512524, 0.06828564560835433, 0.06796422083607177, 0.0676439767214758, 0.06738347976542501, 0.06724561512334916, 0.0672949768445626, 0.06759448121399264, 0.0682014539179103, 0.06916366708409952 ], [ 0.09833970207311582, 0.09420815939977176, 0.09012699994856772, 0.08610929833180954, 0.0821689021680438, 0.07832070544038752, 0.07458101480618183, 0.07096800872608766, 0.06750227278648993, 0.06420736763143096, 0.06111034537274171, 0.058242074885282165, 0.05563717049859174, 0.053333259324039754, 0.0513693071208555, 0.0497828094030905, 0.048605900540775335, 0.047860838320121904, 0.04755575807120061, 0.047681806882664365, 0.048212535062325805, 0.049105756475946616, 0.05030731869930293, 0.051755754093035886, 0.05338678844176581, 0.05513703131185979, 0.05694659967641848, 0.05876074455485925, 0.060530706717844183, 0.06221405805047736, 0.06377474888571168, 0.0651830239313689, 0.06641531473981632, 0.06745417390048794, 0.06828828585182846, 0.06891256865289655, 0.06932836666069275, 0.06954372241787728, 0.06957370411756889, 0.06944075006364382, 0.0691749712989117, 0.06881432666018512, 0.06840455165876, 0.06799868861635504, 0.06765604195821993, 0.06744038944140093, 0.06741734337910728, 0.06765089694557203, 0.0681994057522781, 0.06911149414160465 ], [ 0.09919407809663848, 0.0951215181292909, 0.09110348120771104, 0.08715346382758958, 0.08328578317022678, 0.07951583573295083, 0.0758604333511273, 0.07233820961888898, 0.06897007213737248, 0.0657796492472801, 0.06279364244212081, 0.060041948700351386, 0.057557367950710085, 0.05537467830234864, 0.0535288784755781, 0.052052505364042496, 0.05097216345679788, 0.05030472481215232, 0.050053955766679564, 0.05020841818874966, 0.05074125009933981, 0.05161190896073063, 0.05276940539021852, 0.0541562319208254, 0.055712202783975685, 0.05737767151818138, 0.05909590709916175, 0.06081465441119157, 0.06248703742035264, 0.06407200170774699, 0.06553447587046274, 0.06684539193920147, 0.06798166338949378, 0.06892618432445187, 0.06966788697769903, 0.07020187558000418, 0.07052964041593186, 0.07065934386685961, 0.0706061577344713, 0.07039261562969244, 0.07004892345301611, 0.06961314356480418, 0.06913113474820579, 0.06865609517656748, 0.06824753071726031, 0.06796947602880145, 0.06788785746607945, 0.0680670271228389, 0.06856571410305719, 0.06943288322569759 ], [ 0.10013224901723758, 0.09612428582193017, 0.09217556642835055, 0.08830003820684798, 0.08451249636078514, 0.0808288185497642, 0.07726625975733503, 0.07384379423876064, 0.07058247359004144, 0.06750574471740897, 0.06463963883215892, 0.06201270576989971, 0.05965553604616943, 0.057599703844914515, 0.05587600383020452, 0.05451196999492988, 0.0535288628123531, 0.05293855214257449, 0.052740909991492724, 0.05292233853058768, 0.05345583296708262, 0.054302582823267484, 0.05541472350652102, 0.05673863208408437, 0.058218174104120564, 0.05979748625203855, 0.06142310625040652, 0.06304544668079227, 0.06461971858112385, 0.06610645119654161, 0.06747175043789262, 0.06868741377597723, 0.0697309890859985, 0.07058583730952746, 0.0712412364356198, 0.07169254704358538, 0.07194144598102561, 0.07199622262044761, 0.07187211930117383, 0.07159168174049577, 0.07118506430413678, 0.07069020773721006, 0.07015277389846698, 0.06962568779189421, 0.06916811285335638, 0.0688436904387171, 0.06871793442172087, 0.06885480849959214, 0.06931272532004835, 0.07014044582518317 ], [ 0.10115850452087172, 0.0972208258578964, 0.09334761076375217, 0.08955326030570948, 0.08585302553519622, 0.0822632092639473, 0.07880141021561936, 0.07548679137118605, 0.07234033725386796, 0.06938504238000757, 0.06664594652913146, 0.06414990640299909, 0.06192497709581269, 0.05999928579908459, 0.05839933292337127, 0.05714776583009857, 0.056260830953102865, 0.0557458798893609, 0.05559941006692786, 0.055806086700418596, 0.05633899817047617, 0.0571611041353342, 0.058227564449192824, 0.059488492119487556, 0.060891685745870464, 0.0623850214626309, 0.06391834581623887, 0.06544484880953491, 0.06692198402466432, 0.0683120416740091, 0.06958248504152735, 0.07070614681159085, 0.07166136090166066, 0.07243208433952286, 0.07300804534584245, 0.07338493858903386, 0.07356467574731872, 0.07355568754732196, 0.0733732605155003, 0.07303987580636251, 0.07258549682890036, 0.07204772587751715, 0.07147171836721765, 0.0709097111211248, 0.07041999911543657, 0.07006520143601508, 0.06990971573036894, 0.07001639092642342, 0.07044264803883236, 0.07123650443188213 ], [ 0.10227672414203359, 0.09841496902731406, 0.09462329335311244, 0.09091652811556297, 0.08731032838866079, 0.08382133453927117, 0.08046735823227197, 0.07726757155282939, 0.07424266209847499, 0.0714148980675576, 0.06880802750839986, 0.06644692007620322, 0.06435685651167959, 0.06256239230088734, 0.06108577898548751, 0.059945023116193624, 0.05915178529300244, 0.05870943354101715, 0.05861161476467854, 0.058841653729270124, 0.05937293029909829, 0.060170173889902194, 0.06119142890949655, 0.06239034976973163, 0.06371849452805164, 0.06512737257084975, 0.06657011552046843, 0.06800274169170238, 0.06938505333690378, 0.07068124100744576, 0.07186027863856474, 0.07289618662759538, 0.07376822657555879, 0.07446107585769926, 0.07496501548281866, 0.07527615162004896, 0.07539667936665957, 0.07533518575670888, 0.0751069762179298, 0.07473439303996718, 0.07424707441337927, 0.07368207744893594, 0.07308375931706784, 0.07250328179528243, 0.07199758613478488, 0.07162769395727109, 0.07145624696865698, 0.07154432040028959, 0.07194772874949829, 0.07271324725301871 ], [ 0.10349025506311754, 0.09970989464627228, 0.09600550678123548, 0.09239230327623589, 0.08888626471066362, 0.08550425511771845, 0.08226414518064348, 0.07918492051776074, 0.07628673844658497, 0.07359088201997815, 0.07111954689885386, 0.0688953896778372, 0.0669407726825167, 0.06527666796699189, 0.063921237743878, 0.06288818741477135, 0.062185075322369374, 0.061811831432009544, 0.06175975195776233, 0.06201117796687667, 0.06253994178893046, 0.0633125146734823, 0.06428966408734577, 0.06542836697047157, 0.0666837337331489, 0.06801075719861026, 0.06936578025281559, 0.07070764940718616, 0.07199857466662676, 0.07320474628667684, 0.07429677026925416, 0.07524998310373099, 0.07604469805338865, 0.07666642427792446, 0.07710608858489632, 0.07736027853965606, 0.07743151498143455, 0.07732855099290302, 0.07706668194664074, 0.07666803611735026, 0.07616179635819507, 0.07558428007344167, 0.07497877848442722, 0.07439503148472461, 0.07388820052375097, 0.07351721373238064, 0.07334241281227029, 0.07342254328568545, 0.07381129369655101, 0.07455376916471157 ], [ 0.10480180467291372, 0.10110803083066798, 0.09749627077859432, 0.09398204545130484, 0.09058156036345368, 0.08731176999215239, 0.08419043662030473, 0.0812361602241912, 0.07846834551245914, 0.0759070619287408, 0.0735727451344262, 0.07148568841810198, 0.06966528480935213, 0.06812901002568393, 0.06689118405657533, 0.06596160980355958, 0.06534424661610333, 0.06503611392294108, 0.06502661548125344, 0.06529741983708628, 0.06582293849661201, 0.06657133811149737, 0.06750593924722076, 0.06858681404085266, 0.06977240161676787, 0.07102100079571794, 0.07229205493327034, 0.07354719658838708, 0.07475106014899531, 0.07587189562276643, 0.0768820283024504, 0.07775821065942823, 0.07848190839756602, 0.07903955504942188, 0.07942280066842006, 0.07962877093355124, 0.07966034344273058, 0.07952643768087105, 0.07924230330286476, 0.07882977701747035, 0.07831746072054932, 0.0777407525583596, 0.07714163987228391, 0.07656814288182809, 0.07607328892542137, 0.07571351177642047, 0.07554642351533998, 0.07562800731397136, 0.07600942223239411, 0.0767337641679943 ], [ 0.10621335013243055, 0.10261097556310705, 0.0990966707832002, 0.09568617564602758, 0.09239580383087685, 0.08924245560338574, 0.086243613901541, 0.08341730192913985, 0.08078197278603401, 0.07835629532645684, 0.07615879793697797, 0.07420733653026185, 0.07251836809534119, 0.07110603866106037, 0.06998113331051127, 0.06914997973273607, 0.06861343431073613, 0.06836609697758259, 0.06839588710484228, 0.06868406579805172, 0.06920572053326661, 0.0699306554027376, 0.07082457454520222, 0.07185042031304384, 0.07296973266320814, 0.07414392397238839, 0.0753354017345276, 0.07650850937356216, 0.0776302857335697, 0.07867106407377251, 0.07960494209770475, 0.08041015773989334, 0.08106940351128585, 0.0815701071961869, 0.08190469999371303, 0.08207088554337016, 0.0820719148386962, 0.08191686254920018, 0.08162088918502455, 0.08120546020670712, 0.08069847717796104, 0.08013425767624441, 0.07955328168129451, 0.07900160674695644, 0.07852984985007881, 0.07819165092089853, 0.07804158296600741, 0.07813256278436613, 0.07851293770586917, 0.07922355055640551 ], [ 0.10772606681948345, 0.1042194396502144, 0.10080682128002545, 0.09750406668686783, 0.09432747124930718, 0.09129373301025283, 0.088419890448066, 0.08572321680469275, 0.08322104702483386, 0.0809305103250021, 0.07886814236672439, 0.07704935821001176, 0.07548778247322764, 0.07419445671902075, 0.07317697365263727, 0.07243861756983713, 0.07197761226130465, 0.07178658262356626, 0.07185231924740544, 0.07215589748382688, 0.07267315234866505, 0.07337546098388692, 0.07423074756592636, 0.07520460877637306, 0.0762614615742005, 0.07736563382412388, 0.07848234469360124, 0.07957854854905573, 0.08062363857614015, 0.0815900223516477, 0.08245359097138621, 0.08319410711536693, 0.08379553703799868, 0.0842463482435592, 0.08453978954191935, 0.08467416385549743, 0.08465309674789188, 0.0844857950278789, 0.08418727960354908, 0.08377856464625084, 0.08328674095270658, 0.0827449057383379, 0.08219186583256777, 0.08167153026120985, 0.08123190785450916, 0.08092364425322487, 0.0807980788455494, 0.08090487944099269, 0.08128941370960698, 0.08199011901785526 ], [ 0.10934027702617255, 0.10593321206126265, 0.10262585315247401, 0.09943405841137576, 0.096373975338523, 0.09346195593810146, 0.09071444292253152, 0.08814781178188974, 0.0857781507720547, 0.0836209603221388, 0.08169075644506191, 0.0800005708141963, 0.07856135393192766, 0.07738130658492534, 0.07646518594617678, 0.07581365167397675, 0.07542272851413899, 0.07528346028656573, 0.07538181364406805, 0.07569886084486323, 0.07621123526850748, 0.07689181984480305, 0.07771060435377496, 0.07863563677181548, 0.07963399644976986, 0.08067272963309458, 0.0817197059174907, 0.08274437315295352, 0.08371840481424707, 0.08461624624311179, 0.08541557402885054, 0.08609768654843285, 0.08664784412763547, 0.08705557524301333, 0.08731496133404967, 0.08742490756139823, 0.08738940039684671, 0.08721774521129075, 0.08692476786016128, 0.08653095350253201, 0.08606248365949926, 0.08555111959185789, 0.08503386834797191, 0.08455236079011068, 0.08415187384928884, 0.08387994873280782, 0.0837845986880671, 0.08391216583844124, 0.08430496951651546, 0.08499896994711864 ], [ 0.11105541968413883, 0.10775114749207278, 0.10455192365473628, 0.10147349463676325, 0.09853173351175663, 0.09574251309425778, 0.0931215489390223, 0.09068420112992277, 0.0884452228249586, 0.08641844460317545, 0.08461638771708369, 0.08304980705704378, 0.08172717597508053, 0.08065413902415525, 0.07983297282699643, 0.07926210637282328, 0.07893575650959483, 0.07884372968737303, 0.07897142667812758, 0.07930006527571666, 0.07980711128391167, 0.08046688566395033, 0.08125129990716407, 0.08213066479689844, 0.08307451957496954, 0.0840524370922748, 0.08503477286730292, 0.08599333923151607, 0.08690199772033365, 0.08773717228133596, 0.08847829223097733, 0.08910817727897985, 0.08961337774440403, 0.08998448178987886, 0.09021639852874858, 0.09030862150962086, 0.09026547149429058, 0.09009631062761116, 0.08981571200363175, 0.08944355928998668, 0.08900504079620022, 0.0885304920534581, 0.08805503243149944, 0.08761793759439963, 0.08726169497551262, 0.08703070883885558, 0.08696965878566561, 0.08712157094449464, 0.08752572798853926, 0.08821560770401543 ], [ 0.1128700412240268, 0.10967117534618102, 0.10658224707106538, 0.10361877868353386, 0.10079625059872892, 0.09812993898269065, 0.09563472477857993, 0.09332486723197139, 0.09121373526943898, 0.08931349202827847, 0.08763473197779471, 0.08618607661575836, 0.08497374331222168, 0.0840011114222759, 0.08326831850212073, 0.0827719251308843, 0.08250468742888098, 0.08245547071966698, 0.08260932619504419, 0.0829477367487782, 0.08344902129600612, 0.08408887209384819, 0.08484098936070775, 0.0856777731087154, 0.08657103339914189, 0.08749268595851527, 0.08841540846331196, 0.0893132420096741, 0.09016213087636098, 0.09094040071023322, 0.09162918024743562, 0.09221277453937575, 0.09267899852478467, 0.09301947892514491, 0.09322993009249421, 0.09331040580079748, 0.09326552416015405, 0.09310465689947438, 0.09284206725830897, 0.09249697281117324, 0.09209350115534878, 0.09166049846331858, 0.09123114511023794, 0.09084233150818016, 0.09053375427748854, 0.09034671150641703, 0.09032260848802884, 0.09050123124130377, 0.09091889844839197, 0.09160665143052214 ], [ 0.11478180698120323, 0.11169032870673298, 0.10871314368853263, 0.10586544410899332, 0.10316221198083608, 0.10061802848000058, 0.09824685840405158, 0.09606180672356761, 0.09407484515735687, 0.0922965088900541, 0.09073556717576514, 0.08939867657423013, 0.08829003149089687, 0.0874110326440707, 0.08675999881853443, 0.08633194945225271, 0.0861184841921527, 0.08610778016147808, 0.08628471881069028, 0.08663114323056126, 0.08712623556435721, 0.08774699456280473, 0.08846878681753506, 0.08926594246405183, 0.09011236704285672, 0.09098214500439837, 0.09185011596532897, 0.09269241115010506, 0.09348694352591295, 0.09421385027114533, 0.09485589000306838, 0.09539879946441233, 0.095831615136811, 0.09614696461195504, 0.09634133064148974, 0.09641528772657375, 0.09637370699305076, 0.09622592001120196, 0.09598582627988259, 0.09567192254998613, 0.0953072255162554, 0.09491905358184831, 0.0945386298871811, 0.09420046970806462, 0.09394152323569627, 0.09380006211443094, 0.09381432624246218, 0.0940209849839581, 0.09445350901449731, 0.09514058636849647 ], [ 0.11678753188679114, 0.11380479132435702, 0.1109401043865474, 0.10820823732689766, 0.10562358342830294, 0.1031999514974871, 0.10095033474593824, 0.09888666037941946, 0.09701952145326671, 0.09535789453748157, 0.0939088495036371, 0.0926772611301992, 0.09166553581916355, 0.09087336989505988, 0.09029755795946312, 0.08993186988941694, 0.08976701284282297, 0.08979069004735092, 0.08998776168365334, 0.09034050573540924, 0.0908289693925923, 0.0914313955348704, 0.09212470477501447, 0.09288501186747024, 0.09368815590570143, 0.0945102262175247, 0.0953280695916209, 0.0961197687481805, 0.09686508618191159, 0.09754587116824735, 0.09814643050245891, 0.09865386525336484, 0.09905837639311751, 0.09935354162615355, 0.09953656414094973, 0.09960849142185815, 0.0995743987668738, 0.09944352786396216, 0.09922936584856437, 0.09894964499519979, 0.09862623811280989, 0.09828492067949138, 0.09795496904973403, 0.09766856638709687, 0.09745999621978489, 0.09736461931761303, 0.09741765351188592, 0.09765280664826996, 0.09810084579083117, 0.09878821402273079 ], [ 0.11888322857803642, 0.11600996019950362, 0.11325786794429644, 0.11064120892141137, 0.108173714469413, 0.10586836503486512, 0.10373715161121375, 0.10179082677282585, 0.10003864952185343, 0.09848812967600164, 0.09714477930722365, 0.09601188062896518, 0.09509028144166456, 0.09437823041530108, 0.09387126472973456, 0.09356216160367078, 0.09344096289364073, 0.09349507834987751, 0.09370946863804297, 0.09406690442220826, 0.09454829327673715, 0.09513306251976192, 0.09579958364465677, 0.09652562305233407, 0.0972888042142578, 0.09806706799396737, 0.09883912027130652, 0.09958485884467833, 0.10028577443874218, 0.10092532317925618, 0.10148926985424332, 0.10196600248838877, 0.10234681912126907, 0.10262618716814426, 0.10280197436783041, 0.10287564813028299, 0.1028524371607138, 0.10274144567277345, 0.10255570650097333, 0.10231215529985144, 0.10203150428756047, 0.10173799142952361, 0.10145898063451642, 0.1012243917677969, 0.10106594744008668, 0.10101623762604779, 0.10110762328393882, 0.10137102477982537, 0.10183466652743274, 0.10252287044323637 ], [ 0.1210641705641641, 0.11830052101459819, 0.1156605080841518, 0.1131578106750385, 0.11080544265410247, 0.10861552076051165, 0.10659902560041454, 0.10476556079805298, 0.10312311628915596, 0.10167784264494806, 0.10043384413157634, 0.0993929988309887, 0.0985548144362576, 0.09791632813929099, 0.097472058227967, 0.0972140135398796, 0.09713176480870071, 0.09721257931696599, 0.09744161735884686, 0.09780218610021217, 0.0982760437967984, 0.09884374525551236, 0.09948501808544788, 0.10017915877311809, 0.10090543791532668, 0.101643504943519, 0.10237378419255991, 0.10307785597736235, 0.10373881820029952, 0.10434162569173555, 0.10487340578941036, 0.10532374944094904, 0.10568497726851399, 0.10595237951473471, 0.106124427585655, 0.10620295304841304, 0.10619328749763414, 0.1061043537965543, 0.10594869602644662, 0.10574243235699451, 0.10550511245748156, 0.10525945967658097, 0.10503097889794008, 0.10484741472881032, 0.10473805244774502, 0.10473286650686033, 0.10486153814521251, 0.10515238339534305, 0.10563125258318683, 0.10632047823820924 ], [ 0.1233249677214891, 0.12067053348363464, 0.11814152729657736, 0.11575099559419831, 0.11351119656166969, 0.11143336690272337, 0.10952748811343081, 0.10780205871959377, 0.1062638794676336, 0.10491785873045319, 0.10376684535407979, 0.10281149579760682, 0.10205018169855322, 0.10147894294319607, 0.10109148997715629, 0.10087925751958635, 0.10083151012735848, 0.10093549828799515, 0.10117666200110746, 0.10153887723608054, 0.10200473932096582, 0.10255587630505121, 0.10317328470876465, 0.10383767986678642, 0.1045298532862897, 0.10523103004400315, 0.10592322015319956, 0.10658955892779709, 0.10721463251420965, 0.10778478580190945, 0.10828841071848196, 0.10871621334331572, 0.1090614582460655, 0.10932018791745471, 0.10949141409382653, 0.10957727620511512, 0.10958316016486146, 0.109517768392512, 0.10939312950993718, 0.10922453388435995, 0.10903037952463247, 0.108831912343883, 0.1086528461693187, 0.1085188518477098, 0.10845691199416917, 0.10849454864414211, 0.10865894492728397, 0.10897599760268444, 0.10946935257689158, 0.11015948727839885 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.48771 (SEM: 0)
x1: 0.850006
x2: 0.76179
x3: 0.315696
x4: 0.0667344
x5: 0.735019
x6: 0.515815", "Arm 1_0
l2norm: 0.830972 (SEM: 0)
x1: 0.0435526
x2: 0.271424
x3: 0.384739
x4: 0.324967
x5: 0.513624
x6: 0.312266", "Arm 2_0
l2norm: 1.5566 (SEM: 0)
x1: 0.19224
x2: 0.632054
x3: 0.100307
x4: 0.919172
x5: 0.736001
x6: 0.768069", "Arm 3_0
l2norm: 1.66742 (SEM: 0)
x1: 0.525476
x2: 0.863703
x3: 0.686721
x4: 0.9207
x5: 0.651213
x6: 0.121777", "Arm 4_0
l2norm: 0.901683 (SEM: 0)
x1: 0.224889
x2: 0.158277
x3: 0.404255
x4: 0.52086
x5: 0.294674
x6: 0.464602", "Arm 5_0
l2norm: 1.50307 (SEM: 0)
x1: 0.247425
x2: 0.188518
x3: 0.217416
x4: 0.81642
x5: 0.920121
x6: 0.775914", "Arm 6_0
l2norm: 1.37735 (SEM: 0)
x1: 0.179999
x2: 0.167114
x3: 0.995151
x4: 0.674075
x5: 0.20554
x6: 0.59145", "Arm 7_0
l2norm: 1.58231 (SEM: 0)
x1: 0.868609
x2: 0.926798
x3: 0.365419
x4: 0.793795
x5: 0.306812
x6: 0.180303", "Arm 8_0
l2norm: 1.42406 (SEM: 0)
x1: 0.128604
x2: 0.61249
x3: 0.93022
x4: 0.186771
x5: 0.111331
x6: 0.850688", "Arm 9_0
l2norm: 1.60681 (SEM: 0)
x1: 0.782812
x2: 0.22904
x3: 0.296612
x4: 0.713423
x5: 0.943379
x6: 0.655494", "Arm 10_0
l2norm: 1.15085 (SEM: 0)
x1: 0.512458
x2: 0.432795
x3: 0.57399
x4: 0.711118
x5: 0.144828
x6: 0.135688", "Arm 11_0
l2norm: 1.72381 (SEM: 0)
x1: 0.531558
x2: 0.98588
x3: 0.958956
x4: 0.366984
x5: 0.101068
x6: 0.807794", "Arm 12_0
l2norm: 0.860826 (SEM: 0)
x1: 0.197965
x2: 0.145229
x3: 0.402411
x4: 0.46014
x5: 0.217291
x6: 0.509765", "Arm 13_0
l2norm: 0.835068 (SEM: 0)
x1: 0.171488
x2: 0.136352
x3: 0.393499
x4: 0.403711
x5: 0.160123
x6: 0.55306", "Arm 14_0
l2norm: 0.812133 (SEM: 0)
x1: 0.184576
x2: 0.0843012
x3: 0.416101
x4: 0.444417
x5: 0.132553
x6: 0.479758", "Arm 15_0
l2norm: 0.850369 (SEM: 0)
x1: 0.177896
x2: 0.166541
x3: 0.390051
x4: 0.402515
x5: 0.174901
x6: 0.564798", "Arm 16_0
l2norm: 0.889712 (SEM: 0)
x1: 0.168495
x2: 0.186258
x3: 0.376545
x4: 0.397065
x5: 0.22146
x6: 0.616453", "Arm 17_0
l2norm: 0.924582 (SEM: 0)
x1: 0.14928
x2: 0.18773
x3: 0.363237
x4: 0.383717
x5: 0.25928
x6: 0.671505", "Arm 18_0
l2norm: 0.985266 (SEM: 0)
x1: 0.149205
x2: 0.192005
x3: 0.358198
x4: 0.379943
x5: 0.26876
x6: 0.752812", "Arm 19_0
l2norm: 0.909468 (SEM: 0)
x1: 0.104355
x2: 0.201331
x3: 0.343253
x4: 0.341127
x5: 0.297936
x6: 0.672868", "Arm 20_0
l2norm: 0.892567 (SEM: 0)
x1: 0.0413486
x2: 0.229878
x3: 0.285343
x4: 0.360005
x5: 0.287942
x6: 0.669468", "Arm 21_0
l2norm: 0.906807 (SEM: 0)
x1: 0.12806
x2: 0.194817
x3: 0.376268
x4: 0.282182
x5: 0.314409
x6: 0.669244", "Arm 22_0
l2norm: 0.898954 (SEM: 0)
x1: 0.179306
x2: 0.136724
x3: 0.379285
x4: 0.225713
x5: 0.327444
x6: 0.674723", "Arm 23_0
l2norm: 0.92441 (SEM: 0)
x1: 0.1188
x2: 0.161427
x3: 0.435081
x4: 0.243633
x5: 0.325744
x6: 0.677939" ], "type": "scatter", "x": [ 0.315695583820343, 0.38473911583423615, 0.10030677355825901, 0.686721432954073, 0.40425535570830107, 0.21741607133299112, 0.9951510680839419, 0.3654189072549343, 0.9302203226834536, 0.2966118650510907, 0.5739897470921278, 0.9589558094739914, 0.40241096872492843, 0.3934993961060828, 0.4161007574040361, 0.39005091382878565, 0.37654528829270617, 0.3632371935294076, 0.35819823816344964, 0.3432531745622518, 0.2853431505335215, 0.37626823027921047, 0.37928522889750266, 0.4350805061035148 ], "xaxis": "x", "y": [ 0.06673437356948853, 0.32496699783951044, 0.9191719712689519, 0.9207000136375427, 0.5208599139004946, 0.8164195651188493, 0.6740754898637533, 0.7937947604805231, 0.18677120935171843, 0.7134226160123944, 0.71111826505512, 0.366984068416059, 0.4601403046931708, 0.4037114114557015, 0.44441746663450893, 0.4025147417209764, 0.3970645360568677, 0.3837169321650254, 0.3799427537541372, 0.3411271228649243, 0.3600052042925678, 0.28218245990275703, 0.22571283790638264, 0.2436327925388976 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.48771 (SEM: 0)
x1: 0.850006
x2: 0.76179
x3: 0.315696
x4: 0.0667344
x5: 0.735019
x6: 0.515815", "Arm 1_0
l2norm: 0.830972 (SEM: 0)
x1: 0.0435526
x2: 0.271424
x3: 0.384739
x4: 0.324967
x5: 0.513624
x6: 0.312266", "Arm 2_0
l2norm: 1.5566 (SEM: 0)
x1: 0.19224
x2: 0.632054
x3: 0.100307
x4: 0.919172
x5: 0.736001
x6: 0.768069", "Arm 3_0
l2norm: 1.66742 (SEM: 0)
x1: 0.525476
x2: 0.863703
x3: 0.686721
x4: 0.9207
x5: 0.651213
x6: 0.121777", "Arm 4_0
l2norm: 0.901683 (SEM: 0)
x1: 0.224889
x2: 0.158277
x3: 0.404255
x4: 0.52086
x5: 0.294674
x6: 0.464602", "Arm 5_0
l2norm: 1.50307 (SEM: 0)
x1: 0.247425
x2: 0.188518
x3: 0.217416
x4: 0.81642
x5: 0.920121
x6: 0.775914", "Arm 6_0
l2norm: 1.37735 (SEM: 0)
x1: 0.179999
x2: 0.167114
x3: 0.995151
x4: 0.674075
x5: 0.20554
x6: 0.59145", "Arm 7_0
l2norm: 1.58231 (SEM: 0)
x1: 0.868609
x2: 0.926798
x3: 0.365419
x4: 0.793795
x5: 0.306812
x6: 0.180303", "Arm 8_0
l2norm: 1.42406 (SEM: 0)
x1: 0.128604
x2: 0.61249
x3: 0.93022
x4: 0.186771
x5: 0.111331
x6: 0.850688", "Arm 9_0
l2norm: 1.60681 (SEM: 0)
x1: 0.782812
x2: 0.22904
x3: 0.296612
x4: 0.713423
x5: 0.943379
x6: 0.655494", "Arm 10_0
l2norm: 1.15085 (SEM: 0)
x1: 0.512458
x2: 0.432795
x3: 0.57399
x4: 0.711118
x5: 0.144828
x6: 0.135688", "Arm 11_0
l2norm: 1.72381 (SEM: 0)
x1: 0.531558
x2: 0.98588
x3: 0.958956
x4: 0.366984
x5: 0.101068
x6: 0.807794", "Arm 12_0
l2norm: 0.860826 (SEM: 0)
x1: 0.197965
x2: 0.145229
x3: 0.402411
x4: 0.46014
x5: 0.217291
x6: 0.509765", "Arm 13_0
l2norm: 0.835068 (SEM: 0)
x1: 0.171488
x2: 0.136352
x3: 0.393499
x4: 0.403711
x5: 0.160123
x6: 0.55306", "Arm 14_0
l2norm: 0.812133 (SEM: 0)
x1: 0.184576
x2: 0.0843012
x3: 0.416101
x4: 0.444417
x5: 0.132553
x6: 0.479758", "Arm 15_0
l2norm: 0.850369 (SEM: 0)
x1: 0.177896
x2: 0.166541
x3: 0.390051
x4: 0.402515
x5: 0.174901
x6: 0.564798", "Arm 16_0
l2norm: 0.889712 (SEM: 0)
x1: 0.168495
x2: 0.186258
x3: 0.376545
x4: 0.397065
x5: 0.22146
x6: 0.616453", "Arm 17_0
l2norm: 0.924582 (SEM: 0)
x1: 0.14928
x2: 0.18773
x3: 0.363237
x4: 0.383717
x5: 0.25928
x6: 0.671505", "Arm 18_0
l2norm: 0.985266 (SEM: 0)
x1: 0.149205
x2: 0.192005
x3: 0.358198
x4: 0.379943
x5: 0.26876
x6: 0.752812", "Arm 19_0
l2norm: 0.909468 (SEM: 0)
x1: 0.104355
x2: 0.201331
x3: 0.343253
x4: 0.341127
x5: 0.297936
x6: 0.672868", "Arm 20_0
l2norm: 0.892567 (SEM: 0)
x1: 0.0413486
x2: 0.229878
x3: 0.285343
x4: 0.360005
x5: 0.287942
x6: 0.669468", "Arm 21_0
l2norm: 0.906807 (SEM: 0)
x1: 0.12806
x2: 0.194817
x3: 0.376268
x4: 0.282182
x5: 0.314409
x6: 0.669244", "Arm 22_0
l2norm: 0.898954 (SEM: 0)
x1: 0.179306
x2: 0.136724
x3: 0.379285
x4: 0.225713
x5: 0.327444
x6: 0.674723", "Arm 23_0
l2norm: 0.92441 (SEM: 0)
x1: 0.1188
x2: 0.161427
x3: 0.435081
x4: 0.243633
x5: 0.325744
x6: 0.677939" ], "type": "scatter", "x": [ 0.315695583820343, 0.38473911583423615, 0.10030677355825901, 0.686721432954073, 0.40425535570830107, 0.21741607133299112, 0.9951510680839419, 0.3654189072549343, 0.9302203226834536, 0.2966118650510907, 0.5739897470921278, 0.9589558094739914, 0.40241096872492843, 0.3934993961060828, 0.4161007574040361, 0.39005091382878565, 0.37654528829270617, 0.3632371935294076, 0.35819823816344964, 0.3432531745622518, 0.2853431505335215, 0.37626823027921047, 0.37928522889750266, 0.4350805061035148 ], "xaxis": "x2", "y": [ 0.06673437356948853, 0.32496699783951044, 0.9191719712689519, 0.9207000136375427, 0.5208599139004946, 0.8164195651188493, 0.6740754898637533, 0.7937947604805231, 0.18677120935171843, 0.7134226160123944, 0.71111826505512, 0.366984068416059, 0.4601403046931708, 0.4037114114557015, 0.44441746663450893, 0.4025147417209764, 0.3970645360568677, 0.3837169321650254, 0.3799427537541372, 0.3411271228649243, 0.3600052042925678, 0.28218245990275703, 0.22571283790638264, 0.2436327925388976 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.006574797645589133, -0.6205668306093576, -0.6205668306093576, -0.6595523554881337, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.7643656779554298, -1.8103510970876024, -1.8103510970876024, -1.9741353806480837, -2.460644437931033, -2.7499043994970793, -2.7499043994970793, -2.922920227432404, -2.922920227432404, -3.1378670684080525, -3.1378670684080525, -3.1641898364300083, -3.1641898364300083 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.8500059843063354
x2: 0.7617895603179932
x3: 0.315695583820343
x4: 0.06673437356948853
x5: 0.7350194454193115
x6: 0.5158148407936096", "
Parameterization:
x1: 0.04355258867144585
x2: 0.2714243056252599
x3: 0.38473911583423615
x4: 0.32496699783951044
x5: 0.5136235142126679
x6: 0.31226599495857954", "
Parameterization:
x1: 0.19224035553634167
x2: 0.632053722627461
x3: 0.10030677355825901
x4: 0.9191719712689519
x5: 0.7360014347359538
x6: 0.7680686982348561", "
Parameterization:
x1: 0.525476130656898
x2: 0.8637028364464641
x3: 0.686721432954073
x4: 0.9207000136375427
x5: 0.6512133106589317
x6: 0.12177668046206236", "
Parameterization:
x1: 0.2248887661844492
x2: 0.1582772321999073
x3: 0.40425535570830107
x4: 0.5208599139004946
x5: 0.2946738041937351
x6: 0.4646021854132414", "
Parameterization:
x1: 0.24742478970438242
x2: 0.18851820845156908
x3: 0.21741607133299112
x4: 0.8164195651188493
x5: 0.9201205158606172
x6: 0.7759142126888037", "
Parameterization:
x1: 0.17999933287501335
x2: 0.1671135611832142
x3: 0.9951510680839419
x4: 0.6740754898637533
x5: 0.205539645627141
x6: 0.591449836269021", "
Parameterization:
x1: 0.8686089878901839
x2: 0.9267976386472583
x3: 0.3654189072549343
x4: 0.7937947604805231
x5: 0.306811748072505
x6: 0.18030259385704994", "
Parameterization:
x1: 0.12860394082963467
x2: 0.6124901017174125
x3: 0.9302203226834536
x4: 0.18677120935171843
x5: 0.11133061349391937
x6: 0.8506876900792122", "
Parameterization:
x1: 0.7828124966472387
x2: 0.22904012445360422
x3: 0.2966118650510907
x4: 0.7134226160123944
x5: 0.9433786552399397
x6: 0.6554940240457654", "
Parameterization:
x1: 0.5124581437557936
x2: 0.43279509898275137
x3: 0.5739897470921278
x4: 0.71111826505512
x5: 0.1448278110474348
x6: 0.1356884753331542", "
Parameterization:
x1: 0.5315583599731326
x2: 0.9858796512708068
x3: 0.9589558094739914
x4: 0.366984068416059
x5: 0.10106810554862022
x6: 0.8077936787158251", "
Parameterization:
x1: 0.1979645843635403
x2: 0.1452290194340706
x3: 0.40241096872492843
x4: 0.4601403046931708
x5: 0.2172914327251822
x6: 0.5097647326969051", "
Parameterization:
x1: 0.17148814233997936
x2: 0.1363517190045183
x3: 0.3934993961060828
x4: 0.4037114114557015
x5: 0.1601225499725769
x6: 0.5530596746823503", "
Parameterization:
x1: 0.1845760464708392
x2: 0.08430116762382639
x3: 0.4161007574040361
x4: 0.44441746663450893
x5: 0.13255263226469527
x6: 0.47975771026584696", "
Parameterization:
x1: 0.17789571565036708
x2: 0.16654135632099584
x3: 0.39005091382878565
x4: 0.4025147417209764
x5: 0.17490091560462723
x6: 0.5647982102511802", "
Parameterization:
x1: 0.16849479454503996
x2: 0.18625765922415782
x3: 0.37654528829270617
x4: 0.3970645360568677
x5: 0.22146005425303744
x6: 0.6164531298090602", "
Parameterization:
x1: 0.1492800435027863
x2: 0.18773013182981066
x3: 0.3632371935294076
x4: 0.3837169321650254
x5: 0.25927974804508913
x6: 0.6715054636483072", "
Parameterization:
x1: 0.14920486220555912
x2: 0.19200478471287452
x3: 0.35819823816344964
x4: 0.3799427537541372
x5: 0.2687602796088002
x6: 0.752811884748541", "
Parameterization:
x1: 0.10435477628719056
x2: 0.20133127981777924
x3: 0.3432531745622518
x4: 0.3411271228649243
x5: 0.29793583664931833
x6: 0.6728676941960949", "
Parameterization:
x1: 0.041348560966521945
x2: 0.2298782573249003
x3: 0.2853431505335215
x4: 0.3600052042925678
x5: 0.28794194708043663
x6: 0.6694676392381289", "
Parameterization:
x1: 0.12805965082741697
x2: 0.19481654630430054
x3: 0.37626823027921047
x4: 0.28218245990275703
x5: 0.31440931507486264
x6: 0.6692444697768208", "
Parameterization:
x1: 0.17930557714398054
x2: 0.1367237125073871
x3: 0.37928522889750266
x4: 0.22571283790638264
x5: 0.3274442146226855
x6: 0.6747226513801327", "
Parameterization:
x1: 0.11879979599197747
x2: 0.16142730373374714
x3: 0.4350805061035148
x4: 0.2436327925388976
x5: 0.3257439389979177
x6: 0.6779391031701999", "
Parameterization:
x1: 0.17249609295757548
x2: 0.22895420650980014
x3: 0.42538613175627404
x4: 0.24775753030589082
x5: 0.3376019865392339
x6: 0.6775757005790819" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.006574797645589133, -0.6205668306093576, -0.6205668306093576, -0.6595523554881337, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.7643656779554298, -1.8103510970876024, -1.8103510970876024, -1.9741353806480837, -2.460644437931033, -2.7499043994970793, -2.7499043994970793, -2.922920227432404, -2.922920227432404, -3.1378670684080525, -3.1378670684080525, -3.1641898364300083, -3.1641898364300083 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.006574797645589133, -0.6205668306093576, -0.6205668306093576, -0.6595523554881337, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.3960046666069759, -1.7643656779554298, -1.8103510970876024, -1.8103510970876024, -1.9741353806480837, -2.460644437931033, -2.7499043994970793, -2.7499043994970793, -2.922920227432404, -2.922920227432404, -3.1378670684080525, -3.1378670684080525, -3.1641898364300083, -3.1641898364300083 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.006574797645589133 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:41] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:41] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:41] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.137, 'x2': 0.211166, 'x3': 0.411674, 'x4': 0.214296, 'x5': 0.303471, 'x6': 0.676792}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-10 16:23:46] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.12" } }, "nbformat": 4, "nbformat_minor": 2 }