{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.316215, 'x2': 0.617202, 'x3': 0.706244, 'x4': 0.442446, 'x5': 0.302538, 'x6': 0.689988}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-1.05354, 0.0), 'l2norm': (1.320258, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:10:59] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.811902, 'x2': 0.397874, 'x3': 0.256599, 'x4': 0.587825, 'x5': 0.62507, 'x6': 0.198599}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.030375, 0.0), 'l2norm': (1.28803, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.338193, 'x2': 0.15836, 'x3': 0.646144, 'x4': 0.317308, 'x5': 0.319267, 'x6': 0.282366}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.902763, 0.0), 'l2norm': (0.916134, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.336418, 'x2': 0.780722, 'x3': 0.075576, 'x4': 0.253823, 'x5': 0.09957, 'x6': 0.695929}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.301255, 0.0), 'l2norm': (1.134493, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.380861, 'x2': 0.550309, 'x3': 0.099196, 'x4': 0.57631, 'x5': 0.428499, 'x6': 0.875051}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.336963, 0.0), 'l2norm': (1.318785, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.567525, 'x2': 0.962826, 'x3': 0.634008, 'x4': 0.971757, 'x5': 0.022628, 'x6': 0.529474}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.015445, 0.0), 'l2norm': (1.695951, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.647436, 'x2': 0.919807, 'x3': 0.784123, 'x4': 0.144491, 'x5': 0.556692, 'x6': 0.19643}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.135364, 0.0), 'l2norm': (1.499812, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.433622, 'x2': 0.632672, 'x3': 0.302698, 'x4': 0.416656, 'x5': 0.155608, 'x6': 0.200353}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-1.139769, 0.0), 'l2norm': (0.958063, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.895307, 'x2': 0.42466, 'x3': 0.221151, 'x4': 0.217061, 'x5': 0.806897, 'x6': 0.196305}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.003266, 0.0), 'l2norm': (1.329493, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.394621, 'x2': 0.410424, 'x3': 0.236322, 'x4': 0.477136, 'x5': 0.448209, 'x6': 0.927047}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.61634, 0.0), 'l2norm': (1.291506, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.452516, 'x2': 0.689018, 'x3': 0.00579, 'x4': 0.819839, 'x5': 0.609085, 'x6': 0.359038}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.28145, 0.0), 'l2norm': (1.360727, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.122639, 'x2': 0.808514, 'x3': 0.137789, 'x4': 0.29003, 'x5': 0.580703, 'x6': 0.217619}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:00] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.248956, 0.0), 'l2norm': (1.075366, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:06] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.37559, 'x2': 0.517996, 'x3': 0.483859, 'x4': 0.397443, 'x5': 0.192537, 'x6': 0.314783}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:06] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.781035, 0.0), 'l2norm': (0.968311, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:12] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.448282, 'x2': 0.596617, 'x3': 0.250143, 'x4': 0.389758, 'x5': 0.107677, 'x6': 0.086888}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:12] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.127807, 0.0), 'l2norm': (0.88912, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:18] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.438555, 'x2': 0.743162, 'x3': 0.2751, 'x4': 0.446701, 'x5': 0.134403, 'x6': 0.099596}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:18] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-2.154294, 0.0), 'l2norm': (1.023634, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:23] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.439368, 'x2': 0.776917, 'x3': 0.274371, 'x4': 0.451549, 'x5': 0.105622, 'x6': 0.049494}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:23] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-2.430065, 0.0), 'l2norm': (1.043756, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:28] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.436913, 'x2': 0.829443, 'x3': 0.275494, 'x4': 0.476369, 'x5': 0.095572, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:28] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.69282, 0.0), 'l2norm': (1.09125, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:34] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.465652, 'x2': 0.901557, 'x3': 0.250452, 'x4': 0.49551, 'x5': 0.10908, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:34] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.70927, 0.0), 'l2norm': (1.161805, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:39] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.384509, 'x2': 0.895731, 'x3': 0.314697, 'x4': 0.503408, 'x5': 0.098188, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:39] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.915465, 0.0), 'l2norm': (1.145546, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:45] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.302235, 'x2': 0.905339, 'x3': 0.252056, 'x4': 0.524441, 'x5': 0.082595, 'x6': 0.000194}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:45] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.503007, 0.0), 'l2norm': (1.120883, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:51] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.405389, 'x2': 0.926977, 'x3': 0.392935, 'x4': 0.485002, 'x5': 0.126163, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:51] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.82202, 0.0), 'l2norm': (1.195478, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:56] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.405246, 'x2': 0.90671, 'x3': 0.340061, 'x4': 0.537696, 'x5': 0.059146, 'x6': 0.034836}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:11:56] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.1008, 0.0), 'l2norm': (1.181448, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:00] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.41382, 'x2': 0.887716, 'x3': 0.378968, 'x4': 0.589816, 'x5': 0.047899, 'x6': 0.00971}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:00] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-3.114091, 0.0), 'l2norm': (1.205477, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:06] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.411794, 'x2': 0.914979, 'x3': 0.36451, 'x4': 0.564301, 'x5': 0.0, 'x6': 0.014328}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:06] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.100134, 0.0), 'l2norm': (1.207589, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:11] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.409602, 'x2': 0.902884, 'x3': 0.349478, 'x4': 0.588018, 'x5': 0.039879, 'x6': 0.054516}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:11] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.12852, 0.0), 'l2norm': (1.206415, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:11] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.32, 'x2': 0.62, 'x3': 0.71, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.81, 'x2': 0.4, 'x3': 0.26, 'x...
20Sobol2COMPLETED{'2_0': {'x1': 0.34, 'x2': 0.16, 'x3': 0.65, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.34, 'x2': 0.78, 'x3': 0.08, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.38, 'x2': 0.55, 'x3': 0.1, 'x...
50Sobol5COMPLETED{'5_0': {'x1': 0.57, 'x2': 0.96, 'x3': 0.63, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.65, 'x2': 0.92, 'x3': 0.78, '...
70Sobol7COMPLETED{'7_0': {'x1': 0.43, 'x2': 0.63, 'x3': 0.3, 'x...
80Sobol8COMPLETED{'8_0': {'x1': 0.9, 'x2': 0.42, 'x3': 0.22, 'x...
90Sobol9COMPLETED{'9_0': {'x1': 0.39, 'x2': 0.41, 'x3': 0.24, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.45, 'x2': 0.69, 'x3': 0.01, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.12, 'x2': 0.81, 'x3': 0.14, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.38, 'x2': 0.52, 'x3': 0.48, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.45, 'x2': 0.6, 'x3': 0.25, '...
141GPEI14COMPLETED{'14_0': {'x1': 0.44, 'x2': 0.74, 'x3': 0.28, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.44, 'x2': 0.78, 'x3': 0.27, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.44, 'x2': 0.83, 'x3': 0.28, ...
171GPEI17COMPLETED{'17_0': {'x1': 0.47, 'x2': 0.9, 'x3': 0.25, '...
181GPEI18COMPLETED{'18_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.31, '...
191GPEI19COMPLETED{'19_0': {'x1': 0.3, 'x2': 0.91, 'x3': 0.25, '...
201GPEI20COMPLETED{'20_0': {'x1': 0.41, 'x2': 0.93, 'x3': 0.39, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.41, 'x2': 0.91, 'x3': 0.34, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.38, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.41, 'x2': 0.91, 'x3': 0.36, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.41, 'x2': 0.9, 'x3': 0.35, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.32, 'x2': 0.62, 'x3': 0.71, '... \n", "1 {'1_0': {'x1': 0.81, 'x2': 0.4, 'x3': 0.26, 'x... \n", "2 {'2_0': {'x1': 0.34, 'x2': 0.16, 'x3': 0.65, '... \n", "3 {'3_0': {'x1': 0.34, 'x2': 0.78, 'x3': 0.08, '... \n", "4 {'4_0': {'x1': 0.38, 'x2': 0.55, 'x3': 0.1, 'x... \n", "5 {'5_0': {'x1': 0.57, 'x2': 0.96, 'x3': 0.63, '... \n", "6 {'6_0': {'x1': 0.65, 'x2': 0.92, 'x3': 0.78, '... \n", "7 {'7_0': {'x1': 0.43, 'x2': 0.63, 'x3': 0.3, 'x... \n", "8 {'8_0': {'x1': 0.9, 'x2': 0.42, 'x3': 0.22, 'x... \n", "9 {'9_0': {'x1': 0.39, 'x2': 0.41, 'x3': 0.24, '... \n", "10 {'10_0': {'x1': 0.45, 'x2': 0.69, 'x3': 0.01, ... \n", "11 {'11_0': {'x1': 0.12, 'x2': 0.81, 'x3': 0.14, ... \n", "12 {'12_0': {'x1': 0.38, 'x2': 0.52, 'x3': 0.48, ... \n", "13 {'13_0': {'x1': 0.45, 'x2': 0.6, 'x3': 0.25, '... \n", "14 {'14_0': {'x1': 0.44, 'x2': 0.74, 'x3': 0.28, ... \n", "15 {'15_0': {'x1': 0.44, 'x2': 0.78, 'x3': 0.27, ... \n", "16 {'16_0': {'x1': 0.44, 'x2': 0.83, 'x3': 0.28, ... \n", "17 {'17_0': {'x1': 0.47, 'x2': 0.9, 'x3': 0.25, '... \n", "18 {'18_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.31, '... \n", "19 {'19_0': {'x1': 0.3, 'x2': 0.91, 'x3': 0.25, '... \n", "20 {'20_0': {'x1': 0.41, 'x2': 0.93, 'x3': 0.39, ... \n", "21 {'21_0': {'x1': 0.41, 'x2': 0.91, 'x3': 0.34, ... \n", "22 {'22_0': {'x1': 0.41, 'x2': 0.89, 'x3': 0.38, ... \n", "23 {'23_0': {'x1': 0.41, 'x2': 0.91, 'x3': 0.36, ... \n", "24 {'24_0': {'x1': 0.41, 'x2': 0.9, 'x3': 0.35, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.40960156814499676,\n", " 'x2': 0.9028843565581781,\n", " 'x3': 0.34947836450836417,\n", " 'x4': 0.5880181145970005,\n", " 'x5': 0.03987857675682326,\n", " 'x6': 0.05451576694217824}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.2064166488722867, 'hartmann6': -3.1285245329118543}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:11] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.5731335093910332, -0.5807108707501212, -0.5882340690369812, -0.5955935611212582, -0.6026659868308982, -0.6093150700454599, -0.6153932144196014, -0.6207439082697179, -0.6252050363399785, -0.62861316044983, -0.6308087703740678, -0.6316424160897556, -0.6309815122851319, -0.6287174631043904, -0.6247726080534722, -0.6191063696677921, -0.6117199291398778, -0.6026588045311084, -0.5920128765189471, -0.579913686042319, -0.5665291682071183, -0.5520563149993425, -0.5367125033239619, -0.5207263368742039, -0.5043288205226271, -0.487745539718876, -0.4711903010261178, -0.4548604533357701, -0.43893389325808685, -0.42356758860829213, -0.40889734192535143, -0.39503846121530306, -0.38208699991018147, -0.37012126098868237, -0.3592033188588335, -0.3493803850618855, -0.34068591966678974, -0.33314046078253834, -0.3267522033492798, -0.32151740084589875, -0.317420687565513, -0.3144354247066954, -0.3125241628741393, -0.3116392905900358, -0.31172390810362516, -0.31271293345017925, -0.3145344180938898, -0.31711102611300435, -0.32036161570171373, -0.3242028551592424 ], [ -0.574369326521752, -0.5820586067595589, -0.5896835107970163, -0.5971297218812811, -0.6042685799467943, -0.6109580553576714, -0.6170444523347822, -0.6223649615701425, -0.6267511646440396, -0.6300335564278147, -0.6320470889432231, -0.6326376455765607, -0.631669226671161, -0.6290314731917231, -0.6246469937227201, -0.6184778252738422, -0.610530294556857, -0.6008575966690085, -0.5895595960417778, -0.5767796668800345, -0.5626987717909276, -0.5475273440091668, -0.5314958067643321, -0.5148446787011073, -0.49781516773773504, -0.4806409791829782, -0.46354181231683844, -0.44671875064358535, -0.430351510440776, -0.4145973279916162, -0.3995911488589188, -0.3854467307397631, -0.3722582749232788, -0.36010224651871603, -0.34903911597756987, -0.33911484049544693, -0.330361991964661, -0.3228005187570948, -0.3164381945535828, -0.3112708538952269, -0.30728253880472356, -0.30444568397276095, -0.30272145235493597, -0.3020603033657363, -0.3024028382724191, -0.30368092825271265, -0.3058190955004343, -0.30873609078759556, -0.3123465940964947, -0.3165629584840497 ], [ -0.5753611690920097, -0.5831412150861371, -0.5908444742920356, -0.598351639667895, -0.6055285661102352, -0.612227339573606, -0.6182881139638574, -0.6235418388068694, -0.6278139830891678, -0.6309293229529827, -0.632717795806366, -0.6330213244688708, -0.6317013798611353, -0.6286468857914799, -0.6237818946232483, -0.6170723144889876, -0.6085308966388037, -0.598219744821628, -0.5862498155241332, -0.5727772248316304, -0.5579966021003396, -0.5421321365422035, -0.5254272544413613, -0.508133981284528, -0.49050297660879316, -0.47277501889176166, -0.45517442778753814, -0.4379046073720503, -0.4211456278202652, -0.40505356405300974, -0.38976118878461485, -0.3753795701728573, -0.36200013848639756, -0.3496968456686751, -0.33852812970816504, -0.32853849704603966, -0.3197596378747247, -0.3122110806810461, -0.3059004659440028, -0.3008235693290444, -0.2969642296212227, -0.29429433651592163, -0.29277401161411243, -0.2923520783588227, -0.2929668705434689, -0.29454738205159203, -0.29701471927601575, -0.30028378683387325, -0.3042651189021133, -0.30886676257815604 ], [ -0.5761116394201644, -0.583961937892812, -0.5917208188503229, -0.5992637292917246, -0.6064508105229183, -0.6131280884178348, -0.6191294738672639, -0.6242796983845065, -0.628398290634034, -0.6313046597969891, -0.6328242834872659, -0.6327958943417507, -0.6310794173411273, -0.6275642352812871, -0.6221771732685321, -0.6148894336507685, -0.6057216345853146, -0.5947461638400618, -0.5820862871358738, -0.5679118332158813, -0.5524317459004963, -0.5358842382038267, -0.5185255971632281, -0.5006188031296839, -0.48242303743305803, -0.4641849043915305, -0.44613186207878797, -0.4284680157214842, -0.41137213458485844, -0.39499753976715635, -0.37947338632928407, -0.36490682254199736, -0.3513855364011953, -0.33898027581668067, -0.3277470348042697, -0.3177287163775202, -0.3089561992794332, -0.30144883887537044, -0.2952145140260798, -0.290249386039529, -0.28653756036796874, -0.28405083735624514, -0.28274870916826744, -0.2825787130132169, -0.283477194778913, -0.28537048126521203, -0.28817641118463944, -0.29180614020370244, -0.29616611571845497, -0.30116011215624994 ], [ -0.5766286315682704, -0.5845301273359601, -0.592323428150173, -0.5998784403418924, -0.607049316043384, -0.6136757927318868, -0.6195853911571834, -0.6245965971075954, -0.6285231305618283, -0.6311793626143003, -0.6323868682475123, -0.6319819941480141, -0.6298241717970571, -0.6258045227396581, -0.6198541066118962, -0.6119509945388704, -0.6021252694124117, -0.5904611211017732, -0.5770954554754066, -0.5622128561416205, -0.546037249478989, -0.5288211059566117, -0.5108333439275093, -0.4923472125699534, -0.47362931387478724, -0.45493063451365656, -0.4364800820542618, -0.41848064009941677, -0.40110793590904503, -0.38451078625419965, -0.3688131618710362, -0.35411697929899, -0.340505172359693, -0.328044591501774, -0.31678840557122334, -0.3067778178860747, -0.2980430410196053, -0.290603590228558, -0.2844680450663253, -0.2796334865611738, -0.27608484085607854, -0.27379435048607026, -0.272721356436179, -0.27281251612494506, -0.27400251502647355, -0.27621526360927695, -0.2793655157550705, -0.283360805732195, -0.28810358025296545, -0.2934933988682289 ], [ -0.5769257052942933, -0.5848617106609116, -0.5926707865105593, -0.6002169673338155, -0.607348092133962, -0.6138973228252953, -0.6196855765607721, -0.6245249966265879, -0.6282235606160655, -0.630590876649643, -0.6314451405487987, -0.6306211116493698, -0.627978808795371, -0.6234124369289792, -0.6168588508890542, -0.6083046901505867, -0.5977912385848947, -0.5854161421969374, -0.5713313947903201, -0.5557374599634615, -0.538873952479483, -0.5210078199773863, -0.502420315717253, -0.4833941553470974, -0.46420210306215437, -0.4450978983389423, -0.4263100095017702, -0.4080382782412919, -0.3904531687161865, -0.3736970929845098, -0.35788715972037033, -0.34311867382296124, -0.3294687777802925, -0.3169997448424351, -0.30576158366559536, -0.29579377236139726, -0.28712608964911834, -0.2797786391497792, -0.27376126049074023, -0.2690725817781745, -0.265698989551318, -0.2636137759616233, -0.2627766744337192, -0.2631339243377755, -0.2646189247415145, -0.2671534599386405, -0.2706494158060979, -0.2750108627264569, -0.280136359755911, -0.28592133380343987 ], [ -0.577022354160896, -0.5849795340758676, -0.5927894178184359, -0.6003098059819634, -0.6073818535596075, -0.61383179696073, -0.6194736594587086, -0.6241130579111756, -0.6275522021666511, -0.6295961240773409, -0.6300600878068052, -0.628778010028289, -0.6256115545653771, -0.6204593677337263, -0.6132657117444078, -0.6040275798790143, -0.592799304248891, -0.5796937634638977, -0.5648796046550947, -0.5485743928352357, -0.53103419745185, -0.5125406768754194, -0.4933870843139456, -0.473864708709684, -0.4542510812506766, -0.43480089400016175, -0.4157400989675133, -0.39726318783897985, -0.37953327078571775, -0.36268431732666273, -0.3468248007409136, -0.3320419846014755, -0.3184061777177225, -0.3059744304467067, -0.29479332145827786, -0.2849006653002766, -0.27632613904711656, -0.2690909675766402, -0.2632069122397094, -0.2586748708122939, -0.25548341508247385, -0.253607567946984, -0.2530080612193133, -0.2536312300525654, -0.25540960471306384, -0.258263170514339, -0.2621011943789946, -0.26682446904671475, -0.2723278049837843, -0.278502602360315 ], [ -0.5769441474479269, -0.5849135600342894, -0.5927141557436117, -0.6001971172153696, -0.607196502297963, -0.6135312081095489, -0.6190079885554204, -0.6234256458423083, -0.6265804780034099, -0.628273001407027, -0.6283158724224901, -0.6265427994446865, -0.6228180632859454, -0.6170460586715604, -0.609180057779162, -0.5992292267019739, -0.5872628655432724, -0.5734109632903891, -0.5578605008639065, -0.5408474768831766, -0.5226452696013927, -0.5035505300482638, -0.483868173649867, -0.4638971109564839, -0.4439181344161224, -0.4241849377426097, -0.4049187066388409, -0.38630620055511256, -0.3685008297086585, -0.35162596353250275, -0.3357795923990474, -0.3210394836038206, -0.3074680907807641, -0.29511665525121744, -0.28402814409425914, -0.27423887593496477, -0.26577887210354567, -0.25867112459098074, -0.2529300841003099, -0.2485597356533873, -0.2455516431880369, -0.2438833103817526, -0.2435171302523247, -0.24440009432012122, -0.24646432055892142, -0.24962835571463837, -0.25379912607691724, -0.2588743594565168, -0.2647452810120756, -0.27129939209238163 ], [ -0.5767227278234159, -0.5847008950884667, -0.5924882166286214, -0.5999288634631089, -0.6068493491612861, -0.6130607562375051, -0.6183621029856005, -0.6225449691241082, -0.625399451358515, -0.6267214462202266, -0.626321150666794, -0.6240325255967947, -0.619723283246139, -0.613304746735587, -0.604740717022635, -0.5940543201725927, -0.5813317665996713, -0.5667221053036116, -0.5504324396625065, -0.5327186590542592, -0.5138724228392261, -0.4942057444985012, -0.47403490248927616, -0.4536654561218354, -0.43337987322440896, -0.41342877093228125, -0.3940261645998999, -0.37534854289871555, -0.3575371351211376, -0.3407024577199156, -0.32493012549390343, -0.310286961678637, -0.29682659759995866, -0.2845939708083005, -0.27362837105908433, -0.26396491637038455, -0.25563454668873486, -0.24866278782568463, -0.2430676552508293, -0.23885713083357207, -0.23602665343089857, -0.23455701855396383, -0.23441299178915997, -0.23554282054782938, -0.23787869915760962, -0.2413381238942598, -0.24582598361605745, -0.25123717687865454, -0.257459528070054, -0.2643767869259681 ], [ -0.5763956499964211, -0.5843856292090307, -0.59216305066624, -0.5995646864850069, -0.6064090369352393, -0.6124988392815778, -0.617624817212031, -0.6215707879839574, -0.6241201868264739, -0.6250639814648348, -0.6242098279490766, -0.6213921583720258, -0.6164826933889762, -0.6094006510556235, -0.6001217100376308, -0.5886846339808842, -0.5751944472746783, -0.5598212420591211, -0.5427941285222431, -0.5243904808892127, -0.5049213610990138, -0.48471464459345914, -0.46409775641033957, -0.44338195054852936, -0.4228497367011226, -0.40274647548171916, -0.3832764756646727, -0.36460328271875353, -0.3468533557163904, -0.33012204271685563, -0.31448068380672467, -0.2999837598969468, -0.2866752099198182, -0.27459330376023927, -0.26377373710919927, -0.2542508751443735, -0.2460572948827846, -0.23922195037925542, -0.23376740445425148, -0.22970663120927903, -0.22703989323383333, -0.22575213845034603, -0.22581125331601481, -0.22716736892955192, -0.22975326759234083, -0.2334858033546121, -0.2382681496267034, -0.2439926293280299, -0.2505438675390963, -0.2578020248915698 ], [ -0.5760060497060866, -0.5840184722758592, -0.5917979525388247, -0.5991735024140793, -0.6059551341512156, -0.6119366643210463, -0.6168998725788314, -0.6206201329743858, -0.6228735662357178, -0.6234456596915943, -0.622141162167043, -0.6187948820592146, -0.6132828024741275, -0.6055326949074316, -0.5955331984915062, -0.5833401935775958, -0.5690793112657404, -0.5529436554391645, -0.535186303282103, -0.5161078521879335, -0.49604006592393335, -0.4753273520559671, -0.4543081923243951, -0.4332986397397143, -0.41257959707427405, -0.392388913114333, -0.3729185461831461, -0.3543163200648396, -0.33669126097432756, -0.32012121419233197, -0.3046613902444797, -0.29035263343565343, -0.2772284708366104, -0.2653203197403333, -0.2546605531090538, -0.24528341139784482, -0.23722398740731254, -0.2305156908652808, -0.22518671801679524, -0.22125610618960656, -0.21872994249762456, -0.2175982217591632, -0.21783272119080244, -0.21938609774131046, -0.22219224437216378, -0.22616779143897747, -0.23121452956637456, -0.23722247081172165, -0.24407325340658015, -0.2516436212462272 ], [ -0.5756021372465785, -0.5836561791486895, -0.5914594193528336, -0.598832797399034, -0.6055773775129191, -0.6114774506717744, -0.6163051201007153, -0.6198264916041689, -0.6218095078861776, -0.6220333472094957, -0.620299146961168, -0.6164416115195712, -0.610340828987547, -0.6019333744331326, -0.591221559501099, -0.5782795628410644, -0.5632552208126227, -0.5463665443888219, -0.52789258448147, -0.5081590439003623, -0.4875198880791618, -0.46633693394826836, -0.4449597966429413, -0.42370852714317353, -0.4028607871646783, -0.3826446088957438, -0.3632368759798781, -0.3447668404734918, -0.32732340527964054, -0.3109646165463318, -0.29572781023800854, -0.28163907260455434, -0.2687210160244584, -0.25699825685674327, -0.24650034991134429, -0.23726225003348378, -0.22932262080035004, -0.22272049097457836, -0.21749087225688668, -0.21365999699415195, -0.21124081068805367, -0.2102292632009386, -0.21060179446814553, -0.21231422629742314, -0.2153020810672317, -0.21948218174432688, -0.2247552690957395, -0.23100931141203485, -0.23812317577944486, -0.24597036453706322 ], [ -0.575236515103389, -0.583360761091161, -0.5912202511654465, -0.5986276159062411, -0.6053745509881829, -0.6112352080610534, -0.6159712120688413, -0.6193384342545168, -0.6210955542115266, -0.6210143069150029, -0.618891127842106, -0.6145596824396079, -0.6079035063620017, -0.5988677165439903, -0.5874685275467304, -0.5737991920236022, -0.5580310612768619, -0.5404088043577773, -0.5212394577976937, -0.5008758447874401, -0.4796958462705768, -0.4580798011707712, -0.4363887340736743, -0.41494601751619853, -0.39402447812407937, -0.3738400018824761, -0.3545516237909261, -0.3362671456958659, -0.3190526878744726, -0.3029443126889353, -0.2879599296510762, -0.2741100037051345, -0.2614060259603912, -0.24986616738949463, -0.23951795318102254, -0.23039813509187024, -0.22255019348545613, -0.21602007491189412, -0.2108508721923723, -0.20707718509373785, -0.20471986012856314, -0.20378169871417318, -0.20424455350027193, -0.20606802555345927, -0.20918976310023418, -0.21352718033386187, -0.21898028835530425, -0.2254352699922264, -0.23276843039805506, -0.24085019961256693 ], [ -0.5749653249817488, -0.5831984881031033, -0.5911583973605042, -0.5986492429687827, -0.6054530001431021, -0.611333084993587, -0.6160397934243441, -0.6193176656406397, -0.6209148091747616, -0.6205940562615123, -0.6181456233563766, -0.6134006844939924, -0.6062449802792622, -0.5966312921035036, -0.5845893705774886, -0.5702317948262818, -0.5537543446508776, -0.5354298678803749, -0.5155953469094658, -0.49463284718341916, -0.47294609338722804, -0.45093531128932884, -0.42897343296591695, -0.40738662209745535, -0.38644133583030094, -0.36633898276580634, -0.34721796097770774, -0.32916176977157985, -0.31221119466720704, -0.29637833528972823, -0.2816604198051029, -0.26805179040160065, -0.2555530002116002, -0.24417651053807155, -0.23394894424624724, -0.22491020835594866, -0.21711004877420303, -0.21060275852372357, -0.20544084264359008, -0.20166845502453223, -0.19931536439343622, -0.1983920779420698, -0.19888656029065865, -0.2007627559550318, -0.20396089109637994, -0.20839933341491124, -0.21397765600571472, -0.220580492206933, -0.22808177616744452, -0.23634901855176627 ], [ -0.5748472353415047, -0.5832386936749124, -0.5913555603041533, -0.598993591111308, -0.6059247910101483, -0.6119012943523635, -0.6166611968786063, -0.6199365020077551, -0.6214632212796749, -0.6209934917561464, -0.6183093384117951, -0.6132374209491581, -0.6056637790383985, -0.5955472640470334, -0.5829300797264689, -0.5679437344003588, -0.5508088320250678, -0.5318275855058074, -0.5113687553361986, -0.4898458334152803, -0.46769051442116694, -0.4453245303335932, -0.42313345078053, -0.40144585724964177, -0.38052037571178543, -0.36054162745662954, -0.3416246138912835, -0.3238257756719769, -0.3071582162849975, -0.29160841774880253, -0.27715209620708836, -0.2637674542202493, -0.2514447869730785, -0.2401920452402695, -0.23003647188775456, -0.2210227930721278, -0.21320867808258304, -0.20665831283873626, -0.201434985853713, -0.197593573070181, -0.19517372888303974, -0.19419444210334413, -0.1946504043166184, -0.1965103877069012, -0.19971757841894044, -0.2041916017092309, -0.2098318371537069, -0.216521566276052, -0.22413251108854992, -0.23252938754358055 ], [ -0.5749422863274055, -0.5835524004058952, -0.5918955758667099, -0.5997593120821871, -0.6069055333691686, -0.6130746348819114, -0.6179916580842655, -0.6213747868614534, -0.6229462204066705, -0.6224452827345973, -0.619643366560213, -0.6143599855400383, -0.6064788423583509, -0.5959624512582012, -0.5828635499990522, -0.5673313930897198, -0.5496111476182478, -0.5300351169576921, -0.5090054429702873, -0.4869692222886718, -0.46438840672479764, -0.44170809319690696, -0.41932744654927157, -0.3975772497851686, -0.37670691581411053, -0.35688201470580627, -0.3381914745416621, -0.3206621084815706, -0.30427732039439737, -0.28899679093307706, -0.27477447040342606, -0.26157303107091545, -0.24937380468191717, -0.23818198061094953, -0.22802739266728955, -0.21896157866888943, -0.21105199605202118, -0.2043743667230884, -0.19900414050884496, -0.19500802421125574, -0.19243642111453085, -0.19131745785457155, -0.19165304576235886, -0.19341715529462644, -0.19655621544026713, -0.2009913298594439, -0.20662186060996146, -0.21332987859572916, -0.2209850050113802, -0.2294492443778844 ], [ -0.5753106145330885, -0.5842107916552185, -0.5928625983744417, -0.6010456627517159, -0.6085118986883812, -0.6149896384533732, -0.6201900788532961, -0.6238162695083, -0.6255747270655323, -0.6251895453952252, -0.6224185829458311, -0.6170709479108099, -0.6090245890699764, -0.598242378222068, -0.5847847126393919, -0.5688164788209624, -0.5506063308872904, -0.5305167734086477, -0.5089845723054305, -0.4864925034740587, -0.46353516127996386, -0.44058306999672403, -0.4180501546098552, -0.3962693293547843, -0.37547949517994006, -0.3558249839947982, -0.3373661294999679, -0.32009785503849675, -0.3039723354777111, -0.28892191728398586, -0.2748792869571377, -0.26179298024677355, -0.24963739851085864, -0.23841735299268252, -0.22816773317995986, -0.2189492213300137, -0.21084112036215408, -0.2039323956214647, -0.19831199966611357, -0.19405947203621587, -0.1912366796548659, -0.18988137778657332, -0.19000302643813471, -0.1915810144984813, -0.19456516546884295, -0.19887817154533094, -0.20441946130019906, -0.21106995983327925, -0.2186972345989302, -0.2271606067853542 ], [ -0.5760110852153544, -0.5852835607850706, -0.5943391252530378, -0.6029501635547551, -0.6108588732028117, -0.6177813841621955, -0.6234143779669676, -0.627444481822103, -0.6295605622775289, -0.6294688147803847, -0.6269102318365785, -0.6216796350189226, -0.613644992787197, -0.6027652607744352, -0.5891045517361979, -0.5728401852066863, -0.5542622311839208, -0.533762705407465, -0.5118137106024145, -0.4889355379427769, -0.4656578139838118, -0.44247869656406047, -0.41982820542584043, -0.39804144082213755, -0.37734557883787545, -0.35786164702160517, -0.33961911858742044, -0.3225792279812094, -0.30666207929773326, -0.2917730189348069, -0.27782493168061695, -0.26475456490053806, -0.252532284212879, -0.24116561383809976, -0.23069748680758617, -0.22120039699361382, -0.2127677120498801, -0.20550336672786895, -0.19951106805802588, -0.19488402826058415, -0.19169609110531338, -0.18999491686231718, -0.18979763527424476, -0.19108908458053198, -0.1938224695134667, -0.19792204115415535, -0.20328726189963642, -0.20979787869931954, -0.21731937097812692, -0.22570833573637894 ], [ -0.5770998642497662, -0.5868371754972808, -0.5964039039808444, -0.6055660967031536, -0.614056796897517, -0.6215800318061384, -0.6278174813280354, -0.6324381607319702, -0.6351112970325099, -0.6355223401605271, -0.6333917155155737, -0.6284954917662151, -0.6206866215784662, -0.6099148548507908, -0.5962429033393751, -0.5798560778494208, -0.5610625962105407, -0.5402822714992502, -0.5180225109499804, -0.4948425376319767, -0.4713092707430091, -0.4479507626525464, -0.42521457599182755, -0.4034381482871494, -0.3828358127356992, -0.3635034133141257, -0.34543768958950083, -0.32856505657410495, -0.3127736410529647, -0.2979432440827714, -0.2839695959850126, -0.2707811311627686, -0.2583480471716557, -0.24668443291877473, -0.23584478062199032, -0.22591636752580402, -0.21700895618271665, -0.20924313395853056, -0.20273846069941337, -0.19760243802903865, -0.19392114192349075, -0.1917521492112566, -0.19112012808868184, -0.19201516889704306, -0.19439364553748018, -0.19818116942717245, -0.20327706269472756, -0.20955974414870537, -0.2168924730017392, -0.22512899938993192 ], [ -0.5786289661558546, -0.5889331001401541, -0.5991297709188206, -0.6089799001060099, -0.6182082497330305, -0.6265071396427961, -0.6335430170023579, -0.6389662784717736, -0.6424245943978918, -0.6435797413119603, -0.6421275990535066, -0.6378205050037407, -0.630490589037699, -0.620072074747119, -0.6066199018393809, -0.590321532661525, -0.5714986471400137, -0.5505958550636474, -0.5281548215872308, -0.5047744606247843, -0.4810609320548018, -0.4575743735863066, -0.43478137595421096, -0.41302192909331814, -0.3924965238490943, -0.3732742304904584, -0.3553177664620202, -0.3385185317915156, -0.322734006527154, -0.3078213109377055, -0.2936630900436592, -0.2801842306128852, -0.2673596883739473, -0.25521474838401326, -0.24381947573653617, -0.23327914726998933, -0.2237222868566513, -0.21528769730600072, -0.20811166281250237, -0.2023163021822938, -0.19799986396232327, -0.195229539113708, -0.19403710835111432, -0.19441745212492156, -0.19632967103001708, -0.19970034224500743, -0.20442830930043887, -0.21039037655999682, -0.21744733826838636, -0.22544988223823115 ], [ -0.5806448177723014, -0.591626023524188, -0.6025814780089902, -0.6132685214805396, -0.6234048574286266, -0.6326718449359972, -0.6407207969209527, -0.6471827611005677, -0.6516821172017875, -0.6538540828770759, -0.653365862761084, -0.6499406869212779, -0.6433833671220804, -0.6336052779998653, -0.6206459138251796, -0.6046875110635239, -0.5860588765596582, -0.5652248269517738, -0.5427588932836871, -0.5192994726257077, -0.4954933543714036, -0.4719347122169224, -0.44911058851092833, -0.4273637735569724, -0.4068800860675885, -0.38770067720726575, -0.36975380224287857, -0.3528969258715968, -0.3369598077232665, -0.32178147818081193, -0.30723722057490166, -0.29325456260845373, -0.2798192448038168, -0.2669731310603236, -0.25480629754594886, -0.24344538588086695, -0.23303998398155334, -0.22374845933166165, -0.21572438429124619, -0.20910446649013026, -0.20399869772794976, -0.20048322213729142, -0.19859617546625885, -0.1983364703668038, -0.1996652346004819, -0.20250939784283295, -0.20676680359936284, -0.212312204069671, -0.21900355976565922, -0.22668817993987278 ], [ -0.5831868794543521, -0.594962143529839, -0.606813569021639, -0.6184968053304162, -0.6297241004201599, -0.6401670007891294, -0.6494621861476713, -0.6572209992648174, -0.6630431016960574, -0.6665344544539137, -0.6673294655049437, -0.6651166429237758, -0.6596664335844009, -0.6508591247905299, -0.6387097939219769, -0.6233864312175621, -0.6052167586944719, -0.5846792856832753, -0.562375273801603, -0.5389810348507804, -0.5151844897201053, -0.4916153311037309, -0.46878229088340206, -0.4470312189028943, -0.4265326974663912, -0.4072994898428999, -0.3892261537317816, -0.372138997467208, -0.35584499307657413, -0.3401717245211331, -0.3249946952038312, -0.3102517647785443, -0.29594656328458613, -0.2821435772827212, -0.2689576318963356, -0.2565401144406747, -0.24506379177883852, -0.2347076260131984, -0.22564264943797085, -0.2180197096692733, -0.21195969476904697, -0.20754664660627564, -0.20482393920384867, -0.20379344129280752, -0.20441733270403817, -0.2066220481946628, -0.21030371414083526, -0.21533443177192835, -0.2215688283293349, -0.22885041350495783 ], [ -0.586286366791277, -0.5989775623435075, -0.6118683716414496, -0.6247149929181185, -0.6372262208290987, -0.6490653787976234, -0.6598554825415407, -0.669188283939821, -0.6766377337948635, -0.6817781875241902, -0.6842073314720499, -0.6835733014614814, -0.6796047772442123, -0.6721419615516322, -0.6611653226150924, -0.646817896795001, -0.6294160364095432, -0.6094431548493588, -0.5875219036052355, -0.5643630878978957, -0.5406949463185106, -0.5171834047010099, -0.4943597838837288, -0.4725732621061358, -0.4519790497274955, -0.4325620654259903, -0.41418560776662194, -0.39664981795577225, -0.3797462656303583, -0.36330008954642756, -0.3471965934957586, -0.3313931577821716, -0.31591937759323585, -0.3008689042296204, -0.2863861699153536, -0.2726505353697015, -0.259859730196502, -0.24821390979673308, -0.23790126458144645, -0.22908585708406837, -0.22189817076813845, -0.2164286725103135, -0.21272448403236077, -0.21078902596273763, -0.21058427230989785, -0.21203507582328918, -0.21503492893443643, -0.21945251955511202, -0.225138510587942, -0.23193208735033832 ], [ -0.5899651155705867, -0.603696847175213, -0.6177741747329132, -0.6319564214265951, -0.6459513326257947, -0.6594160632179905, -0.6719614534135788, -0.6831603331794203, -0.6925605090974446, -0.6997028975284505, -0.7041449428549715, -0.7054889639922861, -0.7034143712388742, -0.6977117636651071, -0.6883157589481947, -0.6753320937287012, -0.6590532651270375, -0.6399561959021518, -0.618675871908977, -0.5959517218795094, -0.5725496212023027, -0.5491712783559687, -0.5263709758507764, -0.5045015306715017, -0.4837033336021975, -0.4639354839831209, -0.4450347307928991, -0.42678283370801995, -0.40896624265526227, -0.3914192472601976, -0.37404856382943197, -0.3568416592196175, -0.3398629308882051, -0.32324199461983594, -0.30715763764904724, -0.29182007210490646, -0.27745329034747046, -0.26427869978382446, -0.25250080321087776, -0.24229543660572417, -0.23380090538314668, -0.22711220636064344, -0.2222783471022114, -0.21930257383614826, -0.21814512098901662, -0.2187279393604531, -0.22094077737821238, -0.22464799001977265, -0.22969551959075396, -0.23591760502225156 ], [ -0.5942346308138587, -0.6091318104030983, -0.6245436610154207, -0.6402355123240726, -0.6559168484477107, -0.6712411770876905, -0.6858091994818323, -0.69917611155878, -0.7108638088083089, -0.720378608775492, -0.7272348112318068, -0.7309839450586145, -0.7312488549943361, -0.7277608141360714, -0.7203965816360741, -0.7092107878684881, -0.6944573810136663, -0.6765925351224339, -0.6562512855671297, -0.6341926799812604, -0.6112149933781688, -0.5880535866836061, -0.5652853159610719, -0.5432670687529372, -0.5221260450352376, -0.5017996656374557, -0.48210583633899506, -0.46281914100627086, -0.4437344721463514, -0.4247095659638598, -0.4056860721642892, -0.38669322343949997, -0.3678394983467226, -0.34929722169494926, -0.3312839046430498, -0.3140429303216141, -0.29782522285825763, -0.2828728677161776, -0.2694052415028856, -0.2576079789389587, -0.24762496591162297, -0.23955342885447606, -0.23344205099665105, -0.2292918801397179, -0.22705962473409014, -0.2266628017453225, -0.22798613063757145, -0.23088857259591022, -0.23521048203362072, -0.24078044500517137 ], [ -0.5990953569738446, -0.6152805598643163, -0.6321726634457343, -0.6495461394760407, -0.6671153412055641, -0.6845330918708319, -0.7013925371503357, -0.7172331783025625, -0.731551976464292, -0.7438202967568024, -0.7535072071010275, -0.7601092136283519, -0.763185843055567, -0.7623995050681013, -0.7575567230303741, -0.7486460880168575, -0.7358662670278933, -0.7196354607453209, -0.7005728002496683, -0.6794440863668121, -0.6570713779926751, -0.6342192202193768, -0.6114855973066942, -0.5892321628826769, -0.5675761828995523, -0.5464404700522816, -0.5256356125229918, -0.5049442281405915, -0.4841867203342589, -0.4632611631083199, -0.4421592448419629, -0.42096433544466216, -0.39983829288461137, -0.37900247498340933, -0.358716823434049, -0.3392594552938535, -0.32090814187432226, -0.3039243783997314, -0.28854036733172217, -0.2749490484387016, -0.26329721162547504, -0.2536816500233716, -0.24614820971469809, -0.24069346271663483, -0.23726859311825566, -0.23578497602246995, -0.236120872858802, -0.23812867508735236, -0.2416421930825241, -0.24648358795727976 ], [ -0.6045362006885838, -0.6221268641438998, -0.6406393082170158, -0.6598604637035427, -0.6795129579456868, -0.6992522771347702, -0.7186671041036063, -0.7372838278377312, -0.7545762282151567, -0.7699812583789916, -0.7829216406286812, -0.7928356083870828, -0.7992134975684128, -0.8016399293256056, -0.7998389387020549, -0.7937175174002898, -0.7834006773817288, -0.7692486020877353, -0.7518446562564571, -0.731944010978523, -0.7103796112283597, -0.6879375712846952, -0.6652341237685543, -0.6426368615501351, -0.6202587370266478, -0.598018927845083, -0.5757368780459045, -0.5532228665838261, -0.5303433337851199, -0.5070557909495661, -0.48341810409114294, -0.4595802761500466, -0.4357663679507089, -0.41225229221645265, -0.3893432018005749, -0.3673525944949725, -0.3465841742350846, -0.3273168680266365, -0.3097930729769329, -0.29421007294093204, -0.2807145156898687, -0.26939980571472444, -0.2603062057043335, -0.2534233457433348, -0.24869473303163958, -0.24602376697303807, -0.24528072063161588, -0.24631016066835243, -0.24893833829053902, -0.252980176790091 ], [ -0.6105343298388151, -0.6296398690239434, -0.6499035979563846, -0.6711283113040226, -0.6930484957450926, -0.715325942726242, -0.7375483961508887, -0.7592323013607043, -0.7798307632451329, -0.7987477832973535, -0.815359691268254, -0.8290443626534286, -0.8392182414079251, -0.8453802655128757, -0.847160398725065, -0.8443684846809342, -0.837036507452033, -0.8254442563482748, -0.8101156810481538, -0.7917730265088826, -0.7712421007656634, -0.7493189172225343, -0.7266331818116751, -0.7035603599342476, -0.6802179696045558, -0.656537456681512, -0.632368596356183, -0.6075734310533756, -0.5820879748560231, -0.5559497689520841, -0.5292992676505675, -0.5023650596686889, -0.4754412462255181, -0.4488626680686839, -0.42298134093412343, -0.398145783617857, -0.37468387859544006, -0.3528893410792622, -0.33301162474268975, -0.3152490223299447, -0.2997447224575793, -0.2865855906782808, -0.27580341821372345, -0.2673783214267338, -0.26124389735854825, -0.2572936733706348, -0.25538835609563226, -0.25536339771424954, -0.25703645276473974, -0.2602143828838239 ], [ -0.617055263229604, -0.6377741897948004, -0.6599074752375387, -0.6832771588975342, -0.7076332333552904, -0.7326476104566273, -0.7579109310180097, -0.7829333432864221, -0.8071504504623762, -0.8299356335943593, -0.8506198575731315, -0.8685198091044528, -0.882974712610746, -0.8933913066991894, -0.8992950938471151, -0.9003839398194349, -0.8965772789725234, -0.8880506587463397, -0.8752418131146957, -0.858812973432766, -0.8395591561981294, -0.8182697220386064, -0.7955806942338085, -0.7718784243996846, -0.7472980530392231, -0.7218049554142548, -0.6953062053481928, -0.6677436801282702, -0.6391485885542143, -0.6096595636899269, -0.5795154289230029, -0.549034085736831, -0.518586075364231, -0.4885681377327744, -0.4593795731017869, -0.43140255988270315, -0.4049866380653191, -0.3804371131411479, -0.3580069798470711, -0.3378919645207821, -0.3202283391785512, -0.30509320708041177, -0.29250696886425853, -0.2824376482251778, -0.27480670390330997, -0.26949590588478944, -0.2663548304302177, -0.26520854217901024, -0.2658650809618581, -0.2681224457663074 ], [ -0.6240532544040959, -0.6464703902453814, -0.6705753891300995, -0.6962127657450067, -0.7231515872284016, -0.7510777237983458, -0.7795887041308704, -0.8081923463195277, -0.8363104429167042, -0.8632888283595953, -0.8884151158475124, -0.9109452020128648, -0.9301392119224895, -0.9453067655960075, -0.955860124794186, -0.9613717370403503, -0.9616297665463991, -0.9566813799297071, -0.9468493587634146, -0.932704942996419, -0.9149833170449961, -0.894445406516821, -0.871723697242933, -0.8472197955092776, -0.8211043055898469, -0.7934041284269947, -0.764115464711117, -0.7332908427609489, -0.7010829844031569, -0.6677519226290256, -0.6336490874995433, -0.5991906068881435, -0.5648281117497729, -0.5310217035532103, -0.4982171900107626, -0.46682816159361906, -0.43722268790439145, -0.40971409029380523, -0.38455519045042097, -0.361935502975697, -0.3419809417944979, -0.3247556921473249, -0.31026593852742645, -0.29846513477304293, -0.28926047228780294, -0.28252016933996216, -0.27808118906835433, -0.27575700751886534, -0.27534509631972726, -0.2766338498672323 ], [ -0.6314719614992871, -0.6556558435199057, -0.6818153668853169, -0.7098204680265976, -0.7394626268002482, -0.7704453622757089, -0.8023770509277363, -0.8347672698013319, -0.8670280053002816, -0.8984811608434567, -0.9283738135850204, -0.9559025551395643, -0.9802479086540259, -1.0006191044040598, -1.0163082362918114, -1.0267508044527633, -1.0315866816355825, -1.030711557010204, -1.0243042968618656, -1.0128120912224765, -0.9968773045363307, -0.9772061485420511, -0.9544152403305204, -0.9289272381121155, -0.9009705608870654, -0.8706661136143131, -0.838134167991437, -0.8035695250745742, -0.7672717454107593, -0.7296405790932013, -0.6911519860230814, -0.6523270337022339, -0.6137012329491824, -0.5757980704673777, -0.5391080595251759, -0.5040732929756251, -0.4710768745981331, -0.4404364244654595, -0.4124008955550096, -0.3871500708632136, -0.36479625354650214, -0.34538777387256325, -0.32891399936204957, -0.3153115516635796, -0.3044714216771385, -0.29624665456363664, -0.2904602673605192, -0.2869130750587796, -0.285391138130479, -0.285672600342598 ], [ -0.6392453834565199, -0.6652459536500293, -0.6935205702246421, -0.7239671188844118, -0.756402443018443, -0.7905510736188172, -0.8260359610197485, -0.862372428058566, -0.8989667302196938, -0.9351207421974282, -0.9700443659323486, -1.0028772165136335, -1.0327208885757928, -1.0586824841711602, -1.079928895322058, -1.0957493595508216, -1.105620844491498, -1.1092667858808531, -1.1066949130528982, -1.0981958257662072, -1.0842849691449383, -1.0655854189663834, -1.0426842988005744, -1.0160322378138145, -0.9859405882307279, -0.9526589213128718, -0.9164667567538041, -0.8777311524232456, -0.8369210996429406, -0.7945913382021409, -0.7513514593710074, -0.707831856731314, -0.6646529624000078, -0.6224004741089608, -0.5816070818553353, -0.54274011870812, -0.5061941552060826, -0.47228751896428156, -0.4412618541775132, -0.4132840235141415, -0.38844983223015617, -0.3667891886573247, -0.34827239642387275, -0.33281730768978446, -0.3202970692035314, -0.3105481836681112, -0.30337860494033797, -0.29857559768386377, -0.2959131232221839, -0.2951585601378095 ], [ -0.6472990321994737, -0.6751457006798763, -0.7055712927126864, -0.7385036254980173, -0.7737873188667443, -0.8111707747941032, -0.8502948057468729, -0.8906841334544982, -0.9317431706120167, -0.9727576713830153, -1.012903971368372, -1.0512675793643504, -1.086872725127332, -1.1187239425725966, -1.145859660024118, -1.16741584610578, -1.1826948293012949, -1.1912304133127551, -1.1928356607404018, -1.1876155780458046, -1.1759274019542372, -1.158284400875552, -1.135231489002475, -1.1072545644077396, -1.0747725355142845, -1.0381963337112097, -0.997996481110627, -0.9547380380192013, -0.9090777240802456, -0.8617367415636259, -0.8134643820335173, -0.765002542168625, -0.7170561587221577, -0.6702711310486565, -0.6252194442820523, -0.5823904097455856, -0.5421867412418159, -0.5049242830478303, -0.4708344199758866, -0.44006843421647646, -0.41270327760473524, -0.38874837935747086, -0.36815320421420084, -0.3508153224725985, -0.33658876717690434, -0.3252924526247003, -0.31671842807379536, -0.310639751250426, -0.306817791665287, -0.30500881203743124 ], [ -0.6555513014863328, -0.685251458234861, -0.7178373332944407, -0.7532680028094279, -0.7914176048504842, -0.8320606079398065, -0.8748583494160267, -0.9193480522135837, -0.9649357413190081, -1.010894692060013, -1.0563712371009455, -1.1003998858045945, -1.1419296563851338, -1.1798631052979247, -1.2131085216568025, -1.240643891762995, -1.2615883540938606, -1.27527295925723, -1.281298007687644, -1.2795603938483022, -1.2702348103684584, -1.2537041895853207, -1.2304619927798481, -1.201036095755299, -1.1659732091011308, -1.125871733409443, -1.0814177858395477, -1.0333935269288257, -0.9826561425058132, -0.9301004997720375, -0.8766186382444561, -0.823064192282128, -0.7702251056915527, -0.7188050368916021, -0.6694124134473204, -0.6225556038003573, -0.5786426785843501, -0.5379844549631949, -0.5007998024972592, -0.467222461175959, -0.4373088461564867, -0.4110464771746605, -0.3883627750508345, -0.36913402344392887, -0.3531943162169886, -0.3403443159279571, -0.3303596512996483, -0.32299879065937165, -0.31801024841167336, -0.3151390120457809 ], [ -0.6639149867932033, -0.695453021396423, -0.7301806632183747, -0.7680888357111054, -0.8090821604562979, -0.8529625754091443, -0.8994138249983924, -0.947988003172206, -0.9980955616266597, -1.0490004418674144, -1.0998222453895004, -1.1495475741218373, -1.197052736989651, -1.2411397284520038, -1.280586477533081, -1.3142105772458177, -1.3409428755121393, -1.359903519990238, -1.3704688099268885, -1.3723138670007176, -1.365416720500321, -1.3500189255995887, -1.3265585773941333, -1.2956108194984721, -1.2578629643789176, -1.2141167104315556, -1.1652881834662918, -1.1123871838557906, -1.0564776002319929, -0.998630615401931, -0.9398811421500936, -0.8811931276244439, -0.8234352916019296, -0.7673665226961359, -0.7136291823677099, -0.662748388121573, -0.6151355461431975, -0.5710947375679338, -0.5308309087842524, -0.4944591191348585, -0.4620143383040657, -0.43346145741793696, -0.40870528886621904, -0.3876003921177489, -0.3699605912557833, -0.3555680597789601, -0.3441818523632785, -0.3355457707523968, -0.3293954661410605, -0.3254647037127625 ], [ -0.6722989072867459, -0.7056357758000019, -0.7424582909389716, -0.7827890203187541, -0.8265631888306382, -0.8736107262333885, -0.9236387774056588, -0.976215815596353, -1.0307587453891724, -1.0865246620744098, -1.1426092518333595, -1.1979541328098182, -1.2513656322765143, -1.3015473534894855, -1.3471481142795412, -1.3868251473162947, -1.4193196891055657, -1.4435384107243971, -1.4586302024348672, -1.4640449704441438, -1.459561713290658, -1.4452802922801045, -1.4215853257171662, -1.3891026255899057, -1.3486641431621311, -1.3012786663453004, -1.2480949448403125, -1.1903512856217797, -1.1293174446725227, -1.0662388524730118, -1.0022905694533846, -0.9385439551188286, -0.8759457597029799, -0.815307700046243, -0.7573040962157019, -0.702475279094809, -0.6512348645161059, -0.6038794282183046, -0.5605995170592677, -0.5214912615226518, -0.4865681057066099, -0.455772348946604, -0.42898630889870826, -0.40604298296833696, -0.38673611812776665, -0.3708296125211241, -0.3580661776585843, -0.3481751958515369, -0.340879718368841, -0.33590256669361285 ], [ -0.6806095808170649, -0.7156829364746708, -0.7545252233216742, -0.797189642482637, -0.8436412699572508, -0.8937376302611747, -0.9472093209827483, -1.0036417765905663, -1.0624595185684083, -1.1229145507535798, -1.1840809397074132, -1.244858040216598, -1.3039851680516408, -1.3600705545000114, -1.4116368141255984, -1.4571835908329434, -1.4952653577192756, -1.5245787479088841, -1.5440500346564066, -1.5529107734486463, -1.5507498821251633, -1.5375350024834282, -1.5136041116219539, -1.4796350531766076, -1.4366001088081286, -1.3857072883841797, -1.3283288665443014, -1.2659227657738386, -1.1999566077929735, -1.1318432435764088, -1.0628923136168604, -0.9942782498502716, -0.9270226169934492, -0.861987725807547, -0.7998784456984692, -0.7412495814474316, -0.6865167438575153, -0.6359691830639138, -0.589783506871769, -0.5480375616141632, -0.5107240159234806, -0.47776337162176286, -0.44901624572816456, -0.4242948386349119, -0.4033735405039578, -0.38599864415647334, -0.37189713910160394, -0.36078456575326867, -0.3523719158952341, -0.34637157671651386 ], [ -0.688752905613956, -0.725477787021468, -0.7662374219205725, -0.8111138490423523, -0.8601003897353947, -0.9130808601312885, -0.9698084294670242, -1.029885152538195, -1.0927434731531873, -1.1576313377381269, -1.223603003379717, -1.2895181552788606, -1.3540524516284949, -1.4157228451977093, -1.4729306295633662, -1.5240237464777264, -1.5673772722926251, -1.6014874003148034, -1.6250704456058267, -1.6371556555614943, -1.637160099456396, -1.6249360234103676, -1.6007848544911336, -1.5654358162274131, -1.5199904074272037, -1.4658383390378666, -1.4045562103058282, -1.337803890202431, -1.2672321723896698, -1.194409904814789, -1.120772895690016, -1.0475927882789677, -0.9759621618221488, -0.9067917331750355, -0.8408159608758634, -0.7786040730092908, -0.7205742763248588, -0.6670095409062349, -0.6180738612196571, -0.5738282765389534, -0.5342462100143366, -0.4992278765277701, -0.4686136340174538, -0.442196228109658, -0.41973192055137276, -0.4009505108170013, -0.3855642676125519, -0.37327579027400826, -0.363784823855855, -0.35679405810212006 ], [ -0.6966358073308736, -0.7349058556457678, -0.7774546597867565, -0.8243905743851834, -0.8757327691138561, -0.9313892067238558, -0.9911338796634439, -1.0545842681966762, -1.1211802607142949, -1.1901661488845794, -1.2605778200535345, -1.3312379140072501, -1.4007623851261086, -1.4675823599378013, -1.5299850063817564, -1.586175894338734, -1.6343627610515243, -1.672856880931689, -1.7001841546313685, -1.715194739210727, -1.7171584417513586, -1.705833202865386, -1.6814952739635811, -1.6449226654573597, -1.5973301545805956, -1.5402648164650699, -1.4754808733429183, -1.4048155162923215, -1.3300823519176492, -1.2529906458077051, -1.175091196688555, -1.097745363426184, -1.0221121540914786, -0.949148319987003, -0.8796171701491745, -0.8141027845124775, -0.7530271963169016, -0.6966688457010364, -0.6451811673403538, -0.5986105872467442, -0.5569134965739194, -0.5199719706755958, -0.48760813259671254, -0.45959714035559873, -0.4356788221230148, -0.4155680051895696, -0.39896359323359976, -0.3855564490204675, -0.37503614092070503, -0.3670966139549374 ], [ -0.7041678163284869, -0.7438569732301056, -0.7880431959725508, -0.8368580003359029, -0.8903433175550257, -0.9484283796866131, -1.0109055035942907, -1.077405670894838, -1.1473750876714233, -1.2200543091522524, -1.2944620885205649, -1.3693868678846166, -1.4433896769278676, -1.514822878876442, -1.5818692681076023, -1.6426049638494726, -1.6950869951027716, -1.7374625227343277, -1.7680920175936996, -1.7856745459629053, -1.7893605092838587, -1.7788359205509623, -1.754362702690215, -1.7167632026049122, -1.6673466190672754, -1.6077891593317126, -1.5399913913871592, -1.4659385184282472, -1.3875823732700465, -1.3067536361706547, -1.2251043997283486, -1.1440765619579216, -1.0648899895782489, -0.9885446487786356, -0.9158319029264429, -0.8473513240693535, -0.7835303889229074, -0.7246452481681586, -0.6708413732450372, -0.6221533301951621, -0.5785232429140882, -0.539817721261254, -0.5058431691468269, -0.47635947446396587, -0.45109213254037184, -0.42974288012313067, -0.4119989273696938, -0.3975408779161107, -0.38604942655018215, -0.377210923077252 ], [ -0.7112625466305874, -0.752227168739147, -0.7978781999063679, -0.8483666490808389, -0.9037535657720883, -0.963985987422506, -1.0288714630996056, -1.0980519890608544, -1.1709784877664868, -1.2468873929432334, -1.3247815397985339, -1.4034184281623407, -1.4813099406859358, -1.5567384894859941, -1.6277948577559058, -1.6924421004352264, -1.7486072865523965, -1.7942985745338738, -1.8277397666523703, -1.8475092809322144, -1.852666559283251, -1.84284697815202, -1.8183070960790562, -1.7799073959302398, -1.7290312674336454, -1.6674544062286878, -1.5971905648693967, -1.5203412600541784, -1.4389693626521, -1.355005502964944, -1.2701872940427164, -1.1860264089412706, -1.1037969028768044, -1.0245384652399347, -0.9490693910580799, -0.8780053206822971, -0.8117809158728413, -0.7506725308874397, -0.6948206034758003, -0.6442509705622081, -0.5988946493502632, -0.5586058535206392, -0.5231781652113711, -0.4923588787061691, -0.4658615879523428, -0.44337711988762174, -0.42458292865145, -0.4091510691121205, -0.39675486661481263, -0.3870743965003989 ], [ -0.7178390539584996, -0.7599203675027772, -0.806845874248527, -0.8587820340163265, -0.9158049700668853, -0.9778756451066426, -1.0448133380017373, -1.116268202729382, -1.19169399839984, -1.2703225401797986, -1.3511421166457498, -1.4328830881625885, -1.51401504493619, -1.592760986742513, -1.6671344757540725, -1.7350049289936038, -1.7941935513014544, -1.842597708070092, -1.8783354067456388, -1.899895319596479, -1.906272989709504, -1.8970718162315776, -1.8725493019205073, -1.8335962813053526, -1.7816498234876232, -1.71855586305921, -1.6464084119683677, -1.5673932127328238, -1.4836559699909646, -1.3972044120190128, -1.3098444317525648, -1.2231453797487508, -1.1384277433629804, -1.0567666393681687, -0.9790056359667725, -0.9057767126952281, -0.8375233373438241, -0.774524580225436, -0.7169188950974021, -0.6647267089747839, -0.6178713237048555, -0.5761978794142029, -0.5394902946965142, -0.5074862040907727, -0.4798899774820019, -0.4563839415827111, -0.43663794034606473, -0.42031737616287135, -0.4070898720628886, -0.39663069024227116 ], [ -0.7238230550931132, -0.7668498673141614, -0.8148452410058288, -0.8679868194053891, -0.9263615205129639, -0.9899401185570765, -1.05854990461147, -1.1318461648905886, -1.209283536024649, -1.2900887876301124, -1.373237332089546, -1.4574368163613958, -1.5411224372215213, -1.6224698558810706, -1.699432221896557, -1.7698070942579496, -1.8313362531237125, -1.8818362691475312, -1.9193508309736622, -1.9423087314918108, -1.9496660785280442, -1.9410095922388897, -1.9166011649703494, -1.8773528743599956, -1.8247353789695695, -1.760637130363816, -1.6872011576477302, -1.6066664790813912, -1.521233776775721, -1.4329646885797196, -1.3437153793835566, -1.2550998337086772, -1.1684762756721898, -1.0849501310604155, -1.0053879255545708, -0.9304377657857023, -0.8605532241786771, -0.7960184137561255, -0.7369727777716452, -0.6834346601779342, -0.6353231075795251, -0.5924776200284484, -0.5546757482299808, -0.5216485525234855, -0.4930940123984835, -0.4686885176861185, -0.4480965938792518, -0.43097902162382273, -0.41699950959730114, -0.4058300744323282 ], [ -0.7291479943453102, -0.7729395752206646, -0.8217895703274761, -0.8758824642248035, -0.9353116237955295, -1.0000534699223318, -1.069939566063716, -1.1446273324953957, -1.2235704313959594, -1.3059903882743955, -1.3908518112647557, -1.476844691404411, -1.5623786407208198, -1.6455952575878077, -1.7244055220886705, -1.7965584038602485, -1.8597439132343752, -1.9117283167384387, -1.9505117841782653, -1.9744910410991228, -1.9826040629076254, -1.9744327451924355, -1.9502441910033106, -1.9109616571196586, -1.8580701718456964, -1.7934751245487104, -1.7193398510544005, -1.6379278549231642, -1.5514683300881709, -1.4620542124977314, -1.3715738600496556, -1.2816723619547004, -1.1937362952620902, -1.10889554094086, -1.0280365811610297, -0.9518228528796451, -0.8807188660371419, -0.8150157550139048, -0.7548566840589165, -0.700261088722199, -0.6511471408991428, -0.6073521107909142, -0.5686504954396424, -0.53476991450373, -0.5054048577825703, -0.48022841929447446, -0.4589021796254389, -0.4410844093744135, -0.42643676740057757, -0.4146296622356187 ], [ -0.7337559453216074, -0.778124994246333, -0.8276074438301065, -0.8823903469563505, -0.9425692656596003, -1.0081222229625388, -1.0788814715354822, -1.1545037724384521, -1.2344402309112663, -1.3179072838837822, -1.4038612666690233, -1.4909801517849912, -1.5776574728128034, -1.6620148169346827, -1.741939991553034, -1.8151571933511854, -1.879332392020432, -1.9322113378730552, -1.9717797779322235, -1.99642749760521, -2.0050923727389045, -1.9973602191695095, -1.9735020745839718, -1.9344418231121194, -1.8816608422889907, -1.8170583192784862, -1.742792130974244, -1.661124221959555, -1.5742879250628854, -1.484386146009398, -1.3933218980343576, -1.3027578245636997, -1.214099089242844, -1.128493603341692, -1.0468441716259231, -0.969828151675407, -0.8979212768751741, -0.831423221355704, -0.7704832327709659, -0.7151247299996514, -0.6652681841237627, -0.6207519035458477, -0.5813505561054636, -0.5467914055885242, -0.5167683349826316, -0.49095378783336985, -0.46900879240306526, -0.45059124880463486, -0.43536266271631985, -0.4229935049895954 ], [ -0.7375983378979878, -0.7823539543068343, -0.8322434543396371, -0.8874523854513319, -0.9480744856457952, -1.0140856075688285, -1.0853154219441337, -1.1614175921667242, -1.2418394835526558, -1.325793042395627, -1.4122293378289137, -1.4998204437030396, -1.5869537607703452, -1.6717452272680244, -1.7520785280282707, -1.8256765302631774, -1.8902079087045442, -1.9434259501802413, -1.9833285803743217, -2.0083207329140254, -2.0173550992274474, -2.0100275887962633, -1.9866104613093232, -1.9480177167920405, -1.8957105563139725, -1.8315614062445502, -1.7577000109611487, -1.6763637248009629, -1.589768142405115, -1.5000065755299141, -1.4089801755366436, -1.3183559811621883, -1.229547906390967, -1.1437151026053254, -1.061772540020613, -0.9844095065826619, -0.9121126736542128, -0.8451912504916355, -0.7838024755018753, -0.7279762619888511, -0.6776382462678617, -0.6326308016952887, -0.5927318081241053, -0.557671123818181, -0.5271448130218962, -0.5008272505097849, -0.47838126481483656, -0.45946650235999387, -0.4437462014475495, -0.43089256257710007 ], [ -0.7406365019134199, -0.7855870857186145, -0.8356585518271862, -0.8910311792051907, -0.9517932172912356, -1.0179149733293709, -1.089220702259327, -1.1653590022865683, -1.2457728083176196, -1.3296706659133886, -1.4160018379180792, -1.5034389727374533, -1.5903734472426025, -1.674929765542323, -1.7550059386906396, -1.828345751264121, -1.8926454413188052, -1.9456913182833908, -1.985517019088025, -2.010561506265388, -2.0198043524865152, -2.0128557455996217, -1.9899856857160094, -1.9520883484696665, -1.9005900158903846, -1.8373184623152712, -1.7643557303310688, -1.6838946298238695, -1.598113812824239, -1.5090794778132246, -1.4186757500139118, -1.3285616244952003, -1.2401501414155958, -1.1546047506802724, -1.0728480488827277, -0.995578758926057, -0.9232936548181634, -0.8563119343869141, -0.794800232197282, -0.7387970220561825, -0.6882355900078764, -0.642965082850661, -0.6027693744515487, -0.5673836612961375, -0.536508815559019, -0.5098236012229568, -0.48699490647378163, -0.4676861716650217, -0.4515642027722062, -0.4383045602384775 ], [ -0.7428420210682957, -0.7877980374646449, -0.8378300515144625, -0.8931097107872326, -0.9537165604680087, -1.0196124804698603, -1.0906140050141244, -1.1663632496410956, -1.246298574996229, -1.3296267192417082, -1.4152989975279409, -1.50199531072347, -1.5881210121061775, -1.6718228217237263, -1.751030360049399, -1.8235287027976639, -1.8870639164783136, -1.9394776436125218, -1.978859322774608, -2.0036975785277593, -2.0130083786636366, -2.0064189149414613, -1.9841932623522862, -1.9471968732908072, -1.8968084131956433, -1.8347958441161216, -1.7631769955165715, -1.6840832079309864, -1.5996396859286295, -1.511870163820357, -1.422628129370491, -1.3335530502320057, -1.246047911445233, -1.161273566507562, -1.0801554683497234, -1.0033988750036085, -0.9315093325955824, -0.8648159555010517, -0.8034956651190819, -0.7475970833187957, -0.6970632019439679, -0.6517522771036267, -0.6114566421131037, -0.5759193117195015, -0.544848376695872, -0.5179292737992605, -0.49483507108476266, -0.47523494042489345, -0.45880100402910917, -0.44521374473209574 ], [ -0.744196893202879, -0.7889734461683363, -0.8387513251493781, -0.8936906494830882, -0.953859560041983, -1.0192091849080331, -1.0895466183371736, -1.1645066674521707, -1.2435235372819087, -1.3258042311151028, -1.4103062917161762, -1.4957235958399508, -1.5804851111210543, -1.6627725023249886, -1.740562667766592, -1.8116999715282232, -1.8739994928838837, -1.9253769628397204, -1.9639940868487868, -1.988401599179919, -1.9976591136148691, -1.9914125224492303, -1.9699165763301267, -1.9340005041305315, -1.8849848990952052, -1.8245655156743794, -1.754682441900781, -1.6773915503207373, -1.5947507320623084, -1.5087280927614235, -1.4211345209057649, -1.3335795794455791, -1.2474476340445506, -1.1638902626129664, -1.083830918416529, -1.0079782017207781, -0.9368446806460706, -0.8707688312056603, -0.809938252426955, -0.7544128165280268, -0.7041468263998948, -0.65900957790591, -0.6188039737651932, -0.5832830216570652, -0.5521641836921418, -0.525141638133681, -0.5018965762049669, -0.4821056944670138, -0.46544806274918826, -0.4516105539607034 ], [ -0.7446934966629237, -0.7891126657824606, -0.8384312007580292, -0.8927953042595711, -0.9522595680279631, -1.016762634922124, -1.0861010487652156, -1.1599020802273232, -1.2375967401304289, -1.318394792560547, -1.4012643959346882, -1.4849200094231771, -1.567823264190969, -1.648202291308068, -1.7240949955197866, -1.7934203249269696, -1.8540782047771462, -1.904073496974252, -1.9416530088316937, -1.9654389983400775, -1.974539983582868, -1.968621546166943, -1.947926276808404, -1.9132412929444083, -1.8658209994264707, -1.8072792940181868, -1.739467875846711, -1.6643559452268053, -1.583922745522727, -1.5000697291652412, -1.4145548978189317, -1.3289487237761919, -1.2446091286529797, -1.1626720875278667, -1.0840542422703747, -1.0094641609008086, -0.9394193502515615, -0.8742666702888168, -0.8142043243224769, -0.7593040670018506, -0.7095326654128503, -0.66477196682999, -0.6248371762160294, -0.5894931367615517, -0.5584685474536248, -0.5314681520669085, -0.5081830022526012, -0.48829894060575296, -0.47150347368323775, -0.4574912148874213 ] ], "zauto": true, "zmax": 2.0198043524865152, "zmin": -2.0198043524865152 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.7112238718241818, 0.7060020138051855, 0.7001877620346693, 0.6937741437892115, 0.6867729246998332, 0.6792195138138014, 0.6711778892700326, 0.6627450695430195, 0.6540544714292148, 0.6452773166988829, 0.6366211232556725, 0.6283243184062761, 0.6206462349876344, 0.6138522809926594, 0.6081949350057375, 0.6038923116424515, 0.6011070930670503, 0.5999292354514751, 0.6003656603958613, 0.6023390058823759, 0.6056957060207735, 0.6102217810608573, 0.6156633774329903, 0.6217486630833678, 0.6282081178680333, 0.6347912257319125, 0.6412786603845341, 0.6474899498808002, 0.6532871717143023, 0.6585754767150822, 0.663301252153196, 0.6674486145565723, 0.6710347570061451, 0.6741045221588672, 0.6767244621747088, 0.6789765902262109, 0.6809520204340079, 0.6827447188238046, 0.6844456261639241, 0.6861374414952389, 0.6878903529757572, 0.6897589582341295, 0.6917805288842798, 0.6939746543174126, 0.6963441687645128, 0.6988771469638941, 0.7015496685485699, 0.7043290119487505, 0.7071769467680182, 0.7100528410649352 ], [ 0.7096211197164418, 0.70414244955183, 0.6980350815274182, 0.6912889291609317, 0.6839132232794006, 0.6759418061822902, 0.6674385371291804, 0.6585023221364675, 0.649271074813456, 0.6399237034401599, 0.6306790530765085, 0.6217906924471865, 0.6135366333688655, 0.606203615542082, 0.6000665325050951, 0.5953648241007565, 0.5922789196682712, 0.5909106113405392, 0.5912710982425646, 0.5932791814102265, 0.596769998452631, 0.6015124706112156, 0.6072320625557304, 0.613634968040067, 0.6204303765799838, 0.6273486278375657, 0.6341543191101078, 0.6406544371865546, 0.6467021948116928, 0.6521974904131576, 0.6570848876648394, 0.6613498517655253, 0.6650137803628755, 0.668128192392768, 0.6707683201782949, 0.6730262980370673, 0.675004147041656, 0.6768068017668085, 0.6785354849563123, 0.6802817816210743, 0.6821227699133787, 0.6841175164501087, 0.6863051372205118, 0.6887044762638904, 0.691315289795658, 0.694120675077489, 0.6970903784224616, 0.7001845709992067, 0.7033576956200861, 0.7065620507855694 ], [ 0.7080426425286886, 0.7023176189765912, 0.6959291796879693, 0.6888640070966443, 0.6811285553461653, 0.6727547079942378, 0.6638056426676688, 0.6543814096314592, 0.6446235043302524, 0.634717471072068, 0.6248923669598587, 0.6154158301869973, 0.6065836597716536, 0.5987033603871201, 0.5920721175472456, 0.5869510717702188, 0.5835392382716476, 0.5819514239988877, 0.5822044470944797, 0.5842145950146154, 0.5878068743222669, 0.5927340347936576, 0.5987015213470237, 0.6053939548097717, 0.6124993948289668, 0.619728984062843, 0.626831013191103, 0.6335995667840436, 0.6398785598832563, 0.6455622017051985, 0.650592863475122, 0.6549571260421574, 0.6586805501528503, 0.6618215168141415, 0.664464360648261, 0.6667119737133503, 0.6686780813555997, 0.6704794628954883, 0.6722284770937346, 0.6740263202310269, 0.6759574611922908, 0.6780856424829721, 0.6804517063387694, 0.6830733195792847, 0.6859464647629137, 0.6890483801124234, 0.6923415021443013, 0.6957779125830421, 0.699303814990063, 0.7028636500214285 ], [ 0.7064890410611812, 0.7005294458355498, 0.6938736689611661, 0.6865050880416333, 0.6784271741507643, 0.6696694808048551, 0.6602939381382538, 0.6504009591616706, 0.6401346199482437, 0.6296859034475686, 0.6192927472177746, 0.6092355009560115, 0.5998265184285716, 0.5913931413827367, 0.5842543957057357, 0.5786932655738748, 0.5749281125870209, 0.5730880469685576, 0.5731971400662326, 0.5751709208569729, 0.5788259301639849, 0.5839001641129593, 0.5900801251308482, 0.5970295610760271, 0.6044157293068116, 0.6119305654825642, 0.6193057636113138, 0.6263220112881824, 0.6328133144803835, 0.6386675596465077, 0.6438243631802941, 0.6482710146873478, 0.6520370540560497, 0.6551878065020939, 0.6578170696311298, 0.6600391097567329, 0.6619801698677859, 0.6637697928486321, 0.6655323836976261, 0.6673795303488932, 0.6694036334860696, 0.6716733341187204, 0.6742310697709196, 0.677092859462958, 0.6802501600638138, 0.6836734064592669, 0.6873166913393356, 0.6911229816106598, 0.6950293056242042, 0.6989714552914538 ], [ 0.7049580959071955, 0.6987764988720481, 0.6918681836972709, 0.6842131828514022, 0.6758118046520996, 0.6666909159976765, 0.6569106292665629, 0.6465709059418039, 0.6358173294123548, 0.6248450011313117, 0.6138992254238683, 0.6032714627565057, 0.5932890978308886, 0.584298072315019, 0.5766385238709636, 0.5706152409149076, 0.5664666622606156, 0.564337645866589, 0.5642614839625306, 0.5661551620872682, 0.5698289277788423, 0.5750079122416407, 0.5813611218348956, 0.5885323632602444, 0.5961685085346403, 0.6039422408662849, 0.6115682374587945, 0.6188131030988383, 0.6255001021566723, 0.6315099387848592, 0.6367787001885993, 0.6412937931127417, 0.6450884038686403, 0.6482347763647309, 0.6508364673205737, 0.6530197110386645, 0.6549240953978877, 0.6566928870492642, 0.6584635036748364, 0.6603587618029374, 0.6624795782086911, 0.6648997351258781, 0.667663127790896, 0.6707836267937296, 0.674247366720036, 0.6780169875471262, 0.682037165542874, 0.6862407059392208, 0.6905545254652474, 0.6949049965044305 ], [ 0.7034445590560799, 0.6970537205048773, 0.6899080280890895, 0.6819841471593104, 0.6732790555302806, 0.6638165788850074, 0.6536544287785971, 0.6428912670264786, 0.6316730484897054, 0.6201975737723536, 0.608715858157835, 0.5975286866114966, 0.5869767325522566, 0.577423075833391, 0.5692280508248625, 0.562718118048335, 0.5581525766814799, 0.5556937000573692, 0.5553863469791739, 0.5571516485123997, 0.5607962164800955, 0.5660346187694382, 0.572520094128928, 0.5798775679077107, 0.5877339267174466, 0.5957424238330138, 0.603600090730644, 0.6110585148488812, 0.6179291278995048, 0.6240843455099019, 0.6294557306128307, 0.634030028987215, 0.6378435928688972, 0.6409754523583509, 0.6435391535450267, 0.6456734660007768, 0.647532158251644, 0.649273216460847, 0.6510480886881319, 0.6529917105832134, 0.6552141424308159, 0.6577945739675587, 0.6607782216013733, 0.6641762892625191, 0.6679687657112893, 0.6721094797709686, 0.6765326067921856, 0.6811597510846255, 0.6859068103184903, 0.6906900143109679 ], [ 0.7019400652140725, 0.6953523068251642, 0.6879840149519479, 0.6798084654917687, 0.6708191305714849, 0.6610364235936679, 0.6505150444298583, 0.6393514652126101, 0.6276908173077219, 0.6157321016907067, 0.6037302875415759, 0.5919935777161794, 0.5808740636848432, 0.570750388384865, 0.56200210605691, 0.5549772512508773, 0.5499569341631634, 0.5471228236166275, 0.5465341189839029, 0.5481192615492062, 0.5516843205936575, 0.5569359203278249, 0.5635134165031358, 0.5710239029487426, 0.579074532260247, 0.5872987070341993, 0.5953748917087094, 0.603038418297074, 0.6100875067626048, 0.6163849211564666, 0.6218564865886262, 0.6264873313872406, 0.6303163539539378, 0.6334291362015994, 0.6359493776579636, 0.6380289180257541, 0.6398365403626195, 0.6415459690336017, 0.6433237391811861, 0.6453178402652093, 0.6476481420381033, 0.650399533351656, 0.6536184254375158, 0.6573128367490757, 0.6614557843505373, 0.6659912760856208, 0.6708419255205109, 0.6759171416603877, 0.681120960733568, 0.6863588270162413 ], [ 0.7004331762096377, 0.6936597571520409, 0.6860825205230884, 0.6776713100584585, 0.6684158879193772, 0.6583328458160468, 0.6474732135857181, 0.6359303278975198, 0.6238472393746592, 0.6114225847371203, 0.5989134654375011, 0.5866335405236266, 0.5749444169093483, 0.5642387379320751, 0.5549143861317493, 0.5473410601911821, 0.5418229418692576, 0.5385634980655278, 0.5376395300100546, 0.5389904254529596, 0.5424251709538376, 0.5476452616529254, 0.5542780546389883, 0.5619136873166278, 0.5701395305788243, 0.5785683513670391, 0.5868587485835863, 0.5947282077131975, 0.6019600498522043, 0.6084057688143965, 0.6139840335224777, 0.6186772380111689, 0.6225260836538362, 0.6256223769329597, 0.6281000684906136, 0.6301245609940342, 0.6318804668363769, 0.6335582686925006, 0.635340662710348, 0.6373896530348254, 0.6398356127558797, 0.6427694461047623, 0.6462386537131275, 0.6502475714971037, 0.6547614494280816, 0.6597135117547019, 0.6650138182965308, 0.6705586790244572, 0.6762395339264875, 0.6819505151540831 ], [ 0.6989095636030769, 0.6919601002478761, 0.6841857655274048, 0.6755528893676273, 0.6660472698043425, 0.6556812070924294, 0.6445013339301715, 0.6325968326600572, 0.6201073449332668, 0.6072295187550919, 0.5942207294432411, 0.5813981318306566, 0.5691310034663498, 0.5578245612562852, 0.547894360632109, 0.5397322072268794, 0.5336670823423822, 0.5299272021153116, 0.5286107894462342, 0.5296722865083051, 0.5329273494529638, 0.5380752177476053, 0.544732960586439, 0.552474278831359, 0.5608662535733357, 0.5694997416997698, 0.5780117181928415, 0.5860998353493148, 0.5935305102002402, 0.6001421044300389, 0.6058445321005849, 0.610616203070423, 0.6144987775806149, 0.6175898788736336, 0.6200337391148713, 0.6220097604130991, 0.6237191547144681, 0.625370152232814, 0.627162667877476, 0.6292736790987413, 0.6318447659856573, 0.6349731852000812, 0.638707454632763, 0.6430477806976427, 0.6479509232534423, 0.6533384588057087, 0.6591070257046154, 0.6651390758243972, 0.671312873806509, 0.6775108685534212 ], [ 0.6973523254508446, 0.6902342916956031, 0.6822723155812492, 0.6734290786109929, 0.66368609432803, 0.6530508232679662, 0.6415646863679003, 0.6293116025775826, 0.6164263934799629, 0.6031020324997746, 0.5895942887384285, 0.5762218924278568, 0.5633600731351115, 0.5514254314470687, 0.5408509078955389, 0.532051362778026, 0.5253829277147408, 0.5211022022606232, 0.5193332963964757, 0.5200503042941131, 0.5230795363554473, 0.528120779567835, 0.5347821800868539, 0.5426209842978856, 0.5511828520208144, 0.5600348422745399, 0.5687900097945039, 0.5771237564663559, 0.5847832712463035, 0.5915917009229378, 0.5974484598069196, 0.6023266262039095, 0.6062679026745399, 0.6093752559307405, 0.6118031608862057, 0.6137453797051365, 0.6154204149872606, 0.6170551586942935, 0.6188677397760948, 0.6210510250899779, 0.6237584884892078, 0.6270940892911357, 0.6311073377569777, 0.6357939485968064, 0.6411015922482002, 0.6469394934801623, 0.653190190441585, 0.6597217234899443, 0.6663988104587136, 0.6730920412198264 ], [ 0.6957424240107911, 0.6884607641902248, 0.6803177763834191, 0.6712722996016011, 0.6613011680661842, 0.6504063656849374, 0.6386231877061201, 0.6260290778374599, 0.6127525319946475, 0.598981093946832, 0.5849670250547124, 0.5710287642529964, 0.5575459338715217, 0.5449456234922819, 0.5336783252354304, 0.5241835203931461, 0.5168475965076039, 0.5119599859457795, 0.5096759024967004, 0.5099942300672218, 0.5127561261983054, 0.5176645597324451, 0.5243196210907972, 0.5322613760588862, 0.5410121527377207, 0.5501125928571854, 0.559148924720439, 0.5677714240546533, 0.5757054159983785, 0.5827565592994475, 0.5888119194102319, 0.5938378407517623, 0.5978751129472631, 0.6010315251589142, 0.603471684424563, 0.6054039735245332, 0.6070647545879977, 0.6087003647323816, 0.6105480204102605, 0.612817299053644, 0.6156742025175209, 0.6192297445338746, 0.6235344654864593, 0.6285793516427365, 0.6343025684971472, 0.6406005160408922, 0.6473412146497635, 0.6543780108044012, 0.6615619647902068, 0.6687518651313666 ], [ 0.6940592230254498, 0.686616101030479, 0.6782956430987859, 0.6690525957657937, 0.6588586475885951, 0.6477095819294274, 0.6356335546038185, 0.6227002159231749, 0.6090301287693474, 0.5948035716573417, 0.5802673604575084, 0.5657378136697064, 0.5515975334273995, 0.5382834961265662, 0.5262643838869074, 0.5160065324529304, 0.50793053116517, 0.5023640265305882, 0.4994994295258438, 0.49936618929798215, 0.5018247461509439, 0.5065836717075342, 0.5132352591080458, 0.5213008144543941, 0.5302765039144742, 0.5396730915368078, 0.5490463975001454, 0.5580182147167919, 0.5662890698024186, 0.5736447064617648, 0.5799579361549903, 0.5851869605611284, 0.5893707010322529, 0.5926212212482791, 0.5951130756031969, 0.5970694008101611, 0.5987448154777054, 0.6004056890369895, 0.602309006401424, 0.6046817184679059, 0.6077028929229287, 0.611490935667507, 0.6160975338829047, 0.6215088795309822, 0.6276534680156973, 0.6344147092635404, 0.6416460253087115, 0.6491861233475013, 0.6568726065717966, 0.6645527865649965 ], [ 0.6922810970471786, 0.6846757942995054, 0.6761782508511136, 0.666738830078422, 0.6563235533833569, 0.6449212089458793, 0.6325517139246938, 0.6192755104807112, 0.6052035208756881, 0.5905068314495348, 0.5754248112555267, 0.5602698200236697, 0.5454261076437378, 0.5313401509773653, 0.5184998608641864, 0.5074012863088769, 0.49850401909068925, 0.4921803181301679, 0.48866690429141396, 0.48803036223875756, 0.49015520818317604, 0.49475785660481825, 0.5014224001679297, 0.509648845110576, 0.5189033244710421, 0.5286623232487286, 0.5384469352215213, 0.5478466136062952, 0.556533868843581, 0.5642719893092613, 0.5709176243370958, 0.5764194711143473, 0.5808136708964807, 0.584216011844136, 0.5868107367948608, 0.5888357151915422, 0.5905639945570827, 0.5922822965171528, 0.5942677848053535, 0.596765217371496, 0.5999671191234299, 0.6039995930579515, 0.6089156848693519, 0.6146969445953407, 0.6212623516179615, 0.6284825457573867, 0.6361966809303089, 0.6442292775186597, 0.6524050365668267, 0.6605604088912178 ], [ 0.6903860818493737, 0.6826150442336555, 0.6739377659510176, 0.6642999232291518, 0.6536613243993586, 0.642002929605831, 0.6293352642009684, 0.6157080771376222, 0.601220857035957, 0.5860334748169256, 0.5703757533417928, 0.5545541728562315, 0.5389532628720668, 0.5240286740318895, 0.5102888101715146, 0.49826276371672606, 0.4884547023200531, 0.4812889451039521, 0.4770548074056508, 0.47586359985852583, 0.47762928090133006, 0.4820782993920345, 0.488785505036594, 0.49722603937400756, 0.5068309893214704, 0.5170371247611181, 0.5273256974861773, 0.5372494440030491, 0.5464493747659425, 0.554663712544173, 0.5617310907326704, 0.5675894462053023, 0.5722713208503551, 0.5758957052714301, 0.5786562024593993, 0.5808052154161141, 0.5826341183331569, 0.5844499672904724, 0.5865501655046862, 0.5891974090970036, 0.5925978726550071, 0.596885607377639, 0.6021153383931819, 0.6082643892454522, 0.6152427610717981, 0.6229089992854479, 0.6310887947846189, 0.6395933807850417, 0.6482354967024759, 0.65684165414581 ], [ 0.6883525347833225, 0.6804095558242012, 0.6715471564691238, 0.6617060472749812, 0.6508392976915741, 0.6389192174176167, 0.6259457825126874, 0.6119565384127796, 0.5970376937068281, 0.5813357914745089, 0.5650688780029195, 0.548535461335787, 0.5321187867540313, 0.5162831800514076, 0.5015587445482147, 0.4885111336654188, 0.4776952312344218, 0.4695958661749416, 0.4645645517962208, 0.4627662337001598, 0.46415058931950387, 0.4684565013433389, 0.47524800887502683, 0.48397078496001844, 0.49401463079042307, 0.5047700347594095, 0.5156724258481472, 0.5262329013425162, 0.536057237336725, 0.5448559567311743, 0.5524479399211941, 0.558759278465864, 0.5638182435449628, 0.5677465708850643, 0.570746838007863, 0.573085589057818, 0.5750721066169516, 0.5770333642277535, 0.5792866440678767, 0.5821123414612263, 0.5857302244519156, 0.5902824680791147, 0.5958259166184311, 0.6023343815099468, 0.6097098584448221, 0.6177999836439465, 0.6264183102772193, 0.6353641616438551, 0.6444396555841689, 0.6534625910680388 ], [ 0.6861597770970334, 0.6780362929841128, 0.6689810863789356, 0.6589296971383474, 0.6478280063256932, 0.6356389242181067, 0.6223507823672809, 0.6079874515061892, 0.5926200129413034, 0.5763795064679675, 0.559469820394815, 0.5421791356422102, 0.524887469604025, 0.5080668611376683, 0.4922698752333824, 0.4781020056324479, 0.4661751996373421, 0.4570440811901961, 0.4511333979000282, 0.44867232748175284, 0.44965393518436525, 0.45383255569286474, 0.46075954974830863, 0.4698455155160503, 0.48043142204081274, 0.49185366707780753, 0.50349492397437, 0.514819146420196, 0.5253929052579795, 0.5348964164020233, 0.5431272573115773, 0.5499988329693847, 0.5555346831149374, 0.5598589401249079, 0.5631827342219422, 0.5657861618030984, 0.5679956534863113, 0.5701572399283343, 0.5726072466015906, 0.5756431060232428, 0.5794978339905811, 0.5843218089479162, 0.5901745544761845, 0.597027402594884, 0.6047757792170255, 0.6132581323909901, 0.6222777402002745, 0.6316238755529037, 0.6410897671228384, 0.6504860169770476 ], [ 0.6837886964301433, 0.6754741592820311, 0.6662166893164074, 0.6559465780644257, 0.6446022092205448, 0.6321364917774548, 0.6185251604225704, 0.6037770613354247, 0.5879463748656071, 0.5711464505175298, 0.5535644920834464, 0.5354756661845513, 0.5172542576539085, 0.4993782701066443, 0.4824225781466511, 0.4670349876565018, 0.4538905190876765, 0.44362337648431394, 0.43674404635819886, 0.4335586525436472, 0.434113360653704, 0.43818219933846553, 0.4453020438192952, 0.454841893114585, 0.4660849344293768, 0.47830426994119274, 0.4908218114796254, 0.5030482309410474, 0.5145067023281128, 0.524844617213468, 0.5338369711691602, 0.5413839690141308, 0.5475042395126195, 0.552324123147491, 0.5560628751940436, 0.5590133700649794, 0.5615180784924589, 0.5639407660068182, 0.5666354637621368, 0.5699155272560052, 0.5740265592680288, 0.5791271071561049, 0.5852800444812908, 0.5924555696550005, 0.600544431582888, 0.6093781357167137, 0.6187520659286204, 0.6284477601949515, 0.6382516520943899, 0.6479689203413161 ], [ 0.6812222962466392, 0.672704586395637, 0.6632341948681191, 0.6527362700706633, 0.6411415971214961, 0.6283927080033813, 0.6144520204331002, 0.599312223567549, 0.5830089918663417, 0.5656358666970165, 0.5473607395482534, 0.5284427164077672, 0.5092471402636103, 0.4902551334953367, 0.4720622992554868, 0.45535972264899166, 0.4408904152408853, 0.42937787729804, 0.421432194345149, 0.41745172468496083, 0.41754833884630765, 0.42152207779127504, 0.42889411375905295, 0.4389845296745514, 0.4510082315069658, 0.4641641980416028, 0.4777043279589613, 0.49097917200504404, 0.5034641230407126, 0.514771406955253, 0.5246525353871226, 0.5329944254503204, 0.5398109744070227, 0.5452307576339706, 0.5494807592769626, 0.5528656972637939, 0.5557426445150226, 0.5584913297163904, 0.5614816577241845, 0.5650413424245134, 0.5694275923641217, 0.5748069610629575, 0.5812464286445506, 0.5887166828203163, 0.5971060982558463, 0.6062419520955575, 0.6159145727268224, 0.6259004748073866, 0.635981698199337, 0.6459599842012892 ], [ 0.6784461888434677, 0.6697120257032845, 0.6600174004086575, 0.6492826581723068, 0.6374311564442293, 0.6243949782099782, 0.6101228273217834, 0.5945904238178285, 0.5778136109736091, 0.5598641828150742, 0.5408880791635187, 0.5211249769495173, 0.5009272954049655, 0.48077508671676966, 0.4612811746660134, 0.4431786052109891, 0.4272812392960438, 0.41441065090442364, 0.40529137970243556, 0.40043230545286523, 0.4000275636731292, 0.40391276820992617, 0.4115934989444132, 0.4223329617056797, 0.4352654853668592, 0.4495031312585525, 0.4642170500013086, 0.47869005971684814, 0.49234525716937066, 0.5047576663812883, 0.5156549286149731, 0.5249111267765478, 0.5325360466479484, 0.5386607944707387, 0.5435197570367727, 0.5474284361284082, 0.5507567780603594, 0.5538982977910085, 0.5572364921879607, 0.5611114545960456, 0.5657907148994697, 0.5714485319079285, 0.5781567940701856, 0.5858885087899683, 0.5945322980507156, 0.6039142915408605, 0.6138229569646145, 0.6240328015644732, 0.6343241044920601, 0.6444973111424666 ], [ 0.6754490385247854, 0.6664843531205601, 0.6565540025958168, 0.6455741467747723, 0.6334612134866553, 0.6201371369721153, 0.6055369171673106, 0.5896189134673087, 0.572378209436648, 0.5538632224378502, 0.5341954247673955, 0.5135914874854185, 0.49238619291281843, 0.47105287349434155, 0.4502157438153188, 0.4306454290248476, 0.41322629567250085, 0.3988846084419337, 0.38847447483457337, 0.3826368600026732, 0.3816699492230943, 0.38545928108372235, 0.3934972751087845, 0.40498179544470514, 0.4189520856436002, 0.4344180254763814, 0.45045749974457744, 0.466277169159068, 0.4812433226326574, 0.4948922488426839, 0.5069280289174517, 0.5172130353307105, 0.5257540797055565, 0.5326854064614104, 0.5382485791501104, 0.5427687360664653, 0.5466267320089238, 0.5502273578657348, 0.5539650495663129, 0.5581899547274338, 0.5631783756489969, 0.5691118319404916, 0.5760679117967576, 0.5840238797796289, 0.5928714144315627, 0.6024388022098518, 0.6125160635674087, 0.622878900056204, 0.6333086023924204, 0.6436065524509681 ], [ 0.6722229701983016, 0.6630132105346449, 0.6528358221783016, 0.6416037047230415, 0.6292272210749235, 0.6156188808192236, 0.6007004633200117, 0.5844130818883032, 0.5667306381666255, 0.5476769919863403, 0.5273469246316052, 0.5059305045953599, 0.4837396033842294, 0.4612337898837363, 0.43904032853853103, 0.4179593402240805, 0.39894094793988993, 0.3830189936046621, 0.3711912722419383, 0.36425562137824996, 0.3626426845001726, 0.36630905124343094, 0.3747400234049355, 0.38705923689058547, 0.4021934620507754, 0.4190319702046819, 0.43654475712999247, 0.4538531433759044, 0.4702623615329741, 0.4852692261991362, 0.49855549029345403, 0.5099737413788293, 0.5195295274377514, 0.527361165243152, 0.533717279416972, 0.5389314390847405, 0.543393267120081, 0.5475160759919473, 0.5517023194711954, 0.5563096203815355, 0.5616212955858754, 0.5678255360209764, 0.5750063450760691, 0.5831471667874359, 0.5921455738985333, 0.6018353654901722, 0.6120115851452151, 0.6224543803686303, 0.632948862367908, 0.6432996039273596 ], [ 0.6687639647070621, 0.6592943171521952, 0.6488589712385826, 0.6373688106311738, 0.6247293834288092, 0.6108449502675474, 0.5956250668804289, 0.5789942794821478, 0.5609054773595813, 0.5413573555210792, 0.5204162522790604, 0.4982422597484276, 0.47511879897389797, 0.451483521605007, 0.4279560076245583, 0.4053537693552466, 0.3846824801826311, 0.3670809143241399, 0.3537018050570927, 0.34552721107868273, 0.34315659161668427, 0.34664788966303556, 0.3554905476918205, 0.3687246197258554, 0.38514314205258904, 0.4034923280069287, 0.42261731339125685, 0.44154439820115515, 0.4595142229125227, 0.47598458367430246, 0.49061731012037674, 0.5032580382221554, 0.5139133457647911, 0.5227268528098947, 0.5299542151779378, 0.5359361786764437, 0.5410688732895645, 0.5457712290265234, 0.5504506420126074, 0.5554694821637386, 0.5611161793415574, 0.5675848640327599, 0.5749665262976013, 0.5832525670090226, 0.5923491495306749, 0.6020988108575359, 0.6123049747799819, 0.6227553946856121, 0.6332417423956017, 0.6435739887865042 ], [ 0.6650722645163875, 0.6553277891351333, 0.6446240210978492, 0.6328713830711117, 0.6199722384048653, 0.6058242251763495, 0.5903261927341721, 0.5733873840894224, 0.5549404828414415, 0.5349590737446399, 0.5134799292376997, 0.4906302727533132, 0.46665965424001843, 0.44197504133228893, 0.41717569482458466, 0.3930805860749166, 0.37073468907408186, 0.3513717930261055, 0.3363054675900949, 0.32673028387224146, 0.32345966185427605, 0.32669502980872406, 0.33594833918719424, 0.35016600394376857, 0.36798085673996694, 0.3879686833351818, 0.40883047608417683, 0.42948794535249424, 0.44911500224507006, 0.46713255860590536, 0.48318632630560876, 0.4971187640376425, 0.5089402858275508, 0.518801247002544, 0.526964320190185, 0.5337761065971987, 0.5396369007376163, 0.5449682825853844, 0.5501794712578134, 0.5556348106902517, 0.561625865420325, 0.5683518384581875, 0.5759110731040559, 0.5843044388967604, 0.5934490857001671, 0.6031992110476335, 0.6133697012375414, 0.6237588489563229, 0.6341674572446756, 0.6444129885887834 ], [ 0.6611528111167233, 0.6511185048498302, 0.640136230089939, 0.6281177843997892, 0.6149643254952447, 0.600568914468321, 0.5848217017264261, 0.5676184522775651, 0.5488730816010715, 0.5285348121552091, 0.5066104600468294, 0.4831921955165411, 0.4584908092011589, 0.43287385881864676, 0.4069066202335276, 0.3813906124032668, 0.35738805723018485, 0.33620938251691485, 0.31932670243655037, 0.3081734099035104, 0.30383046507846534, 0.30669920054584376, 0.316341624976933, 0.33159930849726516, 0.3509116623878704, 0.37265113551814666, 0.3953535973580084, 0.417827808900362, 0.4391811197976912, 0.458801850336363, 0.4763249126219293, 0.4915941987208478, 0.5046270932546303, 0.5155821434326388, 0.5247289182581412, 0.5324184353749077, 0.5390527466353117, 0.5450531190945938, 0.5508275262147108, 0.5567395599006197, 0.5630819262108718, 0.5700579105742276, 0.5777733263487834, 0.5862396624143177, 0.5953870206513817, 0.6050837361016084, 0.6151588284428491, 0.6254237201922686, 0.6356906577018523, 0.6457865143992135 ], [ 0.6570157283121644, 0.6466765452860287, 0.6354058822857634, 0.6231189788864944, 0.6097180605105762, 0.595094015744593, 0.5791307284803598, 0.5617128051479747, 0.5427374011992211, 0.5221307832940121, 0.49987017992228155, 0.476011381985736, 0.45072243549331487, 0.42432351757889475, 0.3973323817035178, 0.3705127341663943, 0.3449175560509436, 0.32190708287579134, 0.3030989107812763, 0.29018519827631484, 0.28457390416276546, 0.2869383235907652, 0.296929229642493, 0.31327049739611695, 0.33416685696299664, 0.3577492093009616, 0.38236719427559873, 0.40671110863292387, 0.4298251975147805, 0.4510719403923811, 0.47008214728702735, 0.4867062795582781, 0.5009718296060064, 0.513046758821681, 0.5232071393454457, 0.531806771306125, 0.5392469878288503, 0.5459458310699087, 0.552307082625857, 0.5586909760413217, 0.5653894035273027, 0.5726086378120643, 0.5804618071138324, 0.5889717497182307, 0.5980829681388102, 0.6076798662977103, 0.6176077569165791, 0.62769335106751, 0.6377623204132075, 0.6476526425942783 ], [ 0.6526768536108147, 0.6420177248179046, 0.6304487710151243, 0.6178909051526081, 0.604249913099421, 0.5894171906626693, 0.5732731193123172, 0.5556938583245007, 0.536562275678547, 0.5157836517404573, 0.49330670228063, 0.46915042344308383, 0.44343730352473953, 0.41643358650488155, 0.3885973782886472, 0.3606348265714333, 0.33356131742609196, 0.30875339152521275, 0.2879489497980238, 0.273106998852892, 0.2660219330019882, 0.2677253908539849, 0.2780081108453766, 0.2954616567519251, 0.31800669558823125, 0.34349103159074656, 0.37005965818051106, 0.3962837268295212, 0.4211518578474017, 0.4440097625610222, 0.4644917151707329, 0.48245984641310696, 0.4979544345672297, 0.5111535212305341, 0.5223388235905547, 0.5318650054630821, 0.5401301182693069, 0.5475461445106808, 0.5545098979091176, 0.5613758182956393, 0.568433108272259, 0.5758898519719279, 0.5838660680719545, 0.5923962349963545, 0.6014401503976032, 0.6108996226012218, 0.6206378492854164, 0.6304985008706723, 0.6403222760097086, 0.6499596829549982 ], [ 0.6481583039663392, 0.6371642073650112, 0.6252868357591522, 0.6124550910641221, 0.598580942725549, 0.5835591498586332, 0.5672695771471723, 0.5495829178319739, 0.5303705566398313, 0.5095191855317166, 0.48695067594419517, 0.4626476869957608, 0.43668565240603546, 0.4092722678473769, 0.38079648427120083, 0.3518900355973358, 0.3235039928602559, 0.2969948183415611, 0.2741844603096909, 0.25728958063628404, 0.24854043518141716, 0.24942143482374243, 0.2599265882426597, 0.2784999386136604, 0.3027233933633763, 0.3301214749062598, 0.3586228114949584, 0.38668534557697376, 0.41325356175484873, 0.43766696729574955, 0.45957077304499405, 0.47884305159132085, 0.49553853476059145, 0.5098451140701724, 0.5220486444358018, 0.5325023682968582, 0.5415983858686944, 0.5497398756669035, 0.5573141053021625, 0.5646674883620427, 0.5720847733748771, 0.579774628954925, 0.5878632967366805, 0.596396766399932, 0.6053504812795644, 0.6146443922489281, 0.624160593058784, 0.6337608743032559, 0.6433021559387437, 0.6526486084887272 ], [ 0.6434890434629228, 0.6321451788101543, 0.6199489297869062, 0.6068394989293189, 0.592737696254165, 0.5775445719250052, 0.5611425674302907, 0.5434000370916865, 0.5241798840398703, 0.5033528968694052, 0.4808162301273995, 0.45651744552250006, 0.43048477538276625, 0.40286501665276403, 0.3739720132284045, 0.344351184942222, 0.3148679805214813, 0.28682488734966044, 0.2620847734183334, 0.2430922921691415, 0.2325395322492669, 0.23245232101170604, 0.24309932928012626, 0.26276512439762906, 0.28864084061084755, 0.31789701352067407, 0.3482453158855931, 0.37804367533424704, 0.40620667826469903, 0.43207804626730795, 0.45531996300906225, 0.4758289788557746, 0.49367439176969186, 0.5090525239394457, 0.5222510742955603, 0.5336191620671756, 0.5435401520228811, 0.5524057732847669, 0.5605913804826145, 0.5684333480424936, 0.5762103405263576, 0.5841303665816411, 0.5923250243390141, 0.6008513167045748, 0.6097001884358558, 0.6188099136720597, 0.6280819380039258, 0.6373968326176662, 0.6466285215008208, 0.655655660502473 ], [ 0.6387054010293048, 0.6269975205550624, 0.614471661776817, 0.6010795441820165, 0.5867534115389665, 0.5714035026756491, 0.5549179328503939, 0.537165883316186, 0.5180048640767216, 0.4972926185903409, 0.47490405797042945, 0.4507535718241604, 0.42482335858313053, 0.3971993608942116, 0.36811845198132914, 0.3380342181103213, 0.3077137552480845, 0.278379909953251, 0.251893598143823, 0.23087881305688757, 0.21847820711905294, 0.21731916262629017, 0.22801421066084793, 0.2486876446603342, 0.2761057239096323, 0.3070747575860074, 0.3391032243742603, 0.3704680203818987, 0.40006815571582327, 0.42725961268238916, 0.45172469643452606, 0.473378414818376, 0.49230277967060054, 0.5086997605889768, 0.5228557657179775, 0.5351126700616344, 0.5458422165682136, 0.5554221491835639, 0.5642137597534697, 0.5725415966619598, 0.5806767617786269, 0.588825376471893, 0.5971233849352517, 0.6056380066839684, 0.6143751249773394, 0.6232910307964159, 0.6323064773098095, 0.6413210120650449, 0.6502259504687317, 0.6589149482650302 ], [ 0.6338514681726071, 0.6217664041648322, 0.6089002212067754, 0.5952191864756907, 0.5806694130484692, 0.5651731034164152, 0.5486270600641225, 0.5309044173170187, 0.5118603980156533, 0.4913426699234874, 0.4692066614388953, 0.4453361403728708, 0.41966968905277957, 0.39223478723880717, 0.3631936233294068, 0.33290928493442307, 0.3020480397136869, 0.27174004878875757, 0.24380984128115743, 0.22100040865402887, 0.20684799449311156, 0.20458467985351245, 0.21521550003103213, 0.23672661117701554, 0.2654650817305035, 0.29789439552399005, 0.33134806732645394, 0.3640429456812368, 0.3948733883056061, 0.4232111296879623, 0.4487577340575056, 0.4714436054207347, 0.49135949770415327, 0.508708874770012, 0.5237729248036426, 0.5368827901319378, 0.5483956396161108, 0.5586728220923601, 0.5680596359087414, 0.5768672423323992, 0.5853578640769022, 0.5937345579450382, 0.6021365181391571, 0.6106401650990139, 0.6192654292403169, 0.6279859129678949, 0.6367412076447285, 0.6454496231097114, 0.6540198910477513, 0.6623608861147554 ], [ 0.6289792925861534, 0.6165057063115824, 0.6032890684329562, 0.5893119533052992, 0.5745365343942059, 0.5588995498387741, 0.5423093530344563, 0.5246460718486456, 0.5057657426202906, 0.4855090357939992, 0.4637149519438406, 0.44023980349930075, 0.41498215475830946, 0.38791556036187735, 0.35913355330995295, 0.3289163222841744, 0.29783674688862966, 0.2669332945339458, 0.2379741550263052, 0.21376027768187778, 0.19812133172300952, 0.19481666653197569, 0.20524839806734302, 0.2273209705324955, 0.25702966824474016, 0.29055499017468994, 0.3250945853050147, 0.3588234757420371, 0.3906359848141704, 0.41991727463084433, 0.4463829393701246, 0.4699727121556385, 0.49078016027132215, 0.5090048934319208, 0.5249182992211059, 0.5388370300430483, 0.5511007181462431, 0.5620520544120496, 0.5720186323609276, 0.5812968863122953, 0.5901390118210049, 0.598743902336701, 0.6072528756851374, 0.6157503972947758, 0.6242693177819256, 0.6327995409484808, 0.6412986861852309, 0.6497032679133375, 0.6579391409894373, 0.6659303460086984 ], [ 0.6241487759692922, 0.6112781299334219, 0.5977023500375102, 0.5834217276832129, 0.5684163645971009, 0.552639834351696, 0.536014706191977, 0.5184310368066618, 0.4997487862492287, 0.47980486082899426, 0.4584252416653791, 0.43544259962211096, 0.4107201819860123, 0.384183976070595, 0.3558678421549599, 0.3259814262053159, 0.29501927800967875, 0.26394093773372246, 0.2344537008218035, 0.2093640463085498, 0.19266608141112926, 0.18848565200449735, 0.19856514159574581, 0.2208197302266582, 0.25103084008997567, 0.2851926559698811, 0.32041166720411285, 0.35483347896901757, 0.3873499488930076, 0.41735186518669715, 0.44455988082109044, 0.46891456707380186, 0.49050486874085575, 0.5095203161504944, 0.5262174750432768, 0.5408946098180022, 0.5538709095378846, 0.5654683148055658, 0.5759952213890283, 0.5857322105330005, 0.594920472763656, 0.603753740095334, 0.6123743449010982, 0.6208735724132926, 0.6292959174459983, 0.6376463618028614, 0.6458994869849458, 0.6540091810943185, 0.6619178623673188, 0.6695644437081761 ], [ 0.6194271860575333, 0.6061549148211233, 0.5922138919028889, 0.5776231172044906, 0.5623820946817044, 0.5464631993020014, 0.5298056422898753, 0.5123122320407383, 0.4938500039433618, 0.4742555548097462, 0.45334568723050905, 0.43093393100887056, 0.40685391934228077, 0.38099183214326393, 0.35333277032842386, 0.3240308990949495, 0.29352154541735065, 0.2627046768017969, 0.23323266268718118, 0.20787633441855113, 0.19065662067543074, 0.18584920786255987, 0.19542259250095623, 0.21741519455355518, 0.24758640202597784, 0.2818671744497897, 0.317319880067768, 0.35206820392151794, 0.38499417189011076, 0.41548287147807295, 0.4432487396040548, 0.4682232372753015, 0.49048236645650733, 0.5101988676034046, 0.5276092617482827, 0.5429895231964728, 0.5566356150255467, 0.5688468287098664, 0.5799110857900166, 0.5900921926133923, 0.5996195246591434, 0.6086807702886081, 0.6174182221322225, 0.6259287497095445, 0.6342671415879946, 0.6424521023639668, 0.65047393310482, 0.6583028602853885, 0.6658970923892732, 0.6732099163143863 ], [ 0.6148882058530806, 0.6012150314872117, 0.5869066297953361, 0.5720012254748793, 0.5565187419075315, 0.5404519289047766, 0.5237587850470298, 0.5063575675434766, 0.48812560180007947, 0.46890290288105585, 0.44850142532459925, 0.4267207521062328, 0.40337146250988665, 0.3783086229431752, 0.3514803494314595, 0.32300098745693345, 0.2932660139506705, 0.26313560546533843, 0.23421557474970486, 0.2092071104849365, 0.19202943772029205, 0.18688389500857977, 0.19582276912532098, 0.21711052626629923, 0.24669000628172502, 0.28056267345658376, 0.3157964914553572, 0.3505003567265379, 0.3835382793204357, 0.41427762837341614, 0.442414823079443, 0.46786188621256664, 0.4906733218134531, 0.5109982763582573, 0.5290480344839662, 0.5450725055980821, 0.5593418324680495, 0.5721309741815965, 0.5837063163513307, 0.5943141631307994, 0.604171427593588, 0.6134589964929306, 0.6223181498697917, 0.6308501407911744, 0.6391186865267978, 0.6471547955771781, 0.654963138339752, 0.6625291027545539, 0.6698257526494492, 0.6768200835431983 ], [ 0.610610468727068, 0.5965437781484961, 0.581871362494049, 0.5666506709355468, 0.5509225526141247, 0.5347012540091843, 0.5179653720681074, 0.5006511466092257, 0.4826494552457088, 0.46380773349463367, 0.4439379025887525, 0.42283142458558515, 0.4002830374753914, 0.3761258407278526, 0.3502826415623907, 0.3228424772104499, 0.2941775816034535, 0.2651235349677212, 0.23724309381281725, 0.2131351565204406, 0.1965091193255547, 0.19130580731106114, 0.19952908015818951, 0.2197357954780094, 0.24822631878932364, 0.2812002360256119, 0.31578518387877075, 0.35008742040189283, 0.3829481994913661, 0.41370716184686346, 0.44203198537035193, 0.4678054965072459, 0.491052482649592, 0.5118919477043914, 0.5305049917592816, 0.5471119350179001, 0.561954757388213, 0.5752826419091995, 0.587339592440367, 0.5983538699633351, 0.6085294338041835, 0.6180397381442274, 0.6270241755977609, 0.6355872483336601, 0.6438002672195243, 0.6517051154344184, 0.65931943135845, 0.6666425000385225, 0.6736611909651204, 0.6803554125958711 ], [ 0.6066755665005759, 0.5922307426587701, 0.5772047569741136, 0.5616737441599806, 0.5456994323399407, 0.5293181752731242, 0.5125305742740299, 0.4952931480915829, 0.47751356323388416, 0.4590508765616021, 0.439722177937834, 0.41931710961599633, 0.3976221580224401, 0.3744575813675535, 0.3497316863586117, 0.3235203742745749, 0.29618468598735787, 0.26854356531476997, 0.24211180921899758, 0.21935212365981238, 0.2036821489079018, 0.19865819977511914, 0.20613959433364734, 0.2249960721442817, 0.25199928747726935, 0.28365401688822695, 0.3172053694448522, 0.3507772989018961, 0.38318983001752976, 0.41374873905868875, 0.442084475304253, 0.46804220734004237, 0.4916095932922666, 0.5128695103617268, 0.5319683702140758, 0.5490937539331797, 0.5644574564484794, 0.5782817112153759, 0.5907875172549706, 0.6021847330431117, 0.6126640222584641, 0.6223909010683848, 0.6315021058518027, 0.6401043391182261, 0.6482752305216062, 0.6560661372909493, 0.6635062571028558, 0.6706074645716059, 0.6773693110738138, 0.6837837259814701 ], [ 0.6031655670348854, 0.5883671480060734, 0.5730065982543227, 0.5571776627341526, 0.5409623236911664, 0.5244190860011821, 0.5075714702626899, 0.4903982192352379, 0.47282686090268616, 0.45473230818263927, 0.43594220732601635, 0.41625089795409526, 0.3954442356535027, 0.37333828304908284, 0.34983621135277704, 0.32500997223319184, 0.29921631440009455, 0.273257998544298, 0.24858909631245, 0.22750280999862335, 0.21307144932174638, 0.2084060440396864, 0.21516749725322432, 0.2325209019861505, 0.25775711470795304, 0.28776264721549455, 0.31995717528021395, 0.3525104990321122, 0.3842300416985481, 0.41438635449103656, 0.4425671353587896, 0.4685732845217682, 0.49234913823950993, 0.5139363286190125, 0.5334427294111141, 0.5510205442374904, 0.566849762538329, 0.5811248056697659, 0.5940432820746419, 0.6057964700539525, 0.6165615397392098, 0.6264956850834674, 0.6357323247433353, 0.6443794078403158, 0.6525196864300543, 0.6602126458030644, 0.6674976586398199, 0.6743978727349322, 0.6809243570938261, 0.6870801036050945 ], [ 0.6001601342334623, 0.5850426676546234, 0.5693763549274102, 0.5532709704133877, 0.5368275468649046, 0.5201261747499722, 0.5032136258330714, 0.4860923160854655, 0.46871234649131865, 0.45096850717879455, 0.4327042770771174, 0.41372507742217673, 0.3938233845604973, 0.37281879732673134, 0.3506168682625812, 0.327291580055131, 0.30319743326819854, 0.27911534683203953, 0.25642125360104906, 0.23721048146852955, 0.2241841978360523, 0.21999813366720433, 0.2260959686125811, 0.24189795857490842, 0.2652074451731891, 0.2933342548022063, 0.32392217307507365, 0.3552194141188793, 0.38603561727353697, 0.41560964682529905, 0.4434843280996864, 0.469412005509817, 0.4932891314160626, 0.5151121618330132, 0.534947470467759, 0.5529099128595499, 0.569146549474232, 0.5838234892738073, 0.5971148234771971, 0.6091932584872646, 0.6202224128321479, 0.6303508891394985, 0.6397082304469542, 0.6484027753305706, 0.6565212885985232, 0.6641301075355093, 0.6712774411557499, 0.6779964103705743, 0.6843084236414353, 0.6902265359999981 ], [ 0.5977334002512164, 0.5823418686284055, 0.5664092182243791, 0.5500592282996815, 0.5334102302321478, 0.5165627073270169, 0.49958634989545037, 0.4825080451070161, 0.465302585296, 0.44788814162139007, 0.43012882739170577, 0.41184699322401064, 0.3928482036324481, 0.3729620365740186, 0.3521018628688182, 0.33034659269705613, 0.3080465425764637, 0.2859512958494492, 0.2653407437985491, 0.2480932005249855, 0.2365377077747897, 0.23289936750267395, 0.2384096693045908, 0.2526954019805283, 0.27402871905500104, 0.3001504292293971, 0.32896378493691075, 0.3588273551301358, 0.38857183178707466, 0.417412330758399, 0.4448482815982836, 0.4705819115215473, 0.49445926194770656, 0.5164292019542934, 0.53651477561381, 0.5547923528407972, 0.5713755404281039, 0.5864020524966219, 0.6000226203503161, 0.6123915788653338, 0.6236590729404908, 0.6339649521581443, 0.6434344222384516, 0.6521754464403983, 0.6602777803132808, 0.6678134138552777, 0.6748381120214403, 0.6813937023995926, 0.6875107609239436, 0.6932113862038857 ], [ 0.5959507887639952, 0.5803405059970879, 0.5641918570143838, 0.5476402496463938, 0.5308190797088738, 0.5138474217072682, 0.49681683627644685, 0.4797786909849418, 0.46273376373360914, 0.4456262760916337, 0.42834492274724734, 0.41073389085969186, 0.3926171440391803, 0.37383913342982455, 0.3543243855066206, 0.3341569920300137, 0.31367844276334295, 0.2935962213873977, 0.2750795706647899, 0.2597824248598488, 0.24968076204193532, 0.24661405091715924, 0.2516204502829315, 0.264485751142412, 0.2838873032894228, 0.3079761805587871, 0.3349321702903875, 0.3632504122746986, 0.39180258586892097, 0.41979131487392235, 0.4466775777602241, 0.47211488837539356, 0.49589870776248224, 0.5179297160038892, 0.5381871490668255, 0.5567087348525634, 0.57357479103905, 0.5888950209542907, 0.6027972581544117, 0.6154178624486087, 0.6268937138146541, 0.6373558450190266, 0.646924748911521, 0.6557073329529093, 0.6637954048016526, 0.6712654854313858, 0.6781796797457365, 0.6845873001706188, 0.6905269389101337, 0.6960287149177953 ], [ 0.5948660202886913, 0.5791019407977791, 0.5627981996370547, 0.5460992213825615, 0.5291508507218257, 0.5120884049969421, 0.4950235490423281, 0.4780312623320716, 0.4611385917859656, 0.44431736723080495, 0.4274836200310727, 0.41050699865791074, 0.3932337524214739, 0.37552646071324264, 0.3573222704838591, 0.33870880710746765, 0.32001288649691173, 0.30189024611521376, 0.28539076496747956, 0.2719486111341096, 0.263219918421111, 0.2607128124874934, 0.26529746052944664, 0.2768771402515978, 0.2944640883921878, 0.31657877440486804, 0.3416758438081008, 0.3684037566391501, 0.3956931669509496, 0.4227472012509751, 0.44899623636148256, 0.4740493831637403, 0.49765384023978393, 0.5196634693684125, 0.5400147081630701, 0.5587075620629696, 0.5757899697005519, 0.5913445016570101, 0.6054768693014445, 0.6183060471204711, 0.6299559806997408, 0.6405489085594154, 0.6502003093176757, 0.6590154279848021, 0.667087261643234, 0.6744958148083445, 0.6813083823008587, 0.6875805904134522, 0.6933579273977615, 0.6986775185197608 ], [ 0.5945185378302501, 0.5786739733202743, 0.5622855913002652, 0.5455041166201267, 0.5284849752116378, 0.5113769386547861, 0.49430935009156307, 0.47737904027191735, 0.460638496299207, 0.4440874187546791, 0.42767050516606364, 0.4112849860027612, 0.39480174072345425, 0.37810319390040453, 0.36113915703272853, 0.3439981770320561, 0.32698683731291117, 0.3107024043771551, 0.2960736121225351, 0.2843296048152233, 0.2768479692580062, 0.2748613254345637, 0.27909880117935726, 0.28954732968311225, 0.3054859009092336, 0.3257522295277811, 0.3490582691682199, 0.37421155393296, 0.40021529241507636, 0.4262860525225584, 0.451833392198458, 0.4764288106590053, 0.4997759035870688, 0.5216850288486754, 0.5420523300902256, 0.5608420944440425, 0.5780715383234974, 0.5937974653641103, 0.6081045426051451, 0.6210951287818048, 0.6328806732332378, 0.643574715123468, 0.6532874785271117, 0.6621220016959055, 0.6701716755037844, 0.6775190094954231, 0.6842354031099661, 0.6903816794800943, 0.6960091406280309, 0.7011609232527587 ], [ 0.5949315689548865, 0.5790863673476943, 0.5626916710422927, 0.5459018164111985, 0.5288788364151994, 0.5117818709223125, 0.49475497500561544, 0.47791425139570526, 0.4613356979762458, 0.4450458034321293, 0.42901774990572644, 0.41317690342777813, 0.39741962242685663, 0.38164861761647306, 0.3658255678322004, 0.35003731137015187, 0.3345661262974955, 0.31994794743484745, 0.306995077232468, 0.2967533911779953, 0.2903658881030271, 0.2888420975523242, 0.2927957206518064, 0.3022710312199414, 0.31675286464418434, 0.3353405360633675, 0.3569747639325336, 0.3806176544383555, 0.40535281679021995, 0.4304215505646645, 0.455223124247744, 0.47929995830130506, 0.5023186188955311, 0.5240509724008837, 0.5443567203494132, 0.5631674257681503, 0.5804719214403734, 0.5963030508799136, 0.6107257825204179, 0.6238267828864962, 0.6357055308333063, 0.6464670172504149, 0.656216018922301, 0.6650528740911995, 0.6730706299419047, 0.6803533854825035, 0.6869756217027616, 0.6930022967303706, 0.6984894868363394, 0.7034853722098245 ], [ 0.5961109892353409, 0.5803492867205843, 0.5640322596910108, 0.5473153152805873, 0.5303641586362381, 0.5133450785548497, 0.49641350420500296, 0.4797015702524992, 0.46330588757186975, 0.44727740641769304, 0.4316161847800701, 0.41627481606199856, 0.4011746817660129, 0.3862382955712294, 0.3714381309785716, 0.35685741339745025, 0.3427522096963286, 0.3295981583978093, 0.3181008425887704, 0.3091481730592476, 0.30369099076708433, 0.30256193798254316, 0.3062819807728592, 0.3149329429732636, 0.3281540407327449, 0.34525281464721064, 0.3653645583672039, 0.3875935717745332, 0.4111059370215934, 0.435176290834125, 0.4592037600249754, 0.48271106328597746, 0.5053355894574334, 0.5268169941887533, 0.5469834489578588, 0.5657375848820788, 0.58304274304932, 0.5989099692342716, 0.6133860904322281, 0.6265431213523387, 0.6384691589979942, 0.6492608360475106, 0.6590173240536726, 0.6678358091001685, 0.6758083076510013, 0.6830196502332492, 0.6895464359893655, 0.6954567518855308, 0.7008104552588346, 0.7056598350949228 ], [ 0.5980450781152856, 0.5824527794405607, 0.5663004541388974, 0.5497422840594568, 0.5329448818005138, 0.5160784979857714, 0.49930642416356474, 0.4827731481560877, 0.46659226343553345, 0.4508358510062694, 0.4355280492822023, 0.4206465613488264, 0.40613632088556617, 0.3919385940824616, 0.37803572537441177, 0.36450654818336725, 0.3515812803400578, 0.3396795051983313, 0.32941281999518807, 0.3215369443712057, 0.3168486826001446, 0.3160425783475831, 0.3195659699967469, 0.3275237399214371, 0.33966784153947815, 0.3554665239801644, 0.3742144781370697, 0.3951410426817298, 0.4174920637503376, 0.44058109221327235, 0.4638160360008365, 0.4867092639142984, 0.5088774010160894, 0.5300349045215212, 0.5499840068253687, 0.5686027354140765, 0.5858322098898314, 0.6016640823154908, 0.6161287347923999, 0.6292846430486041, 0.6412091467609419, 0.6519907328326779, 0.6617228336431468, 0.6704990644656907, 0.6784097688952149, 0.6855397048961084, 0.6919666843104085, 0.6977609730894359, 0.7029852658824317, 0.7076950644451506 ], [ 0.6007051726330963, 0.5853673394496348, 0.5694669977718041, 0.5531551189627328, 0.5365967316315479, 0.5199630420042268, 0.5034217187906023, 0.48712573931611486, 0.4712016187747381, 0.4557385712684443, 0.4407811877707476, 0.42632930528140206, 0.41234925568904723, 0.39879973432179827, 0.3856723972549683, 0.3730420602482561, 0.3611153420722917, 0.3502621268530178, 0.34101384521543043, 0.33401798219221435, 0.3299496382905735, 0.3293964971874963, 0.33274769852987635, 0.3401208169267305, 0.3513480512868259, 0.36601844463086597, 0.3835533174581259, 0.40328811664112607, 0.4245425099772795, 0.44667176595606606, 0.4690998144850409, 0.4913373083237288, 0.5129884127693213, 0.5337495809669911, 0.5534029648324518, 0.571806562379591, 0.5888827247383269, 0.6046062298056486, 0.6189927728510515, 0.6320884300426146, 0.6439604183800142, 0.6546892998054299, 0.6643626499493853, 0.673070123676608, 0.6808997916529181, 0.6879355874458449, 0.6942556877665989, 0.6999316452777541, 0.7050281007208165, 0.709602916213737 ], [ 0.6040471405629798, 0.5890454694380366, 0.5734818632547897, 0.5575024423848778, 0.5412685022888116, 0.5249494969083016, 0.5087141924477077, 0.4927202569381906, 0.47710295636247874, 0.4619643507661753, 0.44736542784180344, 0.43332471275922724, 0.41982741901946846, 0.40684827287624903, 0.3943880595381067, 0.38251884185992474, 0.371427113845391, 0.36144036578412553, 0.3530232148495972, 0.3467356668244489, 0.3431572219085126, 0.3427929184082194, 0.3459856815009548, 0.35285852028842535, 0.3632993584735748, 0.37698611577763413, 0.39343843000071316, 0.4120795312321934, 0.43229535658971263, 0.45348354540743857, 0.4750895131642337, 0.49662966903158806, 0.5177033846874218, 0.5379960081779614, 0.5572753595270475, 0.5753839527498186, 0.5922288191520597, 0.6077703771656019, 0.6220113819968005, 0.6349866352684078, 0.6467538550221169, 0.6573858979112328, 0.6669643780921595, 0.675574628671251, 0.6833018896674824, 0.6902285714199783, 0.6964324266250269, 0.7019854621727776, 0.7069534296167193, 0.7113957473955319 ], [ 0.60801352504325, 0.5934240767623263, 0.5782768649716244, 0.562711868011703, 0.5468848756286386, 0.5309612590604446, 0.5151079481280932, 0.49948378202619487, 0.48422878863670554, 0.46945365416645485, 0.4552316665311828, 0.44159648569580034, 0.4285495954484541, 0.41608038114921114, 0.40419882041354993, 0.39297596098317394, 0.3825821375357304, 0.3733097029712403, 0.36556832402294775, 0.35984750683561983, 0.3566513222437434, 0.35642025496506785, 0.3594599682145539, 0.3658939207175696, 0.3756478434484521, 0.3884641245611078, 0.40393773289832297, 0.4215635164334036, 0.44078587546065706, 0.4610440644804655, 0.4818088340147927, 0.5026084668606723, 0.5230442297114326, 0.5427966188189284, 0.5616244644629902, 0.5793590899052056, 0.5958954960824397, 0.6111821525043989, 0.6252105511997796, 0.6380052988904814, 0.6496152137964368, 0.6601056619952371, 0.6695522053194963, 0.6780355248832616, 0.6856375178745095, 0.6924384285817295, 0.6985148586569042, 0.7039384996829258, 0.7087754384643187, 0.7130858987347546 ], [ 0.6125361667145127, 0.5984274718211376, 0.5837690328376426, 0.5686937266913339, 0.5533504456033889, 0.5378985657484542, 0.522500685390318, 0.5073137331752595, 0.4924789209813214, 0.47811169707760953, 0.464293827858304, 0.4510707353949335, 0.43845765978633955, 0.4264573258644445, 0.4150890186265164, 0.4044245480824427, 0.39462191077426784, 0.38594482509362676, 0.3787578733879351, 0.3734933075206566, 0.3705947644224906, 0.37045122441886746, 0.3733375147822004, 0.379374171648931, 0.38851204947971524, 0.40054010442816795, 0.4151109628819172, 0.4317778363002814, 0.4500364517616358, 0.4693661825812279, 0.48926564639617065, 0.5092797671296283, 0.5290172646512494, 0.5481591869964357, 0.566460118432437, 0.5837440798097407, 0.5998970638689305, 0.6148578286698683, 0.6286081711945445, 0.6411635194704413, 0.6525643614074266, 0.6628687843933756, 0.6721462262760771, 0.6804724231346924, 0.6879254683067086, 0.6945828580417129, 0.7005193819411433, 0.7058057135933138, 0.7105075632590039, 0.7146852664716264 ], [ 0.6175390905597966, 0.6039707101830921, 0.5898644369528635, 0.5753453860712159, 0.5605545225699691, 0.5456437403398461, 0.5307692952436123, 0.5160836564536122, 0.5017262011253063, 0.4878138241242398, 0.47443343574539515, 0.4616392173889947, 0.4494578604738252, 0.43790414226738833, 0.4270066358461087, 0.4168393822164543, 0.4075512732785161, 0.39938275664207423, 0.3926611084317003, 0.38777127436627695, 0.38510725983460875, 0.3850156668949491, 0.38774492769724206, 0.39341039822448287, 0.4019793447183449, 0.4132746655478444, 0.42699369439156787, 0.44273777020071564, 0.46004795508647983, 0.4784419951025893, 0.497447913373108, 0.5166308258333896, 0.5356113307200578, 0.5540755109795319, 0.571777761308215, 0.5885382044919715, 0.6042365217095762, 0.6188037876054431, 0.6322135453370998, 0.6444729919158678, 0.6556148278843786, 0.6656900782486376, 0.6747620130521481, 0.6829011758428244, 0.6901814534947858, 0.6966770790214735, 0.7024604398916405, 0.7076005601221271, 0.7121621294698244, 0.7162049635376287 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -1.05354 (SEM: 0)
x1: 0.316215
x2: 0.617202
x3: 0.706244
x4: 0.442446
x5: 0.302538
x6: 0.689988", "Arm 1_0
hartmann6: -0.030375 (SEM: 0)
x1: 0.811902
x2: 0.397874
x3: 0.256599
x4: 0.587825
x5: 0.62507
x6: 0.198599", "Arm 2_0
hartmann6: -0.902763 (SEM: 0)
x1: 0.338193
x2: 0.15836
x3: 0.646144
x4: 0.317308
x5: 0.319267
x6: 0.282366", "Arm 3_0
hartmann6: -0.301255 (SEM: 0)
x1: 0.336418
x2: 0.780722
x3: 0.0755756
x4: 0.253823
x5: 0.0995698
x6: 0.695929", "Arm 4_0
hartmann6: -0.336963 (SEM: 0)
x1: 0.380861
x2: 0.550309
x3: 0.0991958
x4: 0.57631
x5: 0.428499
x6: 0.875051", "Arm 5_0
hartmann6: -0.015445 (SEM: 0)
x1: 0.567525
x2: 0.962826
x3: 0.634008
x4: 0.971757
x5: 0.0226276
x6: 0.529474", "Arm 6_0
hartmann6: -0.135364 (SEM: 0)
x1: 0.647436
x2: 0.919807
x3: 0.784123
x4: 0.144491
x5: 0.556692
x6: 0.19643", "Arm 7_0
hartmann6: -1.13977 (SEM: 0)
x1: 0.433622
x2: 0.632672
x3: 0.302698
x4: 0.416656
x5: 0.155608
x6: 0.200353", "Arm 8_0
hartmann6: -0.00326599 (SEM: 0)
x1: 0.895307
x2: 0.42466
x3: 0.221151
x4: 0.217061
x5: 0.806897
x6: 0.196305", "Arm 9_0
hartmann6: -0.61634 (SEM: 0)
x1: 0.394621
x2: 0.410424
x3: 0.236322
x4: 0.477136
x5: 0.448209
x6: 0.927047", "Arm 10_0
hartmann6: -0.28145 (SEM: 0)
x1: 0.452516
x2: 0.689018
x3: 0.00579017
x4: 0.819839
x5: 0.609085
x6: 0.359038", "Arm 11_0
hartmann6: -0.248956 (SEM: 0)
x1: 0.122639
x2: 0.808514
x3: 0.137789
x4: 0.29003
x5: 0.580703
x6: 0.217619", "Arm 12_0
hartmann6: -0.781035 (SEM: 0)
x1: 0.37559
x2: 0.517996
x3: 0.483859
x4: 0.397443
x5: 0.192537
x6: 0.314783", "Arm 13_0
hartmann6: -1.12781 (SEM: 0)
x1: 0.448282
x2: 0.596617
x3: 0.250143
x4: 0.389758
x5: 0.107677
x6: 0.0868881", "Arm 14_0
hartmann6: -2.15429 (SEM: 0)
x1: 0.438555
x2: 0.743162
x3: 0.2751
x4: 0.446701
x5: 0.134403
x6: 0.0995962", "Arm 15_0
hartmann6: -2.43007 (SEM: 0)
x1: 0.439368
x2: 0.776917
x3: 0.274371
x4: 0.451549
x5: 0.105622
x6: 0.0494945", "Arm 16_0
hartmann6: -2.69282 (SEM: 0)
x1: 0.436913
x2: 0.829443
x3: 0.275494
x4: 0.476369
x5: 0.0955716
x6: 0", "Arm 17_0
hartmann6: -2.70927 (SEM: 0)
x1: 0.465652
x2: 0.901557
x3: 0.250452
x4: 0.49551
x5: 0.10908
x6: 6.03384e-18", "Arm 18_0
hartmann6: -2.91547 (SEM: 0)
x1: 0.384509
x2: 0.895731
x3: 0.314697
x4: 0.503408
x5: 0.0981885
x6: 0", "Arm 19_0
hartmann6: -2.50301 (SEM: 0)
x1: 0.302235
x2: 0.905339
x3: 0.252056
x4: 0.524441
x5: 0.0825954
x6: 0.000194035", "Arm 20_0
hartmann6: -2.82202 (SEM: 0)
x1: 0.405389
x2: 0.926977
x3: 0.392935
x4: 0.485002
x5: 0.126163
x6: 6.1518e-17", "Arm 21_0
hartmann6: -3.1008 (SEM: 0)
x1: 0.405246
x2: 0.90671
x3: 0.340061
x4: 0.537696
x5: 0.0591464
x6: 0.0348358", "Arm 22_0
hartmann6: -3.11409 (SEM: 0)
x1: 0.41382
x2: 0.887716
x3: 0.378968
x4: 0.589816
x5: 0.047899
x6: 0.00971014", "Arm 23_0
hartmann6: -3.10013 (SEM: 0)
x1: 0.411794
x2: 0.914979
x3: 0.36451
x4: 0.564301
x5: 0
x6: 0.0143285" ], "type": "scatter", "x": [ 0.31621479988098145, 0.8119017668068409, 0.3381933942437172, 0.33641818165779114, 0.38086120691150427, 0.5675250813364983, 0.6474357806146145, 0.4336216617375612, 0.8953071711584926, 0.39462097827345133, 0.4525161050260067, 0.12263938784599304, 0.3755896340308345, 0.4482817211399737, 0.4385551133365825, 0.43936831990531183, 0.4369126822091619, 0.46565208109465495, 0.38450883035723354, 0.3022347855143226, 0.40538893434499135, 0.405246127088327, 0.4138195932142098, 0.41179425118329027 ], "xaxis": "x", "y": [ 0.6172017455101013, 0.39787373691797256, 0.15836010966449976, 0.7807221319526434, 0.5503091383725405, 0.9628264494240284, 0.9198073707520962, 0.6326719420030713, 0.42465960048139095, 0.41042422503232956, 0.689017596654594, 0.808514135889709, 0.5179962944903335, 0.5966169057608754, 0.7431621542588341, 0.7769166970485729, 0.8294433285334746, 0.9015569708214667, 0.8957310744874931, 0.9053391943541343, 0.9269769080164703, 0.9067101349859833, 0.8877161507779117, 0.9149793772943162 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -1.05354 (SEM: 0)
x1: 0.316215
x2: 0.617202
x3: 0.706244
x4: 0.442446
x5: 0.302538
x6: 0.689988", "Arm 1_0
hartmann6: -0.030375 (SEM: 0)
x1: 0.811902
x2: 0.397874
x3: 0.256599
x4: 0.587825
x5: 0.62507
x6: 0.198599", "Arm 2_0
hartmann6: -0.902763 (SEM: 0)
x1: 0.338193
x2: 0.15836
x3: 0.646144
x4: 0.317308
x5: 0.319267
x6: 0.282366", "Arm 3_0
hartmann6: -0.301255 (SEM: 0)
x1: 0.336418
x2: 0.780722
x3: 0.0755756
x4: 0.253823
x5: 0.0995698
x6: 0.695929", "Arm 4_0
hartmann6: -0.336963 (SEM: 0)
x1: 0.380861
x2: 0.550309
x3: 0.0991958
x4: 0.57631
x5: 0.428499
x6: 0.875051", "Arm 5_0
hartmann6: -0.015445 (SEM: 0)
x1: 0.567525
x2: 0.962826
x3: 0.634008
x4: 0.971757
x5: 0.0226276
x6: 0.529474", "Arm 6_0
hartmann6: -0.135364 (SEM: 0)
x1: 0.647436
x2: 0.919807
x3: 0.784123
x4: 0.144491
x5: 0.556692
x6: 0.19643", "Arm 7_0
hartmann6: -1.13977 (SEM: 0)
x1: 0.433622
x2: 0.632672
x3: 0.302698
x4: 0.416656
x5: 0.155608
x6: 0.200353", "Arm 8_0
hartmann6: -0.00326599 (SEM: 0)
x1: 0.895307
x2: 0.42466
x3: 0.221151
x4: 0.217061
x5: 0.806897
x6: 0.196305", "Arm 9_0
hartmann6: -0.61634 (SEM: 0)
x1: 0.394621
x2: 0.410424
x3: 0.236322
x4: 0.477136
x5: 0.448209
x6: 0.927047", "Arm 10_0
hartmann6: -0.28145 (SEM: 0)
x1: 0.452516
x2: 0.689018
x3: 0.00579017
x4: 0.819839
x5: 0.609085
x6: 0.359038", "Arm 11_0
hartmann6: -0.248956 (SEM: 0)
x1: 0.122639
x2: 0.808514
x3: 0.137789
x4: 0.29003
x5: 0.580703
x6: 0.217619", "Arm 12_0
hartmann6: -0.781035 (SEM: 0)
x1: 0.37559
x2: 0.517996
x3: 0.483859
x4: 0.397443
x5: 0.192537
x6: 0.314783", "Arm 13_0
hartmann6: -1.12781 (SEM: 0)
x1: 0.448282
x2: 0.596617
x3: 0.250143
x4: 0.389758
x5: 0.107677
x6: 0.0868881", "Arm 14_0
hartmann6: -2.15429 (SEM: 0)
x1: 0.438555
x2: 0.743162
x3: 0.2751
x4: 0.446701
x5: 0.134403
x6: 0.0995962", "Arm 15_0
hartmann6: -2.43007 (SEM: 0)
x1: 0.439368
x2: 0.776917
x3: 0.274371
x4: 0.451549
x5: 0.105622
x6: 0.0494945", "Arm 16_0
hartmann6: -2.69282 (SEM: 0)
x1: 0.436913
x2: 0.829443
x3: 0.275494
x4: 0.476369
x5: 0.0955716
x6: 0", "Arm 17_0
hartmann6: -2.70927 (SEM: 0)
x1: 0.465652
x2: 0.901557
x3: 0.250452
x4: 0.49551
x5: 0.10908
x6: 6.03384e-18", "Arm 18_0
hartmann6: -2.91547 (SEM: 0)
x1: 0.384509
x2: 0.895731
x3: 0.314697
x4: 0.503408
x5: 0.0981885
x6: 0", "Arm 19_0
hartmann6: -2.50301 (SEM: 0)
x1: 0.302235
x2: 0.905339
x3: 0.252056
x4: 0.524441
x5: 0.0825954
x6: 0.000194035", "Arm 20_0
hartmann6: -2.82202 (SEM: 0)
x1: 0.405389
x2: 0.926977
x3: 0.392935
x4: 0.485002
x5: 0.126163
x6: 6.1518e-17", "Arm 21_0
hartmann6: -3.1008 (SEM: 0)
x1: 0.405246
x2: 0.90671
x3: 0.340061
x4: 0.537696
x5: 0.0591464
x6: 0.0348358", "Arm 22_0
hartmann6: -3.11409 (SEM: 0)
x1: 0.41382
x2: 0.887716
x3: 0.378968
x4: 0.589816
x5: 0.047899
x6: 0.00971014", "Arm 23_0
hartmann6: -3.10013 (SEM: 0)
x1: 0.411794
x2: 0.914979
x3: 0.36451
x4: 0.564301
x5: 0
x6: 0.0143285" ], "type": "scatter", "x": [ 0.31621479988098145, 0.8119017668068409, 0.3381933942437172, 0.33641818165779114, 0.38086120691150427, 0.5675250813364983, 0.6474357806146145, 0.4336216617375612, 0.8953071711584926, 0.39462097827345133, 0.4525161050260067, 0.12263938784599304, 0.3755896340308345, 0.4482817211399737, 0.4385551133365825, 0.43936831990531183, 0.4369126822091619, 0.46565208109465495, 0.38450883035723354, 0.3022347855143226, 0.40538893434499135, 0.405246127088327, 0.4138195932142098, 0.41179425118329027 ], "xaxis": "x2", "y": [ 0.6172017455101013, 0.39787373691797256, 0.15836010966449976, 0.7807221319526434, 0.5503091383725405, 0.9628264494240284, 0.9198073707520962, 0.6326719420030713, 0.42465960048139095, 0.41042422503232956, 0.689017596654594, 0.808514135889709, 0.5179962944903335, 0.5966169057608754, 0.7431621542588341, 0.7769166970485729, 0.8294433285334746, 0.9015569708214667, 0.8957310744874931, 0.9053391943541343, 0.9269769080164703, 0.9067101349859833, 0.8877161507779117, 0.9149793772943162 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:12] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0293599132713191, 1.0291530482155902, 1.02929316394527, 1.0297870068482222, 1.030640222180626, 1.0318572825044061, 1.0334414229711966, 1.0353945845529788, 1.0377173662225383, 1.0404089869569153, 1.043467258277989, 1.0468885678621906, 1.0506678745544495, 1.054798714919441, 1.0592732212665656, 1.064082150903765, 1.0692149262179633, 1.0746596850528338, 1.0804033407605864, 1.0864316512429977, 1.0927292962642134, 1.0992799623067733, 1.1060664342447588, 1.1130706931141279, 1.1202740192619565, 1.127657100145854, 1.1352001420282045, 1.1428829847648374, 1.1506852188259329, 1.1585863036123283, 1.1665656860493732, 1.174602918360855, 1.1826777738562742, 1.1907703595143837, 1.1988612241225716, 1.2069314607416963, 1.2149628023139025, 1.2229377093186171, 1.2308394485085128, 1.2386521619192308, 1.24636092553777, 1.2539517972265435, 1.2614118537233638, 1.2687292167616322, 1.2758930685696521, 1.2828936572039504, 1.2897222923414655, 1.2963713322938097, 1.3028341631109166, 1.3091051707101218 ], [ 1.0234486634705415, 1.0231926691463715, 1.0232921922471139, 1.0237543967027294, 1.0245853094700286, 1.0257897439109798, 1.0273712303717004, 1.029331955187219, 1.031672709230932, 1.0343928469812542, 1.0374902568953583, 1.040961343668416, 1.044801022726386, 1.049002727063897, 1.0535584263092337, 1.0584586576895403, 1.0636925683922145, 1.069247968681194, 1.0751113950333933, 1.0812681825094184, 1.0877025455585076, 1.094397666470333, 1.1013357907145185, 1.1084983284390095, 1.115865961419895, 1.123418754757916, 1.1311362725955132, 1.1389976970806839, 1.1469819497324298, 1.1550678142728985, 1.1632340598917246, 1.1714595638087126, 1.1797234319128127, 1.188005116188706, 1.1962845276067553, 1.2045421431549777, 1.2127591057378293, 1.2209173157582143, 1.2289995133345646, 1.236989350280291, 1.2448714511806416, 1.2526314631330588, 1.260256093960002, 1.2677331389466113, 1.2750514963879302, 1.282201172441516, 1.2891732759633598, 1.2959600041518058, 1.3025546199332882, 1.3089514220939686 ], [ 1.0179153327227861, 1.0176103339536549, 1.0176690545148825, 1.0180990796200438, 1.018906822402376, 1.020097442017167, 1.0216747693077912, 1.0236412414025102, 1.025997846493794, 1.0287440798873244, 1.0318779121976824, 1.0353957703209609, 1.039292531543496, 1.0435615308665662, 1.04819458135699, 1.0531820070906588, 1.0585126880552085, 1.0641741162304106, 1.0701524619744995, 1.0764326498103205, 1.0829984427175614, 1.0898325340835775, 1.0969166465282552, 1.1042316368808915, 1.1117576066335753, 1.1194740172140696, 1.127359809404782, 1.1353935261815813, 1.143553438160588, 1.151817670730781, 1.1601643318263815, 1.1685716391688057, 1.1770180456963826, 1.1854823618144124, 1.1939438730485887, 1.2023824516801216, 1.210778660985995, 1.2191138508043722, 1.2273702432912923, 1.2355310079253192, 1.2435803250430322, 1.2515034374394738, 1.2592866898315394, 1.2669175562457313, 1.274384655642014, 1.2816777563122894, 1.288787769785652, 1.2957067351278841, 1.3024277946361724, 1.3089451620016446 ], [ 1.0127986347353855, 1.0124452973294458, 1.0124634965178498, 1.0128612396195018, 1.013645327685538, 1.0148212681169688, 1.0163931952157332, 1.0183638001979909, 1.0207342720747812, 1.023504250620348, 1.0266717924064335, 1.0302333505916337, 1.03418376883377, 1.038516289360785, 1.0432225749153259, 1.0482927440030205, 1.053715418645579, 1.059477783681113, 1.065565656571766, 1.0719635666692284, 1.078654842939679, 1.0856217092418237, 1.0928453863616674, 1.1003062001120607, 1.1079836948829114, 1.1158567520645644, 1.1239037127539444, 1.1321025040901473, 1.1404307684596688, 1.1488659946728137, 1.1573856500571682, 1.1659673122583523, 1.1745887993987165, 1.183228297136689, 1.191864481104878, 1.2004766331930596, 1.2090447501875736, 1.2175496433824262, 1.2259730279366607, 1.2342976009604107, 1.242507107558869, 1.250586394336471, 1.2585214501493818, 1.2662994341784461, 1.2739086916634745, 1.2813387578814683, 1.2885803511567664, 1.2956253558540565, 1.3024667964227392, 1.3090988036336622 ], [ 1.0081374565866204, 1.0077370388459288, 1.0077155402653195, 1.0080813878188881, 1.0088417691299545, 1.010002539406494, 1.011568136683761, 1.0135415070875857, 1.0159240417010746, 1.0187155264109318, 1.0219141058307617, 1.0255162620582405, 1.0295168086403286, 1.0339088997216976, 1.0386840539675746, 1.0438321925145608, 1.049341689939937, 1.0551994370704407, 1.0613909143836833, 1.0679002747829296, 1.0747104346312715, 1.0818031720863084, 1.089159231949076, 1.0967584363989915, 1.1045798011028587, 1.1126016562417615, 1.1208017719864947, 1.129157487871672, 1.137645845381131, 1.1462437228797293, 1.1549279718294834, 1.163675553032764, 1.1724636714725707, 1.1812699081864415, 1.1900723475308606, 1.1988496981748207, 1.2075814062098305, 1.216247758877803, 1.2248299775940998, 1.2333102991713387, 1.2416720444193445, 1.249899673593251, 1.25797882847058, 1.265896361143, 1.2736403498953959, 1.2812001028011537, 1.288566149878819, 1.2957302248251255, 1.3026852374604254, 1.3094252380951714 ], [ 1.0039705122658258, 1.0035249124691308, 1.0034651300757547, 1.0038000056506324, 1.0045371086092667, 1.0056826382886535, 1.007241333699828, 1.0092163938863978, 1.011609410678239, 1.0144203154003855, 1.0176473407758082, 1.0212869988587416, 1.0253340753759714, 1.0297816403708964, 1.0346210745804127, 1.0398421105709423, 1.0454328873550212, 1.0513800170308634, 1.0576686619433422, 1.064282620946771, 1.0712044235311395, 1.0784154308142895, 1.0858959426576842, 1.0936253103894022, 1.1015820547794855, 1.1097439889870104, 1.1180883461777098, 1.1265919114006537, 1.1352311571301263, 1.1439823816481016, 1.1528218491917481, 1.1617259305465981, 1.170671242553958, 1.1796347848408562, 1.1885940719859482, 1.1975272593142579, 1.206413260569146, 1.215231855839804, 1.2239637883191143, 1.2325908487196622, 1.241095946471112, 1.2494631671443877, 1.2576778158804136, 1.2657264469271414, 1.273596879692922, 1.2812782019942022, 1.2887607614014072, 1.2960361457626892, 1.3030971541085576, 1.3099377592126324 ], [ 1.0003359592382481, 0.9998477571593327, 0.9997517378322486, 1.00005714541495, 1.000771922572685, 1.0019026055219062, 1.003454228126571, 1.0054302372119428, 1.0078324211255767, 1.0106608533235721, 1.0139138523902576, 1.0175879594234587, 1.021677933163281, 1.0261767626537026, 1.0310756966585308, 1.03636428856505, 1.0420304551531883, 1.0480605474212, 1.0544394316531982, 1.0611505790743787, 1.0681761627266795, 1.0754971605542312, 1.0830934640508878, 1.0909439921324495, 1.0990268101087972, 1.1073192537197691, 1.115798058157868, 1.1244394918435776, 1.1332194944719896, 1.1421138185473991, 1.1510981733027257, 1.1601483695978865, 1.1692404641347836, 1.1783509011382693, 1.187456649545767, 1.1965353337300502, 1.2055653558490569, 1.2145260080682323, 1.2233975731245614, 1.2321614119832294, 1.2408000376624555, 1.2492971746513806, 1.257637803702484, 1.265808192126383, 1.273795910037569, 1.2815898332816538, 1.2891801340086775, 1.296558260037239, 1.3037169042788102, 1.310649965562391 ], [ 0.9972709806555954, 0.9967434709473368, 0.9966139295585981, 0.9968919900292444, 0.9975859556772585, 0.998702688478292, 1.0002475073593937, 1.0022240983463222, 1.0046344388747543, 1.0074787383029693, 1.0107553962394626, 1.014460979734064, 1.018590219708796, 1.0231360262813578, 1.0280895219335418, 1.033440090880922, 1.0391754425817843, 1.0452816871331505, 1.0517434203552505, 1.058543816638589, 1.065664728061031, 1.0730867887941284, 1.080789524319365, 1.088751465387886, 1.0969502669239375, 1.1053628321651905, 1.1139654422523086, 1.1227338912504627, 1.131643626247962, 1.1406698917809874, 1.1497878774275538, 1.1589728670415116, 1.1682003877926652, 1.1774463569641413, 1.1866872243455917, 1.1959001080527762, 1.2050629216963067, 1.214154491004198, 1.223154658260471, 1.2320443732383692, 1.2408057696636237, 1.249422226621375, 1.257878414701286, 1.2661603270410826, 1.2742552957640925, 1.2821519945984017, 1.2898404287052119, 1.2973119129267603, 1.3045590397884979, 1.3115756386585031 ], [ 0.9948113374616876, 0.9942485525488424, 0.9940888971586472, 0.9943423755672741, 0.9950176348585954, 0.9961218475334578, 0.997660603879799, 0.9996378168539902, 1.0020556421107933, 1.004914415529367, 1.0082126100989992, 1.0119468133577463, 1.016111725757913, 1.0207001794368629, 1.0257031759995878, 1.0311099411840556, 1.0369079937843815, 1.0430832260210257, 1.0496199926900764, 1.0565012068565929, 1.063708440491506, 1.0712220291693386, 1.079021180621131, 1.08708408746978, 1.0953880447935609, 1.103909573241352, 1.112624548272108, 1.1215083357545188, 1.1305359337018905, 1.1396821193998854, 1.1489216006741771, 1.1582291695938167, 1.1675798565514652, 1.1769490824255957, 1.1863128064202526, 1.195647667191842, 1.2049311149987467, 1.2141415328321004, 1.2232583447856982, 1.2322621102795352, 1.2411346031439843, 1.2498588749796982, 1.25841930261299, 1.266801619849796, 1.2749929340788537, 1.2829817285740208, 1.2907578515892113, 1.2983124935223405, 1.305638153547078, 1.312728597175641 ], [ 0.9929908965516294, 0.9923976165733647, 0.9922119612315903, 0.9924442823170767, 0.9931035493482799, 0.994197225843983, 0.9957311556807885, 0.9977094626362683, 1.0001344661348488, 1.0030066159137496, 1.0063244477794178, 1.010084561829776, 1.014281623516577, 1.0189083868066304, 1.0239557376058719, 1.02941275469358, 1.0352667848217598, 1.0415035284654803, 1.0481071329864713, 1.0550602906318507, 1.0623443396994958, 1.0699393681894425, 1.077824320155782, 1.0859771056399738, 1.0943747154243542, 1.1029933418744848, 1.111808506874262, 1.1207951973688761, 1.129928008406477, 1.1391812929008023, 1.148529316703618, 1.1579464170390033, 1.1674071619501825, 1.1768865081621975, 1.1863599546711976, 1.1958036894219333, 1.2051947266093423, 1.2145110324151966, 1.2237316373412588, 1.232836733702597, 1.2418077572756767, 1.2506274525342342, 1.2592799213328767, 1.2677506552969369, 1.2760265525334409, 1.284095919581752, 1.2919484597660205, 1.299575249292468, 1.3069687025527197, 1.314122528153681 ], [ 0.991841143319883, 0.9912228907032019, 0.9910160533303723, 0.991231302667228, 0.9918779048423497, 0.9929635905664629, 0.9944944354297822, 0.9964747540687293, 0.9989070116567369, 1.0017917558764269, 1.0051275719201833, 1.0089110621269126, 1.0131368506378735, 1.0177976120583585, 1.0228841217268583, 1.0283853240399696, 1.034288414568405, 1.0405789315671061, 1.047240852956127, 1.0542566958279198, 1.061607616819402, 1.0692735130242397, 1.077233124277636, 1.0854641384507169, 1.0939433017588804, 1.1026465360193363, 1.111549064355066, 1.1206255461450645, 1.1298502211879258, 1.139197062195866, 1.1486399339652644, 1.1581527569464625, 1.1677096724968197, 1.1772852068582758, 1.1868544308437987, 1.1963931123229545, 1.205877858835714, 1.21528624800317, 1.2245969438140676, 1.2337897973187568, 1.2428459307332773, 1.251747804424281, 1.2604792666924045, 1.2690255866819662, 1.277373471106456, 1.2855110657832634, 1.2934279432116003, 1.3011150776034217, 1.3085648088888904, 1.315770797270635 ], [ 0.991390689323448, 0.9907537058256827, 0.9905311888546179, 0.9907340971689215, 0.9913719632697131, 0.9924527570138788, 0.9939827598588125, 0.995966453658767, 0.9984064279657191, 1.0013033095112411, 1.0046557168771162, 1.0084602422612279, 1.0127114607484196, 1.0174019657438202, 1.0225224274628935, 1.0280616699079195, 1.034006760896175, 1.0403431096396956, 1.0470545671387832, 1.0541235260774198, 1.0615310186923324, 1.0692568128672266, 1.077279508162024, 1.0855766344151185, 1.0941247558787432, 1.1028995836040167, 1.1118760981044784, 1.1210286833559984, 1.1303312721031216, 1.1397575013844023, 1.1492808762734856, 1.158874939129817, 1.1685134411943117, 1.178170513149248, 1.1878208312637213, 1.1974397759280893, 1.20700357970075, 1.2164894624073086, 1.225875751309208, 1.2351419848657426, 1.2442689991247033, 1.2532389962726205, 1.262035595338747, 1.2706438654648282, 1.2790503425152415, 1.2872430301019206, 1.2952113863327648, 1.302946297759534, 1.3104400421046654, 1.3176862413908228 ], [ 0.9916647882692835, 0.9910159928896769, 0.9907839448753932, 0.9909798535541825, 0.9916134833736462, 0.9926930113390079, 0.9942248952881343, 0.9962137573845131, 0.9986622873378604, 1.0015711696319243, 1.0049390383258114, 1.0087624617187825, 1.013035957348867, 1.017752035596965, 1.0229012679139338, 1.0284723738142851, 1.0344523197214965, 1.040826422796709, 1.0475784540609794, 1.0546907371684267, 1.0621442416349807, 1.069918671653995, 1.0779925534132226, 1.0863433248323655, 1.094947431826611, 1.1037804346817373, 1.1128171270970837, 1.1220316691406063, 1.1313977339766834, 1.1408886669464193, 1.150477654523541, 1.160137899904849, 1.1698428015413336, 1.1795661307550325, 1.1892822046739995, 1.198966050997971, 1.208593561524537, 1.2181416318696894, 1.2275882853658762, 1.236912779682687, 1.2460956952654638, 1.2551190052066474, 1.2639661266400624, 1.2726219541687462, 1.2810728761956245, 1.2893067753181897, 1.2973130141721525, 1.3050824082653336, 1.3126071874357694, 1.319880947602641 ], [ 0.992684875886253, 0.9920318030006463, 0.9917969603579955, 0.9919917671154289, 0.9926261814257193, 0.9937085519402296, 0.9952454803023348, 0.9972416994924413, 0.9996999731390326, 1.002621020759173, 1.0060034731584173, 1.0098438607670126, 1.014136635499401, 1.0188742239770483, 1.0240471070710155, 1.0296439183069677, 1.0356515523652292, 1.0420552751272136, 1.048838828489815, 1.0559845260690126, 1.0634733392266926, 1.0712849758325527, 1.0793979562712797, 1.087789692189646, 1.0964365733948562, 1.1053140673903632, 1.1143968345673845, 1.1236588603569289, 1.1330736039423008, 1.1426141616289032, 1.152253441789584, 1.1619643475079071, 1.1717199626276138, 1.1814937368427902, 1.1912596656625194, 1.2009924614827117, 1.2106677125257046, 1.2202620270066877, 1.2297531605096466, 1.239120125171266, 1.2483432798563279, 1.2574044010468615, 1.266286734649221, 1.2749750293412814, 1.283455552431816, 1.2917160894839168, 1.2997459291641753, 1.307535834922143, 1.315078005184347, 1.3223660237707924 ], [ 0.9944681511044763, 0.9938188695796869, 0.9935884790681627, 0.993788564238393, 0.9944292354027334, 0.9955189744712026, 0.9970644919985934, 0.999070600667539, 1.0015401109535473, 1.004473754681706, 1.007870141467555, 1.0117257514209435, 1.0160349648989504, 1.0207901266980137, 1.0259816384008904, 1.0315980694754256, 1.03762627607816, 1.0440515169809177, 1.0508575586308018, 1.0580267654039757, 1.0655401755285727, 1.073377566868715, 1.0815175191073263, 1.0899374796674965, 1.0986138401794845, 1.107522028826422, 1.1166366219065296, 1.1259314757977232, 1.1353798784844737, 1.1449547181039537, 1.1546286647032673, 1.1643743606108818, 1.1741646144877078, 1.18397259416845, 1.1937720137398096, 1.2035373108355727, 1.213243810775803, 1.2228678748729558, 1.232387030923917, 1.241780084572322, 1.2510272108398948, 1.26011002567745, 1.2690116378690415, 1.2777166820328874, 1.2862113337996026, 1.2944833085118828, 1.3025218449832132, 1.3103176759796489, 1.3178629871544771, 1.3251513661768488 ], [ 0.9970272168378176, 0.9963902327121591, 0.99617195725724, 0.9963840932891828, 0.9970368590571611, 0.9981388292193192, 0.9996967869782613, 1.0017155931775987, 1.0041980787296083, 1.0071449668537205, 1.0105548309485937, 1.0144240921846919, 1.0187470579075915, 1.023515997818986, 1.0287212502730723, 1.0343513470055579, 1.0403931425199517, 1.0468319351452775, 1.053651570475631, 1.0608345234626098, 1.0683619612058206, 1.0762137929844273, 1.0843687165159244, 1.0928042698136748, 1.1014968968203067, 1.1104220328351366, 1.119554213174688, 1.1288672059153437, 1.1383341672520446, 1.1479278161502362, 1.1576206236640667, 1.1673850115563216, 1.1771935546310712, 1.1870191813813806, 1.196835368044995, 1.2066163218378845, 1.2163371499044706, 1.2259740113132713, 1.2355042501901692, 1.244906508789483, 1.2541608199398313, 1.2632486788604433, 1.2721530948213156, 1.280858623518517, 1.289351381355615, 1.2976190430669878, 1.3056508242930756, 1.313437450826548, 1.3209711162986488, 1.3282454300735516 ], [ 1.0003697979444206, 0.9997539453606858, 0.9995557581283826, 0.9997870074204636, 1.0004579732464272, 1.0015772812465156, 1.0031517507041698, 1.0051862599891601, 1.0076836363728021, 1.0106445774272776, 1.0140676106636302, 1.0179490962628157, 1.0222832743976225, 1.0270623537711963, 1.0322766322874068, 1.0379146356451026, 1.0439632569595616, 1.0504078816887958, 1.0572324872473442, 1.0644197141523195, 1.071950912918279, 1.0798061761605073, 1.0879643676645645, 1.0964031598612354, 1.1050990890810692, 1.1140276350253715, 1.1231633277239141, 1.1324798822679398, 1.1419503590659694, 1.1515473454218086, 1.161243152944844, 1.1710100246582122, 1.1808203455889381, 1.1906468509799164, 1.2004628269167061, 1.2102422989833665, 1.2199602054470402, 1.2295925523477884, 1.2391165486919795, 1.2485107206896782, 1.2577550046280714, 1.2668308185317194, 1.275721113228368, 1.284410403820369, 1.2928847828615007, 1.3011319167627, 1.309141027104019, 1.3169028586205074, 1.3244096356639705, 1.3316550089282233 ], [ 1.004498551041024, 1.0039128781496442, 1.003742952101919, 1.0040005609286642, 1.0046959990891273, 1.0058379011304934, 1.0074330866598613, 1.0094864231816716, 1.012000714213493, 1.0149766205080226, 1.018412621767644, 1.0223050244330258, 1.0266480175017634, 1.0314337727807161, 1.0366525791590933, 1.0422929941246704, 1.0483419923094042, 1.0547850924252657, 1.061606450719019, 1.0687889187703576, 1.0763140725765707, 1.0841622257162415, 1.0923124412333125, 1.1007425555821717, 1.1094292248929865, 1.118348000083266, 1.1274734336464367, 1.1367792176595282, 1.1462383498679605, 1.1558233227341905, 1.1655063291127552, 1.1752594776964285, 1.1850550114575202, 1.1948655228343756, 1.204664160225577, 1.214424821310788, 1.2241223297078874, 1.2337325924275113, 1.2432327364551188, 1.2526012235575834, 1.2618179430700835, 1.2708642829722485, 1.279723180016443, 1.2883791500330455, 1.2968182998155786, 1.3050283221901489, 1.3129984760063451, 1.3207195528586053, 1.3281838323651742, 1.335385027804969 ], [ 1.0094109754253875, 1.0088646334246762, 1.0087312352753715, 1.0090225335199468, 1.0097487895669168, 1.0109186055132298, 1.0125387674552144, 1.0146141070967363, 1.0171473893987069, 1.02013923451918, 1.0235880819407832, 1.02749020290696, 1.0318397635085403, 1.036628934699526, 1.0418480377421104, 1.0474857060060245, 1.0535290397930601, 1.0599637327870748, 1.0667741572371212, 1.0739434070175358, 1.0814533085304021, 1.089284415642508, 1.0974160059782094, 1.1058260934436759, 1.1144914677399291, 1.1233877671650019, 1.1324895868869265, 1.1417706213751357, 1.1512038369340214, 1.160761668349259, 1.1704162325386076, 1.1801395517276265, 1.1899037789149502, 1.1996814190805165, 1.2094455405471143, 1.219169971980112, 1.2288294815886538, 1.238399936102698, 1.247858438004001, 1.25718344027123, 1.2663548385585714, 1.2753540412701667, 1.284164018429863, 1.2927693305867793, 1.3011561392529862, 1.3093122005488977, 1.3172268438443315, 1.3248909372366584, 1.332296841710573, 1.3394383557851783 ], [ 1.0150994265901876, 1.0146015703489533, 1.0145129681932366, 1.014845285034598, 1.015608702645553, 1.0168117511575931, 1.0184611523359925, 1.0205616816031593, 1.023116056719964, 1.026124861542864, 1.0295865129362736, 1.0334972771574544, 1.037851338194548, 1.0426409142068254, 1.0478564098148884, 1.053486583514045, 1.0595187045504897, 1.0659386758023761, 1.0727311092067449, 1.079879354318382, 1.0873654927713794, 1.095170317766636, 1.1032733180277496, 1.1116526821378603, 1.1202853341513574, 1.1291470063365145, 1.1382123504811092, 1.1474550855840027, 1.1568481770195669, 1.1663640404130413, 1.1759747624767212, 1.1856523308383409, 1.1953688652925583, 1.2050968437378495, 1.2148093171385705, 1.2244801090199464, 1.2340839961488927, 1.2435968681065943, 1.25299586438488, 1.2622594884264753, 1.2713676986830975, 1.280301977295081, 1.2890453774148098, 1.2975825505164182, 1.30589975526811, 1.3139848497018383, 1.3218272685080479, 1.3294179873198768, 1.336749475840526, 1.343815641617598 ], [ 1.021551224601908, 1.0211109319577394, 1.0210753242824517, 1.0214559281627658, 1.022262801319333, 1.0235043654360814, 1.0251872511608742, 1.027316162311519, 1.02989376718337, 1.0329206252655596, 1.0363951572426573, 1.04031366434375, 1.0446703992596262, 1.049457684503842, 1.0546660655602618, 1.0602844773950124, 1.066300397732897, 1.0726999629097214, 1.079468032968811, 1.0865882078367728, 1.0940428092974364, 1.10181284976971, 1.1098780085937614, 1.118216632237255, 1.1268057691894697, 1.135621244870248, 1.1446377772556517, 1.1538291302632004, 1.1631682992556251, 1.1726277212864578, 1.1821795018641825, 1.1917956499390032, 1.2014483133500224, 1.211110007915412, 1.2207538345145743, 1.2303536797437618, 1.2398843969143825, 1.2493219652404173, 1.2586436259966485, 1.2678279952157319, 1.2768551531360386, 1.2857067111266418, 1.2943658572157566, 1.3028173816492226, 1.3110476841192844, 1.3190447644433034, 1.326798198547785, 1.3342991016349006, 1.3415400803858823, 1.348515175996413 ], [ 1.0287488406228584, 1.028375054385106, 1.028400524568995, 1.0288365915375741, 1.0296931479910199, 1.0309784748227524, 1.0326990895934653, 1.0348596146033795, 1.0374626722605205, 1.0405088156651234, 1.0439965017052677, 1.0479221120120579, 1.0522800232948724, 1.0570627224498201, 1.0622609537063925, 1.0678638767951731, 1.0738592103386642, 1.080233337268183, 1.0869713598991104, 1.0940571073126786, 1.10147311039559, 1.1092005659886452, 1.1172193110720743, 1.1255078233596463, 1.1340432587657379, 1.1428015305624597, 1.1517574303106335, 1.1608847869859178, 1.170156658115677, 1.179545545132544, 1.1890236244428232, 1.1985629857632603, 1.208135869917966, 1.2177148993097435, 1.2272732954996552, 1.2367850795941748, 1.2462252523444342, 1.2555699519450134, 1.2647965884519965, 1.2738839545172826, 1.2828123127665096, 1.2915634606461106, 1.3001207739472962, 1.3084692304967547, 1.3165954157000734, 1.3244875117467068, 1.3321352723465696, 1.3395299848777724, 1.346664421792069, 1.3535327830579365 ], [ 1.036670138135606, 1.036371630506429, 1.0364661258641152, 1.0369647344875663, 1.0378771475865616, 1.0392114777926542, 1.0409741126682417, 1.043169588023066, 1.0458004883476875, 1.048867381646357, 1.0523687950691019, 1.0563012356206098, 1.0606592564420256, 1.065435563457082, 1.070621149921012, 1.0762054393010858, 1.0821764131190323, 1.088520703156814, 1.0952236373945867, 1.1022692426929734, 1.1096402188898133, 1.117317904753776, 1.1252822558745184, 1.133511850256557, 1.1419839315982463, 1.1506744946072278, 1.1595584119715392, 1.1686095989881824, 1.1778012093429, 1.1871058540517634, 1.1964958349921173, 1.2059433846072305, 1.2154209040762978, 1.2249011933029514, 1.2343576673113066, 1.243764554905034, 1.253097076642676, 1.2623316002528786, 1.2714457725310133, 1.2804186275199008, 1.289230671391439, 1.2978639449274254, 1.3063020648639176, 1.3145302456297814, 1.3225353031915217, 1.3303056428262663, 1.3378312326942428, 1.3451035650819707, 1.3521156071468823, 1.3588617429216874 ], [ 1.0452886428227801, 1.0450739973422922, 1.045245326451964, 1.0458134714036893, 1.0467878904762389, 1.0481765054818097, 1.049985561522496, 1.0522195064397137, 1.054880896693134, 1.0579703361101898, 1.0614864528055732, 1.0654259173015113, 1.0697835012305437, 1.0745521709064707, 1.0797232039895683, 1.0852863119326117, 1.091229748367177, 1.0975403864596456, 1.1042037568453797, 1.1112040492512112, 1.1185240909052792, 1.1261453200598888, 1.13404777291608, 1.1422100985165304, 1.150609610849985, 1.1592223820433902, 1.168023375932162, 1.1769866177982755, 1.1860853936800901, 1.1952924712975537, 1.2045803341570689, 1.2139214206263058, 1.2232883605083733, 1.232654202707124, 1.2419926287917045, 1.2512781485061981, 1.2604862744363718, 1.2695936740870035, 1.2785782985149825, 1.2874194874026657, 1.2960980510507802, 1.3045963302351633, 1.3128982352228586, 1.3209892654963953, 1.3288565119050597, 1.3364886430615157, 1.3438758778434714, 1.3510099458528761, 1.3578840376397008, 1.36449274642114 ], [ 1.0545738174725252, 1.0544514198677972, 1.054707257780592, 1.0553518697132818, 1.0563944544144774, 1.0578427244240225, 1.0597027728151958, 1.0619789590758502, 1.064673820134302, 1.0677880119975038, 1.071320286129492, 1.0752675023835334, 1.079624676918287, 1.084385059189868, 1.0895402273701347, 1.0950801876238134, 1.1009934613728318, 1.1072671475220828, 1.1138869536459548, 1.1208371992727368, 1.1281008024446442, 1.1356592651727193, 1.1434926736206232, 1.151579725837079, 1.1598977952209255, 1.168423033025543, 1.1771305089384925, 1.1859943854845245, 1.1949881197755379, 1.204084684894316, 1.2132568028021435, 1.2224771809243011, 1.231718745303196, 1.2409548642375667, 1.2501595574919993, 1.2593076873431759, 1.2683751288434775, 1.2773389176791583, 1.2861773748561733, 1.2948702081576777, 1.3033985908902435, 1.3117452188840166, 1.3198943470497977, 1.3278318070387203, 1.3355450077115338, 1.343022920217149, 1.3502560495158968, 1.3572363941717362, 1.3639573961893268, 1.3704138825941736 ], [ 1.0644913252810628, 1.0644693527311464, 1.0648172418182302, 1.0655451994489697, 1.0666621421845377, 1.0681755573969762, 1.0700913772061567, 1.0724138705091397, 1.0751455582742018, 1.0782871565529433, 1.081837550230935, 1.0857937983141162, 1.0901511685695153, 1.0949031958367397, 1.1000417548519892, 1.105557135926004, 1.1114381114745449, 1.117671984086008, 1.1242446123632903, 1.1311404177152387, 1.138342381392003, 1.1458320445571473, 1.1535895244648537, 1.1615935574353857, 1.1698215754519552, 1.1782498189689075, 1.1868534847144157, 1.1956069042995596, 1.2044837474326417, 1.2134572424346504, 1.2225004064243072, 1.2315862778179354, 1.2406881444938707, 1.2497797619387103, 1.2588355567834364, 1.2678308122431015, 1.2767418330191005, 1.2855460881620466, 1.294222331204183, 1.302750697547314, 1.3111127796407391, 1.3192916809141109, 1.327272049755434, 1.3350400950581705, 1.3425835850165153, 1.3498918309361312, 1.3569556578605944, 1.3637673638008063, 1.370320669305655, 1.3766106590345835 ], [ 1.0750032747945828, 1.0750896735611701, 1.0755370086420468, 1.0763551304875207, 1.0775526533600417, 1.0791368241988177, 1.081113403461239, 1.083486562545838, 1.0862588021064767, 1.0894308947521472, 1.0930018542171895, 1.0969689310846453, 1.1013276326686037, 1.1060717619906835, 1.1111934684081057, 1.1166833010485904, 1.1225302565018687, 1.128721814629531, 1.1352439606229199, 1.1420811965149, 1.1492165497673414, 1.1566315890851353, 1.1643064577677373, 1.1722199330174718, 1.1803495164761395, 1.1886715577262368, 1.197161409243231, 1.2057936087114653, 1.2145420828638924, 1.223380366054924, 1.2322818265137332, 1.2412198935015506, 1.2501682792517437, 1.2591011904605338, 1.267993525095673, 1.2768210513056957, 1.28556056617679, 1.294190032956488, 1.3026886961220707, 1.3110371743101294, 1.319217531644655, 1.3272133284127285, 1.3350096523497088, 1.3425931320217241, 1.349951933943577, 1.3570757451560276, 1.3639557430182385, 1.3705845539585564, 1.3769562028785547, 1.3830660548293296 ], [ 1.086068450038437, 1.0862708939540084, 1.0868248836093082, 1.087739890913621, 1.0890242087081654, 1.0906848270068183, 1.092727320059958, 1.095155748124707, 1.0979725774361455, 1.1011786210484253, 1.1047730019297637, 1.1087531380046642, 1.1131147468967153, 1.1178518662092023, 1.1229568836785462, 1.1284205709048925, 1.1342321150060641, 1.1403791446021436, 1.1468477497285663, 1.1536224988557429, 1.1606864592043993, 1.1680212281912015, 1.1756069837852263, 1.1834225599911357, 1.1914455511395845, 1.199652445796119, 1.2080187884284104, 1.2165193648346084, 1.225128405876569, 1.2338198032797738, 1.2425673310703582, 1.2513448664914717, 1.260126604841372, 1.2688872634789925, 1.277602271144277, 1.2862479396588928, 1.294801615950652, 1.3032418131446335, 1.3115483201661537, 1.3197022898968689, 1.327686306416413, 1.335484432253338, 1.343082236869058, 1.350466807816641, 1.357626746162644, 1.3645521478446248, 1.3712345726689643, 1.3776670026424096, 1.3838437912845982, 1.389760605495503 ], [ 1.0976425377457528, 1.0979683639738962, 1.0986359646412933, 1.0996544125546204, 1.101031659617882, 1.1027744197943814, 1.104888061473514, 1.107376512450272, 1.1102421803053912, 1.1134858902112073, 1.117106841096672, 1.1211025797661036, 1.1254689911388498, 1.1302003014950568, 1.1352890907611084, 1.1407263097306275, 1.1465012988869778, 1.1526018071672532, 1.1590140113123093, 1.1657225388617445, 1.1727104997618618, 1.179959532464731, 1.1874498701078493, 1.1951604310095385, 1.203068935667397, 1.2111520501594395, 1.219385553717597, 1.227744526537496, 1.2362035527292414, 1.2447369327099842, 1.2533188992239668, 1.261923831447778, 1.270526462186319, 1.2791020738852688, 1.2876266799911413, 1.2960771890124738, 1.304431549426148, 1.3126688742992516, 1.3207695451404444, 1.3287152950468248, 1.3364892716717494, 1.3440760809086858, 1.351461812472267, 1.3586340487677109, 1.3655818585820725, 1.372295777213933, 1.3787677746909357, 1.384991213715206, 1.3909607989331523, 1.3966725190560794 ], [ 1.109678368372889, 1.1101344911875883, 1.1109223156089278, 1.1120504952536274, 1.1135266202222378, 1.11535710594191, 1.1175470898437172, 1.1201003384987493, 1.1230191674396564, 1.1263043752447746, 1.1299551925968383, 1.133969246035568, 1.1383425351442422, 1.1430694211242691, 1.1481426243110482, 1.1535532283254963, 1.1592906893071673, 1.1653428499619765, 1.1716959597443621, 1.1783347040191094, 1.1852422461254672, 1.1924002866071395, 1.1997891433786612, 1.2073878553841306, 1.2151743106323398, 1.2231253976834753, 1.2312171780021601, 1.239425075275964, 1.2477240769216158, 1.2560889425703003, 1.2644944142877148, 1.2729154235632334, 1.2813272906068316, 1.2897059121385739, 1.2980279345731813, 1.306270910235429, 1.3144134349504921, 1.322435266009172, 1.3303174200941983, 1.338042251261771, 1.345593509499499, 1.3529563807289118, 1.3601175093918583, 1.367065004961114, 1.3737884338530513, 1.3802787983017692, 1.3865285037872817, 1.3925313166027422, 1.3982823131050264, 1.4037778221258033 ], [ 1.1221261881982012, 1.1227189953512537, 1.1236332011459143, 1.1248770197197773, 1.1264576567480162, 1.1283812032787428, 1.1306525357982053, 1.1332752246841795, 1.1362514528693708, 1.1395819460274417, 1.1432659149569144, 1.1473010101549361, 1.1516832879557632, 1.1564071871851922, 1.1614655151677957, 1.1668494421914568, 1.1725485041802137, 1.1785506142531035, 1.184842084862933, 1.1914076630701023, 1.1982305819779733, 1.2052926312833367, 1.2125742492517786, 1.2200546373162806, 1.227711897113615, 1.2355231883436295, 1.2434649045603023, 1.2515128630179475, 1.2596425040652846, 1.2678290953055118, 1.276047935780928, 1.2842745557315172, 1.2924849079478482, 1.3006555473233608, 1.3087637958535843, 1.3167878909848523, 1.3247071158501096, 1.332501910520576, 1.3401539639350406, 1.3476462866342591, 1.3549632648230712, 1.3620906966068902, 1.3690158115047117, 1.3757272745316385, 1.3822151762758823, 1.3884710104740092, 1.39448764062113, 1.4002592571463308, 1.4057813266450612, 1.411050534595967 ], [ 1.1349339766905615, 1.1356692156059447, 1.1367153825138827, 1.1380802313505471, 1.1397705591382552, 1.1417921039928918, 1.144149447826375, 1.14684592556113, 1.1498835424207208, 1.1532629004972144, 1.1569831353658309, 1.161041863088967, 1.1654351376070091, 1.1701574183338816, 1.1752015478223325, 1.1805587396560282, 1.1862185772256908, 1.1921690246556516, 1.1983964517204944, 1.2048856749679835, 1.2116200173100835, 1.2185813879892757, 1.225750384089479, 1.2331064137368075, 1.2406278399746729, 1.248292143161265, 1.256076098763249, 1.2639559666978275, 1.2719076879462017, 1.2799070840182956, 1.2879300549558454, 1.2959527718662243, 1.3039518604260587, 1.3119045723301697, 1.3197889422420455, 1.3275839283922164, 1.3352695355430282, 1.3428269195735478, 1.3502384734236115, 1.357487894563117, 1.3645602345177192, 1.3714419312836925, 1.3781208257040105, 1.384586163057874, 1.3908285812407204, 1.3968400869870572, 1.4026140216197833, 1.4081450178034327, 1.4134289487416127, 1.4184628711966805 ], [ 1.1480478176519424, 1.1489304799294549, 1.150113485365579, 1.151604106734232, 1.1534087071877086, 1.1555326417631393, 1.157980162199545, 1.1607543266567066, 1.163856915766426, 1.1672883562186631, 1.171047652828637, 1.1751323297977165, 1.1795383817255791, 1.1842602349006253, 1.1892907195132238, 1.1946210536915893, 1.200240840601999, 1.2061380801979547, 1.2122991974412447, 1.2187090888514398, 1.2253511889998474, 1.2322075580321283, 1.2392589905217923, 1.2464851450145078, 1.2538646926373165, 1.261375482234608, 1.2689947187475132, 1.2766991510340384, 1.2844652650534205, 1.2922694782983233, 1.3000883315194178, 1.3078986741051213, 1.3156778399087539, 1.3234038108143673, 1.3310553658652458, 1.3386122143167543, 1.346055111496395, 1.3533659568424241, 1.3605278739367959, 1.3675252727415457, 1.3743438945853885, 1.3809708407276688, 1.3873945855502876, 1.3936049755967654, 1.3995932157946798, 1.4053518442678983, 1.4108746971736483, 1.4161568649921668, 1.4211946416596704, 1.4259854678744817 ], [ 1.1614123257962259, 1.1624465383941753, 1.163770440538668, 1.1653908031768487, 1.1673135303193403, 1.1695435635624771, 1.172084788738401, 1.1749399461563779, 1.1781105458265373, 1.181596788945113, 1.1853974967990994, 1.1895100481531469, 1.1939303261460612, 1.1986526757701543, 1.203669873134761, 1.2089731079003787, 1.2145519804612739, 1.220394515582885, 1.226487194193834, 1.232815004831978, 1.2393615158224507, 1.2461089686353055, 1.2530383920829673, 1.2601297361550228, 1.2673620234421035, 1.2747135153581988, 1.282161889796165, 1.289684426480348, 1.2972581961204928, 1.3048602495067372, 1.312467802885567, 1.3200584162838829, 1.3276101618646041, 1.3351017798676679, 1.3425128201861174, 1.3498237681243392, 1.3570161533664724, 1.3640726416340199, 1.3709771089228149, 1.3777146985741326, 1.3842718617485008, 1.3906363821318886, 1.3967973859120015, 1.4027453382194581, 1.4084720273367983, 1.4139705380424736, 1.4192352154814105, 1.4242616209441694, 1.4290464808986227, 1.433587630557367 ], [ 1.1749711237254843, 1.1761600540291854, 1.177627990150178, 1.1793811815925854, 1.1814250489897062, 1.1837640913565781, 1.1864017945138576, 1.1893405420933179, 1.192581530540568, 1.1961246895107618, 1.1999686090291468, 1.204110474782789, 1.2085460129396877, 1.2132694459630848, 1.2182734609902621, 1.223549192447754, 1.2290862206333757, 1.2348725879585287, 1.240894834364834, 1.247138053077673, 1.2535859673330072, 1.260221028041025, 1.267024531585162, 1.2739767561692947, 1.281057114394313, 1.2882443191316433, 1.295516559311306, 1.3028516819771954, 1.3102273768817492, 1.3176213599790458, 1.3250115524005583, 1.332376251829145, 1.3396942935912515, 1.3469451992358719, 1.3541093108364821, 1.3611679097190095, 1.3681033187693807, 1.3748989878962472, 1.381539562609222, 1.3880109360142743, 1.3943002848215196, 1.4003960902045811, 1.4062881445446866, 1.411967545237876, 1.4174266768428898, 1.4226591829042243, 1.4276599288041074, 1.4324249569839091, 1.436951435835301, 1.4412376034996206 ], [ 1.1886673586587668, 1.1900131388392847, 1.1916272443986773, 1.1935153856686178, 1.19568247779911, 1.1981325506367415, 1.2008686590457764, 1.2038927950803469, 1.207205803484334, 1.2108073020435735, 1.2146956083551013, 1.218867674623278, 1.2233190321486662, 1.2280437472397332, 1.2330343903333856, 1.2382820201305422, 1.2437761845012394, 1.249504939753937, 1.2554548895682165, 1.2616112444477803, 1.267957901973715, 1.2744775474605172, 1.2811517738919345, 1.2879612193019, 1.2948857191276106, 1.301904470546708, 1.3089962054504927, 1.3161393685132445, 1.3233122967898086, 1.3304933973915274, 1.3376613200291805, 1.3447951215415401, 1.3518744199211599, 1.358879535779703, 1.365791619641295, 1.372592763896574, 1.3792660986778813, 1.3857958713164809, 1.3921675094072832, 1.3983676678294314, 1.404384260348137, 1.410206476652287, 1.4158247858633644, 1.4212309276851987, 1.4264178924537607, 1.4313798913952769, 1.436112318413902, 1.4406117047123015, 1.4448756675048975, 1.448902854019633 ], [ 1.202444244290376, 1.2039479183193047, 1.2057092701077952, 1.2077334557817268, 1.2100248660089898, 1.2125870385469408, 1.2154225707175308, 1.2185330332460371, 1.2219188870153646, 1.2255794043811172, 1.2295125967703158, 1.2337151503532218, 1.2381823716338725, 1.2429081448427894, 1.2478849030189383, 1.2531036146136554, 1.2585537873106074, 1.2642234905091039, 1.2700993975492085, 1.276166848267446, 1.2824099318800128, 1.2888115895326455, 1.2953537351794893, 1.302017392810613, 1.308782847487121, 1.31562980720308, 1.3225375722981942, 1.3294852090026044, 1.3364517236993818, 1.3434162346248448, 1.3503581379688907, 1.3572572656618658, 1.3640940325155448, 1.3708495708012538, 1.377505850777708, 1.3840457861083009, 1.3904533235188923, 1.3967135164318416, 1.4028125826616287, 1.4087379465661933, 1.414478266311685, 1.4200234471250495, 1.4253646415780146, 1.4304942380694905, 1.435405838753347, 1.4400942281992908, 1.4445553340804749, 1.4487861811579186, 1.4527848397838694, 1.4565503700795444 ], [ 1.2162456109622337, 1.2179071056956545, 1.2198156901249386, 1.2219759545255349, 1.2243917499744252, 1.2270661037187345, 1.2300011341449542, 1.233197966825008, 1.2366566532636447, 1.240376094092199, 1.2443539685480158, 1.2485866721478587, 1.2530692645036752, 1.2577954292324518, 1.2627574478639632, 1.2679461895333441, 1.2733511180414852, 1.2789603175612307, 1.2847605378571376, 1.290737259378517, 1.2968747780024468, 1.3031563085785043, 1.3095641058027674, 1.3160796003685442, 1.322683547845329, 1.3293561873558077, 1.3360774068720729, 1.3428269118418048, 1.3495843938774765, 1.3563296963821763, 1.3630429742244747, 1.3697048448899238, 1.3762965289055376, 1.3827999777354971, 1.3891979877624197, 1.395474299382944, 1.4016136806459045, 1.4076019952345464, 1.413426254933249, 1.4190746570170711, 1.4245366072555596, 1.4298027294281173, 1.434864862407136, 1.439716045978182, 1.4443504966370777, 1.4487635746356424, 1.452951743546322, 1.456912523585758, 1.4606444398845928, 1.4641469668203098 ], [ 1.2300164468189134, 1.2318345669077306, 1.2338892728654087, 1.2361845813826915, 1.2387237932772104, 1.2415094119031684, 1.2445430609930237, 1.24782540344663, 1.2513560627511644, 1.255133548848296, 1.259155190362109, 1.2634170751601983, 1.2679140012370012, 1.2726394398754526, 1.277585512949512, 1.2827429860637274, 1.288101278975847, 1.293648494407696, 1.2993714659201756, 1.3052558250219652, 1.311286087120223, 1.3174457553368375, 1.3237174406410328, 1.3300829962253742, 1.3365236636098026, 1.3430202276221093, 1.3495531771878944, 1.3561028687733265, 1.3626496893547015, 1.369174215928485, 1.3756573688065938, 1.3820805562455556, 1.3884258083143788, 1.3946758982954854, 1.4008144503180506, 1.4068260323277928, 1.4126962338879125, 1.4184117286713587, 1.4239603218355095, 1.4293309827603489, 1.4345138638756325, 1.439500306499504, 1.4442828347602616, 1.448855138776658, 1.453212048333031, 1.4573494983089263, 1.4612644871129328, 1.4649550293338331, 1.4684201037634945, 1.4716595978713816 ], [ 1.243703413512432, 1.245675858638903, 1.2478744930675751, 1.250302756408509, 1.2529633933049926, 1.2558583751360874, 1.2589888211101223, 1.2623549202939366, 1.265955856299463, 1.2697897364847346, 1.2738535276170215, 1.2781429999884508, 1.2826526819655173, 1.2873758268874127, 1.292304394097059, 1.2974290456856372, 1.3027391602507654, 1.3082228646089193, 1.3138670839698987, 1.3196576105882971, 1.3255791903752867, 1.3316156264108532, 1.3377498977725057, 1.3439642916221717, 1.3502405460950309, 1.3565600012334103, 1.3629037550176015, 1.3692528214683815, 1.3755882878292285, 1.3818914679704697, 1.38814404937866, 1.3943282313859662, 1.4004268526379764, 1.4064235061766461, 1.4123026409105346, 1.4180496486414262, 1.4236509362007437, 1.4290939826088047, 1.4343673814952358, 1.4394608693026405, 1.4443653400330252, 1.4490728474854997, 1.453576596074484, 1.45787092141203, 1.4619512618897947, 1.4658141225103904, 1.4694570322000613, 1.4728784957905392, 1.476077941793586, 1.4790556670125437 ], [ 1.2572553220152405, 1.2593787241106897, 1.2617180476949958, 1.2642761561759819, 1.2670552369563952, 1.2700567266829208, 1.2732812359437473, 1.2767284749734429, 1.2803971821016122, 1.2842850568125985, 1.2883886993627105, 1.2927035589258695, 1.2972238922053543, 1.3019427343546564, 1.3068518838907757, 1.3119419030549886, 1.3172021347776448, 1.3226207370378287, 1.3281847349825624, 1.3338800906981856, 1.3396917900270775, 1.3456039453206539, 1.3515999125394713, 1.357662420679882, 1.3637737111456532, 1.3699156844101712, 1.3760700511413717, 1.382218484891769, 1.3883427734878928, 1.3944249663802775, 1.400447515424815, 1.406393406845279, 1.4122462824583906, 1.4179905486106958, 1.4236114716636608, 1.4290952592539872, 1.4344291269354095, 1.4396013501636795, 1.444601301907242, 1.449419476444999, 1.454047500143836, 1.458478130190715, 1.4627052423865943, 1.4667238091953, 1.4705298692832833, 1.4741204897917324, 1.4774937225564857, 1.4806485554399536, 1.4835848598688228, 1.486303335587583 ], [ 1.2706235568530038, 1.2728935344760188, 1.2753693144382137, 1.2780531891619122, 1.2809467925026676, 1.2840510287773506, 1.2873660013714514, 1.2908909424804094, 1.2946241457127532, 1.2985629034046156, 1.3027034505609574, 1.3070409173457516, 1.3115692919892437, 1.3162813958641189, 1.3211688723024486, 1.3262221904815352, 1.3314306654008792, 1.3367824946087306, 1.3422648119244607, 1.347863757954632, 1.3535645667342673, 1.3593516673602444, 1.365208799043504, 1.3711191376116174, 1.377065431163115, 1.3830301423242464, 1.388995594398378, 1.3949441186324456, 1.4008581998536822, 1.4067206178479978, 1.4125145820498988, 1.4182238573804147, 1.4238328793898642, 1.4293268572205784, 1.4346918632843149, 1.4399149089342969, 1.4449840057868442, 1.4498882126994663, 1.4546176687295185, 1.4591636126719834, 1.4635183900009467, 1.4676754482147978, 1.4716293217101812, 1.475375607387102, 1.4789109322219331, 1.482232914041946, 1.485340116701066, 1.4882320007982215, 1.4909088710034, 1.4933718209680487 ], [ 1.283762440266725, 1.2861736671402393, 1.2887807440589414, 1.2915854018355573, 1.294588728996386, 1.2977911047843047, 1.30119213192284, 1.3047905706742782, 1.308584275888862, 1.3125701388528765, 1.3167440357956148, 1.3211007849068177, 1.325634113645736, 1.3303366379913402, 1.3351998550906794, 1.3402141505114133, 1.3453688209984276, 1.3506521132793257, 1.3560512790684824, 1.3615526459966398, 1.3671417037579614, 1.3728032043367404, 1.3785212747701998, 1.384279540540105, 1.390061257381062, 1.395849449060533, 1.4016270485346696, 1.407377039820455, 1.413082597949122, 1.4187272244754392, 1.4242948762050318, 1.429770085056941, 1.4351380672885632, 1.4403848206592818, 1.4454972084821325, 1.4504630298926682, 1.4552710760355594, 1.459911172218063, 1.4643742063932268, 1.4686521446061969, 1.472738034257752, 1.4766259962085453, 1.4803112068651783, 1.4837898714587676, 1.487059189752695, 1.4901173154050495, 1.4929633101697237, 1.4955970940551429, 1.4980193924776846, 1.5002316813540943 ], [ 1.2966295311584655, 1.2991758158960736, 1.3019081815747409, 1.3048278106435611, 1.3079352587001931, 1.3112303916182106, 1.3147123226506745, 1.3183793510044288, 1.3222289035324402, 1.3262574812903227, 1.3304606127429974, 1.334832815386579, 1.3393675674686234, 1.3440572913486533, 1.3488933498424238, 1.3538660566416054, 1.3589647015998059, 1.3641775913333405, 1.3694921052094753, 1.3748947663975277, 1.3803713272526856, 1.3859068679038884, 1.3914859065415717, 1.3970925195641049, 1.4027104694581156, 1.4083233380695483, 1.4139146627788257, 1.4194680730306855, 1.4249674246893744, 1.4303969297912924, 1.4357412794445197, 1.4409857578692113, 1.4461163458727275, 1.4511198123943476, 1.4559837931206863, 1.460696855547774, 1.4652485502331234, 1.4696294483262433, 1.4738311657762564, 1.477846374881505, 1.481668804061851, 1.4852932268975134, 1.4887154415891275, 1.491932242055751, 1.494941381905761, 1.4977415324969696, 1.500332236253674, 1.502713856337207, 1.5048875236796395, 1.5068550822934157 ], [ 1.309185856893531, 1.311860231114128, 1.3147111147503663, 1.3177391586371325, 1.320944401612732, 1.3243262118692265, 1.3278832285129774, 1.3316133047772503, 1.3355134544689538, 1.3395798033185065, 1.3438075469310278, 1.3481909170066573, 1.3527231574087866, 1.3573965115131819, 1.3622022220719672, 1.367130544578619, 1.372170774828924, 1.3773112910453424, 1.382539610576908, 1.3878424608141058, 1.3932058635798519, 1.3986152318871392, 1.4040554776047718, 1.4095111282586295, 1.414966450930269, 1.420405581008395, 1.4258126534112021, 1.4311719338352702, 1.4364679476024753, 1.4416856037703083, 1.446810312339076, 1.4518280926241491, 1.4567256711519572, 1.4614905677714856, 1.4661111690322959, 1.470576788249803, 1.4748777120412844, 1.4790052334572192, 1.4829516721387703, 1.4867103821938077, 1.4902757486945966, 1.4936431738574667, 1.4968090540689438, 1.4997707489780074, 1.502526543885255, 1.5050756066343285, 1.5074179401561174, 1.5095543317397286, 1.511486300012728, 1.5132160405131438 ], [ 1.3213960788926098, 1.3241908911667362, 1.327152851346785, 1.3302820984913848, 1.3335781741610417, 1.337039968038915, 1.3406656640032255, 1.344452688029225, 1.3483976594256617, 1.3524963469864741, 1.3567436316585035, 1.3611334772893875, 1.3656589109269222, 1.3703120139952938, 1.3750839254778662, 1.379964857996146, 1.3849441273954721, 1.3900101961371396, 1.3951507304618034, 1.4003526709397605, 1.4056023156705997, 1.4108854150489467, 1.416187276687356, 1.4214928787934036, 1.426786990047851, 1.432054293835093, 1.4372795145446335, 1.4424475436003596, 1.4475435628864175, 1.452553163325808, 1.4574624565273167, 1.4622581776420485, 1.4669277778524537, 1.471459505241435, 1.4758424731415438, 1.480066715427636, 1.4841232285739276, 1.4880040006325401, 1.4917020275920676, 1.4952113178312731, 1.498526885588268, 1.5016447345169368, 1.5045618325003065, 1.5072760789394657, 1.5097862657413956, 1.512092033197929, 1.5141938218877575, 1.5160928216524705, 1.5177909186024277, 1.5192906410056457 ], [ 1.3332285952796754, 1.3361356086255531, 1.339200628948086, 1.3424233060175863, 1.3458027064356186, 1.3493372635251557, 1.3530247279123482, 1.3568621201056232, 1.3608456864917524, 1.3649708602337727, 1.3692322285685736, 1.3736235079611308, 1.3781375284789499, 1.3827662286070859, 1.387500661534989, 1.3923310137164409, 1.3972466362388145, 1.4022360892442842, 1.4072871993310174, 1.4123871295354204, 1.417522461166305, 1.422679286438844, 1.4278433105511623, 1.43299996157028, 1.4381345062578075, 1.4432321697794905, 1.4482782571152057, 1.4532582739244697, 1.4581580446316325, 1.4629638255763486, 1.4676624112266914, 1.472241231669355, 1.4766884398641371, 1.4809929874660552, 1.4851446883631119, 1.4891342694338197, 1.4929534083798388, 1.4965947588190995, 1.5000519631205413, 1.50331965371247, 1.5063934437962114, 1.5092699085421435, 1.511946557937749, 1.5144218025003426, 1.516694913066803, 1.5187659758365486, 1.520635843779573, 1.5223060854368775, 1.5237789320427795, 1.5250572237941227 ], [ 1.3446555855639977, 1.347666076487398, 1.3508256628844768, 1.3541335299326192, 1.357588293955702, 1.3611879565386853, 1.3649298595655144, 1.3688106424085684, 1.3728262025988651, 1.3769716613620802, 1.3812413354123618, 1.3856287163530494, 1.390126458941401, 1.3947263793363378, 1.3994194642675633, 1.404195891846354, 1.4090450644880654, 1.4139556541404528, 1.4189156597169619, 1.4239124763281494, 1.4289329755955424, 1.4339635960299368, 1.4389904421699184, 1.4439993909165252, 1.448976203276417, 1.4539066395484994, 1.4587765758663167, 1.4635721199482026, 1.4682797239138652, 1.4728862921025399, 1.477379281972623, 1.4817467963713413, 1.4859776657268582, 1.4900615190222726, 1.4939888427466532, 1.4977510273661652, 1.5013404012014018, 1.5047502519200915, 1.5079748361429848, 1.5110093779054647, 1.5138500569108342, 1.5164939876513492, 1.5189391905601801, 1.521184556395828, 1.52322980505609, 1.5250754399787136, 1.5267226992187137, 1.5281735042052433, 1.5294304070816533, 1.5304965374266144 ], [ 1.3556530034202776, 1.3587578607535107, 1.3620031388148104, 1.36538758465982, 1.368909390917336, 1.372566154045201, 1.3763548337279476, 1.3802717145640468, 1.384312371279401, 1.3884716387507703, 1.3927435881252272, 1.39712151027791, 1.4015979077613312, 1.4061644962679956, 1.4108122164571144, 1.4155312567909009, 1.420311087791031, 1.4251405078672283, 1.4300077005940868, 1.4349003030260639, 1.4398054843515966, 1.4447100339041532, 1.449600457279419, 1.4544630790628454, 1.4592841504606648, 1.4640499599585919, 1.4687469450152366, 1.4733618027384283, 1.4778815974980666, 1.4822938635012288, 1.4865867004934556, 1.490748860950703, 1.494769827380841, 1.498639878650768, 1.5023501445808836, 1.5058926483865416, 1.5092603368799886, 1.5124470986603922, 1.5154477708003942, 1.518258134775067, 1.5208749025664434, 1.5232956940112767, 1.5255190065423159, 1.527544178507828, 1.5293713472465793, 1.531001403053199, 1.5324359400998782, 1.5336772052922303, 1.5347280459372108, 1.5355918569952327 ], [ 1.3662005241532678, 1.3693903461878891, 1.3727121570073217, 1.37616429338211, 1.3797445522923721, 1.383450153209958, 1.3872777017238338, 1.3912231555754948, 1.3952817942484106, 1.399448193294759, 1.4037162045812344, 1.4080789435919665, 1.4125287848415706, 1.417057366326978, 1.4216556037863262, 1.4263137153407708, 1.4310212568755711, 1.4357671682751776, 1.4405398303694597, 1.4453271321807817, 1.4501165477915594, 1.4548952218866458, 1.4596500627728473, 1.4643678414475192, 1.4690352950887158, 1.473639233179634, 1.4781666443683996, 1.482604802108067, 1.4869413671262817, 1.4911644848426309, 1.4952628759838213, 1.499225918838996, 1.503043721842265, 1.5067071854557075, 1.5102080526404524, 1.513538947529886, 1.5166934022419578, 1.5196658720713603, 1.5224517395742292, 1.525047308287308, 1.5274497870044343, 1.5296572656622722, 1.5316686839658544, 1.5334837939160924, 1.5351031173918297, 1.5365278998957554, 1.5377600615040006, 1.5388021459712553, 1.5396572688438093, 1.5403290653279724 ] ], "zauto": true, "zmax": 1.5403290653279724, "zmin": -1.5403290653279724 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.09800593442291355, 0.0968247998182561, 0.09573841930616377, 0.09474771867429516, 0.0938526590557135, 0.09305223168498285, 0.09234447955480211, 0.09172654652688657, 0.09119475312644734, 0.09074469695296945, 0.09037137447992089, 0.09006932008221732, 0.089832757481675, 0.08965575845997713, 0.08953240364394893, 0.08945694037892418, 0.08942393311524198, 0.08942840227595146, 0.08946594818980493, 0.08953285731152125, 0.0896261885736904, 0.08974383829852857, 0.08988458263236669, 0.09004809695128038, 0.09023495212966175, 0.09044658797716683, 0.09068526454785382, 0.09095399242398451, 0.09125644348945947, 0.09159684414377531, 0.09197985336934703, 0.09241042854604858, 0.09289368238792861, 0.09343473482704547, 0.0940385640455638, 0.09470986111013965, 0.09545289274182235, 0.0962713766177182, 0.09716837322134689, 0.09814619763458557, 0.09920635382086161, 0.10034949293957346, 0.10157539613052792, 0.10288298110170459, 0.10427033083198724, 0.10573474183942534, 0.10727278882132917, 0.10888040207495404, 0.11055295395942569, 0.1122853507394041 ], [ 0.09452516516699322, 0.09328072079662544, 0.09213639294862845, 0.09109342959866226, 0.0901520280872802, 0.08931132009982748, 0.08856938709644982, 0.08792330730367579, 0.08736923377606759, 0.08690250143102858, 0.08651775949789837, 0.08620912462786127, 0.08597034906874043, 0.08579499785446514, 0.08567662888133881, 0.08560896999134207, 0.08558608768155712, 0.08560254272424729, 0.08565352873494235, 0.08573499050113588, 0.08584371963520103, 0.0859774258144803, 0.08613478250740915, 0.08631544665797113, 0.08652005232066985, 0.08675017871899567, 0.08700829365880336, 0.08729767368172103, 0.08762230280826652, 0.08798675220708921, 0.08839604363901069, 0.0888555000545468, 0.08937058724931382, 0.08994675096618239, 0.09058925422584624, 0.09130301990992085, 0.09209248365450369, 0.0929614618894183, 0.09391303935322452, 0.094949479630301, 0.0960721612323099, 0.09728154055232262, 0.09857714175038763, 0.09995757238974777, 0.10142056253486012, 0.10296302412941012, 0.10458112684985678, 0.10627038630001967, 0.10802576036485688, 0.10984174974080646 ], [ 0.09106202848432658, 0.08975041467728778, 0.08854427380159847, 0.08744524863502517, 0.08645384417389555, 0.0855693996320317, 0.08479009464172571, 0.08411299158021218, 0.08353411402082765, 0.0830485593247203, 0.08265064154094082, 0.08233405924176557, 0.08209208180950407, 0.08191774706896082, 0.08180406301855346, 0.08174420669027846, 0.08173171376693124, 0.08176065339424353, 0.08182578354290448, 0.08192268321737085, 0.08204785871725168, 0.08219882199987208, 0.08237413995683322, 0.08257345410495559, 0.0827974708137665, 0.08304792276361449, 0.08332750286884552, 0.08363977242785595, 0.08398904579334501, 0.0843802544040011, 0.08481879358701393, 0.08531035611998489, 0.08586075710539526, 0.08647575521707575, 0.08716087576699628, 0.0879212412440427, 0.08876141492815755, 0.08968526283244307, 0.09069583854999923, 0.0917952945967581, 0.09298482260284936, 0.09426462330608701, 0.09563390585921461, 0.09709091460214674, 0.09863298028460996, 0.1002565918391763, 0.10195748424830886, 0.10373073783006102, 0.10557088435802951, 0.10747201577754588 ], [ 0.08762945305429941, 0.0862465089616318, 0.08497430981655021, 0.08381497686526608, 0.08276940794638919, 0.08183723257262678, 0.08101680500654825, 0.08030523840913426, 0.07969848086107642, 0.07919143162050528, 0.07877809364283134, 0.07845175638720345, 0.07820520144984919, 0.078030922692279, 0.07792135227566689, 0.07786908429768585, 0.0778670884297064, 0.07790890692703395, 0.07798882949802956, 0.07810204166243014, 0.07824474333266399, 0.07841423537521419, 0.07860897283869547, 0.07882858437423813, 0.0790738581344544, 0.07934669513584006, 0.07965003172396729, 0.0799877334093762, 0.08036446296149721, 0.08078552627066984, 0.08125670011782297, 0.08178404661636561, 0.08237371968127488, 0.08303176938499006, 0.08376395041022182, 0.08457554092882925, 0.08547117805176462, 0.08645471545767752, 0.08752910790414026, 0.08869632608944747, 0.0899573038464023, 0.09131191803319509, 0.09275899988280632, 0.09429637512310449, 0.09592092900456331, 0.09762869155184802, 0.09941493792305832, 0.10127429870341063, 0.10320087522812947, 0.10518835554693638 ], [ 0.08424090259053937, 0.08278217188974979, 0.08143927710378211, 0.08021491281421067, 0.07911046992761903, 0.07812596912307346, 0.07726003584577175, 0.07650992153082511, 0.07587157310038924, 0.07533974981658585, 0.0749081836226226, 0.07456977649403283, 0.0743168263152393, 0.07414127154905306, 0.07403494450768908, 0.07398982328154438, 0.07399827317885926, 0.07405326968825982, 0.0741485963203314, 0.0742790120748509, 0.07444038462588692, 0.07462978657059127, 0.07484555323438914, 0.07508730156942223, 0.07535591063683982, 0.07565346504102712, 0.07598316349987298, 0.07634919550423781, 0.07675658975621895, 0.07721103879043088, 0.07771870487719773, 0.0782860129673148, 0.07891943702926256, 0.07962528659252711, 0.08040950056737951, 0.08127745537797768, 0.0822337940488857, 0.08328228208319123, 0.08442569476911163, 0.08566573901355216, 0.08700301104070118, 0.08843698946453112, 0.08996606151279156, 0.0915875787003501, 0.09329793713788372, 0.09509267698226904, 0.09696659529556981, 0.09891386673850466, 0.1009281670039788, 0.10300279460001874 ], [ 0.08091028928445952, 0.07937104247321365, 0.07795242417788109, 0.07665780767816971, 0.0754891929711459, 0.0744471131213384, 0.07353058502035913, 0.0727371114114144, 0.07206273807703491, 0.0715021665558464, 0.07104891906028422, 0.07069554885837462, 0.07043388664591439, 0.07025531162336997, 0.07015103518696307, 0.07011238526703122, 0.07013108020619903, 0.07019948242213246, 0.07031082371200294, 0.07045939574585677, 0.0706407009467402, 0.07085156050875749, 0.07109017774324207, 0.07135615627123648, 0.07165047380705743, 0.07197541341080203, 0.07233445513332115, 0.07273213194228598, 0.07317385471015445, 0.07366571187117069, 0.07421425011370147, 0.07482624314842667, 0.07550845614065424, 0.07626741374976742, 0.0771091797961518, 0.07803915628981208, 0.07906190883987789, 0.08018102429833344, 0.08139900491276467, 0.08271720137435705, 0.08413578510531262, 0.0856537581210581, 0.08726899701235674, 0.0889783261742099, 0.09077761446028314, 0.09266188899657131, 0.0946254599167309, 0.09666205020637195, 0.09876492555811073, 0.10092702002826512 ], [ 0.07765187807438838, 0.07602715762145074, 0.07452741993821387, 0.07315683082797422, 0.07191813094431637, 0.07081250902377795, 0.06983952102470599, 0.06899706486830813, 0.06828141734820908, 0.06768733568690688, 0.06720822166219896, 0.06683634179382131, 0.066563093330213, 0.06637930311576255, 0.06627554503331423, 0.06624246155706591, 0.066271075792984, 0.06635308191696673, 0.06648110383722132, 0.06664891396370677, 0.0668516060097735, 0.06708571770444927, 0.06734930113539736, 0.06764194017167058, 0.0679647160327399, 0.06832012357033757, 0.06871194220219323, 0.06914506667348023, 0.0696253039192904, 0.07015914325945184, 0.07075350796932403, 0.07141549691449844, 0.07215212536632279, 0.07297007425707157, 0.07387545690300171, 0.07487361154294149, 0.07596892686704791, 0.07716470606118953, 0.07846307285556034, 0.07986492079800744, 0.08136990467575422, 0.08297647089878062, 0.08468192192343606, 0.086482508568909, 0.08837354342088066, 0.09034952841024074, 0.09240429002277627, 0.0945311163215029, 0.09672289091490902, 0.09897222005588543 ], [ 0.07448018417781777, 0.07276488019030529, 0.07117831111888984, 0.0697255536017073, 0.06841023412167635, 0.06723436299281565, 0.06619821341594957, 0.06530025885283855, 0.06453717897246222, 0.0639039399296313, 0.06339394926947338, 0.06299928005501737, 0.06271095367986088, 0.06251926690292778, 0.06241414629556481, 0.06238551256228365, 0.062423637852391634, 0.06251948083403396, 0.06266498654769165, 0.06285334056381903, 0.06307916952722603, 0.06333868267496626, 0.063629751327159, 0.06395192565745095, 0.06430639023324368, 0.06469586184369655, 0.06512443496798342, 0.06559738184471603, 0.06612091546488567, 0.06670192491407559, 0.06734769332254752, 0.06806560921689413, 0.06886288225371538, 0.0697462740833933, 0.07072185436644446, 0.0717947906965995, 0.07296917937868812, 0.07424792174635562, 0.07563264814459732, 0.07712368906576125, 0.07872009046056638, 0.08041966817363258, 0.08221909494299229, 0.08411401253798623, 0.08609916138419835, 0.0881685203564398, 0.09031545017998577, 0.09253283491401716, 0.09481321715225155, 0.09714892374010026 ], [ 0.07140986641048061, 0.06959883182070144, 0.06791949521423359, 0.06637796020556731, 0.0649788933557624, 0.0637253135196363, 0.06261842180265742, 0.06165748953905636, 0.06083981939833178, 0.06016079022355128, 0.05961398995134143, 0.05919143381726902, 0.05888385808003802, 0.05868107370823953, 0.05857236055512395, 0.05854688074375446, 0.05859409011860581, 0.05870412823793816, 0.05886816995216489, 0.05907872468165485, 0.059329872768424725, 0.05961743156805794, 0.05993904719705854, 0.060294211009299103, 0.060684202885371276, 0.06111196620406202, 0.061581921844296374, 0.0620997306709094, 0.06267201564399745, 0.06330605593471324, 0.06400946621088197, 0.06478987454373994, 0.06565461213502921, 0.06661042721572778, 0.06766323398486905, 0.06881790535009635, 0.07007811559048403, 0.07144623606487745, 0.0729232839873569, 0.07450892137147148, 0.07620149877525063, 0.07799813666176217, 0.07989483612828303, 0.08188661044722613, 0.08396762920822072, 0.08613136769670804, 0.08837075530855584, 0.09067831810820168, 0.09304631194460761, 0.09546684373996728 ], [ 0.06845561821585061, 0.06654383351315181, 0.06476571399849367, 0.06312849413067997, 0.06163803560971224, 0.06029856882828193, 0.05911246528089406, 0.058080062725262574, 0.05719956417291961, 0.0564670280765347, 0.05587646053049171, 0.05542001172854143, 0.05508826965720907, 0.05487063553199265, 0.0547557590331751, 0.054732007637075794, 0.05478794329852998, 0.054912780965998526, 0.055096806229206235, 0.05533173317208083, 0.05561098776519949, 0.055929906601523874, 0.0562858452948673, 0.05667819529807135, 0.05710831212358565, 0.057579361813553144, 0.05809609586682059, 0.05866456757417183, 0.05929180477001376, 0.0599854553410629, 0.06075342241675841, 0.061603505975960024, 0.06254306661052067, 0.063578725375272, 0.0647161110634811, 0.06595966299967292, 0.06731249376201402, 0.06877631244525229, 0.070351405505499, 0.07203666922084538, 0.07382968560361033, 0.07572683233235668, 0.07772341692070642, 0.07981382577704196, 0.081991679832753, 0.0842499897987073, 0.08658130563652511, 0.08897785633088666, 0.09143167740228994, 0.09393472473948834 ], [ 0.06563205672668315, 0.0636148545012176, 0.06173206999893322, 0.05999214595778469, 0.05840228183473054, 0.05696812832688903, 0.055693496359923114, 0.054580106072621995, 0.053627403470895445, 0.05283247091988402, 0.05219005195849415, 0.05169270147329212, 0.05133106045175729, 0.05109424237470398, 0.05097030786001041, 0.050946796920972606, 0.05101128474089711, 0.051151926931466835, 0.051357963059111944, 0.051620151890418076, 0.05193111756707802, 0.052285592237873456, 0.05268054718023164, 0.053115210843038385, 0.05359097826123383, 0.05411122167300482, 0.054681016695237436, 0.0553068019289194, 0.055995992285584065, 0.05675656760710513, 0.05759665827564937, 0.05852414847104779, 0.05954631554784872, 0.06066952075335653, 0.061898962373423155, 0.0632384976819809, 0.06469053520018374, 0.06625599421019686, 0.06793432465286443, 0.06972357778655115, 0.0716205164432401, 0.07362075335125681, 0.07571890661455773, 0.07790876276778393, 0.08018343956006418, 0.08253554248403322, 0.08495731084781839, 0.08744075074969948, 0.0899777535900367, 0.092560199729612 ], [ 0.06295360730813294, 0.0608269656357, 0.05883406280626277, 0.056984582545920405, 0.05528717292603784, 0.053749101908494044, 0.05237590279092135, 0.0511710366048988, 0.050135605059038364, 0.04926815048204972, 0.04856457666917613, 0.04801821587793557, 0.04762005331090877, 0.047359103612167525, 0.047222917350867706, 0.04719818212233668, 0.047271374635729765, 0.04742941744742706, 0.047660296168301364, 0.047953598775222976, 0.04830094678782053, 0.04869629743401047, 0.04913610567256813, 0.04961934440650843, 0.05014738988270354, 0.05072378673040099, 0.0513539130711803, 0.05204457047990695, 0.05280352622246741, 0.05363903612202684, 0.05455937561818512, 0.05557240412520702, 0.05668518378797893, 0.05790366843403051, 0.05923247235419748, 0.06067472209544918, 0.062231988376448326, 0.06390429015526047, 0.06569015923887662, 0.06758675182674198, 0.06958999296286528, 0.07169474075671614, 0.07389495902185322, 0.07618388924747574, 0.07855421518915708, 0.0809982155663909, 0.0835079022215004, 0.08607514255917655, 0.08869176615262488, 0.0913496561188837 ], [ 0.060434376807905324, 0.05819528682055343, 0.05608763309316521, 0.05412230693408437, 0.05230945848012082, 0.050658131332912845, 0.04917585449756179, 0.04786821563825066, 0.04673845191092289, 0.04578710465307769, 0.04501178858313714, 0.04440712199743932, 0.043964850718697726, 0.04367417692824471, 0.043522278679241556, 0.043494982141022, 0.04357753105471424, 0.04375538900232276, 0.044015010052284746, 0.044344520554536755, 0.04473426695811185, 0.04517719915762002, 0.045669074083499774, 0.046208478591419265, 0.04679668323053701, 0.04743734864928561, 0.0481361140141798, 0.04890010184151173, 0.049737376120640754, 0.05065639059847081, 0.05166546166799027, 0.052772295605735306, 0.053983593250352166, 0.055304747166833465, 0.0567396376995651, 0.05829052602511089, 0.05995803528172842, 0.06174120576072545, 0.06363760731827445, 0.06564349153528207, 0.06775396732521903, 0.06996318608849025, 0.07226452552611647, 0.07465076432910155, 0.07711424277736295, 0.07964700660162062, 0.08224093321163209, 0.08488784060204985, 0.08757957999705547, 0.09030811369229506 ], [ 0.058088003476511295, 0.05573490915328301, 0.053509189197976995, 0.051422821416857264, 0.049487423675666505, 0.04771389839266952, 0.04611199630070798, 0.0446898130348354, 0.04345325008855923, 0.042405491449709995, 0.041546563834692594, 0.04087305565071086, 0.04037806232086469, 0.040051401757396396, 0.03988010725641975, 0.039849164228401956, 0.03994242183265672, 0.04014358840126197, 0.040437213599769636, 0.04080956906700726, 0.04124935838348592, 0.04174821139626747, 0.04230094265527085, 0.04290557590496496, 0.04356315462567278, 0.04427737207215942, 0.04505406331168616, 0.045900606835392405, 0.046825284765759416, 0.04783664873776902, 0.048942933381553685, 0.050151551311638363, 0.051468693278484405, 0.052899045686393496, 0.05444562633190995, 0.05610972930795372, 0.057890962625769225, 0.05978735780323726, 0.06179552944308294, 0.06391086416679982, 0.06612772136994345, 0.06843963224457485, 0.07083948761700769, 0.07331970883733922, 0.07587239893771051, 0.07848947346016547, 0.08116277179554868, 0.08388415070230663, 0.08664556204447328, 0.08943911684952222 ], [ 0.05592746619037038, 0.053460762316142635, 0.051115574640636076, 0.048904742516208924, 0.04684119918699595, 0.0449376700086961, 0.04320625290947972, 0.04165787446190623, 0.04030163575865263, 0.039144092115943975, 0.03818854491176716, 0.037434453089202034, 0.03687708344651046, 0.03650750228788636, 0.03631296425930851, 0.036277687069919115, 0.036383932150646385, 0.03661326075333314, 0.03694781444596616, 0.03737147896040247, 0.0378708224352112, 0.038435741285315836, 0.03905978871637046, 0.03974019579078423, 0.040477620547632646, 0.041275677365252915, 0.042140308096570704, 0.04307906006326693, 0.04410033479217959, 0.045212665934501316, 0.04642407548349196, 0.04774154481042296, 0.04917062230271983, 0.050715174157738185, 0.052377271032180386, 0.054157192423423296, 0.0560535238894, 0.05806331969002691, 0.06018230457858286, 0.0624050922100413, 0.06472540273503305, 0.06713626752101216, 0.0696302138026155, 0.07219942597692362, 0.07483588309151527, 0.07753147389564254, 0.08027809182076424, 0.08306771264504856, 0.0858924575836038, 0.08874464430097977 ], [ 0.05396483207455848, 0.05138738887522369, 0.04892391745360788, 0.04658778742009565, 0.044392956510682265, 0.04235377555484038, 0.04048465032771955, 0.0387995240321001, 0.037311160342644, 0.036030241376142906, 0.034964348275522014, 0.03411695557868738, 0.03348662355872427, 0.033066587523663774, 0.03284489859494321, 0.03280516860947467, 0.032927842802283384, 0.033191813328059414, 0.03357613087949097, 0.03406158047351857, 0.0346319446535617, 0.03527485478512277, 0.035982204171620714, 0.036750151986472766, 0.03757878188967772, 0.03847149726510252, 0.03943424145605329, 0.040474630236346995, 0.041601077217868696, 0.04282198181554464, 0.04414503424743298, 0.04557667376739234, 0.04712171663235737, 0.048783151521621944, 0.05056208460366153, 0.05245780590113219, 0.05446794367488972, 0.056588673746949356, 0.05881495470584563, 0.06114076614158561, 0.06355933390425562, 0.06606333272340863, 0.06864506169943468, 0.07129659194634792, 0.07400988809351462, 0.07677690667460405, 0.07958967493610127, 0.08244035356263425, 0.08532128647062046, 0.0882250403337444 ], [ 0.05221092267046238, 0.04952858375909876, 0.04695128933627685, 0.044492522717276196, 0.04216684013791027, 0.0399898346918361, 0.037977956327022375, 0.03614811790763015, 0.03451701702825436, 0.033100127593417114, 0.031910377159463425, 0.030956629052681033, 0.030242212235144384, 0.029763836281077972, 0.029511228786594602, 0.02946770111449139, 0.029611617006637586, 0.02991850246680654, 0.030363395331906948, 0.03092303194661822, 0.0315775758961647, 0.03231174222830456, 0.033115301642531805, 0.033983035989337544, 0.034914259808977874, 0.03591203579432324, 0.03698220858786874, 0.0381323699037206, 0.03937085229164042, 0.04070582976344881, 0.04214458122272328, 0.04369294824882139, 0.04535499452677231, 0.047132852952029, 0.049026730714219396, 0.05103503386469264, 0.05315457090156624, 0.055380798407922524, 0.05770807872495928, 0.060129927967878506, 0.06263924075684142, 0.06522848481471903, 0.06788986364356395, 0.07061544883630635, 0.07339728546807844, 0.07622747480299971, 0.0790982386054903, 0.08200196896161288, 0.08493126692150123, 0.08787897262150812 ], [ 0.050674887708294925, 0.04789686525352542, 0.04521410382698581, 0.042639750741090277, 0.04018844257618888, 0.03787646457612443, 0.03572179941334738, 0.033743968469705225, 0.031963539909536924, 0.030401168928856376, 0.02907607645223962, 0.028003996186913033, 0.027194834579650728, 0.026650536660314042, 0.026363796502791987, 0.026318145415622586, 0.02648956791332164, 0.02684930471765437, 0.027367163784452794, 0.0280146235848398, 0.028767224635555037, 0.029606039589325252, 0.030518250054507666, 0.03149698984862221, 0.03254065707296289, 0.0336518900231877, 0.03483637547063625, 0.03610162792582118, 0.03745584948584089, 0.03890695113039021, 0.04046178683733865, 0.042125622311211974, 0.04390183287863394, 0.0457918032534811, 0.047794987725566486, 0.04990908357551752, 0.052130272141673546, 0.05445348876697005, 0.05687269227489086, 0.05938111442945778, 0.06197147849205843, 0.06463618272450954, 0.06736744934141634, 0.0701574422115449, 0.07299835795336138, 0.07588249540165533, 0.07880230812503175, 0.08175044404579519, 0.08471977546221089, 0.08770342202943017 ], [ 0.049363694906385806, 0.0465027694510979, 0.043727210110687795, 0.041049427374330004, 0.038483618484246765, 0.036046128825719725, 0.03375576922577922, 0.03163398486251397, 0.02970470987621623, 0.027993678130917042, 0.026526934292819347, 0.025328373658980476, 0.024416416341252377, 0.023800394927782832, 0.023477710140477608, 0.023432907089891358, 0.023639279019014796, 0.024062629579969883, 0.024666036290186627, 0.025414317630057182, 0.026277336800359364, 0.02723186636628332, 0.028262163597635843, 0.029359587179206493, 0.030521597646353163, 0.03175042467033544, 0.03305161498271554, 0.03443261731723136, 0.035901516042639615, 0.03746598761161115, 0.03913251939652501, 0.04090589834203352, 0.042788949266443145, 0.04478248243292043, 0.04688539896331187, 0.04909490064942864, 0.051406755865577324, 0.0538155828192236, 0.056315122504692984, 0.05889848429019786, 0.06155835578683099, 0.06428717503413517, 0.0670772671707673, 0.0699209500288621, 0.07281061398928035, 0.07573878142971936, 0.07869815057005787, 0.08168162774801002, 0.08468235132787667, 0.08769370966595512 ], [ 0.04828157392769246, 0.04535400605249716, 0.04250270280857157, 0.039739081879740616, 0.03707650646673625, 0.034530820999484894, 0.03212092758871911, 0.02986931618666826, 0.02780237636370826, 0.025950196297575875, 0.024345422391488732, 0.023020707466911615, 0.022004504384617433, 0.021315649910034394, 0.020958213549009168, 0.020918761962111954, 0.02116762045712363, 0.02166391569868028, 0.02236245826007089, 0.023220136482936665, 0.02420037029132279, 0.0252753317586409, 0.026426356679197203, 0.02764316983595904, 0.028922460178186015, 0.030266183562799195, 0.03167983791289659, 0.033170866741207526, 0.03474728947951859, 0.03641661535665609, 0.03818506245256721, 0.04005707262317785, 0.04203508787475498, 0.04411953698290091, 0.04630897393579104, 0.048600311349939466, 0.05098909997677237, 0.05346981677244043, 0.05603613600320811, 0.058681168576926526, 0.061397663227252326, 0.0641781690927502, 0.06701516287765835, 0.06990114563503415, 0.07282871480157661, 0.07579061690165624, 0.07877978568827933, 0.0817893696558634, 0.08481275200723039, 0.08784356537861347 ], [ 0.04742948774142157, 0.044454574489101825, 0.04154856677284968, 0.038721856457369454, 0.03598682515901808, 0.0333585040532622, 0.030855354427852377, 0.028500115538385388, 0.026320575420936954, 0.024349958494347745, 0.022626384575109824, 0.021190614394506542, 0.02008132247632331, 0.019327888972718893, 0.018942397843163473, 0.01891426885129902, 0.019210740355213415, 0.019783476972526078, 0.02057821938436117, 0.021543557472923535, 0.022636591967844292, 0.02382532321440728, 0.02508867464260817, 0.02641517549487746, 0.02780104881809347, 0.029248151548384543, 0.030762011754968392, 0.03235009534086314, 0.03402037329215994, 0.0357802218484456, 0.037635657261056804, 0.03959088033871038, 0.04164808520668271, 0.043807474020097756, 0.04606741572430187, 0.048424691259933005, 0.050874777339322115, 0.05341213312314612, 0.05603046628272423, 0.058722965388018196, 0.06148249355294365, 0.06430174372573304, 0.06717335927243201, 0.07009002507774058, 0.07304453480013778, 0.07602983961198655, 0.07903908306754161, 0.08206562590579401, 0.0851030637577358, 0.08814523997117003 ], [ 0.046804734539150405, 0.04380399869715305, 0.04086738646973119, 0.03800447709395523, 0.035226828800294804, 0.03254871138946739, 0.029988015841878338, 0.02756731953482217, 0.025315000890445524, 0.023266121170599483, 0.021462480806357147, 0.019950841998934443, 0.018778067808867337, 0.01798256407035648, 0.017583640950076015, 0.01757340597354804, 0.017916309320506727, 0.01855732818548351, 0.01943440721577601, 0.02048943291860774, 0.021674784172805533, 0.022955619234698365, 0.024309388031592015, 0.025723979021142197, 0.02719539763996229, 0.02872544270568342, 0.030319597602604643, 0.0319852326067126, 0.03373015894299484, 0.03556154402728333, 0.03748517330650947, 0.03950502311407913, 0.0416230926624743, 0.04383943415781132, 0.04615231893027183, 0.04855848332908193, 0.051053408523212725, 0.053631600563678064, 0.056286848853940516, 0.05901245112172775, 0.06180140048825302, 0.06464653529975943, 0.06754065538459172, 0.07047660982592732, 0.07344736168953313, 0.07644603483246727, 0.07946594725536157, 0.08250063466308694, 0.08554386710155386, 0.08858966081800398 ], [ 0.046400793996969815, 0.04339687027214456, 0.04045542549755211, 0.0375856320245157, 0.03479863796529309, 0.03210833435468666, 0.029532324053071903, 0.02709308555608508, 0.0248192442773593, 0.022746683818689988, 0.020918889180778534, 0.01938541287599346, 0.018196968124250975, 0.017396204398620156, 0.017005721367423475, 0.017018585441807642, 0.017397532662460063, 0.018084155680093885, 0.019012834611654983, 0.020122696637667983, 0.021364396743123067, 0.02270218054802092, 0.024113059124316532, 0.025584680411487686, 0.027112836809532803, 0.02869906028997207, 0.030348493564446914, 0.03206810829836239, 0.033865291855664566, 0.03574679872216516, 0.03771804355803844, 0.039782695854669335, 0.041942523090494066, 0.044197422435253785, 0.04654558126900321, 0.04898371305388046, 0.05150732525088838, 0.0541109875860728, 0.05678858005321953, 0.059533509349893654, 0.062338889466587645, 0.0651976869121122, 0.06810283390112007, 0.07104731421060193, 0.07402422678425404, 0.07702683190884574, 0.08004858419448249, 0.08308315586201087, 0.08612445310340988, 0.08916662760771171 ], [ 0.04620751156487784, 0.04322286835338242, 0.040302370614471124, 0.03745526277902889, 0.03469279723788548, 0.03202900640768366, 0.029481668302645755, 0.027073449241094054, 0.024833120681601345, 0.022796561553260826, 0.02100692076031631, 0.019512848375229087, 0.0183634091886155, 0.017598965605955346, 0.017239797703728008, 0.017277568749198027, 0.01767519398996654, 0.01837589664912994, 0.01931639140315403, 0.020438062486142553, 0.021693288401476322, 0.023047374990694234, 0.024477785246926526, 0.025972133466668698, 0.02752582495389774, 0.029139772043948492, 0.030818369930663694, 0.032567802195746114, 0.03439469665837564, 0.03630512688208315, 0.03830393636433486, 0.040394346943245826, 0.042577801351562986, 0.04485398395619691, 0.04722096414791676, 0.04967541265635318, 0.052212850336977555, 0.05482789957155518, 0.05751451857809156, 0.06026620752160325, 0.06307618187214453, 0.06593751297200318, 0.06884323853416514, 0.07178644719982434, 0.07476034173769543, 0.07775828531853286, 0.08077383481166303, 0.08380076441488468, 0.08683308226754427, 0.08986504208082585 ], [ 0.046211662009700304, 0.04326734311709327, 0.040391912010053405, 0.037595096339361644, 0.0348886764445547, 0.032287225809005386, 0.029809003823443606, 0.027476954392546573, 0.025319666334452092, 0.02337196797572879, 0.02167454012110243, 0.02027161487042868, 0.0192058000192772, 0.01850993079760268, 0.018197937888251713, 0.018258880989775066, 0.018657909285453824, 0.01934411028994217, 0.02026126116373658, 0.021356980040829067, 0.022588127804728166, 0.02392268980711715, 0.02533935135880089, 0.026825913703795723, 0.028377298599478594, 0.02999354428838287, 0.03167798630746907, 0.03343570931433418, 0.03527230345511739, 0.037192929560880085, 0.03920167700325713, 0.041301181957587516, 0.04349246224946898, 0.045774918960220304, 0.04814645479504961, 0.05060366396122479, 0.053142056263211467, 0.05575628742067107, 0.058440376683374144, 0.06118790062582752, 0.06399215807577911, 0.06684630541397152, 0.0697434641906928, 0.07267680446959751, 0.07563960787973929, 0.07862531434097515, 0.08162755606940496, 0.08464018194485752, 0.08765727474973618, 0.09067316323987752 ], [ 0.046397860793499945, 0.04351242864847756, 0.0407031290638372, 0.03798040723177387, 0.03535676099925236, 0.03284739981704393, 0.03047098705533293, 0.028250381962501212, 0.026213197977771607, 0.024391838224476953, 0.022822478138875286, 0.021542352963867615, 0.020584934003590332, 0.019973444826472547, 0.01971457569260149, 0.019795207002578814, 0.020184121630315865, 0.020838176010825625, 0.021710229735321045, 0.022755981165894355, 0.023938260946387083, 0.025228794727404275, 0.026608154167707853, 0.028064676313312862, 0.029592925850224872, 0.031192052426186313, 0.0328642386951356, 0.034613341825615394, 0.0364437782709831, 0.03835966896299124, 0.04036423904567396, 0.04245944887173905, 0.044645820736307025, 0.04692241911638692, 0.049286940946937474, 0.05173587579179013, 0.05426470216419852, 0.056868094078897355, 0.05954011977936807, 0.06227442152767641, 0.06506437088354722, 0.06790319792402896, 0.07078409550046273, 0.07370030115316914, 0.07664515999602343, 0.07961217200976786, 0.08259502696270202, 0.08558762977334299, 0.08858411865479698, 0.0915788779066669 ], [ 0.04674972128798594, 0.04393853224223268, 0.04121244806566413, 0.03858264638132101, 0.03606225583028297, 0.03366688108004139, 0.031415130017720734, 0.029329032764879897, 0.027434158688767328, 0.025759135720043902, 0.024334200614973704, 0.02318846311088642, 0.022345897116050943, 0.021820736437142944, 0.021613693769032907, 0.021710625851333216, 0.022084465597240633, 0.022699797753286143, 0.023518405054787094, 0.02450411328728484, 0.025626024958119352, 0.026860048996547974, 0.028189096714006427, 0.029602423378846582, 0.031094518917295113, 0.03266383012179982, 0.03431149395307665, 0.03604018993507802, 0.037853172369773966, 0.039753510636089756, 0.04174354191628854, 0.04382452261876387, 0.04599645196650904, 0.04825803374641837, 0.05060673981362305, 0.053038940770744544, 0.055550074003532596, 0.058134825542844805, 0.060787308810944525, 0.06350122932172791, 0.06627002934933754, 0.06908701029311104, 0.07194543300863379, 0.07483859792897649, 0.07775990759610457, 0.08070291448320757, 0.08366135690441853, 0.08662918552673624, 0.08960058262571147, 0.09256997583212144 ], [ 0.04725110952110516, 0.04452597296344826, 0.04189581718800126, 0.03937237227266732, 0.03696908818183582, 0.03470148958324848, 0.032587460809471634, 0.03064734619630312, 0.028903697704211806, 0.02738046037119885, 0.026101399806574534, 0.02508770745045606, 0.024355012932494303, 0.023910433306806093, 0.02375058048036839, 0.023861346099404223, 0.024219703236754094, 0.024797003008176558, 0.025562772240627994, 0.026488061885486105, 0.02754779435328298, 0.028721998032795574, 0.029996100996003593, 0.03136055970571573, 0.0328100880547479, 0.03434269664653078, 0.03595869245992561, 0.037659739709744136, 0.0394480451171069, 0.04132570207300306, 0.043294205699946776, 0.04535413335439907, 0.04750497242865855, 0.049745069426282165, 0.0520716709407585, 0.05448102764446046, 0.0569685356243108, 0.05952889420334374, 0.06215626470791204, 0.06484441969030622, 0.06758687641665882, 0.07037701177480767, 0.0732081581413463, 0.07607368128753182, 0.07896704227092041, 0.08188184563234302, 0.0848118762566269, 0.08775112708985287, 0.09069381963277182, 0.09363441881644896 ], [ 0.04788733792403957, 0.04525653281488048, 0.042730740237239676, 0.04032193476321208, 0.03804345925458097, 0.0359102015497806, 0.03393865520043186, 0.03214676680661789, 0.030553451124901498, 0.029177659490788984, 0.028036944274316813, 0.027145594607755407, 0.026512616627848578, 0.026140023592939134, 0.026021963568871403, 0.026145046883785755, 0.026489874201145635, 0.027033385534437005, 0.027751448019776224, 0.028621144940121666, 0.029622437149934885, 0.03073910268091816, 0.03195902805668311, 0.033274004574021326, 0.0346791970687835, 0.03617243299747268, 0.037753428708040195, 0.03942303881988605, 0.04118258739776747, 0.043033316482358884, 0.044975968193686586, 0.04701050096218697, 0.04913592865279202, 0.051350263583639845, 0.053650540550469535, 0.056032898408038004, 0.05849269769260589, 0.06102465624449429, 0.06362298892683331, 0.06628154164811587, 0.06899391353195096, 0.07175356401050344, 0.07455390379432715, 0.07738837014945772, 0.08025048781058593, 0.08313391731353997, 0.08603249267126255, 0.08894025025511909, 0.0918514505634832, 0.09476059432425588 ], [ 0.04864616275668953, 0.04611473044215735, 0.043697901457597325, 0.04140753641435351, 0.03925642827911809, 0.03725832085302434, 0.03542779684765689, 0.03377996784265732, 0.032329900598554374, 0.031091741378125582, 0.030077562573477577, 0.02929605299578489, 0.028751280342045354, 0.028441821963455263, 0.028360533888400402, 0.028495089343904722, 0.028829211770420943, 0.029344344101545818, 0.030021413697933187, 0.030842387752890093, 0.03179142522966573, 0.032855557287287826, 0.03402492556629821, 0.03529266282665787, 0.03665451976854583, 0.03810833872445946, 0.03965346079150264, 0.04129013498134457, 0.04301897957312932, 0.04484052853374263, 0.04675488034345982, 0.048761453396275536, 0.05085884182856489, 0.05304475847123431, 0.055316047604952186, 0.05766874896809339, 0.06009819540542695, 0.06259912891831902, 0.06516582297661339, 0.06779220219888459, 0.07047195349751809, 0.07319862528840052, 0.07596571329592777, 0.07876673285714937, 0.08159527851740525, 0.08444507221248895, 0.0873100015503061, 0.09018414972843011, 0.09306181852641329, 0.09593754564859627 ], [ 0.04951849341153621, 0.04708870277652296, 0.04478224341797997, 0.0426105176915415, 0.040585386769227426, 0.038719069216489065, 0.03702392187558487, 0.03551206667798051, 0.03419484100419432, 0.033082080262913996, 0.03218128962818616, 0.03149681838647246, 0.03102919517663122, 0.03077479017928907, 0.0307259240239216, 0.03087144890161918, 0.03119771691067344, 0.03168976610948519, 0.03233252475145635, 0.03311186011521264, 0.03401535919822667, 0.03503279695230442, 0.036156303809166915, 0.037380280083281175, 0.03870112167251632, 0.04011682451127922, 0.041626529849542626, 0.04323006259750111, 0.04492750315425165, 0.04671882081577463, 0.04860358504335951, 0.050580760367744296, 0.052648582137029075, 0.05480450408428203, 0.057045204893058844, 0.0593666393781434, 0.061764120150018406, 0.064232417152265, 0.06676586470301565, 0.06935846816416137, 0.07200400475784959, 0.07469611513258437, 0.077428383949347, 0.08019440899544746, 0.08298785917886901, 0.08580252227523724, 0.08863234356838402, 0.09147145661499873, 0.09431420733482657, 0.09715517252816991 ], [ 0.05049877003497296, 0.048170655819313894, 0.045973477505009554, 0.04391789071021102, 0.04201454225472393, 0.04027389374053949, 0.03870595765538352, 0.0373199351565565, 0.036123760761806255, 0.03512358354694742, 0.03432324340542088, 0.03372382614906275, 0.03332339144817007, 0.0331169533462775, 0.03309675275132787, 0.03325280451698316, 0.03357364637621806, 0.03404718087861457, 0.03466149387899294, 0.03540555170378217, 0.036269713386273716, 0.03724603203609119, 0.03832835145521949, 0.039512226412398384, 0.040794707363055974, 0.04217403471053311, 0.043649286274467125, 0.045220016469116574, 0.04688591830758424, 0.04864653087153324, 0.05050100623801411, 0.05244794181294774, 0.05448527720836218, 0.05661024963331811, 0.05881939841199054, 0.06110860761705959, 0.06347317563981543, 0.06590790142644806, 0.06840717868293755, 0.0709650912200336, 0.0735755044879436, 0.07623215004520541, 0.07892870111360403, 0.08165883845640523, 0.08441630659416072, 0.08719496088218193, 0.08998880626960636, 0.09279202869588363, 0.09559902010504662, 0.09840439801125402 ], [ 0.05158500748833437, 0.04935690401801747, 0.04726608548972246, 0.04532224719525389, 0.04353464680396649, 0.041911895107023665, 0.04046169696745832, 0.039190548430307164, 0.03810340836598651, 0.037203377341887514, 0.03649142895949837, 0.035966244726917555, 0.035624198223651565, 0.03545951626119536, 0.035464616849986766, 0.03563059308710964, 0.035947787129531686, 0.03640638572682605, 0.036996970387092494, 0.037710968602609606, 0.03854097245152064, 0.039480911878295735, 0.04052608808339151, 0.041673085766208456, 0.04291959113108489, 0.04426414617431177, 0.045705869742233, 0.047244173113280344, 0.048878493241191485, 0.050608061052472245, 0.05243171601515671, 0.05434777222534542, 0.056353936027360274, 0.05844727107102861, 0.060624203901554694, 0.06288056166792295, 0.06521163316229267, 0.06761224490475992, 0.0700768450682846, 0.07259958941789665, 0.07517442488748105, 0.07779516777353594, 0.08045557469069133, 0.08314940536538164, 0.08587047703928695, 0.08861271073550893, 0.09137016994364817, 0.09413709244454112, 0.09690791605891126, 0.09967729909900025 ], [ 0.05277853391807255, 0.05064755357416286, 0.0486589093639869, 0.046821199830808895, 0.04514221628426937, 0.043628734798776034, 0.04228629580956859, 0.04111898565712986, 0.04012924107193562, 0.039317702702746954, 0.03868314523287818, 0.038222507617222415, 0.037931036967262445, 0.03780254491358332, 0.03782975891923831, 0.038004736838876604, 0.038319304298206285, 0.0387654728172374, 0.03933580161761459, 0.04002367580267234, 0.040823485525251064, 0.041730702550746936, 0.042741860692980714, 0.04385445415688817, 0.04506677268430068, 0.04637769474285903, 0.04778646015803759, 0.049292441955248484, 0.05089493417333149, 0.05259296848334475, 0.05438516807256705, 0.05626964290240233, 0.058243926535126805, 0.06030495155830646, 0.062449058390812655, 0.06467203096141236, 0.06696915232003153, 0.06933527350103387, 0.07176488969805639, 0.07425221882424911, 0.0767912786431048, 0.07937595973061824, 0.08200009248339866, 0.08465750717525203, 0.08734208667465321, 0.09004781187741995, 0.0927688002052922, 0.09549933770000361, 0.09823390533199856, 0.1009672001687218 ], [ 0.05408347184251855, 0.0520459026549496, 0.050154436859639356, 0.04841650926610811, 0.04683844662467473, 0.0454252850854852, 0.044180607585994916, 0.04310641745602301, 0.04220306558034323, 0.04146924687986187, 0.040902077142452635, 0.04049725357776969, 0.04024929298176721, 0.040151831836541016, 0.040197964963725644, 0.040380594986979435, 0.04069276447333443, 0.04112794590065535, 0.041680270524607106, 0.04234468449078762, 0.043117027950398235, 0.04399403961011069, 0.044973294571856136, 0.04605308729300259, 0.04723227400787286, 0.048510090077330925, 0.04988595759746839, 0.05135929735740019, 0.052929357091201376, 0.05459506517609637, 0.056354915790647706, 0.058206888384021, 0.060148401418561925, 0.06217629796723412, 0.06428685901687739, 0.06647583928927565, 0.06873851999674085, 0.07106977308519054, 0.07346413203996498, 0.07591586508733555, 0.07841904748382598, 0.08096763044101499, 0.08355550501327198, 0.08617655993869454, 0.08882473295323605, 0.09149405549679156, 0.09417869101115826, 0.09687296721262778, 0.09957140282718004, 0.10226872932361304 ], [ 0.05550602188161255, 0.05355763797772764, 0.05175788571625158, 0.05011302643364, 0.04862798294613688, 0.04730619724991384, 0.046149533228816375, 0.04515823844671569, 0.04433097584746354, 0.04366493060153864, 0.04315599003521932, 0.042798986710680366, 0.042587987720025706, 0.04251660840715625, 0.04257832682606449, 0.04276677637663842, 0.0430759976892596, 0.04350063603579431, 0.04403607633442044, 0.0446785133733302, 0.045424959680271736, 0.046273197273075585, 0.047221682306169764, 0.048269413448236514, 0.049415775781134506, 0.0506603721821284, 0.05200285360684282, 0.05344275850105537, 0.05497936983619295, 0.05661159613162941, 0.05833788048414044, 0.06015613928130426, 0.06206373013432662, 0.06405744679165745, 0.06613353749296742, 0.06828774242953946, 0.07051534566455674, 0.07281123695973415, 0.0751699793508489, 0.07758587890420905, 0.0800530537684355, 0.0825655003291514, 0.08511715491968733, 0.08770195010254146, 0.0903138649973784, 0.09294696948949477, 0.09559546241553452, 0.09825370400374775, 0.100916242959518, 0.1035778386483738 ], [ 0.05705361703273626, 0.05518990848472937, 0.05347618084267649, 0.05191755643872776, 0.050517655389775644, 0.0492785004734347, 0.04820048445200714, 0.04728240956958592, 0.04652160294663411, 0.04591410418415687, 0.045454913851735244, 0.04513828503432747, 0.04495803591767752, 0.044907860142108284, 0.04498161332184857, 0.045173558097467405, 0.045478555412010895, 0.045892195389121336, 0.04641086645327442, 0.04703176568637742, 0.04775285668040507, 0.048572783359874895, 0.04949074956059632, 0.0505063747366643, 0.051619536171075175, 0.05283020758606294, 0.05413830315109451, 0.05554353462142617, 0.05704528777287229, 0.05864252252088575, 0.06033369924520468, 0.06211673202293986, 0.0639889678381084, 0.0659471894951757, 0.06798763898902774, 0.07010605749783783, 0.07229773794774164, 0.07455758619407, 0.07688018719728062, 0.07925987306074032, 0.0816907903651344, 0.0841669648167221, 0.08668236177645236, 0.08923094172359175, 0.09180671011529017, 0.09440376142828373, 0.09701631741474073, 0.09963875978004491, 0.10226565760745013, 0.10489178992481976 ], [ 0.05873402003144126, 0.05695035568890642, 0.055316909536651145, 0.053837731603718915, 0.052515266219651795, 0.05135030507673121, 0.05034201322017077, 0.04948803267835491, 0.04878466108605322, 0.04822709491257748, 0.04780972011804186, 0.04752642841823625, 0.04737093557183909, 0.04733707930566269, 0.047419078157310925, 0.04761173774432039, 0.04791059676367202, 0.04831201052577437, 0.0488131744579768, 0.04941209350898656, 0.050107505734484775, 0.050898769687194055, 0.05178572577517101, 0.05276854168627907, 0.053847551460032575, 0.05502309692644706, 0.05629537909621228, 0.05766432573137631, 0.05912947980865443, 0.060689911980360806, 0.06234415852945651, 0.06409018480269106, 0.0659253727822284, 0.06784653039584337, 0.06984991941384229, 0.07193129834828216, 0.0740859766358273, 0.07630887650387506, 0.07859459922958645, 0.08093749293784967, 0.08333171958557847, 0.08577131929436015, 0.08825027068253706, 0.09076254628524405, 0.09330216252281075, 0.09586322397950639, 0.09843996198800183, 0.10102676768678198, 0.10361821983675318, 0.1062091077591752 ], [ 0.0605544373177129, 0.05884617679162432, 0.05728733111940486, 0.05588096677705508, 0.05462849329270196, 0.053529661415536854, 0.05258263892158903, 0.05178416403968928, 0.0511297688107696, 0.050614057515217595, 0.05023101984178912, 0.04997435560931577, 0.049837787909906735, 0.0498153442434943, 0.04990158982631156, 0.05009180283846672, 0.05038208702645791, 0.05076942211008401, 0.05125165646254645, 0.051827449408364604, 0.0524961722799593, 0.053257778259891565, 0.054112651210999, 0.055061443342080144, 0.05610491081326469, 0.05724375535343379, 0.058478478713365714, 0.05980925537186747, 0.06123582740750231, 0.06275742391425783, 0.0643727058527023, 0.06607973586848441, 0.06787597144961294, 0.06975827888705383, 0.07172296487932281, 0.0737658222826682, 0.07588218643072396, 0.07806699858852839, 0.08031487341182834, 0.08262016769696659, 0.08497704817640259, 0.08737955659562091, 0.08982167076488716, 0.09229736069131961, 0.09480063925008839, 0.09732560714358605, 0.09986649212530707, 0.10241768263615376, 0.10497375612232418, 0.1075295023841124 ], [ 0.0625207189578004, 0.06088328937258848, 0.059393506835025804, 0.05805355674208734, 0.056863960111253685, 0.05582361124746311, 0.05492989332185781, 0.0541788679126518, 0.053565527265836604, 0.05308409185076807, 0.052728331712619564, 0.052491888722617924, 0.052368578111229226, 0.052352651157682104, 0.0524390058089028, 0.05262333743884339, 0.052902227179540316, 0.05327316973466651, 0.05373454606009123, 0.054285548715568205, 0.05492606915243702, 0.05565655686755506, 0.056477860397851076, 0.05739105970413602, 0.05839729871316015, 0.05949762573783152, 0.06069284824142624, 0.06198340701062685, 0.06336927331560965, 0.0648498711334478, 0.06642402506966667, 0.06808993330814049, 0.06984516381763417, 0.07168667119228594, 0.07361083092687794, 0.07561348762409567, 0.0776900135754946, 0.07983537430885095, 0.08204419800091849, 0.08431084606279439, 0.08662948266565362, 0.08899414144561932, 0.09139878807624131, 0.09383737780360148, 0.0963039073899794, 0.09879246120232975, 0.10129725141212716, 0.10381265244799842, 0.1063332299685695, 0.10885376470781294 ], [ 0.0646367033067728, 0.06306565392696979, 0.061639601759378826, 0.06035996063723846, 0.05922650812537647, 0.05823745578295831, 0.05738959445214586, 0.05667850768404442, 0.056098839884078606, 0.05564460070034387, 0.055309484339141374, 0.05508718216981664, 0.05497166899227309, 0.0549574471203936, 0.05503973722392365, 0.05521460991122493, 0.055479056715405844, 0.055831003075294434, 0.056269268907804766, 0.056793484447332114, 0.0574039702831796, 0.05810159110296476, 0.05888759269237416, 0.05976343136866544, 0.06073060432503087, 0.06179048839890264, 0.06294419360031081, 0.06419243639712402, 0.0655354363115012, 0.06697283790652446, 0.06850365881256815, 0.07012626313844299, 0.07183835850242146, 0.07363701405394286, 0.07551869626475351, 0.07747931894907358, 0.07951430390324729, 0.08161864869604668, 0.08378699844089679, 0.08601371878762029, 0.08829296783408508, 0.09061876513497351, 0.09298505644306608, 0.09538577323529163, 0.09781488643786289, 0.10026645406627661, 0.10273466273683553, 0.10521386319052105, 0.10769860010400786, 0.11018363655373288 ], [ 0.06690374832203383, 0.0653947926759156, 0.06402739224214378, 0.06280230053520136, 0.0617186906769257, 0.060774250981541725, 0.05996535062045753, 0.05928726652931392, 0.05873445711555933, 0.058300864339093435, 0.05798022389304334, 0.05776636361348009, 0.05765347260589626, 0.05763632732443211, 0.057710465297042164, 0.05787230172095142, 0.05811918827440068, 0.058449416911897145, 0.05886217402005557, 0.05935745213104844, 0.05993592751867462, 0.06059881256160177, 0.06134769186508271, 0.06218435087575995, 0.06311060516636914, 0.06412813774950503, 0.06523835073622174, 0.06644223642434532, 0.06774027153472328, 0.06913233687874618, 0.07061766331752355, 0.0721948035460044, 0.07386162808150211, 0.07561534291523943, 0.07745252563340793, 0.0793691764388725, 0.08136078038912782, 0.08342237727332995, 0.08554863583189633, 0.08773392942232704, 0.08997241070254525, 0.09225808339308408, 0.09458486965617048, 0.09694667206777159, 0.0993374295423031, 0.10175116689148309, 0.10418203795756906, 0.10662436246040509, 0.1090726568434209, 0.11152165950358195 ], [ 0.0693204701024026, 0.06786952157729945, 0.06655599139292553, 0.06538008155634052, 0.06434049025180016, 0.06343452574818738, 0.06265828426627615, 0.06200688189048121, 0.06147472594425695, 0.06105580819478007, 0.06074400115126731, 0.060533339555434856, 0.06041827160315381, 0.06039386795679543, 0.06045598062430038, 0.060601347774074714, 0.060827644144558476, 0.0611334796770771, 0.06151835127875153, 0.06198255424062877, 0.06252706088246389, 0.06315337457269381, 0.06386336747082068, 0.0646591102248658, 0.06554270146821324, 0.06651610431954202, 0.0675809962127069, 0.06873863729420687, 0.06998976136444575, 0.07133449196650728, 0.07277228482082594, 0.07430189645397697, 0.07592137765985829, 0.07762808943322157, 0.07941873827640736, 0.08128942732020136, 0.0832357195109426, 0.08525270916742678, 0.08733509845602715, 0.08947727571630716, 0.09167339303778897, 0.09391744099229782, 0.09620331892550854, 0.09852489967651247, 0.10087608800619909, 0.10325087236408464, 0.10564336990597581, 0.10804786489406654, 0.1104588407725279, 0.11287100632310894 ], [ 0.07188268668061865, 0.07048589036748738, 0.06922178404961504, 0.0680901214354311, 0.06708924343649984, 0.06621620408271905, 0.06546695377454573, 0.0648365695795163, 0.06431951848119297, 0.06390993719640833, 0.06360191159773705, 0.06338973982592172, 0.06326816552567087, 0.06323257082521054, 0.06327912221794035, 0.06340486597443336, 0.06360777281714926, 0.06388673416543689, 0.0642415142576461, 0.06467266391419411, 0.06518140269584112, 0.06576947681944398, 0.06643900048947565, 0.0671922883333496, 0.06803168641354349, 0.06895940883385845, 0.06997738626106079, 0.07108713175473662, 0.07228962816477984, 0.0735852400683727, 0.07497365185021836, 0.07645383216955733, 0.07802402379664922, 0.07968175672212026, 0.08142388160578969, 0.08324662007088414, 0.08514562806879948, 0.08711606851638758, 0.08915268960014715, 0.09124990549621474, 0.09340187671513041, 0.09560258779303862, 0.09784592057124618, 0.10012572179970643, 0.10243586424338261, 0.10477030085031427, 0.10712311185118516, 0.10948854490352875, 0.11186104857442611, 0.1142352995815693 ], [ 0.07458354501944342, 0.07323730622002168, 0.07201854466972425, 0.07092666110389587, 0.06995974360109006, 0.06911470010036837, 0.0683874416065095, 0.06777310593319597, 0.06726630878812129, 0.06686140730589744, 0.06655276089931897, 0.06633497540829075, 0.0662031186806708, 0.06615289852793871, 0.06618079706267503, 0.06628415840912125, 0.06646122944916116, 0.0667111554991151, 0.06703393457547625, 0.06743033523143413, 0.06790178389387898, 0.06845022827049439, 0.06907798378250919, 0.06978757014150867, 0.07058154513574612, 0.07146234241380575, 0.07243211953723383, 0.07349262181322494, 0.07464506642681948, 0.07589005020884393, 0.07722748306633284, 0.07865654775228677, 0.08017568535617318, 0.08178260474605777, 0.08347431326138013, 0.08524716528944322, 0.08709692497603395, 0.08901883920951208, 0.09100771714300973, 0.09305801283074744, 0.09516390799454783, 0.09731939244932275, 0.09951834025197161, 0.10175458015719793, 0.1040219594379969, 0.10631440054044194, 0.10862595038380878, 0.11095082238710145, 0.1132834315058922, 0.11561842270655555 ], [ 0.07741379454834774, 0.07611480296227859, 0.07493769913454783, 0.07388161678683104, 0.07294448180419486, 0.07212314693804008, 0.07141357083581891, 0.07081103174556891, 0.07031036382526397, 0.06990620273729327, 0.06959322718222123, 0.0693663840977558, 0.06922108715928572, 0.0691533806435882, 0.06916006333627484, 0.06923876970995975, 0.06938800789033309, 0.06960715586424979, 0.06989641894402615, 0.07025675271192221, 0.07068975657965398, 0.07119754376378784, 0.07178259393982732, 0.07244759511495939, 0.07319528134928609, 0.07402827283882109, 0.07494892452616952, 0.07595918880860675, 0.07706049706894542, 0.07825366368894114, 0.07953881497374848, 0.08091534409906445, 0.08238189188476257, 0.08393635199590448, 0.08557589815768378, 0.0872970302054832, 0.08909563530541434, 0.09096706047474233, 0.0929061925790918, 0.09490754223879616, 0.09696532848422103, 0.09907356150134622, 0.10122612135086992, 0.10341683108220538, 0.1056395231648036, 0.10788809860135218, 0.11015657845905555, 0.11243914785292781, 0.11473019264177342, 0.1170243292598697 ], [ 0.08036216295825206, 0.0791074110595795, 0.0779686856658823, 0.07694492929541576, 0.07603398257162307, 0.07523271766280468, 0.07453721016262387, 0.07394294047495682, 0.07344501385758774, 0.07303838735905248, 0.07271809197120166, 0.07247943929801068, 0.07231820369156611, 0.07223077286684665, 0.07221426222214992, 0.07226659025116994, 0.07238651439092975, 0.07257362833032126, 0.07282832318837767, 0.07315171608070448, 0.07354555046746696, 0.0740120733592662, 0.0745538949782297, 0.07517383684155828, 0.07587477444367258, 0.07665948073545638, 0.07753047640244154, 0.0784898925009667, 0.07953935031184779, 0.08067986233004211, 0.08191175717106931, 0.08323462991249017, 0.08464731809285904, 0.08614790235888327, 0.08773372967464088, 0.08940145615555836, 0.09114710600752944, 0.09296614275037846, 0.09485354886843797, 0.09680391022064426, 0.09881150190539718, 0.10087037275345406, 0.10297442615933763, 0.10511749550976644, 0.10729341298870992, 0.10949607100658956, 0.1117194759005766, 0.11395779387772555, 0.11620538942365774, 0.11845685658239037 ], [ 0.08341578921969466, 0.08220258348970089, 0.0810993705635046, 0.08010496721962171, 0.0792171926541291, 0.07843299808884571, 0.07774862950298635, 0.07715981537809402, 0.07666196984133236, 0.07625040090957837, 0.07592051367632116, 0.07566799914027592, 0.07548900077177859, 0.07538025264143738, 0.07533918479347057, 0.07536399336773951, 0.07545367464503508, 0.07560802364849514, 0.07582759916444524, 0.07611365806429733, 0.07646806264688254, 0.07689316540999645, 0.07739167622267903, 0.07796651731003444, 0.07862067176575747, 0.07935703144392417, 0.08017825001391914, 0.08108660665658764, 0.08208388531656344, 0.08317127361003178, 0.08434928445290538, 0.08561770228435901, 0.0869755544999913, 0.08842110747378036, 0.08995188543237737, 0.09156470952776237, 0.09325575378842083, 0.09502061423854977, 0.09685438735358369, 0.09875175413766368, 0.10070706641691204, 0.10271443238516667, 0.10476779895932112, 0.10686102904862989, 0.10898797237451663, 0.1111425289644807, 0.11331870486647487, 0.11551065997939969, 0.11771274816974006, 0.11991955004803537 ], [ 0.08656067348323244, 0.08538663771428232, 0.08431647981037589, 0.08334894618908548, 0.08248188633210593, 0.0817123767526043, 0.08103687336545445, 0.08045138501002028, 0.07995165968715928, 0.0795333745586208, 0.07919232090855606, 0.07892457599524781, 0.0787266548848063, 0.07859563679324551, 0.07852926201103592, 0.07852599701478306, 0.07858506679333695, 0.07870645468112719, 0.07889087108587269, 0.07913969343232231, 0.07945488044173286, 0.07983886455242958, 0.08029442687471017, 0.08082455956295631, 0.08143232086152472, 0.08212068830668126, 0.08289241560467535, 0.08374989851804375, 0.0846950546526482, 0.08572922134301444, 0.08685307490742453, 0.08806657343987752, 0.08936892410084035, 0.09075857465453359, 0.09223322787124377, 0.09378987645186065, 0.0954248553998915, 0.09713390829708993, 0.09891226373665055, 0.10075471821076233, 0.10265572199569944, 0.1046094649749347, 0.10660995983301155, 0.10865112058774894, 0.11072683496153028, 0.11283102959023138, 0.1149577275082999, 0.1171010977181667, 0.1192554969476585, 0.12141550392273286 ], [ 0.08978211159080468, 0.0886451821614958, 0.08760601579090087, 0.08666333442210854, 0.08581505861545874, 0.08505842469059925, 0.08439012613362414, 0.08380647286015694, 0.08330356098338625, 0.08287744534223844, 0.08252430718608672, 0.08224061001689482, 0.08202323754622988, 0.08186960890537376, 0.08177776752907083, 0.08174644141546149, 0.08177507367480678, 0.08186382337763622, 0.08201353768651017, 0.08222569711182924, 0.08250233648792418, 0.08284594493816352, 0.08325934869604416, 0.08374558116908547, 0.08430774505435504, 0.08494887160589687, 0.08567178227470118, 0.08647895785114239, 0.08737241990831252, 0.088353628762034, 0.08942340134514744, 0.0905818513834582, 0.09182835312703042, 0.09316152871878573, 0.09457925816359629, 0.09607870987953987, 0.09765638903510224, 0.09930820034315942, 0.10102952170762594, 0.1028152850886921, 0.10466006113330124, 0.10655814446150008, 0.10850363695293995, 0.11049052688926894, 0.11251276233158906, 0.11456431761148078, 0.11663925226374175, 0.11873176211361898, 0.12083622254438936, 0.12294722421288172 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.32026 (SEM: 0)
x1: 0.316215
x2: 0.617202
x3: 0.706244
x4: 0.442446
x5: 0.302538
x6: 0.689988", "Arm 1_0
l2norm: 1.28803 (SEM: 0)
x1: 0.811902
x2: 0.397874
x3: 0.256599
x4: 0.587825
x5: 0.62507
x6: 0.198599", "Arm 2_0
l2norm: 0.916134 (SEM: 0)
x1: 0.338193
x2: 0.15836
x3: 0.646144
x4: 0.317308
x5: 0.319267
x6: 0.282366", "Arm 3_0
l2norm: 1.13449 (SEM: 0)
x1: 0.336418
x2: 0.780722
x3: 0.0755756
x4: 0.253823
x5: 0.0995698
x6: 0.695929", "Arm 4_0
l2norm: 1.31879 (SEM: 0)
x1: 0.380861
x2: 0.550309
x3: 0.0991958
x4: 0.57631
x5: 0.428499
x6: 0.875051", "Arm 5_0
l2norm: 1.69595 (SEM: 0)
x1: 0.567525
x2: 0.962826
x3: 0.634008
x4: 0.971757
x5: 0.0226276
x6: 0.529474", "Arm 6_0
l2norm: 1.49981 (SEM: 0)
x1: 0.647436
x2: 0.919807
x3: 0.784123
x4: 0.144491
x5: 0.556692
x6: 0.19643", "Arm 7_0
l2norm: 0.958063 (SEM: 0)
x1: 0.433622
x2: 0.632672
x3: 0.302698
x4: 0.416656
x5: 0.155608
x6: 0.200353", "Arm 8_0
l2norm: 1.32949 (SEM: 0)
x1: 0.895307
x2: 0.42466
x3: 0.221151
x4: 0.217061
x5: 0.806897
x6: 0.196305", "Arm 9_0
l2norm: 1.29151 (SEM: 0)
x1: 0.394621
x2: 0.410424
x3: 0.236322
x4: 0.477136
x5: 0.448209
x6: 0.927047", "Arm 10_0
l2norm: 1.36073 (SEM: 0)
x1: 0.452516
x2: 0.689018
x3: 0.00579017
x4: 0.819839
x5: 0.609085
x6: 0.359038", "Arm 11_0
l2norm: 1.07537 (SEM: 0)
x1: 0.122639
x2: 0.808514
x3: 0.137789
x4: 0.29003
x5: 0.580703
x6: 0.217619", "Arm 12_0
l2norm: 0.968311 (SEM: 0)
x1: 0.37559
x2: 0.517996
x3: 0.483859
x4: 0.397443
x5: 0.192537
x6: 0.314783", "Arm 13_0
l2norm: 0.88912 (SEM: 0)
x1: 0.448282
x2: 0.596617
x3: 0.250143
x4: 0.389758
x5: 0.107677
x6: 0.0868881", "Arm 14_0
l2norm: 1.02363 (SEM: 0)
x1: 0.438555
x2: 0.743162
x3: 0.2751
x4: 0.446701
x5: 0.134403
x6: 0.0995962", "Arm 15_0
l2norm: 1.04376 (SEM: 0)
x1: 0.439368
x2: 0.776917
x3: 0.274371
x4: 0.451549
x5: 0.105622
x6: 0.0494945", "Arm 16_0
l2norm: 1.09125 (SEM: 0)
x1: 0.436913
x2: 0.829443
x3: 0.275494
x4: 0.476369
x5: 0.0955716
x6: 0", "Arm 17_0
l2norm: 1.16181 (SEM: 0)
x1: 0.465652
x2: 0.901557
x3: 0.250452
x4: 0.49551
x5: 0.10908
x6: 6.03384e-18", "Arm 18_0
l2norm: 1.14555 (SEM: 0)
x1: 0.384509
x2: 0.895731
x3: 0.314697
x4: 0.503408
x5: 0.0981885
x6: 0", "Arm 19_0
l2norm: 1.12088 (SEM: 0)
x1: 0.302235
x2: 0.905339
x3: 0.252056
x4: 0.524441
x5: 0.0825954
x6: 0.000194035", "Arm 20_0
l2norm: 1.19548 (SEM: 0)
x1: 0.405389
x2: 0.926977
x3: 0.392935
x4: 0.485002
x5: 0.126163
x6: 6.1518e-17", "Arm 21_0
l2norm: 1.18145 (SEM: 0)
x1: 0.405246
x2: 0.90671
x3: 0.340061
x4: 0.537696
x5: 0.0591464
x6: 0.0348358", "Arm 22_0
l2norm: 1.20548 (SEM: 0)
x1: 0.41382
x2: 0.887716
x3: 0.378968
x4: 0.589816
x5: 0.047899
x6: 0.00971014", "Arm 23_0
l2norm: 1.20759 (SEM: 0)
x1: 0.411794
x2: 0.914979
x3: 0.36451
x4: 0.564301
x5: 0
x6: 0.0143285" ], "type": "scatter", "x": [ 0.7062439918518066, 0.2565988237038255, 0.6461439402773976, 0.0755756227299571, 0.09919579513370991, 0.6340076103806496, 0.7841233853250742, 0.30269814655184746, 0.22115143295377493, 0.23632245045155287, 0.005790169350802898, 0.13778851740062237, 0.4838588340231062, 0.25014329806589847, 0.27510013518639664, 0.27437082290123405, 0.275494482254347, 0.25045220037489746, 0.3146965373918134, 0.25205649109542233, 0.39293481926314927, 0.3400612338243544, 0.3789681653174528, 0.36451032802165556 ], "xaxis": "x", "y": [ 0.4424463212490082, 0.5878248661756516, 0.31730847153812647, 0.2538231499493122, 0.5763101866468787, 0.97175707295537, 0.1444914462044835, 0.4166555358096957, 0.21706079319119453, 0.47713612392544746, 0.8198389522731304, 0.29003035463392735, 0.39744329409436485, 0.3897578223599568, 0.44670088651312906, 0.4515489219122116, 0.47636885395621664, 0.4955097575880876, 0.5034082682223749, 0.5244410920925869, 0.4850018190895629, 0.5376964216041936, 0.5898163901590665, 0.5643011144662773 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.32026 (SEM: 0)
x1: 0.316215
x2: 0.617202
x3: 0.706244
x4: 0.442446
x5: 0.302538
x6: 0.689988", "Arm 1_0
l2norm: 1.28803 (SEM: 0)
x1: 0.811902
x2: 0.397874
x3: 0.256599
x4: 0.587825
x5: 0.62507
x6: 0.198599", "Arm 2_0
l2norm: 0.916134 (SEM: 0)
x1: 0.338193
x2: 0.15836
x3: 0.646144
x4: 0.317308
x5: 0.319267
x6: 0.282366", "Arm 3_0
l2norm: 1.13449 (SEM: 0)
x1: 0.336418
x2: 0.780722
x3: 0.0755756
x4: 0.253823
x5: 0.0995698
x6: 0.695929", "Arm 4_0
l2norm: 1.31879 (SEM: 0)
x1: 0.380861
x2: 0.550309
x3: 0.0991958
x4: 0.57631
x5: 0.428499
x6: 0.875051", "Arm 5_0
l2norm: 1.69595 (SEM: 0)
x1: 0.567525
x2: 0.962826
x3: 0.634008
x4: 0.971757
x5: 0.0226276
x6: 0.529474", "Arm 6_0
l2norm: 1.49981 (SEM: 0)
x1: 0.647436
x2: 0.919807
x3: 0.784123
x4: 0.144491
x5: 0.556692
x6: 0.19643", "Arm 7_0
l2norm: 0.958063 (SEM: 0)
x1: 0.433622
x2: 0.632672
x3: 0.302698
x4: 0.416656
x5: 0.155608
x6: 0.200353", "Arm 8_0
l2norm: 1.32949 (SEM: 0)
x1: 0.895307
x2: 0.42466
x3: 0.221151
x4: 0.217061
x5: 0.806897
x6: 0.196305", "Arm 9_0
l2norm: 1.29151 (SEM: 0)
x1: 0.394621
x2: 0.410424
x3: 0.236322
x4: 0.477136
x5: 0.448209
x6: 0.927047", "Arm 10_0
l2norm: 1.36073 (SEM: 0)
x1: 0.452516
x2: 0.689018
x3: 0.00579017
x4: 0.819839
x5: 0.609085
x6: 0.359038", "Arm 11_0
l2norm: 1.07537 (SEM: 0)
x1: 0.122639
x2: 0.808514
x3: 0.137789
x4: 0.29003
x5: 0.580703
x6: 0.217619", "Arm 12_0
l2norm: 0.968311 (SEM: 0)
x1: 0.37559
x2: 0.517996
x3: 0.483859
x4: 0.397443
x5: 0.192537
x6: 0.314783", "Arm 13_0
l2norm: 0.88912 (SEM: 0)
x1: 0.448282
x2: 0.596617
x3: 0.250143
x4: 0.389758
x5: 0.107677
x6: 0.0868881", "Arm 14_0
l2norm: 1.02363 (SEM: 0)
x1: 0.438555
x2: 0.743162
x3: 0.2751
x4: 0.446701
x5: 0.134403
x6: 0.0995962", "Arm 15_0
l2norm: 1.04376 (SEM: 0)
x1: 0.439368
x2: 0.776917
x3: 0.274371
x4: 0.451549
x5: 0.105622
x6: 0.0494945", "Arm 16_0
l2norm: 1.09125 (SEM: 0)
x1: 0.436913
x2: 0.829443
x3: 0.275494
x4: 0.476369
x5: 0.0955716
x6: 0", "Arm 17_0
l2norm: 1.16181 (SEM: 0)
x1: 0.465652
x2: 0.901557
x3: 0.250452
x4: 0.49551
x5: 0.10908
x6: 6.03384e-18", "Arm 18_0
l2norm: 1.14555 (SEM: 0)
x1: 0.384509
x2: 0.895731
x3: 0.314697
x4: 0.503408
x5: 0.0981885
x6: 0", "Arm 19_0
l2norm: 1.12088 (SEM: 0)
x1: 0.302235
x2: 0.905339
x3: 0.252056
x4: 0.524441
x5: 0.0825954
x6: 0.000194035", "Arm 20_0
l2norm: 1.19548 (SEM: 0)
x1: 0.405389
x2: 0.926977
x3: 0.392935
x4: 0.485002
x5: 0.126163
x6: 6.1518e-17", "Arm 21_0
l2norm: 1.18145 (SEM: 0)
x1: 0.405246
x2: 0.90671
x3: 0.340061
x4: 0.537696
x5: 0.0591464
x6: 0.0348358", "Arm 22_0
l2norm: 1.20548 (SEM: 0)
x1: 0.41382
x2: 0.887716
x3: 0.378968
x4: 0.589816
x5: 0.047899
x6: 0.00971014", "Arm 23_0
l2norm: 1.20759 (SEM: 0)
x1: 0.411794
x2: 0.914979
x3: 0.36451
x4: 0.564301
x5: 0
x6: 0.0143285" ], "type": "scatter", "x": [ 0.7062439918518066, 0.2565988237038255, 0.6461439402773976, 0.0755756227299571, 0.09919579513370991, 0.6340076103806496, 0.7841233853250742, 0.30269814655184746, 0.22115143295377493, 0.23632245045155287, 0.005790169350802898, 0.13778851740062237, 0.4838588340231062, 0.25014329806589847, 0.27510013518639664, 0.27437082290123405, 0.275494482254347, 0.25045220037489746, 0.3146965373918134, 0.25205649109542233, 0.39293481926314927, 0.3400612338243544, 0.3789681653174528, 0.36451032802165556 ], "xaxis": "x2", "y": [ 0.4424463212490082, 0.5878248661756516, 0.31730847153812647, 0.2538231499493122, 0.5763101866468787, 0.97175707295537, 0.1444914462044835, 0.4166555358096957, 0.21706079319119453, 0.47713612392544746, 0.8198389522731304, 0.29003035463392735, 0.39744329409436485, 0.3897578223599568, 0.44670088651312906, 0.4515489219122116, 0.47636885395621664, 0.4955097575880876, 0.5034082682223749, 0.5244410920925869, 0.4850018190895629, 0.5376964216041936, 0.5898163901590665, 0.5643011144662773 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -2.154293888967311, -2.4300654663995167, -2.692819717615339, -2.7092695863133742, -2.9154652362135174, -2.9154652362135174, -2.9154652362135174, -3.100799609247281, -3.1140907151622814, -3.1140907151622814, -3.128519874883967 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.31621479988098145
x2: 0.6172017455101013
x3: 0.7062439918518066
x4: 0.4424463212490082
x5: 0.30253785848617554
x6: 0.6899880766868591", "
Parameterization:
x1: 0.8119017668068409
x2: 0.39787373691797256
x3: 0.2565988237038255
x4: 0.5878248661756516
x5: 0.6250696377828717
x6: 0.1985987527295947", "
Parameterization:
x1: 0.3381933942437172
x2: 0.15836010966449976
x3: 0.6461439402773976
x4: 0.31730847153812647
x5: 0.3192668315023184
x6: 0.28236575052142143", "
Parameterization:
x1: 0.33641818165779114
x2: 0.7807221319526434
x3: 0.0755756227299571
x4: 0.2538231499493122
x5: 0.09956976771354675
x6: 0.6959290076047182", "
Parameterization:
x1: 0.38086120691150427
x2: 0.5503091383725405
x3: 0.09919579513370991
x4: 0.5763101866468787
x5: 0.42849938850849867
x6: 0.8750513205304742", "
Parameterization:
x1: 0.5675250813364983
x2: 0.9628264494240284
x3: 0.6340076103806496
x4: 0.97175707295537
x5: 0.02262757532298565
x6: 0.529473596252501", "
Parameterization:
x1: 0.6474357806146145
x2: 0.9198073707520962
x3: 0.7841233853250742
x4: 0.1444914462044835
x5: 0.5566920936107635
x6: 0.19643011689186096", "
Parameterization:
x1: 0.4336216617375612
x2: 0.6326719420030713
x3: 0.30269814655184746
x4: 0.4166555358096957
x5: 0.1556084342300892
x6: 0.2003532387316227", "
Parameterization:
x1: 0.8953071711584926
x2: 0.42465960048139095
x3: 0.22115143295377493
x4: 0.21706079319119453
x5: 0.8068970367312431
x6: 0.19630535133183002", "
Parameterization:
x1: 0.39462097827345133
x2: 0.41042422503232956
x3: 0.23632245045155287
x4: 0.47713612392544746
x5: 0.4482092335820198
x6: 0.9270470486953855", "
Parameterization:
x1: 0.4525161050260067
x2: 0.689017596654594
x3: 0.005790169350802898
x4: 0.8198389522731304
x5: 0.6090848622843623
x6: 0.35903811641037464", "
Parameterization:
x1: 0.12263938784599304
x2: 0.808514135889709
x3: 0.13778851740062237
x4: 0.29003035463392735
x5: 0.580702992156148
x6: 0.21761946473270655", "
Parameterization:
x1: 0.3755896340308345
x2: 0.5179962944903335
x3: 0.4838588340231062
x4: 0.39744329409436485
x5: 0.19253745803887
x6: 0.3147827929180688", "
Parameterization:
x1: 0.4482817211399737
x2: 0.5966169057608754
x3: 0.25014329806589847
x4: 0.3897578223599568
x5: 0.10767695105010013
x6: 0.08688809735361398", "
Parameterization:
x1: 0.4385551133365825
x2: 0.7431621542588341
x3: 0.27510013518639664
x4: 0.44670088651312906
x5: 0.1344032835411189
x6: 0.09959624876073246", "
Parameterization:
x1: 0.43936831990531183
x2: 0.7769166970485729
x3: 0.27437082290123405
x4: 0.4515489219122116
x5: 0.10562195090197206
x6: 0.04949448323111256", "
Parameterization:
x1: 0.4369126822091619
x2: 0.8294433285334746
x3: 0.275494482254347
x4: 0.47636885395621664
x5: 0.09557155445331748
x6: 0.0", "
Parameterization:
x1: 0.46565208109465495
x2: 0.9015569708214667
x3: 0.25045220037489746
x4: 0.4955097575880876
x5: 0.10907987680960073
x6: 6.033836803180118e-18", "
Parameterization:
x1: 0.38450883035723354
x2: 0.8957310744874931
x3: 0.3146965373918134
x4: 0.5034082682223749
x5: 0.09818849418715254
x6: 0.0", "
Parameterization:
x1: 0.3022347855143226
x2: 0.9053391943541343
x3: 0.25205649109542233
x4: 0.5244410920925869
x5: 0.08259539228004306
x6: 0.00019403484058503815", "
Parameterization:
x1: 0.40538893434499135
x2: 0.9269769080164703
x3: 0.39293481926314927
x4: 0.4850018190895629
x5: 0.126162523571402
x6: 6.151800680409196e-17", "
Parameterization:
x1: 0.405246127088327
x2: 0.9067101349859833
x3: 0.3400612338243544
x4: 0.5376964216041936
x5: 0.05914641974645784
x6: 0.03483581396442624", "
Parameterization:
x1: 0.4138195932142098
x2: 0.8877161507779117
x3: 0.3789681653174528
x4: 0.5898163901590665
x5: 0.047898999941939836
x6: 0.009710138873921425", "
Parameterization:
x1: 0.41179425118329027
x2: 0.9149793772943162
x3: 0.36451032802165556
x4: 0.5643011144662773
x5: 0.0
x6: 0.014328459195894224", "
Parameterization:
x1: 0.40960156814499676
x2: 0.9028843565581781
x3: 0.34947836450836417
x4: 0.5880181145970005
x5: 0.03987857675682326
x6: 0.05451576694217824" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -2.154293888967311, -2.4300654663995167, -2.692819717615339, -2.7092695863133742, -2.9154652362135174, -2.9154652362135174, -2.9154652362135174, -3.100799609247281, -3.1140907151622814, -3.1140907151622814, -3.128519874883967 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.053539850205516, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -1.139768527064701, -2.154293888967311, -2.4300654663995167, -2.692819717615339, -2.7092695863133742, -2.9154652362135174, -2.9154652362135174, -2.9154652362135174, -3.100799609247281, -3.1140907151622814, -3.1140907151622814, -3.128519874883967 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -1.053539850205516 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:13] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:13] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:13] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.399258, 'x2': 0.872349, 'x3': 0.379198, 'x4': 0.566144, 'x5': 0.021198, 'x6': 0.054116}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-26 20:12:18] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.12" } }, "nbformat": 4, "nbformat_minor": 2 }