{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:23:51.951770Z", "iopub.status.busy": "2022-12-29T21:23:51.951493Z", "iopub.status.idle": "2022-12-29T21:23:54.315803Z", "shell.execute_reply": "2022-12-29T21:23:54.315139Z" } }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:23:54.375958Z", "iopub.status.busy": "2022-12-29T21:23:54.375068Z", "iopub.status.idle": "2022-12-29T21:23:54.379379Z", "shell.execute_reply": "2022-12-29T21:23:54.378846Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:23:54.381894Z", "iopub.status.busy": "2022-12-29T21:23:54.381310Z", "iopub.status.idle": "2022-12-29T21:23:54.393911Z", "shell.execute_reply": "2022-12-29T21:23:54.393343Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 12 trials, GPEI for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:23:54.396333Z", "iopub.status.busy": "2022-12-29T21:23:54.395729Z", "iopub.status.idle": "2022-12-29T21:23:54.399802Z", "shell.execute_reply": "2022-12-29T21:23:54.399276Z" } }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:23:54.402218Z", "iopub.status.busy": "2022-12-29T21:23:54.401638Z", "iopub.status.idle": "2022-12-29T21:25:45.924346Z", "shell.execute_reply": "2022-12-29T21:25:45.923806Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/runner/work/Ax/Ax/ax/core/observation.py:274: FutureWarning:\n", "\n", "In a future version of pandas, a length 1 tuple will be returned when iterating over a groupby with a grouper equal to a list of length 1. Don't supply a list with a single grouper to avoid this warning.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.248976, 'x2': 0.230282, 'x3': 0.735156, 'x4': 0.417042, 'x5': 0.807821, 'x6': 0.178425}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.117121, 0.0), 'l2norm': (1.230368, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.096023, 'x2': 0.815353, 'x3': 0.561411, 'x4': 0.536357, 'x5': 0.972022, 'x6': 0.692599}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.097308, 0.0), 'l2norm': (1.643594, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.156403, 'x2': 0.858762, 'x3': 0.765385, 'x4': 0.777066, 'x5': 0.799142, 'x6': 0.761238}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.013942, 0.0), 'l2norm': (1.780363, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.961731, 'x2': 0.561134, 'x3': 0.707312, 'x4': 0.420589, 'x5': 0.749887, 'x6': 0.200761}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.00521, 0.0), 'l2norm': (1.58733, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.428804, 'x2': 0.191727, 'x3': 0.29139, 'x4': 0.956337, 'x5': 0.743798, 'x6': 0.104274}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.015254, 0.0), 'l2norm': (1.33575, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.111671, 'x2': 0.393274, 'x3': 0.021062, 'x4': 0.540779, 'x5': 0.567671, 'x6': 0.948091}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.165577, 0.0), 'l2norm': (1.29659, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.950978, 'x2': 0.490146, 'x3': 0.148555, 'x4': 0.077776, 'x5': 0.793243, 'x6': 0.697534}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.004405, 0.0), 'l2norm': (1.512782, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.746434, 'x2': 0.640313, 'x3': 0.771447, 'x4': 0.075774, 'x5': 0.785575, 'x6': 0.324499}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.012082, 0.0), 'l2norm': (1.513428, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.338152, 'x2': 0.602784, 'x3': 0.134864, 'x4': 0.743678, 'x5': 0.922402, 'x6': 0.194144}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.771418, 0.0), 'l2norm': (1.391926, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.564269, 'x2': 0.010032, 'x3': 0.190226, 'x4': 0.238262, 'x5': 0.923009, 'x6': 0.626426}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.014593, 0.0), 'l2norm': (1.286783, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.066505, 'x2': 0.085254, 'x3': 0.181838, 'x4': 0.576385, 'x5': 0.612311, 'x6': 0.272805}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.079032, 0.0), 'l2norm': (0.909023, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.882353, 'x2': 0.8155, 'x3': 0.422534, 'x4': 0.850211, 'x5': 0.662138, 'x6': 0.590321}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:23:54] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.001378, 0.0), 'l2norm': (1.769713, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:02] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.210376, 'x2': 0.454428, 'x3': 0.114578, 'x4': 0.631594, 'x5': 0.823961, 'x6': 0.210003}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:03] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.232548, 0.0), 'l2norm': (1.177206, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:14] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.221159, 'x2': 0.515688, 'x3': 0.110552, 'x4': 0.636218, 'x5': 0.833154, 'x6': 0.204836}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:14] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.371586, 0.0), 'l2norm': (1.211588, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:29] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.233881, 'x2': 0.557273, 'x3': 0.108864, 'x4': 0.642298, 'x5': 0.840535, 'x6': 0.200595}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:29] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.508987, 0.0), 'l2norm': (1.239511, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:38] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.235712, 'x2': 0.623355, 'x3': 0.099583, 'x4': 0.618441, 'x5': 0.810344, 'x6': 0.184075}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:38] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.774671, 0.0), 'l2norm': (1.235741, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:47] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.241427, 'x2': 0.659143, 'x3': 0.09641, 'x4': 0.610123, 'x5': 0.79627, 'x6': 0.174239}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:47] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-0.962625, 0.0), 'l2norm': (1.240446, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:57] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.243362, 'x2': 0.715119, 'x3': 0.090508, 'x4': 0.588752, 'x5': 0.761581, 'x6': 0.15512}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:24:57] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.258836, 0.0), 'l2norm': (1.236733, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:05] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.237091, 'x2': 0.791041, 'x3': 0.081818, 'x4': 0.556624, 'x5': 0.70982, 'x6': 0.1263}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:05] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.552996, 0.0), 'l2norm': (1.232185, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:14] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.232637, 'x2': 0.848263, 'x3': 0.075192, 'x4': 0.537663, 'x5': 0.678757, 'x6': 0.105289}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:14] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.666429, 0.0), 'l2norm': (1.241049, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:21] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.262715, 'x2': 0.853656, 'x3': 0.032562, 'x4': 0.505887, 'x5': 0.651571, 'x6': 0.0531}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:21] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.013416, 0.0), 'l2norm': (1.217413, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:28] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.311531, 'x2': 0.859782, 'x3': 0.00191, 'x4': 0.491899, 'x5': 0.648015, 'x6': 0.022731}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:28] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.395761, 0.0), 'l2norm': (1.224208, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:35] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.359141, 'x2': 0.857291, 'x3': 0.0, 'x4': 0.47549, 'x5': 0.640624, 'x6': 0.000141}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:35] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.557294, 0.0), 'l2norm': (1.224917, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:41] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.373688, 'x2': 0.894462, 'x3': 0.0, 'x4': 0.398036, 'x5': 0.657586, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:41] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.110608, 0.0), 'l2norm': (1.237157, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:45] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.382996, 'x2': 0.839366, 'x3': 0.0, 'x4': 0.532061, 'x5': 0.617507, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:45] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.824621, 0.0), 'l2norm': (1.231107, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:45.926853Z", "iopub.status.busy": "2022-12-29T21:25:45.926396Z", "iopub.status.idle": "2022-12-29T21:25:45.932922Z", "shell.execute_reply": "2022-12-29T21:25:45.932420Z" } }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:45.935312Z", "iopub.status.busy": "2022-12-29T21:25:45.934922Z", "iopub.status.idle": "2022-12-29T21:25:45.960070Z", "shell.execute_reply": "2022-12-29T21:25:45.959524Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:45] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.25, 'x2': 0.23, 'x3': 0.74, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.1, 'x2': 0.82, 'x3': 0.56, 'x...
20Sobol2COMPLETED{'2_0': {'x1': 0.16, 'x2': 0.86, 'x3': 0.77, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.96, 'x2': 0.56, 'x3': 0.71, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.43, 'x2': 0.19, 'x3': 0.29, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.11, 'x2': 0.39, 'x3': 0.02, '...
60Sobol6COMPLETED{'6_0': {'x1': 0.95, 'x2': 0.49, 'x3': 0.15, '...
70Sobol7COMPLETED{'7_0': {'x1': 0.75, 'x2': 0.64, 'x3': 0.77, '...
80Sobol8COMPLETED{'8_0': {'x1': 0.34, 'x2': 0.6, 'x3': 0.13, 'x...
90Sobol9COMPLETED{'9_0': {'x1': 0.56, 'x2': 0.01, 'x3': 0.19, '...
100Sobol10COMPLETED{'10_0': {'x1': 0.07, 'x2': 0.09, 'x3': 0.18, ...
110Sobol11COMPLETED{'11_0': {'x1': 0.88, 'x2': 0.82, 'x3': 0.42, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.21, 'x2': 0.45, 'x3': 0.11, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.22, 'x2': 0.52, 'x3': 0.11, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.23, 'x2': 0.56, 'x3': 0.11, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.24, 'x2': 0.62, 'x3': 0.1, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.24, 'x2': 0.66, 'x3': 0.1, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.24, 'x2': 0.72, 'x3': 0.09, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.24, 'x2': 0.79, 'x3': 0.08, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.23, 'x2': 0.85, 'x3': 0.08, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.26, 'x2': 0.85, 'x3': 0.03, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.31, 'x2': 0.86, 'x3': 0.0, '...
221GPEI22COMPLETED{'22_0': {'x1': 0.36, 'x2': 0.86, 'x3': 0.0, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.37, 'x2': 0.89, 'x3': 0.0, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.38, 'x2': 0.84, 'x3': 0.0, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 0 Sobol 6 COMPLETED \n", "7 0 Sobol 7 COMPLETED \n", "8 0 Sobol 8 COMPLETED \n", "9 0 Sobol 9 COMPLETED \n", "10 0 Sobol 10 COMPLETED \n", "11 0 Sobol 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.25, 'x2': 0.23, 'x3': 0.74, '... \n", "1 {'1_0': {'x1': 0.1, 'x2': 0.82, 'x3': 0.56, 'x... \n", "2 {'2_0': {'x1': 0.16, 'x2': 0.86, 'x3': 0.77, '... \n", "3 {'3_0': {'x1': 0.96, 'x2': 0.56, 'x3': 0.71, '... \n", "4 {'4_0': {'x1': 0.43, 'x2': 0.19, 'x3': 0.29, '... \n", "5 {'5_0': {'x1': 0.11, 'x2': 0.39, 'x3': 0.02, '... \n", "6 {'6_0': {'x1': 0.95, 'x2': 0.49, 'x3': 0.15, '... \n", "7 {'7_0': {'x1': 0.75, 'x2': 0.64, 'x3': 0.77, '... \n", "8 {'8_0': {'x1': 0.34, 'x2': 0.6, 'x3': 0.13, 'x... \n", "9 {'9_0': {'x1': 0.56, 'x2': 0.01, 'x3': 0.19, '... \n", "10 {'10_0': {'x1': 0.07, 'x2': 0.09, 'x3': 0.18, ... \n", "11 {'11_0': {'x1': 0.88, 'x2': 0.82, 'x3': 0.42, ... \n", "12 {'12_0': {'x1': 0.21, 'x2': 0.45, 'x3': 0.11, ... \n", "13 {'13_0': {'x1': 0.22, 'x2': 0.52, 'x3': 0.11, ... \n", "14 {'14_0': {'x1': 0.23, 'x2': 0.56, 'x3': 0.11, ... \n", "15 {'15_0': {'x1': 0.24, 'x2': 0.62, 'x3': 0.1, '... \n", "16 {'16_0': {'x1': 0.24, 'x2': 0.66, 'x3': 0.1, '... \n", "17 {'17_0': {'x1': 0.24, 'x2': 0.72, 'x3': 0.09, ... \n", "18 {'18_0': {'x1': 0.24, 'x2': 0.79, 'x3': 0.08, ... \n", "19 {'19_0': {'x1': 0.23, 'x2': 0.85, 'x3': 0.08, ... \n", "20 {'20_0': {'x1': 0.26, 'x2': 0.85, 'x3': 0.03, ... \n", "21 {'21_0': {'x1': 0.31, 'x2': 0.86, 'x3': 0.0, '... \n", "22 {'22_0': {'x1': 0.36, 'x2': 0.86, 'x3': 0.0, '... \n", "23 {'23_0': {'x1': 0.37, 'x2': 0.89, 'x3': 0.0, '... \n", "24 {'24_0': {'x1': 0.38, 'x2': 0.84, 'x3': 0.0, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:45.962535Z", "iopub.status.busy": "2022-12-29T21:25:45.962117Z", "iopub.status.idle": "2022-12-29T21:25:46.335612Z", "shell.execute_reply": "2022-12-29T21:25:46.335064Z" } }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.3829964106728045,\n", " 'x2': 0.8393659479463345,\n", " 'x3': 9.450896237519534e-16,\n", " 'x4': 0.5320607570891966,\n", " 'x5': 0.6175066555542106,\n", " 'x6': 2.3286685902459458e-14}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:46.338165Z", "iopub.status.busy": "2022-12-29T21:25:46.337760Z", "iopub.status.idle": "2022-12-29T21:25:46.341716Z", "shell.execute_reply": "2022-12-29T21:25:46.341219Z" } }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.231106892809965, 'hartmann6': -2.8246138865475627}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:46.344047Z", "iopub.status.busy": "2022-12-29T21:25:46.343659Z", "iopub.status.idle": "2022-12-29T21:25:46.347378Z", "shell.execute_reply": "2022-12-29T21:25:46.346902Z" } }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:46.349744Z", "iopub.status.busy": "2022-12-29T21:25:46.349342Z", "iopub.status.idle": "2022-12-29T21:25:46.997019Z", "shell.execute_reply": "2022-12-29T21:25:46.996461Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:46] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.06183033865803811, -0.05203713867121729, -0.04297095139942286, -0.03501941486986648, -0.028648142285157108, -0.024384185661751157, -0.02277658176414077, -0.024338478387025186, -0.029482943327589606, -0.03846515360339686, -0.05134006256243884, -0.06794072955515085, -0.08787928655112187, -0.1105696660376847, -0.13526859250921142, -0.16112924579726562, -0.18726084450162606, -0.21278737489478106, -0.23689969395369914, -0.2588969139067518, -0.2782148976084833, -0.2944414864028103, -0.307319505430539, -0.31673954705401464, -0.3227250314708093, -0.32541215934571993, -0.3250272047688422, -0.3218632480278742, -0.31625800251769315, -0.30857391586255906, -0.29918127101334513, -0.2884446119589217, -0.2767124909625771, -0.26431028926725325, -0.25153570133405634, -0.23865638695231844, -0.22590927387118076, -0.21350102099203072, -0.2016092131291839, -0.19038393870158632, -0.1799494897238617, -0.1704060102117929, -0.16183099831369163, -0.15428063490942068, -0.14779096436038897, -0.14237898989774478, -0.13804376608248692, -0.13476757417087537, -0.1325172546426273, -0.1312457475825486 ], [ -0.055665317914524226, -0.045634478576751514, -0.036410811752653705, -0.02840703812738632, -0.022117357579773955, -0.018099878207118447, -0.016934518830025724, -0.019161177042594235, -0.025211211842804615, -0.03534579440162666, -0.049610800601461946, -0.067813870525531, -0.08952592280717664, -0.11410631207693955, -0.14074785479011198, -0.1685355437739735, -0.19651144489322359, -0.22373826819310494, -0.24935528680201274, -0.2726222107394795, -0.2929487968374511, -0.3099099632907984, -0.3232477176123239, -0.3328622064408186, -0.3387946833904198, -0.34120526294017467, -0.34034810280906413, -0.3365462472576792, -0.33016786315174346, -0.3216050806848797, -0.3112561617396135, -0.29951129387862835, -0.28674196578766126, -0.2732936282206798, -0.2594811815517959, -0.24558674820659854, -0.2318591718977716, -0.21851471958118263, -0.20573853002087705, -0.19368644005225877, -0.18248691398784367, -0.17224289403944526, -0.1630334737578346, -0.154915368047995, -0.14792420951706142, -0.14207574001317635, -0.13736698739261421, -0.13377752105113117, -0.13127086716898573, -0.1297961391005802 ], [ -0.04948040249538499, -0.03921738486714477, -0.02984714298656599, -0.021809034200218513, -0.015627201483227937, -0.011891800180055867, -0.011214226883204947, -0.014161383783532266, -0.021182840974388495, -0.032545234197031925, -0.04828418855581984, -0.06817993882412454, -0.09175935046631833, -0.11832364839661502, -0.1469977896594028, -0.17679464266945677, -0.2066856151923323, -0.2356694037621323, -0.26283193021971496, -0.28739276077729664, -0.30873576147267917, -0.32642394349486353, -0.3402001124564979, -0.34997597342025294, -0.35581281056697794, -0.3578968779525543, -0.3565123446144862, -0.3520141598602074, -0.3448026445283998, -0.33530104622269186, -0.32393677219623146, -0.31112656485506157, -0.29726552895824826, -0.2827196620314919, -0.2678213765858568, -0.25286742380997357, -0.2381186182563334, -0.22380080431049176, -0.2101065807098954, -0.19719739377621592, -0.18520571097150051, -0.17423708466310184, -0.1643720051548737, -0.15566751781035804, -0.14815863861514045, -0.1418596439664237, -0.1367653329015469, -0.13285236354130403, -0.13008075183830525, -0.12839559311052107 ], [ -0.043308338970755145, -0.0328213821089518, -0.023318272239758353, -0.015266558542913256, -0.009221648144134176, -0.0058066367601420366, -0.005664859961583613, -0.009390365313085347, -0.01745079412534467, -0.030117704801199907, -0.04741530219601375, -0.06909441574450759, -0.0946349661174627, -0.1232764095867872, -0.15407179330414233, -0.1859578460919914, -0.2178317857992207, -0.24862559946669893, -0.2773701988179109, -0.30324442615484065, -0.32560666418796713, -0.34400923282255574, -0.3581975384521975, -0.3680970088517873, -0.37379128122816063, -0.3754950627827517, -0.3735247132156242, -0.36826904745767264, -0.36016223363430144, -0.34966004372007115, -0.33722015408557504, -0.32328672107434536, -0.3082790880462297, -0.292584218129293, -0.27655228521044845, -0.26049478176444657, -0.24468449907393713, -0.2293567846327631, -0.21471156500818, -0.2009157243743912, -0.18810553668875052, -0.1763889537441531, -0.1658476456410498, -0.15653877026669927, -0.14849651126086427, -0.1417334677586487, -0.13624200287252675, -0.13199566146642683, -0.12895075289893954, -0.12704816456720525 ], [ -0.037185896072597036, -0.026486555912275, -0.016867576209767754, -0.008826204358793444, -0.002950357809326176, 0.0001031489168247246, -0.00034129055789933194, -0.004904911767193987, -0.014073244795898443, -0.02812223198179542, -0.04706350622855637, -0.07061649019367888, -0.09821122765365431, -0.1290216912755795, -0.16202488160361006, -0.19607731190699795, -0.229998473891039, -0.2626510163663146, -0.29300931766952665, -0.32021110202459535, -0.3435898874716449, -0.36268872968676824, -0.37725762972206245, -0.3872380600231725, -0.39273845084604747, -0.39400435254711635, -0.3913865330679533, -0.38530963888308095, -0.3762433576357695, -0.3646773518239423, -0.3511006364639667, -0.33598557885473646, -0.3197763181465033, -0.3028811368869867, -0.2856681575082191, -0.26846366892641915, -0.2515523934166636, -0.23517906184024884, -0.21955075729013196, -0.2048395970207314, -0.1911854373027171, -0.1786983962094324, -0.16746108885670252, -0.15753055398081894, -0.14893991703024534, -0.1416998811456356, -0.13580016231560177, -0.1312109885695324, -0.12788476690808492, -0.12575798944666883 ], [ -0.03115381281361984, -0.02025753083469395, -0.010543491189351384, -0.002540038827870794, 0.003131273525946887, 0.005779265631554065, 0.004695848196188401, -0.0007673658677991302, -0.011113587565931726, -0.026622621206955688, -0.04729240595196604, -0.07280896686388172, -0.10254951050450323, -0.13561874825242703, -0.17091342736872595, -0.2072057300043061, -0.24323390760893232, -0.2777887393249952, -0.3097867124212253, -0.33832425084350704, -0.36271085676592235, -0.38248197041465926, -0.39739437451370463, -0.407408060562989, -0.41265879887499746, -0.41342543544371213, -0.41009538664726897, -0.4031310858817252, -0.39303937630827795, -0.38034512253930086, -0.3655696815608903, -0.34921435650043353, -0.331748565988459, -0.3136021944208871, -0.2951614330973163, -0.27676736176108624, -0.2587165340529557, -0.24126289769538073, -0.22462048120219258, -0.20896639688201657, -0.19444383186818137, -0.1811648154688168, -0.1692126558922633, -0.15864402810257772, -0.1494907642595943, -0.14176144678576919, -0.13544293024047227, -0.13050192168988273, -0.12688673171875942, -0.12452927348030585 ], [ -0.025256633540069684, -0.014183313541999198, -0.004399369394259001, 0.003534525607986616, 0.008962229375826691, 0.01115769845615977, 0.009380258445293443, 0.002954468131335153, -0.00864034534813718, -0.025687353310985928, -0.04816971918994184, -0.07573810187456331, -0.1077138959039795, -0.14312872736174498, -0.18079483418254927, -0.21939593851011963, -0.2575855913170038, -0.29408030260349627, -0.3277375097412698, -0.3576123936239364, -0.38299153806650266, -0.4034046468621074, -0.41861766368168146, -0.42861171745189053, -0.43355255883178523, -0.4337548276820994, -0.42964483376384655, -0.4217247246540044, -0.4105400824892483, -0.3966522165708174, -0.38061575066367753, -0.362961566350684, -0.3441847639499159, -0.32473703469001236, -0.30502268784050834, -0.28539752462750945, -0.2661697747268268, -0.24760238852965483, -0.22991608881624748, -0.21329271190185717, -0.1978784976222271, -0.1837871103419234, -0.17110228318934784, -0.15988007075100408, -0.15015076855346865, -0.14192060862305256, -0.13517336775042155, -0.12987202847327028, -0.12596061376963075, -0.1233662790364014 ], [ -0.019542423470843784, -0.008316991820001118, 0.0015068310220232028, 0.009335039963591862, 0.01447616881316649, 0.01616898285793633, 0.013640225574407583, 0.006187548365924056, -0.006726961386702035, -0.02538937953992726, -0.049767058812722476, -0.07947335693140378, -0.11377088290101156, -0.1516143275327918, -0.19172713995328872, -0.23270047246626202, -0.2730998070694949, -0.3115651568656114, -0.3468939859340817, -0.37810055736869314, -0.4044499004648698, -0.4254680978629834, -0.44093282147378743, -0.450849087960488, -0.4554153448144421, -0.45498455013813993, -0.45002413666496355, -0.4410778461102086, -0.42873151315848174, -0.4135840503553374, -0.3962241820635337, -0.37721291872074353, -0.35707135539053797, -0.3362731120591515, -0.3152405899780742, -0.29434417634333493, -0.2739035645242966, -0.2541904452551591, -0.23543194455462402, -0.21781431927922912, -0.20148655797316517, -0.18656366377790967, -0.17312951142719069, -0.16123926767536645, -0.1509214409641183, -0.142179679434702, -0.13499446489049483, -0.12932485351821588, -0.12511039357872356, -0.12227331005286368 ], [ -0.014062365308024405, -0.002715289915473429, 0.007113022075583175, 0.014794508090169467, 0.01960190564674069, 0.020738653081950997, 0.017399024879842573, 0.00885396036046604, -0.005451466901849833, -0.025805806551683297, -0.05215961648365053, -0.08408706293838342, -0.12078901550618737, -0.16113937895334784, -0.20376854300247593, -0.2471710388605201, -0.2898210474850852, -0.3302800743138287, -0.3672849620404401, -0.39980967855649996, -0.42709934485742995, -0.4486787768135099, -0.4643401216764989, -0.47411515001269977, -0.4782377781320779, -0.47710181036725907, -0.4712179943665395, -0.46117347798607017, -0.4475957739491031, -0.4311224572221553, -0.41237708313942145, -0.3919512394719763, -0.37039223273490673, -0.34819564548452386, -0.32580186660900406, -0.30359566575457037, -0.281907929892425, -0.26101877970968745, -0.24116141419418746, -0.222526175856547, -0.20526447332718534, -0.18949233344693095, -0.17529347542419582, -0.16272190118566054, -0.15180407580486766, -0.14254082748491503, -0.13490912617803974, -0.12886390287957927, -0.12434004936185472, -0.12125469494640728 ], [ -0.008870244280991035, 0.002562009941854626, 0.01235361603156071, 0.019842044027339134, 0.02426406050164487, 0.02478785938833261, 0.020575486736756243, 0.010871427126328825, -0.004896017520219509, -0.0270174629027361, -0.055425738453532825, -0.08965398377191436, -0.1288384159733006, -0.17176833300032424, -0.21697684323498223, -0.2628579118173345, -0.3077913754042168, -0.3502584891061952, -0.3889351444068354, -0.42275596337146987, -0.4509481009535873, -0.47303769860127465, -0.4888342930243599, -0.49839937022091574, -0.5020051183441557, -0.500088694109178, -0.49320629003597594, -0.4819901822451702, -0.46711088008153034, -0.44924556523820847, -0.42905323872261814, -0.4071564029762182, -0.38412868973576175, -0.3604875854640444, -0.336691281418524, -0.3131386570057591, -0.2901714648395557, -0.2680778977293372, -0.24709685923478553, -0.22742241261541518, -0.20920803488187834, -0.19257044427769165, -0.17759289508635268, -0.16432793935156842, -0.1527997380721493, -0.1430060622428897, -0.1349201547638843, -0.12849262687405916, -0.12365353872177143, -0.12031476745001846 ], [ -0.004021834466888974, 0.007452762876398844, 0.017160288787917644, 0.024403675492220223, 0.028383866945233094, 0.028234141608294627, 0.02308471494047326, 0.01215396518480949, -0.005146293295106519, -0.029108339149320206, -0.05964638416525303, -0.09625077053109077, -0.13799021471848416, -0.18356565410967896, -0.23140879069036813, -0.2798092417778683, -0.3270497060333257, -0.37152977083840855, -0.41186441058821, -0.4469502064093053, -0.4759985958108996, -0.4985398701504641, -0.5144040187377612, -0.5236852746605721, -0.5266969036746763, -0.5239218709351042, -0.5159638556314582, -0.5035018714624644, -0.48725061688847743, -0.46792769439806253, -0.4462280379339554, -0.4228052822501147, -0.3982593893334733, -0.3731295948644718, -0.3478916245128391, -0.3229581251667495, -0.2986813298091079, -0.27535709931084557, -0.2532296368922456, -0.2324963334610829, -0.2133123615060789, -0.19579478301344555, -0.18002606743909522, -0.16605702547993917, -0.1539092504677233, -0.143577219144723, -0.13503023519778856, -0.12821440116045435, -0.12305477838452095, -0.1194578453624966 ], [ 0.0004257971985421882, 0.011893252641994922, 0.02146285192640196, 0.028403267927749165, 0.03188010924395901, 0.030992343187399074, 0.024838950210194, 0.012612685551813496, -0.006290757982859385, -0.032164893806958195, -0.06490445806762013, -0.10395529599347564, -0.14831586678291464, -0.1965951043176718, -0.2471193335900242, -0.2980702726565755, -0.3476310078136862, -0.39411842975587275, -0.4360870415918052, -0.4723970708792621, -0.5022467984296167, -0.52517371007556, -0.5410314361245655, -0.5499500283385905, -0.552286606466658, -0.5485723192138683, -0.5394602583770942, -0.5256776481334973, -0.5079844232511805, -0.4871392758973287, -0.463873421711742, -0.4388717180255792, -0.4127603484957979, -0.38610004469370407, -0.3593837151734903, -0.3330373628250078, -0.30742325967650763, -0.282844486190187, -0.2595501059488945, -0.23774041845790067, -0.21757189981613734, -0.1991615948581068, -0.18259085978667522, -0.1679084678958459, -0.15513318003380638, -0.14425594340532, -0.13524191480256553, -0.1280325061014399, -0.12254762199565106, -0.11868820723109741 ], [ 0.004415051207764531, 0.015819056952115385, 0.025190208845351725, 0.03176354436071893, 0.03467017010231732, 0.032975649997108114, 0.02574857045572121, 0.012156738328365946, -0.008419773292006827, -0.03627521705146397, -0.07128400438507387, -0.1128458582536026, -0.15988634408041946, -0.21091891078020975, -0.26416075792273486, -0.3176824613198187, -0.369565419058573, -0.4180432535566837, -0.46161090293204743, -0.49909433489171, -0.529681546472348, -0.5529204643202963, -0.568691643353614, -0.5771640302512283, -0.5787413100588119, -0.5740050760913409, -0.5636596140059994, -0.548481671074766, -0.5292773013886898, -0.5068467962774557, -0.4819578532472343, -0.45532650848902545, -0.4276049413700711, -0.39937502582636025, -0.3711464182827903, -0.3433579981952962, -0.31638158126885907, -0.2905269771236408, -0.26604763866449677, -0.24314633165910154, -0.22198042754991387, -0.20266658228537437, -0.18528470405350916, -0.16988123007058265, -0.1564718244391935, -0.14504367291765874, -0.13555758369704973, -0.1279501044528818, -0.12213583603014266, -0.11801006703044903 ], [ 0.007888602052748994, 0.019165966152539626, 0.02827137294991522, 0.03440717976400853, 0.03667116998432551, 0.034096740424756966, 0.025723220586453155, 0.010694400159404926, -0.011624563272934152, -0.04152804333779725, -0.07886925374380171, -0.12300024168055723, -0.17277119200613122, -0.22659680624258471, -0.28258171073211064, -0.33868249438109677, -0.3928772785737641, -0.4433163772403165, -0.4884365788077606, -0.5270321103142823, -0.5582838629483979, -0.5817536262029261, -0.5973522217705935, -0.6052905319017329, -0.6060214141797161, -0.6001790186695035, -0.5885204320182214, -0.5718730532603201, -0.5510897565218085, -0.5270127692402949, -0.5004463135102477, -0.4721374213610694, -0.44276392200558523, -0.4129283776127356, -0.38315667509662155, -0.3539000252313158, -0.32553924075052176, -0.29839033111241997, -0.27271063891781144, -0.24870493365360502, -0.22653106033129178, -0.20630490608618468, -0.188104592374437, -0.17197392116168597, -0.15792519798394267, -0.1459416203124968, -0.1359794535487907, -0.12797021747059534, -0.12182307391597269, -0.11742754694770097 ], [ 0.010790234063819404, 0.02187093672627538, 0.03063652928661198, 0.03625795267631449, 0.037801183419182705, 0.034269036084554005, 0.024673066376659447, 0.008134304835954231, -0.015996023254692626, -0.04801160332211196, -0.08774350970022537, -0.13449462253963496, -0.18703743843640852, -0.24368493230425592, -0.3024260996992768, -0.3611011983687721, -0.41758407013260473, -0.46994228954885664, -0.5165564660050808, -0.5561920429283638, -0.5880262727248161, -0.6116383709787795, -0.626972783452645, -0.6342852881300789, -0.6340803766396576, -0.6270466830158701, -0.613995498458887, -0.5958057955619869, -0.5733777699612425, -0.5475957378960822, -0.5193003239745433, -0.4892692298953556, -0.4582054678042946, -0.42673173420383087, -0.3953895489518751, -0.36464184614597633, -0.334877841152784, -0.3064191787616279, -0.27952656671303, -0.25440629893062205, -0.23121626190922617, -0.21007118873358743, -0.19104707401581356, -0.17418478705448748, -0.1594930174228656, -0.14695075429112048, -0.13650953518188114, -0.12809569957277078, -0.12161284852127263, -0.11694464843413854 ], [ 0.013065690889476511, 0.023873063408471618, 0.032218124019285366, 0.03724194008870141, 0.03798052062965496, 0.033408044675638515, 0.022510168221824944, 0.004386818016983596, -0.021623367259980042, -0.05581230495646172, -0.09798786262603199, -0.14740230609409843, -0.2027483428962319, -0.26223459556238055, -0.32373186252030844, -0.3849623409662063, -0.4436952829725803, -0.4979167822561205, -0.5459538369391792, -0.5865465052488139, -0.6188721309869235, -0.6425310168387848, -0.6575045550537081, -0.6640962500612216, -0.6628644997240243, -0.6545541280028258, -0.640031801904431, -0.6202287609120082, -0.5960928091336322, -0.5685503101195668, -0.5384779985350987, -0.5066837742471055, -0.4738952447307257, -0.4407545893064953, -0.4078182863899793, -0.37556032665740224, -0.3443776902535462, -0.3145970619088561, -0.2864819691462572, -0.2602397381395028, -0.23602785794640613, -0.21395952014818698, -0.19410825372509133, -0.17651170202122557, -0.16117468774339738, -0.14807178038611835, -0.13714961521313807, -0.1283292117473387, -0.12150850320792483, -0.11656522173658235 ], [ 0.014663524313226484, 0.02511455544922958, 0.032951968066135984, 0.03728874335071497, 0.03713306413262307, 0.031432787241763904, 0.019149970747867284, -0.000634443228685333, -0.02859260819044851, -0.06501323383318158, -0.10967971843203994, -0.16179228202474016, -0.21996197396042916, -0.28229086756396526, -0.3465296012024393, -0.4102813234848102, -0.4712111936116302, -0.527225852020764, -0.5766018846468886, -0.6180577963909442, -0.6507749782431929, -0.6743785261433501, -0.6888900103272657, -0.6946633108568613, -0.69231277021801, -0.6826408512414158, -0.6665705084272074, -0.6450856933691906, -0.6191818779477456, -0.5898272295379887, -0.5579341264424964, -0.5243400494945554, -0.4897964951547755, -0.4549643799417803, -0.42041439405690634, -0.38663086417692644, -0.35401785893213705, -0.32290648159650415, -0.29356251788462423, -0.266193825296374, -0.2409570534225171, -0.21796346595134508, -0.19728379162343324, -0.17895216114121193, -0.16296928807013844, -0.1493051213492259, -0.13790123193927106, -0.1286731939466118, -0.12151318170901038, -0.11629293417609754 ], [ 0.015535929082766686, 0.025541703521207326, 0.032778341842752856, 0.03633273290890071, 0.035187649403305765, 0.02826730096117336, 0.014512902647875303, -0.007010947191141481, -0.036984866834003816, -0.07569246429803966, -0.12289113071208135, -0.17772758596910831, -0.2387296041428098, -0.30389102129600726, -0.37084107908641867, -0.4370637683173348, -0.500121578490314, -0.5578445688734152, -0.6084627665740835, -0.650677366763695, -0.6836779390976873, -0.7071180625754198, -0.7210625649625432, -0.7259181157070096, -0.7223567623746884, -0.7112397645018284, -0.6935469912686969, -0.6703152864269886, -0.6425876107055046, -0.6113734844536244, -0.5776202878577504, -0.5421943213876615, -0.5058701490127769, -0.46932658961575235, -0.43314773160135867, -0.39782746904195165, -0.3637762500353938, -0.33132895439531956, -0.3007530531640091, -0.2722564299613688, -0.24599445370564482, -0.222076078296791, -0.2005689047720831, -0.18150327365316987, -0.16487555790527164, -0.15065089740969384, -0.13876565074751535, -0.12912983676461098, -0.12162979714193534, -0.11613123749551046 ], [ 0.015639550967158855, 0.025105823911644287, 0.03164308748052225, 0.03431429821913334, 0.0320794763486999, 0.023842205513414316, 0.008526077505070062, -0.014817445582726352, -0.046874509456003355, -0.08792117610376393, -0.13768692761166057, -0.19526345741236728, -0.2590939141217337, -0.3270628001998925, -0.39667758262987124, -0.4653040102397075, -0.5304043725050318, -0.589735930788849, -0.6414866686847487, -0.6843450890739375, -0.71751318470556, -0.7406766216922274, -0.7539463484516333, -0.757783948052598, -0.7529206133312556, -0.740277235967881, -0.7208909207636264, -0.695851304637793, -0.6662484124668777, -0.6331324567073889, -0.5974850033510188, -0.5602002706453516, -0.5220749587511451, -0.483804871124175, -0.4459866206378495, -0.4091228587721899, -0.3736296776940925, -0.3398450770142043, -0.308037634261288, -0.2784147543792339, -0.25113008933179837, -0.2262899093727293, -0.20395837055799937, -0.18416175743688845, -0.16689188394958054, -0.15210890668941957, -0.1397438393703061, -0.12970105274383126, -0.12186100052149018, -0.1160833346488459 ], [ 0.014936255392135944, 0.02376416610530019, 0.029498673368228645, 0.031181086478528686, 0.02775153445132139, 0.018096316118665356, 0.0011250805748510562, -0.02412004412386648, -0.05832711994287376, -0.1017615770933592, -0.15412262978028424, -0.21444528878095204, -0.28108700288307314, -0.3518225211352231, -0.4240381564085199, -0.4949835075792052, -0.5620242956963779, -0.6228497302889265, -0.6756109166990214, -0.718988601026873, -0.7522014814490864, -0.7749707539401717, -0.7874560685226912, -0.7901757043203962, -0.7839210804278101, -0.7696732064210231, -0.7485264196997485, -0.721622762227763, -0.6900986483763241, -0.6550441121112187, -0.6174739183264495, -0.5783091663246515, -0.53836765826349, -0.49836118900194437, -0.45889796967004737, -0.4204885651915073, -0.3835539569238096, -0.3484345990536813, -0.3153995963426605, -0.2846553755423894, -0.2563534445163024, -0.2305970276656496, -0.20744653205663655, -0.18692393484484704, -0.16901628778130973, -0.15367860610085782, -0.14083644334928724, -0.1303884477057562, -0.12220914918556203, -0.11615214645332173 ], [ 0.013393843850560638, 0.02148076888647732, 0.02630521372364647, 0.02688921027465807, 0.02215601936406375, 0.010978279737305807, -0.007744181458121613, -0.034974165783163924, -0.07139732170239388, -0.11726464133515746, -0.17224216405493964, -0.23530636839995567, -0.3047282082802242, -0.37817302134535563, -0.4529077292465519, -0.5260691990001387, -0.5949314794345018, -0.6571214666248572, -0.7107591669978336, -0.75452274900338, -0.7876518507356581, -0.8099064004176696, -0.821496984113335, -0.8229999693949958, -0.8152676895383647, -0.7993413859566445, -0.7763722887483666, -0.7475541618273612, -0.7140688839439018, -0.6770452336146286, -0.6375300229522087, -0.5964700684423941, -0.5547031457467677, -0.5129559813950378, -0.4718474146831692, -0.43189505411127593, -0.3935240032324238, -0.35707650367748744, -0.3228216135314272, -0.2909642920983478, -0.26165348940142963, -0.23498903707277574, -0.21102730553795168, -0.18978573012336886, -0.17124641469784418, -0.15535909308792095, -0.14204376211276637, -0.1311932925408713, -0.12267627558834349, -0.11634027856551821 ], [ 0.010986705008835806, 0.018227248922567107, 0.02203142349036946, 0.021404400255690126, 0.015255712868886828, 0.0024482029837911146, -0.018123600722557254, -0.047422438521410704, -0.08612647729821066, -0.1344676851426717, -0.19207539020338515, -0.2578654323339266, -0.3300217550335244, -0.40610147257847434, -0.48325516282879405, -0.5585118444808338, -0.629060134497491, -0.6924713456208874, -0.7468407156231731, -0.790849165595403, -0.8237613666860273, -0.8453788623540767, -0.8559650028000606, -0.8561552045723689, -0.8468629828343605, -0.8291895370718649, -0.804342305843617, -0.7735657957376525, -0.738086177642875, -0.6990696978234071, -0.6575939077106538, -0.6146300596444232, -0.571034690087107, -0.5275483408799713, -0.48479947491420194, -0.44331185711584337, -0.40351394183816985, -0.3657490958895388, -0.33028576797703113, -0.2973269759825231, -0.2670187160214872, -0.23945709894139283, -0.21469419028550862, -0.19274266867648937, -0.17357952404645116, -0.15714908859739074, -0.14336572610207432, -0.13211649592737773, -0.12326405694954867, -0.11664998927597436 ], [ 0.00769638720752186, 0.013983504708944161, 0.016655486527880403, 0.014703074915624836, 0.0070252919372727485, -0.007520768486917961, -0.030041003069948613, -0.06149255388239505, -0.10254031050467505, -0.153391821409528, -0.21363547651577897, -0.2821240587400132, -0.35695426606314823, -0.43557710454997, -0.5150312724702915, -0.5922444052428064, -0.664327316267026, -0.7288034182953368, -0.7837499693880414, -0.8278560167943096, -0.8604151195609838, -0.8812729252189349, -0.8907469179176333, -0.8895320587597488, -0.8786028733248006, -0.85911984890619, -0.8323456024116376, -0.7995741112851104, -0.7620744264384733, -0.7210487948573622, -0.6776040541616601, -0.6327345052919215, -0.5873141600443321, -0.5420962134847145, -0.49771772309711976, -0.45470771482790545, -0.4134972259794108, -0.37443009801281407, -0.3377736246421785, -0.3037284286138277, -0.2724371779393744, -0.2439919570999654, -0.21844028089579537, -0.19578987843179985, -0.1760124813834849, -0.15904692168645085, -0.14480187540361056, -0.13315857847071988, -0.12397378627146838, -0.11708315863854368 ], [ 0.0035120790648480726, 0.008738318013168822, 0.01016581317221732, 0.006773296022836606, -0.0025474732840476966, -0.018940968383743373, -0.043508355123248244, -0.0771951596887327, -0.12064651622466127, -0.17403935642387258, -0.2369161856579548, -0.3080639650111751, -0.3854922000212549, -0.46654890612616373, -0.5481668933725907, -0.6271805366731912, -0.7006318561848506, -0.7660049181294497, -0.821366127722558, -0.8654179563609962, -0.897486372742741, -0.9174631573882379, -0.9257207991827074, -0.9230138121439508, -0.910377112020776, -0.889029406051578, -0.8602871181515519, -0.8254921407923926, -0.7859547640031147, -0.7429115908271787, -0.697497159937887, -0.6507273408748382, -0.6034922751407805, -0.5565566148814859, -0.5105649692611204, -0.46605073086414733, -0.4234467636709321, -0.38309675187304537, -0.34526631145718617, -0.3101532414428233, -0.2778965334774364, -0.24858396592684306, -0.22225828221582988, -0.19892209356584944, -0.17854175280500273, -0.16105051617942978, -0.14635134035322828, -0.13431964876718405, -0.12480634524653289, -0.1176412594607833 ], [ -0.0015690147102109808, 0.0024898347902782003, 0.002561662131825404, -0.0023844244182636976, -0.013460677728958426, -0.031808883640726315, -0.058520113901983195, -0.09452186856662315, -0.14043244801187516, -0.196391222923462, -0.2618891658054719, -0.3356443038800297, -0.41557931397722564, -0.49894340626338674, -0.5825710940922354, -0.6632132894543665, -0.7378535422612282, -0.8039458641525563, -0.8595531266599217, -0.9033963249059883, -0.9348369396136618, -0.953814401189629, -0.960756548383411, -0.9564769594011621, -0.9420698716408702, -0.9188107536740759, -0.8880681346542972, -0.8512299955170346, -0.8096460104123746, -0.7645853314350408, -0.717208496373465, -0.6685513851759144, -0.6195188767804176, -0.5708858624281674, -0.5233034569353943, -0.47730853552164976, -0.43333505213422574, -0.3917259270958822, -0.35274460442163313, -0.31658566059242915, -0.283384092429675, -0.2532231214777834, -0.22614052706018895, -0.202133660835638, -0.18116340178501045, -0.1631573797826208, -0.14801282457681209, -0.13559938189220977, -0.1257621795753755, -0.11832533067816686 ], [ -0.007541414268720903, -0.004754091841606467, -0.006146398334140657, -0.012756501000750209, -0.025697444399060188, -0.0461040481189936, -0.0750518011887914, -0.11344348242443891, -0.1618629991976247, -0.22040457736815078, -0.2885013828779375, -0.36479909919979875, -0.4471342944690889, -0.5326626761412806, -0.6181296697188424, -0.7002141346653745, -0.7758526426464442, -0.842479001290634, -0.8981598963165434, -0.941639628899051, -0.972317803457359, -0.9901824707808101, -0.9957166285515586, -0.9897919367496919, -0.9735604484120142, -0.9483525587196051, -0.9155868865293687, -0.8766954216014082, -0.8330651710690341, -0.7859958843745514, -0.7366722965174018, -0.6861486771038116, -0.6353432177359055, -0.5850398214391425, -0.5358950703895575, -0.4884484580665652, -0.4431343190032399, -0.4002942348320917, -0.3601890171634058, -0.3230096552787201, -0.28888686610308645, -0.25789909566300645, -0.23007899682451072, -0.20541854874236254, -0.1838730888392035, -0.16536459604889542, -0.14978459091411755, -0.13699700079735844, -0.1268412771980496, -0.11913595361707963 ], [ -0.014391232777592466, -0.012975712421103958, -0.015936213658522935, -0.024315870205231183, -0.03922534144527878, -0.06178822432392217, -0.0930588934480584, -0.1339085488270665, -0.18487881873668977, -0.2460107247660061, -0.31667287401178096, -0.3954350113625506, -0.48004874811759723, -0.56758273421012, -0.654704075628721, -0.7380324445313831, -0.8144698721807084, -0.88144014887839, -0.9370209793403084, -0.9799843297159239, -1.0097699983305988, -1.026415066612968, -1.030456970990579, -1.0228239937735863, -1.0047240807574738, -0.9775403647432771, -0.9427392469222573, -0.9017944146608352, -0.8561279814897624, -0.8070682173393671, -0.7558221706145696, -0.7034608336024752, -0.6509142677525762, -0.5989741637728266, -0.5483015513191112, -0.4994377063326616, -0.45281666928402176, -0.40877814613339114, -0.3675798943957018, -0.32940898964602533, -0.2943916204930156, -0.26260127342857903, -0.2340653450803204, -0.2087703597235292, -0.1866660743027857, -0.16766881955414226, -0.15166445064246614, -0.13851126106834843, -0.12804314990912502, -0.12007323161929861 ], [ -0.022096180028036816, -0.022147359022673063, -0.026773971420804177, -0.037021835863473074, -0.05399610039455727, -0.07880494086024337, -0.11247612147731556, -0.1558423750558876, -0.20939502203114557, -0.27311356457523867, -0.34629504260166694, -0.42742966761199397, -0.5141857856054776, -0.6035525683345231, -0.6921309813608981, -0.7764955665181558, -0.8535268991692347, -0.9206490211064959, -0.9759575492706225, -1.018255964595472, -1.0470257616399394, -1.0623529102148308, -1.0648280596439417, -1.0554342070308687, -1.0354328805575466, -1.0062574354529499, -0.9694194823885262, -0.9264318881460416, -0.8787494934380503, -0.8277269075682554, -0.7745915454666588, -0.7204294255373913, -0.6661810326385582, -0.6126446365401444, -0.5604847231745974, -0.5102435521807622, -0.46235423693101063, -0.4171541141145484, -0.3748975086453189, -0.3357672975962728, -0.29988493235186386, -0.2673187928559961, -0.23809092419722683, -0.21218234553052606, -0.18953722447038968, -0.1700662746052376, -0.1536497563726048, -0.14014043945107346, -0.12936681878085798, -0.12113677345447205 ], [ -0.030625706896427185, -0.03223159981198842, -0.03861435123955381, -0.05082019104296953, -0.06994567649741179, -0.09707944747088237, -0.133217269842836, -0.17914662565861728, -0.23530056402220467, -0.3015887673426059, -0.3772297397780397, -0.46063082053136567, -0.5493794565157, -0.6403940019939538, -0.7302226243179235, -0.8154096190454551, -0.8928274754476203, -0.9599105681849948, -1.0147788541612193, -1.0562706099970574, -1.0839099600131232, -1.097831095840176, -1.0986761866860864, -1.0874806281139695, -1.065556869305471, -1.034385679463291, -0.99552107009663, -0.9505123890920468, -0.9008446967297148, -0.8478966779807848, -0.7929141234312266, -0.7369963679727671, -0.6810928838502212, -0.62600733847298, -0.572406721138595, -0.5208335212268707, -0.471719339795446, -0.425398698955554, -0.38212215956156564, -0.3420681601398289, -0.3053532478634539, -0.27204058804905196, -0.24214681499311536, -0.21564742590124086, -0.19248102129582223, -0.17255275774550982, -0.15573739893259497, -0.14188232649375543, -0.1308108037593324, -0.12232568088804163 ], [ -0.03994129261594581, -0.04318157526009436, -0.051400906154300374, -0.0656436345549728, -0.08699468204844396, -0.1165191374029313, -0.1551755527179154, -0.20369961592520414, -0.2624584305063726, -0.33128388405420167, -0.4093093727240946, -0.49485659314243097, -0.5854352820210198, -0.6779026122521995, -0.768768116523366, -0.854561107993062, -0.9321592454667665, -0.9990168638410812, -1.0532840923808136, -1.093836683665114, -1.1202417793129622, -1.1326806474207995, -1.1318448671027967, -1.1188195542024828, -1.094965107974232, -1.0618066461006817, -1.020937568325149, -0.9739408533570667, -0.9223291699094043, -0.8675029541210029, -0.8107243561995624, -0.753104320800879, -0.6955998952522845, -0.6390190012518866, -0.5840302255802079, -0.5311755851194098, -0.48088463660705516, -0.4334886947257084, -0.3892342750566635, -0.34829518474405047, -0.310782943587684, -0.2767554346292398, -0.2462238593627885, -0.21915821058306184, -0.1954915757902318, -0.17512364426016558, -0.15792380848808218, -0.14373422358355148, -0.13237311772740212, -0.12363854070189495 ], [ -0.049996872904908396, -0.05494151554026849, -0.06506667796913246, -0.08141248988341987, -0.10504920949961949, -0.1370144683795521, -0.17822461920879284, -0.2293573848355196, -0.2907067695124107, -0.3620195510632701, -0.44233823588608157, -0.529897018649839, -0.6221320760209148, -0.7158498477232949, -0.8075358005241609, -0.8937194134448316, -0.9712962502334166, -1.0377495344861634, -1.091264705213462, -1.1307570654949488, -1.1558366578520571, -1.1667302606443377, -1.1641763936723377, -1.1493069044335968, -1.1235269058992747, -1.088402579482826, -1.045563529275841, -0.9966233910166548, -0.9431197519390937, -0.8864724353537514, -0.827957927934037, -0.7686970952820311, -0.7096531834429969, -0.651637272886374, -0.5953186966694424, -0.5412383545389514, -0.4898232845706604, -0.4414012569492055, -0.39621451347642817, -0.3544320861085385, -0.31616038929337176, -0.28145199761175416, -0.2503126957816084, -0.22270702470216763, -0.1985626451917779, -0.17777389881280725, -0.16020496007149765, -0.14569294457708637, -0.1340512652485487, -0.1250734213862451 ], [ -0.0607394027844117, -0.06744743260240293, -0.0795350404082027, -0.09803572205976452, -0.12400204387724967, -0.15844038936621396, -0.20222020830527454, -0.25595558694575005, -0.31986102715531156, -0.39359188109088583, -0.4760951738074415, -0.5655169836637706, -0.6592251414188446, -0.7539863961061017, -0.8462766658864961, -0.9326401296173649, -1.010002092907563, -1.0758826905371826, -1.1285070464712175, -1.1668315001894152, -1.1905084297732111, -1.1998082013189397, -1.1955135074890613, -1.178799680835488, -1.1511130906210556, -1.1140575156308965, -1.0692954414194134, -1.018468091265807, -0.9631352260923653, -0.9047336730808105, -0.8445522418650453, -0.7837200617149093, -0.7232052477986146, -0.6638210000758039, -0.606236607717946, -0.5509912710113469, -0.49850909609774746, -0.44911402978259246, -0.4030438659570168, -0.3604627677541243, -0.3214720122528605, -0.28611888138483604, -0.2544037975251064, -0.226285937411823, -0.2016876539097212, -0.18049809026754304, -0.16257638361099613, -0.14775482213937363, -0.13584224611967144, -0.12662787463637226 ], [ -0.07210954362056321, -0.08062797415498557, -0.09472075477566799, -0.11541223464039185, -0.14373424457787154, -0.1806582522852851, -0.22700243365751305, -0.28331218683677595, -0.3497170764229978, -0.42577603166587724, -0.5103375626826423, -0.6014605467817788, -0.6964507897576087, -0.7920467263125037, -0.884728737272743, -0.971069166511475, -1.0480336806818351, -1.113186284738595, -1.1647953651131333, -1.2018592281021705, -1.224071634023771, -1.2317443230406429, -1.2257011533428304, -1.20715748836348, -1.1775973175879817, -1.138658405172832, -1.0920326870111445, -1.0393858350562666, -0.9822970064543816, -0.9222176481905465, -0.8604469040663958, -0.7981205531980666, -0.7362103062162709, -0.6755305063620743, -0.616749674733568, -0.5604047955700614, -0.506916693151694, -0.4566052716400387, -0.40970375809001963, -0.3663714037767929, -0.3267043625310239, -0.29074468146762783, -0.25848751338974857, -0.22988679368871867, -0.20485971817366122, -0.18329041067196594, -0.16503317846519117, -0.14991571881754273, -0.1377425637717442, -0.1282989416999586 ], [ -0.08404245978752134, -0.09440542066699753, -0.11053121373728059, -0.13343241545805862, -0.16411705661883325, -0.2035181583495952, -0.252398635431435, -0.31123087844473674, -0.3800552426600337, -0.458330831123957, -0.5448064620193068, -0.6374564546000877, -0.7335319857489586, -0.8297546034291623, -0.9226222468893976, -1.0087474516262194, -1.085145409668341, -1.1494297902379191, -1.1999150153348763, -1.2356417760441747, -1.2563439342600091, -1.2623721600996503, -1.2545882842421108, -1.2342440849911083, -1.2028573960588949, -1.1620962423782955, -1.1136784991361788, -1.0592911028116727, -1.0005298168252008, -0.9388583395525797, -0.8755841978653738, -0.8118482602757425, -0.7486246224309648, -0.6867278628220846, -0.6268250796380386, -0.5694505922785764, -0.5150216576667208, -0.46385397808353906, -0.4161761499964351, -0.37214252008991766, -0.33184417876576633, -0.29531803767705805, -0.2625541106462588, -0.23350124908279468, -0.20807167424694983, -0.18614469829720925, -0.1675700323851419, -0.15217104278769245, -0.13974823846804962, -0.13008316453294277 ], [ -0.09646870661560814, -0.1086968009419842, -0.12686784051038436, -0.1519798873109962, -0.18501409266299496, -0.2268616607447369, -0.27822669546982254, -0.3395050928862125, -0.41064504889764114, -0.4910042381916842, -0.5792326644057861, -0.6732245460873446, -0.7701847951447496, -0.8668292724944107, -0.9596853272649278, -1.0454160161077022, -1.1210936229041921, -1.1843860665864654, -1.2336557920158477, -1.267985828510054, -1.2871485871723616, -1.2915310460563556, -1.2820296754792868, -1.259928930060642, -1.2267766056199063, -1.1842671799380566, -1.1341409017470254, -1.0781027639728578, -1.0177623514495384, -0.9545932751423828, -0.8899095422161305, -0.8248556111972654, -0.7604068207565693, -0.6973771480441667, -0.6364316846028532, -0.5781017046321697, -0.5228006765054845, -0.47084000079431304, -0.4224436339004957, -0.3777610744591696, -0.3368784539078542, -0.29982768829452217, -0.2665938199064392, -0.237120807166187, -0.21131610999414596, -0.18905446455474617, -0.1701812447430644, -0.15451576812794765, -0.1418548251635543, -0.13197660163681535 ], [ -0.10931518820153241, -0.12341509720006394, -0.14362760381134865, -0.17093340930240963, -0.20628371143009272, -0.2505247220085466, -0.3042986778775113, -0.3679224103618928, -0.4412504401850649, -0.5235393324085238, -0.6133432839998819, -0.7084826505220783, -0.8061252402211401, -0.9029919493438374, -0.9956499183710097, -1.0808212201791612, -1.1556411510068718, -1.2178352675065012, -1.265815279402921, -1.2987060927515857, -1.316316891755815, -1.3190682049030396, -1.3078877061633682, -1.2840886973862786, -1.2492449765764524, -1.2050736081528313, -1.1533336156993705, -1.0957448348718997, -1.033927906877669, -0.969364057349225, -0.9033719273845313, -0.8370981325660155, -0.7715181841585184, -0.7074446941903726, -0.6455402350104701, -0.5863327229000066, -0.5302316794503807, -0.4775441614586583, -0.42848952829849113, -0.3832125346252308, -0.3417945003656699, -0.30426252478882027, -0.27059688153921496, -0.24073685937114386, -0.21458539952833167, -0.1920129245384844, -0.17286075379085863, -0.15694445939132062, -0.14405743580849273, -0.13397484837090012 ], [ -0.12250616141296533, -0.1384705072628698, -0.16070460391380825, -0.19016886707041802, -0.2277815069947351, -0.2743408081886692, -0.33042463407140843, -0.3962691606963973, -0.4716352077516014, -0.5556804908479894, -0.6468684859972391, -0.7429535560118741, -0.8410761511628371, -0.9379722495081697, -1.030257579482246, -1.1147198696954328, -1.1885617418659677, -1.2495686412018472, -1.2962020982156672, -1.327628068926717, -1.3436905503510521, -1.3448407604814272, -1.3320340652899032, -1.3066087190676776, -1.2701605071988358, -1.2244251771013512, -1.1711769138255232, -1.1121471915479166, -1.0489649744211678, -0.9831168541967318, -0.9159243214680314, -0.8485347853165511, -0.7819229317100531, -0.7168993160692331, -0.6541235486472693, -0.5941199405458492, -0.5372939687794382, -0.4839483594375541, -0.4342979678350435, -0.38848295381069925, -0.3465800139872463, -0.3086116466251714, -0.2745535932327375, -0.24434072685790065, -0.2178717406063424, -0.19501303087629873, -0.17560216764249492, -0.15945130018014553, -0.14635076580657724, -0.13607306146151388 ], [ -0.13596426116356675, -0.15377172960975494, -0.17799168251607456, -0.20956128631228044, -0.24936281802254273, -0.2981439943994141, -0.35641640180946604, -0.424334986421185, -0.501568324877931, -0.5871794043921486, -0.6795479694365397, -0.7763716499581492, -0.8747736354938234, -0.9715142206468357, -1.0632649243174348, -1.146883995322303, -1.2196441982187212, -1.279392081507383, -1.3246389408290362, -1.354590639246115, -1.369123873975648, -1.3687176109781822, -1.3543513402878706, -1.3273843267001366, -1.2894302914510032, -1.2422397409565091, -1.1875984086369327, -1.127246224619072, -1.0628177831138153, -0.9958028485955017, -0.9275240416077946, -0.8591282712392061, -0.79158847171415, -0.7257125203285845, -0.6621566888804835, -0.6014414979763306, -0.5439683390582026, -0.4900356721435788, -0.4398539880315845, -0.39355904291970484, -0.35122313630670554, -0.3128644156703372, -0.2784543582678861, -0.24792370401185615, -0.22116719439059063, -0.1980475105195726, -0.17839879861445074, -0.1620301253616332, -0.14872912427530038, -0.1382659873676514 ], [ -0.14961152184391235, -0.1692272368846819, -0.19538200899432567, -0.22898680410822214, -0.2708851666615718, -0.3217719583415677, -0.3820912323394354, -0.4519171521248971, -0.5308289251545152, -0.6178006188802456, -0.7111368633271402, -0.8084888931925159, -0.9069728524480238, -1.0033817033713148, -1.0944484458026587, -1.1771051008569728, -1.2486960661410418, -1.3071293043842283, -1.3509652949670186, -1.3794483972643725, -1.3924857694187085, -1.3905811188375585, -1.3747344485869646, -1.3463220586744973, -1.3069715324321107, -1.2584442049227866, -1.2025337573225108, -1.1409854242144597, -1.0754367838217813, -1.0073786383490946, -0.938133084239894, -0.8688453056653354, -0.800485627087798, -0.7338586921259181, -0.669617119762742, -0.6082775120102436, -0.5502371858843779, -0.4957904471216148, -0.44514360405679176, -0.3984282387616143, -0.35571251448683755, -0.31701050969338684, -0.28228973404514557, -0.2514771031363415, -0.22446372715536622, -0.20110890405337134, -0.18124370050891947, -0.16467445651254053, -0.1511864677035677, -0.14054799411118857 ], [ -0.1633703706691999, -0.18474650487553979, -0.21277059800613685, -0.24832453651282116, -0.2922105433775914, -0.34506874917724956, -0.40727509736629114, -0.478824411390986, -0.559210694959003, -0.6473263432084477, -0.7414107667048113, -0.83907986757312, -0.9374528558949495, -1.0333628134192976, -1.12360855257248, -1.2051977301384142, -1.2755467490453896, -1.3326245467669091, -1.3750397721365215, -1.4020736495431594, -1.4136614534381835, -1.4103285721327343, -1.3930918769889349, -1.3633407054935915, -1.3227124192772601, -1.2729752572549715, -1.2159272702908177, -1.1533158842328406, -1.0867790661552847, -1.0178065804373966, -0.9477184093690988, -0.8776568524287589, -0.808588829998044, -0.7413152569375713, -0.676484841240148, -0.614610189637085, -0.5560846024497511, -0.501198384919156, -0.4501538827878735, -0.40307876766408013, -0.36003735840300305, -0.32103997445893623, -0.28605048039211917, -0.25499229988295063, -0.2277532534846325, -0.20418960707394773, -0.18412970838555254, -0.1673775401405153, -0.15371643656107947, -0.14291310613911334 ], [ -0.1771645705750906, -0.2002411669310299, -0.2300557180669004, -0.2674582882678507, -0.3132074656942927, -0.3678872373926252, -0.4318055553879085, -0.5048802834992807, -0.5865255083366985, -0.675560337806279, -0.770169744541649, -0.8679457198744494, -0.9660203467228813, -1.0612734056886381, -1.1505726959280191, -1.2310022476251743, -1.3000499571229, -1.355744711225849, -1.3967419764003046, -1.422358035981691, -1.4325538496603318, -1.427873381015482, -1.4093466993155221, -1.3783721693697988, -1.336592848614052, -1.2857799714282487, -1.227732411547961, -1.164196716798068, -1.096808701092598, -1.0270550740868831, -0.956252174618312, -0.8855383178173128, -0.8158762832023504, -0.7480628155241863, -0.6827425029107628, -0.6204239248355167, -0.5614964629323241, -0.5062466119378595, -0.454873007482357, -0.4074997038845156, -0.3641874943361957, -0.32494327391601124, -0.2897276071726429, -0.2584607789463484, -0.23102768048671185, -0.20728191315487154, -0.18704948033978097, -0.17013238820068366, -0.15631239438430444, -0.14535504175592584 ], [ -0.19092009301803614, -0.21562606798557526, -0.24714015723389043, -0.2862780605738435, -0.3337527543134994, -0.39009117478800237, -0.4555340915833438, -0.5299256408366861, -0.6126061967106503, -0.7023307743604225, -0.7972411755502158, -0.8949169072196359, -0.992512250252045, -1.0869594454990794, -1.1751975211213685, -1.2543867734717629, -1.3220854388563488, -1.3763809083508676, -1.4159738706065856, -1.4402137312004717, -1.4490846358054403, -1.4431459819075263, -1.4234373496707626, -1.3913621196268409, -1.3485649757270233, -1.2968162666719623, -1.2379121816428953, -1.1735953696771326, -1.1054970036975647, -1.035098778277766, -0.9637119156886532, -0.8924697009087651, -0.8223300860680933, -0.7540852504682388, -0.6883754950816946, -0.6257053774483063, -0.5664604918977039, -0.5109237425764503, -0.4592903344624968, -0.41168102228237646, -0.36815341477435143, -0.3287113380002299, -0.2933124207208025, -0.2618741795440464, -0.23427895253945452, -0.21037805790775388, -0.18999554078837788, -0.17293182040776123, -0.15896746884556745, -0.14786725264596767 ], [ -0.20456590442959632, -0.230820197508256, -0.26393231985512966, -0.30468132471711823, -0.3537329879101707, -0.4115568200255693, -0.4783278830383938, -0.5538205592456801, -0.6373084113134069, -0.7274920344830679, -0.8224814299329778, -0.91985472924569, -1.0167971068711181, -1.1102982756849873, -1.1973700306303843, -1.2752482587591196, -1.3415599776394926, -1.3944493775690214, -1.432660619528694, -1.4555742064906938, -1.4631949219543363, -1.4560944321214118, -1.4353181363599181, -1.4022704313713032, -1.358593585176032, -1.3060532186328904, -1.2464393766603004, -1.1814878415500032, -1.1128227119518277, -1.0419187606004643, -0.970080670836315, -0.8984356984297762, -0.8279363238152084, -0.7593698031327997, -0.6933720162007446, -0.6304435333552084, -0.5709663190695076, -0.5152199301062401, -0.46339644130590396, -0.41561364477679175, -0.371926323860225, -0.3323356075893831, -0.29679656863365006, -0.2652243402040548, -0.23749909607656572, -0.21347026363748212, -0.19296032475561598, -0.17576850783610598, -0.16167459430343822, -0.1504429649970226 ], [ -0.21803465390799248, -0.2457474864101683, -0.2803471368628303, -0.32257404198907347, -0.37304561642132494, -0.43217411174648196, -0.5000709780032299, -0.5764454324408386, -0.6605115971532948, -0.750925485568881, -0.8457764306919227, -0.9426517072624758, -1.0387753338430454, -1.1311988294727335, -1.2170077989682988, -1.2935127293216704, -1.3584076712233806, -1.4098917948340024, -1.446750911281797, -1.4683945490326777, -1.474845554004016, -1.4666846880771076, -1.444959489672728, -1.411071401252363, -1.3666562755474057, -1.3134712157559765, -1.2532967196943048, -1.1878587922971706, -1.1187720794732716, -1.0475025757186789, -0.9753470480022114, -0.9034257630644913, -0.8326851191268052, -0.7639071203466411, -0.697723116082634, -0.6346297454432289, -0.5750055190194816, -0.5191269058596507, -0.46718316613587335, -0.4192894801830322, -0.37549817807062597, -0.3358080761822813, -0.30017208247437466, -0.2685033423935931, -0.24068026393132014, -0.21655078409509032, -0.19593622265512411, -0.1786350173014145, -0.16442655533383554, -0.15307522173743227 ], [ -0.23126325377322587, -0.26033745885465104, -0.29630678070659744, -0.339871422788433, -0.3915997303805405, -0.4518473959204632, -0.5206649109825344, -0.5977013941044441, -0.6821191489562499, -0.7725393312694684, -0.8670412161380577, -0.9632309359816904, -1.0583784787030477, -1.1496008949818317, -1.2340583258476674, -1.3091347653126721, -1.3725895430062947, -1.4226750008708557, -1.4582167787201121, -1.4786513514221573, -1.484017049525217, -1.4749005706759446, -1.4523479449609025, -1.4177537405948275, -1.3727434580729547, -1.3190619609018344, -1.2584768642807336, -1.1927015478191407, -1.1233388816983116, -1.0518442730808575, -0.9795052342907439, -0.9074341149490289, -0.8365706458891337, -0.7676912705895124, -0.7014227147044387, -0.6382577551399352, -0.5785716355265574, -0.5226380064581783, -0.47064363771050527, -0.4227014570969728, -0.37886172176454685, -0.3391213279073111, -0.3034314179630095, -0.2717035525397195, -0.24381477876714253, -0.21961194884217417, -0.19891562507256855, -0.18152385602732912, -0.16721603075049862, -0.155756925407752 ], [ -0.2441933486332098, -0.2745257356606311, -0.31174118417580865, -0.35649842922692593, -0.40931649955805044, -0.4704957350715997, -0.5400288024433149, -0.6175101244409901, -0.7020578583955415, -0.7922676776635686, -0.8862186685412126, -0.9815445826937759, -1.0755676332625763, -1.1654735818115913, -1.248497652926872, -1.3220963154402483, -1.3840925602195429, -1.4327902050820729, -1.4670529602413005, -1.4863421991960175, -1.4907091852749934, -1.4807434311916414, -1.457485870329633, -1.422320352474269, -1.376858173809484, -1.3228283216009156, -1.2619822722810052, -1.1960180012332136, -1.1265243369011626, -1.0549443349011964, -0.9825549485505933, -0.9104597068958368, -0.839591105439135, -0.7707197299202388, -0.7044675966999461, -0.6413236945434274, -0.5816601905544473, -0.5257481889550576, -0.473772296119571, -0.42584354957645504, -0.38201051729577684, -0.342268571509106, -0.3065674922628074, -0.27481766201706814, -0.24689517514480175, -0.22264620675884428, -0.2018909670711838, -0.18442751611687658, -0.17003563763995533, -0.1584808812038997 ], [ -0.25677167240404636, -0.28825439126358454, -0.326588369602144, -0.37239003531790504, -0.42612930696365386, -0.4880528431942797, -0.5580990114183063, -0.6358131402585354, -0.720276786195633, -0.8100689818629836, -0.9032776008465738, -0.9975717371259082, -1.0903312062502333, -1.1788131682429914, -1.2603283948645432, -1.3324049670101648, -1.3929281531435145, -1.4402517366848266, -1.4732758536789476, -1.491484796331124, -1.4949402660639133, -1.4842315397781767, -1.4603909554496308, -1.4247879051220518, -1.3790157387178286, -1.3247840360117873, -1.2638249715822245, -1.1978184145259556, -1.1283369451503786, -1.0568095467624594, -0.9845013388332672, -0.9125061446765008, -0.8417486662973961, -0.7729933383481993, -0.7068573820312348, -0.6438260694465294, -0.5842686779966895, -0.5284540339177043, -0.4765649040094751, -0.4287107954520324, -0.3849389694479166, -0.3452436700093487, -0.30957371800767064, -0.2778387247082492, -0.24991423980217142, -0.22564616825142048, -0.20485477156563991, -0.18733851837152438, -0.17287797495830237, -0.1612398397502195 ], [ -0.2689502961302526, -0.30147217076398586, -0.3407946009389825, -0.3874912664988495, -0.44198361366657246, -0.5044667010286872, -0.5748284208803014, -0.6525706788573243, -0.7367457023679045, -0.8259240573870239, -0.9182103994509953, -1.0113158211809141, -1.1026822598854067, -1.1896405166630477, -1.2695773458647834, -1.3400918039773648, -1.3991303405802382, -1.4450954254270618, -1.47692212717748, -1.4941157781014094, -1.4967461130953172, -1.4853992260038154, -1.461095484176902, -1.4251862191556084, -1.3792432301250732, -1.3249532849663415, -1.2640262015984325, -1.198121126793333, -1.1287922499028253, -1.0574528044326683, -0.9853548274634709, -0.913581564429676, -0.8430493689321956, -0.774516227784141, -0.7085944736489593, -0.6457657238072737, -0.5863965425317708, -0.5307537366217652, -0.47901854836867935, -0.43129930718412185, -0.3876423440150032, -0.34804116578877353, -0.3124440337575111, -0.280760191777757, -0.25286504975422236, -0.22860464574556605, -0.20779969133793286, -0.19024945502830493, -0.17573566626439674, -0.16402653918718701 ], [ -0.2806867723388638, -0.314134577293183, -0.35431437579962055, -0.40175704563983755, -0.45683659576727004, -0.5196989119908496, -0.5901854399241782, -0.6677602871717958, -0.75145323461323, -0.8398338024807486, -0.9310304088474798, -1.0228017539203975, -1.1126556032360115, -1.197998236156482, -1.2762928188471594, -1.345208985241083, -1.402753569826029, -1.4473766991497552, -1.4780470568821888, -1.4942892669518555, -1.4961788159994382, -1.484295806429798, -1.4596454186028307, -1.423557490331411, -1.377578831540846, -1.3233701433224736, -1.2626159568351376, -1.1969521770077733, -1.1279125283575333, -1.0568928616017381, -0.9851309073228377, -0.9136984699347023, -0.8435029976221534, -0.7752957231097413, -0.7096839832637545, -0.6471457864570513, -0.5880451441149551, -0.5326470866706301, -0.481131633015045, -0.43360627526933515, -0.3901167804183449, -0.35065630089201366, -0.31517293061410734, -0.28357594334004316, -0.25574100785693477, -0.23151469208459463, -0.2107185493019762, -0.1931530310175028, -0.17860140119507206, -0.16683374618847613 ], [ -0.29194418395979715, -0.32620384268632524, -0.3671102776488291, -0.4151518758480953, -0.47065659743503085, -0.5337238600024274, -0.6041528046436755, -0.6813752206675259, -0.7644048517602235, -0.8518167977051512, -0.9417692185386856, -1.0320730390497925, -1.1203048083098075, -1.2039477490067791, -1.2805418586682782, -1.3478271660991923, -1.4038703752153463, -1.4471684849338433, -1.4767226630746313, -1.492075230155962, -1.493305296470731, -1.4809843380190286, -1.4560993257016175, -1.4199553726787708, -1.3740710555146571, -1.3200779261177749, -1.2596324406433226, -1.1943448507583176, -1.1257264178974302, -1.0551540241994557, -0.9838498937024108, -0.9128735330832407, -0.8431229219479465, -0.775342218266584, -0.7101336366331873, -0.6479716010575498, -0.5892177088048292, -0.5341354364879187, -0.4829038620322356, -0.4356299642821708, -0.3923592983182426, -0.353085032413699, -0.3177554747786778, -0.2862803167458577, -0.2585358755188709, -0.23436963649042508, -0.21360437665974163, -0.1960421033785823, -0.18146797532224646, -0.16965429555492295 ] ], "zauto": true, "zmax": 1.4967461130953172, "zmin": -1.4967461130953172 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.31496612923850553, 0.2908702179323906, 0.2729344443520852, 0.2629477619401756, 0.2615745274099203, 0.2680074654967872, 0.28036726989471283, 0.296513347037733, 0.3146645771619557, 0.3336119804400345, 0.35265080170199303, 0.37141126215718595, 0.38969664163454476, 0.40737198387698215, 0.42430864479714503, 0.44037152220810705, 0.4554302622432067, 0.4693781565496213, 0.4821483168800187, 0.4937225222706402, 0.5041321449711644, 0.5134525988515598, 0.5217934002486148, 0.529285857790654, 0.5360700808364274, 0.5422826479922856, 0.5480459783336531, 0.5534601862011826, 0.5585979380708133, 0.5635025399353121, 0.56818916742345, 0.572648839749002, 0.5768544802126233, 0.5807682440905783, 0.5843492513447193, 0.5875609297632713, 0.5903773231363103, 0.5927879074056135, 0.5948006474369221, 0.5964431934065563, 0.5977622502221359, 0.5988212605412712, 0.5996966330739443, 0.6004728333576214, 0.6012367374061327, 0.6020717225405229, 0.6030520177799874, 0.6042378374984537, 0.6056717596448923, 0.6073766792240931 ], [ 0.31001616334679305, 0.284935169080495, 0.26598391254033876, 0.2550734180772334, 0.25298183438347827, 0.25894012030412833, 0.2710284001763788, 0.28704418577017043, 0.3051695308231391, 0.3241897175461848, 0.3434092503157999, 0.3624651645084917, 0.38115522631135096, 0.39932527256143463, 0.41681822682111347, 0.4334679062703971, 0.44911591052579325, 0.46363385757300907, 0.4769405149170708, 0.4890099335076127, 0.4998708330490953, 0.5095993259084064, 0.5183074437197401, 0.5261296446953205, 0.5332090220848315, 0.5396845186751792, 0.5456801241294532, 0.5512967613349042, 0.5566073076086733, 0.5616549151916639, 0.5664544922419443, 0.5709969097987768, 0.5752552573725206, 0.5791923213281805, 0.5827684262603016, 0.5859488523258333, 0.5887101904743658, 0.5910451823100332, 0.5929657755692088, 0.5945042869318397, 0.5957126942553658, 0.5966601864590036, 0.5974291935717321, 0.5981102127461416, 0.5987958410722887, 0.5995745138568944, 0.6005245078970454, 0.6017087783524725, 0.6031711347257999, 0.6049341203039152 ], [ 0.30633681566892035, 0.2804111355639543, 0.26052299533964235, 0.24867396831668095, 0.24575009991493224, 0.25104736337565337, 0.2626472685356312, 0.2783213950098971, 0.29623687132358695, 0.3151827302352753, 0.33447369084010425, 0.35374921619534017, 0.37279430238588224, 0.3914275555260031, 0.4094563416345461, 0.42667814223023515, 0.44290333228139406, 0.45798040242499016, 0.4718134571616563, 0.48436906841479016, 0.4956737028155383, 0.5058044733944055, 0.514876020735857, 0.5230258179748152, 0.5303996129677881, 0.5371382492134139, 0.5433667586764059, 0.549186346008553, 0.5546696292873956, 0.5598592327780265, 0.5647695400128724, 0.5693911379882659, 0.5736972583404999, 0.5776513877052989, 0.581215195283504, 0.5843560023942223, 0.5870531664838584, 0.5893029317595618, 0.5911214758832569, 0.5925460360102255, 0.5936341228689785, 0.5944609362629485, 0.5951151928907894, 0.5956936790898092, 0.5962949491442376, 0.5970126931386207, 0.5979293736342851, 0.5991107484737961, 0.6006018335174457, 0.6024247065040977 ], [ 0.30397588110564766, 0.27736966156616977, 0.2566500137736419, 0.2438692539825173, 0.24000664696780696, 0.2444487038336507, 0.255326932226129, 0.27043057387458785, 0.2879379417097144, 0.30665227597302047, 0.3258987118297362, 0.3453134027874174, 0.36466001077747817, 0.3837209693937569, 0.4022605550032928, 0.42003469140216915, 0.436819641592908, 0.45243967517045675, 0.46678421666694786, 0.47981279879450844, 0.49155011503738927, 0.5020745775860254, 0.5115034730642738, 0.5199770716875162, 0.5276433553986987, 0.5346445172186376, 0.5411060252354034, 0.5471287737111157, 0.5527845988761118, 0.5581151819938582, 0.5631340938593926, 0.5678314783160923, 0.5721806674861647, 0.5761459038575352, 0.579690330211912, 0.582783488438425, 0.5854077133756751, 0.5875629808716334, 0.5892699380230245, 0.590570989248943, 0.5915294313980518, 0.5922267338434443, 0.5927581603039949, 0.5932270398774292, 0.5937381170217008, 0.5943905307223915, 0.5952710645613339, 0.5964483376842702, 0.5979685430770568, 0.599853174532122 ], [ 0.30294478441737216, 0.27583720590243627, 0.2544123921414089, 0.2407287677532982, 0.23583596778068647, 0.23923197347223163, 0.249149568659465, 0.26344493917657325, 0.2803377163076173, 0.29865722923578414, 0.3177389674872681, 0.33720906707627024, 0.3568002866368451, 0.3762493026715079, 0.3952696201279761, 0.413570631168882, 0.430892038266408, 0.44703323203988626, 0.46186926031257153, 0.4753532311019866, 0.4875085949453316, 0.49841532706697805, 0.5081933154998848, 0.5169853090651384, 0.5249410017021504, 0.5322032922460549, 0.5388973998193362, 0.5451232519677304, 0.5509513301232147, 0.556421919003674, 0.5615474594300528, 0.5663174708532507, 0.5707053270290527, 0.5746760679491317, 0.5781944271111172, 0.5812323358116593, 0.5837753073347597, 0.5858272687607403, 0.5874135669163416, 0.5885820112786418, 0.589401929412301, 0.5899613108480655, 0.5903622193665322, 0.5907147740315007, 0.591130137002516, 0.5917130855352402, 0.5925548550803921, 0.5937269803304904, 0.5952767977452422, 0.5972250946234358 ], [ 0.3032168260299015, 0.2757913870172749, 0.2537999606029892, 0.23926214064123458, 0.23326928767123317, 0.23544435058471208, 0.24417008079582814, 0.25742129409963316, 0.2734924098042095, 0.29125265595285316, 0.3100482412711062, 0.32948816992587987, 0.3492641658940234, 0.36905729642475144, 0.388522782801934, 0.4073190017072983, 0.4251472334537708, 0.4417818295923156, 0.45708408653916216, 0.4710014475869135, 0.48355666279337883, 0.49483146563550173, 0.5049481941835302, 0.5140516411869788, 0.5222925811607881, 0.5298138803580239, 0.5367397462813586, 0.5431684224417362, 0.5491684159516425, 0.5547781264492903, 0.5600085212128718, 0.5648482937840528, 0.5692707844028548, 0.5732418583989446, 0.5767279447812472, 0.5797035215926122, 0.5821574705559055, 0.5840978786991885, 0.5855550120364317, 0.5865823120635071, 0.5872553709180673, 0.587668938435686, 0.587932121624988, 0.5881620676584232, 0.588476575810321, 0.5889862437916933, 0.5897868833904844, 0.5909529934116802, 0.5925330152584647, 0.594546903522788 ], [ 0.304728609095641, 0.2771619719429924, 0.25474442084519566, 0.239416066159622, 0.2322792365713762, 0.23308644916967033, 0.2404111315291574, 0.25239649139690434, 0.26744713292162686, 0.2844882328364408, 0.3028782647831393, 0.32220227283628267, 0.34210081625886446, 0.3621896993579411, 0.3820588886337093, 0.40131200903600184, 0.4196107827021372, 0.4367049022880227, 0.4524428433943129, 0.4667672483915814, 0.47970067787948717, 0.4913267153673802, 0.5017698679575208, 0.5111764092513049, 0.5196974494124255, 0.5274749901221718, 0.5346313911237686, 0.541262438940703, 0.5474340057284952, 0.5531820873261118, 0.5585158113290087, 0.5634228261669981, 0.5678763486051059, 0.5718430838876564, 0.575291248840044, 0.5781980134312881, 0.5805558057355669, 0.5823770692655703, 0.5836971962758042, 0.5845754745541893, 0.5850939817504949, 0.5853544551932668, 0.5854732755908361, 0.585574844292682, 0.5857838059676832, 0.5862167510006638, 0.5869741833297684, 0.5881336072529523, 0.5897445251745399, 0.591825929654215 ], [ 0.3073844644602993, 0.2798365244481036, 0.25712530449342647, 0.24107870952526483, 0.23278118968167402, 0.23211090667037096, 0.23786052413658657, 0.24838483582358106, 0.2622337553276558, 0.2784065358931622, 0.2962772629684096, 0.31540120186867227, 0.3353582608839902, 0.35569006145524684, 0.37591529198536916, 0.39558009496708496, 0.41430634243735376, 0.43182000644153107, 0.4479579420831136, 0.46265890680511, 0.47594570503245687, 0.487903725979232, 0.49865921657833495, 0.5083592324929509, 0.5171543614627923, 0.5251848199209271, 0.5325702173212699, 0.5394030622655165, 0.5457458973596888, 0.551631771803351, 0.5570675894945296, 0.5620397201620998, 0.5665211543626251, 0.5704794395671793, 0.5738846604264765, 0.576716811466907, 0.5789720321264082, 0.5806673055953115, 0.5818433435223852, 0.582565479718149, 0.5829224831085537, 0.5830232900659894, 0.5829917697154172, 0.582959788257169, 0.5830590295310079, 0.5834122357119303, 0.5841247074675412, 0.5852769870725993, 0.5869195879762035, 0.5890704089015267 ], [ 0.31106316712567295, 0.28366964394717986, 0.2607811673286397, 0.244090700502276, 0.23464119457753665, 0.23242599306006112, 0.2364715167578392, 0.24537680462632597, 0.2578691485644326, 0.2730412483169842, 0.29028822229977835, 0.3091313772704902, 0.3290817870847739, 0.34959927307625, 0.3701265859225008, 0.3901508999023316, 0.4092548767417468, 0.42714225446291093, 0.4436396851850936, 0.4586829518174477, 0.47229541324980595, 0.4845640565886242, 0.4956162791790661, 0.5055990831994642, 0.5146615684325875, 0.5229411658160739, 0.5305537758633024, 0.5375877703093755, 0.5441016424883834, 0.5501249352553031, 0.5556619324822102, 0.5606974811672194, 0.5652042326876251, 0.5691505681824018, 0.5725085083582697, 0.5752609922512197, 0.5774080221567066, 0.5789712897680325, 0.5799970039672615, 0.5805567279346211, 0.5807461101453127, 0.5806814791127596, 0.5804943880621227, 0.5803243597146037, 0.5803102926495382, 0.5805812233722735, 0.5812473397550976, 0.5823922437313372, 0.5840674031640131, 0.5862894893791828 ], [ 0.31562592150368757, 0.2884941143057383, 0.265523668659888, 0.24826021576786128, 0.23768874079821617, 0.2339036071641413, 0.2361661228003055, 0.24333930673918872, 0.2543539736049588, 0.2684153720525513, 0.2849469200712657, 0.3034338334722447, 0.32331206936998286, 0.34395388796098286, 0.3647231972862789, 0.3850481621457179, 0.4044738527582008, 0.42268376996087553, 0.439495932075312, 0.45484399344826754, 0.46875201634249025, 0.4813081955458608, 0.4926403256952022, 0.5028943895268791, 0.512216937427982, 0.5207415485461191, 0.5285794131320479, 0.535813881303534, 0.5424986626382795, 0.5486592253979652, 0.5542968310999832, 0.5593945540416201, 0.5639245861806211, 0.5678561246374589, 0.5711631834353923, 0.5738317535018436, 0.5758658375364097, 0.5772919893102045, 0.5781620761364616, 0.5785540557186486, 0.5785706245120457, 0.5783356748892097, 0.5779886173611865, 0.5776767999713135, 0.5775464893923958, 0.5777331386391106, 0.5783518960212333, 0.5794894319311036, 0.5811981046372888, 0.5834932235729482 ], [ 0.3209245483559023, 0.29413220267724716, 0.27115195721044866, 0.2533790710340962, 0.24173166851517416, 0.23639008259793567, 0.23684087348985758, 0.24221748105571772, 0.25167214641312524, 0.2645395654838847, 0.2802798084912815, 0.29834200928488197, 0.3180830844298681, 0.3387843072992523, 0.3597299190982974, 0.3802906158230382, 0.39997647386376856, 0.418453199825835, 0.43553182636277876, 0.4511446067703133, 0.46531626497380063, 0.47813562316429004, 0.48972996302548333, 0.5002431659188452, 0.5098180931276223, 0.5185833575541287, 0.5266444116633208, 0.5340786876346687, 0.5409343737532775, 0.5472322961042277, 0.5529702924384817, 0.5581294133786504, 0.5626812672609635, 0.5665958423993162, 0.5698491934741547, 0.5724304584316746, 0.5743477637190143, 0.5756326627618051, 0.5763428246288654, 0.5765627467438905, 0.5764023197713738, 0.5759931472839687, 0.5754826441592276, 0.5750261256214587, 0.5747773533130867, 0.5748782945239767, 0.5754491106238908, 0.5765795341613734, 0.5783227417006951, 0.5806925462804479 ], [ 0.3268089923059833, 0.3004057162126623, 0.2774653251091179, 0.2592372096392958, 0.24657054637141282, 0.23971784306910496, 0.23837409902071324, 0.24193780864864908, 0.2497910631069624, 0.26141076424752047, 0.2763019102085276, 0.29387945284338324, 0.3134199510555372, 0.33411294375071326, 0.3551644805109753, 0.3758909661238136, 0.39577100828323863, 0.41445532287664977, 0.43174961082320124, 0.4475852898590335, 0.46198749827078184, 0.4750449208743887, 0.486883276500354, 0.49764316990715096, 0.5074625788373965, 0.5164640092691197, 0.5247461413040415, 0.5323795972391951, 0.539406316255262, 0.5458419252110405, 0.5516804449348708, 0.5569006556274633, 0.5614734573791456, 0.5653696000348534, 0.5685672175866828, 0.5710586783550629, 0.572856341566009, 0.5739968812547417, 0.5745438925611119, 0.5745885361700711, 0.5742480186452587, 0.573661774695682, 0.5729853408451236, 0.5723821101941643, 0.5720134352984888, 0.5720278668188091, 0.5725506076543697, 0.5736744287825281, 0.5754532441348545, 0.5778992368935063 ], [ 0.3331335784729023, 0.3071440046278761, 0.284272997076659, 0.2656340355168744, 0.2520106341390233, 0.24371617222366082, 0.24063364529740341, 0.24241214511065892, 0.2486626021516299, 0.25901126299791455, 0.2730149401230376, 0.29005764965872033, 0.30933688166495343, 0.32995252241366846, 0.3510362776749155, 0.3718550323491469, 0.39186027527398826, 0.4106907951037599, 0.4281485539129101, 0.4441645089022529, 0.4587637611868126, 0.4720339285754968, 0.4840980057977073, 0.4950920829457202, 0.5051480339022529, 0.5143811162160176, 0.5228822172986494, 0.5307142792250721, 0.5379122874810407, 0.544486133440258, 0.5504256436589903, 0.5557070907599814, 0.560300545190209, 0.5641774861264279, 0.5673181581902231, 0.5697182322610356, 0.5713943950700714, 0.5723885450803378, 0.5727703077700281, 0.5726376073501717, 0.5721150611511364, 0.5713500245419038, 0.5705062394510647, 0.569755252094384, 0.5692660663868773, 0.5691938524037317, 0.5696688552445381, 0.5707868407988463, 0.5726023699420624, 0.5751258647461993 ], [ 0.33976176805949027, 0.3141896572893749, 0.2914007825091895, 0.2723861332056353, 0.25787058159863574, 0.24821997454290073, 0.2434840834664932, 0.24354220841492535, 0.248224856205272, 0.25730843328783204, 0.2704059061147558, 0.2868742302693409, 0.3058354723441937, 0.3263047017201704, 0.34734540170964007, 0.36818115297550025, 0.38824134975571284, 0.4071560682178505, 0.4247250082177167, 0.4408788403220454, 0.45564199101730873, 0.469099949800099, 0.4813717528234431, 0.49258771174150484, 0.5028723835114932, 0.5123326629291222, 0.5210506614229146, 0.529080810091888, 0.5364504731745643, 0.5431633014357196, 0.5492045731536058, 0.5545478311358641, 0.5591622016458937, 0.5630198608061097, 0.5661031892409303, 0.5684112220691983, 0.5699650540351936, 0.5708118942838944, 0.5710274819045535, 0.5707165800960934, 0.5700112828058194, 0.5690669222394907, 0.5680554922968395, 0.5671567278161749, 0.5665473044438522, 0.5663890102539121, 0.5668171017594054, 0.5679302741172408, 0.569783634631511, 0.5723857165127315 ], [ 0.34656941985738854, 0.32140204834308767, 0.2986949051907604, 0.27933169460618607, 0.26398788005248786, 0.2530760922510633, 0.2467927858076259, 0.24522408945022794, 0.24840449226859565, 0.2562552205228555, 0.26844644328033973, 0.2843118303176535, 0.30290357217874525, 0.323159202328671, 0.3440820972734241, 0.3648599399759861, 0.38490553811998846, 0.40384351071850894, 0.421472615053563, 0.43772321505770484, 0.45261827300636964, 0.4662400018196972, 0.4787022173268562, 0.49012820534139995, 0.5006340361229231, 0.5103171841138472, 0.519250061950877, 0.5274778167236307, 0.5350195746059602, 0.5418722818745503, 0.5480163451539625, 0.553422375234923, 0.5580584499943423, 0.5618974121899888, 0.5649237992370402, 0.5671400623446974, 0.5685717706862181, 0.5692715124160866, 0.5693212016523901, 0.5688324898198646, 0.5679449822428028, 0.5668220079910796, 0.5656438187691607, 0.5645983296581916, 0.5638698638611778, 0.5636267842611967, 0.5640092929740421, 0.5651189244189283, 0.5670112212489601, 0.5696927049830751 ], [ 0.3534467285782035, 0.3286591014178939, 0.30602360448380245, 0.28633235223936715, 0.27022159626101994, 0.25814728267160625, 0.2504345974335579, 0.24735245753719176, 0.2491196026731687, 0.25579150153219576, 0.2670930925746356, 0.282337847755427, 0.3005149497408022, 0.3204936096442393, 0.34122676359296844, 0.36187445059392964, 0.38183866260877425, 0.4007417491383804, 0.4183826611183891, 0.43469126434595035, 0.4496881609959242, 0.4634511051276868, 0.47608745422926724, 0.48771228206838335, 0.4984320829970635, 0.5083339400628339, 0.5174797280016883, 0.5259046122217729, 0.5336189278670291, 0.5406125036407896, 0.5468605885716415, 0.5523306840015972, 0.5569897287583403, 0.560811206079527, 0.5637818276252446, 0.565907503343539, 0.5672183292857363, 0.5677723226926782, 0.567657611490673, 0.566992757039643, 0.5659248777937282, 0.5646252809535641, 0.5632824378067908, 0.5620923874871832, 0.5612470277939885, 0.5609212073668992, 0.5612599697389504, 0.5623675721935192, 0.5642998707866312, 0.5670612589738429 ], [ 0.3602990879243761, 0.3358577117675991, 0.31327714972796145, 0.2932731913963841, 0.2764531022703012, 0.2633142671106618, 0.2542951230415865, 0.2498242660126135, 0.25028289152604194, 0.2558463008564446, 0.2662886455225592, 0.2809052650786368, 0.2986299108542182, 0.3182739634995306, 0.33875056882754795, 0.35920081413800353, 0.37902166985914676, 0.39783623218732, 0.41544458311890126, 0.4317757597708495, 0.44684705479533265, 0.4607306039833253, 0.47352614490413825, 0.4853394593323753, 0.4962664937116689, 0.5063830840065074, 0.5157398336790696, 0.5243613206340236, 0.5322486119545414, 0.5393840651527663, 0.545737529251358, 0.5512732476766797, 0.5559569458932984, 0.5597627274241056, 0.5626794933692321, 0.564716646386496, 0.5659088479709589, 0.5663195759637633, 0.566043187522765, 0.5652051469436247, 0.563960052826735, 0.5624871306500372, 0.560982985994487, 0.5596516744745991, 0.5586925428755868, 0.5582867869647331, 0.5585841461310644, 0.5596914559977781, 0.5616647531288028, 0.564506194644575 ], [ 0.3670471396671514, 0.34291323524171147, 0.3203668284642822, 0.3000616137434608, 0.28258548103424147, 0.2684763611441848, 0.2582728241311625, 0.25254188105331943, 0.2518050359602293, 0.2563407704164967, 0.2659645533341428, 0.27995458623388864, 0.29719692208726745, 0.31645617078921645, 0.33661669169571373, 0.3568093118255349, 0.3764315528783363, 0.3951100034788216, 0.41264660545113285, 0.42896913352021115, 0.44409062167565333, 0.45807650706433467, 0.4710178730617591, 0.48301027843393124, 0.4941383010556327, 0.5044658158851107, 0.5140315473968609, 0.5228489867196766, 0.5309095423973549, 0.5381878141095126, 0.5446480571930947, 0.5502511411735528, 0.5549615225006258, 0.5587539122042646, 0.5616194145976217, 0.5635709507159348, 0.5646477721842473, 0.5649188300685944, 0.5644847021616917, 0.5634777189369061, 0.5620598899092027, 0.5604182558118885, 0.5587574215494263, 0.5572892971689231, 0.5562204968407917, 0.5557383720718752, 0.5559971686627427, 0.5571061265980339, 0.5591213192897996, 0.5620425690772671 ], [ 0.3736262455911065, 0.3497583806869605, 0.3272233400573969, 0.30662556185392165, 0.28854215156931007, 0.2735511585306617, 0.2622801874543353, 0.25541563460452543, 0.2535980608859246, 0.2571917472272591, 0.2660442614891323, 0.2794167961794728, 0.2961551727767405, 0.31498818363799214, 0.33478213844171895, 0.3546658638690329, 0.3740425477087276, 0.39254465106669384, 0.40997648527538394, 0.426264058230306, 0.4414152454336061, 0.4554878349357328, 0.46856339456813867, 0.4807265157942409, 0.4920497684154918, 0.5025845169880352, 0.5123571418883549, 0.5213696670782428, 0.5296035474097884, 0.5370254111624864, 0.5435937791715083, 0.5492660662851182, 0.5540054246863838, 0.5577871685945145, 0.5606046184361994, 0.5624742311716866, 0.563439859255057, 0.5635759203483488, 0.562989179640482, 0.5618187663513283, 0.5602339941638984, 0.5584295711954788, 0.5566179149044923, 0.5550185707526543, 0.5538451800380911, 0.553291003370158, 0.5535145577660312, 0.55462728332267, 0.5566851363697018, 0.5596855176247388 ], [ 0.379985577854035, 0.3563417592762845, 0.3337948976564527, 0.31291145249564434, 0.29426509790747896, 0.27847363807732023, 0.26624421040423846, 0.25836583370106064, 0.2555785637042965, 0.25831562908170885, 0.2664472031956642, 0.2792171106605118, 0.2954378849984948, 0.3138127915792724, 0.33320001807581073, 0.3527338357845484, 0.37182753979387473, 0.39012138606280583, 0.40742232973513964, 0.4236540600939608, 0.43881848313983995, 0.45296495917714696, 0.4661648895682823, 0.4784913716420067, 0.4900045327001604, 0.5007428600339892, 0.5107200806320613, 0.5199264992553889, 0.5283334238596141, 0.5358993753230412, 0.5425770549750963, 0.5483203792784722, 0.5530911824043298, 0.5568653864936028, 0.5596385403422556, 0.561430646225561, 0.5622901538939659, 0.5622969213023897, 0.5615638425654689, 0.5602367467698083, 0.5584921065076752, 0.5565321032980901, 0.5545767270416393, 0.5528528808539217, 0.551580932401669, 0.5509597478705174, 0.5511518334646501, 0.5522705946684507, 0.5543717073674396, 0.5574500772193876 ], [ 0.3860869788221434, 0.3626262690900851, 0.3400452349966532, 0.31888203473030996, 0.2997129450926788, 0.2831949456795865, 0.2701063908423025, 0.26132425334488635, 0.2576706206133302, 0.2596322577115126, 0.2670930884281859, 0.2792791697623447, 0.2949760776766926, 0.3128707971991571, 0.33182210472649776, 0.35097604143616146, 0.36975959398377045, 0.3878221899791383, 0.4049734425942329, 0.42113413456550997, 0.4362995072686327, 0.4505099167812298, 0.4638261847818949, 0.47630962711974884, 0.488007716029439, 0.4989458895767345, 0.5091250767978255, 0.5185237458293886, 0.5271029707218384, 0.5348131092791385, 0.5416010158241716, 0.5474171027419644, 0.5522218944016956, 0.5559919347639282, 0.5587250124924756, 0.5604446761348572, 0.5612039545766802, 0.5610880995984958, 0.5602160499741147, 0.5587402036967476, 0.556844007790616, 0.5547368762880542, 0.5526460771899154, 0.5508055338198449, 0.54944197806495, 0.5487595206274944, 0.5489243278646343, 0.5500515059430955, 0.552196278721671, 0.5553509985289207 ], [ 0.39190370124480134, 0.368587433233852, 0.34595163583926547, 0.3245142936512157, 0.30485901848492775, 0.2876810015306526, 0.27382233953357205, 0.26423511656346454, 0.25980820386567355, 0.2610684797180046, 0.26790607519840975, 0.2795292616362777, 0.29470242677250563, 0.3121042947453586, 0.33060148188135857, 0.349356798823373, 0.36781350903138854, 0.38563096260367785, 0.4026211529694684, 0.4187013314292374, 0.43385950963131664, 0.4481266829750674, 0.46155293387205215, 0.4741877610834247, 0.4860659998629135, 0.49720006812678824, 0.5075781213282884, 0.5171668109713445, 0.5259169981457076, 0.5337709032120506, 0.5406695639040552, 0.5465599208883374, 0.5514012186900306, 0.5551706457955109, 0.5578682410254104, 0.5595210912084567, 0.5601867710222594, 0.5599558588782818, 0.5589532276069991, 0.5573376805856611, 0.5552994151790782, 0.5530547898490146, 0.550838001957744, 0.5488895978889514, 0.5474422504005082, 0.5467048965959054, 0.5468469878024677, 0.5479850374506763, 0.5501736391606094, 0.5534025505143793 ], [ 0.39741910681087744, 0.3742117657368936, 0.3515030505205945, 0.32979745835486146, 0.30968945100971, 0.29191100792984476, 0.27736107520304687, 0.2670555429235541, 0.26193694929194444, 0.26256107319001376, 0.26881841525876216, 0.2799001548441961, 0.29455485032793927, 0.3114597594950255, 0.32949505508185006, 0.34784388932162214, 0.36596729402410966, 0.38353460004310513, 0.400359577575163, 0.4163552754670935, 0.43150204356129834, 0.4458213860216833, 0.4593527444131147, 0.4721340185924823, 0.48418765598472197, 0.4955132840861868, 0.5060864774222077, 0.5158622275608278, 0.5247813107876835, 0.5327779161700705, 0.5397873523625516, 0.5457531578826266, 0.5506333482869413, 0.5544057872983726, 0.5570727722000732, 0.5586649104197037, 0.5592442731998452, 0.5589066770292881, 0.557782791346417, 0.5560376285041518, 0.5538678724353928, 0.5514964910012254, 0.5491642083962086, 0.5471177381966865, 0.5455952108354427, 0.5448099163426396, 0.5449341716472189, 0.5460855773944004, 0.5483179140908541, 0.5516183215478873 ], [ 0.40262537613735194, 0.3794952093561051, 0.3566983309511164, 0.33473113653790043, 0.3142013617786537, 0.29587588882279947, 0.28070402759263463, 0.2697554413394083, 0.2640151458505742, 0.26405878621258966, 0.2697732297077824, 0.2803341721375014, 0.2944794884898373, 0.3108906848039499, 0.32846573872849083, 0.3464102826526434, 0.36420347072906956, 0.3815239361817822, 0.39818627007823226, 0.41409859056158954, 0.42923328220297696, 0.4436024488862462, 0.4572352412380734, 0.47015842424147863, 0.482382529793414, 0.4938948185016548, 0.504658639474919, 0.5146176136201357, 0.5237026646517593, 0.5318401345655045, 0.5389597455627665, 0.5450017391486399, 0.5499229723118957, 0.5537020215249829, 0.5563434477983595, 0.557881350842892, 0.5583822325260536, 0.5579470368182216, 0.556712065003292, 0.5548483089641385, 0.5525586360261359, 0.5500722422855553, 0.5476359238662267, 0.5455020489826106, 0.5439136652823213, 0.5430878898635235, 0.5431994448174007, 0.5443666742379561, 0.5466423602972772, 0.5500110217404517 ], [ 0.4075222652085612, 0.3844416701478165, 0.36154459698181507, 0.33932358070086466, 0.31840111171984625, 0.2995766749997414, 0.28384376644175296, 0.2723168428166601, 0.2660138799056009, 0.2655233318179216, 0.2707261855260582, 0.28078524849787917, 0.2944328385826262, 0.3103595691123753, 0.3274841657715614, 0.3450355161916089, 0.36251012112099423, 0.37959448963638037, 0.39610271655708285, 0.41193719873871065, 0.42706217353987874, 0.4414806449141083, 0.45521205783591434, 0.46827273506982964, 0.4806619726707425, 0.49235526874423163, 0.5033042554491729, 0.5134415975971384, 0.5226886973226345, 0.5309643079062256, 0.5381927598468802, 0.5443111360068048, 0.5492752228645728, 0.5530643524258925, 0.5556853503652136, 0.5571757686291574, 0.5576064561348936, 0.5570833509887188, 0.5557481938414531, 0.553777693661168, 0.5513805592259857, 0.548791788960287, 0.5462637458843694, 0.5440538867112372, 0.5424095824086391, 0.5415512031682499, 0.5416553790002473, 0.5428408336863444, 0.5451591661163565, 0.5485922914720258 ], [ 0.41211593082078485, 0.38906166221476257, 0.36605573850718626, 0.34359008593876283, 0.32230264023212263, 0.30302285230513487, 0.28678249057148614, 0.27473271308053454, 0.26791635394977364, 0.2669293137649543, 0.27164599743820134, 0.281219865415298, 0.2943829290585232, 0.30983914555864117, 0.3265298287437056, 0.3437066538598397, 0.360881621016972, 0.37774697117944256, 0.39411464417038594, 0.40988047120099563, 0.4250004768873157, 0.4394690578336831, 0.4532967499751293, 0.46649032978407023, 0.47903872180022433, 0.4909064285041373, 0.5020340126824662, 0.5123437128663983, 0.5217478321666127, 0.5301578624448711, 0.5374929855457624, 0.5436872944019031, 0.5486956084609677, 0.5524980615407692, 0.5551037391409434, 0.5565535924670479, 0.5569227153074119, 0.5563218831148491, 0.554898055405531, 0.55283336304045, 0.5503419765620615, 0.5476642280498326, 0.5450574953277973, 0.5427837080433885, 0.5410939182098236, 0.5402111325481503, 0.5403133603101871, 0.5415193256782141, 0.5438792624434401, 0.5473725212698011 ], [ 0.41641783923196285, 0.39337106973591, 0.3702510550775914, 0.34755152138821993, 0.3259258945403843, 0.3062307060591565, 0.2895303424553946, 0.27700534449573727, 0.26971650019413057, 0.2682632004582704, 0.27251384676501045, 0.2816169165539661, 0.2943095520588982, 0.3093128463237857, 0.32559162656174995, 0.34241879088054616, 0.3593190256779175, 0.3759875220960609, 0.3922321203224811, 0.407941215539989, 0.42306267083749816, 0.43758294038774304, 0.45150462879370673, 0.46482603339264716, 0.47752672764060394, 0.48956112492068166, 0.5008594882630882, 0.5113342627139632, 0.5208891577961082, 0.5294287940163743, 0.5368674914540634, 0.5431365488837417, 0.5481899351435793, 0.5520086337171961, 0.5546039777886185, 0.5560202506870079, 0.5563366693331148, 0.5556686656617963, 0.5541681693582682, 0.552022405729837, 0.5494505910528464, 0.5466978821835105, 0.5440260764698743, 0.5417009166785316, 0.5399764514247932, 0.5390776715010325, 0.5391834116611187, 0.5404120067903977, 0.5428121499082689, 0.5463606881178742 ], [ 0.4204437666611113, 0.3973900301160231, 0.37415403509650963, 0.35123300228882887, 0.32929537421093336, 0.3092217144058169, 0.29210364802405525, 0.27914448596646296, 0.2714171036619674, 0.26952159420928495, 0.27332195973373963, 0.2819667072748412, 0.29420369761347026, 0.3087745847699168, 0.324667852743118, 0.34117510990243743, 0.35783009830316864, 0.3743276705361287, 0.390469431172943, 0.40613549171246627, 0.4212657288873905, 0.4358394705826666, 0.44985251412374133, 0.46329587901496355, 0.4761409312766555, 0.48833301520779754, 0.49979296629628883, 0.5104241580003163, 0.5201222848290109, 0.5287855419243452, 0.5363237134696786, 0.5426655233979902, 0.5477642167095844, 0.55160167402386, 0.554191455249696, 0.5555810933613722, 0.555853786233583, 0.5551294168315888, 0.5535646081282799, 0.5513513209438177, 0.5487133667274231, 0.5459001811606621, 0.5431773472810353, 0.5408137230145498, 0.5390656342199622, 0.538159375133295, 0.5382740344315802, 0.539527163220078, 0.5419657472832546, 0.5455642129859827 ], [ 0.42421289646102334, 0.40114194024571453, 0.3777912776221903, 0.35466271400869986, 0.33243882207446046, 0.31202105846449596, 0.29452320696130385, 0.2811654117289014, 0.27302771481179383, 0.2707091324449487, 0.27407169203313303, 0.282269393766717, 0.2940664206233488, 0.3082280052230008, 0.3237657076412441, 0.3399865262526594, 0.3564289949626547, 0.3727840093842775, 0.38884474064323393, 0.4044822586432522, 0.4196287659488667, 0.4342574097401836, 0.4483584126703892, 0.46191681148040115, 0.47489699599463964, 0.4872363467320027, 0.4988472255950334, 0.5096247306297876, 0.5194571827026773, 0.5282368463127033, 0.5358693295575925, 0.5422810208179742, 0.5474245758063802, 0.5512828174756603, 0.5538715012662616, 0.555241310916209, 0.5554792619050064, 0.5547094578591123, 0.553092910215075, 0.5508259259624809, 0.5481364288592702, 0.5452775540695862, 0.5425180032577178, 0.5401290203323212, 0.5383684622593307, 0.5374632264839657, 0.537592074065661, 0.538871379025045, 0.5413462656720913, 0.5449888438362395 ], [ 0.4277470149051691, 0.4046525863254183, 0.3811915598516987, 0.3578709010214619, 0.3353860959445286, 0.3146563219561145, 0.29681276602245427, 0.2830871417033133, 0.27456265085953463, 0.27183638597956394, 0.2747715030248653, 0.2825332075980434, 0.29390740973904894, 0.3076853827923525, 0.32290044409290275, 0.33887098227579865, 0.3551356381315645, 0.3713776146487853, 0.387379543575849, 0.4030028630680422, 0.41817256631302335, 0.43285667198974415, 0.44704112965293225, 0.46070634024382945, 0.4738109995657683, 0.48628568608312306, 0.4980353025185485, 0.5089475268588232, 0.518903999998726, 0.5277915920020787, 0.535512123626644, 0.5419899034898142, 0.547177137917986, 0.5510576334081095, 0.5536492982819322, 0.5550058509026816, 0.555217939325551, 0.5544136324675984, 0.552757997990947, 0.5504512707227172, 0.5477249742127706, 0.5448353345717535, 0.5420534777367386, 0.5396522808111315, 0.5378903677796977, 0.5369945286252704, 0.5371426135851779, 0.5384494335800251, 0.5409581122768391, 0.5446385676210175 ], [ 0.4310698050533563, 0.4079493958076519, 0.38438505170094506, 0.360889031530692, 0.3381682511511885, 0.3171564443863094, 0.2989977924163043, 0.28493100142637606, 0.276039351200263, 0.27291808052818883, 0.27543516608445706, 0.28277278343183365, 0.2937435114043216, 0.3071663517018783, 0.3220942614423965, 0.3378524623835155, 0.3539748252558927, 0.37013323743487875, 0.3860979389087272, 0.40172039197525544, 0.41691901100895223, 0.4316578202335919, 0.44591982640610933, 0.4596821519451451, 0.47289909575224437, 0.48549562416869113, 0.49737023479012576, 0.5084040853100406, 0.5184728723705424, 0.5274586422598171, 0.5352598412878766, 0.5417989673606853, 0.5470279204989199, 0.5509315265193161, 0.5535297915690874, 0.5548793346682553, 0.555074229521377, 0.5542462301904145, 0.5525641017777038, 0.5502315614261298, 0.5474831933826889, 0.5445776816453636, 0.5417878612228921, 0.5393874741310153, 0.5376351386193539, 0.5367568256127834, 0.5369288981174506, 0.5382642312778149, 0.540803826592455, 0.544515553855612 ], [ 0.43420623579709955, 0.41106080747337237, 0.3874026753024826, 0.3637491421176129, 0.34081685208274193, 0.3195509702868969, 0.30110462732473964, 0.2867196517600849, 0.27747727196126915, 0.2739718708457894, 0.27608046236444567, 0.28300782215536263, 0.29359740128500683, 0.306696606385495, 0.32137505115633247, 0.3369598035708893, 0.35297512929736136, 0.36907831502980837, 0.38502576011541345, 0.40065891916990837, 0.4158904293640058, 0.4306815085696038, 0.44501353995847465, 0.45886169544178684, 0.4721771553469619, 0.484880465671265, 0.4968647930918617, 0.5080057052808162, 0.5181737227095032, 0.527246666385484, 0.5351200407782761, 0.5417148125006925, 0.5469827196946062, 0.5509096367322995, 0.5535175995217182, 0.5548659757174533, 0.5550520359886107, 0.5542109152157956, 0.5525146918608302, 0.5501700948727264, 0.5474142070144516, 0.5445075176755024, 0.5417238417214448, 0.5393370107438309, 0.5376048653370437, 0.5367518544230501, 0.5369522925117053, 0.5383167654155521, 0.5408840507781342, 0.5446201312843717 ], [ 0.4371820408423152, 0.41401575253008976, 0.39027560205723466, 0.3664833572823561, 0.34336351340741816, 0.32186960590331287, 0.30316004766399685, 0.28847663881885677, 0.2788973950999092, 0.27501776507459735, 0.2767284690474897, 0.2832622021337202, 0.2934965076300934, 0.3063066678957302, 0.32077507570244634, 0.33622537428629623, 0.35216765602298, 0.3682418572745148, 0.3841896100672238, 0.3998426843649214, 0.4151089053604144, 0.4299478952429746, 0.44434068345479827, 0.4582617541434465, 0.47166039848344626, 0.4844539122417193, 0.4965312079942775, 0.5077632114994778, 0.5180160586067711, 0.5271639653077993, 0.5350999425672205, 0.541743713000556, 0.5470469972099614, 0.5509967401114271, 0.5536169260956654, 0.5549695015544837, 0.5551546842258074, 0.5543106623134444, 0.5526124199375112, 0.5502692049780482, 0.5475200173374577, 0.5446264852993823, 0.5418626674494346, 0.539501711129454, 0.5377999176475722, 0.5369795289781989, 0.5372122729827135, 0.5386061170201099, 0.5411975347668355, 0.5449507980183935 ], [ 0.4400232801259328, 0.4168432361938146, 0.3930348738297851, 0.36912356758741716, 0.3458396514026648, 0.3241420595943363, 0.3051912069683629, 0.29022642877646027, 0.28032231179295636, 0.2760781595009569, 0.2774034118625427, 0.283563527402761, 0.2934722003876655, 0.30603075479743336, 0.3203296397495792, 0.3356836913179542, 0.3515847286787322, 0.367653272718148, 0.3836158550354295, 0.39929524900479474, 0.4145955734752111, 0.42947605298311814, 0.4439185481787862, 0.4578980217825315, 0.47136303087725595, 0.484228749472331, 0.4963809002723709, 0.5076867218465935, 0.5180087724349698, 0.5272182995824725, 0.5352062812994677, 0.5418914893189093, 0.547225769942496, 0.5511971530886564, 0.5538314773674933, 0.5551930807537232, 0.5553848579421392, 0.5545477012586794, 0.5528590712831324, 0.5505302226332977, 0.5478014760397075, 0.5449349238862817, 0.542204132630591, 0.539880801536793, 0.5382189504408426, 0.5374379562740724, 0.5377064525483585, 0.5391294881516984, 0.5417411754675809, 0.5455042643727204 ], [ 0.44275597414585743, 0.4195720059334894, 0.3957111289185208, 0.3717012391607677, 0.348276406334173, 0.3263981092873227, 0.30722587424397824, 0.2919948166233705, 0.28177674081303994, 0.2771783289352736, 0.27813293539503026, 0.28394300130693945, 0.2935591879565247, 0.30590575662736785, 0.32007579599972596, 0.3353700420519483, 0.3512585745115529, 0.3673412040956688, 0.38332963674244813, 0.3990386759192282, 0.4143699405048052, 0.42928340467934945, 0.4437628286084126, 0.4577846981974774, 0.47129789697338964, 0.48421654792626306, 0.49642422283423054, 0.5077854246864705, 0.5181599494620576, 0.527416724234986, 0.5354451637549473, 0.5421633861553489, 0.5475235049767353, 0.5515146422138468, 0.5541643841173245, 0.5555392569081463, 0.5557445433720671, 0.5549234709848876, 0.5532555286705397, 0.5509534497347589, 0.5482582690771353, 0.5454318659775845, 0.5427465863918056, 0.5404719358846669, 0.5388589386955036, 0.5381234835628377, 0.5384306388868688, 0.5398822680529068, 0.5425100882604095, 0.5462755265379059 ], [ 0.4454058001159517, 0.4222302898966059, 0.3983344085375669, 0.3742473184051125, 0.35070468135709737, 0.3286678151107364, 0.3092928514961259, 0.29380954517899016, 0.28328827677553137, 0.27834714497134827, 0.2789485741061081, 0.2844354559103541, 0.2937950239937041, 0.30597028694036976, 0.32005111992467605, 0.33531917802628625, 0.35122008821371037, 0.3673324431451112, 0.3833539611668234, 0.3990927791887607, 0.41444926896672796, 0.4293852114832264, 0.4438871912275995, 0.45793412117790894, 0.4714761626019181, 0.4844273882423915, 0.4966702223064552, 0.5080673723178708, 0.5184766892991343, 0.5277654347945222, 0.5358219364127594, 0.5425639588323191, 0.5479440224392358, 0.5519523415367596, 0.5546181322193603, 0.5560098909616151, 0.5562349829507095, 0.5554385844739672, 0.5538017487962549, 0.5515381478535344, 0.5488889185639708, 0.5461150534586019, 0.5434869641085617, 0.541271242708134, 0.539715239698855, 0.5390307745525912, 0.5393789221944897, 0.5408581294487329, 0.5434977079470015, 0.5472579682460151 ], [ 0.4479978379360737, 0.42484558742779144, 0.40093401654082816, 0.37679219035217937, 0.3531552343941708, 0.3309817815695007, 0.3114224316781428, 0.2957009474030805, 0.28488813805789953, 0.27961777097221047, 0.279886188634997, 0.2850793561847528, 0.2942196217280774, 0.30626379142852633, 0.3202925863931797, 0.33556414289772346, 0.35149774289941643, 0.3676509894289756, 0.3837089174630307, 0.39947448588478496, 0.4148480538423473, 0.42979413749975953, 0.4443029056727861, 0.45835644888751464, 0.4719070386602283, 0.4848696195655348, 0.4971264277654902, 0.5085392966401309, 0.5189649456649956, 0.5282696286082601, 0.5363410659903516, 0.5430969709781888, 0.5484904085371786, 0.5525126795570029, 0.5551945024482728, 0.5566061132416328, 0.5568566393903821, 0.556092805144268, 0.5544967516680096, 0.5522825416532464, 0.5496908014501722, 0.5469809727057593, 0.544420839924702, 0.5422733953212076, 0.5407816801878587, 0.540152911727603, 0.5405437897314402, 0.542049151408546, 0.5446959154558827, 0.5484434867851916 ], [ 0.45055635383597004, 0.4274444933392365, 0.4035384045415568, 0.37936564807246964, 0.3556587581382346, 0.3333713728661106, 0.31364676038852035, 0.2977024315988424, 0.2866116981105363, 0.2810281044113943, 0.28098615905694363, 0.28591662506442156, 0.2948746941176952, 0.3068256972008535, 0.3208355812875288, 0.33613529044913426, 0.35211670797108835, 0.3683173059494284, 0.3844110697248231, 0.40019734270498697, 0.4155776178193593, 0.4305199103742648, 0.4450185533048368, 0.4590594049013159, 0.472597555578598, 0.4855496592892523, 0.4977986731836512, 0.5092064524449302, 0.5196293889251027, 0.5289333851107932, 0.537006035990673, 0.5437653060176592, 0.5491649408512992, 0.5531973174455925, 0.5558945210844275, 0.5573282862799017, 0.5576091709543078, 0.5568850352245613, 0.5553386230991316, 0.55318383680579, 0.5506601842763915, 0.5480249074728284, 0.54554249862618, 0.5434717027599619, 0.5420506653695211, 0.5414815212043541, 0.5419162630454567, 0.5434459644953458, 0.5460951859495071, 0.549822639115856 ], [ 0.45310461027307486, 0.4300525388177425, 0.40617505662059067, 0.3819968340943746, 0.35824588973508076, 0.33586879655160307, 0.3159999845982672, 0.29985066063030047, 0.28849862825740646, 0.2826207916648443, 0.28229318383099294, 0.2869921847774326, 0.2958030708364914, 0.30769460194515746, 0.32171307686853284, 0.3370595335292458, 0.3530982146254493, 0.369347806335922, 0.3854730490876442, 0.40127118862811517, 0.4166458413379964, 0.4315690906693503, 0.44603982371287626, 0.4600480946249405, 0.47355239598211213, 0.48647184039970404, 0.49869095890880966, 0.5100724928075524, 0.5204732951461732, 0.5297595681622148, 0.5378192618386421, 0.5445708946012413, 0.5499690276322632, 0.5540070999542945, 0.5567184224324213, 0.5581759792457964, 0.5584914184561613, 0.5578133163199189, 0.5563245301483314, 0.5542382518165991, 0.5517922729217819, 0.5492410078668436, 0.5468450246004811, 0.5448582185948605, 0.543513306288308, 0.5430069160467779, 0.5434860533839481, 0.5450379134754204, 0.5476847535633314, 0.5513848034646507 ], [ 0.4556646922034995, 0.43269403449137184, 0.4088703522985515, 0.38471412244614905, 0.3609471047338342, 0.33850699225795866, 0.31851810547395376, 0.30218532501753365, 0.29059254326232775, 0.2844427122084581, 0.2838556028866675, 0.28835316486641144, 0.29704787452288745, 0.3089075084169587, 0.32295498751560753, 0.3383598426013237, 0.3544591850881136, 0.37075458596366884, 0.3869033554115311, 0.4027020007904532, 0.4180570335166015, 0.43294495554732093, 0.4473694043597007, 0.46132489804789406, 0.4747737901895695, 0.48763831067159336, 0.4998053559797259, 0.5111393799056295, 0.521498464528135, 0.5307497528807869, 0.5387820266388031, 0.54551465965501, 0.5509031624688586, 0.5549420200957034, 0.5576656240644458, 0.5591479545312867, 0.5595014042328538, 0.5588748420906698, 0.5574507490488909, 0.5554410628628149, 0.5530812759379918, 0.5506223734318152, 0.5483204052773494, 0.5464238643715266, 0.545159561696297, 0.54471825367997, 0.5452417305561688, 0.5468132326484878, 0.5494527878280272, 0.5531183516216367 ], [ 0.4582573420742236, 0.4353919049839258, 0.41164939288173474, 0.38754492073219204, 0.36379246766618356, 0.3413192904163357, 0.32123849431572465, 0.3047484672224991, 0.2929401115257849, 0.286543905025774, 0.28572423212644055, 0.29004777674481713, 0.2986515618469469, 0.3104991078863413, 0.3245877033943517, 0.3400549856211277, 0.3562121141936572, 0.37254538545523763, 0.38870635879592463, 0.4044919064801449, 0.41981193954650964, 0.43464749466246466, 0.44900696304476867, 0.46288943972733687, 0.4762614761869949, 0.48904898572010125, 0.501141955380415, 0.5124073332961212, 0.5227051710728886, 0.5319041786108808, 0.5398944389601256, 0.5465964802220487, 0.5519668952701642, 0.5560011983097629, 0.5587347152729247, 0.5602421667247846, 0.5606363430523871, 0.5600659826884034, 0.5587127048987083, 0.5567866604797803, 0.5545204798030452, 0.5521611481144425, 0.5499596462285508, 0.5481585642586063, 0.5469783904483416, 0.5466037029607871, 0.5471709004777002, 0.54875922887335, 0.5513865768721402, 0.5550108272285742 ], [ 0.460901798595237, 0.4381675088745798, 0.4145357839604121, 0.3905153842751013, 0.3668112318224049, 0.34433883681059463, 0.3241990750544967, 0.30758337292548243, 0.29558966071608733, 0.2889759807228802, 0.28795075710500007, 0.2921238943094574, 0.3006548494172867, 0.31250110867681535, 0.3266337782475394, 0.3421594743337648, 0.3583651661648218, 0.37472375318277645, 0.3908824740313932, 0.4066393412289967, 0.4219078705857267, 0.43667350910194447, 0.45094921759897316, 0.46473863293795903, 0.4780127227018912, 0.4907015556052571, 0.5026988625584917, 0.5138748163030703, 0.5240921442741601, 0.5332217288201682, 0.5411554133782995, 0.5478151747184188, 0.5531588200485729, 0.5571828764447824, 0.559923458877605, 0.5614557739064414, 0.5618926646384875, 0.5613823203323897, 0.5601050221404604, 0.558268616710611, 0.5561023342368385, 0.5538486247333552, 0.5517528950034145, 0.5500513874437007, 0.5489579104778666, 0.5486506165689249, 0.5492603867987332, 0.5508624675814816, 0.553472712746929, 0.5570491255952041 ], [ 0.46361563728376226, 0.44104044288250105, 0.41755137490044464, 0.3936500473368564, 0.3700313010272808, 0.34759780887875286, 0.3274372185646264, 0.3107330984346893, 0.2985893705822304, 0.29179012330053195, 0.2905857833755976, 0.2946274110373081, 0.30309555440979385, 0.31494159868081806, 0.329111730248288, 0.3446836615231918, 0.36092242998156443, 0.37728935699897864, 0.39342846813755206, 0.4091393230362327, 0.42433893459862154, 0.439016798394985, 0.4531900827073731, 0.46686679137907205, 0.48002241120642725, 0.4925915424725125, 0.5044722357835534, 0.5155385597873049, 0.525656582520384, 0.5346999378524945, 0.5425626738108592, 0.5491685036622763, 0.5544765795243861, 0.5584844264877704, 0.5612288061932444, 0.5627851608994295, 0.563266047228574, 0.5628186951740161, 0.5616215846559532, 0.5598797611646997, 0.5578185455972008, 0.5556753565093848, 0.5536895707849517, 0.552090694909449, 0.5510855605881537, 0.5508457046458288, 0.5514964123524599, 0.5531089574548466, 0.5556972746210279, 0.559219670981084 ], [ 0.46641461364734427, 0.4440283338182167, 0.42071596377005505, 0.3969713883581581, 0.3734785842596305, 0.3511264756356504, 0.3309884290498541, 0.3142387468194118, 0.30198519325880513, 0.29503483294582145, 0.2936766797451267, 0.2976004687036576, 0.3060073897511324, 0.31784442936973634, 0.33203590712466646, 0.3476339237753165, 0.3638842669503027, 0.3802383868619294, 0.39633785399257543, 0.41198380688056807, 0.4270963417322593, 0.44166841655852707, 0.45572088035282887, 0.4692657989708778, 0.48228317029068546, 0.4947124047401922, 0.5064563653085814, 0.5173936212628145, 0.5273941968506739, 0.5363350236170374, 0.5441127789979147, 0.5506531913791807, 0.5559168861146213, 0.5599023735952967, 0.5626469246378019, 0.5642259738311677, 0.5647514613401287, 0.5643692603927968, 0.5632556041352947, 0.5616122643158875, 0.5596601763200353, 0.5576312732321635, 0.5557584970555051, 0.5542642874217363, 0.5533482615918757, 0.5531752059972708, 0.5538647766213395, 0.5554843299526926, 0.5580460061177042, 0.5615085877925104 ], [ 0.4693125124199445, 0.4471466259231687, 0.42404698251575845, 0.40049935579916385, 0.3771762879641247, 0.3549521723865415, 0.334884927707442, 0.3181376352700081, 0.3058186741110743, 0.29875359313766436, 0.29726537769225214, 0.3010796723955644, 0.3094187660032887, 0.3212286160227006, 0.3354163709860559, 0.35101286676628213, 0.3672476852527963, 0.38356399012628317, 0.39960132230654066, 0.41516208228808793, 0.4301687560191696, 0.44461697613306245, 0.4585305983095174, 0.4719253262839477, 0.48478555402173124, 0.49705568173131853, 0.5086437889139208, 0.5194334761647053, 0.5292992827466603, 0.5381219445112532, 0.5458011688421579, 0.5522649656634294, 0.5574755584371631, 0.5614324326167787, 0.5641732371593587, 0.565773165104839, 0.5663432227102593, 0.5660275453006024, 0.5649996952627001, 0.563457726309155, 0.5616177483741758, 0.5597057997277946, 0.5579480346445567, 0.5565595518471335, 0.5557325737176056, 0.5556250536518658, 0.5563510259657283, 0.5579740104614007, 0.5605044836681902, 0.5639018627260687 ], [ 0.4723210082570118, 0.4504083742805411, 0.4275591817438186, 0.4042508876149939, 0.38114419956579465, 0.35909827227286784, 0.33915425154024553, 0.3224615099042141, 0.31012486012032864, 0.302982658876081, 0.30138630300262315, 0.30509441905284257, 0.313351665427419, 0.3251077634389354, 0.33925877315785713, 0.35481950369058424, 0.37100668728261277, 0.38725668924040907, 0.4032071693036925, 0.4186611795376411, 0.43354266633596117, 0.44784897917981215, 0.4616061804465606, 0.47483308111303674, 0.4875182547309757, 0.4996111714780234, 0.5110254383319264, 0.5216501371198371, 0.5313648168274496, 0.5400544781911956, 0.5476222297543697, 0.553998613906212, 0.5591475720733406, 0.5630695569803165, 0.5658024723934104, 0.567421047663056, 0.5680350532000901, 0.5677865251045964, 0.5668459561873362, 0.5654072695334501, 0.5636813487642744, 0.5618879744411329, 0.5602462127761664, 0.558963603262207, 0.5582248476450681, 0.5581810320959195, 0.5589406139514186, 0.5605633784699953, 0.5630582733895713, 0.5663854955033437 ], [ 0.47544954456863286, 0.4538240567697946, 0.4312643368009589, 0.40823946013423834, 0.38539801833988363, 0.3635832383047469, 0.343817984527527, 0.3272349603467972, 0.31493047594215223, 0.3077491551510893, 0.3060646108302188, 0.3096654684910357, 0.3178206638549334, 0.3294895438359265, 0.34356421052195174, 0.3590493783846406, 0.37515255345617093, 0.39130474525493636, 0.407141687025584, 0.4224662562203636, 0.43720275312647533, 0.45134915600547654, 0.4649328332249783, 0.477975080609783, 0.4904683401751488, 0.5023671337434802, 0.5135908103164437, 0.5240342963653667, 0.5335825746768971, 0.5421253192473545, 0.5495693766780406, 0.5558480538046342, 0.5609271230016801, 0.5648079985381087, 0.5675287242391418, 0.569163357248457, 0.569820148323835, 0.5696386958958013, 0.568786052718736, 0.5674516332533003, 0.5658407352247846, 0.5641665661410195, 0.5626408560208146, 0.5614634206991771, 0.5608113670018684, 0.5608289240515868, 0.561619049714119, 0.563237914804731, 0.5656930746286564, 0.5689456364509908 ], [ 0.4787052376399974, 0.4574014174445529, 0.4351709968589789, 0.4124747010369891, 0.3899487864249556, 0.36841983208591145, 0.3488907247731044, 0.33247416531178453, 0.3202525200756874, 0.31306964490867684, 0.31131487061844093, 0.3148038730215388, 0.3228321779650904, 0.3343752681963212, 0.3483290765705089, 0.3636946278746014, 0.37967404688452416, 0.395694446997419, 0.41138949517797313, 0.4265609440673213, 0.4411322326527562, 0.4551007955148626, 0.46849433445204, 0.48133593311868655, 0.4936215051562636, 0.5053105101072686, 0.5163281557507879, 0.5265754860247208, 0.5359432655943178, 0.5443261924372284, 0.5516351491058805, 0.5578064164550197, 0.562807701853811, 0.5666413767524106, 0.5693455193701477, 0.5709933212346598, 0.571691249974197, 0.5715761533893002, 0.5708113046993644, 0.569581268667522, 0.5680854403955874, 0.5665301869841952, 0.5651197053684908, 0.5640459747686317, 0.56347848062781, 0.5635546452021619, 0.5643720328800096, 0.565983334559003, 0.5683948489145886, 0.5715687097587667 ], [ 0.48209281285542466, 0.4611453532770654, 0.4392842965260416, 0.4169620965823355, 0.3948024640865492, 0.3736145401784302, 0.354379366707302, 0.3381860648223839, 0.326097388123183, 0.31894927634259496, 0.31714030368493823, 0.32051035319834925, 0.32838400591658873, 0.3397595990488077, 0.35354493719741187, 0.3687439995203783, 0.38455754278914767, 0.40041032201795707, 0.41593380584681733, 0.4309276448466731, 0.44531316659378295, 0.4590860550289269, 0.47227333278037537, 0.4848991192408928, 0.4969623283723882, 0.5084271532050839, 0.5192246801683623, 0.5292622507866758, 0.538436679829653, 0.5466479778773856, 0.5538113181615216, 0.5598661394176675, 0.5647821769571046, 0.5685627554491985, 0.571245891075409, 0.5729037325174122, 0.5736407228714981, 0.5735906739422015, 0.5729127730580739, 0.5717864328730909, 0.5704048729455669, 0.5689674004209663, 0.5676705319609152, 0.5666983457920951, 0.5662127233679531, 0.5663443657731916, 0.5671855740993693, 0.5687857049069487, 0.5711499336106568, 0.5742415217744458 ], [ 0.4856145787844748, 0.4650578541060081, 0.4436058454919097, 0.4217028159141399, 0.3999596806224271, 0.3791672581761396, 0.3602827453982301, 0.3443680096214322, 0.3324605732596023, 0.32538155708675626, 0.32353261926703153, 0.32677516565724823, 0.3344652077424541, 0.34563044903704804, 0.35919846959834834, 0.37418285199227386, 0.38978710168545977, 0.405435279000832, 0.4207566234111239, 0.43554777246578646, 0.44972673083643205, 0.463286241601715, 0.4762516292588912, 0.4886472634673295, 0.5004745263774174, 0.5117020578312343, 0.5222667493542197, 0.5320823276240743, 0.5410518438359541, 0.5490808445074323, 0.5560890017038231, 0.5620190672213752, 0.5668428840203501, 0.5705647252772684, 0.573222457761275, 0.5748870269198847, 0.575660633262221, 0.5756737964136405, 0.5750813461325132, 0.5740572803491395, 0.572788414305285, 0.5714668226816201, 0.5702812423375544, 0.5694078314504487, 0.5690009245766359, 0.569184618335098, 0.5700461007291763, 0.5716315474753092, 0.5739451400353057, 0.5769513541550108 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.117121 (SEM: 0)
x1: 0.248976
x2: 0.230282
x3: 0.735156
x4: 0.417042
x5: 0.807821
x6: 0.178425", "Arm 1_0
hartmann6: -0.0973076 (SEM: 0)
x1: 0.096023
x2: 0.815353
x3: 0.561411
x4: 0.536357
x5: 0.972022
x6: 0.692599", "Arm 2_0
hartmann6: -0.013942 (SEM: 0)
x1: 0.156403
x2: 0.858762
x3: 0.765385
x4: 0.777066
x5: 0.799142
x6: 0.761238", "Arm 3_0
hartmann6: -0.00521022 (SEM: 0)
x1: 0.961731
x2: 0.561134
x3: 0.707312
x4: 0.420589
x5: 0.749887
x6: 0.200761", "Arm 4_0
hartmann6: -0.0152536 (SEM: 0)
x1: 0.428804
x2: 0.191727
x3: 0.29139
x4: 0.956337
x5: 0.743798
x6: 0.104274", "Arm 5_0
hartmann6: -0.165577 (SEM: 0)
x1: 0.111671
x2: 0.393274
x3: 0.0210624
x4: 0.540779
x5: 0.567671
x6: 0.948091", "Arm 6_0
hartmann6: -0.00440488 (SEM: 0)
x1: 0.950978
x2: 0.490146
x3: 0.148555
x4: 0.0777765
x5: 0.793243
x6: 0.697534", "Arm 7_0
hartmann6: -0.0120823 (SEM: 0)
x1: 0.746434
x2: 0.640313
x3: 0.771447
x4: 0.0757741
x5: 0.785575
x6: 0.324499", "Arm 8_0
hartmann6: -0.771418 (SEM: 0)
x1: 0.338152
x2: 0.602784
x3: 0.134864
x4: 0.743678
x5: 0.922402
x6: 0.194144", "Arm 9_0
hartmann6: -0.0145927 (SEM: 0)
x1: 0.564269
x2: 0.0100321
x3: 0.190226
x4: 0.238262
x5: 0.923009
x6: 0.626426", "Arm 10_0
hartmann6: -0.0790319 (SEM: 0)
x1: 0.0665052
x2: 0.0852538
x3: 0.181838
x4: 0.576385
x5: 0.612311
x6: 0.272805", "Arm 11_0
hartmann6: -0.00137818 (SEM: 0)
x1: 0.882353
x2: 0.8155
x3: 0.422534
x4: 0.850211
x5: 0.662138
x6: 0.590321", "Arm 12_0
hartmann6: -0.232548 (SEM: 0)
x1: 0.210376
x2: 0.454428
x3: 0.114578
x4: 0.631594
x5: 0.823961
x6: 0.210003", "Arm 13_0
hartmann6: -0.371586 (SEM: 0)
x1: 0.221159
x2: 0.515688
x3: 0.110552
x4: 0.636218
x5: 0.833154
x6: 0.204836", "Arm 14_0
hartmann6: -0.508987 (SEM: 0)
x1: 0.233881
x2: 0.557273
x3: 0.108864
x4: 0.642298
x5: 0.840535
x6: 0.200595", "Arm 15_0
hartmann6: -0.774671 (SEM: 0)
x1: 0.235712
x2: 0.623355
x3: 0.0995828
x4: 0.618441
x5: 0.810344
x6: 0.184075", "Arm 16_0
hartmann6: -0.962625 (SEM: 0)
x1: 0.241427
x2: 0.659143
x3: 0.09641
x4: 0.610123
x5: 0.79627
x6: 0.174239", "Arm 17_0
hartmann6: -1.25884 (SEM: 0)
x1: 0.243362
x2: 0.715119
x3: 0.090508
x4: 0.588752
x5: 0.761581
x6: 0.15512", "Arm 18_0
hartmann6: -1.553 (SEM: 0)
x1: 0.237091
x2: 0.791041
x3: 0.0818182
x4: 0.556624
x5: 0.70982
x6: 0.1263", "Arm 19_0
hartmann6: -1.66643 (SEM: 0)
x1: 0.232637
x2: 0.848263
x3: 0.075192
x4: 0.537663
x5: 0.678757
x6: 0.105289", "Arm 20_0
hartmann6: -2.01342 (SEM: 0)
x1: 0.262715
x2: 0.853656
x3: 0.0325618
x4: 0.505887
x5: 0.651571
x6: 0.0531", "Arm 21_0
hartmann6: -2.39576 (SEM: 0)
x1: 0.311531
x2: 0.859782
x3: 0.00190978
x4: 0.491899
x5: 0.648015
x6: 0.0227306", "Arm 22_0
hartmann6: -2.55729 (SEM: 0)
x1: 0.359141
x2: 0.857291
x3: 0
x4: 0.47549
x5: 0.640624
x6: 0.000141327", "Arm 23_0
hartmann6: -2.11061 (SEM: 0)
x1: 0.373688
x2: 0.894462
x3: 4.318e-13
x4: 0.398036
x5: 0.657586
x6: 0" ], "type": "scatter", "x": [ 0.24897557497024536, 0.0960230128839612, 0.1564025031402707, 0.9617307437583804, 0.4288041861727834, 0.11167066637426615, 0.9509784653782845, 0.7464336706325412, 0.3381518693640828, 0.5642691543325782, 0.06650516018271446, 0.8823529286310077, 0.21037622256941665, 0.22115866382264862, 0.2338811315731661, 0.23571152916258165, 0.24142699632672424, 0.24336218675524277, 0.2370906317830518, 0.2326371861810669, 0.26271478939294646, 0.3115314752445275, 0.3591411448569515, 0.3736876479919902 ], "xaxis": "x", "y": [ 0.23028185963630676, 0.8153527863323689, 0.8587622847408056, 0.5611339714378119, 0.19172651786357164, 0.39327356312423944, 0.4901457950472832, 0.6403127694502473, 0.6027837051078677, 0.010032054968178272, 0.08525383658707142, 0.8154998291283846, 0.4544277735965905, 0.5156881394848358, 0.557272623364236, 0.6233546219861563, 0.6591425853150353, 0.7151189485429901, 0.7910412806861575, 0.8482626131332559, 0.8536560073495288, 0.85978215409156, 0.8572908681854445, 0.8944617267658436 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.117121 (SEM: 0)
x1: 0.248976
x2: 0.230282
x3: 0.735156
x4: 0.417042
x5: 0.807821
x6: 0.178425", "Arm 1_0
hartmann6: -0.0973076 (SEM: 0)
x1: 0.096023
x2: 0.815353
x3: 0.561411
x4: 0.536357
x5: 0.972022
x6: 0.692599", "Arm 2_0
hartmann6: -0.013942 (SEM: 0)
x1: 0.156403
x2: 0.858762
x3: 0.765385
x4: 0.777066
x5: 0.799142
x6: 0.761238", "Arm 3_0
hartmann6: -0.00521022 (SEM: 0)
x1: 0.961731
x2: 0.561134
x3: 0.707312
x4: 0.420589
x5: 0.749887
x6: 0.200761", "Arm 4_0
hartmann6: -0.0152536 (SEM: 0)
x1: 0.428804
x2: 0.191727
x3: 0.29139
x4: 0.956337
x5: 0.743798
x6: 0.104274", "Arm 5_0
hartmann6: -0.165577 (SEM: 0)
x1: 0.111671
x2: 0.393274
x3: 0.0210624
x4: 0.540779
x5: 0.567671
x6: 0.948091", "Arm 6_0
hartmann6: -0.00440488 (SEM: 0)
x1: 0.950978
x2: 0.490146
x3: 0.148555
x4: 0.0777765
x5: 0.793243
x6: 0.697534", "Arm 7_0
hartmann6: -0.0120823 (SEM: 0)
x1: 0.746434
x2: 0.640313
x3: 0.771447
x4: 0.0757741
x5: 0.785575
x6: 0.324499", "Arm 8_0
hartmann6: -0.771418 (SEM: 0)
x1: 0.338152
x2: 0.602784
x3: 0.134864
x4: 0.743678
x5: 0.922402
x6: 0.194144", "Arm 9_0
hartmann6: -0.0145927 (SEM: 0)
x1: 0.564269
x2: 0.0100321
x3: 0.190226
x4: 0.238262
x5: 0.923009
x6: 0.626426", "Arm 10_0
hartmann6: -0.0790319 (SEM: 0)
x1: 0.0665052
x2: 0.0852538
x3: 0.181838
x4: 0.576385
x5: 0.612311
x6: 0.272805", "Arm 11_0
hartmann6: -0.00137818 (SEM: 0)
x1: 0.882353
x2: 0.8155
x3: 0.422534
x4: 0.850211
x5: 0.662138
x6: 0.590321", "Arm 12_0
hartmann6: -0.232548 (SEM: 0)
x1: 0.210376
x2: 0.454428
x3: 0.114578
x4: 0.631594
x5: 0.823961
x6: 0.210003", "Arm 13_0
hartmann6: -0.371586 (SEM: 0)
x1: 0.221159
x2: 0.515688
x3: 0.110552
x4: 0.636218
x5: 0.833154
x6: 0.204836", "Arm 14_0
hartmann6: -0.508987 (SEM: 0)
x1: 0.233881
x2: 0.557273
x3: 0.108864
x4: 0.642298
x5: 0.840535
x6: 0.200595", "Arm 15_0
hartmann6: -0.774671 (SEM: 0)
x1: 0.235712
x2: 0.623355
x3: 0.0995828
x4: 0.618441
x5: 0.810344
x6: 0.184075", "Arm 16_0
hartmann6: -0.962625 (SEM: 0)
x1: 0.241427
x2: 0.659143
x3: 0.09641
x4: 0.610123
x5: 0.79627
x6: 0.174239", "Arm 17_0
hartmann6: -1.25884 (SEM: 0)
x1: 0.243362
x2: 0.715119
x3: 0.090508
x4: 0.588752
x5: 0.761581
x6: 0.15512", "Arm 18_0
hartmann6: -1.553 (SEM: 0)
x1: 0.237091
x2: 0.791041
x3: 0.0818182
x4: 0.556624
x5: 0.70982
x6: 0.1263", "Arm 19_0
hartmann6: -1.66643 (SEM: 0)
x1: 0.232637
x2: 0.848263
x3: 0.075192
x4: 0.537663
x5: 0.678757
x6: 0.105289", "Arm 20_0
hartmann6: -2.01342 (SEM: 0)
x1: 0.262715
x2: 0.853656
x3: 0.0325618
x4: 0.505887
x5: 0.651571
x6: 0.0531", "Arm 21_0
hartmann6: -2.39576 (SEM: 0)
x1: 0.311531
x2: 0.859782
x3: 0.00190978
x4: 0.491899
x5: 0.648015
x6: 0.0227306", "Arm 22_0
hartmann6: -2.55729 (SEM: 0)
x1: 0.359141
x2: 0.857291
x3: 0
x4: 0.47549
x5: 0.640624
x6: 0.000141327", "Arm 23_0
hartmann6: -2.11061 (SEM: 0)
x1: 0.373688
x2: 0.894462
x3: 4.318e-13
x4: 0.398036
x5: 0.657586
x6: 0" ], "type": "scatter", "x": [ 0.24897557497024536, 0.0960230128839612, 0.1564025031402707, 0.9617307437583804, 0.4288041861727834, 0.11167066637426615, 0.9509784653782845, 0.7464336706325412, 0.3381518693640828, 0.5642691543325782, 0.06650516018271446, 0.8823529286310077, 0.21037622256941665, 0.22115866382264862, 0.2338811315731661, 0.23571152916258165, 0.24142699632672424, 0.24336218675524277, 0.2370906317830518, 0.2326371861810669, 0.26271478939294646, 0.3115314752445275, 0.3591411448569515, 0.3736876479919902 ], "xaxis": "x2", "y": [ 0.23028185963630676, 0.8153527863323689, 0.8587622847408056, 0.5611339714378119, 0.19172651786357164, 0.39327356312423944, 0.4901457950472832, 0.6403127694502473, 0.6027837051078677, 0.010032054968178272, 0.08525383658707142, 0.8154998291283846, 0.4544277735965905, 0.5156881394848358, 0.557272623364236, 0.6233546219861563, 0.6591425853150353, 0.7151189485429901, 0.7910412806861575, 0.8482626131332559, 0.8536560073495288, 0.85978215409156, 0.8572908681854445, 0.8944617267658436 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.001373Z", "iopub.status.busy": "2022-12-29T21:25:47.000782Z", "iopub.status.idle": "2022-12-29T21:25:47.480857Z", "shell.execute_reply": "2022-12-29T21:25:47.480293Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:47] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.205709475796331, 1.2051805545386796, 1.205005980382008, 1.2051922839934317, 1.2057441003027538, 1.2066640949350578, 1.2079529177699668, 1.2096091845756802, 1.2116294868108048, 1.214008428857357, 1.2167386911877203, 1.219811117312522, 1.2232148218299543, 1.226937316514131, 1.2309646511418684, 1.2352815656574423, 1.2398716502980751, 1.2447175104304051, 1.2498009330580777, 1.2551030522314668, 1.26060451090268, 1.2662856171050432, 1.2721264926816152, 1.2781072131318603, 1.284207937479927, 1.2904090273871813, 1.296691155030274, 1.303035399541179, 1.3094233320542874, 1.3158370896247233, 1.3222594384687483, 1.3286738271295497, 1.335064430286466, 1.3414161840031986, 1.347714813249316, 1.3539468525327587, 1.360099660451851, 1.3661614289195794, 1.3721211877373172, 1.3779688051070282, 1.3836949845779116, 1.3892912588315538, 1.3947499806245187, 1.4000643111326325, 1.4052282058794598, 1.4102363983842257, 1.415084381631494, 1.4197683874464404, 1.4242853638537563, 1.4286329505036852 ], [ 1.2019975595481769, 1.201467786068847, 1.2013036662866796, 1.2015120434964315, 1.2020977565939057, 1.2030635612550014, 1.2044100809127527, 1.2061357885383488, 1.2082370192498737, 1.2107080128259404, 1.2135409843430334, 1.2167262204260398, 1.220252198029814, 1.2241057222677794, 1.228272079572481, 1.2327352023994873, 1.2374778417513461, 1.2424817439764446, 1.2477278285626456, 1.2531963639713497, 1.2588671389210826, 1.2647196269117258, 1.2707331421660666, 1.2768869855426581, 1.2831605793366438, 1.2895335902264005, 1.295986039941814, 1.3024984035206335, 1.3090516952818987, 1.3156275428760726, 1.3222082499683276, 1.3287768482715878, 1.3353171397659382, 1.3418137300199304, 1.3482520535660618, 1.354618392278936, 1.3608998876641576, 1.3670845478946887, 1.3731612503369506, 1.379119740199997, 1.3849506258268915, 1.3906453710351387, 1.3961962848105032, 1.4015965085696644, 1.4068400011358098, 1.411921521518543, 1.4168366095558913, 1.421581564460254, 1.426153421310084, 1.4305499255424117 ], [ 1.1985253037245804, 1.1979972940836807, 1.197846265988592, 1.1980793796745488, 1.1987016771479695, 1.1997159978629894, 1.201122927142082, 1.2029207783992006, 1.205105609094326, 1.2076712692681946, 1.2106094805378285, 1.2139099426253486, 1.217560463875072, 1.221547111799121, 1.2258543794759353, 1.2304653635908036, 1.2353619500265645, 1.240525003153039, 1.2459345552939085, 1.2515699932379893, 1.2574102390822735, 1.2634339231252392, 1.2696195469553526, 1.2759456352903928, 1.2823908755115536, 1.2889342441986136, 1.2955551203068962, 1.3022333849314665, 1.3089495078786408, 1.3156846215065883, 1.3224205825034074, 1.3291400224392103, 1.335826388054567, 1.3424639723289553, 1.349037937407724, 1.3555343304553555, 1.3619400934502042, 1.3682430678474709, 1.3744319949216175, 1.3804965124669184, 1.3864271483961406, 1.3922153116421943, 1.3978532806448474, 1.403334189599928, 1.4086520125667292, 1.4138015454714459, 1.4187783860107863, 1.4235789114485629, 1.428200254305547, 1.4326402759660113 ], [ 1.195315250447082, 1.1947919330726673, 1.1946569089823038, 1.1949176580567722, 1.1955794228923426, 1.1966451187424578, 1.1981152794518504, 1.1999880404852412, 1.202259158852431, 1.2049220684987558, 1.2079679686399813, 1.2113859416275632, 1.2151630962690625, 1.2192847321079203, 1.2237345199782743, 1.2284946941674288, 1.2335462517053326, 1.2388691546169608, 1.244442531379307, 1.2502448742836738, 1.2562542298865824, 1.2624483802153705, 1.2688050128622312, 1.2753018785425252, 1.2819169351054995, 1.2886284773654144, 1.2954152524693312, 1.3022565608339731, 1.3091323429690223, 1.3160232527558453, 1.3229107179668267, 1.3297769889869127, 1.3366051768319112, 1.343379281642314, 1.3500842128653854, 1.3567058023209342, 1.3632308112807536, 1.369646932584713, 1.3759427886775393, 1.382107926291063, 1.388132808330342, 1.394008803360659, 1.3997281729468423, 1.4052840569742273, 1.4106704569875674, 1.4158822175216577, 1.4209150053649968, 1.4257652866928174, 1.4304303020231959, 1.434908038985246 ], [ 1.1923903208883153, 1.1918749541383318, 1.1917591350794046, 1.19205066404379, 1.1927549797826584, 1.193875063465108, 1.195411382249663, 1.1973618735607883, 1.1997219697049248, 1.2024846610540367, 1.2056405947985471, 1.2091782052899842, 1.2130838712915406, 1.2173420950397462, 1.2219356978737055, 1.2268460272747694, 1.2320531704314037, 1.2375361698511576, 1.243273237035184, 1.249241960769189, 1.255419507133748, 1.2617828088731544, 1.2683087422697599, 1.2749742901417545, 1.281756690014499, 1.2886335669091953, 1.2955830505505095, 1.302583877119509, 1.3096154759708885, 1.3166580419940472, 1.323692594522571, 1.330701023882936, 1.3376661268132128, 1.3445716320723462, 1.3514022175942144, 1.358143520517563, 1.364782141344174, 1.3713056433510717, 1.377702548217113, 1.3839623286357214, 1.3900753984874643, 1.396033100955213, 1.4018276947933634, 1.4074523388213362, 1.4129010746066473, 1.4181688072359622, 1.4232512840434763, 1.4281450711689083, 1.432847527847864, 1.4373567783867116 ], [ 1.1897736932099034, 1.189269881974514, 1.1891767702219707, 1.189502477320427, 1.190252631558698, 1.191430268028748, 1.1930357700230756, 1.1950668550913441, 1.1975186051737903, 1.200383538624454, 1.2036517205614692, 1.2073109069077037, 1.211346716749122, 1.2157428272424535, 1.22048118521837, 1.2255422298027001, 1.2309051207551975, 1.2365479677396534, 1.2424480563336822, 1.2485820672118515, 1.2549262855555698, 1.2614567983332143, 1.268149677638959, 1.2749811487749236, 1.2819277422077227, 1.2889664289328, 1.2960747391428877, 1.3032308644254604, 1.310413744012646, 1.3176031358740272, 1.324779673677464, 1.3319249108386442, 1.3390213530301245, 1.3460524806165417, 1.3530027625185173, 1.3598576629793846, 1.366603642617417, 1.3732281549978984, 1.3797196397661196, 1.3860675131598859, 1.3922621564874085, 1.398294902931836, 1.4041580228440225, 1.4098447075226945, 1.41534905136412, 1.4206660321932185, 1.4257914895636457, 1.4307221008285909, 1.4354553548297053, 1.4399895231183701 ], [ 1.1874886636742137, 1.187000374604906, 1.1869337846524461, 1.187297328229989, 1.1880968140790715, 1.1893353169065513, 1.1910131168728568, 1.1931276880626898, 1.1956737350772495, 1.1986432750585945, 1.20202576091685, 1.2058082403627848, 1.2099755445894183, 1.2145105000878664, 1.2193941570828346, 1.2246060283637217, 1.2301243327921638, 1.2359262384069112, 1.241988100755215, 1.2482856927996662, 1.254794423443042, 1.2614895423551438, 1.268346329364645, 1.27534026719318, 1.2824471967640387, 1.289643454721453, 1.2969059931588558, 1.3042124818829735, 1.3115413938406857, 1.318872074608583, 1.3261847970884448, 1.3334608027584727, 1.3406823309915743, 1.347832638057011, 1.3548960074615723, 1.361857753254412, 1.3687042178157065, 1.3754227654783828, 1.3820017731081, 1.3884306185073878, 1.3946996672378627, 1.4008002581927645, 1.4067246880208732, 1.4124661943176666, 1.4180189373700596, 1.4233779801689206, 1.4285392663860095, 1.4334995960403207, 1.438256598642721, 1.442808703694701 ], [ 1.185558490092268, 1.1850900649755292, 1.1850541324726585, 1.1854594350907508, 1.1863119501721588, 1.18761477521426, 1.1893680658028805, 1.1915690272433617, 1.194211958675994, 1.197288346380271, 1.2007870012545168, 1.2046942341966071, 1.2089940623437365, 1.2136684388333594, 1.2186974988607076, 1.2240598152436295, 1.2297326573622533, 1.2356922481277344, 1.2419140144684238, 1.2483728276433577, 1.2550432304601404, 1.2618996491644388, 1.2689165883742994, 1.2760688079576419, 1.2833314812058936, 1.2906803340547277, 1.298091765457799, 1.305542949342018, 1.3130119188720903, 1.3204776340282416, 1.3279200337533905, 1.3353200741448967, 1.342659754341107, 1.349922131870065, 1.3570913292740845, 1.3641525337904927, 1.3710919917528164, 1.3778969991824548, 1.3845558897836738, 1.3910580212547814, 1.397393760513592, 1.403554468132101, 1.4095324820098918, 1.4153211001064956, 1.420914561910711, 1.4263080282525635, 1.4314975590551842, 1.4364800886698126, 1.4412533985220535, 1.4458160869075964 ], [ 1.1840062168532248, 1.1835623835695874, 1.183561571693547, 1.1840128215010193, 1.1849222640083374, 1.1862929999750953, 1.1881250367389387, 1.1904152838759219, 1.1931576060311242, 1.1963429288970988, 1.199959392408041, 1.2039925438693437, 1.2084255629861447, 1.2132395105510674, 1.2184135928135904, 1.2239254341652765, 1.2297513516139147, 1.2358666254716373, 1.2422457616556437, 1.2488627419272569, 1.2556912592344271, 1.2627049360557376, 1.2698775242679345, 1.2771830855851782, 1.2845961520627525, 1.2920918665413217, 1.2996461032475166, 1.307235569078697, 1.3148378863930952, 1.322431658405336, 1.3299965185477223, 1.3375131653910923, 1.3449633849100688, 1.352330062010027, 1.359597183289567, 1.366749832979644, 1.373774183873619, 1.380657484844484, 1.387388046252777, 1.3939552242048914, 1.4003494042591047, 1.4065619848291246, 1.4125853602318816, 1.4184129030917276, 1.4240389456591416, 1.4294587595307175, 1.4346685332616116, 1.4396653474275818, 1.4444471468035676, 1.4490127094612886 ], [ 1.1828544808954211, 1.1824403613186865, 1.1824794639779361, 1.1829811127795575, 1.1839515741031286, 1.1853939295752252, 1.1873080123764188, 1.1896904079295494, 1.192534516765924, 1.1958306746799572, 1.1995663231699896, 1.2037262217372258, 1.2082926928975908, 1.21324589068801, 1.2185640839002534, 1.2242239461022761, 1.2302008455569413, 1.2364691292869814, 1.2430023966580426, 1.2497737588865308, 1.256756081786222, 1.2639222098339944, 1.2712451702659595, 1.2786983564305692, 1.2862556900485287, 1.293891762387982, 1.3015819546804241, 1.3093025383976964, 1.3170307562949704, 1.3247448854032504, 1.3324242834246647, 1.340049420232275, 1.3476018963870968, 1.355064450736036, 1.3624209592246674, 1.3696564270302511, 1.3767569759837008, 1.383709829007863, 1.3905032929685701, 1.397126740944431, 1.4035705945075039, 1.4098263062108904, 1.4158863421368215, 1.4217441640976796, 1.4273942109171849, 1.4328318781512823, 1.438053495628043, 1.4430563022755711, 1.4478384178444879, 1.4523988112950732 ], [ 1.1821252981354935, 1.1817464122329837, 1.181830553423544, 1.1823873108347447, 1.18342306421508, 1.1849408506716936, 1.18694030114596, 1.1894176472618072, 1.1923657956702822, 1.1957744639744872, 1.199630369993493, 1.203917464637519, 1.2086171980224276, 1.2137088085545682, 1.219169625404886, 1.2249753758743738, 1.2311004904459983, 1.2375183996635009, 1.244201818258201, 1.2511230130862405, 1.2582540524057377, 1.2655670348110035, 1.2730342967650687, 1.2806285981624308, 1.2883232857432871, 1.2960924345043818, 1.3039109675371983, 1.3117547549963942, 1.3196006931730597, 1.3274267649247358, 1.3352120829927063, 1.3429369180032744, 1.350582713183066, 1.358132087992349, 1.3655688329681235, 1.3728778980474823, 1.3800453764978886, 1.3870584863157887, 1.3939055505851234, 1.4005759778467683, 1.407060243061161, 1.413349869298884, 1.4194374099095217, 1.4253164306314317, 1.4309814909296807, 1.4364281237877643, 1.441652813217226, 1.4466529688658045, 1.4514268972728581, 1.455973769514362 ], [ 1.1818398300864352, 1.1815020953797533, 1.1816367239394376, 1.1822535469676423, 1.1833590316272453, 1.1849561420595318, 1.18704427685892, 1.1896192833442472, 1.1926735449326789, 1.196196134494655, 1.2001730240258068, 1.2045873394474613, 1.2094196488208513, 1.2146482725920684, 1.2202496054623753, 1.2261984408626558, 1.2324682905786841, 1.2390316936428405, 1.2458605100511482, 1.2529261961070193, 1.2602000592075997, 1.2676534906822503, 1.2752581758938237, 1.2829862812636035, 1.2908106182238153, 1.2987047843788275, 1.3066432824033878, 1.3146016174491773, 1.322556374086824, 1.3304852740850108, 1.3383672166161407, 1.346182302763847, 1.3539118464664217, 1.3615383742312517, 1.3690456160644024, 1.3764184900497818, 1.3836430828630149, 1.3907066282173566, 1.3975974848291572, 1.4043051149972223, 1.4108200643644053, 1.417133942927637, 1.4232394069355339, 1.4291301409978896, 1.4348008395479406, 1.4402471867450524, 1.4454658339658208, 1.4504543741780171, 1.4552113126926622, 1.4597360340145367 ], [ 1.18201813068784, 1.1817278561277722, 1.181918735059431, 1.1826008124152807, 1.1837806126217754, 1.1854609953541542, 1.1876410949797112, 1.190316343634338, 1.1934785732591917, 1.1971161880722114, 1.20121439619203, 1.2057554876010763, 1.2107191452790378, 1.2160827769600608, 1.2218218562924443, 1.2279102639110853, 1.2343206208061062, 1.2410246081781118, 1.2479932695761249, 1.255197292447908, 1.2626072672783584, 1.2701939232723818, 1.277928340098179, 1.2857821356005854, 1.2937276296764844, 1.3017379847251345, 1.3097873232866635, 1.317850823691249, 1.3259047947783706, 1.333926731015935, 1.3418953496468746, 1.3497906117978673, 1.3575937297722092, 1.3652871629802505, 1.3728546050959327, 1.3802809650325325, 1.387552344179733, 1.3946560120344518, 1.4015803819083033, 1.4083149878472607, 1.4148504633138506, 1.4211785216244337, 1.427291937662974, 1.433184530052345, 1.4388511427741006, 1.4442876251857242, 1.4494908094694237, 1.454458484725063, 1.4591893671553156, 1.4636830660482507 ], [ 1.1826788737707714, 1.1824427469736245, 1.182695936442937, 1.183448666865314, 1.184707485409493, 1.186475112834576, 1.1887503860067823, 1.1915282912618028, 1.1948000827792011, 1.198553475829773, 1.2027729017915647, 1.2074398103358197, 1.2125330040603592, 1.2180289918291294, 1.223902348811271, 1.230126073337798, 1.2366719329003903, 1.243510793670878, 1.2506129296830353, 1.2579483092277526, 1.2654868570697089, 1.2731986918398621, 1.281054338455841, 1.2890249157422915, 1.2970822996314293, 1.305199262478764, 1.3133495891757563, 1.3215081709125196, 1.3296510776595414, 1.337755610702891, 1.3458003368757139, 1.3537651064587104, 1.3616310570407353, 1.3693806058954299, 1.3769974335950455, 1.384466461604503, 1.391773826449426, 1.3989068527223532, 1.4058540267023627, 1.412604971762567, 1.419150426094459, 1.42548222266422, 1.4315932708020807, 1.4374775384607075, 1.4431300339841104, 1.4485467862009167, 1.453724821767221, 1.4586621388970782, 1.4633576768890713, 1.4678112811470156 ], [ 1.1838390621238, 1.1836641288173027, 1.1839859618805928, 1.1848149257656808, 1.1861575514061031, 1.188016383468776, 1.1903899271743612, 1.1932726934868667, 1.1966553354857046, 1.2005248639488095, 1.2048649270201597, 1.2096561374268258, 1.214876430888989, 1.2205014407796282, 1.2265048762954982, 1.2328588939646035, 1.2395344548762464, 1.2465016623254221, 1.2537300764721897, 1.2611890040818117, 1.2688477624554784, 1.276675917348832, 1.2846434950902323, 1.2927211693399805, 1.3008804230527653, 1.3090936862857396, 1.3173344505822462, 1.3255773607918448, 1.3337982853804862, 1.341974366545647, 1.3500840517701396, 1.3581071088024923, 1.3660246264029392, 1.373819003495051, 1.3814739295602978, 1.388974359156447, 1.3963064832950223, 1.403457700066796, 1.4104165863780536, 1.417172872007288, 1.4237174164875046, 1.4300421886512207, 1.4361402481194603, 1.4420057276287168, 1.4476338148935934, 1.4530207326908282, 1.4581637159903236, 1.4630609852060072, 1.467711714944747, 1.472115997952022 ], [ 1.1855137198674923, 1.185407354312522, 1.1858044044064635, 1.186715328074452, 1.1881465966142801, 1.190100539066812, 1.192575294672071, 1.1955648714353102, 1.1990593020642255, 1.2030448832595084, 1.207504481021974, 1.2124178833761736, 1.217762182466062, 1.2235121698959124, 1.2296407319262768, 1.2361192341746527, 1.2429178884034546, 1.250006096531916, 1.2573527690463397, 1.2649266164792923, 1.2726964136316268, 1.28063123681432, 1.2887006746972673, 1.296875013473753, 1.3051253970726207, 1.3134239631479314, 1.3217439556009387, 1.3300598144776326, 1.3383472442554147, 1.3465832617887712, 1.354746225514676, 1.362815847896826, 1.3707731934731335, 1.3786006652088167, 1.3862819820890302, 1.3938021509521428, 1.4011474354259927, 1.408305324469573, 1.4152645024625385, 1.4220148220825544, 1.4285472804511687, 1.4348539983090223, 1.4409282013875324, 1.4467642027373362, 1.4523573845780129, 1.4577041782388047, 1.4628020409288873, 1.467649428356488, 1.472245762555176, 1.4765913946249114 ], [ 1.1877155708470766, 1.1876854359555125, 1.1881644751983995, 1.1891631872234043, 1.1906879360566796, 1.1927407937544388, 1.195319499891389, 1.1984175349867952, 1.2020242973853956, 1.2061253673329946, 1.210702838540797, 1.215735696477429, 1.22120022363449, 1.2270704145033169, 1.2333183863220436, 1.239914775199996, 1.246829110541471, 1.2540301634836541, 1.2614862672088372, 1.269165608488859, 1.2770364907532872, 1.2850675694646654, 1.29322806076869, 1.3014879243857493, 1.3098180216264192, 1.318190249323516, 1.3265776504346276, 1.3349545021145302, 1.343296382205772, 1.3515802153482834, 1.359784300251773, 1.3678883200780525, 1.375873338298906, 1.3837217827705994, 1.3914174210317518, 1.3989453299238856, 1.406291862504269, 1.4134446148511015, 1.4203923947718045, 1.427125193679406, 1.4336341620930604, 1.439911588453077, 1.4459508803139272, 1.451746546555885, 1.4572941790628815, 1.4625904323373353, 1.4676329997190396, 1.4724205851879697, 1.476952870100185, 1.4812304745813472 ], [ 1.1904547071012084, 1.1905087029867023, 1.1910766504213126, 1.1921690296069483, 1.1937920458085967, 1.1959474716289307, 1.1986326149341013, 1.2018404084641598, 1.205559608731728, 1.2097750855500162, 1.2144681800015695, 1.2196171078747102, 1.2251973871185895, 1.2311822709930857, 1.2375431725390655, 1.2442500700746404, 1.2512718871230382, 1.2585768431950874, 1.2661327740763422, 1.273907421737396, 1.2818686948181273, 1.2899849009910078, 1.2982249525470682, 1.3065585464104632, 1.3149563195889171, 1.32338998088769, 1.331832419611389, 1.3402577919835903, 1.3486415861426917, 1.3569606668235057, 1.3651933011892095, 1.3733191677061598, 1.3813193504043768, 1.3891763212775519, 1.3968739138754351, 1.40439729125884, 1.4117329113696317, 1.418868492492213, 1.4257929808713101, 1.4324965217691172, 1.4389704343946546, 1.445207190334838, 1.45120039446246, 1.4569447668624838, 1.4624361241290065, 1.4676713584259315, 1.472648412926204, 1.4773662525852722, 1.4818248296002767, 1.4860250433035609 ], [ 1.1937382532498244, 1.1938844530691763, 1.194548312152913, 1.1957402269775441, 1.1974661893221654, 1.1997276296597952, 1.2025213948568556, 1.205839855019315, 1.2096711250521002, 1.213999379780252, 1.2188052379117316, 1.2240661896588838, 1.2297570449243609, 1.2358503827591611, 1.2423169874084732, 1.2491262608903273, 1.2562466061352895, 1.2636457779413366, 1.2712912012777287, 1.2791502578779954, 1.2871905427614738, 1.2953800925135088, 1.3036875870276068, 1.3120825261288256, 1.3205353821784886, 1.3290177294913788, 1.3375023512312418, 1.3459633244193063, 1.3543760838022922, 1.3627174655777405, 1.3709657323425302, 1.3791005810810648, 1.3871031364898903, 1.394955932378001, 1.4026428842122511, 1.4101492560179354, 1.4174616247396794, 1.424567844790449, 1.431457014889584, 1.438119448483046, 1.4445466481584286, 1.4507312836360065, 1.4566671722439326, 1.4623492603448953, 1.4677736039985958, 1.4729373472007041, 1.4778386962824925, 1.4824768894192972, 1.4868521606130232, 1.490965697927795 ], [ 1.197570034947107, 1.1978166071789285, 1.198583392143293, 1.1998806318524866, 1.2017140475358432, 1.2040846857388545, 1.206988906961904, 1.2104185103923477, 1.2143609782103566, 1.2187998158194222, 1.2237149607809492, 1.229083233114464, 1.2348788023007053, 1.2410736508235969, 1.2476380193769803, 1.2545408240524267, 1.2617500402904445, 1.269233051793145, 1.2769569648992358, 1.2848888902313944, 1.2929961939601216, 1.3012467210292833, 1.30960899238009, 1.3180523777707585, 1.326547245348455, 1.335065088773596, 1.3435786324747865, 1.3520619155494504, 1.3604903549253442, 1.3688407886514262, 1.377091500568614, 1.385222228081975, 1.3932141552621986, 1.4010498939740086, 1.4087134560853005, 1.416190219972875, 1.4234668944484654, 1.4305314828552935, 1.4373732494511586, 1.443982689372657, 1.4503515025766598, 1.4564725713079356, 1.4623399399590942, 1.4679487957463149, 1.4732954484484362, 1.4783773075262396, 1.4831928551992077, 1.4877416144378177, 1.4920241112614048, 1.496041831156842 ], [ 1.201950262386779, 1.2023053792352094, 1.203182030459136, 1.2045902284832104, 1.2065353657877722, 1.2090180653111735, 1.2120341808935076, 1.215574940010356, 1.2196272102493593, 1.224173863489642, 1.2291942081758844, 1.234664460288601, 1.2405582268596456, 1.246846981083209, 1.2535005140627675, 1.260487354004313, 1.2677751485161102, 1.2753310092629717, 1.2831218205160888, 1.2911145143139697, 1.2992763152845639, 1.3075749579657865, 1.3159788789565658, 1.3244573856307422, 1.332980802585063, 1.3415205965546309, 1.3500494802575338, 1.3585414955422648, 1.366972076304962, 1.3753180919021752, 1.3835578721802066, 1.3916712157318538, 1.3996393835179943, 1.4074450804832752, 1.415072428171275, 1.4225069315241958, 1.4297354429730555, 1.4367461265585708, 1.4435284241917645, 1.4500730253400447, 1.4563718405234782, 1.4624179781559654, 1.4682057235833685, 1.4737305187320682, 1.47898894061275, 1.4839786770033911, 1.488698497906562, 1.4931482217669183, 1.4973286758745838, 1.5012416508108737 ], [ 1.2068752430883316, 1.207346975593827, 1.2083402649382242, 1.2098648159979863, 1.2119256346815812, 1.2145228840917761, 1.2176518971867443, 1.2213033369755548, 1.2254634838755618, 1.230114622028521, 1.2352354927565148, 1.2408017837998397, 1.2467866267522223, 1.253161081014308, 1.2598945893096867, 1.2669553961874531, 1.2743109261756609, 1.2819281219879237, 1.2897737454290155, 1.2978146446420695, 1.3060179914388046, 1.3143514920028818, 1.3227835735442082, 1.3312835487199952, 1.339821758963164, 1.3483696973475316, 1.356900111307677, 1.3653870854267585, 1.3738061045978927, 1.3821340981319816, 1.390349465793474, 1.398432087250339, 1.4063633169665848, 1.4141259670719784, 1.4217042811335, 1.429083901945617, 1.4362518363899126, 1.443196420061203, 1.4499072837380456, 1.4563753229651704, 1.4625926711256645, 1.4685526755428788, 1.4742498754795683, 1.4796799804729237, 1.4848398472828694, 1.4897274538168126, 1.4943418686689487, 1.4986832153057277, 1.5027526303695948, 1.5065522160025717 ], [ 1.212337141405504, 1.212933343167197, 1.2140497713589502, 1.2156957445137009, 1.2178758262774312, 1.220589688454715, 1.2238321356781718, 1.227593281787123, 1.2318588560936796, 1.2366106095032554, 1.241826786648005, 1.2474826307648992, 1.253550892291551, 1.2600023187929703, 1.2668061113558708, 1.2739303396261057, 1.2813423133011546, 1.2890089117434442, 1.296896875521617, 1.3049730644531183, 1.3132046865458675, 1.321559501525175, 1.3300060017059492, 1.3385135720505703, 1.347052630473075, 1.3555947488788207, 1.3641127550888057, 1.372580815685911, 1.3809744999184514, 1.3892708250747492, 1.397448284163763, 1.405486857253024, 1.4133680083661462, 1.421074670356178, 1.428591220566752, 1.435903450294558, 1.4429985310110376, 1.4498649799643433, 1.4564926271855665, 1.462872585137782, 1.4689972213844567, 1.474860133840948, 1.4804561275217258, 1.485781191281521, 1.4908324728959768, 1.4956082509152067, 1.5001079019966503, 1.5043318628120361, 1.5082815860571483, 1.511959490515462 ], [ 1.2183238045183307, 1.2190519876556944, 1.2202976772571537, 1.2220697281972446, 1.224372210130323, 1.2272042779822456, 1.2305602076450983, 1.2344295865106079, 1.238797636133991, 1.2436456355504788, 1.248951409492009, 1.2546898462476546, 1.2608334146001592, 1.2673526567470141, 1.2742166425582493, 1.2813933782858429, 1.288850168861541, 1.296553936829744, 1.3044715029260359, 1.3125698337848093, 1.3208162617689372, 1.3291786809260537, 1.3376257219363692, 1.346126907850671, 1.3546527915488693, 1.3631750752331042, 1.3716667119144033, 1.3801019887436945, 1.3884565921471872, 1.396707655018499, 1.4048337866525111, 1.4128150866294285, 1.4206331444111495, 1.4282710269255365, 1.4357132568100988, 1.4429457841906692, 1.4499559548262095, 1.4567324771341137, 1.463265390043742, 1.469546032878545, 1.4755670176463385, 1.4813222033426277, 1.486806671251891, 1.4920166998371733, 1.4969497376646916, 1.5016043728969024, 1.5059802981525203, 1.5100782699084485, 1.5139000620388976, 1.517448413496372 ], [ 1.224818674779605, 1.225685883627214, 1.2270664726502098, 1.228968759543141, 1.2313962737886517, 1.2343476343975022, 1.2378165947939785, 1.2417922448233867, 1.2462593470162886, 1.2511987745315292, 1.2565880130388865, 1.2624016890288163, 1.2686120922553115, 1.275189668544751, 1.2821034687473898, 1.2893215481533626, 1.2968113170539413, 1.3045398469934144, 1.3124741389423613, 1.320581359730469, 1.3288290522344777, 1.3371853235440023, 1.345619013984997, 1.3540998486869837, 1.3625985724442802, 1.371087067979136, 1.3795384573599896, 1.3879271862328812, 1.3962290906509003, 1.4044214465941052, 1.4124830027143902, 1.4203939973658002, 1.4281361615306456, 1.4356927097576855, 1.4430483216177128, 1.4501891163848573, 1.457102623617162, 1.463777752017105, 1.4702047584239115, 1.4763752180911962, 1.4822819966357574, 1.487919223318633, 1.4932822647389528, 1.498367697651756, 1.5031732794869093, 1.5076979152294232, 1.5119416195738462, 1.5159054736234565, 1.519591575806209, 1.5230029870696813 ], [ 1.231800804711381, 1.2328134941524949, 1.2343340364314332, 1.236370144165417, 1.2389247669345522, 1.2419959752514806, 1.2455770120387468, 1.2496565030113023, 1.2542188037662576, 1.2592444500953666, 1.2647106714500018, 1.2705919273224284, 1.2768604323008064, 1.2834866454777139, 1.2904397107492018, 1.2976878438910242, 1.3051986688839277, 1.3129395096305425, 1.3208776444897572, 1.3289805307221632, 1.337216004719548, 1.3455524623380242, 1.353959022131175, 1.3624056729852991, 1.3708634066815713, 1.379304335262446, 1.3877017927402282, 1.396030420613409, 1.404266236804958, 1.4123866879600318, 1.420370685489453, 1.4281986262687925, 1.435852399442543, 1.4433153812748145, 1.450572420364394, 1.4576098157403348, 1.4644152903286873, 1.4709779620145391, 1.4772883140391369, 1.4833381658309837, 1.4891206446652323, 1.4946301578800831, 1.4998623648451361, 1.5048141475369423, 1.5094835784537768, 1.5138698846798195, 1.5179734071446949, 1.5217955544595463, 1.5253387510873984, 1.5286063799724714 ], [ 1.2392449828476004, 1.240408908260039, 1.2420737864674236, 1.244246663564863, 1.246929875715124, 1.2501209377241431, 1.2538125980990165, 1.2579930546562947, 1.2626463099391916, 1.2677526320230366, 1.2732890777177075, 1.2792300346346348, 1.2855477457701827, 1.2922127920021624, 1.2991945202610595, 1.3064614152405836, 1.3139814191465293, 1.3217222072725114, 1.3296514279419294, 1.3377369145205056, 1.3459468755950803, 1.3542500676022757, 1.3626159525197121, 1.3710148418725814, 1.3794180273176904, 1.3877978974364034, 1.396128040057645, 1.40438332939005, 1.4125399974161281, 1.420575689338912, 1.428469503323845, 1.4362020152944566, 1.4437552900640873, 1.451112880557781, 1.458259817238125, 1.4651825900395505, 1.4718691250988523, 1.4783087583321461, 1.4844922074731173, 1.4904115436103593, 1.4960601626271945, 1.5014327563480259, 1.506525282713915, 1.5113349340039048, 1.5158601020077462, 1.5201003391284311, 1.5240563146097748, 1.5277297653933803, 1.5311234414569992, 1.5342410458265043 ], [ 1.2471219669325435, 1.248442090655461, 1.2502549455895988, 1.252566855849132, 1.2553795153328877, 1.258689879258222, 1.2624902200284644, 1.2667683453164258, 1.2715079596581613, 1.2766891339789566, 1.2822888365018035, 1.2882814777517297, 1.2946394312330476, 1.3013335053147441, 1.3083333558315073, 1.3156078396281523, 1.3231253157353322, 1.3308539035805746, 1.3387617077432867, 1.3468170173873606, 1.3549884865202821, 1.363245299193681, 1.3715573219836426, 1.3798952447014543, 1.3882307093099275, 1.396536426426178, 1.4047862785220206, 1.4129554089271725, 1.421020295939262, 1.42895881169481, 1.4367502659067588, 1.4443754350766553, 1.4518165782921848, 1.4590574411684758, 1.4660832498302652, 1.4728806970139836, 1.4794379223606058, 1.4857444887633673, 1.4917913562507317, 1.497570854376231, 1.5030766535269158, 1.5083037350333008, 1.5132483595394002, 1.517908032821127, 1.5222814681454273, 1.526368544329807, 1.5301702588590904, 1.5336886756972334, 1.5369268677484313, 1.5398888542319173 ], [ 1.255398809171258, 1.256879224260103, 1.2588428998487518, 1.261295387082919, 1.2642377109537872, 1.2676662639860963, 1.2715728612250234, 1.2759449588598013, 1.280766020012544, 1.2860159907130184, 1.291671835623942, 1.2977080824301737, 1.3040973347134948, 1.3108107294891644, 1.3178183311012373, 1.3250894643070856, 1.3325929954481697, 1.3402975725957063, 1.3481718349507015, 1.3561845998618012, 1.364305033499232, 1.3725028090151832, 1.380748254184922, 1.3890124891432314, 1.3972675538962744, 1.4054865247467054, 1.4136436185484789, 1.4217142837398167, 1.4296752773256565, 1.4375047273393564, 1.4451821807592662, 1.452688637340232, 1.4600065702970657, 1.4671199351967306, 1.4740141687321757, 1.480676179222541, 1.487094330685192, 1.4932584221501506, 1.4991596635569315, 1.504790649134963, 1.510145328685644, 1.5152189767280106, 1.5200081591046641, 1.5245106964131143, 1.52872562354813, 1.5326531447039624, 1.5362945833633708, 1.539652327052355, 1.5427297669236044, 1.545531232509827 ], [ 1.264039251404608, 1.2656831187664808, 1.2677996176914696, 1.2703934781819348, 1.273465029568218, 1.2770100972367302, 1.28102005685198, 1.2854820526403072, 1.2903793652231554, 1.2956918905935972, 1.3013966762749731, 1.3074684604002371, 1.313880172426119, 1.3206033727725812, 1.3276086254912416, 1.334865809378724, 1.3423443784701732, 1.3500135840478784, 1.3578426689804106, 1.3658010427920346, 1.3738584432532932, 1.3819850879552404, 1.390151817477749, 1.3983302304209435, 1.40649280969513, 1.4146130389829754, 1.4226655081187602, 1.430626006197934, 1.4384716014731558, 1.4461807074553215, 1.453733135072657, 1.4611101312031312, 1.4682944043430006, 1.4752701385639126, 1.482022997203539, 1.4885401178960551, 1.4948101005592758, 1.5008229898118903, 1.506570253017867, 1.512044754785446, 1.5172407283417686, 1.5221537438212887, 1.5267806732003835, 1.5311196514194594, 1.5351700331723628, 1.5389323449041965, 1.542408231718599, 1.5456003991196463, 1.5485125497646326, 1.551149315649902 ], [ 1.2730041700082595, 1.274813662494871, 1.2770841051991744, 1.2798193610670154, 1.2830190361138136, 1.2866783821627765, 1.2907883524519073, 1.2953358197025715, 1.300303943395221, 1.305672646780744, 1.311419147360679, 1.3175184847787786, 1.3239440046843822, 1.3306677773329663, 1.3376609473391086, 1.3448940222566983, 1.3523371125780512, 1.3599601361960643, 1.3677329984268458, 1.3756257558616143, 1.3836087694963761, 1.3916528501937016, 1.3997293976985494, 1.4078105331492652, 1.4158692242216182, 1.4238794016269498, 1.4318160655660925, 1.4396553808416257, 1.4473747595881439, 1.4549529309404108, 1.462369997377715, 1.4696074779182722, 1.4766483387535216, 1.4834770122700796, 1.4900794056760716, 1.4964429006000943, 1.502556345051308, 1.5084100390179254, 1.5139957147571614, 1.5193065125284002, 1.524336952189474, 1.5290829007646405, 1.5335415358462956, 1.537711304542458, 1.5415918776399324, 1.5451840987148457, 1.5484899280658833, 1.5515123815434901, 1.5542554645676545, 1.5567241018399887 ], [ 1.2822520598601603, 1.284228308668766, 1.2866528908674582, 1.2895287601688172, 1.2928547723388872, 1.2966255986512754, 1.300831786585402, 1.3054599784621292, 1.3104932750810323, 1.3159117045521111, 1.3216927396602107, 1.3278118078726668, 1.334242753577484, 1.3409582330374683, 1.3479300404105157, 1.3551293741651973, 1.3625270575728543, 1.3700937268117077, 1.3777999978018776, 1.3856166197750701, 1.3935146206366749, 1.4014654467695233, 1.4094410981435166, 1.4174142583865816, 1.4253584187411705, 1.4332479944747631, 1.441058432236553, 1.4487663069780912, 1.4563494073198882, 1.4637868085974222, 1.4710589332172965, 1.4781475983603083, 1.4850360514501173, 1.4917089941331727, 1.4981525957606718, 1.5043544975067245, 1.5103038082867974, 1.5159910935608232, 1.521408357931713, 1.5265490222137768, 1.531407895385086, 1.5359811415952032, 1.5402662422109383, 1.5442619527731558, 1.5479682547168874, 1.5513863017706329, 1.5545183610813689, 1.5573677492852729, 1.5599387639337976, 1.5622366108662396 ], [ 1.2917395572775592, 1.2938826016364697, 1.2964605516651417, 1.2994754168737603, 1.3029252803713236, 1.306804228460967, 1.3111024206562318, 1.315806309797807, 1.3208989987406095, 1.3263606943763067, 1.33216920408683, 1.3383004210820788, 1.3447287605069773, 1.3514275287159006, 1.3583692254731614, 1.3655257892979789, 1.3728688000435594, 1.3803696522676903, 1.3879997102753787, 1.3957304524663792, 1.4035336096439748, 1.4113812995680854, 1.419246158318361, 1.4271014678983847, 1.4349212788483516, 1.4426805263286697, 1.450355138093708, 1.4579221329155116, 1.4653597082798535, 1.4726473165134493, 1.4797657288724706, 1.4866970874963046, 1.493424945477836, 1.4999342955974757, 1.5062115884916005, 1.5122447411614326, 1.5180231367690504, 1.5235376166176076, 1.528780465087266, 1.5337453881232752, 1.5384274856793798, 1.5428232183419965, 1.5469303682269515, 1.5507479941705358, 1.5542763812378717, 1.5575169846392218, 1.560472368265003, 1.5631461382024674, 1.565542871758859, 1.5676680426679637 ], [ 1.3014220055042804, 1.303730752900109, 1.3064602967753942, 1.3096116791108061, 1.3131821971800979, 1.3171653541628323, 1.3215509420588956, 1.3263252638168614, 1.3314714798961973, 1.3369700414603194, 1.3427991589499924, 1.3489352567746922, 1.3553533794837949, 1.3620275339203918, 1.3689309680177029, 1.3760363965799025, 1.3833161878543716, 1.3907425240005187, 1.398287545844715, 1.4059234890954286, 1.4136228162847877, 1.4213583464127992, 1.4291033826366863, 1.4368318372856124, 1.4445183528743215, 1.4521384175226166, 1.4596684731645282, 1.4670860150755243, 1.4743696814982088, 1.4814993324616286, 1.488456117230747, 1.495222530161998, 1.5017824550536574, 1.508121198345867, 1.5142255117280026, 1.52008360484014, 1.5256851488069367, 1.5310212713208666, 1.5360845439115498, 1.5408689619193423, 1.5453699175605489, 1.5495841663540106, 1.5535097870972794, 1.5571461355484397, 1.5604937919930504, 1.563554502949497, 1.566331117377887, 1.568827517891731, 1.571048547608776, 1.5729999334018805 ], [ 1.3112540599331066, 1.313726267340486, 1.316604612417566, 1.319889161844936, 1.323576427072263, 1.327659339238752, 1.332127347058429, 1.3369666407623289, 1.3421604858001428, 1.3476896305982216, 1.353532742085164, 1.359666825375594, 1.3660675973372078, 1.3727098008371112, 1.379567460857124, 1.3866140923243009, 1.3938228725910606, 1.4011667907966978, 1.4086187837804698, 1.4161518651836513, 1.4237392516329994, 1.431354487738609, 1.4389715701028132, 1.4465650695449723, 1.4541102501855778, 1.4615831837908462, 1.4689608577634186, 1.4762212753013073, 1.4833435464804992, 1.4903079693031258, 1.4970961000614542, 1.503690812671191, 1.5100763469064828, 1.5162383457065267, 1.5221638819080172, 1.5278414748814253, 1.5332610976113406, 1.5384141747668068, 1.5432935722685792, 1.5478935787940182, 1.5522098795860622, 1.55623952287081, 1.559980879154461, 1.5634335936745072, 1.5665985323252354, 1.5694777214586724, 1.57207428206886, 1.574392358985719, 1.576437045820578, 1.5782143065050387 ], [ 1.3211903174876423, 1.3238226025758864, 1.3268459487849396, 1.330259457474028, 1.3340588695063298, 1.3382365656686532, 1.3427816797519538, 1.3476803232823353, 1.3529159042149383, 1.358469506433322, 1.3643202893591801, 1.370445870362129, 1.3768226645127943, 1.383426170887986, 1.3902312069416847, 1.3972120999038287, 1.4043428468623342, 1.4115972545757176, 1.4189490677862482, 1.4263720920683443, 1.4338403147427394, 1.4413280253994307, 1.448809936149301, 1.4562613008011902, 1.4636580316356989, 1.4709768122174136, 1.4781952046664493, 1.485291749929066, 1.492246059793112, 1.4990388996477466, 1.50565226125847, 1.5120694250956281, 1.5182750119997548, 1.5242550241779986, 1.5299968756933937, 1.5354894127281442, 1.54072292397505, 1.5456891415415874, 1.550381232750083, 1.5547937831982452, 1.5589227714212728, 1.5627655354851586, 1.5663207318507086, 1.5695882868856108, 1.572569341468277, 1.575266189216396, 1.5776822089768516, 1.5798217923195803, 1.5816902668751966, 1.5832938164339683 ], [ 1.3311859427617045, 1.3339738290538397, 1.3371374114211076, 1.3406748536134883, 1.3445811561380312, 1.3488481813018551, 1.3534647800134738, 1.358417015578713, 1.363688465848683, 1.3692605733704666, 1.375113008492902, 1.3812240143899464, 1.3875707133497663, 1.3941293659311171, 1.4008755847423575, 1.4077845107634916, 1.4148309623974529, 1.4219895669465936, 1.4292348822747234, 1.436541514041817, 1.4438842316863971, 1.4512380845469344, 1.458578518217531, 1.4658814903802155, 1.4731235848606494, 1.4802821224280174, 1.4873352668241957, 1.4942621246002363, 1.5010428375107694, 1.5076586664328793, 1.5140920660099255, 1.5203267494503723, 1.5263477431254164, 1.5321414307944172, 1.537695587439753, 1.5429994028090954, 1.5480434948454467, 1.5528199132389284, 1.557322133367149, 1.5615450409134708, 1.5654849074757256, 1.56913935751057, 1.572507327008415, 1.5755890143622757, 1.578385823980274, 1.5809003032897966, 1.5831360738833822, 1.5850977576528162, 1.5867908988397348, 1.5882218829897923 ], [ 1.341197258299311, 1.3441352523152728, 1.3474334125721508, 1.3510890086536624, 1.3550963437996595, 1.3594468020465462, 1.3641289860395984, 1.369128937749876, 1.37443042310661, 1.3800152531321872, 1.3858636118368097, 1.3919543655853588, 1.398265337680548, 1.4047735419679375, 1.4114553774281553, 1.4182867906512586, 1.4252434149121527, 1.4323006941702003, 1.4394339987180118, 1.4466187372065338, 1.4538304678734366, 1.4610450102389074, 1.4682385573744017, 1.4753877880691357, 1.4824699777516974, 1.489463106795422, 1.4963459647800734, 1.5030982493427865, 1.5097006583861277, 1.516134974586986, 1.5223841413441463, 1.528432329496003, 1.5342649943223674, 1.539868922506644, 1.5452322688732307, 1.5503445828290843, 1.5551968245299013, 1.5597813708654416, 1.564092011421554, 1.5681239346360076, 1.571873704428466, 1.5753392276572435, 1.57851971284002, 1.5814156206718113, 1.5840286069785492, 1.5863614588516604, 1.5884180248114572, 1.5902031399361405, 1.5917225469623228, 1.5929828144061853 ], [ 1.3511822691965683, 1.3542639629293232, 1.357690243615023, 1.361457542508674, 1.365559518240558, 1.3699871224710622, 1.3747287453478607, 1.3797704309125192, 1.385096143763996, 1.3906880625286198, 1.3965268751385356, 1.4025920555784088, 1.408862109578494, 1.415314784931381, 1.4219272485669203, 1.4286762363648566, 1.4355381830887235, 1.4424893394867144, 1.4495058823016356, 1.4565640212829245, 1.4636401056966477, 1.4707107314882257, 1.477752849233714, 1.4847438723099766, 1.4916617842731352, 1.4984852442016119, 1.5051936886794999, 1.5117674291213072, 1.518187743233283, 1.5244369595413252, 1.530498534069533, 1.5363571184121554, 1.5419986185945525, 1.5474102442597117, 1.552580547843209, 1.5574994535114377, 1.562158275737775, 1.5665497274835138, 1.570667918039821, 1.5745083406785105, 1.5780678503575545, 1.581344631833623, 1.5843381586489156, 1.5870491435803014, 1.5894794812603728, 1.591632183795969, 1.593511310313334, 1.5951218914427692, 1.5964698498148708, 1.5975619176707716 ], [ 1.3611011008718892, 1.364319290548944, 1.3678665429652193, 1.371738515376286, 1.3759282803738344, 1.3804264060105176, 1.3852211054172658, 1.390298444881337, 1.395642592553757, 1.4012360862372473, 1.4070600993604847, 1.4130946888558598, 1.4193190153941342, 1.425711533110393, 1.43225015105152, 1.438912371539523, 1.4456754116919726, 1.4525163140329431, 1.4594120510633635, 1.466339627311142, 1.4732761810577788, 1.4801990868037986, 1.4870860586525287, 1.493915254158984, 1.5006653777771657, 1.5073157828003014, 1.5138465705828623, 1.5202386858222052, 1.5264740067307836, 1.5325354290231472, 1.5384069427575864, 1.5440737011966195, 1.5495220809762755, 1.5547397329950297, 1.5597156235486227, 1.5644400653470787, 1.5689047381572427, 1.573102698922218, 1.577028381320785, 1.5806775848489865, 1.5840474536337936, 1.5871364453239423, 1.5899442905443257, 1.5924719435420094, 1.5947215247883237, 1.5966962564258982, 1.5984003915547171, 1.5998391384316968, 1.6010185807099129, 1.6019455948636478 ], [ 1.3709163398857283, 1.374263151813676, 1.3779236493103124, 1.3818927846414018, 1.3861631054529275, 1.3907248453504995, 1.395566074481164, 1.4006728986862742, 1.4060296906761256, 1.4116193344386778, 1.4174234654573383, 1.4234226936694339, 1.4295968018638814, 1.4359249176858555, 1.4423856614688382, 1.4489572744135732, 1.455617732407723, 1.462344850495215, 1.4691163821297304, 1.4759101162459927, 1.4827039740919346, 1.489476106814216, 1.4962049940297146, 1.5028695430523433, 1.5094491880559482, 1.515923988210672, 1.522274723699314, 1.5284829884736877, 1.5345312786239407, 1.5404030752869797, 1.5460829210986624, 1.5515564892868747, 1.5568106446025438, 1.5618334953889446, 1.5666144361943781, 1.5711441804422182, 1.575414782784836, 1.5794196508896114, 1.5831535465356235, 1.58661257604176, 1.5897941701990286, 1.5926970540395025, 1.5953212069372111, 1.5976678136955922, 1.599739207425647, 1.6015388051503057, 1.6030710371783876, 1.6043412713697436, 1.6053557334593145, 1.6061214246202529 ], [ 1.380593278023684, 1.3840602937532125, 1.387825843404588, 1.3918842446688198, 1.3962275811179456, 1.4008457995933126, 1.4057268590913121, 1.4108569199140248, 1.416220558072836, 1.421800988713199, 1.4275802840233696, 1.4335395750481341, 1.4396592317269459, 1.4459190199797296, 1.4522982379351101, 1.458775835220305, 1.4653305198231759, 1.4719408567856518, 1.4785853622693588, 1.4852425956349784, 1.4918912512798768, 1.4985102511830266, 1.5050788384540643, 1.5115766716808792, 1.5179839195046156, 1.5242813546018357, 1.5304504460995778, 1.5364734493682977, 1.5423334921124714, 1.5480146556941625, 1.5535020506681796, 1.5587818855705786, 1.5638415280783664, 1.56866955774531, 1.5732558096143439, 1.5775914081136924, 1.581668790761701, 1.5854817213373673, 1.5890252923196568, 1.5922959165593757, 1.5952913083191058, 1.5980104539962134, 1.6004535730241731, 1.6026220696214253, 1.604518476216919, 1.6061463895195491, 1.6075104003086962, 1.6086160181005453, 1.6094695918872368, 1.610078228152852 ], [ 1.390100067622102, 1.3936784428909268, 1.3975404908478262, 1.4016799639101387, 1.4060885402788807, 1.4107559250509782, 1.415669995381939, 1.4208169790752976, 1.4261816532287888, 1.4317475490105136, 1.4374971504081906, 1.4434120782773276, 1.4494732551392515, 1.4556610499063958, 1.4619554044005996, 1.468335945026754, 1.4747820834526222, 1.4812731099458463, 1.4877882824389195, 1.494306913661164, 1.500808457938592, 1.5072725985965887, 1.5136793363378767, 1.5200090785175833, 1.5262427288904377, 1.5323617771504214, 1.5383483874067494, 1.5441854846275462, 1.5498568380221063, 1.555347140312777, 1.5606420818588171, 1.5657284186303149, 1.57059403308521, 1.5752279870740746, 1.5796205659848885, 1.5837633134441003, 1.587649056011931, 1.5912719174500038, 1.5946273222977743, 1.5977119886693187, 1.6005239103694773, 1.6030623286227668, 1.6053276939028045, 1.6073216185350618, 1.6090468209141007, 1.610507062319973, 1.6117070774306175, 1.6126524997045957, 1.613349782848406, 1.6138061195863398 ], [ 1.3994078006943804, 1.4030883749022345, 1.4070381028899304, 1.41125023825831, 1.4157161091860793, 1.4204252208089831, 1.4253653952536232, 1.430522939556411, 1.4358828297244342, 1.4414288990455082, 1.447144020439339, 1.453010275629823, 1.4590091073615392, 1.4651214539755018, 1.471327867904436, 1.4776086209203103, 1.4839437994111107, 1.4903133928353527, 1.4966973780513997, 1.5030758016318977, 1.5094288616693985, 1.5157369900200162, 1.5219809354443878, 1.5281418476966535, 1.5342013622803239, 1.5401416853285586, 1.5459456778691685, 1.5515969385929778, 1.5570798841513054, 1.5623798259562582, 1.567483042439557, 1.5723768457368352, 1.5770496417995248, 1.5814909829947075, 1.5856916123327691, 1.5896434985642531, 1.5933398615109087, 1.596775187142415, 1.5999452320773644, 1.602847017373054, 1.6054788116674898, 1.6078401039428583, 1.6099315663838059, 1.6117550079976055, 1.6133133198377174, 1.6146104128199155, 1.615651149234424, 1.616441269135322, 1.6169873128273515, 1.6172965406722546 ], [ 1.408490526097039, 1.4122639209835193, 1.4162923331504398, 1.4205685799665215, 1.425083691021817, 1.4298270099237282, 1.434786328339074, 1.4399480434802947, 1.4452973288258182, 1.4508183079423311, 1.4564942227924775, 1.4623075904228626, 1.4682403447773678, 1.4742739629492323, 1.4803895770825732, 1.4865680742501401, 1.4927901870715699, 1.4990365777910737, 1.5052879182069365, 1.51152496738838, 1.5177286486271764, 1.523880126602897, 1.529960885315286, 1.5359528069636708, 1.5418382516323463, 1.5476001373731374, 1.5532220200597444, 1.558688172220388, 1.5639836599333825, 1.5690944167889231, 1.5740073138765742, 1.5787102247461893, 1.583192084308319, 1.5874429406854336, 1.5914539990972778, 1.5952176569622294, 1.5987275295207595, 1.6019784654373481, 1.6049665520104792, 1.6076891098135264, 1.6101446767959837, 1.6123329820879977, 1.6142549099619115, 1.615912454603801, 1.617308666526827, 1.6184475916084478, 1.6193342038497727, 1.619974333033582, 1.6203745884964456, 1.6205422802318972 ], [ 1.4173252185280956, 1.4211819260658385, 1.4252799265190659, 1.4296116592591734, 1.4341679026937422, 1.438937874164431, 1.443909357568056, 1.449068850888504, 1.4544017248213403, 1.4598923838621203, 1.465524422539808, 1.471280771554011, 1.4771438309164315, 1.4830955893295161, 1.4891177306512313, 1.4951917292951122, 1.501298936863682, 1.5074206623558546, 1.5135382480807484, 1.519633143073577, 1.5256869754244076, 1.5316816245414937, 1.5375992939992922, 1.5434225852769312, 1.5491345723814947, 1.554718877076229, 1.5601597442001016, 1.5654421163740917, 1.5705517072413848, 1.5754750722820683, 1.5801996761754409, 1.584713955651412, 1.5890073767749375, 1.5930704856411382, 1.596894951523454, 1.6004736016117918, 1.6038004466013767, 1.6068706965449424, 1.609680766557342, 1.6122282721590946, 1.6145120142565668, 1.6165319539740761, 1.6182891777677586, 1.6197858534533418, 1.6210251779610492, 1.6220113177826567, 1.622749343193301, 1.6232451574092455, 1.623505421882908, 1.6235374789380403 ], [ 1.4258917114512766, 1.4298221717397286, 1.4339806336813317, 1.438359212448717, 1.442948478815, 1.4477375562779948, 1.4527142421537578, 1.4578651457772132, 1.463175836222829, 1.4686309921865677, 1.4742145477700057, 1.4799098296039275, 1.485699682660781, 1.491566583873448, 1.49749274406089, 1.5034601995680805, 1.5094508954936963, 1.5154467625047818, 1.5214297891394433, 1.527382091271782, 1.5332859801222063, 1.5391240298790072, 1.5448791456735231, 1.5505346323335072, 1.5560742640370435, 1.5614823547101129, 1.5667438287632647, 1.5718442915518076, 1.5767700987736997, 1.5815084238900756, 1.586047322565577, 1.5903757930761064, 1.5944838316198346, 1.5983624814903266, 1.6020038751278483, 1.605401268155218, 1.6085490646263612, 1.6114428328670762, 1.6140793114651601, 1.616456405165327, 1.6185731706374384, 1.620429792305155, 1.622027548637771, 1.6233687695110248, 1.62445678542409, 1.6252958695124677, 1.6258911734141879, 1.6262486581265283, 1.626375021031278, 1.6262776202698142 ], [ 1.434172603828972, 1.4381672740960798, 1.4423771016412346, 1.4467939269603138, 1.451408153197333, 1.456208839961601, 1.4611838180099994, 1.4663198188072486, 1.4716026124470203, 1.477017147639691, 1.482547688375273, 1.4881779432410185, 1.4938911849259164, 1.4996703589088363, 1.5054981815129524, 1.5113572283361245, 1.5172300145464876, 1.5230990687313355, 1.5289470019871285, 1.5347565738105395, 1.5405107561447418, 1.5461927966834395, 1.5517862822567219, 1.5572752028305938, 1.562644016360215, 1.5678777144554117, 1.5729618885589058, 1.5778827961106165, 1.5826274259828312, 1.5871835623229085, 1.5915398458343506, 1.5956858314623747, 1.5996120414250288, 1.6033100125439739, 1.606772336879114, 1.6099926947560301, 1.6129658793939499, 1.6156878124910214, 1.6181555502997713, 1.6203672799229398, 1.6223223057715028, 1.6240210263441346, 1.6254649017015907, 1.6266564122110514, 1.6275990093159205, 1.6282970592381463, 1.6287557806378739, 1.6289811773355556, 1.6289799672438372, 1.6287595086618498 ], [ 1.442153148335229, 1.4462025641756988, 1.4504547478506853, 1.4549013107164717, 1.4595325251170297, 1.4643374146140904, 1.4693038625151915, 1.474418733497411, 1.4796680027260962, 1.4850368870632618, 1.490509973687914, 1.4960713425483168, 1.501704680322702, 1.5073933847764043, 1.5131206594214874, 1.5188695991394987, 1.524623267914096, 1.5303647700780476, 1.536077316562202, 1.5417442875924645, 1.5473492931517532, 1.5528762323322989, 1.5583093524680938, 1.5636333086713472, 1.5688332241172258, 1.573894751141444, 1.5788041329505789, 1.583548265506538, 1.5881147589434572, 1.5924919977116974, 1.5966691985231258, 1.600636465093299, 1.6043848386396653, 1.6079063430986051, 1.611194024066394, 1.6142419805486472, 1.6170453887164928, 1.6196005170132337, 1.6219047321277917, 1.6239564955450585, 1.6257553505914444, 1.627301900107778, 1.6285977750923986, 1.6296455948558113, 1.6304489194057763, 1.6310121949319658, 1.6313406933758767, 1.6314404471526245, 1.631318180134669, 1.6309812360154943 ], [ 1.44982112678878, 1.453915956624791, 1.458201623341274, 1.462669551050794, 1.4673099153065725, 1.4721117296439061, 1.4770629482901692, 1.482150580530812, 1.487360811908661, 1.4926791275924327, 1.4980904338264123, 1.503579174246688, 1.5091294388627288, 1.5147250645049462, 1.520349726413786, 1.5259870213325841, 1.5316205429510008, 1.537233950847044, 1.542811034226046, 1.5483357717865873, 1.553792388980589, 1.5591654137989166, 1.5644397320180181, 1.5696006426053555, 1.5746339137162984, 1.579525839441491, 1.5842632971970674, 1.5888338054048532, 1.593225580895862, 1.5974275952956474, 1.601429629516827, 1.6052223253944433, 1.6087972334529281, 1.6121468557882985, 1.6152646830839432, 1.6181452248513244, 1.6207840320950635, 1.6231777117419353, 1.6253239323406192, 1.6272214207275892, 1.6288699495570491, 1.6302703158013945, 1.631424310533884, 1.632334680499084, 1.6330050821502988, 1.6334400289805722, 1.6336448330891327, 1.633625542006007, 1.6333888718424028, 1.6329421378450062 ] ], "zauto": true, "zmax": 1.6336448330891327, "zmin": -1.6336448330891327 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.10306047751671396, 0.10218510930330282, 0.10142979570450326, 0.10078908978511786, 0.10025556459772685, 0.09981992757732432, 0.09947119450257375, 0.09919691594769227, 0.09898344670476714, 0.09881624724801437, 0.098680205979605, 0.09855997162841815, 0.0984402865448372, 0.09830631346830057, 0.09814395035921114, 0.09794012984078154, 0.09768310150529322, 0.09736269668259445, 0.09697057617840636, 0.09650046193620501, 0.09594835354760708, 0.09531273002333635, 0.09459473622155606, 0.09379835177945244, 0.09293053826183482, 0.09200135748478423, 0.09102405058264318, 0.09001506343679992, 0.08899399980780237, 0.08798347940012104, 0.0870088749986637, 0.08609790204557655, 0.08528003728095962, 0.08458575222288488, 0.08404556378929531, 0.08368892847182281, 0.08354303607460406, 0.08363158909337993, 0.08397367670707309, 0.08458285975936951, 0.08546656915507209, 0.08662588454161593, 0.08805570968966872, 0.08974530753418714, 0.09167911421348399, 0.09383772669424377, 0.0961989552392763, 0.09873884641750293, 0.10143260733885548, 0.10425538966604063 ], [ 0.10016028299942106, 0.0992696693820354, 0.09850646908676984, 0.09786518648402873, 0.09733819970824342, 0.09691587812548258, 0.09658676591560358, 0.09633782380067185, 0.09615471805652247, 0.09602214429102673, 0.09592417311337481, 0.09584460561266346, 0.09576732823290764, 0.09567665883138933, 0.09555767809748858, 0.09539654280125402, 0.09518077932448865, 0.09489955747107318, 0.09454394559307627, 0.0941071485851282, 0.0935847302919161, 0.09297482134364034, 0.09227831236740613, 0.09149903088201176, 0.09064389791165248, 0.08972305738604915, 0.08874996769079681, 0.087741440333126, 0.08671760580287538, 0.08570178182918277, 0.08472021527474843, 0.08380166731813303, 0.08297681432825876, 0.08227744619713764, 0.08173546178515158, 0.08138168806142901, 0.08124458331733185, 0.08134891972196379, 0.0817145674353317, 0.08235551144940022, 0.08327921616365498, 0.0844864111886589, 0.08597131328830918, 0.08772223821282116, 0.08972250768004683, 0.09195153113739454, 0.0943859412868686, 0.09700068149519152, 0.09976997314017805, 0.1026681227297171 ], [ 0.09729179788193874, 0.09638580284797711, 0.09561470955541425, 0.09497301016019508, 0.09445291862205664, 0.094044490174955, 0.09373581419838758, 0.09351327159137617, 0.09336184430989751, 0.09326546276914874, 0.09320737640561275, 0.09317053366739121, 0.09313795970983263, 0.09309312269374946, 0.09302028240183051, 0.09290481756261623, 0.09273353055885145, 0.09249492995774854, 0.09217949247574785, 0.09177990657376424, 0.09129129988742876, 0.09071145214423024, 0.09004099409849015, 0.08928359128685119, 0.08844610900225369, 0.08753875171642359, 0.08657516617895274, 0.08557249258975418, 0.08455134275793504, 0.08353567851034524, 0.08255255876005488, 0.08163172117961347, 0.0808049666003706, 0.08010532375485166, 0.07956599119207321, 0.07921908299483704, 0.07909424307450462, 0.07921723276316424, 0.07960862758802498, 0.08028276957092541, 0.08124710267417143, 0.08250197098177786, 0.08404089198350596, 0.08585124829179375, 0.08791528805483813, 0.09021129847612527, 0.09271481959195041, 0.09539978978857283, 0.09823954956581217, 0.10120766560061749 ], [ 0.0944638748818764, 0.09354224164275851, 0.09276308622951053, 0.09212093077796382, 0.09160786213271085, 0.09121365182197018, 0.09092595752481697, 0.09073059619703923, 0.09061187491675791, 0.09055296316576512, 0.09053628977693652, 0.09054394894382445, 0.09055810208121877, 0.09056136542570878, 0.09053717657105173, 0.09047013623722705, 0.09034632419686871, 0.09015359027814975, 0.08988182267869413, 0.08952319647300823, 0.08907240521329969, 0.08852687794096675, 0.08788698274570723, 0.0871562161926814, 0.08634137540571939, 0.08545270623827077, 0.08450401668102801, 0.08351273941259806, 0.08249992133913116, 0.08149011156376057, 0.08051111348059248, 0.07959356332865199, 0.078770299098921, 0.07807549326504597, 0.07754354330873249, 0.07720774668952869, 0.07709882947258716, 0.07724344291281479, 0.0776627776896728, 0.0783714572783682, 0.07937685028439534, 0.08067888655776428, 0.08227038575712926, 0.08413783022866582, 0.0862624569574812, 0.0886215180149764, 0.09118956570713409, 0.0939396484725193, 0.09684434364975908, 0.09987659222869495 ], [ 0.09168519772601096, 0.09074753229341076, 0.08995996303148396, 0.08931709057193725, 0.0888109187914594, 0.08843097326061983, 0.08816451014887919, 0.08799680485778263, 0.08791150474029323, 0.08789102742792378, 0.08791698567295618, 0.08797062097561041, 0.08803323108744023, 0.08808658012750462, 0.08811328390809435, 0.08809716665721797, 0.08802358832622625, 0.08787974392210332, 0.08765493776652777, 0.08734083629293511, 0.08693170301047869, 0.08642461864143626, 0.08581968819117315, 0.08512023480126898, 0.08433297757866692, 0.08346818705844763, 0.08253980741166686, 0.08156552888098258, 0.08056678732059629, 0.07956866058984532, 0.07859962493942325, 0.07769113029333294, 0.07687695426834196, 0.07619230441366984, 0.07567265991185726, 0.07535237950822754, 0.07526314937971962, 0.07543239480321476, 0.07588181893734856, 0.07662624484794064, 0.07767291191570376, 0.07902131546664198, 0.08066359339543461, 0.08258537940874425, 0.08476698212434441, 0.08718472523930815, 0.0898122953278742, 0.09262197929363769, 0.09558571835481959, 0.09867594742651382 ], [ 0.08896410291292592, 0.08800985688842553, 0.08721332021741504, 0.08656922751299183, 0.08606955172465416, 0.08570361838186392, 0.08545832019645784, 0.0853184205098155, 0.08526692816835378, 0.08528552294479469, 0.0853550098048437, 0.08545578186971677, 0.08556827521802571, 0.08567340293190033, 0.08575296028367818, 0.08578999710229972, 0.08576915678289954, 0.08567698393667751, 0.08550220429712148, 0.08523598126624711, 0.08487215349296284, 0.08440745720182284, 0.08384173566504337, 0.08317813620329126, 0.08242329231634485, 0.08158748483699282, 0.08068477120784119, 0.07973306599255432, 0.0787541486196326, 0.077773566556374, 0.07682039469197079, 0.07592680665162561, 0.07512741412809537, 0.07445834004285973, 0.07395601434906332, 0.07365571959145413, 0.07358996451241272, 0.07378681895162442, 0.0742683864248693, 0.07504960415866774, 0.07613753164708523, 0.07753121909759521, 0.07922215346786184, 0.08119518907181403, 0.0834298070030509, 0.08590152569016103, 0.08858330115633659, 0.09144679650407861, 0.09446344931690767, 0.09760531007684486 ], [ 0.08630838712404883, 0.085336839590599, 0.08453056177663373, 0.08388448541326844, 0.08339061327215465, 0.08303812574643146, 0.08281359869925599, 0.08270132047801872, 0.08268368888028003, 0.08274166457859669, 0.08285525638061993, 0.08300401541194075, 0.08316751911277026, 0.08332583089525246, 0.083459926520578, 0.08355208302985266, 0.08358622996877343, 0.08354826549671564, 0.08342634176009059, 0.08321112473468477, 0.08289603373091059, 0.08247746501638381, 0.08195500259326033, 0.08133161705053336, 0.08061385049518523, 0.07981198168838637, 0.07894016048484537, 0.07801649435289819, 0.07706306217578339, 0.07610582212344301, 0.07517437223733944, 0.07430151658470822, 0.07352258971878439, 0.07287450205501675, 0.07239449301449555, 0.07211861975626763, 0.0720800644615133, 0.07230740246180434, 0.07282301975105297, 0.0736418818133242, 0.07477082292476459, 0.07620844810707135, 0.0779456383235698, 0.07996655326750456, 0.08224996209659792, 0.08477071331974576, 0.0875011763329127, 0.090412533154368, 0.0934758517579784, 0.09666291859221697 ], [ 0.08372510833934796, 0.08273534673049265, 0.08191831672465755, 0.08126921866611676, 0.08078015540034703, 0.08044022681866214, 0.08023574765426203, 0.08015057615696214, 0.080166532678527, 0.08026388186806811, 0.08042185057638333, 0.08061915538442914, 0.08083451801768551, 0.08104715264600354, 0.0812372151089046, 0.08138620961206858, 0.08147735290300492, 0.08149589914737357, 0.08142943070703293, 0.0812681209042047, 0.08100497481516328, 0.0806360533154065, 0.08016068407193046, 0.07958166093618359, 0.07890543013299656, 0.07814225759135093, 0.07730636651020573, 0.07641602762550609, 0.07549357665104788, 0.07456532441726697, 0.07366131645863046, 0.07281489241014469, 0.07206199510004688, 0.07144018934781284, 0.07098737597203977, 0.07074023000234102, 0.07073245082354469, 0.07099297506774083, 0.07154435167204436, 0.07240149124864843, 0.0735709648119787, 0.07505094302100468, 0.07683175859126422, 0.07889697408255629, 0.08122477313611369, 0.08378947742725175, 0.08656301780718474, 0.08951623866516391, 0.0926199703010257, 0.09584585140437495 ], [ 0.08122039195790888, 0.08021129179680068, 0.07938224556076834, 0.07872880278694516, 0.07824324688709153, 0.07791467222075743, 0.07772919755348337, 0.07767030372541468, 0.07771927293895699, 0.07785570037215273, 0.07805804653460457, 0.07830420061255158, 0.07857202996328898, 0.07883989754021169, 0.07908713602997262, 0.07929447384520905, 0.07944441323151198, 0.07952156438441663, 0.07951294167048897, 0.07940822899179235, 0.07920002124985995, 0.07888404794183239, 0.0784593832636963, 0.07792864470845325, 0.0772981789319804, 0.07657822943170557, 0.07578307511218564, 0.07493112190248886, 0.0740449212298506, 0.07315107975011152, 0.07228001545420583, 0.07146550842788853, 0.07074399387963441, 0.07015355555310553, 0.0697326044095466, 0.06951827328438184, 0.06954462006972634, 0.06984079805403463, 0.07042940211093379, 0.07132521078576068, 0.0725345027533579, 0.07405503596376192, 0.075876663662105, 0.07798245829254964, 0.08035015112908189, 0.08295368337832448, 0.08576469527293491, 0.08875383395892754, 0.09189181880942712, 0.09515025057337344 ], [ 0.07879925645823094, 0.07776945991916713, 0.07692686641555954, 0.07626746508208616, 0.0757838112817235, 0.07546507956211176, 0.07529726736678394, 0.07526353818374827, 0.07534468015778012, 0.07551964770906348, 0.0757661504205983, 0.07606125516059344, 0.07638197290166697, 0.07670580932371983, 0.07701126641426047, 0.07727828965957573, 0.077488661314298, 0.07762634437763331, 0.07767778435888131, 0.07763217692735373, 0.07748170940145727, 0.07722178298099266, 0.07685122080943861, 0.07637246439480233, 0.07579175752548109, 0.07511931240075218, 0.07436944700896819, 0.07356067561809183, 0.07271572556726076, 0.07186144377712018, 0.07102854674016822, 0.07025116063062412, 0.06956609751128592, 0.06901182464449737, 0.06862711197160884, 0.06844939073776284, 0.06851292062562746, 0.06884693094650618, 0.06947395197032015, 0.07040856176610798, 0.07165672788447411, 0.07321582766721269, 0.07507531272010175, 0.07721787873284185, 0.07962094062733942, 0.08225820478748648, 0.08510116490602469, 0.088120405098672, 0.09128665297683902, 0.09457157302175778 ], [ 0.0764654759003625, 0.07541336926838929, 0.07455541822417595, 0.07388815248530237, 0.07340450218573026, 0.07309381870909575, 0.07294206199037664, 0.07293214471697958, 0.07304440844865968, 0.073257195875427, 0.07354747875552874, 0.07389150245460714, 0.07426541409104909, 0.07464585007290288, 0.07501046828078005, 0.0753384187591676, 0.07561075361552791, 0.07581078157388652, 0.07592437538670438, 0.07594024139364589, 0.07585016029759406, 0.07564920701693818, 0.0753359554601993, 0.07491267130659165, 0.07438549228097557, 0.07376459079053141, 0.07306430788864521, 0.07230324012606665, 0.07150425191100473, 0.07069437595622528, 0.06990455450114737, 0.06916916678148571, 0.06852528775858575, 0.06801163483094132, 0.06766718859252432, 0.0675295234218389, 0.06763294995708923, 0.068006640834077, 0.06867296105312042, 0.06964623094454801, 0.07093209938343292, 0.07252760506186225, 0.07442188289988742, 0.07659736867800879, 0.07903129656992594, 0.08169727984137162, 0.08456680305339731, 0.0876105130947387, 0.09079925579325515, 0.09410485186650273 ], [ 0.07422149829636573, 0.07314518860353626, 0.07226978006205782, 0.07159245531738993, 0.0711066339558559, 0.07080195169513326, 0.0706644232399339, 0.07067678215478315, 0.07081897230119331, 0.07106875157932738, 0.07140236210061007, 0.07179522170037678, 0.07222259837345575, 0.07266023934874476, 0.07308493761377041, 0.07347502881262474, 0.07381081943216879, 0.07407495267410266, 0.07425272152503322, 0.07433233969441885, 0.07430518076278309, 0.0741659944656626, 0.07391310678297394, 0.07354860749524186, 0.07307852503826014, 0.07251298364356572, 0.07186633163391992, 0.07115722212337311, 0.07040861822653759, 0.06964768466423178, 0.06890551767742381, 0.0682166580436907, 0.06761833193392326, 0.06714937687869178, 0.06684884070461634, 0.06675429248544146, 0.06689995198965937, 0.06731481355680753, 0.06802098879776279, 0.06903249593773349, 0.07035466940071215, 0.07198426035407145, 0.07391017741196418, 0.07611471447152353, 0.07857505767879056, 0.08126486267028805, 0.08415573376892166, 0.08721849670780704, 0.09042421550490813, 0.09374495005392797 ], [ 0.0720684389351872, 0.07096573035099049, 0.07007046595965728, 0.0693806058550466, 0.06889018594734599, 0.06858924431842416, 0.06846395010862166, 0.06849693271531308, 0.06866778609929229, 0.06895370529355009, 0.06933020295128185, 0.06977185359723698, 0.07025302051594537, 0.0707485319625913, 0.07123428648137949, 0.07168777909466742, 0.07208854954192268, 0.0724185601223353, 0.0726625142247818, 0.07280812784906225, 0.07284636593746364, 0.07277165365082887, 0.07258207016395929, 0.07227952924974304, 0.07186994681923341, 0.07136339049672419, 0.07077419997337843, 0.07012105907447173, 0.06942699118358943, 0.06871923937909684, 0.06802898272948658, 0.06739083336444554, 0.06684205947711251, 0.06642149287954709, 0.06616811149147324, 0.06611933939244037, 0.06630917490627707, 0.06676632576423555, 0.06751257643660241, 0.06856161264329225, 0.0699184704992251, 0.07157967320034302, 0.0735339974886705, 0.07576371292682153, 0.07824608586607927, 0.08095494228064513, 0.08386212574477125, 0.08693874671063594, 0.09015617724929599, 0.0934867899595614 ], [ 0.07000616558687871, 0.06887453654801538, 0.06795671252384136, 0.06725156862178872, 0.06675389641083261, 0.06645426440330378, 0.06633910184943384, 0.06639100996215344, 0.0665892765526335, 0.06691054732527452, 0.06732959426012908, 0.06782011992147086, 0.06835554442018082, 0.06890973549714091, 0.06945765780522925, 0.0699759317836635, 0.07044330369695265, 0.07084103586053551, 0.07115323007367297, 0.07136709853115782, 0.07147319576915237, 0.07146562316221519, 0.07134221454730656, 0.07110470788596135, 0.07075890345842359, 0.0703148037297036, 0.0697867234762826, 0.06919335079463415, 0.06855773023934793, 0.06790712908792272, 0.06727273803919064, 0.06668915129271695, 0.06619357225938806, 0.06582470562790657, 0.06562132929915089, 0.06562059256081962, 0.06585615432740262, 0.0663563420209213, 0.06714255453580492, 0.06822812902348206, 0.0696178310801069, 0.07130802311891377, 0.07328744742800897, 0.07553846524563487, 0.07803854605124544, 0.08076180614594437, 0.08368043837072649, 0.08676593382943316, 0.08999005287697107, 0.09332554553139225 ], [ 0.06803348777798734, 0.06687007036650956, 0.06592667219220316, 0.0652032349161432, 0.06469545784894283, 0.06439457747228651, 0.06428739328678224, 0.06435655283070985, 0.06458107422127142, 0.06493705535438034, 0.06539850133062211, 0.06593819808849384, 0.06652856880032239, 0.06714246582841975, 0.06775386984215044, 0.06833848496122828, 0.0688742321483331, 0.06934165180233387, 0.06972423100607841, 0.07000867209772996, 0.07018511817578381, 0.07024734864085527, 0.07019295445541751, 0.0700234987053839, 0.06974466326838193, 0.06936637675365268, 0.06890291211818328, 0.06837293427360977, 0.06779946861539857, 0.06720975130443388, 0.06663491280929702, 0.06610944049594993, 0.06567036825576734, 0.06535615666746783, 0.06520526080458425, 0.06525443576587926, 0.065536896284963, 0.06608051082978826, 0.06690624971201625, 0.06802709946941887, 0.06944759391237947, 0.07116400857992176, 0.07316515082542889, 0.07543358740463939, 0.07794710829859192, 0.08068023232614677, 0.08360560267390697, 0.08669517787213828, 0.08992117806521012, 0.09325678751112126 ], [ 0.06614845500848658, 0.06495001872942391, 0.06397771791594693, 0.06323272727236563, 0.0627118190530069, 0.06240704424177972, 0.062305685695512064, 0.06239050779952548, 0.06264028484304811, 0.06303055276412478, 0.06353450507492552, 0.06412394747554596, 0.06477023506584509, 0.0654451355351532, 0.06612158461835452, 0.06677432110337686, 0.06738040471267372, 0.0679196303995434, 0.0683748576049819, 0.06873227407951377, 0.06898161231216868, 0.06911633348015221, 0.06913378980886874, 0.0690353716181455, 0.06882664014179578, 0.06851744126572523, 0.06812198837472441, 0.0676588943311486, 0.0671511232958291, 0.06662582326503082, 0.06611399138779471, 0.06564991919183089, 0.06527036804896832, 0.06501344170988324, 0.06491715691955259, 0.06501776565263274, 0.06534794685154631, 0.06593504615684988, 0.06679957708015269, 0.06795418653906118, 0.06940322505644461, 0.07114296078026294, 0.07316236687636019, 0.07544432686355049, 0.07796706312920126, 0.08070560194946645, 0.08363312989655379, 0.08672215164738832, 0.0899454110872435, 0.09327657677048967 ], [ 0.06434875926748564, 0.06311170213250576, 0.06210685589554812, 0.061336810694682074, 0.06079959056823826, 0.06048821630873589, 0.06039056899792267, 0.060489594178841505, 0.06076383458139355, 0.06118823103708356, 0.06173509915406129, 0.06237517942440779, 0.0630786689320119, 0.06381616654668036, 0.06455949172125078, 0.0652823627290813, 0.06596093948151771, 0.06657424797131656, 0.06710450882874382, 0.0675373931829981, 0.06786222673143068, 0.06807215897302937, 0.06816430979233214, 0.06813990035796447, 0.06800436965566456, 0.06776747172390161, 0.06744334153528475, 0.06705050927949945, 0.06661183364895763, 0.0661543152740254, 0.0657087432922384, 0.06530912400631507, 0.0649918448386885, 0.06479454418617063, 0.0647546922052803, 0.06490793908452161, 0.06528634905976331, 0.06591669497893625, 0.06681901884249986, 0.06800565038593176, 0.06948081342938407, 0.07124085230173696, 0.07327500690721812, 0.07556658570750414, 0.07809435006216407, 0.08083393203696723, 0.0837591476028552, 0.08684311946639231, 0.09005917292813889, 0.09338150535709971 ], [ 0.06263222630018378, 0.0613525769756029, 0.06031123245373615, 0.059512397373221664, 0.05895554070879397, 0.058634817340779036, 0.058538822588639815, 0.05865073969086311, 0.05894887618167755, 0.05940752305647875, 0.05999802781438724, 0.06068995790093856, 0.0614522431286766, 0.062254215038566145, 0.06306649632831383, 0.06386172515507749, 0.06461512234659955, 0.06530492330071826, 0.06591270206307014, 0.06642361512844382, 0.06682658919139073, 0.06711447206645466, 0.06728416031656975, 0.06733671120320665, 0.06727744043337192, 0.06711600062080238, 0.06686642812221474, 0.06654713776965232, 0.06618083611915475, 0.06579431488050477, 0.06541807879814632, 0.065085759220251, 0.06483326989789255, 0.06469767969394703, 0.06471581118751207, 0.06492262412133004, 0.06534950106762719, 0.06602260473129021, 0.06696150258660545, 0.0681782389282674, 0.0696769733643433, 0.07145421216110175, 0.07349956169000683, 0.07579685975405157, 0.07832550785789505, 0.08106183608890608, 0.08398036971535262, 0.08705491567047219, 0.0902594333107752, 0.09356868902291816 ], [ 0.06099736887140634, 0.059670804557208294, 0.05858871025684765, 0.0577571211710249, 0.05717715940785851, 0.056844287908716054, 0.056747933632334546, 0.056871565788504164, 0.057193236058204186, 0.05768650797720573, 0.05832164588211811, 0.05906691329191088, 0.059889844960792124, 0.0607583938539419, 0.061641898495069826, 0.06251185529081053, 0.06334250829654572, 0.06411128453127209, 0.06479910861902043, 0.06539062951414325, 0.06587438733049897, 0.06624294194291312, 0.0664929782564013, 0.06662539632036002, 0.06664538780632101, 0.06656249352437899, 0.06639062931845559, 0.06614805966820776, 0.06585728977909346, 0.06554483859743297, 0.06524084866252067, 0.06497848672548875, 0.06479309537398645, 0.06472107457417536, 0.0647985058334088, 0.06505957955057837, 0.06553494075378206, 0.06625011567959388, 0.06722420374759754, 0.06846900226765044, 0.06998867240020269, 0.0717799679548054, 0.0738329585238121, 0.07613211077947579, 0.07865756175396038, 0.08138642588766569, 0.08429401218083934, 0.08735487324781933, 0.09054365120190729, 0.09383571846691477 ], [ 0.05944396494445797, 0.058065850531525534, 0.05693847896979797, 0.056069948486301445, 0.05546325809408986, 0.05511536369064006, 0.055016644004267146, 0.05515089524926751, 0.055495876217381966, 0.05602432304298007, 0.05670527795790122, 0.05750554830106535, 0.05839112987190865, 0.0593284760314885, 0.06028554989271641, 0.06123264537914235, 0.062142996138307864, 0.06299320873817175, 0.06376356170694897, 0.06443820930597134, 0.06500532229310106, 0.06545718991164949, 0.06579029929244294, 0.0660054008677396, 0.06610756121101137, 0.06610619762636775, 0.06601508146730409, 0.06585228936909661, 0.06564007349015095, 0.0654046142260208, 0.0651756132835127, 0.06498568408651215, 0.06486950370431235, 0.06486270945396823, 0.0650005562062974, 0.06531639571198411, 0.06584008970354517, 0.0665965108780837, 0.06760430408811506, 0.06887506193320657, 0.07041301319737545, 0.07221524199544867, 0.07427237275852373, 0.0765695941932333, 0.07908786764277659, 0.0818051721335077, 0.08469766965760243, 0.08774071586018259, 0.09090968122864442, 0.0941805790255771 ], [ 0.05797361530671071, 0.05653907004784457, 0.05536165694320841, 0.05445178394597302, 0.05381456615941188, 0.053448649789487004, 0.05334549076358604, 0.05348924905393737, 0.05385734019282198, 0.05442155384326335, 0.05514955086414181, 0.05600651283879739, 0.05695674101039284, 0.057965062740405755, 0.058997974695199684, 0.06002451178164696, 0.06101687005789186, 0.061950830764246324, 0.06280603648401017, 0.06356616538676746, 0.06421904042124692, 0.06475670028422947, 0.06517544949740295, 0.06547589641068353, 0.06566298025863215, 0.0657459811201046, 0.0657384993615031, 0.06565838366231858, 0.0655275791892897, 0.0653718606548551, 0.0652204104178659, 0.06510520191258316, 0.06506015668525275, 0.06512006229651993, 0.06531926993087564, 0.06569023286593567, 0.06626199294071913, 0.06705875964353655, 0.06809874118449771, 0.06939336852349769, 0.07094700132523804, 0.07275713103335772, 0.07481502097325582, 0.07710666686291283, 0.07961393534843575, 0.08231574357166274, 0.08518917049480285, 0.08821042831993314, 0.09135565900199182, 0.09460154996503155 ], [ 0.05659022949736176, 0.05509422763640072, 0.05386183420228077, 0.05290602318024507, 0.052234278743970866, 0.0518471486112112, 0.05173730042065033, 0.051889295687475884, 0.05228014913056731, 0.05288057236872516, 0.053656672209840446, 0.054571824558933876, 0.0555884754501018, 0.056669700360400276, 0.05778044339396282, 0.05888843146412686, 0.05996480430955732, 0.060984520959745735, 0.06192660487674961, 0.0627742816655816, 0.06351505108808785, 0.06414072270907804, 0.06464743341524251, 0.0650356555885927, 0.06531019656444936, 0.06548018262197507, 0.06555901365495484, 0.0655642676008043, 0.06551752682110497, 0.06544409266466156, 0.06537255088440083, 0.06533415169105865, 0.06536197682731126, 0.06548988476700143, 0.06575125509206613, 0.06617759213753804, 0.06679708941150228, 0.06763328908313196, 0.06870398255515911, 0.07002048007497118, 0.07158732958596424, 0.07340249827205912, 0.07545796234792927, 0.0777405993269996, 0.0802332528894877, 0.08291584417095502, 0.0857664273215068, 0.08876212072138877, 0.09187987859684156, 0.09509709484564331 ], [ 0.055300386400282384, 0.0537378974812005, 0.052445502973597236, 0.05143900065513761, 0.05072850641011072, 0.050316695019986486, 0.05019759419056007, 0.050356213773533026, 0.050769112912802825, 0.05140579202970611, 0.052230628808207946, 0.053205013559564134, 0.05428938042305986, 0.055444934786017835, 0.056634992062987666, 0.05782593275825669, 0.05898783121913837, 0.0600948351760174, 0.06112537128440349, 0.06206223925800068, 0.06289264130794617, 0.06360817851001004, 0.06420483293481728, 0.06468294398920682, 0.06504717888076106, 0.06530648972730117, 0.06547404300338457, 0.06556710045216278, 0.06560682443043918, 0.06561797560386164, 0.0656284683546794, 0.06566875126698464, 0.06577098907612232, 0.06596804066819467, 0.06629225574964981, 0.06677414838417359, 0.06744104246067872, 0.06831581252834766, 0.06941585261312587, 0.07075238839203832, 0.07233020490249593, 0.07414780226746696, 0.07619793119258854, 0.07846841360059446, 0.08094313109710033, 0.0836030658680676, 0.08642729893512617, 0.08939390016402687, 0.092480674476919, 0.09566575372181964 ], [ 0.054113516915844845, 0.05247968922778114, 0.051122320258022234, 0.05006027804166754, 0.04930657454614249, 0.04886625004356137, 0.04873485971096033, 0.048897928298381466, 0.04933152181193823, 0.05000381072470617, 0.05087728183953624, 0.051911173943241594, 0.0530637678184618, 0.05429429630918478, 0.05556438492076599, 0.05683904206794646, 0.05808727733163073, 0.059282444407531575, 0.06040239861611678, 0.06142954084442818, 0.06235079957407243, 0.06315758459751379, 0.06384573148533015, 0.06441544460695536, 0.06487123768499498, 0.0652218635716302, 0.06548021847594793, 0.065663199896558, 0.0657914921341931, 0.065889249135266, 0.06598364282442086, 0.06610424785900505, 0.06628224298828563, 0.0665494266424926, 0.06693707029292108, 0.06747466516842038, 0.06818865037245811, 0.06910123476268784, 0.07022943205219648, 0.07158441255174804, 0.07317123644663923, 0.07498898069625627, 0.07703121777665695, 0.0792867627358081, 0.0817405836600714, 0.08437477078365004, 0.08716947619232625, 0.09010376156487661, 0.09315631818386828, 0.09630604636977105 ], [ 0.05304186135570601, 0.0513322474933462, 0.04990514798773527, 0.048782718178920485, 0.047981119221578494, 0.04750800340044615, 0.047360644541920946, 0.0475251818802689, 0.047977186982090934, 0.048683417455265096, 0.049604341395981244, 0.05069691158816314, 0.051917142278498744, 0.053222215456221474, 0.05457202460950538, 0.055930194024602746, 0.057264677445662715, 0.058548055367130564, 0.05975763694681703, 0.06087544808786079, 0.06188816211511846, 0.06278700825551156, 0.06356767683500805, 0.06423022805577783, 0.06477900221820687, 0.06522252216571946, 0.06557337273032121, 0.06584803663715412, 0.066066661760427, 0.06625273141435363, 0.06643260866068404, 0.06663492902629242, 0.06688982531536342, 0.06722798469233193, 0.06767956188689296, 0.06827300091843312, 0.06903384603087293, 0.06998364320009749, 0.0711390390183478, 0.07251116916968066, 0.07410539481067938, 0.07592139894186552, 0.07795360743983074, 0.08019186201746384, 0.0826222522373419, 0.08522801218252046, 0.08799040069874847, 0.09088950579950969, 0.09390493741986507, 0.09701639353553429 ], [ 0.05210016495695666, 0.05031098135145291, 0.048809821753864786, 0.04762229296910805, 0.04676792823295572, 0.04625723697063948, 0.04608942945781453, 0.04625140676422404, 0.046718304101623365, 0.047455445594022934, 0.0484212117630439, 0.04957018665847047, 0.05085604721138089, 0.052233878427062036, 0.05366182179465925, 0.05510211847843881, 0.05652168077775179, 0.0578923364025626, 0.05919086887967207, 0.06039894555604165, 0.061502994168852694, 0.06249406443449164, 0.06336769308661157, 0.06412377805181624, 0.06476645838292318, 0.06530398978123592, 0.06574860006968758, 0.06611630435652258, 0.06642665588385323, 0.066702406222957, 0.06696904857506307, 0.06725422184228878, 0.06758696229572757, 0.06799680506444827, 0.06851275906027932, 0.06916220412958728, 0.06996978366829931, 0.07095638338916134, 0.07213829109046303, 0.07352661927087746, 0.07512704297393766, 0.07693986516292853, 0.07896038049723834, 0.08117947503545474, 0.0835843804559186, 0.08615949840698599, 0.08888722077550698, 0.09174868975151837, 0.09472446208080686, 0.09779506063802207 ], [ 0.05130509335889255, 0.049433496146634275, 0.04785461236150215, 0.046597584164752376, 0.04568548483078353, 0.04513190935955853, 0.04493824796447512, 0.04509237276579802, 0.04556912529408686, 0.04633246762165528, 0.04733871070661706, 0.048540060745477655, 0.04988784322470788, 0.05133503937177589, 0.05283804248502403, 0.05435772269876759, 0.055859966765079226, 0.057315864857650646, 0.058701685995564475, 0.05999874364436991, 0.06119321682474965, 0.06227596415519122, 0.06324234855155976, 0.06409207695821592, 0.06482905043233694, 0.0654612134805858, 0.0660003866524198, 0.06646206248499568, 0.06686514195046736, 0.06723158703861352, 0.06758596589705465, 0.06795487120999968, 0.06836620138550843, 0.06884830833113004, 0.06942903473450776, 0.0701346857741106, 0.07098900114566241, 0.07201220794881234, 0.07322023816976385, 0.07462418311350964, 0.07623003182466413, 0.07803870608809757, 0.08004636865039695, 0.08224495172413612, 0.08462283512096277, 0.08716559917072861, 0.0898567849608775, 0.0926786092119903, 0.09561259869021943, 0.09864012573186982 ], [ 0.050674378313176956, 0.04871872763143573, 0.04705937021903684, 0.045728959279910636, 0.04475419250273417, 0.04415194083850112, 0.04392603663542481, 0.04406560405758762, 0.04454544160772302, 0.04532834232531778, 0.04636868060559125, 0.04761637095554651, 0.04902044345246718, 0.05053181420395247, 0.0521051565762797, 0.05369999015421653, 0.055281189208522256, 0.05681911166345668, 0.058289509203840774, 0.059673330402291724, 0.06095648654420793, 0.06212961847497208, 0.06318788143173176, 0.06413075091531623, 0.06496184366537525, 0.0656887417759649, 0.06632280367957448, 0.06687894251759724, 0.06737535022799421, 0.06783314489796194, 0.06827592029749137, 0.06872918098943803, 0.06921965491311452, 0.06977448831994992, 0.07042034491207808, 0.07118245012971325, 0.07208363939477117, 0.07314348138695603, 0.0743775499030615, 0.07579690804911894, 0.07740784698415903, 0.07921189206481727, 0.08120605824418099, 0.08338331047600944, 0.08573316840273847, 0.08824238947893027, 0.0908956696286946, 0.09367631232933278, 0.09656683185804678, 0.09954947109530374 ], [ 0.050225742772015795, 0.04818581963104348, 0.046444384321759555, 0.04503744536205174, 0.04399529708707818, 0.0433382124999684, 0.04307273180712275, 0.0431895849263221, 0.0436639017049272, 0.04445764477760602, 0.04552352447825095, 0.04680936449468341, 0.048262037874522934, 0.04983048517780392, 0.05146771311038267, 0.05313191723123516, 0.0547869659110015, 0.05640247624949539, 0.0579536622684397, 0.05942107801387735, 0.06079032987802899, 0.06205179757264935, 0.06320038013141971, 0.0642352688371128, 0.06515974002423108, 0.06598095506181177, 0.06670975107077586, 0.06736040337660554, 0.06795033920190689, 0.06849978196297424, 0.06903130736741504, 0.0695692970939175, 0.07013928386705798, 0.07076719349615257, 0.07147850439140087, 0.07229736153660474, 0.07324569704742263, 0.07434241969267398, 0.0756027377110793, 0.07703767093767468, 0.07865379010644834, 0.08045319633260675, 0.08243372720966574, 0.08458935304160138, 0.08691071152385652, 0.08938572339661106, 0.09200023449230531, 0.09473863874968994, 0.09758444909058413, 0.10052079577148554 ], [ 0.04997569970637395, 0.047852838078060546, 0.04602904344265902, 0.044543380323129385, 0.04342957718510433, 0.042711342975174406, 0.04239817052354406, 0.042482808898277505, 0.04294121857420882, 0.043735028085281166, 0.04481571215048759, 0.04612933422948538, 0.04762084158407429, 0.049237345311036414, 0.05093026548456651, 0.05265650557185984, 0.05437892639271724, 0.0560663797757844, 0.05769350244866201, 0.05924040428992698, 0.06069233057643797, 0.06203933933858336, 0.06327601006777454, 0.06440118485897842, 0.06541773408820058, 0.06633233338671304, 0.06715523541576758, 0.06790001797717178, 0.0685832891060282, 0.06922433019447725, 0.06984466038401119, 0.07046751005446665, 0.07111719874870409, 0.07181842344257226, 0.0725954761529898, 0.07347142401085725, 0.07446729773419675, 0.07560134299561222, 0.07688839076200597, 0.07833939571594203, 0.07996117669210069, 0.08175637214343129, 0.08372360099766092, 0.08585779924937277, 0.08815068870323052, 0.0905913280877078, 0.09316669798379133, 0.09586227787398381, 0.09866258366274137, 0.10155164489939908 ], [ 0.04993836001577193, 0.04773546499547254, 0.045830445685829634, 0.044264984074780515, 0.043075935308336054, 0.042290361340786425, 0.04192089892608431, 0.04196275926660144, 0.042393338361783245, 0.04317457849774991, 0.04425730694820833, 0.04558629554019564, 0.047104898307824494, 0.048758605973465985, 0.05049736295207481, 0.05227682036209795, 0.05405882290029993, 0.055811417588392885, 0.057508605531418594, 0.05912998339700321, 0.060660360732157255, 0.06208939689741618, 0.06341127448730075, 0.06462441005691219, 0.06573119378609618, 0.06673774455131572, 0.06765366400228584, 0.0684917717598886, 0.06926780347209915, 0.07000005430765832, 0.07070895291165345, 0.07141655536605036, 0.07214595566436835, 0.07292061866218463, 0.073763652871557, 0.07469705256256792, 0.07574094944683811, 0.0769129213746939, 0.07822740679967695, 0.07969526799367566, 0.08132353339076656, 0.08311533192958905, 0.08507001303616761, 0.08718342848970387, 0.08944833975270404, 0.09185490797301303, 0.09439122376902793, 0.09704383882998086, 0.099798269387194, 0.10263945078530046 ], [ 0.050124406439483626, 0.0478458474942357, 0.045862143329517255, 0.04421703881125482, 0.04295007057088675, 0.04209143864995749, 0.04165702577452226, 0.04164493194434733, 0.04203465705038559, 0.042789227917446424, 0.043859559251010934, 0.04518973670825447, 0.04672196029604279, 0.04840037999274488, 0.05017361386928684, 0.0519961146164913, 0.053828700530501955, 0.05563856342877547, 0.05739899522197811, 0.059088993783293395, 0.06069284232847111, 0.06219971016031628, 0.06360329334465843, 0.06490149663368708, 0.06609614830651929, 0.06719273442126682, 0.06820013633768057, 0.0691303542557199, 0.06999819953575384, 0.0708209397475277, 0.07161788300536526, 0.07240989253499615, 0.07321882883733334, 0.07406692523466014, 0.07497611250375034, 0.07596731863524613, 0.07705977888363502, 0.0782703972733967, 0.07961320186528234, 0.08109893135844788, 0.08273478019388274, 0.08452431473427631, 0.08646755683902013, 0.0885612160941503, 0.09079904053502867, 0.09317224933942916, 0.09567000986889823, 0.09827992474902454, 0.10098850094160648, 0.10378158037631025 ], [ 0.05054037887270024, 0.04819177121876459, 0.04613321152372531, 0.044409876532796176, 0.04306342733422681, 0.042126855030438795, 0.04161927001743547, 0.04154201666879072, 0.04187736889728486, 0.04259028006943664, 0.04363260130315398, 0.04494846088341866, 0.046479450810055827, 0.04816873815338321, 0.04996381277123411, 0.05181800759937443, 0.05369111199092569, 0.05554940923214589, 0.057365399683039574, 0.05911738547841944, 0.06078902104200614, 0.06236888311465648, 0.06385008193137043, 0.06522991632318062, 0.06650956508650453, 0.06769380152458879, 0.06879071548404196, 0.06981142631937547, 0.07076977052102917, 0.07168194916129157, 0.07256612300955591, 0.07344194738183132, 0.07433004467832406, 0.0752514200463945, 0.07622683422294281, 0.0772761564411509, 0.0784177279982949, 0.07966777213451506, 0.0810398868817877, 0.0825446537054432, 0.08418938620365471, 0.08597803101363617, 0.08791121937324801, 0.08998645480428971, 0.09219841215179145, 0.09453931701858312, 0.09699937280826304, 0.09956720460073377, 0.1022302938401246, 0.10497538403175884 ], [ 0.05118836824849541, 0.048776278115645604, 0.046647781991315994, 0.04484883030948898, 0.043422581019807754, 0.04240435480278833, 0.04181633345018498, 0.0416633379868094, 0.04193101629356028, 0.04258709113837098, 0.04358526090783346, 0.04487052032583444, 0.04638449849020934, 0.04806982125904032, 0.04987310942194279, 0.05174669359674744, 0.053649352621950606, 0.055546416363585316, 0.05740951175390956, 0.05921614421184191, 0.06094923074845357, 0.06259664631568172, 0.06415080971068007, 0.06560831442427419, 0.06696959821148675, 0.06823863916512954, 0.06942266332671386, 0.07053184803935567, 0.07157900570498671, 0.07257923416517027, 0.07354952263722123, 0.07450830614522563, 0.07547496676904082, 0.07646928667934194, 0.07751086541523869, 0.07861852141739002, 0.07980970436449888, 0.08109994913873243, 0.08250240316311876, 0.08402745576876075, 0.08568249124321624, 0.08747177717544868, 0.08939648819613281, 0.09145485405746506, 0.09364241188896869, 0.09595233654857882, 0.09837582066934097, 0.10090247698525373, 0.10352073901059103, 0.1062182411323339 ], [ 0.05206614155478675, 0.049597765083006805, 0.047405095102929645, 0.045534219903616585, 0.04402914523945244, 0.04292697887269596, 0.04225268144243789, 0.042014622088951854, 0.04220228378420459, 0.04278692336950083, 0.043724991678341305, 0.044963225264844926, 0.04644401621057071, 0.04810997524009387, 0.049907185504546425, 0.05178714700930703, 0.053707683173740486, 0.05563314790789769, 0.0575342247985994, 0.05938752661984292, 0.061175125198210605, 0.06288408307576891, 0.06450601970991492, 0.06603672151489579, 0.06747579184524197, 0.06882633013398974, 0.07009462623961404, 0.07128985510392867, 0.07242375729980421, 0.07351029264188107, 0.0745652566952499, 0.07560585379544237, 0.07665022510155634, 0.07771693610557287, 0.07882443453893996, 0.0799904961003933, 0.08123168098796166, 0.08256282786196177, 0.08399661271614772, 0.0855431976754246, 0.08720998901902985, 0.0890015154311118, 0.09091942781729787, 0.0929626124683145, 0.09512740129054038, 0.09740785726146987, 0.09979611064709608, 0.10228272171178114, 0.1048570481001534, 0.10750759898943346 ], [ 0.05316764064748789, 0.050650506699940534, 0.048400019850964364, 0.04646183397201285, 0.04488017962456275, 0.04369337072165193, 0.04292873906595868, 0.042598098242657756, 0.04269503732989955, 0.04319495988734752, 0.04405789486553253, 0.04523319208148068, 0.046664782984107006, 0.048295865598071835, 0.050072395842071654, 0.05194528304490933, 0.05387150291724481, 0.05581444820827767, 0.05774381395186959, 0.05963523965705436, 0.061469853024436874, 0.063233798251171, 0.06491778982325865, 0.06651670640656372, 0.06802922425302986, 0.06945748141757511, 0.07080676024298727, 0.07208517429714835, 0.07330334629612685, 0.07447406507400921, 0.07561191220674707, 0.0767328524248135, 0.07785378641280213, 0.07899206983801253, 0.08016500813684906, 0.08138934216914552, 0.08268074460171432, 0.0840533500075332, 0.08551934246597084, 0.08708862250747992, 0.08876857058824542, 0.09056391742892424, 0.09247672345309993, 0.0945064613900102, 0.09665018900585745, 0.09890279376904816, 0.1012572884822627, 0.10370513652045134, 0.10623658692109642, 0.10884100258407688 ], [ 0.05448373538718675, 0.05192546958796227, 0.04962390233479728, 0.04762377162964017, 0.04596897362778229, 0.044698451899099434, 0.043841421779239574, 0.04341287345173021, 0.04341055916731797, 0.043814435159713554, 0.044588786556020756, 0.04568638270875923, 0.04705347992112674, 0.04863452312002836, 0.05037582866406168, 0.052228032194193544, 0.054147435448901646, 0.056096536262686944, 0.058044033428504366, 0.05996453861034297, 0.06183815384844227, 0.06365001040334224, 0.06538981949506599, 0.06705145622754356, 0.06863258049202876, 0.07013428896669852, 0.07156078754053324, 0.0729190716846932, 0.07421860235990156, 0.07547096639866961, 0.07668951266479886, 0.07788895854595002, 0.079084965378264, 0.08029368606337796, 0.08153129311239721, 0.08281350017549563, 0.08415509419744736, 0.08556949803835305, 0.0870683841557323, 0.08866135842465889, 0.09035572938573419, 0.09215637255601346, 0.09406569265512327, 0.09608367962439715, 0.0982080480888588, 0.10043444517884614, 0.10275670881933424, 0.10516715778123768, 0.10765689572989452, 0.11021611375683812 ], [ 0.05600308364288559, 0.053411249564329584, 0.051065556645453175, 0.049009448243648696, 0.04728601413421308, 0.04593429114332309, 0.04498485168979138, 0.044455462476304955, 0.044347888590723264, 0.044646812204435365, 0.04532125416517697, 0.04632808621746493, 0.04761663523608711, 0.0491332788979313, 0.05082524601430161, 0.052643292940955724, 0.05454329521388556, 0.05648698461575964, 0.05844210503171907, 0.06038222213723759, 0.06228635693577168, 0.06413855155772955, 0.06592742852875638, 0.06764577267775856, 0.06929014491062485, 0.07086052558826685, 0.07235997925480171, 0.07379432991291407, 0.0751718356616525, 0.07650285256846695, 0.0777994797552799, 0.07907518062895572, 0.08034437882601306, 0.08162203158115554, 0.08292318758875003, 0.08426254061172289, 0.08565399361640028, 0.08711025055792596, 0.08864245366041038, 0.09025988285883878, 0.09196973099450786, 0.0937769636884274, 0.09568426713654643, 0.09769208112421326, 0.09979870911296532, 0.10200049294982702, 0.10429203698897864, 0.10666646531732982, 0.10911569620051678, 0.11163071949075104 ], [ 0.057712960859758626, 0.05509497280100848, 0.05271221968390577, 0.05060657274077598, 0.048819939739238684, 0.047390978999763744, 0.046351094210830814, 0.04572034082710564, 0.04550417144190087, 0.0456919395796558, 0.04625765668368746, 0.047162809691639315, 0.04836045170712481, 0.049799564830263765, 0.051428881818002134, 0.05319974130091571, 0.055067914627098244, 0.0569945652161106, 0.05894658116259571, 0.060896509601253236, 0.06282226969254044, 0.06470676384709631, 0.0665374592430935, 0.0683059775231521, 0.070007708265923, 0.07164144839697702, 0.07320906230579793, 0.07471515394701544, 0.07616674121258404, 0.0775729235029357, 0.07894453519855905, 0.08029378034489246, 0.08163384710514002, 0.08297850419942984, 0.0843416853713313, 0.08573707156376653, 0.08717768354186155, 0.08867549975045237, 0.09024111487747927, 0.09188345369202412, 0.09360955222976443, 0.09542441454380149, 0.0973309484794007, 0.09932997886424667, 0.1014203317596685, 0.10359897953576512, 0.10586123388097247, 0.10820097258086601, 0.11061088593620744, 0.11308272980815635 ], [ 0.05959996106229754, 0.056963048646218824, 0.05455034370294997, 0.052401958758747, 0.05055833814441938, 0.049057367737918356, 0.04793078987829592, 0.04720042108388883, 0.046874949828268994, 0.046948149385059965, 0.047399052525476534, 0.048194075741692745, 0.04929051955779934, 0.05064058307727864, 0.05219509913554892, 0.05390649617114131, 0.05573082860539281, 0.05762895762232391, 0.0595670770448917, 0.06151679538800937, 0.06345495113336282, 0.06536328894640414, 0.06722807886464136, 0.0690397253125762, 0.07079238858004942, 0.07248362607730259, 0.07411405176777637, 0.07568700759553866, 0.0772082389740967, 0.07868556650924585, 0.08012854748403692, 0.08154812286198655, 0.08295624840340773, 0.08436551170812724, 0.08578874034191794, 0.0872386093738624, 0.08872725930765911, 0.09026593718745987, 0.09186467430477657, 0.0935320132484456, 0.09527479501328201, 0.097098013695586, 0.09900474231253235, 0.1009961289656398, 0.10307145843986569, 0.10522827084843302, 0.10746252642836247, 0.10976880422107667, 0.1121405221219883, 0.11457016649706801 ], [ 0.061650522107075195, 0.05900172285536234, 0.056566170973138596, 0.05438210972479854, 0.05248832361631076, 0.050921613778908005, 0.0497136249220367, 0.04888741016158504, 0.04845436996601395, 0.04841229625351572, 0.04874507352999992, 0.04942415678307058, 0.05041144897284862, 0.051662877035967135, 0.05313193431473039, 0.05477266230076804, 0.056541832754988135, 0.05840033123116379, 0.060313880441219866, 0.06225328616925743, 0.06419437487715644, 0.06611775413236953, 0.06800848576356086, 0.06985572703856927, 0.07165236978791349, 0.07339469046354696, 0.07508201372146536, 0.0767163863514311, 0.07830225575135102, 0.07984614660537952, 0.08135633027936871, 0.08284248324207244, 0.08431533324086647, 0.0857862947500253, 0.0872670981163082, 0.08876941957952932, 0.0903045216536164, 0.09188291493031726, 0.09351405297231975, 0.09520607144808498, 0.09696558101343608, 0.0987975208045989, 0.10070507605608109, 0.10268965967800599, 0.10475095404180969, 0.1068870061173243, 0.10909436676991538, 0.11136826362309404, 0.11370279643982117, 0.11609114437409092 ], [ 0.06385127357861396, 0.06119743370759748, 0.058746096489608414, 0.056533585647773214, 0.05459690211712491, 0.05297152870056169, 0.05168864591869485, 0.050772055783429845, 0.05023532469244543, 0.050079766394017976, 0.050293787305648104, 0.05085379801276402, 0.05172647830280454, 0.05287185848123979, 0.05424657737600988, 0.05580679301094527, 0.05751044986614405, 0.05931882943211913, 0.061197461190131704, 0.0631165391216394, 0.06505099648888894, 0.06698036753380719, 0.06888853057461808, 0.07076339479868014, 0.07259656762995342, 0.07438302154632358, 0.07612076752794776, 0.07781053538632884, 0.07945545765945923, 0.08106075249227142, 0.0826334012012489, 0.08418181753287356, 0.08571550760486907, 0.08724472188393613, 0.08878010304924852, 0.0903323359650797, 0.09191180798299191, 0.09352828917163981, 0.09519064262988966, 0.096906574653852, 0.09868243318554018, 0.10052306077808199, 0.10243170549326867, 0.10440999001007904, 0.1064579361120606, 0.10857403896208095, 0.11075538342096572, 0.1129977932759646, 0.11529600365771296, 0.11764384708070201 ], [ 0.06618923559181178, 0.0635370070584578, 0.061076861528561434, 0.0588431987650548, 0.05687117196110484, 0.05519478352994952, 0.05384445766553625, 0.052844316350987165, 0.05220956383266674, 0.05194449433896788, 0.05204159409611332, 0.05248198438840428, 0.05323711958585523, 0.0542713543175131, 0.05554484957074682, 0.05701632810229483, 0.05864535321888023, 0.06039399708112871, 0.06222791545015435, 0.06411693044667054, 0.06603525002018015, 0.06796144389811899, 0.06987827081794495, 0.07177242401249541, 0.07363423778353555, 0.0754573797049604, 0.07723854039203387, 0.07897712481566885, 0.08067494465064118, 0.08233590911134027, 0.08396571137949602, 0.08557150851065783, 0.08716159421956081, 0.08874506588103138, 0.0903314891821295, 0.09193056588152561, 0.09355181184371751, 0.09520425370822912, 0.09689615305722352, 0.09863476665444122, 0.10042615022773277, 0.1022750114397989, 0.10418461531457167, 0.10615674270838708, 0.10819169971796956, 0.11028837347385384, 0.11244432780089475, 0.11465593088146403, 0.11691850638648489, 0.11922649951435593 ], [ 0.06865190912081444, 0.06600773841259738, 0.06354563226951912, 0.061298095803811216, 0.05929841754462926, 0.05757901937623754, 0.056169349331121936, 0.05509349021690228, 0.05436780185069821, 0.05399901566818719, 0.053983191309657376, 0.05430579352492991, 0.054942892476199025, 0.05586323060666557, 0.057030738377267354, 0.05840706602249237, 0.05995380185644282, 0.06163420106434648, 0.06341438859576189, 0.06526409254667274, 0.06715700710453579, 0.06907088994972092, 0.07098748452477881, 0.07289233576028024, 0.07477454638757831, 0.07662650333321491, 0.07844359072671216, 0.08022389734484583, 0.08196792100462531, 0.08367826962878176, 0.08535935770775745, 0.08701709710722894, 0.08865858219649139, 0.0902917707747261, 0.09192516398137097, 0.09356749005876369, 0.09522739827738606, 0.09691317034922282, 0.09863245709493033, 0.10039204790444271, 0.10219767962034869, 0.10405388994233948, 0.10596391844012962, 0.10792965597189799, 0.10995164096697857, 0.11202909887328183, 0.11416001928440399, 0.1163412639809993, 0.11856869840682031, 0.12083733894255551 ], [ 0.0712272974938489, 0.06859740667795454, 0.06614001179288603, 0.06388577660526908, 0.06186614432247332, 0.06011190748637658, 0.058651383630426705, 0.057508329043135874, 0.056699838467709936, 0.05623456664288487, 0.05611161812847786, 0.05632035423276361, 0.056841176852819905, 0.05764713462841983, 0.05870603856662854, 0.05998272310680504, 0.061441141301624806, 0.06304609543597625, 0.06476452462789746, 0.06656636333839665, 0.06842503756026977, 0.07031768398277043, 0.07222517359845806, 0.07413200651966097, 0.0760261272315653, 0.07789869352932063, 0.07974381973928679, 0.08155830576072165, 0.08334135753480224, 0.08509430109005955, 0.08682029068462889, 0.0885240112288031, 0.09021137570127824, 0.09188921933492392, 0.09356499367096009, 0.09524646493339921, 0.09694142235793593, 0.09865740295054354, 0.10040143951855982, 0.10217983862906284, 0.10399799438580647, 0.10586024262433302, 0.10776975841659481, 0.10972849781322104, 0.11173718272317397, 0.11379532592751383, 0.11590129161179301, 0.11805238559982817, 0.12024496874311556, 0.12247458666977033 ], [ 0.07390389056062131, 0.07129425340933493, 0.06884802043074986, 0.06659408371885214, 0.06456208728855255, 0.0627811862632444, 0.06127846936548883, 0.060077146513184236, 0.05919469427279879, 0.05864122598893076, 0.05841837364342912, 0.0585189084208259, 0.058927191135258745, 0.059620373714532146, 0.060570129322266485, 0.06174461859026365, 0.06311041375623243, 0.06463417728606521, 0.06628398783012983, 0.06803029129731682, 0.06984651197614285, 0.0717093866151541, 0.07359909022310739, 0.07549921514634235, 0.0773966522459371, 0.07928140957799218, 0.08114639236010948, 0.08298715906827675, 0.08480166224841834, 0.08658997865335072, 0.088354031129857, 0.09009730380949103, 0.09182455219912337, 0.09354151039451229, 0.0952545985824712, 0.09697063502840642, 0.09869655767473925, 0.10043916114326668, 0.10220485521974275, 0.1039994507260504, 0.10582797803170226, 0.10769454235607603, 0.10960221855341329, 0.1115529863843736, 0.1135477055161332, 0.1155861278165257, 0.11766694305793744, 0.11978785303012787, 0.1219456683394576, 0.12413642185925962 ], [ 0.07667063300181136, 0.07408694933626557, 0.07165806585946999, 0.06941118310424091, 0.06737421081574757, 0.06557468947449832, 0.06403842624320083, 0.06278792423238624, 0.06184075500355423, 0.061208084979677904, 0.060893590123339926, 0.06089295836226332, 0.06119408408405962, 0.06177792851370364, 0.06261989668535049, 0.06369150563751289, 0.06496210673825051, 0.06640046807151806, 0.06797609435010055, 0.0696602345458368, 0.07142658356353997, 0.07325171789682502, 0.07511531883846126, 0.07700023669940281, 0.07889244195653289, 0.0807808990637636, 0.08265738871760568, 0.08451629606083134, 0.08635437606305826, 0.08817050304164062, 0.08996540866418538, 0.09174141143272772, 0.09350214023704821, 0.09525225477443013, 0.0969971662062907, 0.09874276214056943, 0.10049514070964313, 0.10226035900747338, 0.10404420134382222, 0.10585197259561131, 0.10768832136067374, 0.10955709666962159, 0.1114612407556285, 0.11340271892373814, 0.11538248602771581, 0.11740048758556772, 0.1194556922647078, 0.12154615143841895, 0.12366908081492117, 0.12582095878890562 ], [ 0.079516889462664, 0.07696456017587457, 0.07455891392471652, 0.07232554563205994, 0.07029070789099236, 0.06848037142353755, 0.06691904441704902, 0.06562841242194098, 0.06462591568896929, 0.06392342981846, 0.06352623917204747, 0.06343247386610085, 0.06363311592148464, 0.06411258240455087, 0.06484979222705285, 0.06581954978070818, 0.06699405144772025, 0.06834433974114318, 0.06984157867849561, 0.0714580822394954, 0.0731680788214582, 0.07494823011086311, 0.07677794178587222, 0.07863950935298916, 0.08051813995091277, 0.08240188434881661, 0.08428150559566422, 0.08615030356566544, 0.08800390877772904, 0.08984005454229141, 0.09165833359349425, 0.09345994365229966, 0.09524742555702735, 0.09702439742486792, 0.09879528853374776, 0.10056507703364001, 0.10233903603744861, 0.10412249296332228, 0.10592060709610886, 0.10773817013666266, 0.10957943398539997, 0.11144796917387943, 0.11334655626704172, 0.11527711129201677, 0.11724064491012452, 0.11923725374625199, 0.12126614112574448, 0.12332566352523829, 0.12541339837444324, 0.12752622847340334 ], [ 0.0824324128720286, 0.07991651715455356, 0.07753966466045842, 0.07532593294550746, 0.07330000145203996, 0.07148633076476663, 0.06990813879699086, 0.06858622260368955, 0.06753771732984432, 0.06677492288792461, 0.06630435060854639, 0.06612613354614741, 0.0662339002136239, 0.06661513971483665, 0.06725200567042984, 0.06812244024591015, 0.06920146517826306, 0.07046248840801865, 0.0718785048193002, 0.07342311324091545, 0.07507131533751629, 0.07680009630233008, 0.07858880909951754, 0.08041939439081229, 0.08227647026956901, 0.084147322885598, 0.08602182372403762, 0.08789229354640067, 0.08975332784532215, 0.09160159455338815, 0.0934356117662366, 0.0952555112835663, 0.09706279264859413, 0.09886007186370487, 0.1006508288725176, 0.10243915804130933, 0.10422952608656601, 0.10602654204922579, 0.10783474390972181, 0.10965840620467712, 0.1115013725148465, 0.11336691594979074, 0.11525762979576751, 0.11717534938484227, 0.11912110506841363, 0.12109510502724999, 0.12309674560827283, 0.12512464601637713, 0.12717670355654404, 0.12925016524105803 ], [ 0.0854073184294893, 0.08293259393966923, 0.08058973457390661, 0.07840138835889236, 0.07639074832932749, 0.0745808333498193, 0.0729935980765866, 0.07164891089667227, 0.07056347190848662, 0.06974977399275305, 0.06921522900021765, 0.06896157848632258, 0.06898467936098977, 0.06927470281560813, 0.06981672218442127, 0.0705916087611741, 0.07157711848475364, 0.07274904337601493, 0.07408231689236648, 0.0755519928118252, 0.07713405211557256, 0.07880602319065441, 0.08054742310372108, 0.08234004091978316, 0.08416808955581943, 0.0860182528484331, 0.08787965168069875, 0.0897437489284361, 0.09160420880142332, 0.09345672249805198, 0.0952988092199439, 0.09712959953558428, 0.09894960674564215, 0.10076049113919484, 0.1025648216756093, 0.10436583952325394, 0.10616722789139922, 0.10797289258642694, 0.10978675761434878, 0.111612579875075, 0.11345378651682972, 0.11531333784011581, 0.11719361778643839, 0.1190963530683584, 0.12102256096089335, 0.12297252475360668, 0.12494579492927185, 0.1269412133493555, 0.1289569571324904, 0.13099059853288206 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.23037 (SEM: 0)
x1: 0.248976
x2: 0.230282
x3: 0.735156
x4: 0.417042
x5: 0.807821
x6: 0.178425", "Arm 1_0
l2norm: 1.64359 (SEM: 0)
x1: 0.096023
x2: 0.815353
x3: 0.561411
x4: 0.536357
x5: 0.972022
x6: 0.692599", "Arm 2_0
l2norm: 1.78036 (SEM: 0)
x1: 0.156403
x2: 0.858762
x3: 0.765385
x4: 0.777066
x5: 0.799142
x6: 0.761238", "Arm 3_0
l2norm: 1.58733 (SEM: 0)
x1: 0.961731
x2: 0.561134
x3: 0.707312
x4: 0.420589
x5: 0.749887
x6: 0.200761", "Arm 4_0
l2norm: 1.33575 (SEM: 0)
x1: 0.428804
x2: 0.191727
x3: 0.29139
x4: 0.956337
x5: 0.743798
x6: 0.104274", "Arm 5_0
l2norm: 1.29659 (SEM: 0)
x1: 0.111671
x2: 0.393274
x3: 0.0210624
x4: 0.540779
x5: 0.567671
x6: 0.948091", "Arm 6_0
l2norm: 1.51278 (SEM: 0)
x1: 0.950978
x2: 0.490146
x3: 0.148555
x4: 0.0777765
x5: 0.793243
x6: 0.697534", "Arm 7_0
l2norm: 1.51343 (SEM: 0)
x1: 0.746434
x2: 0.640313
x3: 0.771447
x4: 0.0757741
x5: 0.785575
x6: 0.324499", "Arm 8_0
l2norm: 1.39193 (SEM: 0)
x1: 0.338152
x2: 0.602784
x3: 0.134864
x4: 0.743678
x5: 0.922402
x6: 0.194144", "Arm 9_0
l2norm: 1.28678 (SEM: 0)
x1: 0.564269
x2: 0.0100321
x3: 0.190226
x4: 0.238262
x5: 0.923009
x6: 0.626426", "Arm 10_0
l2norm: 0.909023 (SEM: 0)
x1: 0.0665052
x2: 0.0852538
x3: 0.181838
x4: 0.576385
x5: 0.612311
x6: 0.272805", "Arm 11_0
l2norm: 1.76971 (SEM: 0)
x1: 0.882353
x2: 0.8155
x3: 0.422534
x4: 0.850211
x5: 0.662138
x6: 0.590321", "Arm 12_0
l2norm: 1.17721 (SEM: 0)
x1: 0.210376
x2: 0.454428
x3: 0.114578
x4: 0.631594
x5: 0.823961
x6: 0.210003", "Arm 13_0
l2norm: 1.21159 (SEM: 0)
x1: 0.221159
x2: 0.515688
x3: 0.110552
x4: 0.636218
x5: 0.833154
x6: 0.204836", "Arm 14_0
l2norm: 1.23951 (SEM: 0)
x1: 0.233881
x2: 0.557273
x3: 0.108864
x4: 0.642298
x5: 0.840535
x6: 0.200595", "Arm 15_0
l2norm: 1.23574 (SEM: 0)
x1: 0.235712
x2: 0.623355
x3: 0.0995828
x4: 0.618441
x5: 0.810344
x6: 0.184075", "Arm 16_0
l2norm: 1.24045 (SEM: 0)
x1: 0.241427
x2: 0.659143
x3: 0.09641
x4: 0.610123
x5: 0.79627
x6: 0.174239", "Arm 17_0
l2norm: 1.23673 (SEM: 0)
x1: 0.243362
x2: 0.715119
x3: 0.090508
x4: 0.588752
x5: 0.761581
x6: 0.15512", "Arm 18_0
l2norm: 1.23218 (SEM: 0)
x1: 0.237091
x2: 0.791041
x3: 0.0818182
x4: 0.556624
x5: 0.70982
x6: 0.1263", "Arm 19_0
l2norm: 1.24105 (SEM: 0)
x1: 0.232637
x2: 0.848263
x3: 0.075192
x4: 0.537663
x5: 0.678757
x6: 0.105289", "Arm 20_0
l2norm: 1.21741 (SEM: 0)
x1: 0.262715
x2: 0.853656
x3: 0.0325618
x4: 0.505887
x5: 0.651571
x6: 0.0531", "Arm 21_0
l2norm: 1.22421 (SEM: 0)
x1: 0.311531
x2: 0.859782
x3: 0.00190978
x4: 0.491899
x5: 0.648015
x6: 0.0227306", "Arm 22_0
l2norm: 1.22492 (SEM: 0)
x1: 0.359141
x2: 0.857291
x3: 0
x4: 0.47549
x5: 0.640624
x6: 0.000141327", "Arm 23_0
l2norm: 1.23716 (SEM: 0)
x1: 0.373688
x2: 0.894462
x3: 4.318e-13
x4: 0.398036
x5: 0.657586
x6: 0" ], "type": "scatter", "x": [ 0.7351559996604919, 0.5614106636494398, 0.7653854265809059, 0.7073120288550854, 0.29139045625925064, 0.021062413230538368, 0.1485545728355646, 0.7714471016079187, 0.13486393727362156, 0.19022618420422077, 0.18183833546936512, 0.4225344667211175, 0.11457826470661621, 0.11055192519861308, 0.10886415850319096, 0.0995828124016875, 0.09641004053972126, 0.09050798409954779, 0.08181820580563792, 0.0751919595571795, 0.032561836630120126, 0.0019097839097025249, 0.0, 4.318001020464733e-13 ], "xaxis": "x", "y": [ 0.4170418381690979, 0.5363569892942905, 0.7770662326365709, 0.4205893473699689, 0.9563366090878844, 0.5407788762822747, 0.07777649164199829, 0.07577406708151102, 0.7436783611774445, 0.2382622491568327, 0.5763847157359123, 0.8502105847001076, 0.6315940755638574, 0.6362183716408301, 0.6422978401844622, 0.6184407953420836, 0.6101234121822483, 0.5887516509268822, 0.5566238431939288, 0.5376634628659039, 0.5058869205394153, 0.49189880592425017, 0.47549042979048917, 0.3980362779790994 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.23037 (SEM: 0)
x1: 0.248976
x2: 0.230282
x3: 0.735156
x4: 0.417042
x5: 0.807821
x6: 0.178425", "Arm 1_0
l2norm: 1.64359 (SEM: 0)
x1: 0.096023
x2: 0.815353
x3: 0.561411
x4: 0.536357
x5: 0.972022
x6: 0.692599", "Arm 2_0
l2norm: 1.78036 (SEM: 0)
x1: 0.156403
x2: 0.858762
x3: 0.765385
x4: 0.777066
x5: 0.799142
x6: 0.761238", "Arm 3_0
l2norm: 1.58733 (SEM: 0)
x1: 0.961731
x2: 0.561134
x3: 0.707312
x4: 0.420589
x5: 0.749887
x6: 0.200761", "Arm 4_0
l2norm: 1.33575 (SEM: 0)
x1: 0.428804
x2: 0.191727
x3: 0.29139
x4: 0.956337
x5: 0.743798
x6: 0.104274", "Arm 5_0
l2norm: 1.29659 (SEM: 0)
x1: 0.111671
x2: 0.393274
x3: 0.0210624
x4: 0.540779
x5: 0.567671
x6: 0.948091", "Arm 6_0
l2norm: 1.51278 (SEM: 0)
x1: 0.950978
x2: 0.490146
x3: 0.148555
x4: 0.0777765
x5: 0.793243
x6: 0.697534", "Arm 7_0
l2norm: 1.51343 (SEM: 0)
x1: 0.746434
x2: 0.640313
x3: 0.771447
x4: 0.0757741
x5: 0.785575
x6: 0.324499", "Arm 8_0
l2norm: 1.39193 (SEM: 0)
x1: 0.338152
x2: 0.602784
x3: 0.134864
x4: 0.743678
x5: 0.922402
x6: 0.194144", "Arm 9_0
l2norm: 1.28678 (SEM: 0)
x1: 0.564269
x2: 0.0100321
x3: 0.190226
x4: 0.238262
x5: 0.923009
x6: 0.626426", "Arm 10_0
l2norm: 0.909023 (SEM: 0)
x1: 0.0665052
x2: 0.0852538
x3: 0.181838
x4: 0.576385
x5: 0.612311
x6: 0.272805", "Arm 11_0
l2norm: 1.76971 (SEM: 0)
x1: 0.882353
x2: 0.8155
x3: 0.422534
x4: 0.850211
x5: 0.662138
x6: 0.590321", "Arm 12_0
l2norm: 1.17721 (SEM: 0)
x1: 0.210376
x2: 0.454428
x3: 0.114578
x4: 0.631594
x5: 0.823961
x6: 0.210003", "Arm 13_0
l2norm: 1.21159 (SEM: 0)
x1: 0.221159
x2: 0.515688
x3: 0.110552
x4: 0.636218
x5: 0.833154
x6: 0.204836", "Arm 14_0
l2norm: 1.23951 (SEM: 0)
x1: 0.233881
x2: 0.557273
x3: 0.108864
x4: 0.642298
x5: 0.840535
x6: 0.200595", "Arm 15_0
l2norm: 1.23574 (SEM: 0)
x1: 0.235712
x2: 0.623355
x3: 0.0995828
x4: 0.618441
x5: 0.810344
x6: 0.184075", "Arm 16_0
l2norm: 1.24045 (SEM: 0)
x1: 0.241427
x2: 0.659143
x3: 0.09641
x4: 0.610123
x5: 0.79627
x6: 0.174239", "Arm 17_0
l2norm: 1.23673 (SEM: 0)
x1: 0.243362
x2: 0.715119
x3: 0.090508
x4: 0.588752
x5: 0.761581
x6: 0.15512", "Arm 18_0
l2norm: 1.23218 (SEM: 0)
x1: 0.237091
x2: 0.791041
x3: 0.0818182
x4: 0.556624
x5: 0.70982
x6: 0.1263", "Arm 19_0
l2norm: 1.24105 (SEM: 0)
x1: 0.232637
x2: 0.848263
x3: 0.075192
x4: 0.537663
x5: 0.678757
x6: 0.105289", "Arm 20_0
l2norm: 1.21741 (SEM: 0)
x1: 0.262715
x2: 0.853656
x3: 0.0325618
x4: 0.505887
x5: 0.651571
x6: 0.0531", "Arm 21_0
l2norm: 1.22421 (SEM: 0)
x1: 0.311531
x2: 0.859782
x3: 0.00190978
x4: 0.491899
x5: 0.648015
x6: 0.0227306", "Arm 22_0
l2norm: 1.22492 (SEM: 0)
x1: 0.359141
x2: 0.857291
x3: 0
x4: 0.47549
x5: 0.640624
x6: 0.000141327", "Arm 23_0
l2norm: 1.23716 (SEM: 0)
x1: 0.373688
x2: 0.894462
x3: 4.318e-13
x4: 0.398036
x5: 0.657586
x6: 0" ], "type": "scatter", "x": [ 0.7351559996604919, 0.5614106636494398, 0.7653854265809059, 0.7073120288550854, 0.29139045625925064, 0.021062413230538368, 0.1485545728355646, 0.7714471016079187, 0.13486393727362156, 0.19022618420422077, 0.18183833546936512, 0.4225344667211175, 0.11457826470661621, 0.11055192519861308, 0.10886415850319096, 0.0995828124016875, 0.09641004053972126, 0.09050798409954779, 0.08181820580563792, 0.0751919595571795, 0.032561836630120126, 0.0019097839097025249, 0.0, 4.318001020464733e-13 ], "xaxis": "x2", "y": [ 0.4170418381690979, 0.5363569892942905, 0.7770662326365709, 0.4205893473699689, 0.9563366090878844, 0.5407788762822747, 0.07777649164199829, 0.07577406708151102, 0.7436783611774445, 0.2382622491568327, 0.5763847157359123, 0.8502105847001076, 0.6315940755638574, 0.6362183716408301, 0.6422978401844622, 0.6184407953420836, 0.6101234121822483, 0.5887516509268822, 0.5566238431939288, 0.5376634628659039, 0.5058869205394153, 0.49189880592425017, 0.47549042979048917, 0.3980362779790994 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.488130Z", "iopub.status.busy": "2022-12-29T21:25:47.487539Z", "iopub.status.idle": "2022-12-29T21:25:47.551969Z", "shell.execute_reply": "2022-12-29T21:25:47.551335Z" } }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.16557744480411626, -0.16557744480411626, -0.16557744480411626, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7746710217387267, -0.9626248268704104, -1.258836044087273, -1.552995644484707, -1.6664292888860979, -2.0134156833235815, -2.3957605434459888, -2.5572941697249454, -2.5572941697249454, -2.8246211193011663 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.24897557497024536
x2: 0.23028185963630676
x3: 0.7351559996604919
x4: 0.4170418381690979
x5: 0.8078205585479736
x6: 0.17842471599578857", "
Parameterization:
x1: 0.0960230128839612
x2: 0.8153527863323689
x3: 0.5614106636494398
x4: 0.5363569892942905
x5: 0.9720220109447837
x6: 0.6925985831767321", "
Parameterization:
x1: 0.1564025031402707
x2: 0.8587622847408056
x3: 0.7653854265809059
x4: 0.7770662326365709
x5: 0.7991422135382891
x6: 0.7612376939505339", "
Parameterization:
x1: 0.9617307437583804
x2: 0.5611339714378119
x3: 0.7073120288550854
x4: 0.4205893473699689
x5: 0.7498865090310574
x6: 0.20076104067265987", "
Parameterization:
x1: 0.4288041861727834
x2: 0.19172651786357164
x3: 0.29139045625925064
x4: 0.9563366090878844
x5: 0.7437981329858303
x6: 0.10427382495254278", "
Parameterization:
x1: 0.11167066637426615
x2: 0.39327356312423944
x3: 0.021062413230538368
x4: 0.5407788762822747
x5: 0.5676709925755858
x6: 0.9480907581746578", "
Parameterization:
x1: 0.9509784653782845
x2: 0.4901457950472832
x3: 0.1485545728355646
x4: 0.07777649164199829
x5: 0.793243171647191
x6: 0.6975344885140657", "
Parameterization:
x1: 0.7464336706325412
x2: 0.6403127694502473
x3: 0.7714471016079187
x4: 0.07577406708151102
x5: 0.7855745675042272
x6: 0.3244990538805723", "
Parameterization:
x1: 0.3381518693640828
x2: 0.6027837051078677
x3: 0.13486393727362156
x4: 0.7436783611774445
x5: 0.9224017774686217
x6: 0.1941435532644391", "
Parameterization:
x1: 0.5642691543325782
x2: 0.010032054968178272
x3: 0.19022618420422077
x4: 0.2382622491568327
x5: 0.9230088265612721
x6: 0.626425739377737", "
Parameterization:
x1: 0.06650516018271446
x2: 0.08525383658707142
x3: 0.18183833546936512
x4: 0.5763847157359123
x5: 0.6123113492503762
x6: 0.2728052567690611", "
Parameterization:
x1: 0.8823529286310077
x2: 0.8154998291283846
x3: 0.4225344667211175
x4: 0.8502105847001076
x5: 0.6621380159631371
x6: 0.5903205387294292", "
Parameterization:
x1: 0.21037622256941665
x2: 0.4544277735965905
x3: 0.11457826470661621
x4: 0.6315940755638574
x5: 0.823960631000068
x6: 0.210003250291283", "
Parameterization:
x1: 0.22115866382264862
x2: 0.5156881394848358
x3: 0.11055192519861308
x4: 0.6362183716408301
x5: 0.8331543726157952
x6: 0.2048360787996824", "
Parameterization:
x1: 0.2338811315731661
x2: 0.557272623364236
x3: 0.10886415850319096
x4: 0.6422978401844622
x5: 0.8405345699447891
x6: 0.20059540017487945", "
Parameterization:
x1: 0.23571152916258165
x2: 0.6233546219861563
x3: 0.0995828124016875
x4: 0.6184407953420836
x5: 0.8103435233577786
x6: 0.18407474195968992", "
Parameterization:
x1: 0.24142699632672424
x2: 0.6591425853150353
x3: 0.09641004053972126
x4: 0.6101234121822483
x5: 0.7962704076785114
x6: 0.1742391303294605", "
Parameterization:
x1: 0.24336218675524277
x2: 0.7151189485429901
x3: 0.09050798409954779
x4: 0.5887516509268822
x5: 0.7615811619578391
x6: 0.15511968930967898", "
Parameterization:
x1: 0.2370906317830518
x2: 0.7910412806861575
x3: 0.08181820580563792
x4: 0.5566238431939288
x5: 0.7098203875422895
x6: 0.12630026699474006", "
Parameterization:
x1: 0.2326371861810669
x2: 0.8482626131332559
x3: 0.0751919595571795
x4: 0.5376634628659039
x5: 0.6787572005922089
x6: 0.10528935794818349", "
Parameterization:
x1: 0.26271478939294646
x2: 0.8536560073495288
x3: 0.032561836630120126
x4: 0.5058869205394153
x5: 0.6515713869472488
x6: 0.053100036031939045", "
Parameterization:
x1: 0.3115314752445275
x2: 0.85978215409156
x3: 0.0019097839097025249
x4: 0.49189880592425017
x5: 0.6480150397926737
x6: 0.02273063719168386", "
Parameterization:
x1: 0.3591411448569515
x2: 0.8572908681854445
x3: 0.0
x4: 0.47549042979048917
x5: 0.6406243172027277
x6: 0.00014132691875589726", "
Parameterization:
x1: 0.3736876479919902
x2: 0.8944617267658436
x3: 4.318001020464733e-13
x4: 0.3980362779790994
x5: 0.6575860417977242
x6: 0.0", "
Parameterization:
x1: 0.3829964106728045
x2: 0.8393659479463345
x3: 9.450896237519534e-16
x4: 0.5320607570891966
x5: 0.6175066555542106
x6: 2.3286685902459458e-14" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.16557744480411626, -0.16557744480411626, -0.16557744480411626, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7746710217387267, -0.9626248268704104, -1.258836044087273, -1.552995644484707, -1.6664292888860979, -2.0134156833235815, -2.3957605434459888, -2.5572941697249454, -2.5572941697249454, -2.8246211193011663 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.1171205834663499, -0.16557744480411626, -0.16557744480411626, -0.16557744480411626, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7714177244758701, -0.7746710217387267, -0.9626248268704104, -1.258836044087273, -1.552995644484707, -1.6664292888860979, -2.0134156833235815, -2.3957605434459888, -2.5572941697249454, -2.5572941697249454, -2.8246211193011663 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ -3.32237, -0.1171205834663499 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.554979Z", "iopub.status.busy": "2022-12-29T21:25:47.554490Z", "iopub.status.idle": "2022-12-29T21:25:47.587457Z", "shell.execute_reply": "2022-12-29T21:25:47.586886Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:47] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.590857Z", "iopub.status.busy": "2022-12-29T21:25:47.589872Z", "iopub.status.idle": "2022-12-29T21:25:47.862961Z", "shell.execute_reply": "2022-12-29T21:25:47.862344Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:47] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.865824Z", "iopub.status.busy": "2022-12-29T21:25:47.865588Z", "iopub.status.idle": "2022-12-29T21:25:47.879639Z", "shell.execute_reply": "2022-12-29T21:25:47.879068Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:47] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:47.882428Z", "iopub.status.busy": "2022-12-29T21:25:47.882109Z", "iopub.status.idle": "2022-12-29T21:25:52.770171Z", "shell.execute_reply": "2022-12-29T21:25:52.769624Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.398076, 'x2': 0.840814, 'x3': 0.0, 'x4': 0.572068, 'x5': 0.58788, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:52.773933Z", "iopub.status.busy": "2022-12-29T21:25:52.772818Z", "iopub.status.idle": "2022-12-29T21:25:52.781131Z", "shell.execute_reply": "2022-12-29T21:25:52.780613Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:52.784763Z", "iopub.status.busy": "2022-12-29T21:25:52.783719Z", "iopub.status.idle": "2022-12-29T21:25:52.800274Z", "shell.execute_reply": "2022-12-29T21:25:52.799753Z" } }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-29 21:25:52] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": { "execution": { "iopub.execute_input": "2022-12-29T21:25:52.803618Z", "iopub.status.busy": "2022-12-29T21:25:52.802771Z", "iopub.status.idle": "2022-12-29T21:25:52.808544Z", "shell.execute_reply": "2022-12-29T21:25:52.808026Z" } }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.15" } }, "nbformat": 4, "nbformat_minor": 2 }