{ "cells": [ { "cell_type": "markdown", "id": "dd7113a9", "metadata": { "papermill": { "duration": 0.005669, "end_time": "2024-03-01T16:33:56.179804", "exception": false, "start_time": "2024-03-01T16:33:56.174135", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "b6d6fdb5", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:33:56.190918Z", "iopub.status.busy": "2024-03-01T16:33:56.190297Z", "iopub.status.idle": "2024-03-01T16:33:59.629614Z", "shell.execute_reply": "2024-03-01T16:33:59.628679Z" }, "papermill": { "duration": 3.461919, "end_time": "2024-03-01T16:33:59.646540", "exception": false, "start_time": "2024-03-01T16:33:56.184621", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:33:59] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:33:59] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "af935514", "metadata": { "papermill": { "duration": 0.043637, "end_time": "2024-03-01T16:33:59.730907", "exception": false, "start_time": "2024-03-01T16:33:59.687270", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "1f299262", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:33:59.820045Z", "iopub.status.busy": "2024-03-01T16:33:59.819563Z", "iopub.status.idle": "2024-03-01T16:33:59.823851Z", "shell.execute_reply": "2024-03-01T16:33:59.823179Z" }, "papermill": { "duration": 0.050741, "end_time": "2024-03-01T16:33:59.825229", "exception": false, "start_time": "2024-03-01T16:33:59.774488", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:33:59] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "e9885c8a", "metadata": { "papermill": { "duration": 0.044178, "end_time": "2024-03-01T16:33:59.913002", "exception": false, "start_time": "2024-03-01T16:33:59.868824", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "bdb4a3ba", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:34:00.005365Z", "iopub.status.busy": "2024-03-01T16:34:00.004738Z", "iopub.status.idle": "2024-03-01T16:34:00.021597Z", "shell.execute_reply": "2024-03-01T16:34:00.020868Z" }, "papermill": { "duration": 0.06498, "end_time": "2024-03-01T16:34:00.023059", "exception": false, "start_time": "2024-03-01T16:33:59.958079", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "76b7f5e7", "metadata": { "papermill": { "duration": 0.045464, "end_time": "2024-03-01T16:34:00.114533", "exception": false, "start_time": "2024-03-01T16:34:00.069069", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "0f7a4550", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:34:00.205757Z", "iopub.status.busy": "2024-03-01T16:34:00.205250Z", "iopub.status.idle": "2024-03-01T16:34:00.209566Z", "shell.execute_reply": "2024-03-01T16:34:00.208893Z" }, "papermill": { "duration": 0.051169, "end_time": "2024-03-01T16:34:00.210855", "exception": false, "start_time": "2024-03-01T16:34:00.159686", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "1a0d64d2", "metadata": { "papermill": { "duration": 0.044635, "end_time": "2024-03-01T16:34:00.300426", "exception": false, "start_time": "2024-03-01T16:34:00.255791", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "c24a1b0e", "metadata": { "papermill": { "duration": 0.045176, "end_time": "2024-03-01T16:34:00.430165", "exception": false, "start_time": "2024-03-01T16:34:00.384989", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "da516c9a", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:34:00.522657Z", "iopub.status.busy": "2024-03-01T16:34:00.521895Z", "iopub.status.idle": "2024-03-01T16:35:35.808356Z", "shell.execute_reply": "2024-03-01T16:35:35.807623Z" }, "papermill": { "duration": 95.334745, "end_time": "2024-03-01T16:35:35.810172", "exception": false, "start_time": "2024-03-01T16:34:00.475427", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.979432, 'x2': 0.784923, 'x3': 0.297002, 'x4': 0.430659, 'x5': 0.786892, 'x6': 0.07397} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.008235, 0.0), 'l2norm': (1.572813, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.249398, 'x2': 0.568361, 'x3': 0.531979, 'x4': 0.271478, 'x5': 0.804936, 'x6': 0.230381} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.373106, 0.0), 'l2norm': (1.201222, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.004508, 'x2': 0.274208, 'x3': 0.350825, 'x4': 0.503775, 'x5': 0.874895, 'x6': 0.905855} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.080531, 0.0), 'l2norm': (1.427618, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.029083, 'x2': 0.393902, 'x3': 0.595405, 'x4': 0.916642, 'x5': 0.915106, 'x6': 0.568628} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.042971, 0.0), 'l2norm': (1.584771, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.572154, 'x2': 0.218557, 'x3': 0.024659, 'x4': 0.077701, 'x5': 0.823543, 'x6': 0.654053} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.012623, 0.0), 'l2norm': (1.219746, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.912443, 'x2': 0.410203, 'x3': 0.956054, 'x4': 0.558295, 'x5': 0.143371, 'x6': 0.673672} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.298741, 0.0), 'l2norm': (1.643454, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.470742, 'x2': 0.809175, 'x3': 0.888021, 'x4': 0.923421, 'x5': 0.008376, 'x6': 0.851274} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.159117, 0.0), 'l2norm': (1.800663, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.953139, 'x2': 0.757169, 'x3': 0.884338, 'x4': 0.19917, 'x5': 0.63656, 'x6': 0.947568} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.04091, 0.0), 'l2norm': (1.899104, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.065875, 'x2': 0.830336, 'x3': 0.209183, 'x4': 0.519807, 'x5': 0.39785, 'x6': 0.210257} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.329269, 0.0), 'l2norm': (1.100112, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.538918, 'x2': 0.988224, 'x3': 0.941543, 'x4': 0.282868, 'x5': 0.189363, 'x6': 0.421953} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.170027, 0.0), 'l2norm': (1.56443, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.591468, 'x2': 0.371087, 'x3': 0.92552, 'x4': 0.358084, 'x5': 0.495212, 'x6': 0.769208} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.603883, 0.0), 'l2norm': (1.519628, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.690951, 'x2': 0.030641, 'x3': 0.216716, 'x4': 0.716453, 'x5': 0.291473, 'x6': 0.575743} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:00] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.223249, 0.0), 'l2norm': (1.206258, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:08] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.177877, 'x2': 0.674407, 'x3': 0.421198, 'x4': 0.338802, 'x5': 0.594461, 'x6': 0.219123} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:08] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.45371, 0.0), 'l2norm': (1.086305, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:16] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.231516, 'x2': 0.616074, 'x3': 0.476394, 'x4': 0.335011, 'x5': 0.465578, 'x6': 0.263612} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:16] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.634692, 0.0), 'l2norm': (1.028875, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:26] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.291882, 'x2': 0.5522, 'x3': 0.568437, 'x4': 0.331709, 'x5': 0.410356, 'x6': 0.333812} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:26] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.845565, 0.0), 'l2norm': (1.050283, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:35] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.33613, 'x2': 0.500325, 'x3': 0.646939, 'x4': 0.333627, 'x5': 0.377844, 'x6': 0.398972} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:35] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.056369, 0.0), 'l2norm': (1.093202, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:42] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.366051, 'x2': 0.451651, 'x3': 0.71543, 'x4': 0.335184, 'x5': 0.347802, 'x6': 0.453928} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:42] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.251565, 0.0), 'l2norm': (1.135424, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:48] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.369722, 'x2': 0.396793, 'x3': 0.776089, 'x4': 0.331656, 'x5': 0.300074, 'x6': 0.485381} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:48] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.392822, 0.0), 'l2norm': (1.154161, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:53] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.336904, 'x2': 0.344148, 'x3': 0.819443, 'x4': 0.31952, 'x5': 0.248514, 'x6': 0.469396} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:34:53] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.303993, 0.0), 'l2norm': (1.134731, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:03] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.396041, 'x2': 0.393813, 'x3': 0.761329, 'x4': 0.341066, 'x5': 0.261872, 'x6': 0.548757} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:03] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.56399, 0.0), 'l2norm': (1.173711, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:08] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.401077, 'x2': 0.389952, 'x3': 0.719855, 'x4': 0.352102, 'x5': 0.207668, 'x6': 0.597962} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:08] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.592274, 0.0), 'l2norm': (1.164378, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:17] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.44262, 'x2': 0.378485, 'x3': 0.729044, 'x4': 0.317232, 'x5': 0.199577, 'x6': 0.569486} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:17] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-1.45421, 0.0), 'l2norm': (1.155617, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:23] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.372955, 'x2': 0.391623, 'x3': 0.768302, 'x4': 0.37871, 'x5': 0.244363, 'x6': 0.601324} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:23] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-1.616371, 0.0), 'l2norm': (1.203112, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:29] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.351682, 'x2': 0.407125, 'x3': 0.737527, 'x4': 0.338623, 'x5': 0.257507, 'x6': 0.623074} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:29] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-1.865098, 0.0), 'l2norm': (1.184303, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:35] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.305094, 'x2': 0.423341, 'x3': 0.722495, 'x4': 0.301513, 'x5': 0.279932, 'x6': 0.666682} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:35] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.08928, 0.0), 'l2norm': (1.186607, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameterization, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameterization))" ] }, { "cell_type": "markdown", "id": "260a661c", "metadata": { "papermill": { "duration": 0.054381, "end_time": "2024-03-01T16:35:35.939914", "exception": false, "start_time": "2024-03-01T16:35:35.885533", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "b52a0002", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:36.040976Z", "iopub.status.busy": "2024-03-01T16:35:36.040326Z", "iopub.status.idle": "2024-03-01T16:35:36.047618Z", "shell.execute_reply": "2024-03-01T16:35:36.046906Z" }, "papermill": { "duration": 0.059475, "end_time": "2024-03-01T16:35:36.049018", "exception": false, "start_time": "2024-03-01T16:35:35.989543", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "aaa2aff2", "metadata": { "papermill": { "duration": 0.047396, "end_time": "2024-03-01T16:35:36.145159", "exception": false, "start_time": "2024-03-01T16:35:36.097763", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "886754fc", "metadata": { "papermill": { "duration": 0.046769, "end_time": "2024-03-01T16:35:36.239160", "exception": false, "start_time": "2024-03-01T16:35:36.192391", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "84d624df", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:36.335192Z", "iopub.status.busy": "2024-03-01T16:35:36.334537Z", "iopub.status.idle": "2024-03-01T16:35:36.355678Z", "shell.execute_reply": "2024-03-01T16:35:36.355104Z" }, "papermill": { "duration": 0.070764, "end_time": "2024-03-01T16:35:36.357091", "exception": false, "start_time": "2024-03-01T16:35:36.286327", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:36] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
0GenerationStep_0Sobol0COMPLETED{'0_0': {'x1': 0.98, 'x2': 0.78, 'x3': 0.3, 'x...
1GenerationStep_0Sobol1COMPLETED{'1_0': {'x1': 0.25, 'x2': 0.57, 'x3': 0.53, '...
2GenerationStep_0Sobol2COMPLETED{'2_0': {'x1': 0.0, 'x2': 0.27, 'x3': 0.35, 'x...
3GenerationStep_0Sobol3COMPLETED{'3_0': {'x1': 0.03, 'x2': 0.39, 'x3': 0.6, 'x...
4GenerationStep_0Sobol4COMPLETED{'4_0': {'x1': 0.57, 'x2': 0.22, 'x3': 0.02, '...
5GenerationStep_0Sobol5COMPLETED{'5_0': {'x1': 0.91, 'x2': 0.41, 'x3': 0.96, '...
6GenerationStep_0Sobol6COMPLETED{'6_0': {'x1': 0.47, 'x2': 0.81, 'x3': 0.89, '...
7GenerationStep_0Sobol7COMPLETED{'7_0': {'x1': 0.95, 'x2': 0.76, 'x3': 0.88, '...
8GenerationStep_0Sobol8COMPLETED{'8_0': {'x1': 0.07, 'x2': 0.83, 'x3': 0.21, '...
9GenerationStep_0Sobol9COMPLETED{'9_0': {'x1': 0.54, 'x2': 0.99, 'x3': 0.94, '...
10GenerationStep_0Sobol10COMPLETED{'10_0': {'x1': 0.59, 'x2': 0.37, 'x3': 0.93, ...
11GenerationStep_0Sobol11COMPLETED{'11_0': {'x1': 0.69, 'x2': 0.03, 'x3': 0.22, ...
12GenerationStep_1BoTorch12COMPLETED{'12_0': {'x1': 0.18, 'x2': 0.67, 'x3': 0.42, ...
13GenerationStep_1BoTorch13COMPLETED{'13_0': {'x1': 0.23, 'x2': 0.62, 'x3': 0.48, ...
14GenerationStep_1BoTorch14COMPLETED{'14_0': {'x1': 0.29, 'x2': 0.55, 'x3': 0.57, ...
15GenerationStep_1BoTorch15COMPLETED{'15_0': {'x1': 0.34, 'x2': 0.5, 'x3': 0.65, '...
16GenerationStep_1BoTorch16COMPLETED{'16_0': {'x1': 0.37, 'x2': 0.45, 'x3': 0.72, ...
17GenerationStep_1BoTorch17COMPLETED{'17_0': {'x1': 0.37, 'x2': 0.4, 'x3': 0.78, '...
18GenerationStep_1BoTorch18COMPLETED{'18_0': {'x1': 0.34, 'x2': 0.34, 'x3': 0.82, ...
19GenerationStep_1BoTorch19COMPLETED{'19_0': {'x1': 0.4, 'x2': 0.39, 'x3': 0.76, '...
20GenerationStep_1BoTorch20COMPLETED{'20_0': {'x1': 0.4, 'x2': 0.39, 'x3': 0.72, '...
21GenerationStep_1BoTorch21COMPLETED{'21_0': {'x1': 0.44, 'x2': 0.38, 'x3': 0.73, ...
22GenerationStep_1BoTorch22COMPLETED{'22_0': {'x1': 0.37, 'x2': 0.39, 'x3': 0.77, ...
23GenerationStep_1BoTorch23COMPLETED{'23_0': {'x1': 0.35, 'x2': 0.41, 'x3': 0.74, ...
24GenerationStep_1BoTorch24COMPLETED{'24_0': {'x1': 0.31, 'x2': 0.42, 'x3': 0.72, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 GenerationStep_0 Sobol 0 COMPLETED \n", "1 GenerationStep_0 Sobol 1 COMPLETED \n", "2 GenerationStep_0 Sobol 2 COMPLETED \n", "3 GenerationStep_0 Sobol 3 COMPLETED \n", "4 GenerationStep_0 Sobol 4 COMPLETED \n", "5 GenerationStep_0 Sobol 5 COMPLETED \n", "6 GenerationStep_0 Sobol 6 COMPLETED \n", "7 GenerationStep_0 Sobol 7 COMPLETED \n", "8 GenerationStep_0 Sobol 8 COMPLETED \n", "9 GenerationStep_0 Sobol 9 COMPLETED \n", "10 GenerationStep_0 Sobol 10 COMPLETED \n", "11 GenerationStep_0 Sobol 11 COMPLETED \n", "12 GenerationStep_1 BoTorch 12 COMPLETED \n", "13 GenerationStep_1 BoTorch 13 COMPLETED \n", "14 GenerationStep_1 BoTorch 14 COMPLETED \n", "15 GenerationStep_1 BoTorch 15 COMPLETED \n", "16 GenerationStep_1 BoTorch 16 COMPLETED \n", "17 GenerationStep_1 BoTorch 17 COMPLETED \n", "18 GenerationStep_1 BoTorch 18 COMPLETED \n", "19 GenerationStep_1 BoTorch 19 COMPLETED \n", "20 GenerationStep_1 BoTorch 20 COMPLETED \n", "21 GenerationStep_1 BoTorch 21 COMPLETED \n", "22 GenerationStep_1 BoTorch 22 COMPLETED \n", "23 GenerationStep_1 BoTorch 23 COMPLETED \n", "24 GenerationStep_1 BoTorch 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.98, 'x2': 0.78, 'x3': 0.3, 'x... \n", "1 {'1_0': {'x1': 0.25, 'x2': 0.57, 'x3': 0.53, '... \n", "2 {'2_0': {'x1': 0.0, 'x2': 0.27, 'x3': 0.35, 'x... \n", "3 {'3_0': {'x1': 0.03, 'x2': 0.39, 'x3': 0.6, 'x... \n", "4 {'4_0': {'x1': 0.57, 'x2': 0.22, 'x3': 0.02, '... \n", "5 {'5_0': {'x1': 0.91, 'x2': 0.41, 'x3': 0.96, '... \n", "6 {'6_0': {'x1': 0.47, 'x2': 0.81, 'x3': 0.89, '... \n", "7 {'7_0': {'x1': 0.95, 'x2': 0.76, 'x3': 0.88, '... \n", "8 {'8_0': {'x1': 0.07, 'x2': 0.83, 'x3': 0.21, '... \n", "9 {'9_0': {'x1': 0.54, 'x2': 0.99, 'x3': 0.94, '... \n", "10 {'10_0': {'x1': 0.59, 'x2': 0.37, 'x3': 0.93, ... \n", "11 {'11_0': {'x1': 0.69, 'x2': 0.03, 'x3': 0.22, ... \n", "12 {'12_0': {'x1': 0.18, 'x2': 0.67, 'x3': 0.42, ... \n", "13 {'13_0': {'x1': 0.23, 'x2': 0.62, 'x3': 0.48, ... \n", "14 {'14_0': {'x1': 0.29, 'x2': 0.55, 'x3': 0.57, ... \n", "15 {'15_0': {'x1': 0.34, 'x2': 0.5, 'x3': 0.65, '... \n", "16 {'16_0': {'x1': 0.37, 'x2': 0.45, 'x3': 0.72, ... \n", "17 {'17_0': {'x1': 0.37, 'x2': 0.4, 'x3': 0.78, '... \n", "18 {'18_0': {'x1': 0.34, 'x2': 0.34, 'x3': 0.82, ... \n", "19 {'19_0': {'x1': 0.4, 'x2': 0.39, 'x3': 0.76, '... \n", "20 {'20_0': {'x1': 0.4, 'x2': 0.39, 'x3': 0.72, '... \n", "21 {'21_0': {'x1': 0.44, 'x2': 0.38, 'x3': 0.73, ... \n", "22 {'22_0': {'x1': 0.37, 'x2': 0.39, 'x3': 0.77, ... \n", "23 {'23_0': {'x1': 0.35, 'x2': 0.41, 'x3': 0.74, ... \n", "24 {'24_0': {'x1': 0.31, 'x2': 0.42, 'x3': 0.72, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "6d243176", "metadata": { "papermill": { "duration": 0.047216, "end_time": "2024-03-01T16:35:36.451229", "exception": false, "start_time": "2024-03-01T16:35:36.404013", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "61ba59a1", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:36.547630Z", "iopub.status.busy": "2024-03-01T16:35:36.547111Z", "iopub.status.idle": "2024-03-01T16:35:36.841171Z", "shell.execute_reply": "2024-03-01T16:35:36.840503Z" }, "papermill": { "duration": 0.344089, "end_time": "2024-03-01T16:35:36.842854", "exception": false, "start_time": "2024-03-01T16:35:36.498765", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.3050938293898015,\n", " 'x2': 0.4233409740952644,\n", " 'x3': 0.7224953769282285,\n", " 'x4': 0.30151298944537835,\n", " 'x5': 0.27993173308995967,\n", " 'x6': 0.6666818268490359}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "3198a70f", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:36.980752Z", "iopub.status.busy": "2024-03-01T16:35:36.980007Z", "iopub.status.idle": "2024-03-01T16:35:36.985356Z", "shell.execute_reply": "2024-03-01T16:35:36.984630Z" }, "papermill": { "duration": 0.067482, "end_time": "2024-03-01T16:35:36.987003", "exception": false, "start_time": "2024-03-01T16:35:36.919521", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 1.1866080001045465, 'hartmann6': -2.0892725379556696}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "48ded429", "metadata": { "papermill": { "duration": 0.04898, "end_time": "2024-03-01T16:35:37.085298", "exception": false, "start_time": "2024-03-01T16:35:37.036318", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "24d6642f", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:37.182622Z", "iopub.status.busy": "2024-03-01T16:35:37.182179Z", "iopub.status.idle": "2024-03-01T16:35:37.186961Z", "shell.execute_reply": "2024-03-01T16:35:37.186343Z" }, "papermill": { "duration": 0.054735, "end_time": "2024-03-01T16:35:37.188278", "exception": false, "start_time": "2024-03-01T16:35:37.133543", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "a38cad20", "metadata": { "papermill": { "duration": 0.047387, "end_time": "2024-03-01T16:35:37.283175", "exception": false, "start_time": "2024-03-01T16:35:37.235788", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "bff5f010", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:37.380227Z", "iopub.status.busy": "2024-03-01T16:35:37.379585Z", "iopub.status.idle": "2024-03-01T16:35:38.025177Z", "shell.execute_reply": "2024-03-01T16:35:38.024429Z" }, "papermill": { "duration": 0.69924, "end_time": "2024-03-01T16:35:38.030103", "exception": false, "start_time": "2024-03-01T16:35:37.330863", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:37] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.5621403423739297, -0.5823908991331133, -0.6023697357785088, -0.6218640458897486, -0.6406456839538687, -0.658474288046823, -0.675101268345013, -0.690274659328344, -0.703744785455538, -0.7152706325789941, -0.7246267529380127, -0.7316104645225039, -0.7360490420401514, -0.7378065442582051, -0.7367898895335258, -0.7329537859808448, -0.7263041513063231, -0.71689972291018, -0.7048516598452378, -0.6903210675562002, -0.6735145216582221, -0.654677812066818, -0.6340882559675579, -0.612046021817592, -0.5888649563591187, -0.5648634092032873, -0.5403555089619523, -0.5156432709737782, -0.491009822250297, -0.46671392739535356, -0.44298590093451046, -0.4200249045574088, -0.39799755673370546, -0.3770377287265883, -0.3572473649060192, -0.33869814491243566, -0.32143379841351744, -0.3054728874008588, -0.2908118835927997, -0.2774283870403419, -0.26528435418396357, -0.25432922739536107, -0.24450288184422747, -0.23573832813601747, -0.2279641297346533, -0.2211065122143383, -0.21509115664931155, -0.2098446819230203, -0.2052958305275775, -0.20137637972270162 ], [ -0.5802724737973236, -0.6018008049469352, -0.6230712107653207, -0.6438574382970159, -0.6639159758107686, -0.6829892836700556, -0.7008099877911697, -0.7171060467221898, -0.7316068508953742, -0.74405014823719, -0.7541896165150681, -0.7618028241861746, -0.7666992450400563, -0.7687279266029202, -0.767784368386072, -0.7638161538548445, -0.7568269078728744, -0.74687822390086, -0.7340893212560053, -0.7186343442187728, -0.7007373867646063, -0.6806654990316099, -0.6587200822643554, -0.6352271883704039, -0.6105272955853251, -0.5849651295924931, -0.5588800457597028, -0.532597396042194, -0.5064211900547558, -0.4806282399171017, -0.45546386566511726, -0.4311391408780219, -0.4078295810505493, -0.3856751211777411, -0.3647811928774843, -0.3452206928057137, -0.32703663023496127, -0.31024524942925447, -0.2948394388761423, -0.2807922617354767, -0.2680604675275011, -0.2565878719759505, -0.24630851834329992, -0.23714955829558787, -0.22903381249385113, -0.22188199027891287, -0.2156145638372836, -0.21015330515509345, -0.2054225040608184, -0.20134989297566974 ], [ -0.5986123663630243, -0.6214530734235933, -0.6440527397059382, -0.6661714180799698, -0.6875498341572412, -0.7079127076479844, -0.7269731389710442, -0.744438088346617, -0.7600149178421435, -0.7734188953209953, -0.7843814752040938, -0.7926590792730435, -0.7980420092401458, -0.8003630420779384, -0.7995052016679949, -0.7954081790879376, -0.7880728998384304, -0.7775638160831059, -0.7640086351251688, -0.7475953727419782, -0.7285668235793228, -0.7072127455648792, -0.6838602335994913, -0.6588628851790616, -0.632589421436325, -0.6054124179115884, -0.5776977288340601, -0.5497950742650777, -0.5220301221857212, -0.49469825720402805, -0.46806009902176626, -0.4423387262826268, -0.4177184787661628, -0.3943451530991158, -0.372327371966789, -0.35173889091389576, -0.3326216066128161, -0.3149890423887828, -0.2988301074743961, -0.28411295285490457, -0.2707887759566294, -0.2587954565568112, -0.24806093538162688, -0.2385062736482118, -0.23004835551156055, -0.22260221561624072, -0.2160829906500774, -0.21040750708259093, -0.20549552739652766, -0.2012706843954084 ], [ -0.617081792036271, -0.641263929306988, -0.6652250437729071, -0.6887113243305317, -0.7114474193226119, -0.7331398273991137, -0.7534814615859153, -0.7721574333066781, -0.7888520423411189, -0.8032568798581086, -0.8150798565818141, -0.8240548618270532, -0.8299516502645515, -0.8325854542119592, -0.8318257451717261, -0.8276035354036495, -0.8199166328842389, -0.8088323502661812, -0.7944873210935762, -0.7770842842408905, -0.7568859384803757, -0.7342062122368866, -0.709399504338187, -0.6828485993650972, -0.6549520270186291, -0.6261116156334867, -0.5967208979804707, -0.5671548859098015, -0.5377615659338465, -0.5088553044441305, -0.4807122060323402, -0.45356735070985554, -0.42761374854811696, -0.403002791926448, -0.3798459524965995, -0.3582174577370355, -0.33815768619392356, -0.3196770371292714, -0.3027600556336057, -0.28736962500881646, -0.27345107151005393, -0.2609360599736601, -0.2497461906252723, -0.23979623620107693, -0.23099698369344074, -0.22325766625111254, -0.21648798804454283, -0.2105997584719892, -0.20550816226323232, -0.20113269920645327 ], [ -0.6355945899590479, -0.6611406934071185, -0.6864889009102624, -0.7113714531821503, -0.735496699651827, -0.758552534751142, -0.780211119834933, -0.8001349605687993, -0.8179843453119771, -0.8334260638457625, -0.8461432189585485, -0.8558458208151071, -0.862281725218546, -0.8652473561407139, -0.8645975585568788, -0.8602538798179842, -0.8522105950754297, -0.8405378872501089, -0.8253817669217167, -0.8069605606765534, -0.7855580814384733, -0.7615138826779388, -0.7352112468608408, -0.7070637290395408, -0.677501146165959, -0.6469558692816187, -0.6158501567109772, -0.5845850921081972, -0.553531495359776, -0.5230229856184119, -0.49335121328040266, -0.46476315059918866, -0.4374602400906463, -0.4115991424881662, -0.3872937963488536, -0.3646184938524329, -0.3436116867256991, -0.3242802580593442, -0.3066040261001285, -0.29054028140733984, -0.27602819604078566, -0.2629929802256257, -0.2513496963548744, -0.24100667100745304, -0.23186847221460216, -0.2238384413007719, -0.21682078638581903, -0.21072225838872072, -0.20545344053415915, -0.2009296893660344 ], [ -0.654056951928573, -0.6809820471528529, -0.7077353780619126, -0.7340352449170934, -0.7595735796247021, -0.7840194006319624, -0.8070236693345281, -0.8282256446907981, -0.8472607655511559, -0.8637699968946208, -0.8774104569784281, -0.8878670019207104, -0.8948642926692107, -0.8981787231199352, -0.8976494693258524, -0.8931878533183008, -0.8847842248665508, -0.8725116674996253, -0.8565260355352273, -0.8370621135093987, -0.8144260261334585, -0.7889843680989622, -0.7611508147911255, -0.7313711702559796, -0.7001078803148751, -0.6678249860051819, -0.6349743398854998, -0.6019836946986243, -0.5692470423989333, -0.5371173655591099, -0.5059017835139097, -0.47585894033325393, -0.44719838970945797, -0.4200816771210082, -0.39462479479841767, -0.37090168313023364, -0.3489484673551427, -0.328768145826943, -0.31033548166169145, -0.29360188955408245, -0.27850015085778135, -0.2649488301163756, -0.2528563032243416, -0.24212434009101907, -0.23265121249558857, -0.2243343206707013, -0.21707235028537597, -0.21076698534775273, -0.20532421261677525, -0.2006552598938548 ], [ -0.6723678848853409, -0.7006784956876446, -0.728846284483361, -0.7565757153255386, -0.7835422955521016, -0.8093960202697057, -0.8337663364832907, -0.8562687543185131, -0.8765131636137253, -0.8941138141397563, -0.908700785760305, -0.9199326148307625, -0.9275095657756309, -0.9311868608420071, -0.930787032819859, -0.926210476115463, -0.9174432714063369, -0.9045614706969718, -0.887731259671032, -0.8672047475502164, -0.8433115319115078, -0.8164465881313492, -0.7870553735799721, -0.7556172579171684, -0.7226284610392684, -0.6885856018235232, -0.6539707671189047, -0.6192387522550727, -0.58480685326677, -0.5510473464972331, -0.518282595196156, -0.4867825812525551, -0.4567645689256845, -0.4283945573011721, -0.40179015957992237, -0.3770245519875199, -0.3541311566266995, -0.3331087559025803, -0.31392677698912014, -0.2965305294760699, -0.28084622463637354, -0.2667856480816125, -0.25425039703462254, -0.24313562789192977, -0.23333328869201386, -0.22473483458653082, -0.21723344280790524, -0.21072575748520328, -0.20511320456947546, -0.20030292364396285 ], [ -0.6904198647373267, -0.7201130480033643, -0.7496948696312082, -0.7788561607096786, -0.807256115084735, -0.8345256929345057, -0.8602726630245923, -0.8840884457595201, -0.9055568491376945, -0.9242646837160606, -0.9398140978068164, -0.9518362930094173, -0.9600060737443744, -0.9640564738756165, -0.9637925202170123, -0.9591030752491396, -0.9499696885653174, -0.9364715078938881, -0.9187855656762361, -0.8971821478628501, -0.8720154192048473, -0.8437099509404498, -0.8127441905613944, -0.7796321602042344, -0.7449047341961726, -0.7090917345428758, -0.6727058404118587, -0.6362289982064172, -0.6001017049731099, -0.5647152645053914, -0.5304069047541907, -0.4974575000169005, -0.46609155332597085, -0.43647905085821975, -0.4087387890626413, -0.38294278716091745, -0.35912142585700224, -0.33726899236152663, -0.31734935797415526, -0.299301563758265, -0.2830451390325387, -0.26848502384264067, -0.2555160083672434, -0.2440266382613308, -0.23390256487110173, -0.22502934324149082, -0.21729469939229773, -0.2105903021252311, -0.20481308431699263, -0.1998661648622252 ], [ -0.708099691697917, -0.7391621281668783, -0.770146784487717, -0.8007311612327014, -0.830558372215126, -0.859240476091883, -0.8863635651063908, -0.9114948115825598, -0.9341916033409206, -0.9540127882698246, -0.9705318905776099, -0.9833519575604712, -0.9921214566651846, -0.9965503918367672, -0.9964255830819452, -0.9916239017243784, -0.982122225576363, -0.9680030114962727, -0.9494546903934462, -0.926766548616306, -0.9003183086447756, -0.8705651708866909, -0.8380195281140881, -0.80323083369346, -0.7667651555627356, -0.7291857941545178, -0.6910360428595348, -0.6528248037256982, -0.6150154126157854, -0.5780177267792834, -0.5421833049310323, -0.5078033641393556, -0.47510911559321484, -0.4442740460573545, -0.4154177092217498, -0.38861061082688536, -0.36387980636736217, -0.3412148753286701, -0.3205739872051138, -0.30188982829934863, -0.28507521122204876, -0.2700282383975231, -0.25663693484039996, -0.24478330296697814, -0.23434678298280415, -0.22520712675961774, -0.217246711732752, -0.21035233499495787, -0.20441653719318353, -0.19933851171117112 ], [ -0.7252895518550089, -0.7576967256180834, -0.790061318522348, -0.8220479001581948, -0.8532838619347701, -0.8833626461554391, -0.9118488485681328, -0.9382854370955647, -0.9622032622487482, -0.9831329202647889, -1.0006188599661643, -1.0142353967936824, -1.0236040220129556, -1.028411097713318, -1.0284247534702087, -1.0235096081008477, -1.0136378934151637, -0.9988957058609862, -0.9794834724893268, -0.9557102586084446, -0.9279821870279478, -0.8967858711208381, -0.8626682684409069, -0.8262146470822617, -0.7880263850462415, -0.748700118036548, -0.7088093880976402, -0.6688895200994234, -0.6294260501507685, -0.5908467032837024, -0.5535166861296295, -0.5177369170573977, -0.4837447422175277, -0.45171666045174547, -0.42177258658267675, -0.39398121010820264, -0.3683660478325033, -0.3449118397548329, -0.3235709937329681, -0.3042698424220698, -0.28691453242956444, -0.27139641777408574, -0.257596875690113, -0.24539150161121426, -0.2346536716535766, -0.22525748556820663, -0.21708012172930247, -0.21000364917453507, -0.2039163508489069, -0.1987136177329838 ], [ -0.741868282944965, -0.7755837847912918, -0.8092929157361438, -0.8426478067270075, -0.8752606079001688, -0.9067065862999787, -0.9365292097064377, -0.9642475045836635, -0.9893659131145721, -1.0113867581140652, -1.029825243182154, -1.0442266630822505, -1.0541851835267466, -1.0593631982764982, -1.0595099375356225, -1.0544777597198782, -1.0442344909538321, -1.0288703476235794, -1.0085984057930024, -0.9837482226371499, -0.9547529646279018, -0.922131115877029, -0.8864643917411411, -0.8483737710860128, -0.8084955535380142, -0.7674590838226188, -0.7258673554246544, -0.6842812212910216, -0.6432074947576972, -0.6030908755163448, -0.5643093987954845, -0.5271729681291268, -0.49192446809348034, -0.45874293852354736, -0.4277483075823872, -0.3990072161638408, -0.3725395138246818, -0.34832506248306316, -0.3263105448840463, -0.3064160367695659, -0.2885411614173095, -0.2725706999179094, -0.25837957833092257, -0.24583719279275057, -0.23481106572611915, -0.22516985112869986, -0.21678572543433616, -0.20953621365300523, -0.2033055093194277, -0.19798535195894618 ], [ -0.7577128344140708, -0.7926878250532794, -0.8276929624585511, -0.8623685179875831, -0.8963120022618127, -0.9290811057509881, -0.9601987328560624, -0.9891604654535417, -1.0154447350941704, -1.0385258673957574, -1.0578899708664038, -1.0730533646873064, -1.0835828798540952, -1.0891169546481847, -1.0893860408888223, -1.084230535516204, -1.0736143598358723, -1.0576325109998013, -1.036511428148994, -1.0106017821677429, -0.9803641698135012, -0.9463489954306361, -0.9091724048237143, -0.8694904054294673, -0.8279732493441074, -0.785281826619077, -0.7420473215309181, -0.6988548463976296, -0.6562312872886393, -0.61463723091661, -0.5744626038191765, -0.536025524635068, -0.4995738171927889, -0.4652886279366398, -0.43328961598709864, -0.40364122627667137, -0.376359609567939, -0.3514198139785605, -0.3287629375896526, -0.3083029973004217, -0.2899333318595107, -0.2735324140597512, -0.2589689964997095, -0.24610655625064004, -0.23480703632559324, -0.2249339067831626, -0.2163545866858454, -0.20894228108954693, -0.20257729574895256, -0.19714789706083158 ], [ -0.7726999030743953, -0.8088727714437479, -0.8451118270600045, -0.8810461401077369, -0.9162592994465797, -0.9502921747289018, -0.9826478727184027, -1.0127992735886664, -1.040199484736824, -1.0642954371415343, -1.0845446502898182, -1.1004348888682383, -1.1115060262518672, -1.1173729451793433, -1.1177478172649327, -1.1124597277652661, -1.1014694909283056, -1.0848777475198697, -1.0629250731458086, -1.0359837514846169, -1.0045418781853002, -0.9691813367987632, -0.9305517673051019, -0.8893428655806316, -0.8462572262237312, -0.8019855471729541, -0.7571854654137266, -0.7124647133753097, -0.6683687787723376, -0.6253728741599216, -0.5838777851091561, -0.5442090436614042, -0.5066188311316215, -0.4712900199890866, -0.4383417973210539, -0.4078363607502437, -0.3797862360344491, -0.3541618306646998, -0.3308989065297915, -0.3099057236466548, -0.2910696725172208, -0.27426327187822913, -0.2593494595111597, -0.24618614559494917, -0.23463003103891805, -0.2245397182251886, -0.2157781598253815, -0.20821450405373498, -0.201725402922741, -0.19619585458254007 ], [ -0.786707716397659, -0.8240039654108872, -0.8614011180387489, -0.8985177731464153, -0.9349244258031513, -0.9701460354682946, -1.00366688112329, -1.0349381398079047, -1.0633885875481988, -1.088438715244322, -1.109518348258491, -1.12608753167349, -1.1376599840336676, -1.1438278571019393, -1.144285950420316, -1.1388530640356471, -1.1274880161957883, -1.110298158953551, -1.087539020623921, -1.0596048341901145, -1.02701088346929, -0.9903695264118101, -0.9503622810027776, -0.9077104778676783, -0.8631467703259855, -0.817389343059409, -0.771120078788724, -0.7249673407205425, -0.6794935066674435, -0.6351870073081167, -0.5924583848067286, -0.5516397723556176, -0.5129871612497003, -0.47668483593147387, -0.4428513969140288, -0.4115468451220387, -0.3827802638657845, -0.35651770353822476, -0.3326899463111844, -0.31119990009191073, -0.29192943911618974, -0.2747455697152367, -0.2595058520297326, -0.24606305103590242, -0.23426902353721651, -0.22397787279464887, -0.21504842054917328, -0.2073460586428073, -0.20074405036840126, -0.19512435589990684 ], [ -0.7996179262639809, -0.8379503132982635, -0.8764161128168024, -0.9146242458924042, -0.9521330457417507, -0.9884526237716507, -1.0230496063479466, -1.055354729061527, -1.0847737506258501, -1.1107020512834143, -1.1325430754839219, -1.149730430275576, -1.1617529390967478, -1.1681812958648456, -1.1686942581767252, -1.1631017421013203, -1.1513619787088114, -1.1335902758807899, -1.1100579340614731, -1.0811812593848873, -1.0475019780404895, -1.0096613016260594, -0.9683702921895182, -0.9243791315214038, -0.8784475801502712, -0.8313184284134582, -0.7836951629442122, -0.7362244754746312, -0.6894837168798457, -0.643973011420462, -0.600111508500221, -0.5582371364730542, -0.5186091944408293, -0.48141313761149696, -0.4467669563898345, -0.4147286072995487, -0.38530402021407506, -0.35845527861379767, -0.3341086448823134, -0.31216217741857766, -0.29249275677737857, -0.27496240097926794, -0.25942380356556566, -0.24572507125568543, -0.23371367164539697, -0.2232396264252453, -0.21415800354145498, -0.20633077395972954, -0.1996281063719576, -0.19392917714965796 ], [ -0.811317567417481, -0.8505865195510635, -0.890018296036977, -0.929212990439799, -0.9677178039008025, -1.005029209370596, -1.040597560710119, -1.0738346819673708, -1.1041249619541058, -1.130840394081263, -1.1533597990014075, -1.1710921014394926, -1.1835029686949878, -1.1901433669940884, -1.1906777511270337, -1.1849088916208406, -1.1727960801949582, -1.154463930911572, -1.130200266828748, -1.1004433160460674, -1.0657600230011386, -1.026818199250215, -0.9843554113260884, -0.9391472167238943, -0.8919769192904616, -0.843608536075728, -0.7947641405424722, -0.7461061888372431, -0.6982249221939224, -0.6516305454455682, -0.6067496370765925, -0.5639251305623072, -0.5234191791461331, -0.48541823882179436, -0.4500397523920102, -0.4173398787964637, -0.387321781467884, -0.3599440647316542, -0.33512902537733946, -0.31277046380978124, -0.292740871710677, -0.2748978776521975, -0.2590898866087478, -0.24516089321442247, -0.23295448246634465, -0.2223170566499587, -0.21310034510279563, -0.20516326550080788, -0.19837321283161224, -0.1926068559671541 ], [ -0.8217010276585798, -0.8617953423538458, -0.9020779343364155, -0.9421409711531935, -0.9815216438821013, -1.019704139463804, -1.05612412218147, -1.0901763047958055, -1.1212256950416066, -1.1486230325142652, -1.1717247353205593, -1.189917296742466, -1.2026454591843594, -1.2094426413825445, -1.2099611047079475, -1.2039984734007525, -1.1915168781034264, -1.1726515724280813, -1.1477074721485967, -1.1171442256507815, -1.0815522695813957, -1.0416231600944978, -0.9981172993115381, -0.9518315561447432, -0.9035687111383933, -0.8541102314922321, -0.8041934667829111, -0.7544938717340287, -0.7056123695232777, -0.6580675672110653, -0.6122922755574143, -0.5686336597893135, -0.5273563163256535, -0.4886475931088534, -0.45262452121222335, -0.4193417893094699, -0.3888002649171533, -0.36095564429129373, -0.3357268935128752, -0.31300422282043316, -0.2926564106157751, -0.27453735947084285, -0.25849182191464415, -0.2443602782423857, -0.23198298270842038, -0.2212032196071354, -0.21186982853373826, -0.20383907006938662, -0.19697591046822538, -0.1911548075024514 ], [ -0.8306719715968041, -0.8714698025803504, -0.9124766056628232, -0.9532775711413568, -0.9934010892851765, -1.0323205509430602, -1.0694587119452004, -1.1041952420975127, -1.135878100112355, -1.1638393210548883, -1.187415617527878, -1.205973809348953, -1.2189404403005242, -1.225833990928233, -1.2262969480600838, -1.2201239391029084, -1.2072816872706422, -1.187917228575187, -1.1623528105831638, -1.1310685633811817, -1.0946761895225379, -1.0538876194866809, -1.009481938589465, -0.9622728429641718, -0.9130781807687933, -0.8626928272106048, -0.8118659005018328, -0.7612829498704649, -0.7115532823963572, -0.6632021792590808, -0.6166674692426013, -0.572299784280632, -0.5303657813573313, -0.49105363484643694, -0.45448015379112117, -0.42069894439287203, -0.38970911265180297, -0.3614640824765743, -0.3358801874748167, -0.3128447761040784, -0.2922236458102125, -0.27386768887158514, -0.2576186889411011, -0.243314252253595, -0.23079189186101812, -0.21989230851227604, -0.2104619295916692, -0.20235477943114388, -0.19543376155503833, -0.1895714368735698 ], [ -0.8381451571892677, -0.87951527332552, -0.9211095962688757, -0.9625073327449489, -1.003229364071728, -1.0427399056090987, -1.0804507756870505, -1.1157289287144951, -1.1479079418782032, -1.1763041060351682, -1.200237598717745, -1.2190588289505082, -1.2321793525979046, -1.239105716975906, -1.239473287818941, -1.2330758645492856, -1.219886307947509, -1.2000641813765205, -1.1739487952807008, -1.1420392960160068, -1.1049659539979493, -1.0634573266441207, -1.0183067516550035, -0.9703400689932795, -0.9203856390459824, -0.8692475886864152, -0.8176832039493572, -0.766385148289684, -0.715968755510165, -0.6669642114080382, -0.6198131248710445, -0.5748688224759952, -0.5323996468321932, -0.4925945530757364, -0.45557034721879364, -0.4213799768589681, -0.3900213612888768, -0.36144633044203994, -0.33556932687732316, -0.3122756080708792, -0.29142876351275127, -0.27287742916797514, -0.25646113883079535, -0.24201529734373234, -0.22937529534104856, -0.2183798105972079, -0.20887335893746395, -0.20070816958699167, -0.19374546704943052, -0.1878562449918616 ], [ -0.8440480847327496, -0.8858513774957074, -0.9278880783789919, -0.9697324479477094, -1.0108992281743172, -1.050845201086777, -1.0889733946032678, -1.1246406165148275, -1.1571690440438844, -1.1858625719535945, -1.2100284627961742, -1.229004457591739, -1.242190789489022, -1.249085426960802, -1.2493194232234601, -1.2426878090364633, -1.2291707387467048, -1.2089404450305532, -1.1823523506436222, -1.1499225470656855, -1.1122967541368833, -1.0702162001563913, -1.02448400049301, -0.975933498022548, -0.9253990704971532, -0.8736899799442157, -0.8215680875899398, -0.7697301729151753, -0.7187952065660816, -0.6692964727044999, -0.6216780892349081, -0.5762952800552741, -0.5334176828191531, -0.4932349816983524, -0.4558642011622942, -0.4213580636069877, -0.38971389138584983, -0.3608826176814729, -0.33477755682946725, -0.31128266895629103, -0.29026013196551537, -0.2715571027028842, -0.25501160665979106, -0.24045754144141324, -0.22772881422772606, -0.21666265910312088, -0.20710219816011377, -0.19889832229167925, -0.191910974833418, -0.18600992458111065 ], [ -0.8483224216723276, -0.890413625255552, -0.9327409865879994, -0.9748749006057489, -1.0163254114668339, -1.0565437190989524, -1.0949263637439328, -1.1308227871302767, -1.1635470235998586, -1.1923942611207088, -1.2166628645757673, -1.2356820743345973, -1.2488448631573208, -1.255644262367667, -1.2557099004493808, -1.2488398869846948, -1.2350223022636126, -1.2144414357141453, -1.1874670644729568, -1.1546295020382011, -1.1165864437181632, -1.0740877881073887, -1.0279421271150662, -0.9789859274509605, -0.9280553360396622, -0.8759608124519562, -0.8234653017667175, -0.771266738559468, -0.7199853345015789, -0.6701556357912763, -0.6222229581552365, -0.5765435843873203, -0.5333880195667953, -0.49294659455772577, -0.4553367502718859, -0.4206114006825315, -0.388767850537079, -0.35975682837190986, -0.33349128241805864, -0.30985467193192057, -0.2887085652236166, -0.2698994249247558, -0.25326451898271796, -0.2386369421100239, -0.2258497677536555, -0.2147393765819462, -0.20514802574266744, -0.19692573531527313, -0.18993157571872188, -0.18403444322695495 ], [ -0.8509251534822634, -0.893154731512791, -0.9356165212606737, -0.9778781748674137, -1.019446544573867, -1.0597691919032188, -1.098238599640188, -1.134199793727768, -1.1669621407172484, -1.1958160793287393, -1.220055405523452, -1.2390053579541966, -1.252056016430171, -1.2586993214582256, -1.2585663752065406, -1.2514599454276265, -1.237376096854197, -1.2165097627427994, -1.1892424801363084, -1.156115420198514, -1.117794491905074, -1.0750343394772996, -1.0286450540459127, -0.9794622617357325, -0.9283200128310755, -0.8760263147834574, -0.8233418869449619, -0.7709629495599509, -0.7195085857408671, -0.6695127519766231, -0.6214206118614893, -0.5755886191760563, -0.532287666587718, -0.491708599055602, -0.45396942618421826, -0.41912363031422634, -0.38716904410941255, -0.35805685589270314, -0.3317003880574626, -0.3079833789552941, -0.28676757754493437, -0.2678995295471716, -0.25121649205374813, -0.23655146009673222, -0.22373732436744975, -0.21261020554408594, -0.20301202923625394, -0.1947924179496573, -0.1878099839597802, -0.18193311044543414 ], [ -0.8518294206330739, -0.8940455656365813, -0.9364832219913006, -0.9787084623669727, -1.0202265074439159, -1.0604832954550627, -1.0988697737240862, -1.134729618391453, -1.1673711459439233, -1.1960841737078927, -1.2201624507343642, -1.2389319138849517, -1.2517842941001471, -1.2582143860439219, -1.2578576126300622, -1.250522707403263, -1.236213257653365, -1.2151327185218357, -1.1876710564734563, -1.154376381203639, -1.1159188305131933, -1.0730539958425236, -1.026589862907592, -0.9773577241231153, -0.9261861151659564, -0.8738772984523971, -0.8211867042626815, -0.7688061145791405, -0.7173511808993119, -0.6673534289332947, -0.6192564945934879, -0.5734160676338385, -0.5301028902340618, -0.48950812645928155, -0.4517504448758208, -0.41688421432094647, -0.384908287338943, -0.35577492901468294, -0.32939853525353147, -0.3056638691257329, -0.2844336224627348, -0.2655551792384717, -0.24886651555395978, -0.23420121784557774, -0.2213926369639, -0.210277222415447, -0.20069709995749696, -0.19250196841212353, -0.18555039924749983, -0.1797106260478315 ], [ -0.8510250136949502, -0.8930757004812419, -0.9353305725405805, -0.9773553233725846, -1.0186551443293381, -1.0586764117162448, -1.0968111092247088, -1.1324046816153244, -1.1647680669398035, -1.1931946427890732, -1.2169826841141467, -1.2354635673777996, -1.2480352376719068, -1.2541992612410282, -1.2535981190474539, -1.2460475865961078, -1.2315579376436667, -1.2103385389289967, -1.18278394872152, -1.1494449072209232, -1.1109916397231925, -1.06817699558887, -1.021803570588755, -0.9726952596789857, -0.9216721051788931, -0.8695277124232168, -0.8170094498681322, -0.7648021333167444, -0.7135157924384199, -0.6636777282576717, -0.6157286726480647, -0.5700225827673288, -0.5268294579317045, -0.4863405203031277, -0.4486751165363943, -0.41388874855700514, -0.3819817121219458, -0.35290790253094684, -0.32658343148908503, -0.3028947824978759, -0.2817063099160589, -0.26286695573332586, -0.24621611627136025, -0.23158863797743756, -0.2188189578218782, -0.20774443085021732, -0.19820790672500788, -0.19005963009183302, -0.1831585475206583, -0.17737310749232282 ], [ -0.8485185121556561, -0.8902535444946873, -0.9321691192439717, -0.9738317822911762, -1.0147483245044782, -1.0543676394701917, -1.0920853230401335, -1.1272516913463686, -1.1591839346898605, -1.1871831020360835, -1.210556465374258, -1.228645451988736, -1.24085863254501, -1.2467080990233952, -1.2458459610334596, -1.238095943887306, -1.2234739961230243, -1.2021925973074188, -1.1746468678027968, -1.1413857098026101, -1.1030752202789234, -1.0604618759166575, -1.0143398016185505, -0.9655227476472137, -0.9148196541619134, -0.8630129195529913, -0.81083938772813, -0.7589746162184715, -0.7080209807642522, -0.6584998521125726, -0.6108477132257218, -0.565415808586548, -0.5224727603359417, -0.48220952587424204, -0.44474607569622043, -0.41013921297832506, -0.378391021377965, -0.349457504475816, -0.32325706228372864, -0.2996785317122979, -0.27858859433958394, -0.2598384229327651, -0.24326949601210418, -0.2287185567255084, -0.2160217289164429, -0.20501783069383217, -0.19555094549879426, -0.18747232401086533, -0.18064169841388555, -0.17492809443099633 ], [ -0.8443330666442336, -0.885606058047323, -0.9270301061504111, -0.9681738638179312, -1.008547359240838, -1.0476040699921259, -1.084745736910574, -1.1193305668313227, -1.1506854995345246, -1.178123176284576, -1.200964090172515, -1.2185640373836277, -1.2303463120491247, -1.235836993274989, -1.2347001682019199, -1.2267683125566653, -1.2120620589076025, -1.190794316964471, -1.1633568794148643, -1.1302924378468833, -1.092258781555505, -1.0499924086707433, -1.0042759751007595, -0.9559105194787069, -0.9056915380787114, -0.8543879819660066, -0.8027240094704374, -0.7513638844574806, -0.7009004895419607, -0.6518476852648671, -0.6046364253793199, -0.5596142757650493, -0.5170478226000037, -0.477127383663135, -0.43997342911693343, -0.40564415158061456, -0.37414368346970023, -0.3454305316793063, -0.31942587812585277, -0.2960214735311215, -0.2750869264523492, -0.2564762565198489, -0.24003363810774325, -0.22559830752146093, -0.21300864358654947, -0.20210545929820078, -0.19273456226863084, -0.1847486554095813, -0.17800865773654273, -0.17238452925669523 ], [ -0.838507838018634, -0.8791780719177706, -0.9199646505604117, -0.960439600627956, -1.0001178148777032, -1.03845937820347, -1.0748746211375875, -1.1087325146496625, -1.13937302935456, -1.1661240259802295, -1.188323072724816, -1.2053442241023222, -1.2166291485258456, -1.2217209730428737, -1.2202978391389772, -1.212201705713679, -1.1974570666339113, -1.1762749357145057, -1.149040308340987, -1.1162856315602077, -1.078656385614126, -1.036875530182424, -0.9917112664043022, -0.9439494243928257, -0.8943698782717562, -0.843726129654949, -0.7927277584893844, -0.7420259535202833, -0.6922024745852218, -0.6437622433219896, -0.597129495474076, -0.5526471902988325, -0.51057921322256, -0.47111482820062206, -0.43437481818887785, -0.4004187760698621, -0.3692530589817907, -0.34083898534925605, -0.31510092801255857, -0.291934032486307, -0.27121136168460536, -0.252790333897917, -0.23651837724159092, -0.2222377703591134, -0.20978967603701115, -0.19901740244327426, -0.1897689471318783, -0.18189889298952633, -0.1752697340162933, -0.16975271309693696 ], [ -0.8310971193311775, -0.8710312410122945, -0.9110425007955775, -0.9507075651221635, -0.9895477872348553, -1.0270318092480786, -1.0625808669166108, -1.095577369355143, -1.125377316648257, -1.151327042534995, -1.1727845836737414, -1.189145617537205, -1.1998732978832292, -1.2045303840805777, -1.2028108346270239, -1.1945667659325108, -1.1798259521678751, -1.158795680112438, -1.131851282622619, -1.099511460038566, -1.0624057167596108, -1.0212400456716466, -0.9767652268279932, -0.9297494040705679, -0.8809547392404067, -0.8311174502788663, -0.7809308650420425, -0.7310315452294557, -0.6819887037902145, -0.6342970552859999, -0.5883730360063897, -0.5445541258872161, -0.5031008546478914, -0.4642009915342673, -0.4279753916550863, -0.39448498691016837, -0.36373845233487145, -0.33570013875466553, -0.3102979318229857, -0.2874307693957733, -0.26697561876382103, -0.24879377886486187, -0.23273642794443605, -0.21864938320830696, -0.20637707581496811, -0.1957657727924772, -0.18666609818090973, -0.17893492002670253, -0.172436678813509, -0.16704423736050067 ], [ -0.8221691773136716, -0.8612426789780975, -0.9003504328370383, -0.9390749950142563, -0.9769457225393143, -1.0134416630450152, -1.047997108442268, -1.0800103380632415, -1.1088560486398482, -1.133901873657616, -1.15452919592783, -1.1701581021796579, -1.1802757541911735, -1.184466610866077, -1.1824418659221458, -1.1740643925031589, -1.1593649091588916, -1.1385456739931872, -1.1119701744069777, -1.0801405157104504, -1.0436670390905838, -1.0032356025725295, -0.9595766963707548, -0.9134383363619063, -0.8655629401140816, -0.8166677240543359, -0.7674282584951316, -0.7184651180781539, -0.670333729295751, -0.6235174853702977, -0.5784240523894599, -0.5353846224413352, -0.4946557352965217, -0.4564232084976282, -0.4208076838330309, -0.38787130558533295, -0.35762508135885507, -0.330036529955019, -0.30503728470961544, -0.2825303884759931, -0.26239708293221287, -0.24450295635107794, -0.2287033679834592, -0.21484811258608238, -0.20278532519977233, -0.19236465457537444, -0.18343975455562023, -0.175870157273469, -0.1695226011882065, -0.1642718915867527 ], [ -0.8118048582133862, -0.8499033287800524, -0.8879903531826879, -0.9256555946148464, -0.9624378834842313, -0.9978283941889501, -1.0312764321320211, -1.0621983059691626, -1.0899897140197012, -1.1140419616964174, -1.1337621179643456, -1.1485968718888857, -1.158059318553584, -1.1617571582357464, -1.159419877852739, -1.150921600384212, -1.1362958522961608, -1.115739046980993, -1.089601313724562, -1.058366015151142, -1.0226217281047698, -0.9830314033977581, -0.9403025890817298, -0.8951608379715655, -0.8483268664023296, -0.8004972660388004, -0.7523284733283229, -0.7044238684973818, -0.6573240065962115, -0.6114999812255403, -0.5673498210290148, -0.5251976865076148, -0.48529551928750797, -0.4478267196134211, -0.41291139351016637, -0.38061271268846, -0.350943959137733, -0.32387587388671557, -0.2993439880959911, -0.2772556781409994, -0.25749674954688573, -0.23993741372903832, -0.22443757394861535, -0.2108513813789119, -0.19903105834714307, -0.1888300140181438, -0.18010529877789982, -0.17271945827105462, -0.16654185735340132, -0.1614495489534451 ], [ -0.800096008284784, -0.8371161302451134, -0.8740771815717339, -0.9105771001958147, -0.9461655656437736, -0.9803474511554906, -1.0125888169747514, -1.0423258670612678, -1.068977229239701, -1.09195979233874, -1.1107081186602232, -1.1246971152192244, -1.1334671604498459, -1.1366502309791016, -1.133994805002479, -1.1253866105496386, -1.1108619773409645, -1.090611055806082, -1.0649697021010343, -1.034401070692404, -0.9994700125997407, -0.9608143032511429, -0.9191162353728909, -0.8750767675302629, -0.8293930849815099, -0.7827396350471197, -0.7357524540050698, -0.6890166423660287, -0.6430569235637257, -0.5983312267746471, -0.5552271660255845, -0.5140611859682472, -0.47508004867365805, -0.43846426744661154, -0.40433305959325133, -0.37275038790869586, -0.3437316841688949, -0.3172508899362295, -0.2932475036543759, -0.27163338225863765, -0.25229910535418204, -0.23511976658997147, -0.21996010757690254, -0.20667895310450657, -0.19513294199613895, -0.18517957589857525, -0.1766796292450341, -0.16949897837229977, -0.16350991715615226, -0.15859203134593558 ], [ -0.7871437619564821, -0.8229940480464326, -0.858736589194516, -0.8939786989841101, -0.9282821695100425, -0.9611669774407028, -0.992117447312888, -1.0205912407741087, -1.0460314645034288, -1.06788205218032, -1.0856063584656237, -1.098708583870447, -1.1067572089442184, -1.1094090532088154, -1.1064319405018554, -1.0977233989317838, -1.083322621019274, -1.0634133725166912, -1.0383168157664935, -1.0084750480896802, -0.974427871617004, -0.9367861841796369, -0.8962051463405307, -0.8533592913144338, -0.8089206392145618, -0.7635401095521221, -0.7178321842275184, -0.6723627047344454, -0.6276397051484556, -0.5841071783174892, -0.5421416217995911, -0.5020511316716231, -0.4640767338926149, -0.42839558366903646, -0.3951256314568511, -0.36433135009853, -0.3360301370888602, -0.3101990433124656, -0.2867815287096119, -0.2656940005452891, -0.24683194645137901, -0.2300755284079648, -0.21529455268841924, -0.2023527729573028, -0.1911115185429738, -0.18143266745737607, -0.1731810044931208, -0.16622601940619752, -0.1604432095739029, -0.15571495636589805 ], [ -0.7730567508091344, -0.8076580228745843, -0.8421026660739268, -0.8760083877625026, -0.9089502277407912, -0.9404644890619741, -0.9700550284137996, -0.9972022218255653, -1.0213748345196827, -1.0420448792104757, -1.0587053316868331, -1.0708902724518803, -1.078196629079938, -1.0803062138361677, -1.077006236673554, -1.0682060525465475, -1.0539477860805986, -1.0344088988216849, -1.0098958224012193, -0.9808292716231213, -0.9477232690913835, -0.9111607100254351, -0.8717682383296513, -0.8301925051695392, -0.7870789938228074, -0.7430538923718729, -0.6987091046304519, -0.6545903388558213, -0.6111881730481055, -0.5689319705426094, -0.528186473960172, -0.48925084224589266, -0.4523598311330079, -0.41768676687727635, -0.3853479346432539, -0.35540799825747565, -0.3278860847811572, -0.3027622009579557, -0.2799836937631317, -0.2594715188188813, -0.2411261337634627, -0.2248328851005144, -0.2104668039791826, -0.19789676715048887, -0.1869890132719616, -0.17761003172333734, -0.16962886152931944, -0.16291885248677085, -0.15735894988773014, -0.15283456905213388 ], [ -0.7579492843368548, -0.7912349050979793, -0.8243155861485639, -0.8568203496837332, -0.8883384770657188, -0.9184236293820309, -0.9466002179325734, -0.9723722892006972, -0.9952350939302484, -1.0146893619467188, -1.0302580945994662, -1.0415054081245616, -1.048056612360887, -1.049618304564837, -1.0459968470699894, -1.0371132861450352, -1.0230127208964337, -1.0038665139381455, -0.9799666103427753, -0.9517124380957196, -0.919592026507654, -0.8841596887792843, -0.84601267258448, -0.8057687067495549, -0.7640456791850663, -0.721444065513416, -0.6785323249128951, -0.6358352739499583, -0.5938253582958484, -0.5529166913264048, -0.5134616789713259, -0.47574999419931396, -0.44000960980620235, -0.4064095549339793, -0.3750640358507666, -0.34603755725974444, -0.31935069543855293, -0.2949862052712684, -0.2728951851338855, -0.25300307189413146, -0.23521528868384278, -0.21942241707570798, -0.20550481026695888, -0.19333660320484092, -0.18278910847754726, -0.17373361308216484, -0.16604361115580957, -0.15959652196754837, -0.15427495158878213, -0.14996756139602174 ], [ -0.7419395494433598, -0.7738554246368464, -0.8055193310163304, -0.8365724178301004, -0.8666190511523756, -0.8952310853947615, -0.9219542652667603, -0.9463169743073503, -0.9678414460680976, -0.9860574059778326, -1.0005179110531526, -1.0108168991494961, -1.0166076538032376, -1.0176210533349226, -1.0136821496045398, -1.0047233991474864, -0.9907928710573213, -0.9720561012718206, -0.948790986180149, -0.9213760841955532, -0.8902736446041812, -0.8560093035369147, -0.8191505136294746, -0.7802854660086814, -0.7400037357495406, -0.6988793600700923, -0.6574566707986358, -0.6162389668216747, -0.5756799832176203, -0.5361780372880107, -0.4980726724623201, -0.461643566185721, -0.42711141848134304, -0.39464049976352206, -0.36434251466966416, -0.3362814352462679, -0.3104789709225047, -0.2869203714105874, -0.26556029795581687, -0.2463285438979726, -0.2291354332764683, -0.21387677286534956, -0.20043827606647502, -0.18869941490092734, -0.17853668808265033, -0.16982631861653996, -0.16244641375511693, -0.1562786339612109, -0.15120942638571422, -0.14713088295882748 ], [ -0.7251478702116371, -0.7556522436925773, -0.7858595241445812, -0.8154236823716677, -0.8439648560202984, -0.8710737313139552, -0.8963179283280526, -0.9192505610295878, -0.9394210408451626, -0.9563880473636717, -0.9697344003160437, -0.9790833353998218, -0.9841154213402584, -0.9845850772104077, -0.9803353987068649, -0.9713098493877688, -0.9575594100586223, -0.9392440892441445, -0.9166282966048266, -0.890070370908576, -0.8600073298611655, -0.8269364445645021, -0.7913954044684065, -0.7539426526313138, -0.7151390789458614, -0.6755318286349006, -0.6356406276440508, -0.5959467807448556, -0.5568848438178142, -0.5188368732925857, -0.4821290845215693, -0.44703069277644936, -0.41375466267933564, -0.3824600566024707, -0.3532556529398753, -0.3262045025593372, -0.3013291053787115, -0.2786169162829689, -0.25802592685363707, -0.23949011262537317, -0.2229245810459881, -0.2082302998260499, -0.1952983265361471, -0.18401349657307386, -0.17425755713303415, -0.16591175935119518, -0.1588589394651353, -0.1529851331763663, -0.14818077590766066, -0.14434154603870153 ], [ -0.7076950631508967, -0.7367581309891235, -0.7654814173899437, -0.7935322858746986, -0.8205471745625137, -0.8461360471306717, -0.8698887154781426, -0.8913831645010759, -0.9101959068913165, -0.9259142560389637, -0.9381502288495347, -0.9465555826305558, -0.9508372622227462, -0.9507723060953317, -0.9462210693953479, -0.9371375231335377, -0.9235754495717361, -0.9056896304173669, -0.8837316217363129, -0.8580403504726426, -0.8290284006850853, -0.7971653155790777, -0.7629594190245412, -0.7269395601623976, -0.6896378999172241, -0.6515745113064468, -0.613244250481959, -0.5751061143467241, -0.5375751325956712, -0.5010167268828908, -0.4657433867663789, -0.4320134483264262, -0.4000317121991676, -0.3699516032550029, -0.34187855562199787, -0.3158743047229692, -0.2919617813886054, -0.2701303293919443, -0.25034100345977905, -0.2325317461821152, -0.21662228570003106, -0.20251863860402697, -0.19011714185545003, -0.17930797225397188, -0.16997814120499377, -0.16201397603768164, -0.15530311703449518, -0.14973607206603556, -0.14520737883934076, -0.14161642889491755 ], [ -0.689700916300673, -0.717304287831157, -0.7445280615512608, -0.7710534391796043, -0.7965335323436986, -0.8205978429139993, -0.8428584807311992, -0.8629182127321937, -0.8803803369604608, -0.8948602423226375, -0.9059983529835334, -0.9134739719285213, -0.9170193438591996, -0.9164330734176797, -0.9115918918888218, -0.9024597072342608, -0.8890929476578873, -0.8716414547499316, -0.8503445966427698, -0.8255227939753127, -0.7975651695324422, -0.7669144220140819, -0.7340502027254024, -0.6994722328430537, -0.6636841972540195, -0.6271791765772816, -0.5904271074501568, -0.5538645344565347, -0.517886745015377, -0.4828422525247159, -0.4490294998655326, -0.4166955850765927, -0.38603675879123767, -0.3572004076557963, -0.33028821949647713, -0.3053602241251507, -0.2824394168637194, -0.261516697444571, -0.24255589147931517, -0.2254986615260327, -0.21026915651594458, -0.19677828907286432, -0.18492756793486465, -0.17461244585813884, -0.16572517128949027, -0.15815715449889278, -0.15180087590881775, -0.14655137643320382, -0.14230737728310117, -0.13897208051904086 ], [ -0.671282813639001, -0.6974188480103566, -0.7231386829167515, -0.7481376788860975, -0.7720858437405468, -0.7946323047320578, -0.8154113835862283, -0.8340503366028472, -0.8501787250425723, -0.8634392569491123, -0.8734997943815704, -0.8800660578213222, -0.8828943950709, -0.8818038341000559, -0.8766865343257106, -0.8675157222143077, -0.8543502799437512, -0.8373353736295557, -0.8166988543032111, -0.7927435927095557, -0.7658363344107971, -0.7363939922880054, -0.704868464523954, -0.6717310642752162, -0.6374575086819356, -0.6025142014366061, -0.5673463138085514, -0.532367962211548, -0.4979546114210453, -0.46443770098817755, -0.432101391580056, -0.4011812514224887, -0.37186464687913423, -0.3442925638837364, -0.3185625677406636, -0.2947326066673054, -0.2728253773686754, -0.2528329959660222, -0.23472175122265243, -0.21843675559398446, -0.20390634985952716, -0.1910461562464255, -0.17976271101188546, -0.169956639106283, -0.16152536009925722, -0.15436533581599354, -0.14837388625207526, -0.14345061169679596, -0.1394984661192069, -0.13642453035186652 ], [ -0.6525545195145571, -0.6772255657469429, -0.7014472787375571, -0.7249293772384828, -0.7473588460443646, -0.7684043654906544, -0.7877222112556811, -0.8049636592698176, -0.8197838384500225, -0.8318518592841464, -0.8408619138856893, -0.8465449015723729, -0.8486799958292637, -0.8471054507397743, -0.8417278695191962, -0.8325291503445118, -0.81957040996619, -0.8029923778922092, -0.7830120452215896, -0.7599157047310737, -0.7340488698573456, -0.7058038407528828, -0.6756058450369992, -0.643898704277195, -0.6111308858170446, -0.5777426360834969, -0.5441547008858095, -0.5107589536767476, -0.4779110916709496, -0.44592542704922633, -0.4150716947490284, -0.38557371652126693, -0.3576097007522391, -0.3313139177235387, -0.3067794694769583, -0.2840618706985977, -0.2631831695735283, -0.24413636212019035, -0.22688988639357838, -0.21139202047464822, -0.1975750470725467, -0.18535908522950129, -0.17465552413606245, -0.165370024232534, -0.15740507597969966, -0.1506621267758662, -0.14504330165277268, -0.1404527539873065, -0.13679768903319256, -0.13398910618574678 ], [ -0.6336251315495827, -0.6568426986974665, -0.6795814365190368, -0.7015655063223815, -0.7224988195224491, -0.7420693937812052, -0.7599550504865453, -0.7758304653677643, -0.7893754976638663, -0.8002846183639849, -0.8082771399718137, -0.8131078275764245, -0.8145773555729566, -0.8125419812518794, -0.8069217537016276, -0.797706583587116, -0.7849595835681685, -0.7688172585102517, -0.7494863704536767, -0.7272375955713867, -0.7023963816788945, -0.6753316533697935, -0.6464431580237158, -0.6161482849603049, -0.5848691333594213, -0.5530204812341364, -0.5209991512428771, -0.4891751070606729, -0.45788446373271297, -0.4274244650186218, -0.3980503726256246, -0.36997412648707184, -0.3433645714217179, -0.318349003055256, -0.2950157637973715, -0.27341761607739956, -0.25357563210043405, -0.23548336349239152, -0.2191110864418876, -0.20440995455354027, -0.19131592934417474, -0.17975339459125672, -0.1696383937884418, -0.16088145867775927, -0.15339002068634966, -0.14707041600391002, -0.14182950920207094, -0.13757597011696499, -0.1342212447014225, -0.13168026327008542 ], [ -0.6145982048242644, -0.6363820867687682, -0.6576613751214195, -0.6781746510694062, -0.6976425836535559, -0.7157721858883671, -0.7322622883299162, -0.7468102229469313, -0.7591196300170934, -0.7689092057243943, -0.7759221036631266, -0.7799355978203573, -0.7807705186712368, -0.7782999008961399, -0.7724562456190918, -0.7632368167507244, -0.7507064717794902, -0.7349976762530311, -0.7163075595292252, -0.6948921132524004, -0.6710578773487403, -0.6451516618272198, -0.6175489853653522, -0.5886419597457515, -0.5588273179206817, -0.5284951919672641, -0.49801911994291514, -0.4677476199036452, -0.43799753119781465, -0.4090491973131266, -0.38114345619865686, -0.35448031575177064, -0.3292191254100126, -0.30548000991870256, -0.2833463076405656, -0.26286775124980605, -0.24406414017005512, -0.22692927776897448, -0.2114349779714969, -0.19753498171850048, -0.1851686603086783, -0.17426441762970502, -0.16474273491449143, -0.1565188289538587, -0.14950491722100778, -0.1436121010858128, -0.13875189146262623, -0.13483741025838825, -0.13178430637822613, -0.12951142735937615 ], [ -0.5955710452762144, -0.6159484221571431, -0.6357991999736989, -0.6548762596329973, -0.672916753742684, -0.6896462402376244, -0.70478391574387, -0.718048926306742, -0.7291676594921556, -0.7378818364486659, -0.7439571306986759, -0.7471919499470613, -0.74742593780919, -0.7445476953118559, -0.7385011992096754, -0.7292904167081105, -0.7169816920481599, -0.7017036110854191, -0.6836442273151742, -0.6630457376266468, -0.6401969007172004, -0.6154236655347096, -0.5890785969677046, -0.5615297388056589, -0.5331495410328776, -0.5043044119518812, -0.4753453529393559, -0.4466000122997243, -0.41836636897310236, -0.3909081370504833, -0.3644518751201966, -0.3391856950967374, -0.31525939636241185, -0.2927858041984104, -0.27184306631561217, -0.25247765585701004, -0.2347078401984481, -0.2185273980637873, -0.20390939854458723, -0.19080989057518094, -0.17917138696989, -0.16892606084093253, -0.15999860247611564, -0.15230871066772178, -0.14577321369785046, -0.14030783173596373, -0.13582860457667767, -0.13225301687316937, -0.1295008578160366, -0.12749485411552752 ], [ -0.5766341661973852, -0.595638701723257, -0.6140983602335497, -0.6317801151951056, -0.6484372377524683, -0.6638132895330379, -0.6776471044510626, -0.6896787252303085, -0.6996561933039519, -0.7073430145190043, -0.7125260428370298, -0.7150234470677174, -0.7146923602128937, -0.7114357667683904, -0.7052081699077132, -0.6960196062024095, -0.6839376457020319, -0.6690871297500074, -0.6516475504436136, -0.63184814879893, -0.6099609820154738, -0.5862923606039362, -0.5611731642080827, -0.5349485996515303, -0.5079679649004438, -0.4805749354614873, -0.4530988073530997, -0.42584702662022517, -0.3990992216895459, -0.373102841855629, -0.348070400914622, -0.3241782356278669, -0.3015666186929002, -0.2803410176117046, -0.26057426449789606, -0.24230939561730674, -0.2255629298661848, -0.21032837810387794, -0.19657980574592937, -0.1842753051867586, -0.17336026914533476, -0.16377038851769976, -0.15543432725131734, -0.14827605132371946, -0.1422168088445983, -0.13717677370505166, -0.13307637639617897, -0.129837353064717, -0.1273835480815202, -0.1256415069071526 ], [ -0.5578708985027018, -0.5755418495075801, -0.5926532924221461, -0.6089860100892752, -0.6243089502970579, -0.6383830634002011, -0.6509660256786991, -0.6618178051573617, -0.670706965968555, -0.6774175397231288, -0.6817562225816909, -0.6835595911649732, -0.6827009766163586, -0.6790966020436255, -0.672710581902646, -0.663558408902705, -0.6517086181562046, -0.6372824186394288, -0.6204512120339696, -0.6014320663181708, -0.5804813593450309, -0.557886938061025, -0.5339592365128664, -0.5090218505941048, -0.4834020769248273, -0.45742189105943953, -0.43138977444004184, -0.40559371022614826, -0.3802955656758661, -0.3557269728187765, -0.3320867183893845, -0.30953956567490376, -0.2882163605833266, -0.26821522510995505, -0.2496036141980011, -0.23242100509177926, -0.21668199818671552, -0.20237963060131747, -0.1894887335723603, -0.17796919812351386, -0.16776904695379824, -0.15882724178386864, -0.1510761830359001, -0.14444388198730085, -0.13885580423990196, -0.13423639764291972, -0.1305103280645219, -0.1276034530960488, -0.12544356741395102, -0.12396095464679247 ], [ -0.5393571430557335, -0.5557384948339399, -0.5715492328353893, -0.5865836011441397, -0.6006257191396063, -0.6134532532603224, -0.624841878973359, -0.6345704831789105, -0.6424270027905411, -0.6482147355639535, -0.6517588988170588, -0.6529131561474288, -0.6515657880837652, -0.6476451564963361, -0.6411241106872289, -0.6320230100854869, -0.6204110965866011, -0.6064060374448145, -0.5901715715839205, -0.571913318267933, -0.5518729341122687, -0.5303209182539173, -0.5075484536189242, -0.4838587260195256, -0.45955817871137616, -0.43494813932157567, -0.41031720373001773, -0.38593468490844623, -0.3620453424672679, -0.3388655097457362, -0.3165806385625915, -0.2953441952354542, -0.27527777154339556, -0.2564722249209658, -0.23898963452312816, -0.22286585243352242, -0.20811343873943355, -0.19472479090482253, -0.1826753070929764, -0.1719264555910468, -0.16242865494639636, -0.15412389953231176, -0.14694809163973044, -0.1408330631995598, -0.13570828775687582, -0.13150229655547685, -0.12814382194899476, -0.12556269732333447, -0.12369054581697891, -0.12246129088190627 ], [ -0.5211612517093036, -0.5363008899535529, -0.5508621797599746, -0.5646524242007506, -0.577470359012052, -0.5891096511711238, -0.599363099919061, -0.6080274860752909, -0.6149089667942974, -0.6198288604904878, -0.622629614489184, -0.6231807010120305, -0.6213841509094004, -0.6171794146713159, -0.6105472416054519, -0.6015122942094198, -0.5901442670634297, -0.5765573565233106, -0.5609080242704076, -0.5433911063230704, -0.524234429014175, -0.503692193437768, -0.4820374697260618, -0.4595541946191024, -0.4365290860578271, -0.4132438765386238, -0.3899682254497299, -0.366953604772989, -0.34442836941078303, -0.3225941312598833, -0.30162346382278893, -0.2816588800637604, -0.26281295735284627, -0.24516943423405174, -0.22878507599163128, -0.2136920983273113, -0.19990094750036957, -0.18740325644568145, -0.17617482489219793, -0.16617850311022797, -0.15736689031496853, -0.14968478768806692, -0.1430713711348457, -0.13746206969787367, -0.13279015193795307, -0.12898803482937438, -0.1259883382277096, -0.12372471326086099, -0.12213247559170115, -0.1211490749166686 ], [ -0.5033440227711763, -0.5172929504386208, -0.5306589860625539, -0.5432620456626733, -0.5549148879273205, -0.565426435239413, -0.5746057170303067, -0.5822663786713108, -0.5882316557949233, -0.5923396680413997, -0.5944488413059393, -0.5944432279302367, -0.5922374646433306, -0.5877810930181263, -0.581061970719886, -0.5721085265710293, -0.5609906592891336, -0.5478191471879019, -0.5327435200957897, -0.5159484387356453, -0.4976487225097755, -0.4780832550138098, -0.45750806917998993, -0.4361889639477567, -0.41439402744540693, -0.3923864362344991, -0.37041786727974474, -0.34872280248521215, -0.3275139306112347, -0.3069787656845767, -0.28727751325859785, -0.2685421347038666, -0.25087649247127813, -0.23435741091485363, -0.21903645970284402, -0.2049422590432476, -0.19208311460383032, -0.1804498105783483, -0.17001841707613996, -0.1607529986663767, -0.15260814122301913, -0.14553124198600753, -0.13946453172414974, -0.13434681753991384, -0.13011495018570007, -0.12670503106142028, -0.12405338178880898, -0.12209730392578322, -0.12077565851897754, -0.12002929529892847 ], [ -0.48595879623988647, -0.4987704014203535, -0.5109975629229787, -0.5224723295213723, -0.5330208621757814, -0.542466575714045, -0.5506338301032969, -0.5573521133045674, -0.5624606193169813, -0.5658130849532437, -0.5672827102822594, -0.5667669542507481, -0.5641919727314776, -0.5595164549541384, -0.5527346191316991, -0.5438781511635625, -0.5330169120899129, -0.5202582991225395, -0.5057452181985789, -0.489652707829219, -0.4721833378704153, -0.4535615853941539, -0.43402745597507053, -0.41382966635567303, -0.39321872918783696, -0.3724402799678263, -0.3517289602317137, -0.3313031217909963, -0.3113605489138618, -0.29207531572120893, -0.2735958129806555, -0.2560439005862622, -0.23951507685989942, -0.22407950861105114, -0.20978373880516876, -0.1966528808677923, -0.18469311692458978, -0.17389433719548275, -0.1642327846239997, -0.15567359846124085, -0.14817317972448563, -0.14168132806268474, -0.13614312238457615, -0.13150053617191226, -0.12769379273947634, -0.12466247614013914, -0.12234642041950006, -0.12068640402519226, -0.11962467789387687, -0.1191053555700875 ], [ -0.4690516342694735, -0.4807810131554328, -0.4919271761993753, -0.5023337993908861, -0.5118398077004986, -0.520282337803339, -0.5275001846787488, -0.5333376739884287, -0.5376488682292035, -0.5403019797611963, -0.5411838306777652, -0.540204171305723, -0.5372996492564657, -0.5324372125456055, -0.5256167359282596, -0.5168726808629996, -0.5062746367336465, -0.4939266429226606, -0.4799652552481457, -0.46455639188403114, -0.4478910677807649, -0.43018019677311614, -0.4116487009619358, -0.3925292121098465, -0.3730556752845173, -0.35345716790178383, -0.33395222664936375, -0.31474393177146537, -0.2960159366394866, -0.27792955660113877, -0.2606219527220783, -0.24420537170842632, -0.22876734061009135, -0.21437166919468076, -0.20106008648383944, -0.1888543301861434, -0.17775851563436507, -0.1677616300227457, -0.15884002365126126, -0.15095979843718388, -0.14407902200829947, -0.13814972115454505, -0.13311963013229433, -0.1289336868571993, -0.12553528344473952, -0.12286728720628304, -0.12087285456605412, -0.11949606395863355, -0.1186823951170638, -0.11837908175473566 ] ], "zauto": true, "zmax": 1.2586993214582256, "zmin": -1.2586993214582256 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.40511302293758905, 0.4021768567235502, 0.399163491347391, 0.39609995024193134, 0.39301747071153825, 0.38995080548072325, 0.3869371470045472, 0.3840146843745211, 0.3812208529786611, 0.37859039499220204, 0.3761534053452503, 0.3739335805846357, 0.3719469033018514, 0.37020097135620983, 0.3686951147915021, 0.3674213403365333, 0.36636602081321173, 0.36551212925442006, 0.36484173046364804, 0.36433840476489254, 0.3639892962522825, 0.3637865441502177, 0.36372795423484505, 0.36381687698459186, 0.364061361399086, 0.36447273486882925, 0.36506381300061574, 0.36584696703037956, 0.3668322720562627, 0.3680259307296854, 0.3694291197893734, 0.37103734774075076, 0.3728403487584101, 0.37482247829259663, 0.3769635267027312, 0.37923983336749817, 0.38162556736961495, 0.3840940415667292, 0.38661894193957563, 0.3891753794241103, 0.39174070232917774, 0.3942950395104523, 0.39682157408583607, 0.39930657203529957, 0.40173920798928536, 0.4041112412967337, 0.40641659930016727, 0.40865092247603313, 0.41081111900828315, 0.4128949659947923 ], [ 0.4025098533234337, 0.3993123190645722, 0.3960248413333063, 0.39267692934595416, 0.38930302360794056, 0.38594177602938246, 0.382634891055025, 0.3794255285153591, 0.3763563271260509, 0.37346717694883935, 0.37079293941483016, 0.3683613695144793, 0.36619151892314245, 0.3642928760388031, 0.36266542246805256, 0.3613006620511404, 0.36018352918944435, 0.3592949393762738, 0.35861463909993513, 0.3581239683901364, 0.357808174662061, 0.3576580011526316, 0.3576703946220224, 0.35784830845238386, 0.3581996957984407, 0.3587358780013738, 0.3594695294078982, 0.36041254062219713, 0.36157401130252553, 0.36295858612495546, 0.3645652901020106, 0.3663869499874844, 0.3684102158985524, 0.37061613047088515, 0.3729811395115675, 0.3754784034218941, 0.37807925461091385, 0.3807546514964197, 0.38347650076164286, 0.38621875112320586, 0.388958198450645, 0.39167497868663387, 0.39435275775283407, 0.39697865386190756, 0.3995429459871335, 0.4020386323120738, 0.4044609047757707, 0.4068066014558352, 0.4090736890397815, 0.41126081481668114 ], [ 0.39981909200840066, 0.396345159270354, 0.3927667315509515, 0.38911582583441356, 0.38543019092855496, 0.38175258160350894, 0.37812952647452913, 0.37460957768650555, 0.3712410969578577, 0.3680697148221321, 0.3651356864494255, 0.36247143995644526, 0.3600996493639728, 0.3580321440653148, 0.35626987953533173, 0.3548040467262008, 0.3536182160381626, 0.3526912357964118, 0.35200047685741054, 0.35152496455607285, 0.35124797523094875, 0.3511587824985723, 0.3512533879668068, 0.3515342278034484, 0.3520089825309328, 0.35268871619973813, 0.3535856273661888, 0.3547107100354338, 0.3560716033331174, 0.35767086085689354, 0.3595048021040919, 0.36156302800674733, 0.363828600466373, 0.36627881196390955, 0.36888641435869185, 0.37162114134045654, 0.3744513482372726, 0.3773456038628241, 0.38027409689989855, 0.38320975765553716, 0.3861290385018971, 0.3890123374425247, 0.391844084924938, 0.3946125416760059, 0.3973093737500652, 0.39992908004785205, 0.40246834803930587, 0.4049254066870816, 0.4072994334331335, 0.40959005662790543 ], [ 0.39705034001831335, 0.39328545103928, 0.38939955791272324, 0.38542715994677784, 0.3814093721156056, 0.377393213192641, 0.37343031573955615, 0.3695750292000323, 0.36588196218858143, 0.3624031065035806, 0.3591847908784038, 0.35626480535977734, 0.3536700895490606, 0.3514153628428732, 0.34950297686762194, 0.34792409555995185, 0.34666108818653346, 0.34569080560891297, 0.34498825445197495, 0.3445301262760924, 0.3442976891748296, 0.34427868667570244, 0.34446807263671836, 0.34486759667451317, 0.3454844087113231, 0.34632895628601973, 0.34741250169967686, 0.34874459354664894, 0.35033079704004694, 0.3521709281191582, 0.35425795613560784, 0.35657764864368613, 0.3591089405120062, 0.3618249294262722, 0.36469434019363983, 0.3676832666970676, 0.37075699389796185, 0.3738817197134327, 0.377026031711178, 0.3801620389082962, 0.3832661073205599, 0.38631919335618387, 0.3893068074864864, 0.3922186693904618, 0.39504813397351024, 0.39779147546416876, 0.4004471152145293, 0.40301486951262133, 0.4054952787322734, 0.407889060809742 ], [ 0.3942148571617385, 0.39014519297653893, 0.38593592151755834, 0.3816239426058234, 0.3772537361163032, 0.3728766889208263, 0.3685497686282455, 0.36433349381910396, 0.3602892332548674, 0.3564759780648574, 0.3529468580181686, 0.3497457905185088, 0.34690472435630076, 0.3444419341523323, 0.34236171332815185, 0.3406556075854917, 0.33930506483079514, 0.3382851151534706, 0.33756850565731344, 0.3371296495208698, 0.3369478179394358, 0.3370091783762435, 0.3373075080900656, 0.33784363100119413, 0.3386237979346633, 0.3396573381358505, 0.3409539558037839, 0.34252104051865695, 0.34436131704855555, 0.34647108809445704, 0.3488392319410065, 0.3514470156530545, 0.35426868511165294, 0.35727270795159394, 0.36042348436269067, 0.36368330939693755, 0.3670143692111061, 0.37038057815237857, 0.37374910626319735, 0.3770914990680309, 0.3803843454707775, 0.3836094989822266, 0.386753898105402, 0.38980906124317244, 0.3927703492179873, 0.39563609482482026, 0.3984066950348496, 0.40108374940893354, 0.4036693102893781, 0.4061652889927129 ], [ 0.39132556458756124, 0.3869383410909027, 0.38239069959197813, 0.37772179364850955, 0.3729793953565789, 0.3682192908536953, 0.3635039464697114, 0.3589003684821775, 0.35447716914707, 0.35030097864638576, 0.3464324937521674, 0.34292260083640824, 0.33980911124891466, 0.33711465516577743, 0.33484616356518937, 0.33299612766236864, 0.33154550507451797, 0.33046782245901385, 0.32973379525555346, 0.3293157109679161, 0.3291909164943577, 0.3293439718323664, 0.3297673087153349, 0.3304604894400894, 0.33142834958879064, 0.3326784133478756, 0.33421800159114634, 0.33605143037100477, 0.33817763822711644, 0.34058849619327825, 0.3432679528634316, 0.34619205760986793, 0.3493297998222578, 0.3526446136360124, 0.3560963366249335, 0.3596433829650924, 0.363244896238402, 0.3668626787493938, 0.37046274424415265, 0.37401639969098555, 0.37750082078598646, 0.3808991386288059, 0.3842000974393657, 0.38739737317202366, 0.3904886599275274, 0.39347463579933306, 0.3963579136756419, 0.3991420676328979, 0.4018308044546899, 0.4044273253366719 ], [ 0.3883970153615961, 0.38368080728784054, 0.3787810818908935, 0.37373902712490603, 0.3686055512132359, 0.3634407811450972, 0.3583127573459764, 0.3532952153533567, 0.3484644402104108, 0.34389532124175487, 0.33965691194126096, 0.3358079805353825, 0.332393171058609, 0.3294404238559066, 0.3269601831000984, 0.32494664153647285, 0.32338088985188956, 0.3222354498015013, 0.3214793920497775, 0.3210831554587944, 0.3210223106254824, 0.3212797913985996, 0.3218464558640381, 0.32272013705047603, 0.3239035451271348, 0.3254014762696212, 0.32721779083563757, 0.32935257659040557, 0.3317998352913091, 0.33454593516924525, 0.3375689638095386, 0.34083900264171535, 0.34431923660247704, 0.34796772356598676, 0.3517395889116666, 0.35558938678177754, 0.3594733801878077, 0.3633515305862163, 0.36718904410800485, 0.3709573859667445, 0.3746347377548099, 0.3782059278278518, 0.3816619087562923, 0.3849988860023407, 0.38821721824616845, 0.39132021291973307, 0.39431293209979174, 0.39720110619886684, 0.3999902286392928, 0.4026848770182372 ], [ 0.385445329746549, 0.3803904190978575, 0.37512656625169083, 0.36969669587896303, 0.36415460203170097, 0.3585645880394549, 0.35300023323215896, 0.34754213999910555, 0.34227461211305243, 0.3372813705964368, 0.3326406172152225, 0.32841997483896085, 0.3246720096482902, 0.32143109887271254, 0.3187122872269878, 0.3165124596959965, 0.314813703851493, 0.3135882646700144, 0.3128041568918192, 0.3124304038812706, 0.3124410387487951, 0.3128173584568681, 0.3135483339923345, 0.3146294248265935, 0.3160602541851288, 0.3178416703619469, 0.3199726894514018, 0.3224477353328284, 0.32525449566802606, 0.3283726095182245, 0.3317732939723692, 0.33541990619748707, 0.3392693322050657, 0.34327400721027934, 0.34738431642640205, 0.35155110554346736, 0.3557280458468413, 0.35987364279817535, 0.36395273851460375, 0.36793742711450916, 0.3718073681750386, 0.37554954100845633, 0.3791575271989022, 0.382630439088784, 0.38597162744299646, 0.38918730318865985, 0.39228519756966845, 0.39527336460813955, 0.3981592023844995, 0.40094873873311593 ], [ 0.38248809244970766, 0.3770868362109873, 0.37144890692912036, 0.36561858699528654, 0.3596522033896654, 0.35361795008312624, 0.34759477709161873, 0.3416701578869121, 0.3359366432984163, 0.3304872758184087, 0.3254101680700643, 0.32078280994638286, 0.3166668939355382, 0.3131045468850413, 0.31011674525068694, 0.307704338532717, 0.3058515711942192, 0.3045314265283796, 0.3037117054072223, 0.3033606422928934, 0.3034510789200646, 0.303962663425252, 0.30488204535075797, 0.3062014321167394, 0.30791607693176776, 0.31002129288796365, 0.31250950266049204, 0.3153677114567672, 0.3185756748435907, 0.3221049305216626, 0.3259187652645948, 0.32997308895201105, 0.33421809144490944, 0.3386004773749442, 0.3430660216313986, 0.3475621717478824, 0.35204044204291324, 0.35645839121494327, 0.3607810395255979, 0.36498165266251265, 0.36904188753401285, 0.37295135400734686, 0.3767066920533347, 0.38031029414128636, 0.38376881777832433, 0.38709163358580545, 0.3902893418609838, 0.3933724675754458, 0.39635041334382837, 0.3992307157515084 ], [ 0.3795442098682507, 0.373791419923459, 0.36777200945173455, 0.36153115915259904, 0.3551272688531283, 0.34863200430974745, 0.3421293640967232, 0.3357135333594337, 0.32948538231848407, 0.3235476390951093, 0.3179990195278542, 0.3129279003776368, 0.30840640373998685, 0.3044859110760501, 0.3011949350999293, 0.2985398934059014, 0.2965087068315711, 0.29507646659648107, 0.2942119161097726, 0.2938833648496075, 0.2940629336267913, 0.29472859286634884, 0.2958640670035811, 0.2974571251299587, 0.29949696094845407, 0.3019713180434312, 0.3048638516475407, 0.30815204401830815, 0.31180586067743454, 0.3157872472594288, 0.320050495503328, 0.3245434321361387, 0.3292093045100417, 0.3339891642436772, 0.33882450034407596, 0.34365985653792086, 0.34844518532237734, 0.35313773749600275, 0.35770335032442435, 0.3621170688990079, 0.36636310414638046, 0.37043419053581744, 0.374330452713532, 0.3780579211149623, 0.3816268516093068, 0.38505000401157613, 0.388341020349475, 0.3915130184949851, 0.3945774834613543, 0.3975435013368049 ], [ 0.37663372631847825, 0.37052705237361916, 0.36412176609814395, 0.35746341256085845, 0.35061189801406833, 0.3436418012228252, 0.3366416763958108, 0.3297120685427307, 0.3229620429863816, 0.31650420228017623, 0.31044843480909834, 0.3048949845547061, 0.29992777457996506, 0.2956091315377407, 0.29197700433723034, 0.28904536311958146, 0.2868077540534577, 0.2852431791603818, 0.2843228680007631, 0.28401635775291295, 0.28429565968766174, 0.28513699494382944, 0.2865203238299582, 0.28842738939607004, 0.29083912919310123, 0.29373315040543735, 0.2970816886551873, 0.3008502362461575, 0.3049968952149259, 0.30947246228069236, 0.31422123170021793, 0.3191824676976268, 0.3242924415260137, 0.32948686358577445, 0.33470348953759926, 0.3398846566292498, 0.3449795177146977, 0.3499457815164553, 0.35475082883187775, 0.3593721443335739, 0.36379707240049663, 0.3680219657230497, 0.37205084268317734, 0.375893701348706, 0.37956465351739993, 0.38308004190296513, 0.38645668858308263, 0.3897103956066051, 0.39285478265032103, 0.39590050618032413 ], [ 0.37377759938278093, 0.3673179034876701, 0.3605258267789566, 0.3534466821175315, 0.3461412173293268, 0.3386862263076324, 0.3311741453342115, 0.32371131126026687, 0.3164146239242353, 0.30940651922632895, 0.30280844016617786, 0.2967333744661341, 0.29127843381223545, 0.2865187397475264, 0.28250388053880265, 0.27925778834710224, 0.27678208734876114, 0.27506201672796743, 0.27407330915444383, 0.2737882306245563, 0.27417944922446064, 0.27522128171707355, 0.276888760049959, 0.2791554942679391, 0.281991346281027, 0.2853606026897233, 0.2892209137012781, 0.2935229689747511, 0.29821077783163896, 0.30322245005256837, 0.308491433946792, 0.31394819189515244, 0.3195222642694397, 0.3251446112843403, 0.3307500606233979, 0.33627965115824093, 0.3416826605270641, 0.346918135106526, 0.3519557957501811, 0.3567762597221806, 0.36137058761224555, 0.36573922540691656, 0.36989046093578215, 0.3738385475940124, 0.3776016652341469, 0.38119988834583685, 0.38465331618785215, 0.38798049074708213, 0.3911971899227821, 0.3943156399001373 ], [ 0.370997435839894, 0.3641891449086109, 0.35701330123275066, 0.34951434489526134, 0.3417531184970361, 0.33380780494740836, 0.3257738691601173, 0.3177626412171962, 0.30989822475025774, 0.30231256295053827, 0.2951387748060071, 0.2885032816975541, 0.2825177105122238, 0.2772719320611596, 0.2728296642419051, 0.26922766587295294, 0.2664786685280153, 0.2645770981255542, 0.2635057801917006, 0.2632416261515838, 0.263758889671211, 0.2650296814857285, 0.2670224950143615, 0.2697000368255048, 0.2730175260732399, 0.27692205737684766, 0.2813530167971447, 0.2862431981318771, 0.29152024087732614, 0.29710817227236647, 0.3029290158520376, 0.3089045251337953, 0.31495809613891895, 0.3210168424912563, 0.3270137311512054, 0.33288961288458596, 0.3385949570336826, 0.3440911157784761, 0.34935098932288333, 0.35435902702701816, 0.3591105678477423, 0.363610586812231, 0.3678719661251592, 0.3719134460547623, 0.3757574300264054, 0.37942781988173074, 0.3829480418868155, 0.38633939411234, 0.3896198051117087, 0.3928030475225748 ], [ 0.3683151911430251, 0.3611666118753597, 0.35361439011744455, 0.34570143431187544, 0.33748787922361745, 0.32905236559644424, 0.32049236874962084, 0.3119231832367708, 0.3034751943146251, 0.29528919281849464, 0.2875097573840184, 0.2802771472885971, 0.2737186641105142, 0.26794089608063465, 0.26302441570098745, 0.25902213118347117, 0.25596154847192154, 0.25384995525718185, 0.2526805410056062, 0.25243726460780963, 0.2530970500642473, 0.25462925965134875, 0.2569936349150751, 0.2601383778806311, 0.26399963191571646, 0.2685027106416226, 0.2735646080817155, 0.279096983238062, 0.28500894850972747, 0.29120935873665055, 0.2976086362234464, 0.3041203409706224, 0.3106626996069313, 0.31716020661991734, 0.3235452829839151, 0.32975987371321325, 0.3357568117480708, 0.3415007726149135, 0.346968681144324, 0.3521494922479613, 0.3570433372919364, 0.36166009429822005, 0.3660174961872173, 0.370138931776883, 0.37405111672511293, 0.37778181514174947, 0.38135777783772995, 0.3848030324345844, 0.3881376178998449, 0.3913768070644641 ], [ 0.36575283704618183, 0.3582764160695801, 0.3503599449118557, 0.34204415560472934, 0.3333876527627263, 0.32446853570167544, 0.31538513993158507, 0.3062554865643966, 0.2972150283637982, 0.28841237857459046, 0.28000295107824263, 0.2721408537274757, 0.2649699221440563, 0.25861531012402006, 0.25317730157892065, 0.24872869164465036, 0.24531609434658952, 0.24296414766047209, 0.24168046163345813, 0.24145899085581377, 0.24228053821037554, 0.24411080001244528, 0.24689775667957164, 0.2505705011493389, 0.25504072278023576, 0.26020669632404, 0.26595860850998393, 0.2721838245263717, 0.2787711243843854, 0.28561360059402485, 0.29261043355196187, 0.29966799716201714, 0.3067007280184243, 0.3136320304604111, 0.3203952965732335, 0.326934964817902, 0.33320745218623216, 0.33918177236076763, 0.34483968096080514, 0.35017524866951755, 0.35519383565866236, 0.35991051239112365, 0.3643480332882057, 0.3685345152353403, 0.3725009993493351, 0.37627908058825293, 0.37989877611069295, 0.38338677212067307, 0.3867651445810402, 0.3900505976450403 ], [ 0.363332003702934, 0.3555445148435465, 0.3472809596149469, 0.3385793007916899, 0.32949581610820183, 0.32010704718038585, 0.3105109601824672, 0.30082690239983484, 0.2911939173122405, 0.2817670473676674, 0.2727114612797944, 0.2641946311737164, 0.25637733584537487, 0.24940484600886428, 0.24339997924263138, 0.23845945542598637, 0.23465396228998853, 0.232030830216506, 0.23061700134762128, 0.23041994661570017, 0.2314256044808752, 0.2335945345441205, 0.2368589407156827, 0.24112306250478727, 0.2462678295916291, 0.2521587353479874, 0.25865475428231777, 0.2656162069732728, 0.2729103731477092, 0.28041469327669366, 0.28801810682442386, 0.29562132591395524, 0.3031367480641192, 0.3104884515637759, 0.31761243852455945, 0.3244570757235435, 0.33098355937982965, 0.33716619066978326, 0.34299227237367086, 0.3484614986429962, 0.35358478782531927, 0.3583825865388013, 0.36288274116018293, 0.3671180841643307, 0.371123913766652, 0.3749355545483207, 0.37858617452585125, 0.38210500284659793, 0.3855160465127055, 0.38883735069832753 ], [ 0.36107360430382607, 0.3529962449297296, 0.34440800105770325, 0.3353435663351184, 0.3258561727159559, 0.3160198343522521, 0.30593091176106574, 0.29570859095009, 0.28549383358301705, 0.2754463915314248, 0.26573964692463925, 0.25655338633461444, 0.2480651459673416, 0.24044136040097433, 0.23382993267353513, 0.22835563164731454, 0.22411866975459274, 0.22119519904714688, 0.21963723635682145, 0.21946980750821812, 0.2206851494868004, 0.22323645069649223, 0.22703494087829812, 0.2319531050201276, 0.23783408423993105, 0.24450475004138308, 0.251788930507135, 0.2595179774808983, 0.26753744118688505, 0.2757100823456593, 0.2839162815787171, 0.2920530832020011, 0.30003287152404035, 0.3077822817989708, 0.3152415713687921, 0.322364402397653, 0.32911783378574083, 0.33548226951692833, 0.34145113405365196, 0.3470301121932859, 0.352235876178455, 0.35709430896140093, 0.3616383077979255, 0.3659053098581507, 0.3699347174289489, 0.3737654128447411, 0.37743354278225527, 0.3809707204407204, 0.3844027472046308, 0.3877488995065083 ], [ 0.35899745198500366, 0.3506558316029612, 0.34177058914156966, 0.3323727832708902, 0.3225120144631158, 0.31225891807539424, 0.30170709487832426, 0.29097409826215404, 0.28020104832449794, 0.2695504570105562, 0.25920197747803336, 0.24934608777655662, 0.24017619849613672, 0.23188024303342022, 0.22463319597728346, 0.21859174936015274, 0.2138912576137077, 0.21064334867662374, 0.2089314753511099, 0.20880256652363374, 0.21025599573331472, 0.2132343832802266, 0.21762156886357684, 0.2232504625975033, 0.2299191704283481, 0.23741064885635277, 0.24551072930987078, 0.2540211506125939, 0.2627666895327493, 0.27159732277326576, 0.28038716643771266, 0.28903191986182564, 0.2974460883411955, 0.30556070353203457, 0.3133217868765112, 0.32068947844825174, 0.3276375808427237, 0.3341532146711295, 0.3402363106184754, 0.34589873797911885, 0.35116296383593526, 0.3560602316035921, 0.36062833041512243, 0.36490909060269416, 0.36894578129466865, 0.37278060211465214, 0.3764524523414445, 0.37999513018310693, 0.38343606704944094, 0.38679564410003114 ], [ 0.3571218802148935, 0.3485458871470795, 0.3393965432750167, 0.32970107743465127, 0.3195050592401941, 0.30887508603367547, 0.29790102508207056, 0.28669746604408597, 0.27540398706318714, 0.26418383778955595, 0.25322074052054694, 0.24271375651204802, 0.23287057771789335, 0.2239001037108309, 0.21600548313591664, 0.20937849322152383, 0.20419486257029362, 0.20060830391510978, 0.1987401531278081, 0.19866344067018968, 0.200384859318344, 0.20383221353602338, 0.2088545992714974, 0.21523728299453312, 0.22272678371557178, 0.23105830266896862, 0.2399785950363594, 0.24926079994440617, 0.2587111566195197, 0.2681695744425525, 0.27750660527069326, 0.2866190169658022, 0.29542545232583156, 0.30386294252600726, 0.31188449232768156, 0.31945760183520355, 0.32656341206397993, 0.33319611439716523, 0.33936230185815375, 0.34508002501480006, 0.35037741883971385, 0.3552908696067765, 0.3598627807116093, 0.36413906593232037, 0.36816654403038207, 0.3719904278560622, 0.3756520944438102, 0.379187292511038, 0.38262489549144385, 0.3859862492730508 ], [ 0.355463379013595, 0.346686915134489, 0.3373113163346762, 0.3273599861327712, 0.31687429462022365, 0.3059164004820899, 0.29457173955714444, 0.2829508780216735, 0.2711903814177719, 0.25945234735084355, 0.24792232883245505, 0.23680557876046635, 0.2263218873471335, 0.2166996805116878, 0.208170226175696, 0.2009622858614547, 0.19529599884915763, 0.19137274753103997, 0.1893572934088834, 0.18935201371947172, 0.19137004758983622, 0.19531927428354734, 0.2010065785876204, 0.20816253374413143, 0.21647755322957987, 0.2256377476843507, 0.23535207708661532, 0.24536790354203045, 0.255476293888565, 0.26551032634644894, 0.2753397563414207, 0.28486461455985596, 0.29400932609034397, 0.3027180945163217, 0.31095169698039443, 0.3186854778579243, 0.3259081602838, 0.33262106017721926, 0.3388373370759534, 0.34458101103824007, 0.3498855868044039, 0.3547922362921846, 0.35934758637250186, 0.3636012336009339, 0.36760315708516345, 0.37140122300864153, 0.37503896961845656, 0.37855383227148975, 0.3819759197063425, 0.3853273928282334 ], [ 0.35403626003773636, 0.3450968391713972, 0.33553734212290937, 0.32537756636057485, 0.3146547733180465, 0.30342658993845933, 0.2917736765329254, 0.27980190503869684, 0.26764375545579583, 0.2554586411770779, 0.2434319480101332, 0.23177274727861988, 0.22071041864701701, 0.21049069219213615, 0.20137159507022592, 0.19361895905195348, 0.18749916005172954, 0.1832644137837999, 0.18112604468969276, 0.18121690746299052, 0.18355429626861522, 0.1880208703585378, 0.19437526787055193, 0.202289210255845, 0.21139610240542997, 0.22133506371741946, 0.23178116143175054, 0.24246040653149453, 0.2531527586315264, 0.2636877499245077, 0.27393676108118764, 0.28380473836883413, 0.29322293019522316, 0.30214329776798976, 0.3105346480528649, 0.3183801942460646, 0.32567609954187154, 0.3324305410913244, 0.33866289230947455, 0.34440272511183373, 0.34968845212618715, 0.35456554420991104, 0.35908435916526943, 0.3632976963810131, 0.36725824512577193, 0.3710161193349479, 0.37461666898015955, 0.3780987299895431, 0.38149342652401513, 0.38482357910540527 ], [ 0.35285236363309447, 0.3437905760773985, 0.3340934259104257, 0.3237775373584926, 0.31287642081174233, 0.3014434075381555, 0.2895544367655158, 0.2773104843423503, 0.2648393996527497, 0.2522969332751331, 0.23986681783166353, 0.2277599263558426, 0.21621275282951907, 0.20548560544519226, 0.1958606358707599, 0.18763859488538126, 0.18113067076341793, 0.17663903500585335, 0.17442048618430178, 0.17463605422335524, 0.1773033640660014, 0.18227566725125377, 0.18926092534399866, 0.19787286971908383, 0.20769197845204354, 0.21831634789205145, 0.22939342062250165, 0.24063330494863344, 0.25180899335098883, 0.26274928118020296, 0.27332886701370784, 0.28345847119719697, 0.2930764496886868, 0.30214243458504325, 0.3106329483614166, 0.3185386245632556, 0.3258625408010838, 0.3326191658035719, 0.33883349254222367, 0.3445400384485658, 0.34978151615040654, 0.35460709674886753, 0.3590702913382774, 0.36322655831352313, 0.36713079980934044, 0.3708349381792555, 0.3743857626149247, 0.37782320922775214, 0.38117919045337534, 0.3844770294348177 ], [ 0.3519208203004363, 0.34277967364746875, 0.332994209576176, 0.322578505613141, 0.3115629271411665, 0.2999970618496207, 0.2879525792544405, 0.27552584600100577, 0.26284011935030305, 0.25004717213285993, 0.23732829331377012, 0.224894764463181, 0.21298808566750035, 0.20188024250312636, 0.1918737803689156, 0.1832997920113689, 0.17650883960878183, 0.1718467771711299, 0.16960901357021196, 0.16997807742048418, 0.1729669646661746, 0.1783981612971325, 0.18593230437103514, 0.19513260452712924, 0.20553620321782476, 0.21670965887691698, 0.22828066111874712, 0.23994910120993002, 0.25148460336506356, 0.2627171534188909, 0.2735255025324176, 0.2838261041381773, 0.29356392016803645, 0.3027055077289861, 0.31123425136114197, 0.3191473231558714, 0.32645384599240906, 0.33317374160795205, 0.3393368202801506, 0.3449817799108177, 0.3501549057900818, 0.35490838205029973, 0.3592982310239815, 0.3633819804629025, 0.3672162164846134, 0.37085420978958616, 0.3743438038161102, 0.3777257283173481, 0.38103245553827764, 0.38428765662586084 ], [ 0.3512478775587258, 0.34207203193396934, 0.3322497424774531, 0.3217933220453655, 0.31073080088113086, 0.2991088407667575, 0.2869956354435261, 0.27448366420965853, 0.2616921695043014, 0.2487692729248834, 0.2358937436507441, 0.22327658183491367, 0.21116270392371417, 0.19983290562031694, 0.18960550252047867, 0.18083501260431384, 0.17390177014273694, 0.16918326056234997, 0.16700052489434136, 0.1675467429406124, 0.17082521617761218, 0.17663059871426934, 0.18458637406931871, 0.19421936741673188, 0.2050376953914029, 0.21658826602785264, 0.22848749596670329, 0.24043030216276431, 0.25218563390418014, 0.26358558176765184, 0.2745127368642174, 0.2848884277769468, 0.29466304462831894, 0.30380877612641755, 0.3123145778984134, 0.3201829326509588, 0.3274278683824054, 0.33407371172594025, 0.3401541285358974, 0.3457111131585765, 0.3507937096344039, 0.3554563668822751, 0.35975693514131624, 0.3637543955338154, 0.36750647395884195, 0.37106732198501374, 0.37448545044164244, 0.37780207806318117, 0.3810500128330879, 0.3842531253422351 ], [ 0.3508368009041675, 0.3416717242387522, 0.3318651860674259, 0.3214286180319522, 0.3103886612725502, 0.29879005067716735, 0.28669853688619573, 0.2742037427772242, 0.26142186335545026, 0.24849816828464663, 0.2356093657238938, 0.22296601592869514, 0.21081524718846573, 0.1994437829732546, 0.18918029482761411, 0.18039381410009306, 0.17348138639839475, 0.16883547367024426, 0.16678529963787483, 0.16752150869414284, 0.1710339209487375, 0.17709681615852693, 0.18531238948389608, 0.19518991100882696, 0.20622549353703537, 0.21795918640838824, 0.23000437957346545, 0.24205550585268892, 0.253882652192661, 0.2653201075122004, 0.276253394437017, 0.28660729309005906, 0.2963359917237066, 0.30541565743731675, 0.31383924026899324, 0.32161307969622877, 0.32875479177924866, 0.3352919237704802, 0.3412609332849323, 0.34670615337599253, 0.35167852248856435, 0.35623397428331094, 0.36043148619141563, 0.3643308700019771, 0.3679904479131501, 0.37146479037716207, 0.3748026969559876, 0.3780455801051725, 0.3812263690989839, 0.38436899471446373 ], [ 0.3506878545080638, 0.34157892972730036, 0.33184067428946806, 0.3214845585834063, 0.31053683311860397, 0.29904137809311965, 0.28706263289249556, 0.2746885247105418, 0.2620333308059362, 0.2492404573964538, 0.23648520476619092, 0.22397768284676808, 0.2119660310896213, 0.20073972503411586, 0.19063160267365467, 0.18201491200916223, 0.17528845317420455, 0.17084110658884544, 0.16899180492929064, 0.16991613082921506, 0.17358898959746602, 0.1797747987678471, 0.18807281393930322, 0.19799483114329755, 0.20904211690378344, 0.2207601549449149, 0.23276685313227277, 0.24475998969704324, 0.2565120701807217, 0.2678592764751816, 0.2786888606073359, 0.28892741112323866, 0.29853111445831637, 0.30747832646952206, 0.31576430272828293, 0.3233976930639018, 0.330398309595672, 0.3367956776966625, 0.34262794066623037, 0.3479407851160169, 0.3527861653586758, 0.35722071668224403, 0.3613038486374356, 0.3650955928183107, 0.3686543398769831, 0.3720346344816113, 0.3752852035699937, 0.3784473741435987, 0.3815539964903347, 0.3846289343281107 ], [ 0.3507983636098973, 0.3417899839607547, 0.3321713431702989, 0.3219548377332601, 0.3111672885058295, 0.2998527490052272, 0.2880754250236132, 0.27592263881777207, 0.26350778390184143, 0.25097325406202287, 0.2384933909269065, 0.22627753938280368, 0.2145732085029545, 0.20366886154960112, 0.19389465410747192, 0.18561728442740497, 0.17922256512217521, 0.17507870052088603, 0.1734787104096047, 0.17457403814392275, 0.17832578425549897, 0.18449953380610043, 0.1927085569376659, 0.20248497383858072, 0.21335020680357275, 0.22486593520825704, 0.23666125846939362, 0.24844075024810255, 0.2599805327166385, 0.271118440456711, 0.2817423723554226, 0.29177920542185093, 0.3011854279136824, 0.30993987196676476, 0.3180384623217499, 0.32549064628248114, 0.33231706130202415, 0.33854798354149795, 0.3442221497746118, 0.3493856307912817, 0.3540905375523783, 0.3583934470533574, 0.362353532307037, 0.3660304622034577, 0.36948219672884586, 0.3727628376483212, 0.37592070299111596, 0.37899677682836136, 0.38202364808264805, 0.3850250002947146 ], [ 0.35116285646803513, 0.3422975470733277, 0.33284753247631654, 0.32282692414835173, 0.3122639517121813, 0.30120371586352696, 0.289711070393977, 0.2778735714799846, 0.26580443739348386, 0.2536454809624571, 0.24157000282028332, 0.22978562244343514, 0.2185368605484418, 0.20810675950833976, 0.19881569090560108, 0.19101372217906856, 0.1850612218855021, 0.1812928394882082, 0.17996551370953273, 0.18120221828288607, 0.1849532177847024, 0.1909945174068718, 0.19896615308729645, 0.2084337509595952, 0.21895028801394753, 0.23010223392515125, 0.2415355936562628, 0.2529650075251166, 0.26417164389874886, 0.2749951450071528, 0.28532339416748487, 0.295082415237014, 0.3042276140867205, 0.3127368304898494, 0.3206052058708393, 0.3278416082634615, 0.33446623064378556, 0.34050894939201415, 0.3460080640011047, 0.35100911264309437, 0.35556355161050357, 0.35972718519243685, 0.3635583251223883, 0.36711573718453244, 0.3704564910662793, 0.37363386435522933, 0.37669546116402686, 0.37968169125211343, 0.38262472052609414, 0.3855479548549063 ], [ 0.3517732795251298, 0.34309088235361396, 0.333855150818895, 0.3240825460725939, 0.31380335245063634, 0.30306435021608924, 0.2919316188293019, 0.28049340479362017, 0.268862981668292, 0.25718142660400517, 0.2456202262918609, 0.23438356391439386, 0.2237099298505274, 0.21387218453909798, 0.20517424384845756, 0.19794127448464224, 0.19249943624634508, 0.18914240088652745, 0.18808683984986962, 0.18942726383073882, 0.1931068877795295, 0.19891847017825617, 0.20653643179845813, 0.21556779393783232, 0.22560441554951233, 0.236263694808211, 0.24721316338736013, 0.25818060987361297, 0.2689539795251347, 0.2793753845696197, 0.28933257759172476, 0.2987500912169799, 0.30758129114838345, 0.3158018995962968, 0.3234050902409045, 0.3303979808177631, 0.33679920749041586, 0.34263721842983447, 0.3479489425881249, 0.3527785497233592, 0.3571761003443799, 0.36119597457374736, 0.3648950556612568, 0.3683307185834832, 0.3715587307497447, 0.3746312063239865, 0.3775947662973094, 0.3804890439478092, 0.3833456431529654, 0.3861876111230977 ], [ 0.3526192754717887, 0.34415623127414025, 0.3351761844421149, 0.32569838634359716, 0.3157555824085311, 0.3053965693901337, 0.2946888670319752, 0.283721426621089, 0.2726072797569493, 0.26148600568434927, 0.2505258525427107, 0.23992525285780467, 0.22991325554304975, 0.2207479563860392, 0.21271130017939552, 0.20609784540017442, 0.20119488829457205, 0.19825284320085115, 0.19744879667641108, 0.19885174707094078, 0.2024015908099212, 0.20791127487257205, 0.21509269522789248, 0.2235974879199513, 0.23305997022890138, 0.24313216851129524, 0.253506526349587, 0.26392669763083376, 0.27418929731622327, 0.28413999290883074, 0.2936668023254338, 0.30269263098269633, 0.3111682928770605, 0.31906664169933524, 0.3263780018214781, 0.33310680983581675, 0.3392692219121867, 0.3448913794470478, 0.3500080285012684, 0.35466123487055773, 0.35889900785248613, 0.3627737271405033, 0.36634034736829313, 0.36965442501883583, 0.3727700664118355, 0.3757379291199507, 0.37860342046013995, 0.38140522612180255, 0.38417427258805853, 0.38693318423340095 ], [ 0.35368851050296624, 0.3454772652250244, 0.33678932036376436, 0.3276469427392812, 0.31808548531047576, 0.3081557864948425, 0.29792665166541465, 0.28748732326630994, 0.27694981561310233, 0.2664509487684584, 0.2561538529669231, 0.24624860828128156, 0.2369514914378459, 0.22850197506198797, 0.22115617731252218, 0.21517509401097504, 0.21080615798410873, 0.20825812820531892, 0.20767229154882494, 0.20909652721709185, 0.212470598988545, 0.2176288428727868, 0.2243204899036738, 0.2322415809016969, 0.24106949302374778, 0.250492418965596, 0.2602298053047347, 0.2700433153734565, 0.2797400557882547, 0.28917056054447765, 0.29822387695584296, 0.3068215564826725, 0.31491174271357614, 0.32246401855310314, 0.3294652729039662, 0.3359165738564124, 0.34183087250286553, 0.3472312859717724, 0.3521496973870056, 0.35662544369645294, 0.36070392213211866, 0.36443501809222095, 0.36787133012003365, 0.3710662327001641, 0.3740718683977545, 0.3769371931259426, 0.3797062098877289, 0.3824165173948348, 0.38509827318618517, 0.3877736311953956 ], [ 0.3549670345750947, 0.3470355899324805, 0.33867064763087557, 0.3298974982146541, 0.3207539947815838, 0.3112927502009638, 0.30158337239751826, 0.291714627444845, 0.2817963823183527, 0.27196112864269106, 0.26236481983967996, 0.2531866561722193, 0.24462730788149598, 0.23690486394779367, 0.23024757191872472, 0.22488235745835955, 0.2210185062293177, 0.21882710762053262, 0.21841891036913091, 0.21982538971195792, 0.22298866001347425, 0.22776420497950425, 0.23393653099938055, 0.24124373303035876, 0.24940478428569138, 0.2581438639621421, 0.2672082950263102, 0.2763791864029008, 0.28547567085910913, 0.2943544676830343, 0.3029066024101507, 0.31105281699510556, 0.3187387627010066, 0.325930635802069, 0.33261156162812705, 0.33877877573910997, 0.34444148812640357, 0.3496192328533596, 0.35434048355970094, 0.358641336860373, 0.36256411468845823, 0.36615579936415843, 0.3694662805576193, 0.3725464527556377, 0.37544624894074985, 0.37821272658610305, 0.3808883334780644, 0.3835094732549104, 0.3861054661805831, 0.38869796398956 ], [ 0.35643965712944364, 0.348811276197896, 0.34079439688182667, 0.3324171407528916, 0.32371952867799986, 0.314755436174065, 0.30559453711425616, 0.2963241119080103, 0.28705055573143307, 0.27790037144666585, 0.26902036927235046, 0.26057672039916197, 0.25275242410201426, 0.24574265455791544, 0.23974739481563212, 0.23496085258602928, 0.23155757220593004, 0.22967606987333264, 0.22940214495478242, 0.23075525640309247, 0.2336816859863997, 0.23805703220635324, 0.2436981017639705, 0.25038159161352125, 0.2578653650067517, 0.2659081865056679, 0.27428510225192404, 0.2827973713231384, 0.29127726140568666, 0.29958882660963565, 0.3076260341739088, 0.31530948968699724, 0.3225827175438291, 0.32940861925810433, 0.3357664329676758, 0.34164928642256204, 0.3470622804324116, 0.35202095376685794, 0.35654995101703774, 0.36068172707786517, 0.36445516128392186, 0.3679140081229125, 0.37110516934227034, 0.3740768258440843, 0.3768765107677945, 0.3795492332647429, 0.3821357733206184, 0.3846712613307056, 0.3871841339050485, 0.38969552350935094 ], [ 0.358090320679179, 0.3507833903660492, 0.343133678394174, 0.3351717736990142, 0.3269393529336997, 0.31849086392462966, 0.30989514921558076, 0.30123687808205746, 0.29261761696356237, 0.2841563238434112, 0.27598900411241223, 0.2682672194795153, 0.2611551056956413, 0.2548245422519194, 0.2494481570856376, 0.24519000432235835, 0.24219411551225645, 0.24057175524291, 0.2403890246304412, 0.24165713974259667, 0.2443278136407882, 0.24829537485009112, 0.2534056878970383, 0.25947021175159535, 0.26628238743236543, 0.27363339989538654, 0.281325087705473, 0.28917890433289306, 0.2970408875667173, 0.3047832975484891, 0.31230389397741, 0.31952382775888266, 0.32638494827673264, 0.3328470832476083, 0.3388856066776418, 0.34448941140885275, 0.34965926154963584, 0.35440641698628045, 0.3587513891222301, 0.36272269230889365, 0.36635548673644325, 0.3696900544119913, 0.372770100530591, 0.3756409202046318, 0.37834750917648097, 0.3809327226091097, 0.3834355959739005, 0.38588993602361227, 0.3883232694497041, 0.3907562055342074 ], [ 0.35990245586546415, 0.3529304997626452, 0.34566118208870245, 0.33812706381844215, 0.3303708404331549, 0.32244673672802066, 0.3144218013572106, 0.30637696901286227, 0.29840772544606126, 0.2906241769007292, 0.2831502954378474, 0.27612209317405867, 0.2696844819546252, 0.2639866117258289, 0.2591755664895361, 0.2553884587116102, 0.2527432390011571, 0.25132894434946274, 0.2511965830806044, 0.2523522199826637, 0.2547538345364043, 0.25831300816596775, 0.2629015156435485, 0.26836178014391054, 0.2745193371325807, 0.2811952307281456, 0.2882166349244098, 0.2954247079287299, 0.30267944343065906, 0.30986185780099906, 0.3168741649331988, 0.3236386657719421, 0.33009599291874875, 0.33620318277115213, 0.3419318617053833, 0.34726666888025287, 0.352203916003859, 0.3567504089028144, 0.36092232294644433, 0.36474402564240865, 0.36824676478655416, 0.37146717944561575, 0.3744456350246964, 0.3772244255386276, 0.379845920405017, 0.3823507556569709, 0.3847761781477932, 0.38715464556936524, 0.3895127662395962, 0.39187063364610397 ], [ 0.3618593039434532, 0.35523113194894756, 0.34834980892465944, 0.3412492845632943, 0.33397256813595844, 0.32657283256416436, 0.3191143905986719, 0.31167341766487866, 0.30433827096560406, 0.29720923292631135, 0.2903974940078413, 0.28402319305012497, 0.27821236125324256, 0.2730926753043422, 0.26878802060384377, 0.26541200366613266, 0.2630607440336642, 0.2618055220529828, 0.26168612385797846, 0.2627059146077049, 0.26482965326437935, 0.26798473927447125, 0.27206597593844967, 0.2769432196513904, 0.28247071204667745, 0.2884966637710373, 0.294871818329085, 0.3014561584090991, 0.308123437871002, 0.3147636664495983, 0.3212839543641388, 0.32760823069229095, 0.3336763212282496, 0.3394427639941084, 0.3448756042882693, 0.349955282495395, 0.3546736275397328, 0.35903290464041615, 0.36304483689571865, 0.3667295201209458, 0.3701141711002284, 0.37323168256117767, 0.3761189961205474, 0.378815340797798, 0.38136041443718166, 0.3837926049036819, 0.386147355076616, 0.3884557698830192, 0.3907435459555445, 0.393030277575738 ], [ 0.36394419592103744, 0.35766417157280406, 0.351173210891247, 0.3445060244928466, 0.3377052156351561, 0.33082210543535767, 0.32391741789314416, 0.317061711821582, 0.31033542983708473, 0.30382842415380534, 0.29763881936217534, 0.2918710894581608, 0.28663326551354273, 0.2820332535817166, 0.27817432749532717, 0.2751499648428596, 0.27303831627911107, 0.2718967376134415, 0.27175695497357916, 0.2726215300381073, 0.27446227453110533, 0.27722107125696643, 0.28081319315164527, 0.28513275829337936, 0.29005956319672427, 0.29546633351832574, 0.30122547556940565, 0.30721465954503024, 0.31332090805538376, 0.31944318767988844, 0.3254937310849444, 0.3313984278273001, 0.3370966282778473, 0.3425406421798559, 0.34769511902242983, 0.35253640201184683, 0.3570518701724316, 0.36123923271182423, 0.3651057170700056, 0.36866709300334466, 0.37194649329036455, 0.3749730203001991, 0.3777801603294187, 0.3804040588222897, 0.3828817349827736, 0.3852493306720213, 0.3875404939222698, 0.389784991311069, 0.392007626694664, 0.3942275186434045 ], [ 0.3661407814178656, 0.3602091843011594, 0.3541062254279949, 0.34786674386923955, 0.34153224789019687, 0.3351514848939955, 0.32878087458008803, 0.32248470891505865, 0.31633501255750485, 0.310410955554385, 0.30479771942678446, 0.29958474156577664, 0.29486330334962624, 0.29072348332601455, 0.28725056288973994, 0.2845210417314822, 0.28259849102989004, 0.28152954478248104, 0.28134040036379215, 0.28203424906766966, 0.2835900488804774, 0.285962946628887, 0.2890864445018104, 0.2928761256373325, 0.29723448643672595, 0.3020562572227967, 0.3072335781008922, 0.31266052412770634, 0.31823668539076466, 0.3238697294250669, 0.32947704679047357, 0.334986677666782, 0.34033773958684227, 0.3454805440981022, 0.35037652953216936, 0.3549980715590805, 0.35932817886885343, 0.3633600462366402, 0.367096422986455, 0.3705487588315607, 0.3737361064437789, 0.3766837854599768, 0.37942184080539604, 0.3819833547228879, 0.38440269311773523, 0.38671378006079893, 0.38894849786224023, 0.3911353035052312, 0.393298136126834, 0.3954556665808039 ], [ 0.3684332043716513, 0.3628466632258905, 0.35712519869767473, 0.35130317478191614, 0.3454203821138549, 0.3395223847101683, 0.3336607475801072, 0.3278930671575851, 0.32228272174009487, 0.3168982627796804, 0.31181238154064106, 0.30710041049403125, 0.302838354607206, 0.2991004913789239, 0.295956624215913, 0.293469115514358, 0.2916898614848152, 0.29065740341917295, 0.29039440294096275, 0.2909057360657641, 0.29217746329972266, 0.29417688484958604, 0.2968537769543057, 0.3001427408432349, 0.30396642279094427, 0.3082392369379393, 0.3128711818457257, 0.3177713934282798, 0.3228511938180847, 0.32802653358804507, 0.3332198425200969, 0.33836137762687696, 0.343390182052631, 0.3482547551437213, 0.3529134992871356, 0.3573349695208487, 0.3614979193784455, 0.3653911172503529, 0.36901290315630575, 0.37237046436317667, 0.37547882617143896, 0.3783595773229854, 0.38103937390944437, 0.3835482879304503, 0.3859180839261197, 0.38818051723348984, 0.39036574902773047, 0.3925009659661746, 0.39460927655866773, 0.3967089339956006 ], [ 0.3708062266228505, 0.36555819871054485, 0.3602081999454051, 0.35478957076672873, 0.3493398525825718, 0.343900948382445, 0.33851919337575276, 0.33324527595863807, 0.3281339476630145, 0.32324346691057143, 0.3186347357803938, 0.3143701111522697, 0.310511899742083, 0.3071205770616492, 0.3042527981005768, 0.30195928818035656, 0.300282715527917, 0.29925565728908765, 0.29889878416312404, 0.2992194063893004, 0.3002105358354428, 0.30185060798976626, 0.3041039590715547, 0.3069220674415395, 0.3102454646476353, 0.3140061314590892, 0.31813014643229026, 0.3225403602478412, 0.32715891885655923, 0.3319095291627941, 0.33671942747948924, 0.34152105620761375, 0.3462534728155676, 0.3508635118293974, 0.35530670493058514, 0.3595479465072056, 0.36356187956587144, 0.3673329735545577, 0.3708552718928287, 0.37413180121913153, 0.37717365385168866, 0.37999877676925337, 0.3826305217773537, 0.3850960300099776, 0.3874245375010663, 0.3896456956691272, 0.3917880001706321, 0.393877413378012, 0.39593625025437856, 0.39798237604923614 ], [ 0.3732453038243898, 0.3683265774496159, 0.36333513566273545, 0.35830282019693777, 0.3532644970576079, 0.3482580698038364, 0.3433244401154026, 0.3385073728849001, 0.3338532226016226, 0.3294104840454888, 0.32522914286769855, 0.3213598190608302, 0.3178527161203095, 0.3147564073359748, 0.31211650420089565, 0.30997425782876264, 0.3083651435817592, 0.3073174772340225, 0.3068511151437956, 0.3069763048347937, 0.30769277191855127, 0.3089891426411326, 0.3108427952061715, 0.313220200993773, 0.316077764388208, 0.31936311263678907, 0.32301674255156404, 0.3269739098892202, 0.3311666500192706, 0.3355258362739088, 0.33998320345492805, 0.34447327947482875, 0.34893517483950226, 0.3533141796194085, 0.35756311535422786, 0.36164338962531895, 0.365525706735307, 0.36919039983175805, 0.37262736697564663, 0.3758356142284449, 0.3788224307061294, 0.3816022417646525, 0.38419520536120166, 0.3866256317606458, 0.3889203169203977, 0.39110688410677535, 0.393212225914903, 0.3952611297157178, 0.3972751541239839, 0.3992718035923281 ], [ 0.3757366207878706, 0.3711358202273665, 0.36648777710674374, 0.3618224435040467, 0.3571716946487967, 0.35256923266197276, 0.34805047943649603, 0.34365243052695377, 0.3394134410578978, 0.3353729192837268, 0.3315709126855803, 0.32804758347859714, 0.3248425824474253, 0.32199433902645375, 0.319539288715468, 0.31751105516179984, 0.3159395955985024, 0.3148503104027321, 0.3142631175724087, 0.3141915059040596, 0.3146416056251765, 0.31561134447016065, 0.31708977938719257, 0.3190566998230277, 0.3214825848174656, 0.32432896707487174, 0.3275492210563465, 0.33108975691591486, 0.33489157232662853, 0.33889209074866694, 0.3430271964867632, 0.34723336330378596, 0.3514497650668018, 0.35562025546401516, 0.35969511054741216, 0.36363244281031554, 0.3673992173222304, 0.370971826698852, 0.37433620965166825, 0.3774875251233468, 0.3804294187961817, 0.3831729399333143, 0.385735183404859, 0.3881377439092645, 0.3904050764193617, 0.39256285837055926, 0.3946364447803969, 0.39664949734333294, 0.3986228530518127, 0.4005736781113869 ], [ 0.378267095123665, 0.3739711703122241, 0.3696497177753473, 0.3653304975836187, 0.361042187749831, 0.3568142131823064, 0.3526766070089491, 0.34865988804827724, 0.34479493587328763, 0.3411128469027615, 0.33764476028397533, 0.33442164903229094, 0.3314740774159568, 0.32883192732587413, 0.32652409247028596, 0.3245781295408322, 0.323019842583002, 0.32187276611285975, 0.32115751094358125, 0.32089094969350457, 0.3210852476034236, 0.32174678389669753, 0.3228750502703131, 0.3244616457533374, 0.3264895028998815, 0.3289324752174351, 0.33175539045749197, 0.33491463282023626, 0.33835926512814957, 0.342032646537433, 0.34587444972833986, 0.3498229406828015, 0.3538173594753393, 0.35780023459080473, 0.36171947547130046, 0.3655301147081313, 0.36919560721068645, 0.37268863317914164, 0.37599139004988336, 0.3790953925611665, 0.3820008280566185, 0.38471553566368005, 0.3872536932930877, 0.38963430595530696, 0.39187959304342973, 0.3940133711711012, 0.396059522961754, 0.3980406310352257, 0.39997684080253265, 0.4018849964799282 ], [ 0.38082435879800397, 0.37681904556716944, 0.37280627875981337, 0.36881141179787685, 0.36485982071564704, 0.3609766887407592, 0.3571868651657679, 0.3535147914376386, 0.34998448297599916, 0.3466195541658086, 0.34344327536793073, 0.34047865283490225, 0.3377485228268783, 0.3352756478557895, 0.3330827945723158, 0.3311927597509875, 0.32962829586179204, 0.32841187595981675, 0.32756523552380057, 0.3271086420878138, 0.32705987447752943, 0.327432939788634, 0.32823661068663684, 0.32947291765175896, 0.3311357691398263, 0.33320988775225907, 0.3356702367473958, 0.3384820682021439, 0.3416016572759771, 0.34497770692098667, 0.34855332771256664, 0.3522684318953931, 0.35606233952642213, 0.3598763823345284, 0.3636563060040703, 0.3673543075892436, 0.37093059284861074, 0.37435438975005647, 0.3776044024395354, 0.3806687304442124, 0.3835443091247374, 0.38623594951554124, 0.3887550697478409, 0.3911182175225276, 0.39334548467165065, 0.39545891144388157, 0.39748097020973544, 0.3994332061560617, 0.40133509671724593, 0.40320317278209084 ], [ 0.3833967270590111, 0.3796669672842914, 0.3759443796715327, 0.37225177917029334, 0.36861122588202133, 0.36504379068219306, 0.36156943370074623, 0.35820699520604604, 0.35497429171719586, 0.35188830606410476, 0.34896545794647454, 0.346221939753527, 0.3436740990158377, 0.34133884208144316, 0.3392340225271656, 0.3373787630664455, 0.33579364397397515, 0.33450067905310155, 0.33352299795631846, 0.3328841669717832, 0.332607112646283, 0.33271266321204324, 0.33321778619602355, 0.3341336667298564, 0.3354638268572631, 0.3372025180513674, 0.33933361657366834, 0.3418302097792507, 0.3446549850112455, 0.3477614338855217, 0.35109578194064356, 0.3545994661868891, 0.35821192607174474, 0.36187345381475344, 0.36552786616813815, 0.36912480283034965, 0.3726215151185779, 0.3759840705395446, 0.37918795576943015, 0.38221810711247634, 0.3850684319527501, 0.3877409075951439, 0.3902443569687258, 0.3925930059736907, 0.3948049265335128, 0.39690046389744676, 0.39890073719885905, 0.4008262892343614, 0.402695945407092, 0.40452592349449956 ], [ 0.38597316321032854, 0.38250347765276066, 0.37905239135894475, 0.3756401241108661, 0.3722854839705205, 0.36900563421464166, 0.3658160069510807, 0.3627303674153944, 0.3597610240015623, 0.35691917222905917, 0.3542153556677262, 0.3516600220602018, 0.34926414679907275, 0.34703988699300486, 0.345001216858725, 0.343164479774192, 0.34154877651926874, 0.3401760973785249, 0.339071103570508, 0.33826047668634607, 0.337771787648008, 0.33763188989556797, 0.33786491100998056, 0.3384899933210608, 0.33951900318134287, 0.3409544742429844, 0.34278805774518817, 0.3449997144314091, 0.34755780042793444, 0.35042008662260227, 0.3535356295552305, 0.35684730563838996, 0.36029474905005654, 0.3638174065077576, 0.3673574378973683, 0.37086224023043984, 0.37428643925409694, 0.37759326414767214, 0.3807552854056876, 0.38375454807120896, 0.3865821699336316, 0.3892374980190954, 0.39172692903648054, 0.39406250309020174, 0.3962603772617768, 0.3983392782837089, 0.40031902256421625, 0.4022191779573995, 0.4040579254670779, 0.4058511611729264 ], [ 0.38854324613722396, 0.385318055903766, 0.38211998423653004, 0.3789666647675384, 0.3758737814485214, 0.37285485216405667, 0.369921187300331, 0.3670820299808227, 0.3643448737870022, 0.3617159446304363, 0.35920082586074914, 0.35680519867850086, 0.3545356620102128, 0.3524005858236781, 0.35041093874942053, 0.3485810154313207, 0.34692897352660024, 0.34547707873920974, 0.3442515541004504, 0.3432819427203699, 0.34259992615375656, 0.342237595170756, 0.3422252432096777, 0.34258883635632537, 0.34334739283916565, 0.34451056163594673, 0.34607670641401, 0.3480317665489629, 0.35034908159613803, 0.35299024281779373, 0.3559068992537026, 0.35904332412518136, 0.3623394632093867, 0.36573415236564794, 0.36916820585606397, 0.3725871292916993, 0.3759432845543407, 0.3791974126455718, 0.3823194917077658, 0.38528896433183973, 0.38809440843420506, 0.39073275055252427, 0.3932081322156795, 0.3955305423352435, 0.39771432418128744, 0.39977665653649547, 0.40173609643085345, 0.40361125628748273, 0.4054196719574535, 0.4071769005833985 ], [ 0.3910971455542727, 0.3881010408373134, 0.38513798310375763, 0.3822230843058921, 0.3793690825195454, 0.37658615317582944, 0.37388191765666995, 0.3712616573537395, 0.3687287288319592, 0.3662851647900546, 0.3639324361158909, 0.36167234171988094, 0.35950798372602344, 0.35744477475302133, 0.35549141077450624, 0.35366072790250275, 0.3519703464365515, 0.3504429943949878, 0.3491064006558209, 0.3479926605939299, 0.3471370098251385, 0.3465759969485527, 0.3463451220714052, 0.3464760963083822, 0.3469939637708089, 0.34791439252509143, 0.34924146506583253, 0.3509662684678854, 0.3530664979441636, 0.35550715816188555, 0.3582422998063331, 0.3612175950035251, 0.3643734604808657, 0.36764839618348005, 0.3709822195491358, 0.37431893002605654, 0.37760901681314973, 0.38081110723665873, 0.3838929298276005, 0.386831627046189, 0.38961349513003596, 0.3922332539463721, 0.3946929612054007, 0.39700068663387933, 0.3991690559752275, 0.40121376441229123, 0.40315214580905234, 0.4050018690242615, 0.4067798161088148, 0.4085011800175046 ], [ 0.3936256078889225, 0.39084356491653527, 0.3880982361832752, 0.38540232146727543, 0.38276582851486857, 0.38019591901626576, 0.3776969685484427, 0.3752708490189954, 0.37291742854327453, 0.3706352714372184, 0.3684225103227118, 0.36627785263330537, 0.36420167396356457, 0.36219713956107, 0.3602712821598064, 0.3584359496850703, 0.35670852196677033, 0.35511228496194114, 0.3536763490593033, 0.352435010586823, 0.35142648801874365, 0.3506910197098846, 0.35026838703517427, 0.35019501808192266, 0.3505009180648721, 0.35120674352921366, 0.352321367274228, 0.3538402544430084, 0.3557448842175043, 0.3580033185052583, 0.36057186499513777, 0.36339763924462815, 0.36642172745074725, 0.36958260457179726, 0.37281947252318975, 0.3760752383647231, 0.3792989338930613, 0.3824474666129508, 0.3854866727258669, 0.38839170680663776, 0.3911468473297713, 0.3937448234038264, 0.3961857794111618, 0.3984759947514737, 0.4006264691426637, 0.40265147266334583, 0.40456714574702435, 0.4063902187751943, 0.4081369044607116, 0.40982199939783653 ], [ 0.3961199537604566, 0.3935375026754783, 0.3909935030536393, 0.3884983869699969, 0.386059672865576, 0.3836818502323263, 0.381366489395059, 0.37911258471031284, 0.37691712517070886, 0.3747758733024693, 0.37268432170615207, 0.37063878617401363, 0.36863758404173513, 0.3666822352149193, 0.36477861049969446, 0.3629379377654701, 0.36117756275492785, 0.35952135130020946, 0.3579996180579821, 0.3566484793135624, 0.35550855937185855, 0.3546230350009096, 0.3540350795814456, 0.353784861055255, 0.3539063412822453, 0.3544241989757295, 0.3553512323794795, 0.35668657481045496, 0.3584149717433362, 0.3605072339405847, 0.36292182334472806, 0.3656073801889837, 0.36850589089818675, 0.3715561446051015, 0.3746971334505736, 0.37787110657399214, 0.38102607056319077, 0.38411762009838757, 0.3871100658238832, 0.3899768927594826, 0.39270062857939314, 0.3952722280117188, 0.3976900909935541, 0.39995883228370477, 0.402087912817737, 0.4040902311310811, 0.40598075867054434, 0.4077752869959008, 0.4094893384884066, 0.4111372757553601 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.00823543 (SEM: 0)
x1: 0.979432
x2: 0.784923
x3: 0.297002
x4: 0.430659
x5: 0.786892
x6: 0.07397", "Arm 10_0
hartmann6: -0.603883 (SEM: 0)
x1: 0.591468
x2: 0.371087
x3: 0.92552
x4: 0.358084
x5: 0.495212
x6: 0.769208", "Arm 11_0
hartmann6: -0.223249 (SEM: 0)
x1: 0.690951
x2: 0.0306413
x3: 0.216716
x4: 0.716453
x5: 0.291473
x6: 0.575743", "Arm 12_0
hartmann6: -0.45371 (SEM: 0)
x1: 0.177877
x2: 0.674407
x3: 0.421198
x4: 0.338802
x5: 0.594461
x6: 0.219123", "Arm 13_0
hartmann6: -0.634692 (SEM: 0)
x1: 0.231516
x2: 0.616074
x3: 0.476394
x4: 0.335011
x5: 0.465578
x6: 0.263612", "Arm 14_0
hartmann6: -0.845565 (SEM: 0)
x1: 0.291882
x2: 0.5522
x3: 0.568437
x4: 0.331709
x5: 0.410356
x6: 0.333812", "Arm 15_0
hartmann6: -1.05637 (SEM: 0)
x1: 0.33613
x2: 0.500325
x3: 0.646939
x4: 0.333627
x5: 0.377844
x6: 0.398972", "Arm 16_0
hartmann6: -1.25156 (SEM: 0)
x1: 0.366051
x2: 0.451651
x3: 0.71543
x4: 0.335184
x5: 0.347802
x6: 0.453928", "Arm 17_0
hartmann6: -1.39282 (SEM: 0)
x1: 0.369722
x2: 0.396793
x3: 0.776089
x4: 0.331656
x5: 0.300074
x6: 0.485381", "Arm 18_0
hartmann6: -1.30399 (SEM: 0)
x1: 0.336904
x2: 0.344148
x3: 0.819443
x4: 0.31952
x5: 0.248514
x6: 0.469396", "Arm 19_0
hartmann6: -1.56399 (SEM: 0)
x1: 0.396041
x2: 0.393813
x3: 0.761329
x4: 0.341066
x5: 0.261872
x6: 0.548757", "Arm 1_0
hartmann6: -0.373106 (SEM: 0)
x1: 0.249398
x2: 0.568361
x3: 0.531979
x4: 0.271478
x5: 0.804936
x6: 0.230381", "Arm 20_0
hartmann6: -1.59227 (SEM: 0)
x1: 0.401077
x2: 0.389952
x3: 0.719855
x4: 0.352102
x5: 0.207668
x6: 0.597962", "Arm 21_0
hartmann6: -1.45421 (SEM: 0)
x1: 0.44262
x2: 0.378485
x3: 0.729044
x4: 0.317232
x5: 0.199577
x6: 0.569486", "Arm 22_0
hartmann6: -1.61637 (SEM: 0)
x1: 0.372955
x2: 0.391623
x3: 0.768302
x4: 0.37871
x5: 0.244363
x6: 0.601324", "Arm 23_0
hartmann6: -1.8651 (SEM: 0)
x1: 0.351682
x2: 0.407125
x3: 0.737527
x4: 0.338623
x5: 0.257507
x6: 0.623074", "Arm 2_0
hartmann6: -0.0805311 (SEM: 0)
x1: 0.00450812
x2: 0.274208
x3: 0.350825
x4: 0.503775
x5: 0.874895
x6: 0.905855", "Arm 3_0
hartmann6: -0.0429713 (SEM: 0)
x1: 0.0290827
x2: 0.393902
x3: 0.595405
x4: 0.916642
x5: 0.915106
x6: 0.568628", "Arm 4_0
hartmann6: -0.0126235 (SEM: 0)
x1: 0.572154
x2: 0.218557
x3: 0.024659
x4: 0.0777005
x5: 0.823543
x6: 0.654053", "Arm 5_0
hartmann6: -0.298741 (SEM: 0)
x1: 0.912443
x2: 0.410203
x3: 0.956054
x4: 0.558295
x5: 0.143371
x6: 0.673672", "Arm 6_0
hartmann6: -0.159117 (SEM: 0)
x1: 0.470742
x2: 0.809175
x3: 0.888021
x4: 0.923421
x5: 0.00837565
x6: 0.851274", "Arm 7_0
hartmann6: -0.0409104 (SEM: 0)
x1: 0.953139
x2: 0.757169
x3: 0.884338
x4: 0.19917
x5: 0.63656
x6: 0.947568", "Arm 8_0
hartmann6: -0.329269 (SEM: 0)
x1: 0.0658751
x2: 0.830336
x3: 0.209183
x4: 0.519807
x5: 0.39785
x6: 0.210257", "Arm 9_0
hartmann6: -0.170027 (SEM: 0)
x1: 0.538918
x2: 0.988224
x3: 0.941543
x4: 0.282868
x5: 0.189363
x6: 0.421953" ], "type": "scatter", "x": [ 0.9794321060180664, 0.5914676208049059, 0.6909514805302024, 0.1778768148813106, 0.2315162014293475, 0.29188205050993954, 0.33612953635828546, 0.36605058261781953, 0.369721963294722, 0.3369037948380292, 0.396040823755955, 0.24939769599586725, 0.4010768823949977, 0.4426197893690578, 0.37295535938323604, 0.35168199134834444, 0.00450812466442585, 0.02908271737396717, 0.572154127061367, 0.9124428760260344, 0.4707419825717807, 0.9531386848539114, 0.06587506551295519, 0.5389183945953846 ], "xaxis": "x", "y": [ 0.7849229574203491, 0.37108732108026743, 0.03064131084829569, 0.6744073832361512, 0.6160737556494109, 0.5522000600157247, 0.5003251757569187, 0.4516510279539641, 0.39679304130410087, 0.3441483495432939, 0.39381301572228916, 0.5683613494038582, 0.38995214834384917, 0.37848546823878204, 0.39162327522900264, 0.4071247787102214, 0.2742081005126238, 0.39390181470662355, 0.21855673659592867, 0.4102029297500849, 0.809175293892622, 0.7571685556322336, 0.8303359784185886, 0.9882235275581479 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.00823543 (SEM: 0)
x1: 0.979432
x2: 0.784923
x3: 0.297002
x4: 0.430659
x5: 0.786892
x6: 0.07397", "Arm 10_0
hartmann6: -0.603883 (SEM: 0)
x1: 0.591468
x2: 0.371087
x3: 0.92552
x4: 0.358084
x5: 0.495212
x6: 0.769208", "Arm 11_0
hartmann6: -0.223249 (SEM: 0)
x1: 0.690951
x2: 0.0306413
x3: 0.216716
x4: 0.716453
x5: 0.291473
x6: 0.575743", "Arm 12_0
hartmann6: -0.45371 (SEM: 0)
x1: 0.177877
x2: 0.674407
x3: 0.421198
x4: 0.338802
x5: 0.594461
x6: 0.219123", "Arm 13_0
hartmann6: -0.634692 (SEM: 0)
x1: 0.231516
x2: 0.616074
x3: 0.476394
x4: 0.335011
x5: 0.465578
x6: 0.263612", "Arm 14_0
hartmann6: -0.845565 (SEM: 0)
x1: 0.291882
x2: 0.5522
x3: 0.568437
x4: 0.331709
x5: 0.410356
x6: 0.333812", "Arm 15_0
hartmann6: -1.05637 (SEM: 0)
x1: 0.33613
x2: 0.500325
x3: 0.646939
x4: 0.333627
x5: 0.377844
x6: 0.398972", "Arm 16_0
hartmann6: -1.25156 (SEM: 0)
x1: 0.366051
x2: 0.451651
x3: 0.71543
x4: 0.335184
x5: 0.347802
x6: 0.453928", "Arm 17_0
hartmann6: -1.39282 (SEM: 0)
x1: 0.369722
x2: 0.396793
x3: 0.776089
x4: 0.331656
x5: 0.300074
x6: 0.485381", "Arm 18_0
hartmann6: -1.30399 (SEM: 0)
x1: 0.336904
x2: 0.344148
x3: 0.819443
x4: 0.31952
x5: 0.248514
x6: 0.469396", "Arm 19_0
hartmann6: -1.56399 (SEM: 0)
x1: 0.396041
x2: 0.393813
x3: 0.761329
x4: 0.341066
x5: 0.261872
x6: 0.548757", "Arm 1_0
hartmann6: -0.373106 (SEM: 0)
x1: 0.249398
x2: 0.568361
x3: 0.531979
x4: 0.271478
x5: 0.804936
x6: 0.230381", "Arm 20_0
hartmann6: -1.59227 (SEM: 0)
x1: 0.401077
x2: 0.389952
x3: 0.719855
x4: 0.352102
x5: 0.207668
x6: 0.597962", "Arm 21_0
hartmann6: -1.45421 (SEM: 0)
x1: 0.44262
x2: 0.378485
x3: 0.729044
x4: 0.317232
x5: 0.199577
x6: 0.569486", "Arm 22_0
hartmann6: -1.61637 (SEM: 0)
x1: 0.372955
x2: 0.391623
x3: 0.768302
x4: 0.37871
x5: 0.244363
x6: 0.601324", "Arm 23_0
hartmann6: -1.8651 (SEM: 0)
x1: 0.351682
x2: 0.407125
x3: 0.737527
x4: 0.338623
x5: 0.257507
x6: 0.623074", "Arm 2_0
hartmann6: -0.0805311 (SEM: 0)
x1: 0.00450812
x2: 0.274208
x3: 0.350825
x4: 0.503775
x5: 0.874895
x6: 0.905855", "Arm 3_0
hartmann6: -0.0429713 (SEM: 0)
x1: 0.0290827
x2: 0.393902
x3: 0.595405
x4: 0.916642
x5: 0.915106
x6: 0.568628", "Arm 4_0
hartmann6: -0.0126235 (SEM: 0)
x1: 0.572154
x2: 0.218557
x3: 0.024659
x4: 0.0777005
x5: 0.823543
x6: 0.654053", "Arm 5_0
hartmann6: -0.298741 (SEM: 0)
x1: 0.912443
x2: 0.410203
x3: 0.956054
x4: 0.558295
x5: 0.143371
x6: 0.673672", "Arm 6_0
hartmann6: -0.159117 (SEM: 0)
x1: 0.470742
x2: 0.809175
x3: 0.888021
x4: 0.923421
x5: 0.00837565
x6: 0.851274", "Arm 7_0
hartmann6: -0.0409104 (SEM: 0)
x1: 0.953139
x2: 0.757169
x3: 0.884338
x4: 0.19917
x5: 0.63656
x6: 0.947568", "Arm 8_0
hartmann6: -0.329269 (SEM: 0)
x1: 0.0658751
x2: 0.830336
x3: 0.209183
x4: 0.519807
x5: 0.39785
x6: 0.210257", "Arm 9_0
hartmann6: -0.170027 (SEM: 0)
x1: 0.538918
x2: 0.988224
x3: 0.941543
x4: 0.282868
x5: 0.189363
x6: 0.421953" ], "type": "scatter", "x": [ 0.9794321060180664, 0.5914676208049059, 0.6909514805302024, 0.1778768148813106, 0.2315162014293475, 0.29188205050993954, 0.33612953635828546, 0.36605058261781953, 0.369721963294722, 0.3369037948380292, 0.396040823755955, 0.24939769599586725, 0.4010768823949977, 0.4426197893690578, 0.37295535938323604, 0.35168199134834444, 0.00450812466442585, 0.02908271737396717, 0.572154127061367, 0.9124428760260344, 0.4707419825717807, 0.9531386848539114, 0.06587506551295519, 0.5389183945953846 ], "xaxis": "x2", "y": [ 0.7849229574203491, 0.37108732108026743, 0.03064131084829569, 0.6744073832361512, 0.6160737556494109, 0.5522000600157247, 0.5003251757569187, 0.4516510279539641, 0.39679304130410087, 0.3441483495432939, 0.39381301572228916, 0.5683613494038582, 0.38995214834384917, 0.37848546823878204, 0.39162327522900264, 0.4071247787102214, 0.2742081005126238, 0.39390181470662355, 0.21855673659592867, 0.4102029297500849, 0.809175293892622, 0.7571685556322336, 0.8303359784185886, 0.9882235275581479 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "9f76585e", "metadata": { "papermill": { "duration": 0.061839, "end_time": "2024-03-01T16:35:38.154817", "exception": false, "start_time": "2024-03-01T16:35:38.092978", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "337f1c4e", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:38.278790Z", "iopub.status.busy": "2024-03-01T16:35:38.278124Z", "iopub.status.idle": "2024-03-01T16:35:38.915423Z", "shell.execute_reply": "2024-03-01T16:35:38.914645Z" }, "papermill": { "duration": 0.703688, "end_time": "2024-03-01T16:35:38.919963", "exception": false, "start_time": "2024-03-01T16:35:38.216275", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:38] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0993413497776021, 1.0961032042340537, 1.0931752827656962, 1.090570495579947, 1.0883013757090556, 1.0863800174285927, 1.0848180124339757, 1.0836263838144409, 1.0828155179509278, 1.0823950945823588, 1.0823740154310388, 1.082760331946778, 1.0835611729109849, 1.08478267282251, 1.0864299021493846, 1.0885068006548373, 1.0910161150714863, 1.093959342385071, 1.0973366798838478, 1.1011469829251739, 1.1053877310717644, 1.1100550028763112, 1.11514345918076, 1.1206463343972193, 1.1265554349150868, 1.1328611436018043, 1.139552429394419, 1.1466168612573195, 1.1540406263150855, 1.1618085527192425, 1.169904138682761, 1.1783095899787637, 1.1870058688813576, 1.195972757856802, 1.2051889411563104, 1.2146321067522683, 1.2242790698288954, 1.2341059174201678, 1.2440881720012322, 1.2542009701466401, 1.2644192510214478, 1.2747179486586344, 1.2850721817879063, 1.295457435396758, 1.3058497291089113, 1.316225768683695, 1.3265630782786288, 1.3368401124042761, 1.3470363476069747, 1.3571323547694085 ], [ 1.0937540068961586, 1.090444060110587, 1.0874490211965895, 1.084782207604704, 1.0824565677449722, 1.0804846173904707, 1.0788783734231615, 1.0776492849265453, 1.0768081617294165, 1.0763651006412762, 1.076329409791213, 1.0767095316820896, 1.0775129657897873, 1.078746191757648, 1.0804145944384893, 1.082522392196329, 1.0850725699708947, 1.088066818604156, 1.0915054818079515, 1.0953875119025698, 1.0997104350794773, 1.1044703264568465, 1.1096617946468958, 1.1152779750034918, 1.1213105302517425, 1.1277496569130951, 1.1345840959212903, 1.1418011461463484, 1.149386680231576, 1.157325163166134, 1.1655996752524824, 1.1741919423991558, 1.1830823777373822, 1.1922501391716005, 1.2016732074155412, 1.2113284882200746, 1.221191940891443, 1.2312387330116326, 1.2414434188227133, 1.251780136411375, 1.2622228170019674, 1.2727453986102457, 1.2833220361458746, 1.2939273007291097, 1.3045363623163726, 1.3151251514394982, 1.325670497669923, 1.3361502440825648, 1.346543338351199, 1.3568299020826422 ], [ 1.0885692069441144, 1.0851929870543096, 1.0821361462741876, 1.0794123990339128, 1.0770350998518494, 1.0750171777759527, 1.07337106771917, 1.072108638651008, 1.0712411187194777, 1.0707790175334582, 1.0707320460335865, 1.0711090346142387, 1.0719178504190436, 1.0731653149996416, 1.0748571237787623, 1.0769977689646544, 1.0795904676913024, 1.082637097173433, 1.0861381385365803, 1.0900926306888843, 1.0944981351376086, 1.0993507120377095, 1.1046449070384734, 1.1103737477464684, 1.1165287479564339, 1.1230999173454856, 1.1300757742125702, 1.1374433591854778, 1.1451882486724105, 1.1532945681811309, 1.1617450073391402, 1.1705208402831098, 1.1796019567136746, 1.1889669099600177, 1.198592988533168, 1.2084563166621654, 1.2185319872062315, 1.2287942273637424, 1.2392165942141355, 1.249772193908676, 1.2604339158283107, 1.271174671655323, 1.2819676292180011, 1.292786432059739, 1.3036053976430846, 1.314399689505387, 1.3251454611188667, 1.3358199713444716, 1.346401673007325, 1.3568702771944547 ], [ 1.0838115645407527, 1.080375298395294, 1.0772626667302883, 1.0744877682826297, 1.0720643518482118, 1.0700057488274939, 1.0683248021881935, 1.0670337917563872, 1.0661443558715855, 1.0656674096165855, 1.0656130600592388, 1.0659905192153452, 1.0668080157484032, 1.068072706743929, 1.0697905912065642, 1.0719664271926936, 1.0746036546690487, 1.07770432623435, 1.0812690477145728, 1.0852969303090558, 1.0897855554089726, 1.0947309524434474, 1.1001275891800841, 1.105968372907685, 1.112244659993929, 1.1189462706098412, 1.1260615051322804, 1.1335771590460078, 1.141478534182522, 1.1497494458648407, 1.158372227842314, 1.1673277394975905, 1.1765953822367483, 1.186153133691116, 1.1959776088453573, 1.2060441561068482, 1.2163269935930618, 1.2267993868576643, 1.2374338645682024, 1.2482024641542089, 1.2590769960083203, 1.2700293130435416, 1.2810315724946357, 1.2920564785964126, 1.3030774976629953, 1.3140690404792295, 1.3250066101895552, 1.335866916585874, 1.3466279596259942, 1.3572690861270076 ], [ 1.0795048302965848, 1.0760154487343063, 1.0728537398588571, 1.0700341715480564, 1.0675708723582507, 1.0654775622534975, 1.063767479251732, 1.0624533018399909, 1.0615470671457137, 1.0610600850456082, 1.0610028486484173, 1.0613849418997898, 1.0622149454151464, 1.0635003420301727, 1.0652474239387593, 1.0674612036251658, 1.0701453310415083, 1.0733020195779475, 1.0769319832648563, 1.0810343872840025, 1.0856068132190178, 1.0906452395441284, 1.0961440366798023, 1.1020959746356793, 1.108492239976594, 1.115322457804128, 1.1225747138965423, 1.1302355723466706, 1.1382900851766378, 1.1467217925656585, 1.1555127153873719, 1.1646433453616012, 1.1740926416821726, 1.1838380457113657, 1.1938555264308437, 1.2041196682055282, 1.2146038088750475, 1.2252802306408106, 1.2361203996296106, 1.247095243695354, 1.258175453259724, 1.2693317876898071, 1.2805353701336368, 1.2917579565008155, 1.3029721685414626, 1.314151685736859, 1.3252713950861907, 1.3363075012731327, 1.3472376018879104, 1.3580407334190665 ], [ 1.075671703150161, 1.0721368385771386, 1.0689334683658671, 1.0660764118128288, 1.063580159925378, 1.0614588044253261, 1.0597259621537176, 1.0583946946610079, 1.0574774229113404, 1.0569858372413545, 1.05693080299717, 1.0573222626255523, 1.0581691354074354, 1.0594792164737947, 1.0612590772038937, 1.0635139695295854, 1.0662477369986003, 1.0694627356170445, 1.073159767423094, 1.0773380293712462, 1.0819950793779147, 1.0871268202767643, 1.0927275009912893, 1.0987897325571088, 1.1053045149032825, 1.1122612687979938, 1.1196478664105562, 1.1274506538956504, 1.135654460581523, 1.1442425919262587, 1.153196807342115, 1.162497288893939, 1.172122611990598, 1.1820497334213866, 1.1922540142236995, 1.2027092938886874, 1.2133880278952913, 1.2242614929792413, 1.2353000552814706, 1.2464734875706496, 1.2577513150927024, 1.2691031666325725, 1.2804991084167772, 1.2919099428400995, 1.3033074602826986, 1.314664638944757, 1.3259557934003956, 1.337156676728556, 1.3482445434301247, 1.3591981811085077 ], [ 1.0723336425676238, 1.0687616180169976, 1.0655246953750945, 1.0626380250389043, 1.060116440283286, 1.0579743846386223, 1.0562258341469482, 1.0548842142056902, 1.0539623108594194, 1.053472176627043, 1.0534250312614706, 1.0538311582314195, 1.0546997981830626, 1.056039041163875, 1.057855719939889, 1.06015530726133, 1.0629418203652172, 1.0662177362653396, 1.069983921378457, 1.074239578678561, 1.0789822147802548, 1.0842076280848159, 1.0899099173937477, 1.0960815083035624, 1.1027131924448523, 1.1097941725324891, 1.1173121046700063, 1.1252531288803198, 1.133601879891043, 1.1423414731376815, 1.151453465844083, 1.1609177995444262, 1.1707127376130901, 1.1808148177939604, 1.191198843551643, 1.2018379376194044, 1.2127036754949352, 1.2237663062966975, 1.2349950553232714, 1.2463584899000235, 1.2578249207695809, 1.26936280748448, 1.2809411383949516, 1.292529762632751, 1.3040996607092852, 1.3156231495970485, 1.3270740256743525, 1.338427653824983, 1.3496610132739517, 1.3607527109293258 ], [ 1.0695106827044751, 1.0659104916569684, 1.0626487998731964, 1.0597410659253546, 1.057202442247578, 1.0550477009921033, 1.053291154244823, 1.0519465682284423, 1.0510270712766243, 1.050545055601924, 1.0505120732134188, 1.0509387267706323, 1.0518345566840794, 1.0532079263726324, 1.0550659082317744, 1.0574141735029365, 1.0602568897897506, 1.0635966303480293, 1.0674342993715555, 1.0717690771869566, 1.076598388448501, 1.0819178950114114, 1.0877215131458584, 1.094001452214801, 1.1007482690833634, 1.1079509297083023, 1.115596867073079, 1.1236720235055224, 1.1321608661098232, 1.1410463671516842, 1.15030994707472, 1.159931386191202, 1.1698887209935063, 1.1801581505702252, 1.1907139851403017, 1.2015286695025853, 1.2125729074590443, 1.2238158992708383, 1.2352256857278032, 1.2467695741253204, 1.2584146082664027, 1.2701280397995414, 1.281877762200688, 1.2936326792691784, 1.3053629934399915, 1.3170404119158252, 1.3286382781772965, 1.3401316419485811, 1.3514972825266718, 1.3627136995424334 ], [ 1.0672212507297427, 1.0636025271057252, 1.0603254950629795, 1.0574058958376908, 1.0548591749771163, 1.0527004067787358, 1.0509442125845985, 1.0496046724746788, 1.0486952300590944, 1.0482285903172932, 1.0482166107849418, 1.0486701868546089, 1.0495991325329672, 1.0510120586720724, 1.0529162514344075, 1.0553175545081035, 1.0582202592813785, 1.0616270077081764, 1.0655387128194782, 1.0699545016111276, 1.0748716842244577, 1.0802857518145572, 1.0861904032183987, 1.0925775975420726, 1.0994376262766719, 1.1067591948991136, 1.1145295006846347, 1.1227342914043121, 1.131357889586328, 1.1403831699780678, 1.1497914844400952, 1.1595625388553592, 1.169674239858852, 1.1801025429931211, 1.1908213445757039, 1.201802462786851, 1.2130157459076032, 1.2244293268997395, 1.2360100174082804, 1.2477238079599637, 1.2595364224419336, 1.271413868968726, 1.2833229363478824, 1.2952316015822702, 1.3071093332233519, 1.3189272925404505, 1.3306584462529314, 1.3422776103063092, 1.3537614449140396, 1.3650884186183583 ], [ 1.0654819916088107, 1.0618549695185164, 1.058572632280262, 1.0556509757543098, 1.0531057096480176, 1.0509521806368138, 1.049205288862808, 1.0478793972698357, 1.04698823338805, 1.0465447834339998, 1.0465611789602585, 1.0470485767832498, 1.048017033543203, 1.0494753769964005, 1.051431076979501, 1.0538901198666037, 1.0568568911793006, 1.06033407169243, 1.0643225527555558, 1.068821376448215, 1.0738277054251877, 1.079336825724873, 1.0853421833087378, 1.091835451678385, 1.0988066237445047, 1.1062441165676138, 1.1141348732626397, 1.1224644431160384, 1.131217019894082, 1.1403754206597718, 1.1499209943391189, 1.1598334614825956, 1.1700907036814152, 1.1806685404617, 1.1915405482875028, 1.2026779839087027, 1.214049866690505, 1.225623249921932, 1.2373636743497516, 1.2492357593055319, 1.2612038602525029, 1.2732327143656057, 1.2852880079054894, 1.297336823763548, 1.3093479550845888, 1.3212920935025423, 1.3331419144390921, 1.3448720871161621, 1.3564592356869958, 1.3678818730705458 ], [ 1.064307601729481, 1.0606830647867085, 1.0574060133084333, 1.05449266730678, 1.051958968870443, 1.049820504055092, 1.0480924177117632, 1.046789320630184, 1.0459251885238579, 1.0455132526377138, 1.0455658821376057, 1.0460944589593415, 1.047109246462112, 1.0486192540427308, 1.050632100799175, 1.0531538823349367, 1.0561890457848797, 1.0597402789959314, 1.0638084203473825, 1.0683923957470647, 1.073489188673416, 1.079093847543179, 1.085199532016306, 1.091797596057896, 1.0988777007817436, 1.1064279446434884, 1.1144349930461666, 1.1228841847827873, 1.131759590212874, 1.1410439972112651, 1.1507188074926138, 1.1607638394455937, 1.171157054524595, 1.181874250407635, 1.1928887895164215, 1.204171446374799, 1.215690451377339, 1.2274117769778532, 1.239299661023429, 1.2513173076097357, 1.2634276682720096, 1.2755941980372651, 1.2877815009689553, 1.2999558165105325, 1.3120853362141351, 1.324140369378745, 1.3360933916008868, 1.3479190137310806, 1.3595939043679464, 1.3710966910915712 ], [ 1.063710673826887, 1.0600998940898463, 1.0568392140802443, 1.0539450451949472, 1.0514335274354107, 1.0493204501388447, 1.0476211652560412, 1.0463504924780724, 1.0455226156574136, 1.0451509702212465, 1.0452481216588017, 1.0458256357007731, 1.0468939415103289, 1.0484621900733617, 1.0505381109913239, 1.0531278719969597, 1.056235946647302, 1.0598649966711773, 1.0640157761830755, 1.0686870652003568, 1.0738756393651512, 1.079576281225643, 1.0857818356681352, 1.0924833080096967, 1.0996699979286193, 1.1073296561235928, 1.1154486439341198, 1.1240120700373657, 1.13300387406743, 1.1424068263717033, 1.1522024184436641, 1.1623706324524568, 1.172889602601698, 1.183735214805196, 1.19488072776499, 1.2062965245594406, 1.2179501026207438, 1.229806371012878, 1.2418282534258949, 1.2539775180940882, 1.2662157032432289, 1.2785049979211531, 1.2908089702213343, 1.3030930881776466, 1.3153250302836923, 1.327474818125973, 1.3395148194615343, 1.3514196702850974, 1.3631661557468182, 1.3747330781030622 ], [ 1.0637015557014031, 1.0601162225956398, 1.0568834228648856, 1.0540197244077232, 1.0515414281734303, 1.0494644877853674, 1.047804421377149, 1.046576214879929, 1.0457942161351585, 1.0454720194551472, 1.0456223406397809, 1.0462568830055843, 1.047386195711351, 1.0490195265786562, 1.0511646726928192, 1.053827833287357, 1.0570134706807663, 1.0607241862172148, 1.064960619076034, 1.0697213762186393, 1.0750030013564549, 1.0807999893592368, 1.087104849727274, 1.0939082184689177, 1.1011990119710382, 1.108964609469576, 1.1171910430484224, 1.1258631665724148, 1.1349647688601348, 1.144478593585677, 1.154386231602469, 1.1646678643109147, 1.1753018631778804, 1.186264291774835, 1.197528406676343, 1.20906429512468, 1.220838795163513, 1.2328157981622918, 1.2449569390245967, 1.2572225717995216, 1.2695728562397932, 1.2819687729621994, 1.2943729342020076, 1.306750131827333, 1.3190676313748142, 1.3312952623847214, 1.343405369714052, 1.3553726857561799, 1.367174169489733, 1.378788842528009 ], [ 1.0642882252104358, 1.0607403651018672, 1.0575472960723933, 1.0547257057429125, 1.052292016800443, 1.0502623055440035, 1.0486522123741222, 1.0474768434151789, 1.0467506625883465, 1.0464873736956144, 1.0466997924603456, 1.0473997090243423, 1.0485977421479136, 1.0503031873086282, 1.0525238620384378, 1.0552659531391282, 1.0585338717932877, 1.0623301239098843, 1.0666552041167325, 1.0715075223832204, 1.076883372022203, 1.0827769464583306, 1.0891804093680264, 1.0960840183955467, 1.1034762965984015, 1.1113442382722143, 1.1196735273188572, 1.1284487376189956, 1.1376534770890094, 1.147270432003666, 1.1572812686561387, 1.167666360134958, 1.1784043329250933, 1.1894714755594957, 1.2008411156935026, 1.2124831328120744, 1.2243637956383544, 1.2364460627921638, 1.2486903625907932, 1.2610557227924433, 1.2735010253312655, 1.2859861561770258, 1.2984728921654454, 1.310925466448397, 1.3233108372291258, 1.3355987303052042, 1.3477615369065712, 1.359774137306899, 1.3716137009300389, 1.38325949399425 ], [ 1.0654761839293116, 1.061978071335369, 1.0588368347374113, 1.0560692430603633, 1.0536917995801973, 1.0517206594027424, 1.0501715386873944, 1.049059614773455, 1.0483994164894002, 1.0482047041624125, 1.0484883392279944, 1.0492621438966625, 1.0505367520923854, 1.0523214538507486, 1.0546240365495552, 1.0574506277067042, 1.060805545542936, 1.064691164938136, 1.069107807612381, 1.0740536660725717, 1.0795247707630327, 1.0855150085967848, 1.092016198300677, 1.099018223549818, 1.1065092186298595, 1.1144757935124263, 1.1229032761807454, 1.1317759404760834, 1.141077178627035, 1.1507895705157258, 1.1608947994591343, 1.1713733720450508, 1.1822041253148077, 1.1933635562320484, 1.2048250853667999, 1.2165584480040077, 1.2285294455371798, 1.2407002379806338, 1.2530302069727868, 1.2654772324251302, 1.2779991051229782, 1.29055479796016, 1.3031054155654969, 1.315614767578808, 1.328049608029465, 1.3403796312460194, 1.3525773208891454, 1.3646177311643721, 1.3764782541917373, 1.3881384045434748 ], [ 1.06726837170035, 1.0638324334359333, 1.0607552845460597, 1.058053735493655, 1.055744327412238, 1.0538432485127025, 1.0523662421104567, 1.051328505419682, 1.050744578379526, 1.0506282220099203, 1.0509922861738255, 1.051848567179716, 1.053207656420923, 1.0550787822347716, 1.0574696483738668, 1.0603862738827219, 1.0638328406913942, 1.067811556741651, 1.0723225437519228, 1.0773637595342331, 1.0829309647693668, 1.0890177429630172, 1.09561557960277, 1.1027140020599981, 1.1103007754453496, 1.1183621415737903, 1.12688307881455, 1.1358475505036374, 1.1452386996162804, 1.1550389388480793, 1.16522988076953, 1.1757920577411471, 1.1867044051323852, 1.1979435349766068, 1.209482913576911, 1.2212921551482927, 1.2333367004696758, 1.2455780988376948, 1.257974935962354, 1.2704842275498738, 1.283062955728609, 1.2956694321137887, 1.3082642913450329, 1.3208110656516903, 1.333276398439023, 1.3456300031506931, 1.3578444751798278, 1.3698950417234292, 1.3817593054047859, 1.3934170122497653 ], [ 1.069665104011523, 1.0663038178439512, 1.0633030619273616, 1.06067964746817, 1.0584501095409569, 1.0566306224097668, 1.0552369064220484, 1.0542841256327382, 1.0537867754324362, 1.053758559683837, 1.054212257246901, 1.0551595783281251, 1.0566110118515288, 1.058575666038581, 1.0610611056015549, 1.064073190370827, 1.0676159217183092, 1.0716913046754413, 1.0762992349754334, 1.081437421103113, 1.0871013514762657, 1.093284315740467, 1.0999774864827958, 1.1071700631953392, 1.114849473950317, 1.1230016221175823, 1.1316111559358857, 1.1406617284176381, 1.150136204678257, 1.1600167645133233, 1.17028484238504, 1.1809208504161557, 1.1919036525023792, 1.2032098117680745, 1.2148127245971825, 1.2266818625760563, 1.2387824109995225, 1.2510755437838943, 1.2635193856461684, 1.2760704683206525, 1.2886853326901804, 1.3013219395376243, 1.313940684905246, 1.326504974209052, 1.338981421665539, 1.351339789528779, 1.3635527804952678, 1.3755957709725848, 1.387446541866729, 1.399085037231577 ], [ 1.0726640337645854, 1.0693898233783896, 1.0664777082431645, 1.0639444588266629, 1.0618065594713337, 1.0600801226173326, 1.0587807946283851, 1.0579236524113402, 1.0575230901377415, 1.0575926956057093, 1.0581451161547424, 1.059191914597179, 1.0607434163872622, 1.0628085502313003, 1.065394685551849, 1.0685074716255933, 1.072150684746314, 1.076326091290494, 1.081033335884669, 1.0862698647185622, 1.0920308940827246, 1.0983094330652743, 1.1050963666691498, 1.112380601147067, 1.1201492670000666, 1.1283879669783696, 1.1370810469318, 1.1462118570540991, 1.1557629607092281, 1.1657162388072546, 1.1760528321183465, 1.1867528674688252, 1.197794936363706, 1.2091553485693283, 1.2208072736357107, 1.2327199904185322, 1.2448585309854099, 1.2571839565139478, 1.2696543154524804, 1.2822260925248603, 1.294855803599158, 1.3075014016812332, 1.320123290856133, 1.3326849016033604, 1.3451528926214225, 1.3574970923410343, 1.3696902926740055, 1.3817079824225553, 1.3935280771088425, 1.4051306758544115 ], [ 1.0762601385175583, 1.0730852667483712, 1.0702738734926098, 1.0678426466647, 1.0658079748923066, 1.0641858606388042, 1.0629918250368742, 1.0622408036795403, 1.0619470327362173, 1.062123924993316, 1.062783935792009, 1.0639384193818129, 1.0655974769556744, 1.0677697985984478, 1.0704625025656183, 1.0736809766830007, 1.0774287281468697, 1.0817072494779933, 1.0865159096447785, 1.0918518801528865, 1.0977101058742054, 1.104083329198893, 1.1109621734020623, 1.118335286672027, 1.1261895419647228, 1.1345102798682107, 1.1432815723647862, 1.1524864753698925, 1.1621072280475975, 1.1721253484956649, 1.1825215711362365, 1.1932755764692027, 1.20436548786547, 1.2157671632129228, 1.2274533939876155, 1.2393932201421751, 1.251551623614741, 1.263889812895474, 1.2763661398976056, 1.288937473774337, 1.3015607172621322, 1.3141941563175614, 1.3267984493238543, 1.3393372046152483, 1.3517772004749868, 1.3640883501952097, 1.376243517646971, 1.388218267421802, 1.399990605610797, 1.4115407425879118 ], [ 1.0804457337385727, 1.0773821961130672, 1.0746833302297585, 1.0723656996644597, 1.0704455524912837, 1.0689387333224898, 1.0678605872449212, 1.067225854975323, 1.0670485586845917, 1.0673418781765238, 1.0681180174786848, 1.0693880624422984, 1.0711618306793091, 1.073447716104749, 1.0762525314971834, 1.0795813538073844, 1.0834373783599998, 1.087821789475113, 1.0927336561928829, 1.098169862454563, 1.104125080964011, 1.1105917986848826, 1.1175603992048324, 1.125019302793205, 1.1329551588297107, 1.1413530775484826, 1.1501968791351336, 1.1594693288028846, 1.1691523175388356, 1.1792269413282594, 1.1896734296972546, 1.2004708825018118, 1.2115967996624468, 1.2230264392669548, 1.2347321139979341, 1.2466826134500204, 1.2588429766778253, 1.271174788269422, 1.283637025894603, 1.2961873092214145, 1.3087832838848033, 1.3213838728719312, 1.3339502188627208, 1.3464462606825354, 1.3588389811218207, 1.3710984112976057, 1.3831974846318886, 1.3951118180937194, 1.4068194748860632, 1.4183007406637191 ], [ 1.085210512017912, 1.0822699326276353, 1.0796950176202738, 1.0775021648383405, 1.075707437554371, 1.074326475474515, 1.0733743978991062, 1.0728656984566647, 1.072814130964058, 1.0732325862051186, 1.07413295979095, 1.0755260117942234, 1.0774212195598367, 1.0798266259971652, 1.0827486867480554, 1.0861921208635428, 1.090159770934111, 1.0946524798744348, 1.099668992575348, 1.1052058911556792, 1.1112575722794202, 1.1178162736360309, 1.1248721539307662, 1.1324134264060932, 1.1404265399868094, 1.1488963948035817, 1.1578065705609861, 1.1671395377304001, 1.1768768140040178, 1.1869990236166528, 1.1974858179240238, 1.2083156265120285, 1.2194652347188617, 1.2309092295557686, 1.242619417278384, 1.2545643730114306, 1.2667093023616574, 1.279016346184617, 1.2914453435410131, 1.30395493094138, 1.316503764902929, 1.3290516484463102, 1.3415604079813253, 1.3539944605375749, 1.366321090610766, 1.3785105012730323, 1.390535716816954, 1.4023724054967555, 1.4139986730858456, 1.425394859421337 ], [ 1.090541607588998, 1.0877351392308037, 1.0852951147864944, 1.0832377257144876, 1.0815788072572725, 1.0803337484894289, 1.0795173948540646, 1.079143942713696, 1.0792268255866175, 1.0797785919837377, 1.08081077512859, 1.0823337553585815, 1.0843566166871963, 1.0868869998624369, 1.0899309552748706, 1.0934928002093933, 1.0975749861200548, 1.1021779827097622, 1.107300186436744, 1.1129378614141863, 1.1190851202491947, 1.1257339509019793, 1.1328742928943945, 1.1404941620127194, 1.14857981704954, 1.157115955354563, 1.1660859165281927, 1.1754718663322783, 1.185254927060268, 1.1954152180449826, 1.2059317733602093, 1.2167823166128766, 1.2279428984997118, 1.2393874423140578, 1.2510872897223964, 1.26301087763148, 1.2751236834002104, 1.2873885321590817, 1.2997662714159812, 1.3122167176048343, 1.3246997111069174, 1.3371761072734347, 1.3496085752566516, 1.3619621453484407, 1.3742045088442576, 1.3863061150739724, 1.3982401259100952, 1.409982285445965, 1.4215107504794724, 1.4328059129580217 ], [ 1.0964236849439069, 1.0937619152873304, 1.0914671418629118, 1.0895553101768445, 1.0880419856335284, 1.0869422627456904, 1.0862706672303153, 1.0860410506370972, 1.0862664773099424, 1.0869591037288941, 1.08813005064159, 1.0897892688901256, 1.0919454004852729, 1.0946056372779176, 1.0977755805116538, 1.1014591055672491, 1.1056582372501909, 1.110373041903966, 1.11560154328452, 1.121339669293082, 1.127581236094841, 1.134317974610782, 1.1415396016649686, 1.1492339341059692, 1.157387039067789, 1.1659834074826507, 1.1750061315688327, 1.1844370611780282, 1.1942569098707947, 1.2044452811315858, 1.2149805904545723, 1.2258398725415098, 1.2369984861628862, 1.2484297611627664, 1.2601046662312119, 1.2719915999023534, 1.2840564055548878, 1.2962626746971613, 1.308572337440251, 1.3209464674415703, 1.333346179185475, 1.3457334859409749, 1.35807201493922, 1.3703275247867701, 1.3824682183705514, 1.3944648789022702, 1.4062908733810546, 1.417922069708925, 1.4293367067822802, 1.4405152464806066 ], [ 1.1028390498290557, 1.1003319151352147, 1.0981920865521098, 1.0964352254666792, 1.0950765874224253, 1.0941309306462823, 1.0936124179174278, 1.093534511552595, 1.093909861443691, 1.0947501863309144, 1.0960661488465775, 1.0978672253377333, 1.1001615720786482, 1.102955890215691, 1.1062552926262874, 1.1100631767754836, 1.1143811085389088, 1.1192087227140173, 1.1245436464060712, 1.1303814514624593, 1.1367156414326676, 1.1435376769558745, 1.1508370408811286, 1.1586013407665243, 1.1668164418027107, 1.1754666179938673, 1.1845347041942336, 1.194002227219556, 1.2038494919217497, 1.2140555993156932, 1.2245983802243119, 1.2354542408529667, 1.2465979364886606, 1.2580023139986443, 1.269638087283022, 1.2814737233563311, 1.2934755110196463, 1.3056078548822545, 1.3178337902896244, 1.3301156645599406, 1.3424158947341764, 1.3546977032384466, 1.366925750055487, 1.3790666129710003, 1.3910891028678707, 1.4029644287794323, 1.4146662432651955, 1.4261706034486603, 1.4374558801671125, 1.448502640921298 ], [ 1.1097677804979569, 1.1074244881344157, 1.1054485534706562, 1.103855317301381, 1.1026596873948566, 1.1018760465249493, 1.1015181543515056, 1.1015990430540525, 1.1021309067905536, 1.1031249852975655, 1.1045914422864243, 1.1065392397331357, 1.108976009713522, 1.1119079260923879, 1.115339579113257, 1.1192738567057747, 1.1237118370563335, 1.1286526975649325, 1.1340936455995942, 1.1400298762949204, 1.146454561854254, 1.1533588752547712, 1.1607320488295036, 1.1685614649194302, 1.176832771812553, 1.1855300138689984, 1.194635760649551, 1.204131216833532, 1.2139962937579645, 1.2242096256898134, 1.2347485205376363, 1.2455888462193112, 1.2567048698142531, 1.2680690845855696, 1.2796520754073013, 1.2914224800183007, 1.3033470964731328, 1.3153911645909764, 1.3275188155836135, 1.339693649215814, 1.3518793730079806, 1.36404043044725, 1.3761425552696838, 1.3881532107661518, 1.4000418983368892, 1.4117803410389154, 1.4233425618679378, 1.4347048825896056, 1.4458458688241003, 1.4567462432576634 ], [ 1.117187876797307, 1.1150168374890133, 1.1132129332248308, 1.1117911496920234, 1.1107660113556956, 1.1101514892132405, 1.1099609029436774, 1.11020681748596, 1.1109009342495513, 1.112053977399113, 1.1136755759748163, 1.1157741430186343, 1.1183567533758345, 1.1214290224198866, 1.1249949885816306, 1.1290570032039462, 1.133615631819137, 1.1386695713616672, 1.1442155879619296, 1.1502484796829073, 1.1567610677261322, 1.1637442181397495, 1.1711868938618994, 1.1790762340776415, 1.1873976545429408, 1.1961349590874948, 1.2052704494828996, 1.2147850189583231, 1.2246582146840133, 1.234868257347869, 1.2453920121363846, 1.2562049150792531, 1.2672808709650851, 1.2785921517455086, 1.2901093341285388, 1.3018013179989583, 1.3136354604105833, 1.3255778428721907, 1.3375936658793035, 1.3496477405183127, 1.3617050294840074, 1.3737311836806847, 1.3856930262789138, 1.3975589503946246, 1.409299214240193, 1.4208861338070278, 1.4322941848366326, 1.443500032119319, 1.4544825057255781, 1.4652225420942753 ], [ 1.125075424475591, 1.1230841949233616, 1.1214595879626805, 1.120216201847196, 1.1193681448287376, 1.118928942873412, 1.1189114423486237, 1.1193277078390111, 1.1201889154178357, 1.121505241929012, 1.123285751132343, 1.1255382779347085, 1.1282693123708243, 1.1314838854958258, 1.135185459881094, 1.1393758279198511, 1.1440550215852718, 1.1492212375557933, 1.1548707816291608, 1.1609980359795944, 1.1675954519717644, 1.1746535698614684, 1.1821610647758949, 1.1901048159538399, 1.1984699935334584, 1.2072401545313598, 1.2163973375269905, 1.2259221445230128, 1.2357937991100145, 1.245990172958485, 1.2564877780727977, 1.2672617299615552, 1.2782856959833255, 1.289531851867229, 1.3009708753875722, 1.3125720069294315, 1.3243032006303823, 1.33613137715134, 1.348022772375639, 1.3599433595991373, 1.3718593104552448, 1.3837374549152006, 1.3955457037748777, 1.407253406269892, 1.4188316276690547, 1.4302533436483373, 1.4414935576433412, 1.4525293532177048, 1.463339895886763, 1.4739063985918208 ], [ 1.1334047720253713, 1.1316000082284994, 1.1301610501013089, 1.1291020785239205, 1.1284367554275199, 1.1281781317261135, 1.1283385508137884, 1.128929547900941, 1.1299617456277666, 1.1314447466087476, 1.1333870238334258, 1.1357958101778378, 1.138676988662515, 1.1420349855123257, 1.1458726685040954, 1.1501912534879544, 1.154990222280864, 1.1602672552832316, 1.1660181820802757, 1.1722369528752363, 1.1789156327919352, 1.1860444198414675, 1.1936116856882502, 1.2016040363677736, 1.2100063879905514, 1.2188020505050525, 1.2279728111706976, 1.2374990089512123, 1.2473595920092355, 1.2575321531817258, 1.267992942808033, 1.278716864238159, 1.289677463930852, 1.3008469339220752, 1.3121961479664197, 1.32369475231661, 1.335311327102359, 1.347013624993317, 1.3587688820216985, 1.3705441837871575, 1.3823068615588108, 1.3940248889666127, 1.405667251516437, 1.4172042670801575, 1.4286078438715268, 1.4398516711021634, 1.4509113448495765, 1.4617644367537157, 1.4723905158293162, 1.4827711343029204 ], [ 1.1421487173891356, 1.1405361387407806, 1.139288231006382, 1.1384187303011188, 1.1379408250710081, 1.1378670645020246, 1.1382092630969582, 1.1389784017983453, 1.1401845261939507, 1.1418366425405297, 1.143942612585244, 1.1465090484508171, 1.1495412091734147, 1.1530429008264815, 1.1570163825034352, 1.1614622807303043, 1.1663795150870873, 1.17176523787431, 1.1776147905051477, 1.1839216788724831, 1.1906775691891938, 1.1978723047142816, 1.2054939423911386, 1.213528806834172, 1.2219615574775229, 1.2307752632894082, 1.2399514785598929, 1.2494703132121945, 1.2593104921516767, 1.2694494005159263, 1.2798631152712632, 1.290526428063993, 1.3014128688878304, 1.3124947439930432, 1.323743203445328, 1.3351283529322489, 1.3466194204251, 1.3581849815328533, 1.3697932390443663, 1.3814123440007393, 1.3930107394580358, 1.4045575051590344, 1.4160226820153836, 1.4273775590779405, 1.4385949113736414, 1.4496491832371432, 1.4605166173846513, 1.471175334219635, 1.4816053684590789, 1.4917886712424735 ], [ 1.1512787019552162, 1.1498630659482596, 1.148810636576162, 1.148134680473472, 1.1478478884773402, 1.1479622847765185, 1.148489132828199, 1.1494388385135528, 1.1508208511518594, 1.1526435631742227, 1.154914209472289, 1.1576387676820548, 1.1608218609299799, 1.1644666648432667, 1.1685748208850275, 1.1731463582860355, 1.1781796269669265, 1.1836712438313681, 1.18961605461339, 1.1960071130385708, 1.202835678383304, 1.2100912315904266, 1.2177615089664358, 1.2258325512371615, 1.2342887645235694, 1.2431129888135333, 1.2522865689783698, 1.261789423540679, 1.2716001074191625, 1.2816958668216116, 1.2920526872235507, 1.3026453386365604, 1.3134474255984403, 1.3244314518122264, 1.3355689104052855, 1.3468304098306985, 1.3581858423233546, 1.3696045968941493, 1.381055812935889, 1.3925086647764415, 1.4039326631060571, 1.4152979569633601, 1.4265756201848572, 1.4377379086289674, 1.448758478370292, 1.459612559535922, 1.4702770847036524, 1.4807307742215654, 1.4909541831595905, 1.5009297158537573 ], [ 1.1607650094242512, 1.1595500966159387, 1.158696586924712, 1.1582172555577908, 1.158124274719389, 1.1584291237573625, 1.1591424966667596, 1.1602742075006416, 1.1618330943764466, 1.163826922927995, 1.1662622902382571, 1.1691445304923207, 1.1724776238053947, 1.1762641098930577, 1.1805050084399595, 1.1851997481616354, 1.190346106609545, 1.1959401627054533, 1.201976263773548, 1.2084470084393746, 1.2153432461720155, 1.2226540934721815, 1.2303669657989842, 1.2384676233651637, 1.246940228036328, 1.2557674078972076, 1.2649303257639495, 1.2744087481783892, 1.284181112319883, 1.2942245898206097, 1.304515148551773, 1.3150276157917755, 1.3257357483898653, 1.3366123171164186, 1.347629212878649, 1.3587575815582171, 1.369967991837112, 1.3812306367917386, 1.3925155658304675, 1.4037929394891755, 1.4150332964411954, 1.4262078203810575, 1.4372885944298088, 1.4482488322443046, 1.4590630776671742, 1.4697073679558241, 1.4801593588162127, 1.4903984122036837, 1.5004056498869671, 1.5101639770305615 ], [ 1.170576967316025, 1.1695655760531722, 1.1689134376386192, 1.1686328167351467, 1.1687353490129049, 1.1692319525420287, 1.1701327371126844, 1.1714469120993014, 1.173182693611196, 1.1753472118137944, 1.177946419461174, 1.1809850028473843, 1.1844662965526578, 1.1883922035187025, 1.1927631221174495, 1.1975778819578027, 1.2028336901798151, 1.2085260898884285, 1.214648932155988, 1.2211943626572743, 1.2281528234911505, 1.235513070106011, 1.243262202525672, 1.251385709338716, 1.2598675222646885, 1.2686900786600148, 1.2778343891928345, 1.2872801081978316, 1.2970056049722685, 1.3069880354721242, 1.3172034153990204, 1.327626697320408, 1.338231855943777, 1.348991986637937, 1.3598794224621888, 1.3708658741399389, 1.3819225955912806, 1.3930205750264348, 1.4041307485965082, 1.4152242307086507, 1.4262725528414484, 1.4372479014202173, 1.4481233451979538, 1.458873043571773, 1.4694724290883554, 1.4798983596874886, 1.4901292386164993, 1.5001451021003493, 1.5099276765619225, 1.5194604083634 ], [ 1.1806831490923657, 1.1798770993928036, 1.1794278003720038, 1.1793469898906128, 1.1796457522979253, 1.1803344313055129, 1.1814225413345478, 1.1829186780069114, 1.1848304285628486, 1.187164283110158, 1.1899255477397113, 1.1931182606744577, 1.1967451127467443, 1.2008073736105174, 1.2053048251769285, 1.21023570379638, 1.2155966526781163, 1.22138268592128, 1.227587165313362, 1.2342017907248342, 1.24121660449641, 1.2486200096969118, 1.256398801564157, 1.2645382108864451, 1.2730219576134, 1.2818323126860272, 1.2909501660277818, 1.3003550989025465, 1.3100254594440974, 1.3199384410625945, 1.330070164538245, 1.3403957657569912, 1.3508894920172596, 1.361524810415121, 1.3722745318065979, 1.3831109531417425, 1.394006019581997, 1.4049315059042022, 1.415859214536306, 1.4267611855032865, 1.4376099119232313, 1.448378553739445, 1.4590411422293246, 1.4695727684682023, 1.479949750191512, 1.4901497731533395, 1.5001520048636567, 1.5099371802681736, 1.5194876603467453, 1.5287874656575566 ], [ 1.191051575077231, 1.1904517209932464, 1.1902057608251349, 1.190324892234589, 1.1908196365403794, 1.1916997532924376, 1.192974153836804, 1.1946508145831265, 1.1967366907855954, 1.199237631751866, 1.2021582984995187, 1.2055020849815798, 1.2092710440948853, 1.213465819758293, 1.2180855863909423, 1.223127997120401, 1.2285891419930137, 1.2344635173312652, 1.2407440071761775, 1.2474218774641677, 1.254486783224076, 1.2619267886605288, 1.2697283995474689, 1.2778766069366976, 1.2863549408473292, 1.2951455324031482, 1.3042291828797152, 1.3135854383483465, 1.3231926690646072, 1.3330281534102852, 1.3430681669788491, 1.3532880781735508, 1.363662452315138, 1.3741651665813195, 1.3847695380005063, 1.395448466136671, 1.406174591053337, 1.4169204657466534, 1.4276587406800214, 1.4383623565679784, 1.4490047403722366, 1.4595599987642403, 1.4700031031681005, 1.4803100609189523, 1.490458067961005, 1.5004256397131894, 1.5101927180713357, 1.5197407538281276, 1.52905276494588, 1.5381133720316875 ], [ 1.2016499105484144, 1.201256160298023, 1.2012130924076247, 1.2015313537792052, 1.202220894006285, 1.2032908818502022, 1.204749621192368, 1.2066044672046243, 1.2088617435661488, 1.211526661641321, 1.2146032426160165, 1.2180942436649884, 1.2220010892855904, 1.2263238089747053, 1.2310609824385317, 1.2362096934985762, 1.2417654937825717, 1.2477223771579298, 1.2540727656728734, 1.2608075075177518, 1.2679158872140845, 1.2753856478995487, 1.2832030252303643, 1.291352792104514, 1.2998183131613206, 1.3085816078773544, 1.3176234210902447, 1.326923299960825, 1.3364596767265677, 1.346209957072696, 1.3561506144885622, 1.3662572914957642, 1.3765049090272647, 1.3868677854015312, 1.3973197661951875, 1.4078343658378654, 1.418384920957096, 1.428944754472846, 1.4394873483120973, 1.4499865215430672, 1.4604166098710167, 1.4707526419154235, 1.4809705075691793, 1.4910471140273531, 1.500960525709429, 1.5106900851853042, 1.5202165132310632, 1.5295219871670074, 1.538590197569079, 1.5474063842272467 ], [ 1.2124456595482627, 1.2122570026841555, 1.2124154641086393, 1.2129311321909075, 1.2138133790351813, 1.2150707790421944, 1.2167110273976356, 1.2187408592502724, 1.2211659704164208, 1.223990940517418, 1.2272191595201236, 1.230852758703183, 1.2348925471093832, 1.2393379545609589, 1.2441869823039111, 1.249436162302341, 1.2550805261183366, 1.2611135841825651, 1.2675273160835525, 1.274312172282755, 1.281457087406542, 1.2889495049901682, 1.296775413274895, 1.3049193914146944, 1.3133646652637367, 1.322093171818625, 1.331085631402515, 1.340321626811483, 1.3497796888891997, 1.3594373883261908, 1.369271433845583, 1.379257777273821, 1.3893717262294705, 1.3995880652286297, 1.4098811858522409, 1.4202252262310378, 1.43059421949898, 1.4409622501063184, 1.451303616061561, 1.4615929943970105, 1.4718056065317948, 1.4819173798255199, 1.4919051015237428, 1.5017465615005439, 1.511420680669711, 1.5209076225990588, 1.530188886640204, 1.5392473816939924, 1.5480674804951882, 1.556635054963725 ], [ 1.2234063531099475, 1.2234208939971027, 1.2237786412808926, 1.2244891197426875, 1.2255611210607191, 1.2270026246203265, 1.2288207186670792, 1.2310215225772871, 1.2336101110829722, 1.236590441343936, 1.239965283805967, 1.2437361578179065, 1.2479032729975685, 1.2524654773332746, 1.257420212979032, 1.2627634806431463, 1.2684898133783638, 1.2745922604543418, 1.281062381830983, 1.2878902535574948, 1.2950644842055825, 1.302572242218349, 1.3103992938369418, 1.318530051074731, 1.3269476290656328, 1.3356339120381462, 1.3445696271734322, 1.353734425698123, 1.3631069707316743, 1.3726650316308326, 1.382385584813262, 1.3922449212523629, 1.4022187609652155, 1.4122823748209687, 1.4224107138466537, 1.4325785458926594, 1.4427605990590224, 1.4529317107202313, 1.463066980385721, 1.4731419240719181, 1.4831326274136705, 1.493015894468619, 1.5027693891038763, 1.5123717660080613, 1.5218027887225805, 1.5310434325922377, 1.5400759711388057, 1.5488840450030215, 1.5574527132239897, 1.565768487185683 ], [ 1.2344997307209187, 1.2347147276066888, 1.2352686781933282, 1.2361705412490582, 1.2374285277970014, 1.2390500243181857, 1.2410415166779147, 1.2434085155543348, 1.2461554842000753, 1.2492857694106423, 1.2528015366052978, 1.2567037099438578, 1.2609919184040368, 1.2656644487251325, 1.2707182060820343, 1.2761486832861908, 1.2819499392153535, 1.288114587051138, 1.294633792754623, 1.3014972840393506, 1.3086933699158616, 1.3162089706927738, 1.3240296581397482, 1.332139705362658, 1.3405221458257268, 1.34915884089224, 1.358030555252607, 1.3671170396664105, 1.376397120555064, 1.385848796125486, 1.3954493388551428, 1.4051754042919267, 1.4150031461842218, 1.4249083379270948, 1.434866500171013, 1.44485303418595, 1.4548433602210313, 1.464813059680454, 1.4747380194965016, 1.4845945766734667, 1.4943596606547342, 1.5040109309713634, 1.5135269075917077, 1.52288709151469, 1.5320720734223423, 1.5410636286019446, 1.549844796824834, 1.5583999463848446, 1.5667148220119413, 1.5747765768514135 ], [ 1.2456939139492889, 1.2461058229292328, 1.2468521013244533, 1.2479411419895603, 1.249380577637374, 1.251177206559046, 1.2533369194130222, 1.2558646278595837, 1.2587641958600808, 1.2620383744919437, 1.2656887411502353, 1.2697156440113433, 1.2741181526227872, 1.2788940154524104, 1.2840396251789372, 1.2895499924325557, 1.2954187285983072, 1.3016380381774262, 1.3081987210646508, 1.315090184947335, 1.3223004678713774, 1.3298162708582688, 1.3376230003069718, 1.3457048197852195, 1.354044710717213, 1.3626245414173315, 1.3714251439061882, 1.3804263979756008, 1.389607322034283, 1.3989461703528039, 1.4084205364134665, 1.418007462135538, 1.4276835527644864, 1.4374250971662341, 1.4472081931419503, 1.4570088771749965, 1.4668032577510428, 1.4765676510791805, 1.4862787177190753, 1.495913598324764, 1.5054500464868594, 1.5148665565218757, 1.5241424840402156, 1.5332581572294695, 1.542194977009342, 1.550935504530211, 1.5594635348710817, 1.5677641562132303, 1.5758237941916873, 1.5836302415299983 ], [ 1.256957571247116, 1.257562094452144, 1.2584960824613955, 1.259767364721324, 1.2613830004078666, 1.2633492067686913, 1.2656712888456314, 1.2683535713463345, 1.2713993334681892, 1.2748107475000015, 1.278588822036335, 1.2827333506340628, 1.2872428667187397, 1.2921146055091461, 1.2973444736701458, 1.302927027327122, 1.3088554589797614, 1.3151215937402863, 1.321715895194345, 1.3286274810454894, 1.3358441485623005, 1.3433524097076794, 1.3511375357003639, 1.3591836106473982, 1.3674735938003504, 1.375989389932658, 1.3847119273130175, 1.3936212427579608, 1.4026965732793786, 1.4119164538884674, 1.4212588211617836, 1.430701122200896, 1.4402204286087275, 1.4497935550496641, 1.459397181850359, 1.4690079809340901, 1.4786027441735439, 1.4881585130125439, 1.497652707970371, 1.5070632564306146, 1.5163687169557734, 1.5255483982818687, 1.5345824711482374, 1.543452071211974, 1.5521393914798025, 1.5606277629491256, 1.5689017224653965, 1.5769470671513752, 1.5847508951215914, 1.5923016325404937 ], [ 1.2682600730229276, 1.2690522103759798, 1.270168600748118, 1.271616514958054, 1.273402445692087, 1.2755320385546254, 1.2780100247771433, 1.2808401563424388, 1.2840251443074475, 1.2875666011223568, 1.29146498774478, 1.2957195663340217, 1.3003283592809867, 1.3052881152834128, 1.3105942831135262, 1.3162409936461923, 1.3222210506215655, 1.3285259305082624, 1.3351457917148457, 1.3420694932720827, 1.3492846229811521, 1.3567775348991749, 1.3645333959192274, 1.3725362411029984, 1.3807690373456263, 1.3892137548973058, 1.3978514462356308, 1.4066623317745157, 1.4156258919043883, 1.4247209648754757, 1.4339258500511056, 1.4432184160587391, 1.4525762133423272, 1.4619765905616953, 1.4713968141892932, 1.4808141905228809, 1.4902061891725338, 1.4995505669049598, 1.5088254905548442, 1.518009657562018, 1.5270824125832974, 1.53602385857539, 1.5448149607609185, 1.5534376419777494, 1.5618748680696406, 1.5701107221944315, 1.5781304671907443, 1.5859205954377786, 1.593468865947302, 1.6007643287248574 ], [ 1.279571636151389, 1.2805457400631657, 1.2818385928981666, 1.283456913761807, 1.2854066380096083, 1.2876928510737546, 1.2903197241947222, 1.2932904527987237, 1.2966071982817335, 1.3002710339683738, 1.3042818960081777, 1.3086385399515987, 1.3133385037127951, 1.3183780775758038, 1.323752281835254, 1.3294548525830754, 1.33547823606022, 1.3418135918891458, 1.3484508053916673, 1.355378509081093, 1.3625841133014804, 1.3700538458748677, 1.3777728005140142, 1.3857249936679248, 1.393893429393404, 1.4022601717905172, 1.4108064245029386, 1.4195126167639058, 1.428358495460473, 1.4373232226865211, 1.4463854782506491, 1.4555235665905115, 1.464715527512523, 1.473939250119912, 1.4831725892103937, 1.4923934833192045, 1.5015800734597708, 1.5107108214832896, 1.5197646268527043, 1.5287209405205322, 1.5375598745279775, 1.5462623059163032, 1.5548099735687877, 1.563185566686217, 1.5713728037386319, 1.5793565009246386, 1.5871226293963954, 1.5946583607602576, 1.6019521006257331, 1.6089935102351165 ], [ 1.2908634571665474, 1.2920132895594139, 1.2934760908615257, 1.295258037364634, 1.297364518196185, 1.299800071971996, 1.302568325570512, 1.3056719357501785, 1.3091125343458219, 1.3128906777817793, 1.3170058016282862, 1.3214561809023813, 1.3262388967750642, 1.3313498102930474, 1.3367835436561786, 1.3425334695122495, 1.3485917086404915, 1.3549491362960284, 1.3615953973825357, 1.3685189305123888, 1.3757070009061734, 1.3831457419804563, 1.390820205377284, 1.3987144191048395, 1.406811453387699, 1.4150934937691844, 1.4235419209666487, 1.432137396951682, 1.4408599567076061, 1.449689105101345, 1.4586039182903041, 1.4675831490610518, 1.476605335460422, 1.4856489120276954, 1.494692322867144, 1.503714135715938, 1.5126931560675219, 1.5216085403132025, 1.5304399067744427, 1.5391674434260052, 1.5477720110662734, 1.556235240684198, 1.56453962380902, 1.57266859471119, 1.580606603449916, 1.5883391789292818, 1.5958529813231905, 1.6031358434489287, 1.6101768008990198, 1.6169661109695803 ], [ 1.3021078334718363, 1.3034266245389656, 1.3050523463180015, 1.3069906430169522, 1.3092463704101645, 1.311823535350406, 1.3147252375904013, 1.317953614613759, 1.3215097901845507, 1.325393827321987, 1.329604686390962, 1.334140188970251, 1.338996988117678, 1.3441705455961501, 1.3496551165566673, 1.3554437420958212, 1.3615282500172008, 1.3678992640310486, 1.3745462215267117, 1.381457399950788, 1.3886199517233766, 1.3960199475286357, 1.403642427726588, 1.411471461553279, 1.4194902137079497, 1.42768101786919, 1.4360254566372233, 1.4445044473646582, 1.453098333310759, 1.4617869795306742, 1.4705498728871265, 1.4793662255435531, 1.4882150812608097, 1.497075423772573, 1.5059262864563059, 1.5147468624495486, 1.523516614288815, 1.5322153820766353, 1.540823489119042, 1.5493218439286114, 1.5576920374655634, 1.5659164344974252, 1.5739782580014097, 1.5818616656146298, 1.5895518172547467, 1.5970349331835347, 1.6042983419623664, 1.6113305179430006, 1.6181211081408158, 1.6246609485408678 ], [ 1.3132782719985632, 1.3147587801225509, 1.3165399414658099, 1.3186268805535357, 1.3210239342806744, 1.323734594300574, 1.3267614518841218, 1.3301061459256764, 1.333769314777148, 1.337750552584853, 1.3420483707847455, 1.346660165379777, 1.351582190578683, 1.3568095393191897, 1.3623361311307705, 1.368154707714942, 1.3742568365354149, 1.3806329226189764, 1.3872722286728356, 1.3941629035277827, 1.4012920188216282, 1.4086456137465846, 1.4162087475995986, 1.423965559798394, 1.4318993369591169, 1.4399925865747545, 1.4482271167864789, 1.4565841217014615, 1.4650442716785792, 1.4735878079747573, 1.482194641116699, 1.490844452332177, 1.4995167973396077, 1.5081912117527676, 1.5168473173091632, 1.5254649280774473, 1.534024155744315, 1.542505513029662, 1.5508900142357216, 1.55915927190804, 1.5672955885793765, 1.5752820425868013, 1.583102567001308, 1.5907420207890666, 1.598186251433722, 1.6054221483863402, 1.6124376868688999, 1.6192219617320298, 1.6257652112502023, 1.6320588309202673 ], [ 1.3243495848563775, 1.3259841571291489, 1.3279128856859905, 1.3301403892794268, 1.3326705018232854, 1.335506217659991, 1.3386496394342255, 1.3421019292240388, 1.3458632635819332, 1.3499327931286063, 1.3543086073202693, 1.3589877049766719, 1.363965971111436, 1.369238160549416, 1.3747978887490313, 1.3806376301715955, 1.3867487244569356, 1.3931213905764201, 1.3997447490435826, 1.406606852170657, 1.4136947222692267, 1.4209943976067136, 1.4284909858496468, 1.4361687246511827, 1.4440110489751217, 1.4520006646919945, 1.4601196279347846, 1.4683494296608837, 1.4766710848319877, 1.4850652255922063, 1.493512197794834, 1.501992160197451, 1.5104851856119308, 1.5189713632593256, 1.527430901539772, 1.535844230385964, 1.5441921023277803, 1.5524556913594285, 1.5606166886730743, 1.5686573943096924, 1.5765608037830512, 1.5843106887604417, 1.591891670936606, 1.5992892883162992, 1.6064900532253648, 1.6134815014973303, 1.6202522324283515, 1.62679193925209, 1.633091430051625, 1.6391426391908581 ], [ 1.3352979716445696, 1.3370786044493352, 1.339146697791164, 1.3415063799064197, 1.3441609988775194, 1.3471130707668808, 1.3503642304696226, 1.3539151859096656, 1.3577656762024166, 1.3619144343947376, 1.3663591553691359, 1.3710964694640493, 1.3761219223159387, 1.3814299613723806, 1.3870139294596133, 1.3928660657140137, 1.3989775141069634, 1.4053383397076353, 1.4119375527411862, 1.4187631404119978, 1.4258021063755093, 1.4330405176595542, 1.440463558758624, 1.4480555925533911, 1.4558002276441835, 1.4636803916310266, 1.4716784098243714, 1.479776088828669, 1.4879548044046689, 1.496195592983736, 1.5044792461771792, 1.5127864075939215, 1.5210976712494428, 1.5293936808174502, 1.537655228943279, 1.545863355805855, 1.5539994460853588, 1.5620453234695288, 1.5699833418163962, 1.577796472089049, 1.5854683841923713, 1.592983522875683, 1.6003271769208711, 1.607485540913545, 1.6144457689944585, 1.6211960201073579, 1.6277254943942294, 1.6340244605345893, 1.6400842739768062, 1.6458973861604245 ], [ 1.346101088229711, 1.348019487367491, 1.3502184737090106, 1.3527017014148974, 1.355472050966408, 1.3585315801410889, 1.3618814777975656, 1.3655220210670995, 1.3694525365453465, 1.3736713660632662, 1.378175837590884, 1.3829622417917833, 1.3880258146999565, 1.3933607269348771, 1.398960079806244, 1.4048159085881633, 1.4109191931650413, 1.4172598761700517, 1.4238268886532548, 1.4306081832325468, 1.4375907745980923, 1.444760787161669, 1.4521035095677854, 1.4596034557146635, 1.4672444318711562, 1.475009609420427, 1.4828816027129161, 1.4908425514690586, 1.4988742071354189, 1.5069580225653647, 1.5150752443655096, 1.5232070072212198, 1.5313344294870623, 1.539438709301282, 1.5475012204572918, 1.5555036072408637, 1.5634278774209958, 1.5712564925678048, 1.578972454865157, 1.586559389592006, 1.594001622467832, 1.6012842510961063, 1.6083932097972655, 1.6153153271996064, 1.6220383760519541, 1.6285511148341352, 1.6348433208667497, 1.6409058147565843, 1.6467304761532928, 1.6523102509317942 ], [ 1.3567381019405298, 1.358785741809122, 1.3611069396031474, 1.363704892871151, 1.3665820336367338, 1.3697399821789296, 1.3731795036918941, 1.3769004683939514, 1.3809018156496238, 1.3851815226522717, 1.3897365781886148, 1.3945629619701918, 1.3996556299710465, 1.405008506156001, 1.4106144809213301, 1.4164654165001191, 1.4225521595099726, 1.4288645607424075, 1.4353915022130568, 1.4421209314112058, 1.4490399026082401, 1.4561346250084142, 1.463390517453549, 1.4707922693268296, 1.478323907240423, 1.485968867037671, 1.4937100705928548, 1.5015300068500286, 1.5094108165058457, 1.5173343797092835, 1.5252824061226324, 1.533236526661844, 1.541178386210114, 1.5490897365760716, 1.5569525289471213, 1.564749005070868, 1.572461786384112, 1.580073960301814, 1.5875691628802944, 1.5949316570817664, 1.6021464058939825, 1.6091991396007075, 1.6160764165574242, 1.6227656769023624, 1.6292552887246685, 1.6355345863177209, 1.6415939002631184, 1.6474245792164401, 1.6530190033947811, 1.6583705898942571 ], [ 1.3671897332807847, 1.3693579146435546, 1.3717924905922756, 1.3744962203926587, 1.3774711075046164, 1.3807183561195828, 1.3842383306286354, 1.3880305185635808, 1.3920934975451371, 1.3964249067548664, 1.401021423420651, 1.4058787447692132, 1.4109915758540432, 1.4163536236135035, 1.421957597453148, 1.4277952165791992, 1.4338572242383125, 1.440133408943633, 1.4466126326901125, 1.4532828660850017, 1.4601312302435618, 1.4671440452270108, 1.4743068847305634, 1.481604636665192, 1.4890215692181998, 1.4965414019249963, 1.5041473812379045, 1.511822360036949, 1.5195488804919846, 1.5273092596545002, 1.5350856771301902, 1.542860264159391, 1.5506151934110668, 1.5583327687772572, 1.5659955144389306, 1.5735862624618338, 1.5810882381734885, 1.5884851425715345, 1.59576123102126, 1.6029013875181664, 1.6098911938219915, 1.616716992813002, 1.623365945480675, 1.629826081028934, 1.6360863396706142, 1.642136607784479, 1.6479677452187893, 1.6535716046426931, 1.6589410429666476, 1.6640699249719142 ] ], "zauto": true, "zmax": 1.6640699249719142, "zmin": -1.6640699249719142 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.11713519733654129, 0.11532246004749906, 0.11354431557563788, 0.11179960791148566, 0.11008679029255167, 0.10840399061099541, 0.10674908982464783, 0.10511981168701513, 0.103513821719213, 0.10192883305221571, 0.10036271657889471, 0.09881361276914546, 0.09728004250515168, 0.09576101436745277, 0.09425612592097919, 0.09276565668739022, 0.09129065062143002, 0.08983298601486941, 0.08839543081927338, 0.08698168140487257, 0.08559638276442948, 0.08424512814787379, 0.08293443610900551, 0.08167170300803113, 0.08046512920570202, 0.07932361758069027, 0.07825664367955062, 0.07727409783642154, 0.07638610101563524, 0.07560279791765448, 0.07493413295101144, 0.07438961681902759, 0.07397809341773756, 0.07370751814753153, 0.07358475926235993, 0.07361543325435965, 0.07380378339861313, 0.07415260758216777, 0.0746632377568281, 0.07533556929804185, 0.0761681347950166, 0.0771582138479203, 0.07830196864481002, 0.07959459454708538, 0.08103047552308226, 0.0826033357683838, 0.08430638089092035, 0.08613242426917951, 0.08807399631921319, 0.09012343622405292 ], [ 0.11518859171992023, 0.11330259284694155, 0.11144932865881733, 0.10962762657905022, 0.10783592450071884, 0.10607233735536518, 0.10433473703636836, 0.10262084401586338, 0.1009283285973173, 0.09925491944841154, 0.09759851686846183, 0.0959573081575731, 0.09432988245713983, 0.09271534250104504, 0.0911134108267894, 0.08952452811677511, 0.08794994144468742, 0.08639178026769238, 0.08485311801650693, 0.0833380170864028, 0.08185155492876357, 0.08039982880485678, 0.07898993662851835, 0.07762993125028521, 0.0763287456029321, 0.07509608644045154, 0.07394229507656705, 0.07287817468044834, 0.07191478539937965, 0.0710632108632209, 0.0703343023804892, 0.0697384101111885, 0.06928511329406492, 0.06898296370162908, 0.06883925736103484, 0.06885984879427814, 0.0690490194342012, 0.0694094076536102, 0.06994200255337268, 0.07064619809723242, 0.07151989922901325, 0.0725596679874611, 0.07376089576248582, 0.07511798776108983, 0.07662454719544809, 0.07827354919069084, 0.0800574973958327, 0.08196855928416455, 0.08399867879076743, 0.08613966704298333 ], [ 0.11337885410027267, 0.11142053870206166, 0.10949278653580181, 0.10759440196088549, 0.10572380371158238, 0.1038790924734394, 0.10205813206986743, 0.10025864263474943, 0.09847830375227618, 0.09671486525108831, 0.09496626315341941, 0.09323073819688672, 0.09150695435147548, 0.08979411482311811, 0.08809207313828508, 0.0864014370090983, 0.08472366275499839, 0.0830611380782627, 0.08141725093720976, 0.07979644212247652, 0.07820423891988007, 0.07664726695543929, 0.07513323700192988, 0.07367090324765464, 0.07226998938749424, 0.0709410790333143, 0.06969546753028784, 0.06854497349723628, 0.06750171044715464, 0.06657782176476776, 0.06578518603367543, 0.06513510389704245, 0.06463798172484808, 0.06430303055856681, 0.06413800025588327, 0.06414896777034154, 0.0643401947937261, 0.06471406387310955, 0.06527109450215021, 0.06601003289322341, 0.06692800253300438, 0.06802069825823293, 0.06928260493637918, 0.07070722275477022, 0.07228728399551018, 0.07401495016180969, 0.07588198260363983, 0.07787988372740837, 0.08000000907234635, 0.08223365283142722 ], [ 0.11171304084472583, 0.10968393294989963, 0.10768292951147829, 0.10570880358347762, 0.1037599488262212, 0.10183444792697521, 0.09993015478716032, 0.09804478890012841, 0.09617603995820966, 0.09432168044377286, 0.0924796837832471, 0.09064834557015188, 0.0888264053763664, 0.08701316674410482, 0.08520861305190977, 0.08341351704119082, 0.08162954184064637, 0.07985933130311439, 0.07810658734759361, 0.07637613176101585, 0.0746739495531569, 0.07300721048226932, 0.0713842648102926, 0.06981460877180039, 0.06830881476784494, 0.06687842110782254, 0.06553577647256292, 0.06429383546584684, 0.06316590396498376, 0.06216533668282982, 0.06130519439527741, 0.06059787428800907, 0.06005473300657305, 0.05968572702255056, 0.05949909744130894, 0.059501125173584295, 0.05969597695727765, 0.060085653559942796, 0.06067004018317433, 0.061447047861424145, 0.06241282572523735, 0.06356201891456711, 0.06488804612768007, 0.06638337367018517, 0.06803976815129129, 0.06984851621681343, 0.0718006057015215, 0.0738868675515941, 0.07609808147341686, 0.07842505050079598 ], [ 0.11019660907826037, 0.10809883039085816, 0.10602644841790962, 0.10397819558373404, 0.1019524329884052, 0.09994721948483513, 0.09796039457761736, 0.09598967362462597, 0.09403275345320572, 0.0920874262360804, 0.09015169931408178, 0.08822391859740022, 0.08630289320616229, 0.08438801909670242, 0.08247939952703817, 0.08057796030518573, 0.07868555779803016, 0.0768050776199027, 0.07494052173577447, 0.07309708137632578, 0.07128119265018121, 0.06950057104279328, 0.06776422012440371, 0.06608240880467561, 0.06446661049188344, 0.06292939676501377, 0.061484278001228104, 0.06014548429657042, 0.058927682518233514, 0.05784562990250465, 0.05691377143973069, 0.05614579698386104, 0.05555418343372438, 0.05514975551137218, 0.054941303196723294, 0.05493529258967586, 0.05513569882662565, 0.055543975511921716, 0.05615915771555753, 0.05697807888784738, 0.05799566980861502, 0.05920530218178459, 0.06059914085775463, 0.06216847526218239, 0.06390400989418252, 0.06579610330012069, 0.06783495304489259, 0.07001073010516294, 0.07231366973374186, 0.07473412754056115 ], [ 0.10883328708538222, 0.10666955952376193, 0.10452832237794922, 0.10240825796923701, 0.10030768662851883, 0.09822463620254972, 0.09615692533550987, 0.09410225906929913, 0.09205833495918457, 0.09002295765853095, 0.08799415979334703, 0.08597032691747879, 0.08395032439324743, 0.08193362415082987, 0.07992042940534462, 0.0779117955122834, 0.07590974517649664, 0.07391737615519493, 0.07193895936986863, 0.06998002492414857, 0.06804743287252858, 0.06614942465815159, 0.06429564990974426, 0.06249716177034427, 0.0607663722208055, 0.05911695720429701, 0.05756370021403205, 0.05612226308771066, 0.05480887498223015, 0.0536399358389493, 0.05263153973347125, 0.05179893615897658, 0.05115596201937731, 0.05071449085411718, 0.0504839543661754, 0.050470990539334036, 0.050679260278051703, 0.051109451863635684, 0.05175946467599609, 0.05262473787237443, 0.05369867266930658, 0.05497309188962382, 0.05643868666898398, 0.05808541370869085, 0.05990282229312879, 0.061880304493614854, 0.06400727243206031, 0.066273272770642, 0.06866805138311555, 0.07118158148725014 ], [ 0.10762499882394985, 0.10539862938974266, 0.10319170685061559, 0.10100285494932738, 0.09883034543873798, 0.09667216774006747, 0.09452611222891881, 0.09238986575638565, 0.09026111769282626, 0.08813767456833528, 0.08601758128228164, 0.08389924685740811, 0.08178157280236122, 0.07966408228969987, 0.07754704851620928, 0.07543162074542735, 0.07331994659341985, 0.07121528906127725, 0.06912213659240012, 0.06704630398313079, 0.06499502123239215, 0.06297700629452385, 0.06100251610476232, 0.05908336810473199, 0.05723292181616819, 0.05546600699502143, 0.05379878207222018, 0.052248504933353354, 0.050833199082985586, 0.04957120368357937, 0.0484806074888043, 0.047578584890460324, 0.04688067557964825, 0.04640007306004719, 0.046147004005847606, 0.04612828205360317, 0.0463471009275635, 0.046803094505672174, 0.04749264507407627, 0.04840937964582212, 0.04954477006599167, 0.0508887506177086, 0.052430283365403736, 0.05415782757175825, 0.056059695851175914, 0.05812430009986206, 0.06034030258721135, 0.06269669282405134, 0.06518281115479281, 0.0677883376601943 ], [ 0.10657184950133479, 0.10428669708328721, 0.1020178811308379, 0.09976396058952211, 0.0975231525279339, 0.095293401619117, 0.09307246300329762, 0.09085799720004298, 0.08864767544813398, 0.0864392936706412, 0.08423089319660378, 0.08202088641276198, 0.0798081856493956, 0.07759233379368756, 0.07537363533372114, 0.07315328672384885, 0.07093350508226003, 0.06871765423731034, 0.06651036697778459, 0.06431766196588877, 0.06214705304376393, 0.060007647462972845, 0.05791022769959434, 0.055867308764353654, 0.05389315910174035, 0.052003768315655154, 0.050216739515761104, 0.04855107922586654, 0.047026855678437555, 0.04566470005314196, 0.0444851383547444, 0.04350776677966114, 0.042750319981896594, 0.04222772328475896, 0.041951253620899694, 0.041927943262519585, 0.04216033291600816, 0.04264661766836954, 0.04338114885647032, 0.0443551854955558, 0.04555775414263232, 0.04697648297739064, 0.04859831361228904, 0.05041004299487845, 0.05239869037521567, 0.05455171189733178, 0.05685709754853346, 0.05930338625134839, 0.06187962998687177, 0.06457533093629361 ], [ 0.1056721754017288, 0.10333260034021875, 0.10100626103449571, 0.09869164891207145, 0.09638692330027422, 0.09408998035988304, 0.09179853505988872, 0.0895102149147116, 0.08722266394579457, 0.08493365518188328, 0.08264120998315043, 0.08034372255739675, 0.07804008821397715, 0.07572983414395379, 0.07341325178757023, 0.07109153011271585, 0.06876688934019079, 0.06644271477245237, 0.06412369036481409, 0.06181593145388786, 0.059527115513076226, 0.0572666087440054, 0.05504558442757263, 0.05287712582064041, 0.050776301505292734, 0.04876019410163881, 0.04684785422053357, 0.045060141510267306, 0.04341940629921644, 0.04194896343501723, 0.04067232124841842, 0.03961216026589335, 0.03878911180538623, 0.03822045944945585, 0.03791895514227078, 0.037891972574103455, 0.03814118330046753, 0.03866283207545311, 0.039448542599786626, 0.04048646288898808, 0.04176250895668125, 0.0432614953050788, 0.044968021555270306, 0.046867073758138894, 0.04894436539423948, 0.05118647667984569, 0.053580857296671, 0.05611574866026595, 0.058780067477420914, 0.06156327862445179 ], [ 0.10492265687643247, 0.10253345530018483, 0.10015447823907186, 0.0977841514614127, 0.09542057777733175, 0.09306160503262738, 0.09070490671976159, 0.0883480739696836, 0.0859887174567838, 0.08362457763238333, 0.08125364170698199, 0.07887426592333387, 0.07648530188500642, 0.07408622600222925, 0.07167727145666841, 0.06925956243565225, 0.06683525071393563, 0.06440765494087679, 0.06198140319524518, 0.05956257945045014, 0.057158874444350666, 0.05477974084818795, 0.052436551169289185, 0.05014275384166535, 0.0479140175448141, 0.045768344911407396, 0.04372612366166228, 0.04181006604183484, 0.04004496860379767, 0.03845720989384271, 0.037073904613104815, 0.03592166487125074, 0.03502499688271858, 0.034404485309091244, 0.034075056621692204, 0.03404470027322913, 0.03431398709182243, 0.03487653399043095, 0.035720291291794014, 0.03682930457344231, 0.03818552990475713, 0.039770366557433136, 0.04156573884096645, 0.043554717499126185, 0.045721768859941815, 0.048052752151108775, 0.05053477425994167, 0.05315598233259296, 0.05590534512889385, 0.058772451377303414 ], [ 0.10431848910451957, 0.10188481505360118, 0.09945852314233891, 0.09703798071014297, 0.09462124051517709, 0.0922061074041133, 0.08979021710802669, 0.08737112595809961, 0.08494641010695557, 0.08251377274942497, 0.08007115786871394, 0.07761686918685241, 0.07514969325773911, 0.07266902598404758, 0.07017500223869726, 0.06766862870215992, 0.06515192047252312, 0.06262804246241126, 0.06010145707290142, 0.057578080126997735, 0.05506544749817549, 0.05257289509184153, 0.050111754386010614, 0.047695563776024415, 0.04534029115294022, 0.04306455361310024, 0.04088980380311756, 0.03884042742653943, 0.03694366311408533, 0.035229219270750116, 0.03372843701606693, 0.032472861752228695, 0.03149217678708797, 0.030811648519457592, 0.030449505578500322, 0.03041490025525965, 0.030707096948981664, 0.03131620207341631, 0.03222522007210518, 0.03341278911098115, 0.03485584817871816, 0.03653170284500415, 0.038419296366020456, 0.04049976565584504, 0.04275649101035703, 0.04517485785931032, 0.047741897675153466, 0.050445912144783084, 0.053276134153438875, 0.05622244671779227 ], [ 0.10385360140675619, 0.10138088045636687, 0.09891294370035725, 0.09644811305400168, 0.09398440348967407, 0.09151958803652982, 0.08905127437252745, 0.08657699182147571, 0.08409428737723, 0.08160082930235872, 0.07909451689828682, 0.07657359521596342, 0.07403677375795976, 0.07148334859437236, 0.06891332775346172, 0.06632756023710033, 0.06372786955015823, 0.06111719324711444, 0.05849973074167297, 0.055881102564183334, 0.05326852542528998, 0.05067100876767636, 0.0480995796000745, 0.045567542456545866, 0.04309077871229288, 0.040688081633391826, 0.03838150674790826, 0.036196686794339655, 0.03416301222011315, 0.03231351119440819, 0.03068418851525293, 0.029312538277246877, 0.02823500783543033, 0.027483458517757242, 0.027081168055201832, 0.027039460297416173, 0.027356207969049338, 0.028016903972772636, 0.02899794355809388, 0.030270899864046668, 0.0318064472162019, 0.033577100877213724, 0.03555861245749788, 0.03773030373970849, 0.040074758485678236, 0.0425772308016792, 0.045225001766246165, 0.04800680218719117, 0.05091234419805338, 0.053931964630145844 ], [ 0.10352091298235681, 0.10101475141340412, 0.0985110890432054, 0.09600822110433133, 0.09350414293099166, 0.09099661300642309, 0.08848322705659717, 0.08596150201519803, 0.08342896850518002, 0.08088327041605045, 0.07832227021231591, 0.07574415878577204, 0.07314756895089455, 0.0705316920598161, 0.06789639766200127, 0.06524235664353796, 0.0625711688653821, 0.05988549703095262, 0.05718920945383293, 0.054487535715954556, 0.05178724106803926, 0.04909682791387399, 0.046426775684333156, 0.04378983319595078, 0.04120137870516693, 0.03867985951228655, 0.03624731044026222, 0.033929921439812334, 0.03175856826393268, 0.029769123944096906, 0.02800222711499279, 0.02650202497543722, 0.025313347101245408, 0.02447702892062465, 0.024023908941927734, 0.023969199658165682, 0.024309608831037152, 0.025024770382049973, 0.026082445387961183, 0.027445195085934068, 0.02907610445354242, 0.03094230694121365, 0.03301633699552691, 0.035275996739630056, 0.037703487166623244, 0.040284337631088, 0.04300641902392874, 0.045859148681137746, 0.048832898419880616, 0.051918577042650266 ], [ 0.10331261121424702, 0.1007787047337521, 0.09824538414817659, 0.09571094200762006, 0.09317337762103299, 0.09063045794661483, 0.08807978900398038, 0.08551889664535334, 0.08294531534862334, 0.08035668363006486, 0.0777508447274154, 0.07512595137355395, 0.07248057375529866, 0.06981381011261364, 0.06712539986200827, 0.064415839617136, 0.061686503051629815, 0.05893976627626408, 0.05617914142825674, 0.053409422720076406, 0.050636851556074426, 0.047869310778049304, 0.045116562769805316, 0.04239055176061773, 0.039705796184479406, 0.037079900060425115, 0.03453420857616264, 0.0320946139981956, 0.029792468164099292, 0.02766545029630401, 0.0257580372032125, 0.024120910524563496, 0.022808312217258615, 0.021872398841704888, 0.02135468093922651, 0.02127686074003328, 0.02163535078084185, 0.02240286862465102, 0.023536470619183774, 0.02498779047320337, 0.026711206610936667, 0.028668172333436347, 0.030828235433369437, 0.0331681286423065, 0.035670134546098416, 0.038320438338985026, 0.041107771138295335, 0.044022406644455794, 0.0470554682487346, 0.05019847449475486 ], [ 0.10322043823867101, 0.10066448388647736, 0.09810762068435752, 0.09554816689121676, 0.09298415399985506, 0.09041338534157821, 0.08783350474179205, 0.08524207408387392, 0.08263665846556224, 0.08001491756265858, 0.07737470185724446, 0.07471415253991055, 0.07203180414532058, 0.06932668930829339, 0.06659844541366013, 0.0638474233500323, 0.06107479909003751, 0.05828268949033249, 0.055474274703306785, 0.05265393119682316, 0.04982738197313424, 0.04700187460590665, 0.04418640355921029, 0.04139200104231051, 0.0386321299809149, 0.03592322219665935, 0.03328541148580198, 0.030743508077029878, 0.028328232028916815, 0.026077632987815923, 0.024038403818930635, 0.02226635328615981, 0.02082463216433343, 0.019777813947223583, 0.019180796050810335, 0.01906493492531074, 0.019428263390528805, 0.02023655209523615, 0.021434980695700236, 0.022963168006759696, 0.024766377112216992, 0.02680056480673095, 0.029032741729464937, 0.0314390261502516, 0.03400211953582502, 0.03670905821441685, 0.03954950937677003, 0.04251459527624686, 0.045596132679303666, 0.0487861668937005 ], [ 0.10323597219610575, 0.10066358647383167, 0.09808924931860982, 0.09551133631099719, 0.09292794270495264, 0.09033693967682256, 0.0877360402339784, 0.08512287367534994, 0.08249506732232609, 0.07985033416177266, 0.07718656507107524, 0.07450192442541995, 0.07179494810705378, 0.06906464322407553, 0.06631058918062714, 0.063533040111563, 0.060733029125936804, 0.05791247538022768, 0.05507429590367556, 0.05222252562940894, 0.049362451684235344, 0.04650077219831099, 0.04364579626746112, 0.04080771065453034, 0.037998950456367794, 0.03523472487079935, 0.032533763974868624, 0.029919364013592287, 0.027420804849392043, 0.025075159181397227, 0.022929324445194098, 0.0210416260677391, 0.019481401717700395, 0.018323819085306763, 0.01763730700363049, 0.01746507391175595, 0.017809754634087575, 0.018632560190302058, 0.019868319391885166, 0.02144573437985574, 0.02330188800440867, 0.025387978027320762, 0.02766893502276676, 0.030120438354898877, 0.032725566563402544, 0.03547202881645046, 0.03835018210531989, 0.041351730898640214, 0.044468928383108106, 0.047694115033304334 ], [ 0.10335089122576452, 0.10076753675503591, 0.0981816600897342, 0.09559172760554588, 0.09299593180234013, 0.0903922451577189, 0.08777848334351744, 0.08515237675204056, 0.08251164910394404, 0.07985410182486652, 0.07717770289080941, 0.07448067894989478, 0.071761609717146, 0.06901952388790726, 0.06625399610113916, 0.06346524479447911, 0.06065423114937103, 0.057822759809297374, 0.05497358284733067, 0.05211050986982012, 0.04923852962457857, 0.046363952606889455, 0.04349459054248959, 0.04063999781440933, 0.03781181224175239, 0.03502424821424517, 0.032294813735725056, 0.029645342601445634, 0.027103445523651102, 0.024704460476618728, 0.022493840696715, 0.020529477478092157, 0.018882450918142304, 0.017633150236194932, 0.016858997139941455, 0.01661368435398354, 0.016907276848080948, 0.017702079709093387, 0.01892858012887938, 0.020509212035425325, 0.022375691643192093, 0.0244757246132613, 0.026772398283724304, 0.029240619412072108, 0.03186325700539843, 0.034628041056597225, 0.037525397603254726, 0.040547065870961047, 0.04368527378480832, 0.04693227906291914 ], [ 0.10355721051239952, 0.10096813277182451, 0.0983764395894941, 0.09578072203395506, 0.09317930368723858, 0.09057029205862241, 0.08795163916153587, 0.08532121027617001, 0.08267685974447338, 0.08001651255163288, 0.07733825044603426, 0.07464040143574827, 0.0719216316607912, 0.06918103885580029, 0.0664182468643621, 0.06363350093185284, 0.06082776380739, 0.05800281310663027, 0.05516134109947077, 0.052307059389630026, 0.04944481328486804, 0.04658071456919305, 0.04372230747277805, 0.04087879140635263, 0.03806133582280289, 0.035283537528465754, 0.0325620887743884, 0.02991774427635072, 0.02737669044005881, 0.024972405941364403, 0.022747987657596766, 0.020758536763091254, 0.019072303167470352, 0.017767809682712275, 0.016923205051590565, 0.01659683588935367, 0.016806657197472374, 0.017523053216979237, 0.018681789631599933, 0.020207088554572757, 0.022030106451434484, 0.024097026810512952, 0.02636929489563662, 0.02882038037184077, 0.031431970767166285, 0.03419082454505244, 0.037086547881548, 0.04011016819786654, 0.04325328360159937, 0.04650759067009837 ], [ 0.10384748521105439, 0.10125766019365762, 0.09866559626804938, 0.09607004211318519, 0.09346948506029457, 0.0908621999846358, 0.08824630724736722, 0.08561983880522926, 0.0829808114289124, 0.08032730587037976, 0.07765755080243383, 0.07497001041868252, 0.07226347471744467, 0.06953715167938589, 0.0667907607649488, 0.0640246273927722, 0.06123977833321992, 0.05843803833728232, 0.05562212898378833, 0.05279577194521144, 0.0499638010442108, 0.047132291090190334, 0.04430871704604659, 0.041502164961559354, 0.03872362646424095, 0.035986421254213564, 0.03330680639928505, 0.03070484533931587, 0.028205616501270847, 0.02584081913680449, 0.02365072355259009, 0.021686091426023006, 0.020008988451074745, 0.01869032483727861, 0.017801294297765755, 0.01739782513924204, 0.017503271899484533, 0.018100235057932606, 0.019138276410185832, 0.02055201298433836, 0.022278009020605324, 0.02426390982335128, 0.02647036922320509, 0.028869098758464388, 0.031439785475826314, 0.03416727678145389, 0.03703947736104439, 0.040045946482299505, 0.043177034136327536, 0.046423384776150496 ], [ 0.10421497458056674, 0.10162906760586765, 0.09904174786813887, 0.09645195231058393, 0.0938583621349729, 0.0912594490257963, 0.0886535303784118, 0.08603883275888993, 0.08341356264483402, 0.08077598338647941, 0.0781244972938943, 0.07545773179820767, 0.072774628743078, 0.07007453602003523, 0.06735730094967213, 0.06462336502124283, 0.06187385985486965, 0.05911070461349132, 0.05633670571384538, 0.05355566081274263, 0.05077247101903376, 0.047993268500879455, 0.04522557148475743, 0.04247848526501894, 0.03976297612423398, 0.03709225440597719, 0.03448231208055106, 0.031952666094344724, 0.029527354126894403, 0.027236194854384745, 0.025116217075354857, 0.023212904604228857, 0.021580417752812858, 0.020279309219603303, 0.019370005724598727, 0.018901671794817648, 0.018899691976999335, 0.019358463912595734, 0.020244546055214314, 0.021508249861216574, 0.023096661356826413, 0.02496246699234546, 0.027067418212498123, 0.029382108801082094, 0.03188413570511326, 0.03455600174161581, 0.03738336537710038, 0.04035378227418973, 0.04345588064266293, 0.04667885697114348 ], [ 0.10465376494735393, 0.10207610037806944, 0.09949826752694127, 0.09691941889410068, 0.09433845597483127, 0.0917540725941408, 0.08916480724050986, 0.08656910374591548, 0.0839653794772803, 0.08135210008270997, 0.07872785978236452, 0.07609146620917365, 0.0734420288812003, 0.07077905051144943, 0.06810252051702485, 0.06541301027162061, 0.06271176987153125, 0.06000082651828811, 0.05728308518813173, 0.054562433264320774, 0.05184385252386314, 0.04913354458581196, 0.04643907985485396, 0.04376958512312661, 0.041135990933403574, 0.03855136561541779, 0.03603136681747762, 0.03359484002713529, 0.031264580080047975, 0.02906823143231169, 0.02703920892471574, 0.025217335444122364, 0.0236485988761364, 0.022383119493492396, 0.02147042279904019, 0.020951980534025097, 0.02085289781560945, 0.021176415071814638, 0.021904359261171874, 0.02300336895678437, 0.024433474406504316, 0.026155272629521262, 0.028133961091430536, 0.03034053455875497, 0.032751289223949195, 0.03534667151963295, 0.03811008995583785, 0.041026948302471944, 0.0440839499295064, 0.04726863442763066 ], [ 0.10515885108314033, 0.10259339233723037, 0.10002938730477222, 0.09746622710331557, 0.09490305536518771, 0.09233880838551461, 0.08977226427950269, 0.08720210061940292, 0.08462695983370684, 0.0820455215140212, 0.0794565806971851, 0.07685913117325278, 0.07425245290860243, 0.07163620275665776, 0.06901050774462741, 0.0663760603691054, 0.06373421552307872, 0.06108708896477025, 0.0584376577292296, 0.05578986373589479, 0.05314872325836849, 0.05052044708144462, 0.04791257915499293, 0.045334165206882805, 0.042795966557867604, 0.040310737215341994, 0.03789358238865721, 0.03556241081861743, 0.033338476405435594, 0.03124696725824194, 0.0293175285795267, 0.0275844867710812, 0.026086384720681897, 0.02486431504016847, 0.02395862343905576, 0.023404069129864966, 0.023224483256975934, 0.023428830334085663, 0.02401045029873632, 0.024949837385542212, 0.026219576746969644, 0.027789365258943703, 0.029629656748300086, 0.031713562603073536, 0.0340173872512681, 0.036520388590951566, 0.039204237575176326, 0.04205245197881383, 0.045049921466927455, 0.04818255047021867 ], [ 0.10572617717663392, 0.10317651617894602, 0.10063025973645193, 0.09808705578531217, 0.09554630676751225, 0.09300720623569757, 0.09046878446923133, 0.08792996269513136, 0.08538961531128497, 0.08284663935363368, 0.080300030342487, 0.07774896358887742, 0.07519288003658099, 0.07263157575141362, 0.07006529423789294, 0.0674948208622537, 0.06492157880488685, 0.06234772619801117, 0.05977625450660452, 0.05721108890064277, 0.054657192478427964, 0.05212067783615534, 0.04960893162558965, 0.047130760166054546, 0.04469656631255343, 0.04231856862355035, 0.04001107185860642, 0.03779079063078466, 0.035677212130724945, 0.03369295420926747, 0.03186402612196825, 0.03021982936663554, 0.02879265924530162, 0.02761642976150864, 0.02672442797940541, 0.026146190169281765, 0.0259040572960385, 0.026010382004827547, 0.02646636343497736, 0.02726291702915328, 0.028383147835178552, 0.02980544879846128, 0.03150628244436108, 0.03346214012097379, 0.03565063216021582, 0.038050920904263465, 0.040643761605445104, 0.043411359134305154, 0.046337167021230016, 0.04940569120459563 ], [ 0.10635263982851924, 0.10382199489426892, 0.1012969794562052, 0.09877751122666958, 0.09626326265046595, 0.09375369357684668, 0.09124809291990506, 0.08874562902216097, 0.08624540822969497, 0.08374654101054704, 0.08124821481023745, 0.07874977274345772, 0.07625079716862336, 0.07375119717736875, 0.07125129904925045, 0.06875193877284473, 0.06625455583171992, 0.06376128763216148, 0.06127506427049779, 0.05879970388490446, 0.056340009694750934, 0.05390187104413787, 0.051492372273231356, 0.04911991479434111, 0.04679435884167489, 0.0445271911687389, 0.042331722302466394, 0.040223310236400064, 0.03821959461278848, 0.03634070418344799, 0.034609369098863536, 0.033050830503337625, 0.03169240413106162, 0.03056254742416946, 0.029689338340015494, 0.029098427267753878, 0.02881075246697648, 0.028840517066329924, 0.029193966936580995, 0.029869299869925096, 0.030857657576602637, 0.03214481374796941, 0.03371304883673929, 0.035542805750508465, 0.03761392857851912, 0.03990646900215292, 0.04240114418626081, 0.045079554594978914, 0.04792425446786363, 0.050918740414762145 ], [ 0.10703605645135905, 0.1045272775162716, 0.10202656806503825, 0.09953412314336302, 0.09704989086211728, 0.09457360074756951, 0.09210480102364002, 0.0896429046598711, 0.08718724380162718, 0.08473713200088229, 0.08229193349617904, 0.07985113865479054, 0.0774144445908484, 0.07498183990924594, 0.07255369249521353, 0.07013083927659555, 0.06771467694294836, 0.06530725274111694, 0.06291135472702798, 0.06053060129560983, 0.05816953048581215, 0.055833690474954435, 0.05352973375552667, 0.051265518503043346, 0.049050221180803384, 0.0468944638579381, 0.04481045720409504, 0.04281215465145153, 0.04091540367433577, 0.03913806560331225, 0.03750005588230631, 0.03602323471843226, 0.03473106088036248, 0.03364792222748788, 0.032798092145408526, 0.032204342275816346, 0.03188635896719503, 0.031859223355216786, 0.03213226243832093, 0.032708516504975485, 0.03358490795784829, 0.03475300876149854, 0.0362001740271049, 0.03791078131605339, 0.03986737213409219, 0.04205158352052741, 0.04444483899362652, 0.047028819461849065, 0.04978575711507643, 0.05269859872218639 ], [ 0.10777510317015032, 0.10529068326167822, 0.10281692625167942, 0.10035430672247342, 0.09790304875545254, 0.09546314960777866, 0.09303441223006591, 0.09061648657667006, 0.08820891943317402, 0.08581121226725001, 0.08342288640920517, 0.08104355469478573, 0.07867299856023303, 0.07631124947103424, 0.07395867349432121, 0.07161605779636573, 0.06928469787462352, 0.06696648444226479, 0.06466398910652592, 0.06238054835960033, 0.060120345959639096, 0.05788849450917781, 0.055691117856162695, 0.05353543665685087, 0.05142985972510883, 0.04938408318467409, 0.047409197359923674, 0.04551779714502476, 0.043724084687572114, 0.04204394329698117, 0.0404949489757817, 0.03909627283320786, 0.03786841822630375, 0.036832737765205514, 0.036010695385060396, 0.03542288256582885, 0.03508786167720098, 0.035020976703292746, 0.03523331548162239, 0.03573100288293255, 0.03651494342424532, 0.03758103328205096, 0.03892076274674435, 0.04052206599444212, 0.042370260574055775, 0.0444489457576908, 0.046740775794936705, 0.049228071065893594, 0.05189326557989186, 0.05471921034617631 ], [ 0.10856922684778543, 0.10611131871355999, 0.10366675780201286, 0.10123629530165959, 0.09882042656054235, 0.09641940980925442, 0.09403329360443173, 0.09166195306311577, 0.08930513472369776, 0.08696250963334878, 0.08463373403562374, 0.08231851682461198, 0.08001669275186366, 0.07772830022607305, 0.07545366244023351, 0.07319347050613138, 0.07094886728563904, 0.06872153070319563, 0.06651375552968518, 0.06432853297005177, 0.06216962787651467, 0.06004165402410852, 0.05795014854560369, 0.05590164716790424, 0.05390376206740021, 0.05196526362232658, 0.05009616567764152, 0.048307810733843236, 0.046612946392744645, 0.04502577735928058, 0.04356196875731047, 0.04223856783317917, 0.04107380493466058, 0.040086734890973114, 0.03929669100943168, 0.038722548936542714, 0.038381835786617996, 0.03828976432178344, 0.038458309597633036, 0.03889546094960063, 0.03960476460140921, 0.04058522223880677, 0.04183154298956343, 0.04333468263073402, 0.04508256382890233, 0.04706086257425493, 0.049253763702907634, 0.051644620221474556, 0.05421648459757109, 0.05695250713456794 ], [ 0.10941853623937353, 0.10698897310109906, 0.10457547057974512, 0.10217904876879665, 0.09980046505731122, 0.09744022771973362, 0.0950986180854328, 0.09277572147953339, 0.09047146688731329, 0.0881856750452242, 0.0859181144136989, 0.08366856425178998, 0.08143688380228936, 0.07922308641897548, 0.07702741733583088, 0.07485043370380087, 0.07269308551883706, 0.07055679615347048, 0.06844354140183, 0.06635592626906806, 0.06429725918000723, 0.062271623818223806, 0.06028394935971317, 0.05834008029810225, 0.0564468471677832, 0.05461213899476973, 0.05284497694479459, 0.051155586108481636, 0.04955545846397473, 0.048057394790711354, 0.046675507047372146, 0.045425156426139104, 0.04432279766288058, 0.04338569967204522, 0.04263151899467579, 0.04207771815759407, 0.04174084618769249, 0.041635730204268535, 0.04177465815369307, 0.042166653250182415, 0.042816940809884976, 0.04372668346350557, 0.04489301574106101, 0.04630935667502148, 0.04796593522876449, 0.04985043959427998, 0.051948700567590565, 0.054245336057537306, 0.056724309169796774, 0.05936937771814243 ], [ 0.11032367752874803, 0.10792399700242693, 0.1055430598562491, 0.10318214309126002, 0.10084225297181083, 0.09852413342396651, 0.09622828286358157, 0.0939549797696876, 0.09170431707840158, 0.08947624521414649, 0.08727062331047225, 0.08508727791532092, 0.08292606823889014, 0.08078695679994466, 0.07867008417305044, 0.07657584644885584, 0.07450497400804489, 0.07245861029185528, 0.0704383894410956, 0.06844651197681427, 0.06648581809917699, 0.064559858650678, 0.06267296425265849, 0.06083031346143405, 0.05903800083615073, 0.05730310535922751, 0.05563375847943386, 0.05403920895491402, 0.052529878535536124, 0.051117398378598605, 0.04981461124952737, 0.04863551972842503, 0.04759515703150311, 0.04670935636458439, 0.04599439893227107, 0.04546653156183331, 0.04514136299326722, 0.04503317173964719, 0.0451541836704869, 0.04551389714589686, 0.046118539936630995, 0.04697073018133405, 0.04806938390351932, 0.04940987145492309, 0.050984386079977614, 0.05278246022899851, 0.05479155481801933, 0.05699765246256019, 0.05938580232435069, 0.061940584762545055 ], [ 0.1112856996218412, 0.10891716993058062, 0.10656997951618043, 0.10424564655111722, 0.10194540970931984, 0.09967023144748119, 0.09742080956698804, 0.09519759749825887, 0.09300083351101265, 0.09083057879026556, 0.08868676404133344, 0.08656924401208413, 0.0844778590631009, 0.08241250269267572, 0.08037319375040373, 0.07836015196688799, 0.07637387540292383, 0.0744152184923774, 0.07248546952645059, 0.07058642670158709, 0.06872047221166883, 0.06689064426734387, 0.06510070730155576, 0.06335522086576802, 0.06165960769840894, 0.0600202209924657, 0.058444409834713044, 0.056940579992053555, 0.05551824460923522, 0.054188056018988365, 0.05296180602219472, 0.05185237823776589, 0.05087363336910851, 0.050040207752724726, 0.04936720880730507, 0.048869799293113546, 0.04856267617147541, 0.04845946839000319, 0.048572098119283494, 0.04891016685639306, 0.04948043559476101, 0.05028646252272284, 0.05132844177556706, 0.052603256781191744, 0.05410472952181113, 0.055824020995709066, 0.05775012401354969, 0.059870388462035656, 0.06217102857894796, 0.06463757682367385 ], [ 0.11230591455622621, 0.10996956225295866, 0.1076570066622184, 0.1053699882667705, 0.10310995905150715, 0.10087808087575861, 0.09867523198617391, 0.09650202223800755, 0.09435881735906577, 0.09224577232496065, 0.09016287362927626, 0.08810998994329958, 0.08608693038452149, 0.0840935093696563, 0.08212961683503367, 0.08019529248229158, 0.07829080266522727, 0.07641671858511043, 0.07457399461021855, 0.0727640457738375, 0.0709888238112999, 0.06925089142854048, 0.06755349478581078, 0.06590063433850647, 0.06429713408734292, 0.06274870882311015, 0.0612620279810053, 0.05984477314846122, 0.05850568406756694, 0.05725458521934736, 0.05610238202256853, 0.05506101279768571, 0.05414334066992939, 0.053362969488013, 0.05273397070968339, 0.05227051499822611, 0.051986413354405306, 0.05189458725541421, 0.05200650328541234, 0.052331621493853425, 0.052876913935021155, 0.053646507084076075, 0.05464148812024986, 0.055859892827985445, 0.05729686736414093, 0.05894497363138166, 0.06079459341242537, 0.06283438178894733, 0.06505172466696985, 0.06743316541048233 ], [ 0.11338575822086588, 0.11108239672940216, 0.10880510497700671, 0.10655582441657754, 0.10433619928055407, 0.10214757037818932, 0.09999097690709273, 0.09786716696930041, 0.09577661725516193, 0.09371956209309835, 0.09169603177249218, 0.0897058997464885, 0.08774893803011416, 0.0858248798464705, 0.08393348835989056, 0.08207463018777522, 0.08024835231692427, 0.07845496107428164, 0.07669510191676694, 0.0749698389993169, 0.0732807337295616, 0.07162992177885047, 0.07002018823106751, 0.06845504063192276, 0.0669387795568852, 0.06547656584400591, 0.06407448274659126, 0.06273958988888201, 0.06147996405499705, 0.060304719603697786, 0.05922399891139135, 0.05824892110821611, 0.05739147608039859, 0.05666435101982878, 0.056080679518057515, 0.055653708982628974, 0.0553963911901014, 0.05532091245794404, 0.05543819252930162, 0.05575739214238825, 0.05628547527824476, 0.05702687068558275, 0.05798326757892634, 0.05915356384897492, 0.06053396527736209, 0.062118215639355344, 0.06389792413684453, 0.0658629504365749, 0.06800180860477718, 0.07030205763193235 ], [ 0.11452665625411111, 0.11225691462338586, 0.11001529186561028, 0.10780390724145823, 0.10562457485086985, 0.10347879329952146, 0.10136774326805277, 0.09929229378903578, 0.09725301781720849, 0.09525021741521579, 0.09328395858227358, 0.09135411544299553, 0.08946042320743611, 0.08760253903185897, 0.08578010967349903, 0.08399284466015443, 0.0822405936008789, 0.08052342625499972, 0.0788417140516252, 0.07719621189800051, 0.07558813930616988, 0.07401926006232006, 0.0724919598052682, 0.0710093209001739, 0.06957519381231746, 0.06819426372541927, 0.06687211034490143, 0.06561525764581733, 0.06443120879017848, 0.06332845965400603, 0.06231648258543712, 0.06140567050752003, 0.06060723076308288, 0.05993301875292936, 0.05939530403000185, 0.05900646651318132, 0.058778627928443995, 0.05872323291107282, 0.05885060409182621, 0.0591695039478938, 0.05968674095437984, 0.060406856760540716, 0.061331924029360566, 0.06246147213702374, 0.063792542568128, 0.06531986080673456, 0.06703609982518674, 0.06893220379330095, 0.0709977397259737, 0.07322124847859898 ], [ 0.1157298994984524, 0.1134942508433295, 0.11128851389816008, 0.10911496139522597, 0.10697555421715749, 0.10487192746564568, 0.10280538433394226, 0.1007768986907666, 0.09878712707158148, 0.09683643051259853, 0.09492490636531552, 0.09305242991089659, 0.09121870527391986, 0.08942332483501388, 0.08766583608295292, 0.0859458146474093, 0.08426294212783139, 0.08261708728867288, 0.08100838922396353, 0.07943734119164367, 0.0779048739541014, 0.07641243759749247, 0.07496208088804575, 0.07355652719912616, 0.07219924584499475, 0.07089451722686112, 0.06964748949112955, 0.06846422340692214, 0.0673517209278358, 0.06631793151859049, 0.06537172899540986, 0.06452285064242393, 0.06378179010886426, 0.0631596365025186, 0.06266785458922527, 0.0623180053538643, 0.06212141233382611, 0.062088786599567396, 0.0622298309880392, 0.06255285070041357, 0.06306440100282973, 0.06376900217760131, 0.06466894653920695, 0.06576421286431593, 0.06705249168230523, 0.06852931285549262, 0.07018825701272621, 0.07202122625192853, 0.07401874761972087, 0.0761702847327638 ], [ 0.11699653274675441, 0.11479532191759358, 0.11262553441268311, 0.11048957154885014, 0.10838951776481578, 0.10632712368893325, 0.10430379691932365, 0.1023206015107269, 0.10037826695803312, 0.09847720720901056, 0.09661754993944885, 0.09479917599855994, 0.09302176860067973, 0.09128487152227292, 0.08958795528243269, 0.08793049005921859, 0.08631202393720219, 0.08473226500020545, 0.08319116577484427, 0.08168900858197158, 0.08022649044016808, 0.07880480625265719, 0.07742572905220503, 0.07609168602743838, 0.0748058288579927, 0.07357209650152483, 0.07239526797653592, 0.07128100187459174, 0.07023585836040663, 0.06926729838259292, 0.06838365389423579, 0.0675940623143226, 0.06690835855189241, 0.066336918991319, 0.06589045418578389, 0.06557975077664586, 0.06541536825098503, 0.06540730212483256, 0.06556463117238352, 0.06589517128895085, 0.06640516127302902, 0.06709900528295502, 0.06797909259515442, 0.06904570799164701, 0.07029703683267123, 0.07172925930077216, 0.07333672012572505, 0.07511215457165704, 0.07704694913440138, 0.07913141607287416 ], [ 0.11832725973986936, 0.11616072982190154, 0.11402683634874484, 0.11192808436622993, 0.10986665900559882, 0.10784440618408042, 0.10586282092753482, 0.10392304437695035, 0.10202587034292802, 0.10017176201816409, 0.09836087915791103, 0.09659311570798462, 0.09486814751826737, 0.0931854894480222, 0.09154456086916699, 0.08994475832361744, 0.08838553390495586, 0.08686647781985915, 0.08538740353876614, 0.08394843395617946, 0.08255008702666575, 0.08119335939156848, 0.07987980652544717, 0.0786116178684072, 0.07739168523104509, 0.07622366243133073, 0.07511201363347723, 0.07406204722078047, 0.0730799312979403, 0.07217268618061755, 0.0713481486404385, 0.07061490243191847, 0.06998216996969954, 0.06945966118915532, 0.06905737780095626, 0.06878537441041492, 0.06865348218728146, 0.06867100555612764, 0.06884640707947755, 0.06918699947783206, 0.06969866569246808, 0.07038562736632877, 0.07125027884070781, 0.07229309805567495, 0.07351263846454095, 0.07490559844492897, 0.07646695797181213, 0.07819016749837975, 0.08006737157178011, 0.08208964966504953 ], [ 0.11972236650623959, 0.11759068379979912, 0.11549254250257572, 0.11343052709448796, 0.11140690133881162, 0.10942358726020565, 0.10748215164825382, 0.10558380119452969, 0.1037293871794627, 0.10191942037461088, 0.10015409652659384, 0.09843333245558553, 0.09675681245278189, 0.095124044318617, 0.09353442406763607, 0.09198730805577734, 0.09048209107526826, 0.08901828881862801, 0.0875956230351386, 0.08621410768009212, 0.08487413436958968, 0.08357655547432853, 0.08232276318196702, 0.08111476279490754, 0.07995523837761276, 0.07884760860298272, 0.07779607026559826, 0.0768056264495543, 0.07588209581041264, 0.07503209894219263, 0.07426301747800534, 0.07358292157807873, 0.07300046197185764, 0.0725247239128458, 0.07216504239650906, 0.07193078079917525, 0.07183107858078056, 0.07187457752602291, 0.0720691396604361, 0.0724215728278735, 0.07293738130889649, 0.07362055831025485, 0.07447343449530239, 0.07549659219490125, 0.07668884917359162, 0.07804730972256409, 0.07956747535194487, 0.08124340322877557, 0.08306789818874212, 0.08503272369155294 ], [ 0.1211816642174861, 0.11908494139345044, 0.11702235447256168, 0.11499654409981902, 0.11300983178428843, 0.11106419778567934, 0.10916126641668542, 0.10730229989324612, 0.10548820167823418, 0.10371953001736643, 0.10199652206890088, 0.1003191286950269, 0.09868705963111828, 0.09709983839949385, 0.09555686600767264, 0.09405749218588719, 0.09260109268875912, 0.09118715101925301, 0.08981534282893713, 0.08848562119853888, 0.08719830098997679, 0.08595414046204997, 0.08475441832929621, 0.08360100438915895, 0.08249642172241269, 0.08144389827119321, 0.0804474053181349, 0.07951168005073503, 0.07864222904450613, 0.0778453092137216, 0.07712788266515938, 0.0764975420761256, 0.07596240383893699, 0.07553096738966385, 0.07521194093991813, 0.07501403624009037, 0.0749457378821184, 0.07501505571941386, 0.07522927183142435, 0.07559469560207757, 0.07611644144109324, 0.07679824310994289, 0.0776423164128247, 0.07864927836835112, 0.07981812636595549, 0.0811462758992305, 0.08262965096677138, 0.08426281773474067, 0.08603914992879355, 0.0879510137523541 ], [ 0.12270445182317748, 0.12064276898736327, 0.11861551065392918, 0.11662535178340983, 0.11467465221881137, 0.11276543407727203, 0.11089936642857876, 0.10907775839504208, 0.10730156162512175, 0.10557138285110086, 0.10388750694766666, 0.10224993057731267, 0.10065840615728128, 0.09911249553113118, 0.09761163239582538, 0.09615519224062478, 0.09474256831092437, 0.09337325192645841, 0.09204691535977298, 0.09076349541060769, 0.08952327578074722, 0.08832696634238389, 0.0871757773780825, 0.08607148682960132, 0.08501649850740607, 0.08401388907346292, 0.08306744142041807, 0.08218166185279696, 0.08136177827341841, 0.08061371645685704, 0.07994405153774045, 0.07935993215507421, 0.0788689753748521, 0.07847913164293427, 0.07819852063430538, 0.07803524092713195, 0.07799715880866327, 0.07809168397982437, 0.07832554214067432, 0.07870455603783562, 0.07923344718764253, 0.07991566991124538, 0.08075328746558494, 0.08174689708287519, 0.0828956070038918, 0.08419706461017376, 0.0856475310661805, 0.08724199493587231, 0.08897431533795919, 0.09083738444623662 ], [ 0.12428949787644425, 0.12226292131516639, 0.1202707627961967, 0.11831571148211413, 0.1164001478413801, 0.11452612109003088, 0.11269533376765432, 0.11090913456405416, 0.10916852033526456, 0.10747414801072627, 0.1058263568058742, 0.10422520082901945, 0.10267049182484521, 0.10116185144777869, 0.09969877212617542, 0.09828068528005572, 0.09690703540462053, 0.09557735833739021, 0.09429136188991542, 0.09304900694078617, 0.09185058704326314, 0.09069680458227783, 0.08958884150289076, 0.08852842260741489, 0.08751786936742285, 0.08656014211372104, 0.0856588683581364, 0.0848183548864565, 0.08404358118039301, 0.08334017173312433, 0.08271434498741974, 0.08217283702441461, 0.08172279883727898, 0.08137166708946347, 0.0811270096940928, 0.08099634931215599, 0.08098696983185219, 0.08110571286259076, 0.0813587729963773, 0.08175150177202073, 0.08228823066528038, 0.08297212284874367, 0.08380506188452505, 0.08478758305984843, 0.0859188500319728, 0.08719667619926805, 0.08861758717197148, 0.09017691823814304, 0.09186893904988426, 0.09368699698500366 ], [ 0.1259350402178786, 0.12394363863710332, 0.12198636990306597, 0.12006591924020991, 0.11818467189670594, 0.11634469111692572, 0.11454770306914848, 0.1127950898086644, 0.11108789118294672, 0.1094268163549777, 0.10781226534099435, 0.10624436064211012, 0.10472298871104707, 0.10324785065330086, 0.10181852123467396, 0.10043451497065953, 0.09909535782106321, 0.09780066281370589, 0.09655020777656372, 0.09534401326472032, 0.0941824187177736, 0.0930661548618282, 0.09199641036247587, 0.0909748907270995, 0.0900038674357259, 0.0890862152462742, 0.08822543557906515, 0.08742566385612753, 0.08669165868585715, 0.08602877088841908, 0.0854428906070456, 0.08494037120286194, 0.08452792933718668, 0.08421252163637132, 0.08400119960649748, 0.0839009459668662, 0.08391849719371855, 0.08406015864487026, 0.08433161996633888, 0.08473777934554469, 0.08528258538085591, 0.08596890476417365, 0.08679842260775673, 0.08777158019758491, 0.0888875524453602, 0.09014426463708237, 0.09153844555683743, 0.09306571198034899, 0.09472067807899875, 0.09649708253617112 ], [ 0.12763880158590735, 0.12568265970042225, 0.12376010766764434, 0.12187381076538235, 0.12002614513146252, 0.11821917667535763, 0.11645464673849121, 0.11473396553174714, 0.11305821420969957, 0.11142815621769718, 0.10984425827775024, 0.10830672107351644, 0.10681551936818487, 0.10537045095834809, 0.10397119354886133, 0.10261736834392769, 0.10130860890083918, 0.1000446335931418, 0.09882531988274827, 0.09765077850329035, 0.0965214256029143, 0.0954380508730896, 0.09440187968888296, 0.093414627294166, 0.09247854307462135, 0.09159644297059014, 0.09077172809759006, 0.09000838768163984, 0.08931098450687444, 0.08868462125096027, 0.08813488639234902, 0.08766777885499581, 0.08728961124534017, 0.08700689244874531, 0.08682619147455006, 0.08675398571763102, 0.08679649814398675, 0.08695952917204347, 0.08724829004638178, 0.08766724511893322, 0.088219970523114, 0.08890903616578548, 0.08973591677014645, 0.09070093597314724, 0.09180324539062149, 0.09304083834561515, 0.09441059585849618, 0.0959083607419359, 0.09752903438624866, 0.09926669013498739 ], [ 0.12939801879129936, 0.12747724816918032, 0.1255892912177129, 0.12373677947383317, 0.12192206806181649, 0.12014721587610751, 0.11841397227928363, 0.11672377127982202, 0.1150777339900873, 0.11347667994984072, 0.11192114764156155, 0.11041142423165631, 0.10894758425972695, 0.10752953668177023, 0.1061570793682497, 0.10482995987882149, 0.1035479410941579, 0.10231087008979467, 0.10111874849086902, 0.09997180244893293, 0.09887055032750743, 0.09781586616352751, 0.09680903697781153, 0.09585181203052273, 0.09494644215151095, 0.09409570732006446, 0.09330293073031691, 0.09257197767192174, 0.09190723770315247, 0.0913135888243042, 0.09079634270574051, 0.09036117051739745, 0.09001400956706215, 0.08976095178804314, 0.08960811610280493, 0.08956150777706108, 0.0896268689842408, 0.08980952581046939, 0.0901142377147314, 0.0905450558890408, 0.09110519693497145, 0.09179693772970268, 0.09262153630580343, 0.09357918209468563, 0.09466897712745435, 0.09588894793342, 0.09723608612160106, 0.09870641414795699, 0.10029507168701947, 0.10199641740397739 ], [ 0.13120948284010245, 0.12932422996153978, 0.127470808702415, 0.12565180529106545, 0.12386954389714092, 0.122126068341062, 0.12042313005999077, 0.11876218322205238, 0.1171443877215502, 0.11557062058190667, 0.11404149604659528, 0.11255739436131333, 0.11111849895550385, 0.10972484143206851, 0.10837635348515431, 0.10707292460054728, 0.10581446416264093, 0.1046009664039064, 0.10343257649120978, 0.10230965594810122, 0.1012328455596286, 0.10020312389023416, 0.09922185955846972, 0.0982908554481923, 0.09741238309037008, 0.09658920552295348, 0.09582458703426032, 0.09512228833002068, 0.09448654585381691, 0.09392203425743997, 0.09343381138576581, 0.0930272456308705, 0.0927079261345311, 0.09248155707430554, 0.09235383813257282, 0.09233033417219014, 0.09241633805381524, 0.09261673133487061, 0.09293584818489356, 0.093377348137652, 0.09394410320040734, 0.09463810431842928, 0.09546039126317818, 0.09641100874505103, 0.09748899006392253, 0.09869236805048755, 0.10001821157433513, 0.10146268463874208, 0.10302112414913156, 0.10468813188467051 ], [ 0.1330695873066638, 0.1312200388539835, 0.12940116317493364, 0.12761549179744885, 0.1258653098839767, 0.1241526396492033, 0.12247922975350124, 0.12084655148493437, 0.11925580238941795, 0.11770791781246087, 0.11620359058300812, 0.11474329880937834, 0.11332734148040108, 0.11195588128448683, 0.11062899378840861, 0.10934672186834297, 0.10810913406837683, 0.10691638538372482, 0.105768778831294, 0.10466682607973014, 0.10361130536229454, 0.10260331488430588, 0.10164431995711856, 0.10073619213771567, 0.09988123872424068, 0.0990822210537367, 0.09834236017408887, 0.09766532862744289, 0.09705522730141028, 0.09651654659389033, 0.0960541115145612, 0.09567301082409041, 0.09537851089617844, 0.09517595566980731, 0.09507065481436372, 0.09506776301461398, 0.09517215403251011, 0.09538829384148655, 0.09572011757364053, 0.09617091519497527, 0.09674323067321776, 0.09743877890388253, 0.09825838383145068, 0.0992019401048434, 0.10026839933657654, 0.10145578071288584, 0.1027612044519722, 0.10418094554007164, 0.1057105043721169, 0.10734469042940888 ], [ 0.13497438232752554, 0.13316076778313887, 0.13137652029510924, 0.12962410937062, 0.12790577488607022, 0.12622351232615475, 0.12457906369931067, 0.12297391486034102, 0.12140929982399687, 0.11988621246755139, 0.11840542580172894, 0.11696751874606488, 0.1155729100871452, 0.11422189903769878, 0.11291471156292948, 0.1116515514088403, 0.11043265456492055, 0.10925834572746387, 0.108129095204077, 0.10704557461582094, 0.10600870970970216, 0.105019728587692, 0.10408020368522937, 0.10319208588877304, 0.10235772926647517, 0.10157990499929523, 0.10086180324605283, 0.10020702186272705, 0.09961954113452164, 0.09910368398091042, 0.09866406147061785, 0.0983055039425914, 0.09803297857050602, 0.09785149482088953, 0.09776599991350665, 0.09778126705677191, 0.097901779846688, 0.09813161672144173, 0.09847433968975049, 0.09893289164119504, 0.09950950636136624, 0.10020563490073596, 0.10102189120423366, 0.10195801895163914, 0.103012880468035, 0.10418446743623477, 0.10546993207959807, 0.10686563657316311, 0.10836721774969783, 0.10996966373154282 ], [ 0.13691963177980285, 0.1351422234684674, 0.13339275956273275, 0.13167364215176308, 0.12998706117321973, 0.12833498152514583, 0.12671913554035136, 0.12514102147139966, 0.12360190849391305, 0.12210284856097618, 0.12064469523734077, 0.11922812941643227, 0.11785369158516583, 0.11652182006148808, 0.11523289439797572, 0.11398728293157537, 0.1127853932732117, 0.11162772437794218, 0.11051491872077608, 0.10944781302680025, 0.1084274859664729, 0.10745530122582028, 0.10653294439415166, 0.10566245217631716, 0.10484623253128374, 0.104087074464779, 0.10338814636421631, 0.10275298196500465, 0.1021854532864169, 0.10168973018076262, 0.10127022650866617, 0.10093153338875525, 0.10067834046822095, 0.1005153467082168, 0.1004471627505449, 0.10047820749314829, 0.10061260200557101, 0.10085406430934736, 0.10120580878024164, 0.10167045395523364, 0.10224994231899835, 0.10294547519683858, 0.1037574652145066, 0.10468550794687555, 0.10572837343480772, 0.1068840172829622, 0.10814961014222615, 0.10952158360107614, 0.11099568991423042, 0.1125670726144749 ], [ 0.13890087149101982, 0.1371599822594302, 0.135445527063196, 0.13375983691747773, 0.13210504862280123, 0.13048309374760433, 0.12889569264908848, 0.12734435409914374, 0.1258303809487341, 0.12435488210021886, 0.1229187908676381, 0.12152288959690892, 0.12016784019936347, 0.11885422003238207, 0.1175825623493135, 0.11635340034630813, 0.11516731366377485, 0.11402497606088173, 0.11292720287687841, 0.11187499682496192, 0.11086959063316852, 0.10991248505123415, 0.10900548078076304, 0.10815070295680464, 0.10735061691131934, 0.10660803408376951, 0.10592610711378142, 0.10530831335963924, 0.10475842633971232, 0.10428047489686051, 0.10387869024196571, 0.10355744144154774, 0.1033211603695896, 0.10317425763090732, 0.10312103145944175, 0.10316557206745496, 0.10331166433154078, 0.10356269200574927, 0.10392154680986888, 0.10439054571864313, 0.10497135955621252, 0.10566495557884986, 0.10647155612890202, 0.10739061470490718, 0.10842080997427067, 0.10956005742206917, 0.11080553754901051, 0.11215373886215313, 0.11360051338742026, 0.1151411420979948 ], [ 0.14091346666704113, 0.13920944544462943, 0.1375302880286062, 0.13587825224062208, 0.13425541981228437, 0.13266368719117227, 0.13110476105475966, 0.1295801590207049, 0.1280912159158495, 0.12663909581340815, 0.12522480987289145, 0.12384923982642188, 0.12251316675572561, 0.12121730460429266, 0.11996233767733885, 0.1187489612060933, 0.11757792389948538, 0.11645007128097168, 0.11536638851491379, 0.11432804136771144, 0.1133364139245035, 0.11239314169227509, 0.1115001387635798, 0.11065961779085128, 0.1098741016290366, 0.1091464256445914, 0.10847972986357585, 0.10787744034345732, 0.10734323940554606, 0.10688102466040515, 0.10649485709789754, 0.10618889889382699, 0.10596734199839357, 0.10583432900330748, 0.10579386821269338, 0.10584974523946374, 0.10600543378042573, 0.10626400845500814, 0.10662806269180773, 0.10709963458927654, 0.10768014344920825, 0.10837033928711882, 0.1091702670824135, 0.11007924687948238, 0.11109587013708694, 0.11221801200265516, 0.11344285851531301, 0.11476694716453634, 0.11618621878618234, 0.11769607848460141 ], [ 0.14295266708858592, 0.14128589261607685, 0.13964237785829692, 0.138024306642539, 0.1364337047709135, 0.13487243256617942, 0.13334218179281218, 0.13184447736772195, 0.13038068415633983, 0.12895201900789258, 0.12755956802287005, 0.12620430887146822, 0.12488713780079881, 0.12360890078805012, 0.1223704281238934, 0.12117257155226, 0.12001624295524412, 0.11890245346041996, 0.11783235176585898, 0.11680726042791009, 0.11582870883936335, 0.11489846164101414, 0.11401854135742115, 0.11319124412724359, 0.1124191475097191, 0.11170510949201914, 0.11105225799847485, 0.11046397041360435, 0.10994384287813888, 0.1094956494014239, 0.10912329115346522, 0.10883073665083967, 0.10862195392365423, 0.10850083613137615, 0.10847112246366418, 0.10853631649354788, 0.108699604416371, 0.10896377578039311, 0.10933114936862809, 0.10980350680793452, 0.11038203625295774, 0.11106728812453241, 0.111859144393653, 0.11275680232496463, 0.1137587729691659, 0.11486289406768474, 0.1160663564508949, 0.11736574251242166, 0.11875707495613368, 0.1202358737560776 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.57281 (SEM: 0)
x1: 0.979432
x2: 0.784923
x3: 0.297002
x4: 0.430659
x5: 0.786892
x6: 0.07397", "Arm 10_0
l2norm: 1.51963 (SEM: 0)
x1: 0.591468
x2: 0.371087
x3: 0.92552
x4: 0.358084
x5: 0.495212
x6: 0.769208", "Arm 11_0
l2norm: 1.20626 (SEM: 0)
x1: 0.690951
x2: 0.0306413
x3: 0.216716
x4: 0.716453
x5: 0.291473
x6: 0.575743", "Arm 12_0
l2norm: 1.0863 (SEM: 0)
x1: 0.177877
x2: 0.674407
x3: 0.421198
x4: 0.338802
x5: 0.594461
x6: 0.219123", "Arm 13_0
l2norm: 1.02888 (SEM: 0)
x1: 0.231516
x2: 0.616074
x3: 0.476394
x4: 0.335011
x5: 0.465578
x6: 0.263612", "Arm 14_0
l2norm: 1.05028 (SEM: 0)
x1: 0.291882
x2: 0.5522
x3: 0.568437
x4: 0.331709
x5: 0.410356
x6: 0.333812", "Arm 15_0
l2norm: 1.0932 (SEM: 0)
x1: 0.33613
x2: 0.500325
x3: 0.646939
x4: 0.333627
x5: 0.377844
x6: 0.398972", "Arm 16_0
l2norm: 1.13542 (SEM: 0)
x1: 0.366051
x2: 0.451651
x3: 0.71543
x4: 0.335184
x5: 0.347802
x6: 0.453928", "Arm 17_0
l2norm: 1.15416 (SEM: 0)
x1: 0.369722
x2: 0.396793
x3: 0.776089
x4: 0.331656
x5: 0.300074
x6: 0.485381", "Arm 18_0
l2norm: 1.13473 (SEM: 0)
x1: 0.336904
x2: 0.344148
x3: 0.819443
x4: 0.31952
x5: 0.248514
x6: 0.469396", "Arm 19_0
l2norm: 1.17371 (SEM: 0)
x1: 0.396041
x2: 0.393813
x3: 0.761329
x4: 0.341066
x5: 0.261872
x6: 0.548757", "Arm 1_0
l2norm: 1.20122 (SEM: 0)
x1: 0.249398
x2: 0.568361
x3: 0.531979
x4: 0.271478
x5: 0.804936
x6: 0.230381", "Arm 20_0
l2norm: 1.16438 (SEM: 0)
x1: 0.401077
x2: 0.389952
x3: 0.719855
x4: 0.352102
x5: 0.207668
x6: 0.597962", "Arm 21_0
l2norm: 1.15562 (SEM: 0)
x1: 0.44262
x2: 0.378485
x3: 0.729044
x4: 0.317232
x5: 0.199577
x6: 0.569486", "Arm 22_0
l2norm: 1.20311 (SEM: 0)
x1: 0.372955
x2: 0.391623
x3: 0.768302
x4: 0.37871
x5: 0.244363
x6: 0.601324", "Arm 23_0
l2norm: 1.1843 (SEM: 0)
x1: 0.351682
x2: 0.407125
x3: 0.737527
x4: 0.338623
x5: 0.257507
x6: 0.623074", "Arm 2_0
l2norm: 1.42762 (SEM: 0)
x1: 0.00450812
x2: 0.274208
x3: 0.350825
x4: 0.503775
x5: 0.874895
x6: 0.905855", "Arm 3_0
l2norm: 1.58477 (SEM: 0)
x1: 0.0290827
x2: 0.393902
x3: 0.595405
x4: 0.916642
x5: 0.915106
x6: 0.568628", "Arm 4_0
l2norm: 1.21975 (SEM: 0)
x1: 0.572154
x2: 0.218557
x3: 0.024659
x4: 0.0777005
x5: 0.823543
x6: 0.654053", "Arm 5_0
l2norm: 1.64345 (SEM: 0)
x1: 0.912443
x2: 0.410203
x3: 0.956054
x4: 0.558295
x5: 0.143371
x6: 0.673672", "Arm 6_0
l2norm: 1.80066 (SEM: 0)
x1: 0.470742
x2: 0.809175
x3: 0.888021
x4: 0.923421
x5: 0.00837565
x6: 0.851274", "Arm 7_0
l2norm: 1.8991 (SEM: 0)
x1: 0.953139
x2: 0.757169
x3: 0.884338
x4: 0.19917
x5: 0.63656
x6: 0.947568", "Arm 8_0
l2norm: 1.10011 (SEM: 0)
x1: 0.0658751
x2: 0.830336
x3: 0.209183
x4: 0.519807
x5: 0.39785
x6: 0.210257", "Arm 9_0
l2norm: 1.56443 (SEM: 0)
x1: 0.538918
x2: 0.988224
x3: 0.941543
x4: 0.282868
x5: 0.189363
x6: 0.421953" ], "type": "scatter", "x": [ 0.2970021665096283, 0.9255203837528825, 0.21671577263623476, 0.42119787265206565, 0.4763938335697652, 0.568437406792342, 0.6469391612032974, 0.7154300483633987, 0.7760888374578017, 0.8194433764793437, 0.7613292291796273, 0.5319789526984096, 0.7198552980371945, 0.7290438970933106, 0.7683022054221651, 0.7375273306849044, 0.3508254634216428, 0.5954045867547393, 0.02465902268886566, 0.956054481677711, 0.8880211319774389, 0.8843380026519299, 0.20918256510049105, 0.941543310880661 ], "xaxis": "x", "y": [ 0.43065887689590454, 0.3580843470990658, 0.7164526404812932, 0.3388016594537909, 0.335010898825457, 0.3317086883233389, 0.33362678209544616, 0.3351844960185878, 0.3316561116062642, 0.31951992764750203, 0.3410664092792352, 0.2714783549308777, 0.35210174898606306, 0.31723212670053325, 0.3787096820817488, 0.3386227427715542, 0.5037752818316221, 0.9166423613205552, 0.07770051434636116, 0.5582953616976738, 0.9234206723049283, 0.19917000737041235, 0.5198070602491498, 0.2828679056838155 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.57281 (SEM: 0)
x1: 0.979432
x2: 0.784923
x3: 0.297002
x4: 0.430659
x5: 0.786892
x6: 0.07397", "Arm 10_0
l2norm: 1.51963 (SEM: 0)
x1: 0.591468
x2: 0.371087
x3: 0.92552
x4: 0.358084
x5: 0.495212
x6: 0.769208", "Arm 11_0
l2norm: 1.20626 (SEM: 0)
x1: 0.690951
x2: 0.0306413
x3: 0.216716
x4: 0.716453
x5: 0.291473
x6: 0.575743", "Arm 12_0
l2norm: 1.0863 (SEM: 0)
x1: 0.177877
x2: 0.674407
x3: 0.421198
x4: 0.338802
x5: 0.594461
x6: 0.219123", "Arm 13_0
l2norm: 1.02888 (SEM: 0)
x1: 0.231516
x2: 0.616074
x3: 0.476394
x4: 0.335011
x5: 0.465578
x6: 0.263612", "Arm 14_0
l2norm: 1.05028 (SEM: 0)
x1: 0.291882
x2: 0.5522
x3: 0.568437
x4: 0.331709
x5: 0.410356
x6: 0.333812", "Arm 15_0
l2norm: 1.0932 (SEM: 0)
x1: 0.33613
x2: 0.500325
x3: 0.646939
x4: 0.333627
x5: 0.377844
x6: 0.398972", "Arm 16_0
l2norm: 1.13542 (SEM: 0)
x1: 0.366051
x2: 0.451651
x3: 0.71543
x4: 0.335184
x5: 0.347802
x6: 0.453928", "Arm 17_0
l2norm: 1.15416 (SEM: 0)
x1: 0.369722
x2: 0.396793
x3: 0.776089
x4: 0.331656
x5: 0.300074
x6: 0.485381", "Arm 18_0
l2norm: 1.13473 (SEM: 0)
x1: 0.336904
x2: 0.344148
x3: 0.819443
x4: 0.31952
x5: 0.248514
x6: 0.469396", "Arm 19_0
l2norm: 1.17371 (SEM: 0)
x1: 0.396041
x2: 0.393813
x3: 0.761329
x4: 0.341066
x5: 0.261872
x6: 0.548757", "Arm 1_0
l2norm: 1.20122 (SEM: 0)
x1: 0.249398
x2: 0.568361
x3: 0.531979
x4: 0.271478
x5: 0.804936
x6: 0.230381", "Arm 20_0
l2norm: 1.16438 (SEM: 0)
x1: 0.401077
x2: 0.389952
x3: 0.719855
x4: 0.352102
x5: 0.207668
x6: 0.597962", "Arm 21_0
l2norm: 1.15562 (SEM: 0)
x1: 0.44262
x2: 0.378485
x3: 0.729044
x4: 0.317232
x5: 0.199577
x6: 0.569486", "Arm 22_0
l2norm: 1.20311 (SEM: 0)
x1: 0.372955
x2: 0.391623
x3: 0.768302
x4: 0.37871
x5: 0.244363
x6: 0.601324", "Arm 23_0
l2norm: 1.1843 (SEM: 0)
x1: 0.351682
x2: 0.407125
x3: 0.737527
x4: 0.338623
x5: 0.257507
x6: 0.623074", "Arm 2_0
l2norm: 1.42762 (SEM: 0)
x1: 0.00450812
x2: 0.274208
x3: 0.350825
x4: 0.503775
x5: 0.874895
x6: 0.905855", "Arm 3_0
l2norm: 1.58477 (SEM: 0)
x1: 0.0290827
x2: 0.393902
x3: 0.595405
x4: 0.916642
x5: 0.915106
x6: 0.568628", "Arm 4_0
l2norm: 1.21975 (SEM: 0)
x1: 0.572154
x2: 0.218557
x3: 0.024659
x4: 0.0777005
x5: 0.823543
x6: 0.654053", "Arm 5_0
l2norm: 1.64345 (SEM: 0)
x1: 0.912443
x2: 0.410203
x3: 0.956054
x4: 0.558295
x5: 0.143371
x6: 0.673672", "Arm 6_0
l2norm: 1.80066 (SEM: 0)
x1: 0.470742
x2: 0.809175
x3: 0.888021
x4: 0.923421
x5: 0.00837565
x6: 0.851274", "Arm 7_0
l2norm: 1.8991 (SEM: 0)
x1: 0.953139
x2: 0.757169
x3: 0.884338
x4: 0.19917
x5: 0.63656
x6: 0.947568", "Arm 8_0
l2norm: 1.10011 (SEM: 0)
x1: 0.0658751
x2: 0.830336
x3: 0.209183
x4: 0.519807
x5: 0.39785
x6: 0.210257", "Arm 9_0
l2norm: 1.56443 (SEM: 0)
x1: 0.538918
x2: 0.988224
x3: 0.941543
x4: 0.282868
x5: 0.189363
x6: 0.421953" ], "type": "scatter", "x": [ 0.2970021665096283, 0.9255203837528825, 0.21671577263623476, 0.42119787265206565, 0.4763938335697652, 0.568437406792342, 0.6469391612032974, 0.7154300483633987, 0.7760888374578017, 0.8194433764793437, 0.7613292291796273, 0.5319789526984096, 0.7198552980371945, 0.7290438970933106, 0.7683022054221651, 0.7375273306849044, 0.3508254634216428, 0.5954045867547393, 0.02465902268886566, 0.956054481677711, 0.8880211319774389, 0.8843380026519299, 0.20918256510049105, 0.941543310880661 ], "xaxis": "x2", "y": [ 0.43065887689590454, 0.3580843470990658, 0.7164526404812932, 0.3388016594537909, 0.335010898825457, 0.3317086883233389, 0.33362678209544616, 0.3351844960185878, 0.3316561116062642, 0.31951992764750203, 0.3410664092792352, 0.2714783549308777, 0.35210174898606306, 0.31723212670053325, 0.3787096820817488, 0.3386227427715542, 0.5037752818316221, 0.9166423613205552, 0.07770051434636116, 0.5582953616976738, 0.9234206723049283, 0.19917000737041235, 0.5198070602491498, 0.2828679056838155 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "ce517b87", "metadata": { "papermill": { "duration": 0.077616, "end_time": "2024-03-01T16:35:39.076323", "exception": false, "start_time": "2024-03-01T16:35:38.998707", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "8687e0ef", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:39.230385Z", "iopub.status.busy": "2024-03-01T16:35:39.229925Z", "iopub.status.idle": "2024-03-01T16:35:39.295871Z", "shell.execute_reply": "2024-03-01T16:35:39.295158Z" }, "papermill": { "duration": 0.143936, "end_time": "2024-03-01T16:35:39.297333", "exception": false, "start_time": "2024-03-01T16:35:39.153397", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.4537103818508663, -0.6346920095828354, -0.8455651013459439, -1.056368532090507, -1.2515647804678323, -1.3928223521380863, -1.3928223521380863, -1.5639902973899291, -1.5922737733904173, -1.5922737733904173, -1.6163712643835328, -1.865098139221581, -2.089279614297727 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.9794321060180664
x2: 0.7849229574203491
x3: 0.2970021665096283
x4: 0.43065887689590454
x5: 0.7868920564651489
x6: 0.07396999001502991", "
Parameterization:
x1: 0.24939769599586725
x2: 0.5683613494038582
x3: 0.5319789526984096
x4: 0.2714783549308777
x5: 0.8049361351877451
x6: 0.23038071673363447", "
Parameterization:
x1: 0.00450812466442585
x2: 0.2742081005126238
x3: 0.3508254634216428
x4: 0.5037752818316221
x5: 0.8748950166627765
x6: 0.9058553110808134", "
Parameterization:
x1: 0.02908271737396717
x2: 0.39390181470662355
x3: 0.5954045867547393
x4: 0.9166423613205552
x5: 0.9151057889685035
x6: 0.5686279581859708", "
Parameterization:
x1: 0.572154127061367
x2: 0.21855673659592867
x3: 0.02465902268886566
x4: 0.07770051434636116
x5: 0.8235425753518939
x6: 0.6540529653429985", "
Parameterization:
x1: 0.9124428760260344
x2: 0.4102029297500849
x3: 0.956054481677711
x4: 0.5582953616976738
x5: 0.14337059948593378
x6: 0.6736718891188502", "
Parameterization:
x1: 0.4707419825717807
x2: 0.809175293892622
x3: 0.8880211319774389
x4: 0.9234206723049283
x5: 0.008375653997063637
x6: 0.8512744344770908", "
Parameterization:
x1: 0.9531386848539114
x2: 0.7571685556322336
x3: 0.8843380026519299
x4: 0.19917000737041235
x5: 0.6365602388978004
x6: 0.9475681893527508", "
Parameterization:
x1: 0.06587506551295519
x2: 0.8303359784185886
x3: 0.20918256510049105
x4: 0.5198070602491498
x5: 0.3978501632809639
x6: 0.2102569192647934", "
Parameterization:
x1: 0.5389183945953846
x2: 0.9882235275581479
x3: 0.941543310880661
x4: 0.2828679056838155
x5: 0.18936335667967796
x6: 0.42195336148142815", "
Parameterization:
x1: 0.5914676208049059
x2: 0.37108732108026743
x3: 0.9255203837528825
x4: 0.3580843470990658
x5: 0.4952122587710619
x6: 0.7692078361287713", "
Parameterization:
x1: 0.6909514805302024
x2: 0.03064131084829569
x3: 0.21671577263623476
x4: 0.7164526404812932
x5: 0.29147317446768284
x6: 0.5757430028170347", "
Parameterization:
x1: 0.1778768148813106
x2: 0.6744073832361512
x3: 0.42119787265206565
x4: 0.3388016594537909
x5: 0.5944607989282964
x6: 0.2191233393141826", "
Parameterization:
x1: 0.2315162014293475
x2: 0.6160737556494109
x3: 0.4763938335697652
x4: 0.335010898825457
x5: 0.465578264860657
x6: 0.26361184309463126", "
Parameterization:
x1: 0.29188205050993954
x2: 0.5522000600157247
x3: 0.568437406792342
x4: 0.3317086883233389
x5: 0.4103563027789573
x6: 0.33381213180156094", "
Parameterization:
x1: 0.33612953635828546
x2: 0.5003251757569187
x3: 0.6469391612032974
x4: 0.33362678209544616
x5: 0.3778436151714494
x6: 0.39897234781504043", "
Parameterization:
x1: 0.36605058261781953
x2: 0.4516510279539641
x3: 0.7154300483633987
x4: 0.3351844960185878
x5: 0.34780248697357
x6: 0.4539278746668873", "
Parameterization:
x1: 0.369721963294722
x2: 0.39679304130410087
x3: 0.7760888374578017
x4: 0.3316561116062642
x5: 0.30007365416121934
x6: 0.4853807327866337", "
Parameterization:
x1: 0.3369037948380292
x2: 0.3441483495432939
x3: 0.8194433764793437
x4: 0.31951992764750203
x5: 0.24851391858109362
x6: 0.469395890081403", "
Parameterization:
x1: 0.396040823755955
x2: 0.39381301572228916
x3: 0.7613292291796273
x4: 0.3410664092792352
x5: 0.26187187476725704
x6: 0.5487573904866277", "
Parameterization:
x1: 0.4010768823949977
x2: 0.38995214834384917
x3: 0.7198552980371945
x4: 0.35210174898606306
x5: 0.20766760015446914
x6: 0.5979621269760239", "
Parameterization:
x1: 0.4426197893690578
x2: 0.37848546823878204
x3: 0.7290438970933106
x4: 0.31723212670053325
x5: 0.19957705868472914
x6: 0.5694864108006191", "
Parameterization:
x1: 0.37295535938323604
x2: 0.39162327522900264
x3: 0.7683022054221651
x4: 0.3787096820817488
x5: 0.24436282144210159
x6: 0.6013239099991485", "
Parameterization:
x1: 0.35168199134834444
x2: 0.4071247787102214
x3: 0.7375273306849044
x4: 0.3386227427715542
x5: 0.25750652919048184
x6: 0.6230741915548201", "
Parameterization:
x1: 0.3050938293898015
x2: 0.4233409740952644
x3: 0.7224953769282285
x4: 0.30151298944537835
x5: 0.27993173308995967
x6: 0.6666818268490359" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.4537103818508663, -0.6346920095828354, -0.8455651013459439, -1.056368532090507, -1.2515647804678323, -1.3928223521380863, -1.3928223521380863, -1.5639902973899291, -1.5922737733904173, -1.5922737733904173, -1.6163712643835328, -1.865098139221581, -2.089279614297727 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.3731057701015167, -0.4537103818508663, -0.6346920095828354, -0.8455651013459439, -1.056368532090507, -1.2515647804678323, -1.3928223521380863, -1.3928223521380863, -1.5639902973899291, -1.5922737733904173, -1.5922737733904173, -1.6163712643835328, -1.865098139221581, -2.089279614297727 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 12, 12 ], "y": [ null, null ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "91ac3315", "metadata": { "papermill": { "duration": 0.075932, "end_time": "2024-03-01T16:35:39.450497", "exception": false, "start_time": "2024-03-01T16:35:39.374565", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "f5b13e76", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:39.609197Z", "iopub.status.busy": "2024-03-01T16:35:39.608914Z", "iopub.status.idle": "2024-03-01T16:35:39.637123Z", "shell.execute_reply": "2024-03-01T16:35:39.636545Z" }, "papermill": { "duration": 0.109488, "end_time": "2024-03-01T16:35:39.638521", "exception": false, "start_time": "2024-03-01T16:35:39.529033", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:39] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "cc1caf25", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:39.802846Z", "iopub.status.busy": "2024-03-01T16:35:39.802350Z", "iopub.status.idle": "2024-03-01T16:35:39.926994Z", "shell.execute_reply": "2024-03-01T16:35:39.926231Z" }, "papermill": { "duration": 0.210971, "end_time": "2024-03-01T16:35:39.928532", "exception": false, "start_time": "2024-03-01T16:35:39.717561", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "/tmp/tmp.KbiES6I0qN/Ax-main/ax/core/data.py:203: FutureWarning:\n", "\n", "Passing literal json to 'read_json' is deprecated and will be removed in a future version. To read from a literal string, wrap it in a 'StringIO' object.\n", "\n", "[INFO 03-01 16:35:39] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "58e57ee2", "metadata": { "papermill": { "duration": 0.07923, "end_time": "2024-03-01T16:35:40.089998", "exception": false, "start_time": "2024-03-01T16:35:40.010768", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "b35281b4", "metadata": { "papermill": { "duration": 0.079769, "end_time": "2024-03-01T16:35:40.250435", "exception": false, "start_time": "2024-03-01T16:35:40.170666", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "42f6b363", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:40.410135Z", "iopub.status.busy": "2024-03-01T16:35:40.409503Z", "iopub.status.idle": "2024-03-01T16:35:40.419883Z", "shell.execute_reply": "2024-03-01T16:35:40.419348Z" }, "papermill": { "duration": 0.091336, "end_time": "2024-03-01T16:35:40.421213", "exception": false, "start_time": "2024-03-01T16:35:40.329877", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:40] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "67408ab1", "metadata": { "papermill": { "duration": 0.0793, "end_time": "2024-03-01T16:35:40.580069", "exception": false, "start_time": "2024-03-01T16:35:40.500769", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "d3edac80", "metadata": { "papermill": { "duration": 0.078388, "end_time": "2024-03-01T16:35:40.737875", "exception": false, "start_time": "2024-03-01T16:35:40.659487", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "5ccc9ce0", "metadata": { "papermill": { "duration": 0.079154, "end_time": "2024-03-01T16:35:40.901531", "exception": false, "start_time": "2024-03-01T16:35:40.822377", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "333b1506", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:41.071030Z", "iopub.status.busy": "2024-03-01T16:35:41.070404Z", "iopub.status.idle": "2024-03-01T16:35:46.892096Z", "shell.execute_reply": "2024-03-01T16:35:46.891500Z" }, "papermill": { "duration": 5.907735, "end_time": "2024-03-01T16:35:46.893801", "exception": false, "start_time": "2024-03-01T16:35:40.986066", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:46] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.263516, 'x2': 0.433845, 'x3': 0.68667, 'x4': 0.26498, 'x5': 0.280186, 'x6': 0.698264} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:46] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "00a74e1f", "metadata": { "papermill": { "duration": 0.082724, "end_time": "2024-03-01T16:35:47.100981", "exception": false, "start_time": "2024-03-01T16:35:47.018257", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "e838e101", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:47.259567Z", "iopub.status.busy": "2024-03-01T16:35:47.258999Z", "iopub.status.idle": "2024-03-01T16:35:47.265456Z", "shell.execute_reply": "2024-03-01T16:35:47.264816Z" }, "papermill": { "duration": 0.085845, "end_time": "2024-03-01T16:35:47.266777", "exception": false, "start_time": "2024-03-01T16:35:47.180932", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "198187f6", "metadata": { "papermill": { "duration": 0.079333, "end_time": "2024-03-01T16:35:47.425185", "exception": false, "start_time": "2024-03-01T16:35:47.345852", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "id": "16ce1df2", "metadata": { "papermill": { "duration": 0.079784, "end_time": "2024-03-01T16:35:47.584598", "exception": false, "start_time": "2024-03-01T16:35:47.504814", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "a3af55d6", "metadata": { "papermill": { "duration": 0.079987, "end_time": "2024-03-01T16:35:47.744441", "exception": false, "start_time": "2024-03-01T16:35:47.664454", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "id": "ca81a8d6", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:47.905546Z", "iopub.status.busy": "2024-03-01T16:35:47.905085Z", "iopub.status.idle": "2024-03-01T16:35:47.916748Z", "shell.execute_reply": "2024-03-01T16:35:47.915942Z" }, "papermill": { "duration": 0.094448, "end_time": "2024-03-01T16:35:47.918454", "exception": false, "start_time": "2024-03-01T16:35:47.824006", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-01 16:35:47] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "id": "14b1c459", "metadata": { "execution": { "iopub.execute_input": "2024-03-01T16:35:48.083605Z", "iopub.status.busy": "2024-03-01T16:35:48.082968Z", "iopub.status.idle": "2024-03-01T16:35:48.087876Z", "shell.execute_reply": "2024-03-01T16:35:48.087217Z" }, "papermill": { "duration": 0.088004, "end_time": "2024-03-01T16:35:48.089214", "exception": false, "start_time": "2024-03-01T16:35:48.001210", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.9.18" }, "papermill": { "default_parameters": {}, "duration": 114.113963, "end_time": "2024-03-01T16:35:49.575736", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.KbiES6I0qN/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.KbiES6I0qN/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2024-03-01T16:33:55.461773", "version": "2.5.0" } }, "nbformat": 4, "nbformat_minor": 5 }