{ "cells": [ { "cell_type": "markdown", "id": "3e47ebf0", "metadata": { "papermill": { "duration": 0.005774, "end_time": "2024-11-13T05:08:25.314454", "exception": false, "start_time": "2024-11-13T05:08:25.308680", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "2e5b778f", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:08:25.326054Z", "iopub.status.busy": "2024-11-13T05:08:25.325585Z", "iopub.status.idle": "2024-11-13T05:08:28.186896Z", "shell.execute_reply": "2024-11-13T05:08:28.185864Z" }, "papermill": { "duration": 2.919196, "end_time": "2024-11-13T05:08:28.238808", "exception": false, "start_time": "2024-11-13T05:08:25.319612", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[ERROR 11-13 05:08:28] ax.storage.sqa_store.encoder: ATTENTION: The Ax team is considering deprecating SQLAlchemy storage. If you are currently using SQLAlchemy storage, please reach out to us via GitHub Issues here: https://github.com/facebook/Ax/issues/2975\n" ] }, { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "698e46f6", "metadata": { "papermill": { "duration": 0.049275, "end_time": "2024-11-13T05:08:28.332568", "exception": false, "start_time": "2024-11-13T05:08:28.283293", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "dd6d5aa4", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:08:28.432408Z", "iopub.status.busy": "2024-11-13T05:08:28.431885Z", "iopub.status.idle": "2024-11-13T05:08:28.436074Z", "shell.execute_reply": "2024-11-13T05:08:28.435456Z" }, "papermill": { "duration": 0.055614, "end_time": "2024-11-13T05:08:28.437385", "exception": false, "start_time": "2024-11-13T05:08:28.381771", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "324f991c", "metadata": { "papermill": { "duration": 0.050543, "end_time": "2024-11-13T05:08:28.537653", "exception": false, "start_time": "2024-11-13T05:08:28.487110", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "f3c59791", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:08:28.640891Z", "iopub.status.busy": "2024-11-13T05:08:28.640397Z", "iopub.status.idle": "2024-11-13T05:08:28.656033Z", "shell.execute_reply": "2024-11-13T05:08:28.655346Z" }, "papermill": { "duration": 0.068547, "end_time": "2024-11-13T05:08:28.657293", "exception": false, "start_time": "2024-11-13T05:08:28.588746", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:28] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "68c8f768", "metadata": { "papermill": { "duration": 0.050935, "end_time": "2024-11-13T05:08:28.758345", "exception": false, "start_time": "2024-11-13T05:08:28.707410", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "27cd9767", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:08:28.862899Z", "iopub.status.busy": "2024-11-13T05:08:28.862376Z", "iopub.status.idle": "2024-11-13T05:08:28.866488Z", "shell.execute_reply": "2024-11-13T05:08:28.865892Z" }, "papermill": { "duration": 0.058073, "end_time": "2024-11-13T05:08:28.867812", "exception": false, "start_time": "2024-11-13T05:08:28.809739", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "8930b322", "metadata": { "papermill": { "duration": 0.051235, "end_time": "2024-11-13T05:08:28.970247", "exception": false, "start_time": "2024-11-13T05:08:28.919012", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "023e453c", "metadata": { "papermill": { "duration": 0.051501, "end_time": "2024-11-13T05:08:29.073439", "exception": false, "start_time": "2024-11-13T05:08:29.021938", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "26aca8d4", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:08:29.178147Z", "iopub.status.busy": "2024-11-13T05:08:29.177561Z", "iopub.status.idle": "2024-11-13T05:10:19.499882Z", "shell.execute_reply": "2024-11-13T05:10:19.499188Z" }, "papermill": { "duration": 110.427837, "end_time": "2024-11-13T05:10:19.552877", "exception": false, "start_time": "2024-11-13T05:08:29.125040", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.068576, 'x2': 0.718234, 'x3': 0.335965, 'x4': 0.897475, 'x5': 0.601168, 'x6': 0.710612} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.014158, 0.0), 'l2norm': (1.518311, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.949338, 'x2': 0.049118, 'x3': 0.556218, 'x4': 0.320373, 'x5': 0.292361, 'x6': 0.187725} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.093541, 0.0), 'l2norm': (1.198494, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.581462, 'x2': 0.980194, 'x3': 0.132119, 'x4': 0.674815, 'x5': 0.048719, 'x6': 0.327802} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.478455, 0.0), 'l2norm': (1.371691, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.462208, 'x2': 0.256397, 'x3': 0.975449, 'x4': 0.105526, 'x5': 0.872175, 'x6': 0.836164} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.016691, 0.0), 'l2norm': (1.643737, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.336828, 'x2': 0.758475, 'x3': 0.6409, 'x4': 0.18382, 'x5': 0.883545, 'x6': 0.503031} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.201448, 0.0), 'l2norm': (1.472064, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.705866, 'x2': 0.474217, 'x3': 0.486199, 'x4': 0.596891, 'x5': 0.19162, 'x6': 0.020061} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.188604, 0.0), 'l2norm': (1.16315, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.82591, 'x2': 0.55901, 'x3': 0.827168, 'x4': 0.39866, 'x5': 0.467513, 'x6': 0.40147} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.137807, 0.0), 'l2norm': (1.489128, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.194934, 'x2': 0.204444, 'x3': 0.045483, 'x4': 0.819543, 'x5': 0.642837, 'x6': 0.88725} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.014947, 0.0), 'l2norm': (1.397845, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.187192, 'x2': 0.903279, 'x3': 0.774756, 'x4': 0.51646, 'x5': 0.33764, 'x6': 0.753606} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.209356, 0.0), 'l2norm': (1.549146, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.802279, 'x2': 0.361091, 'x3': 0.11798, 'x4': 0.202968, 'x5': 0.520776, 'x6': 0.269658} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.10929, 0.0), 'l2norm': (1.083087, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.666982, 'x2': 0.664268, 'x3': 0.693438, 'x4': 0.80162, 'x5': 0.765403, 'x6': 0.152042} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.323145, 0.0), 'l2norm': (1.618186, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.jh7tLjWjTJ/Ax-main/ax/modelbridge/cross_validation.py:464: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 11-13 05:08:29] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.282084, 'x2': 0.067387, 'x3': 0.413584, 'x4': 0.480315, 'x5': 0.065665, 'x6': 0.636843} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:29] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.849672, 0.0), 'l2norm': (0.94644, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:35] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.206254, 'x2': 0.0, 'x3': 0.298768, 'x4': 0.493777, 'x5': 0.0, 'x6': 0.702143} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:35] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.405476, 0.0), 'l2norm': (0.932, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:43] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.200045, 'x2': 0.048072, 'x3': 0.441246, 'x4': 0.472412, 'x5': 0.031725, 'x6': 0.712375} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:43] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.67418, 0.0), 'l2norm': (0.984218, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:50] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.328193, 'x2': 0.069326, 'x3': 0.450113, 'x4': 0.463215, 'x5': 0.070569, 'x6': 0.60032} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:50] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.894065, 0.0), 'l2norm': (0.946071, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:58] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.417384, 'x2': 0.0, 'x3': 0.699884, 'x4': 0.350061, 'x5': 0.085593, 'x6': 0.580207} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:08:58] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.913914, 0.0), 'l2norm': (1.063276, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:07] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.15606, 'x2': 0.0, 'x3': 0.587224, 'x4': 0.369418, 'x5': 0.081176, 'x6': 0.401662} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:07] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-0.741567, 0.0), 'l2norm': (0.820718, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:19] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.498267, 'x2': 0.05185, 'x3': 0.671262, 'x4': 0.518782, 'x5': 0.06568, 'x6': 0.668412} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:19] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-0.516029, 0.0), 'l2norm': (1.192382, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:26] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.323201, 'x2': 0.20733, 'x3': 0.556927, 'x4': 0.334392, 'x5': 0.080051, 'x6': 0.669071} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:26] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.340793, 0.0), 'l2norm': (1.011679, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:35] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.299306, 'x2': 0.252011, 'x3': 0.626811, 'x4': 0.28573, 'x5': 0.109757, 'x6': 0.855278} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:35] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.446304, 0.0), 'l2norm': (1.170971, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:44] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.291316, 'x2': 0.280218, 'x3': 0.991354, 'x4': 0.257568, 'x5': 0.128539, 'x6': 0.385291} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:44] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-0.45554, 0.0), 'l2norm': (1.173662, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:51] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.396724, 'x2': 0.37477, 'x3': 0.381043, 'x4': 0.285986, 'x5': 0.106864, 'x6': 0.787727} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:09:51] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-1.129077, 0.0), 'l2norm': (1.075527, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:00] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.216635, 'x2': 0.150787, 'x3': 0.46828, 'x4': 0.286583, 'x5': 0.114892, 'x6': 0.859544} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:00] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-1.367871, 0.0), 'l2norm': (1.059764, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:12] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.51546, 'x2': 0.196726, 'x3': 0.628195, 'x4': 0.223741, 'x5': 0.08115, 'x6': 0.861798} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:12] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-0.94263, 0.0), 'l2norm': (1.22408, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:19] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.283151, 'x2': 0.254489, 'x3': 0.533738, 'x4': 0.208122, 'x5': 0.122888, 'x6': 0.987474} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:19] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-0.915671, 0.0), 'l2norm': (1.209684, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameterization, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameterization))" ] }, { "cell_type": "markdown", "id": "69538bbb", "metadata": { "papermill": { "duration": 0.053625, "end_time": "2024-11-13T05:10:19.660387", "exception": false, "start_time": "2024-11-13T05:10:19.606762", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "8bca42ab", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:19.773702Z", "iopub.status.busy": "2024-11-13T05:10:19.773030Z", "iopub.status.idle": "2024-11-13T05:10:19.780035Z", "shell.execute_reply": "2024-11-13T05:10:19.779383Z" }, "papermill": { "duration": 0.067159, "end_time": "2024-11-13T05:10:19.781327", "exception": false, "start_time": "2024-11-13T05:10:19.714168", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "737d003a", "metadata": { "papermill": { "duration": 0.053692, "end_time": "2024-11-13T05:10:19.889011", "exception": false, "start_time": "2024-11-13T05:10:19.835319", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "aa849e39", "metadata": { "papermill": { "duration": 0.053733, "end_time": "2024-11-13T05:10:19.996851", "exception": false, "start_time": "2024-11-13T05:10:19.943118", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "c39ba6fe", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:20.106162Z", "iopub.status.busy": "2024-11-13T05:10:20.105678Z", "iopub.status.idle": "2024-11-13T05:10:20.133656Z", "shell.execute_reply": "2024-11-13T05:10:20.133084Z" }, "papermill": { "duration": 0.084164, "end_time": "2024-11-13T05:10:20.134971", "exception": false, "start_time": "2024-11-13T05:10:20.050807", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:20] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration Model(s)Trial IndexTrial StatusArm Parameterizations
0[GenerationStep_0][Sobol]0COMPLETED{'0_0': {'x1': 0.07, 'x2': 0.72, 'x3': 0.34, '...
1[GenerationStep_0][Sobol]1COMPLETED{'1_0': {'x1': 0.95, 'x2': 0.05, 'x3': 0.56, '...
2[GenerationStep_0][Sobol]2COMPLETED{'2_0': {'x1': 0.58, 'x2': 0.98, 'x3': 0.13, '...
3[GenerationStep_0][Sobol]3COMPLETED{'3_0': {'x1': 0.46, 'x2': 0.26, 'x3': 0.98, '...
4[GenerationStep_0][Sobol]4COMPLETED{'4_0': {'x1': 0.34, 'x2': 0.76, 'x3': 0.64, '...
5[GenerationStep_0][Sobol]5COMPLETED{'5_0': {'x1': 0.71, 'x2': 0.47, 'x3': 0.49, '...
6[GenerationStep_0][Sobol]6COMPLETED{'6_0': {'x1': 0.83, 'x2': 0.56, 'x3': 0.83, '...
7[GenerationStep_0][Sobol]7COMPLETED{'7_0': {'x1': 0.19, 'x2': 0.2, 'x3': 0.05, 'x...
8[GenerationStep_0][Sobol]8COMPLETED{'8_0': {'x1': 0.19, 'x2': 0.9, 'x3': 0.77, 'x...
9[GenerationStep_0][Sobol]9COMPLETED{'9_0': {'x1': 0.8, 'x2': 0.36, 'x3': 0.12, 'x...
10[GenerationStep_0][Sobol]10COMPLETED{'10_0': {'x1': 0.67, 'x2': 0.66, 'x3': 0.69, ...
11[GenerationStep_0][Sobol]11COMPLETED{'11_0': {'x1': 0.28, 'x2': 0.07, 'x3': 0.41, ...
12[GenerationStep_1][BoTorch]12COMPLETED{'12_0': {'x1': 0.21, 'x2': 0.0, 'x3': 0.3, 'x...
13[GenerationStep_1][BoTorch]13COMPLETED{'13_0': {'x1': 0.2, 'x2': 0.05, 'x3': 0.44, '...
14[GenerationStep_1][BoTorch]14COMPLETED{'14_0': {'x1': 0.33, 'x2': 0.07, 'x3': 0.45, ...
15[GenerationStep_1][BoTorch]15COMPLETED{'15_0': {'x1': 0.42, 'x2': 0.0, 'x3': 0.7, 'x...
16[GenerationStep_1][BoTorch]16COMPLETED{'16_0': {'x1': 0.16, 'x2': 0.0, 'x3': 0.59, '...
17[GenerationStep_1][BoTorch]17COMPLETED{'17_0': {'x1': 0.5, 'x2': 0.05, 'x3': 0.67, '...
18[GenerationStep_1][BoTorch]18COMPLETED{'18_0': {'x1': 0.32, 'x2': 0.21, 'x3': 0.56, ...
19[GenerationStep_1][BoTorch]19COMPLETED{'19_0': {'x1': 0.3, 'x2': 0.25, 'x3': 0.63, '...
20[GenerationStep_1][BoTorch]20COMPLETED{'20_0': {'x1': 0.29, 'x2': 0.28, 'x3': 0.99, ...
21[GenerationStep_1][BoTorch]21COMPLETED{'21_0': {'x1': 0.4, 'x2': 0.37, 'x3': 0.38, '...
22[GenerationStep_1][BoTorch]22COMPLETED{'22_0': {'x1': 0.22, 'x2': 0.15, 'x3': 0.47, ...
23[GenerationStep_1][BoTorch]23COMPLETED{'23_0': {'x1': 0.52, 'x2': 0.2, 'x3': 0.63, '...
24[GenerationStep_1][BoTorch]24COMPLETED{'24_0': {'x1': 0.28, 'x2': 0.25, 'x3': 0.53, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model(s) Trial Index Trial Status \\\n", "0 [GenerationStep_0] [Sobol] 0 COMPLETED \n", "1 [GenerationStep_0] [Sobol] 1 COMPLETED \n", "2 [GenerationStep_0] [Sobol] 2 COMPLETED \n", "3 [GenerationStep_0] [Sobol] 3 COMPLETED \n", "4 [GenerationStep_0] [Sobol] 4 COMPLETED \n", "5 [GenerationStep_0] [Sobol] 5 COMPLETED \n", "6 [GenerationStep_0] [Sobol] 6 COMPLETED \n", "7 [GenerationStep_0] [Sobol] 7 COMPLETED \n", "8 [GenerationStep_0] [Sobol] 8 COMPLETED \n", "9 [GenerationStep_0] [Sobol] 9 COMPLETED \n", "10 [GenerationStep_0] [Sobol] 10 COMPLETED \n", "11 [GenerationStep_0] [Sobol] 11 COMPLETED \n", "12 [GenerationStep_1] [BoTorch] 12 COMPLETED \n", "13 [GenerationStep_1] [BoTorch] 13 COMPLETED \n", "14 [GenerationStep_1] [BoTorch] 14 COMPLETED \n", "15 [GenerationStep_1] [BoTorch] 15 COMPLETED \n", "16 [GenerationStep_1] [BoTorch] 16 COMPLETED \n", "17 [GenerationStep_1] [BoTorch] 17 COMPLETED \n", "18 [GenerationStep_1] [BoTorch] 18 COMPLETED \n", "19 [GenerationStep_1] [BoTorch] 19 COMPLETED \n", "20 [GenerationStep_1] [BoTorch] 20 COMPLETED \n", "21 [GenerationStep_1] [BoTorch] 21 COMPLETED \n", "22 [GenerationStep_1] [BoTorch] 22 COMPLETED \n", "23 [GenerationStep_1] [BoTorch] 23 COMPLETED \n", "24 [GenerationStep_1] [BoTorch] 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.07, 'x2': 0.72, 'x3': 0.34, '... \n", "1 {'1_0': {'x1': 0.95, 'x2': 0.05, 'x3': 0.56, '... \n", "2 {'2_0': {'x1': 0.58, 'x2': 0.98, 'x3': 0.13, '... \n", "3 {'3_0': {'x1': 0.46, 'x2': 0.26, 'x3': 0.98, '... \n", "4 {'4_0': {'x1': 0.34, 'x2': 0.76, 'x3': 0.64, '... \n", "5 {'5_0': {'x1': 0.71, 'x2': 0.47, 'x3': 0.49, '... \n", "6 {'6_0': {'x1': 0.83, 'x2': 0.56, 'x3': 0.83, '... \n", "7 {'7_0': {'x1': 0.19, 'x2': 0.2, 'x3': 0.05, 'x... \n", "8 {'8_0': {'x1': 0.19, 'x2': 0.9, 'x3': 0.77, 'x... \n", "9 {'9_0': {'x1': 0.8, 'x2': 0.36, 'x3': 0.12, 'x... \n", "10 {'10_0': {'x1': 0.67, 'x2': 0.66, 'x3': 0.69, ... \n", "11 {'11_0': {'x1': 0.28, 'x2': 0.07, 'x3': 0.41, ... \n", "12 {'12_0': {'x1': 0.21, 'x2': 0.0, 'x3': 0.3, 'x... \n", "13 {'13_0': {'x1': 0.2, 'x2': 0.05, 'x3': 0.44, '... \n", "14 {'14_0': {'x1': 0.33, 'x2': 0.07, 'x3': 0.45, ... \n", "15 {'15_0': {'x1': 0.42, 'x2': 0.0, 'x3': 0.7, 'x... \n", "16 {'16_0': {'x1': 0.16, 'x2': 0.0, 'x3': 0.59, '... \n", "17 {'17_0': {'x1': 0.5, 'x2': 0.05, 'x3': 0.67, '... \n", "18 {'18_0': {'x1': 0.32, 'x2': 0.21, 'x3': 0.56, ... \n", "19 {'19_0': {'x1': 0.3, 'x2': 0.25, 'x3': 0.63, '... \n", "20 {'20_0': {'x1': 0.29, 'x2': 0.28, 'x3': 0.99, ... \n", "21 {'21_0': {'x1': 0.4, 'x2': 0.37, 'x3': 0.38, '... \n", "22 {'22_0': {'x1': 0.22, 'x2': 0.15, 'x3': 0.47, ... \n", "23 {'23_0': {'x1': 0.52, 'x2': 0.2, 'x3': 0.63, '... \n", "24 {'24_0': {'x1': 0.28, 'x2': 0.25, 'x3': 0.53, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "6a0cecc3", "metadata": { "papermill": { "duration": 0.054094, "end_time": "2024-11-13T05:10:20.243059", "exception": false, "start_time": "2024-11-13T05:10:20.188965", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "973fe3bd", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:20.353387Z", "iopub.status.busy": "2024-11-13T05:10:20.352782Z", "iopub.status.idle": "2024-11-13T05:10:20.709583Z", "shell.execute_reply": "2024-11-13T05:10:20.708909Z" }, "papermill": { "duration": 0.413883, "end_time": "2024-11-13T05:10:20.711269", "exception": false, "start_time": "2024-11-13T05:10:20.297386", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.2993061269648042,\n", " 'x2': 0.25201071586372265,\n", " 'x3': 0.6268109946515383,\n", " 'x4': 0.2857295958491197,\n", " 'x5': 0.10975727956764317,\n", " 'x6': 0.8552776686032254}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "057c073c", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:20.867727Z", "iopub.status.busy": "2024-11-13T05:10:20.867385Z", "iopub.status.idle": "2024-11-13T05:10:20.872096Z", "shell.execute_reply": "2024-11-13T05:10:20.871405Z" }, "papermill": { "duration": 0.062068, "end_time": "2024-11-13T05:10:20.873393", "exception": false, "start_time": "2024-11-13T05:10:20.811325", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -1.446300876538848, 'l2norm': 1.1709792391324942}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "14d636de", "metadata": { "papermill": { "duration": 0.053726, "end_time": "2024-11-13T05:10:20.981703", "exception": false, "start_time": "2024-11-13T05:10:20.927977", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "0d38d56c", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:21.093346Z", "iopub.status.busy": "2024-11-13T05:10:21.092827Z", "iopub.status.idle": "2024-11-13T05:10:21.097317Z", "shell.execute_reply": "2024-11-13T05:10:21.096667Z" }, "papermill": { "duration": 0.061582, "end_time": "2024-11-13T05:10:21.098681", "exception": false, "start_time": "2024-11-13T05:10:21.037099", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "5f9820b8", "metadata": { "papermill": { "duration": 0.054677, "end_time": "2024-11-13T05:10:21.208271", "exception": false, "start_time": "2024-11-13T05:10:21.153594", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "272d0572", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:21.319470Z", "iopub.status.busy": "2024-11-13T05:10:21.318970Z", "iopub.status.idle": "2024-11-13T05:10:21.853682Z", "shell.execute_reply": "2024-11-13T05:10:21.853023Z" }, "papermill": { "duration": 0.595881, "end_time": "2024-11-13T05:10:21.858834", "exception": false, "start_time": "2024-11-13T05:10:21.262953", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:21] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.45737628022511384, -0.4973094687456171, -0.5384926846734875, -0.5802580557431288, -0.6218614991761805, -0.6625018655729175, -0.7013438860918787, -0.7375440803829069, -0.7702785643918465, -0.7987715313629367, -0.8223230804935957, -0.8403350458275466, -0.8523335378700936, -0.8579870509088791, -0.857119202919979, -0.8497154493993757, -0.8359234299375293, -0.8160469459295538, -0.7905339068384509, -0.7599588983328369, -0.7250012977023116, -0.6864200729982068, -0.6450265399238572, -0.6016564078212788, -0.5571424223909279, -0.5122888131074553, -0.4678485879308747, -0.4245045012886808, -0.3828542706624217, -0.34340035100909183, -0.30654431304304763, -0.2725856278688949, -0.24172445061600623, -0.2140678300234669, -0.18963865574513228, -0.168386592714044, -0.15020024053595005, -0.13491979050765202, -0.12234952578363983, -0.11226961199841207, -0.10444674600774373, -0.09864335908581656, -0.09462519843954886, -0.0921672291924826, -0.09105790175370565, -0.09110191242813814, -0.09212164597288636, -0.09395752717799094, -0.09646752569245859, -0.09952605675080656 ], [ -0.46878044719123974, -0.5096669878045282, -0.5517855201256412, -0.5944522145487072, -0.6369065247514535, -0.6783307866307507, -0.7178736567065486, -0.7546765283618697, -0.7879018437204499, -0.816762052040946, -0.8405478667376557, -0.8586544526700901, -0.8706042379172207, -0.8760651885864126, -0.8748636038936751, -0.8669907686795696, -0.85260312381336, -0.8320159603007953, -0.8056909873314162, -0.7742184450634237, -0.7382947086524136, -0.6986965434496412, -0.6562533098647221, -0.611818473289769, -0.5662417490060382, -0.5203431093687338, -0.47488971130098934, -0.43057658094516127, -0.3880116367835611, -0.3477053615368288, -0.3100651653438075, -0.27539423515938444, -0.24389445220949219, -0.2156727912949768, -0.19075049918553127, -0.16907428650673778, -0.15052875663401966, -0.1349493309722981, -0.12213500475890143, -0.11186037154575557, -0.10388647731785283, -0.0979701963516062, -0.09387195078164162, -0.09136171621515599, -0.09022336022289174, -0.09025744479718045, -0.09128268561345942, -0.09313629979522225, -0.09567349114854001, -0.09876632008367708 ], [ -0.4797097295508047, -0.5214783236729963, -0.5644583942764162, -0.6079513248553498, -0.6511814183476721, -0.6933159182362219, -0.7334888983014973, -0.7708281417207293, -0.8044839078214339, -0.8336583170538769, -0.8576339862757352, -0.8758005274376908, -0.8876775879269985, -0.8929332587715142, -0.8913969000287318, -0.8830657176144163, -0.8681047543781938, -0.8468403087925572, -0.8197471438401376, -0.7874301733394412, -0.7506015917890247, -0.7100546292098511, -0.666635251757031, -0.621213185220968, -0.5746536113040477, -0.5277907811245355, -0.48140461749424635, -0.4362011521306183, -0.39279738395626174, -0.35171086919176753, -0.3133540820045103, -0.27803333331146773, -0.2459518193629397, -0.21721620165363376, -0.1918460020146393, -0.1697850336333569, -0.1509140783899881, -0.13506405797187232, -0.12202902271485078, -0.11157838821670457, -0.10346797481811737, -0.09744953844931992, -0.0932786133246532, -0.0907206092059008, -0.08955521198227523, -0.08957922173768434, -0.09060802499598891, -0.09247593710296231, -0.09503566804506913, -0.09815716305920824 ], [ -0.490096922659688, -0.5326709323996239, -0.5764335525502751, -0.6206726389466635, -0.6645987475742653, -0.7073655424696755, -0.7480940942828691, -0.7859001740502876, -0.8199234229289871, -0.8493571103922848, -0.8734770954081343, -0.8916685876343051, -0.9034493733323863, -0.9084883220159452, -0.9066182170259952, -0.8978422426658148, -0.8823337937681011, -0.8604296287014593, -0.8326167402133768, -0.7995136466663896, -0.7618470876810636, -0.7204253251723998, -0.6761093905038806, -0.6297836741471916, -0.5823272252605749, -0.5345870205120138, -0.48735428520842194, -0.4413447205821267, -0.3971832270545082, -0.35539343388904454, -0.316392070049531, -0.28048795677385113, -0.247885183930243, -0.21868986043584326, -0.1929197104195865, -0.170515723579719, -0.15135505840814167, -0.1352644351976378, -0.12203333385491716, -0.11142641954759275, -0.10319474630515102, -0.09708542412318638, -0.09284956898947172, -0.09024847913420742, -0.08905808817132399, -0.0890718322146214, -0.09010213121742289, -0.09198072436753296, -0.09455811673565118, -0.09770239221748717 ], [ -0.49987739564892614, -0.5431752433470577, -0.5876366289547438, -0.6325372223746162, -0.6770753202742741, -0.7203926031053343, -0.7615987974858403, -0.7997993339704362, -0.8341248654391473, -0.8637613428979463, -0.8879792481890105, -0.9061605671846906, -0.9178221570980192, -0.9226343159611863, -0.9204335931543135, -0.9112291732951399, -0.8952025031259019, -0.8727001900941793, -0.8442205582357456, -0.8103945780206352, -0.7719621703671778, -0.7297451031570863, -0.684617838487936, -0.6374777437491406, -0.5892160489161088, -0.5406908218891227, -0.49270305437733664, -0.44597671819498474, -0.4011433842522656, -0.35873171366169054, -0.31916185163791866, -0.2827444978990863, -0.2496842067793713, -0.22008629710671074, -0.19396663264195746, -0.17126347066453013, -0.15185056714014666, -0.13555076627981222, -0.12214938190688135, -0.11140678778556695, -0.10306976297848591, -0.09688127551535114, -0.09258852316423549, -0.08994917539254077, -0.08873586909840209, -0.08873909793002627, -0.08976869868562387, -0.09165417809214393, -0.09424414060049674, -0.09740507545040955 ], [ -0.5089897295159181, -0.552925346348261, -0.59799738100205, -0.6434707345486268, -0.6885330078689407, -0.7323155679916565, -0.7739185270927602, -0.8124387113632567, -0.8469994715869134, -0.8767810189647293, -0.9010498732995476, -0.9191859963315816, -0.9307062553425123, -0.9352830193898594, -0.9327569245933536, -0.9231431417701557, -0.9066308204986335, -0.883575746005595, -0.8544866050320965, -0.820005590151456, -0.7808843570988483, -0.7379565685296949, -0.6921083974096938, -0.6442484171490379, -0.5952782732189965, -0.5460654181235476, -0.49741900952706275, -0.45006983570229386, -0.40465486181634147, -0.3617067047833388, -0.321648063049943, -0.28479086853795366, -0.2513397058464944, -0.22139886963971844, -0.19498231147923312, -0.1720256643177147, -0.15239952439583304, -0.13592321074154656, -0.12237830345378664, -0.11152137323322209, -0.10309544512996877, -0.0968398782262459, -0.09249847986613952, -0.08982579950990727, -0.08859165669677421, -0.08858404547629051, -0.08961062171474465, -0.09149901961559548, -0.09409626105234953, -0.09726751868649502 ], [ -0.5173763288861628, -0.5618596485552305, -0.6074503901873726, -0.6534041706483421, -0.6988995257647577, -0.7430592442796076, -0.7849756143107138, -0.8237386484843552, -0.8584661284085743, -0.8883341412972106, -0.9126066861887246, -0.9306629145109, -0.9420206442025452, -0.9463549463762024, -0.9435108403525885, -0.9335094326564887, -0.9165471791556661, -0.8929883144027575, -0.8633508541595243, -0.8282869120236854, -0.7885583571519212, -0.7450090592278107, -0.6985351062076086, -0.6500544332240075, -0.6004772670126102, -0.5506786752591999, -0.5014743257795291, -0.4536003222402424, -0.40769770993038584, -0.36430195692108214, -0.3238374325113817, -0.2866166440517336, -0.25284376993361124, -0.22262185169260001, -0.195962888351856, -0.17280001340746814, -0.15300092710265412, -0.1363817981269108, -0.12272093110221094, -0.11177160884775694, -0.10327365027656804, -0.09696336479818829, -0.09258172211692345, -0.08988068369975755, -0.08862775228474828, -0.08860888413054091, -0.08962997298257697, -0.09151715469322808, -0.09411619855839959, -0.09729124855161675 ], [ -0.5249839991450684, -0.5699214920580212, -0.6159357184971835, -0.6622745547565133, -0.7081091601794476, -0.7525555353625186, -0.7946999852358658, -0.8336275440089382, -0.8684521937479561, -0.8983475412679511, -0.9225765238897609, -0.9405187035688849, -0.951693785348788, -0.9557801580821188, -0.9526274945378042, -0.9422627500745174, -0.9248892447968848, -0.9008788808448032, -0.8707579098412805, -0.8351870014336082, -0.7949366503614684, -0.7508591785028068, -0.7038587270474042, -0.6548606856153902, -0.604781969531404, -0.554503439604828, -0.5048455722098089, -0.4565482471412256, -0.410255245495433, -0.36650375982917227, -0.32571893388947804, -0.2882131872547052, -0.25418985619405754, -0.22375050690904696, -0.19690515760465327, -0.17358458357917095, -0.15365387252898027, -0.13692643973040264, -0.12317779609136842, -0.1121584758411735, -0.10360566359692958, -0.09725320157076178, -0.09283979654677449, -0.09011537430452121, -0.08884563972439952, -0.0888149894041636, -0.08982798797361624, -0.09170965918590945, -0.09430485980036174, -0.097477001120226 ], [ -0.5317644810667059, -0.5770597238381134, -0.623399511968407, -0.6700255747176606, -0.7161034314149972, -0.7607441291241583, -0.8030298701243871, -0.8420425789177026, -0.87689423396599, -0.9067576233614301, -0.9308960909075881, -0.9486908297050993, -0.9596643586085922, -0.963498980806527, -0.9600492648050694, -0.9493478918693212, -0.9316045611764234, -0.9071980118053795, -0.8766615848057706, -0.8406630848042911, -0.7999799869661569, -0.7554712535712719, -0.7080471621980472, -0.6586385978829659, -0.6081672244842243, -0.557517831941678, -0.5075139678539479, -0.4588977198258999, -0.4123142383209544, -0.36830129850440474, -0.32728391364886733, -0.2895737501008922, -0.2553728695028119, -0.22478114888304246, -0.19780660987707388, -0.1743778266976524, -0.15435757628125873, -0.13755693742083575, -0.12374912998604776, -0.1126825000452924, -0.10409219053021973, -0.09771017883871119, -0.09327350221029773, -0.09053062015721192, -0.08924597402286616, -0.08920289240446783, -0.09020505546964869, -0.09207677091756467, -0.09466233102757199, -0.09782471680340427 ], [ -0.5376749356295419, -0.5832292102522789, -0.6297945430217323, -0.676608150002231, -0.7228316844507042, -0.7675731080058781, -0.8099124292702364, -0.8489303541702885, -0.8837386691121956, -0.9135110133420317, -0.9375126057643319, -0.9551274837505852, -0.965881891400038, -0.9694626201595585, -0.965729347109884, -0.9547203211027657, -0.9366510949122051, -0.911906369842512, -0.8810253833761976, -0.8446816063046567, -0.8036578014346119, -0.7588177133972246, -0.7110757955764404, -0.661366429150072, -0.6106140506299461, -0.5597054843019841, -0.5094655863466407, -0.4606370642762078, -0.41386505766140447, -0.3696867741976335, -0.32852618886515095, -0.29069355127808266, -0.25638922220128113, -0.2257111855637124, -0.19866546357077702, -0.17517860163601306, -0.15511138449913453, -0.13827298913333513, -0.12443486514834906, -0.11334374883242981, -0.10473335140173912, -0.09833440423130235, -0.09388288357179975, -0.09112636584228284, -0.08982857537259575, -0.08977227501066476, -0.090760714089553, -0.09261788769797497, -0.09518787759193914, -0.09833354135304917 ], [ -0.5426783723988924, -0.588391289010274, -0.635080684138704, -0.6819809247814953, -0.7282515987330673, -0.7729994724833994, -0.8153042868420115, -0.854247431332978, -0.8889423165961741, -0.918565101115538, -0.9423843391657192, -0.9597881108002808, -0.9703072761148104, -0.9736336626781777, -0.9696322383047908, -0.9583466267112566, -0.9399976716636764, -0.9149751231796898, -0.8838228827921162, -0.8472185797198191, -0.8059485341689302, -0.7608793799816783, -0.7129277538250667, -0.6630295055906887, -0.6121098446756404, -0.5610557156138192, -0.5106915059304356, -0.46175894525324396, -0.41490177665677475, -0.3706554892041079, -0.32944211455057926, -0.29156982826185235, -0.2572368730337866, -0.2265391471490087, -0.19948068366171173, -0.17598618582633763, -0.15591477980345497, -0.13907419069772498, -0.1252346337462723, -0.11414182841867265, -0.10552867795301785, -0.0991252992262327, -0.09466722759555568, -0.09190174980367277, -0.09059242858267552, -0.09052197081446317, -0.09149365482251748, -0.09333157144623327, -0.095879949589886, -0.09900183289667186 ], [ -0.5467440156595648, -0.5925141524985607, -0.6392253064271395, -0.6861106794792191, -0.7323296101844758, -0.7769895707702071, -0.8191719653341714, -0.8579607687010564, -0.8924728258341724, -0.9218884707450745, -0.9454810362871748, -0.9626438217880945, -0.9729131681786005, -0.9759864578003907, -0.971734099736247, -0.9602048667548211, -0.9416242974145262, -0.9163862437772388, -0.8850380072093075, -0.8482598379055608, -0.8068398563175136, -0.7616456687976267, -0.7135940829671843, -0.6636203742044344, -0.6126485133342459, -0.561563643425234, -0.5111879024061975, -0.46226044416410206, -0.41542223289062874, -0.3712058939284806, -0.33003061904196346, -0.2922018628053674, -0.2579153444488004, -0.22726469681090694, -0.20025198734254246, -0.17680027717647812, -0.15676738069676416, -0.13996003377764132, -0.12614776512978415, -0.11507588142063885, -0.10647711167387397, -0.10008159871084127, -0.09562506485994637, -0.09285510721795825, -0.09153568781297083, -0.09144997172723324, -0.09240172944473396, -0.09421555829211647, -0.09673619347584267, -0.09982717485558984 ], [ -0.5498476033857743, -0.5955731572966386, -0.6422035977054015, -0.6889726552431765, -0.7350412397184174, -0.7795194289154042, -0.8214922147186894, -0.8600480469601615, -0.8943089979144128, -0.9234612117062073, -0.9467842173465462, -0.9636776812937367, -0.9736842592381557, -0.9765073748425216, -0.9720229967124661, -0.9602847893842577, -0.941522360265852, -0.9161326895968295, -0.8846651903923097, -0.8478011761616728, -0.8063287943563728, -0.7611146953533056, -0.7130738379409074, -0.663138876489996, -0.6122305324484415, -0.5612302298944576, -0.5109560834729951, -0.46214308326651415, -0.41542804397287325, -0.3713395953271825, -0.3302932067256056, -0.2925909792887284, -0.25842571781507107, -0.22788862390707554, -0.20097983623501098, -0.1776209861585561, -0.15766893427119338, -0.14092989980963294, -0.12717328148510126, -0.11614458458703314, -0.10757700385937402, -0.1012013535080909, -0.09675417460213381, -0.0939839775247806, -0.09265568648644917, -0.09255344011131816, -0.0934819646594065, -0.0952667744784304, -0.09775346945522972, -0.10080639454151308 ], [ -0.5519716151218892, -0.5975510558142496, -0.6439987959132283, -0.6905507870509806, -0.736371323912131, -0.7805749769146277, -0.8222522319155768, -0.8604978800374061, -0.894440985996656, -0.9232751071925551, -0.9462873524003365, -0.9628848676711831, -0.972617421742634, -0.9751949314464483, -0.9704990105263425, -0.9585879284420492, -0.9396947098971902, -0.9142184684647722, -0.8827094247557212, -0.8458483874294387, -0.8044217525884634, -0.7592932862694572, -0.7113740836231018, -0.6615921408397087, -0.6108629321998374, -0.5600622612446954, -0.5100024638173275, -0.4614127977138782, -0.4149245777736563, -0.3710613264595831, -0.33023392791744377, -0.29274051581537897, -0.2587706064931866, -0.22841281965755267, -0.20166541517515385, -0.17844881808441027, -0.15861930224087323, -0.1419830499524864, -0.12830989176337576, -0.11734614668155313, -0.10882611734453324, -0.1024819357937709, -0.09805159359194493, -0.09528511648514243, -0.09394895222295602, -0.09382872625299798, -0.09473058175408883, -0.09648135783765849, -0.0989278744127805, -0.10193558717337892 ], [ -0.5531054258988533, -0.5984381471266058, -0.6446023349033182, -0.690837842507364, -0.7363141449232329, -0.7801521679763344, -0.8214497678062728, -0.8593099084725835, -0.8928703739053521, -0.921333697080804, -0.9439959081395252, -0.9602727034565248, -0.9697217230697152, -0.9720597918475331, -0.9671742215883323, -0.9551275724562216, -0.9361556136559201, -0.9106585826894549, -0.8791861960954138, -0.8424171888284792, -0.8011344332365339, -0.7561968946909807, -0.708509807291768, -0.6589944937149612, -0.6085592085565136, -0.558072260912378, -0.508338481239209, -0.46007985577047517, -0.4139208776650964, -0.3703788775173288, -0.3298593162676532, -0.29265576841328983, -0.2589541070988646, -0.2288402355929675, -0.20231059784134353, -0.17928464579611858, -0.15961844048123547, -0.14311861118087282, -0.12955598396830348, -0.11867830655194073, -0.11022162990270262, -0.10392004734378102, -0.09951362872926506, -0.0967545126205438, -0.09541122660980489, -0.09527139095901449, -0.09614302152825066, -0.09785468457143354, -0.10025477008507028, -0.10321014500833181 ], [ -0.5532453844075192, -0.5982323452795912, -0.6440139009605305, -0.6898354647787042, -0.7348734582179354, -0.7782569896543385, -0.819093120663056, -0.8564947743611675, -0.8896101321596406, -0.9176522149992132, -0.9399272663353133, -0.9558605559131219, -0.9650183092592735, -0.9671246352242158, -0.9620725641181394, -0.9499286076502915, -0.9309305900558204, -0.9054788553525768, -0.8741213050474913, -0.8375330406670958, -0.7964916553375943, -0.7518494212925091, -0.7045037438160207, -0.6553672909000755, -0.605339162245496, -0.5552783376465044, -0.5059804550278793, -0.4581587283509379, -0.4124295438544884, -0.3693029893356782, -0.32917829460643167, -0.2923439091653351, -0.2589817296868189, -0.22917482540608497, -0.20291789975999064, -0.18012967321095763, -0.16066637242185583, -0.1443355587809616, -0.13090961597591283, -0.12013833147930109, -0.11176013932842133, -0.10551173056513252, -0.10113587325790552, -0.0983874078718695, -0.09703748960072617, -0.09687623302749843, -0.09771397420777045, -0.09938140102178367, -0.10172881614458917, -0.10462479123843837 ], [ -0.5523948147711965, -0.5969391645551819, -0.6422413997104877, -0.6875541195196451, -0.7320624181779898, -0.7749053671418027, -0.8152010165298409, -0.8520739786523053, -0.8846844524742543, -0.9122574007826546, -0.9341105154598621, -0.9496796094693736, -0.9585401603237385, -0.9604238962915841, -0.9552295547263209, -0.9430272374418907, -0.9240561222693076, -0.8987156409394963, -0.8675505779893395, -0.8312308606579428, -0.7905270751574849, -0.7462829435540083, -0.6993861161803079, -0.650738671347594, -0.6012286676481827, -0.5517039708241572, -0.5029493887047445, -0.4556679098429789, -0.41046657260171676, -0.36784721100871415, -0.32820205068034847, -0.2918138795468162, -0.2588603079650887, -0.22942147115386602, -0.20349041948036223, -0.18098539036482092, -0.16176315679865383, -0.14563269562558318, -0.13236850514623194, -0.12172301596013896, -0.1134376702605584, -0.10725238228036788, -0.10291322648980888, -0.10017832230597218, -0.09882198831473954, -0.0986373213175471, -0.09943741403185202, -0.10105546008892735, -0.10334400782690534, -0.10617361826836691 ], [ -0.5505639423846539, -0.5945716224067846, -0.6393008343919548, -0.6840129470500287, -0.7279034031433108, -0.7701229605926311, -0.8098023787341552, -0.8460796232945692, -0.8781284635301063, -0.9051871914058782, -0.9265861188476425, -0.9417725136639477, -0.9503317209693745, -0.9520033821582937, -0.9466918990525386, -0.9344705827035265, -0.9155792559514025, -0.8904154246685831, -0.8595194717222022, -0.8235546376170677, -0.783282812303789, -0.7395373573494046, -0.693194295219169, -0.6451432372973346, -0.5962593750844972, -0.5473777362136711, -0.4992707201178304, -0.4526296929422573, -0.4080511557905911, -0.366027723819356, -0.3269438847354954, -0.2910762606788943, -0.2585978910110581, -0.2295858950557777, -0.2040317689524987, -0.1818535207912086, -0.16290885042132308, -0.14700862871954046, -0.13393001706818258, -0.12342868112889749, -0.1152496828352701, -0.10913677025131274, -0.10483991693575923, -0.10212108268947134, -0.10075826999001564, -0.10054803111938043, -0.1013066381715857, -0.10287016192168302, -0.10509371770252213, -0.10785012995903626 ], [ -0.5477697453948634, -0.5911500619720919, -0.6352160977538011, -0.6792395224122538, -0.7224277429003647, -0.7639448598647759, -0.8029359903068843, -0.838554042378679, -0.8699878325196646, -0.8964902952321143, -0.9174054645357319, -0.9321929120009425, -0.9404484123524859, -0.9419197712451416, -0.9365169823822463, -0.9243161687779322, -0.9055570874044347, -0.8806343164915139, -0.8500825778180183, -0.8145569503905443, -0.7748089870970774, -0.7316599361830712, -0.6859723836365852, -0.6386216654527727, -0.5904683509553199, -0.5423329763237421, -0.4949740226836293, -0.44906990094773397, -0.4052054439552303, -0.3638631342433475, -0.32541903137425354, -0.29014312260570974, -0.2582036182941611, -0.2296745584091746, -0.2045459943650652, -0.18273596224986582, -0.16410346674900916, -0.14846174360873166, -0.13559115385328607, -0.12525117507915734, -0.11719108328910616, -0.11115905244318985, -0.10690952874163384, -0.10420885474276648, -0.10283921883436353, -0.10260108450872224, -0.10331430961791094, -0.10481819848325924, -0.10697074117095862, -0.10964728739820745 ], [ -0.544035734469767, -0.5867018972258284, -0.6300186810740219, -0.6732695272546882, -0.7156753530163491, -0.7564151815384684, -0.7946500546064126, -0.8295493279996484, -0.8603182585892784, -0.8862256560646102, -0.9066303035941432, -0.9210048588007935, -0.9289560321763861, -0.9302400017318422, -0.9247722518065278, -0.9126313068462089, -0.8940561496505417, -0.8694374472366493, -0.8393030339467427, -0.8042983991118147, -0.7651631760386288, -0.722704814601486, -0.6777707304873901, -0.6312202550106488, -0.5838976611334484, -0.5366074203065382, -0.49009266231319015, -0.44501758162097393, -0.4019542764358981, -0.36137423928267054, -0.3236444585371808, -0.28902785506182743, -0.2576875801094034, -0.22969454938806322, -0.20503748889796847, -0.18363472197559694, -0.1653469311878617, -0.14999017733684394, -0.13734854245835615, -0.12718587438513462, -0.11925623665906332, -0.11331279904310443, -0.10911503133175399, -0.10643417888200574, -0.10505709650313205, -0.10478859435442062, -0.10545250365980513, -0.1068917015771223, -0.1089673452362625, -0.11155755774107051 ], [ -0.5393916645160383, -0.5812612849255933, -0.6237473049632121, -0.6661463387225026, -0.7076942817211719, -0.7475865744250529, -0.7850016608601871, -0.8191267580230638, -0.8491848657997618, -0.8744618150149933, -0.8943320853004284, -0.9082821326818813, -0.9159300519791791, -0.9170405585267158, -0.9115344989909199, -0.8994923787110184, -0.8811517053959047, -0.8568982757287485, -0.8272518507977875, -0.7928469571200917, -0.7544097933642411, -0.7127324033789326, -0.6686453832870229, -0.6229904192444004, -0.576593903813711, -0.530242759120035, -0.484663415215262, -0.4405046672908653, -0.3983248828427037, -0.35858376781834234, -0.32163864683162546, -0.28774498250784136, -0.2570606657837368, -0.2296534617019737, -0.20551089901309927, -0.18455184774991645, -0.1666390341250082, -0.1515917907079964, -0.139198423570074, -0.12922768716005256, -0.12143898174709516, -0.11559101725658211, -0.11144881216227076, -0.10878900925208451, -0.10740358592653243, -0.10710211163699024, -0.10771275756084803, -0.10908229390455565, -0.11107532011039034, -0.11357296565192082 ], [ -0.533873182947386, -0.5748687285118059, -0.6164474776876251, -0.657920541671577, -0.6985401762306779, -0.7375196410250369, -0.7740561626247502, -0.8073561342657991, -0.8366615045815907, -0.8612761795779588, -0.88059119889948, -0.8941074566959033, -0.9014548218418987, -0.9024066691152371, -0.8968890539526266, -0.884984035353609, -0.8669269571221038, -0.8430978169167653, -0.8140071643482214, -0.7802772529439372, -0.7426194076778927, -0.7018087450074075, -0.6586574857723839, -0.6139881281227212, -0.5686076987380432, -0.5232841822857373, -0.4787260523283132, -0.4355656063753115, -0.394346560430471, -0.3555161020366797, -0.31942135273683087, -0.28630996646913254, -0.2563344022286924, -0.22955926626235867, -0.2059710260417294, -0.1854893562027255, -0.16797938279204372, -0.15326414067053157, -0.14113664162345202, -0.13137105801286914, -0.12373264853044064, -0.1179861789113203, -0.11390271248692779, -0.11126475584906548, -0.10986983820116691, -0.1095326757272394, -0.11008612303348475, -0.11138114271711941, -0.11328603318338576, -0.11568514687172754 ], [ -0.5275214199553968, -0.5675706200304739, -0.6081709877093678, -0.6486493715348396, -0.6882756764651926, -0.7262822834964207, -0.7618864783033803, -0.7943150407685282, -0.8228299718494828, -0.8467542105036365, -0.8654961328965075, -0.8785716363437588, -0.8856226939384915, -0.8864314198150502, -0.8809289013887418, -0.8691983207309351, -0.8514721856044066, -0.8281238020568507, -0.7996534241912432, -0.7666697926561794, -0.7298680034988747, -0.690004818796222, -0.6478726300458773, -0.604273310087615, -0.5599931402888473, -0.5157798830914314, -0.4723228965850428, -0.43023697188456594, -0.3900503323261289, -0.35219698327010096, -0.31701335945544795, -0.28473899841070877, -0.2555207855729603, -0.22942017813119214, -0.20642272492571528, -0.18644915982548327, -0.1693673531050663, -0.15500445367448057, -0.1431586365501853, -0.13360997527849094, -0.12613007820503475, -0.12049025089772325, -0.116468066034354, -0.1138523295251016, -0.11244652225436697, -0.11207086726804172, -0.11256322110495193, -0.11377901562306925, -0.11559048489665852, -0.11788540343543952 ], [ -0.5203825269811914, -0.5594187269401057, -0.598975337977633, -0.6383960960470529, -0.6769697450302533, -0.7139489836383026, -0.7485723238302017, -0.780088032826684, -0.8077791609436505, -0.8309885380678668, -0.8491425638392686, -0.8617726276988934, -0.8685330773343111, -0.8692148049284063, -0.863753732033194, -0.8522337331796451, -0.8348838290175922, -0.8120697828138519, -0.7842805294060998, -0.7521101336223173, -0.7162361982179253, -0.6773958054932018, -0.6363601723852851, -0.5939092216112586, -0.5508072223842957, -0.5077805394761301, -0.4654983595499837, -0.4245570527602991, -0.38546859179514004, -0.3486532067979947, -0.3144362193491093, -0.2830487865159145, -0.25463210871459446, -0.22924452110744276, -0.2068708020294865, -0.1874329942195147, -0.1708020426560939, -0.15680960087165657, -0.14525943786068374, -0.13593798089812859, -0.12862364604654725, -0.12309472847054204, -0.11913574048961995, -0.11654218966252228, -0.11512387698434734, -0.11470686329813434, -0.1151342989664999, -0.11626633810653603, -0.11797936605754017, -0.12016476006683041 ], [ -0.5125071702167503, -0.5504696313295196, -0.5889231302023119, -0.627229344760181, -0.6646969430772954, -0.7006000271661317, -0.7341993884164553, -0.7647657682436881, -0.7916041533669229, -0.8140780201415244, -0.8316323873398759, -0.8438145486469955, -0.8502914372038317, -0.8508627220239344, -0.8454689422330615, -0.8341942374744528, -0.8172635154344084, -0.7950341917497128, -0.7679829240137027, -0.7366880211837712, -0.7018084254322546, -0.6640603217684209, -0.6241925223858785, -0.582961793490392, -0.5411092434057374, -0.4993387780898761, -0.4582984641878289, -0.4185654340856625, -0.38063473788180163, -0.3449123102719778, -0.3117119919881438, -0.28125633980627085, -0.25368078768227836, -0.2290405923403212, -0.20731991395946325, -0.18844234711202884, -0.17228222603146942, -0.15867607602222883, -0.14743366165457983, -0.1383481833152872, -0.13120528726173758, -0.12579067142453337, -0.12189618166280597, -0.11932439429580477, -0.11789176557375619, -0.11743049425420848, -0.1177892883978176, -0.11883325232140324, -0.12044311613916964, -0.12251402128707978 ], [ -0.5039499864705684, -0.5407841296019421, -0.5780814078900778, -0.6152223958470988, -0.6515366622409332, -0.6863206831430986, -0.7188584648479048, -0.7484440928643499, -0.7744052648773501, -0.7961267550424846, -0.8130727046566129, -0.8248066468044488, -0.8310082521714488, -0.8314859270888386, -0.826184595416973, -0.8151882410405519, -0.7987170619419053, -0.7771193720536573, -0.7508586644140066, -0.7204965001338648, -0.6866720959104199, -0.6500796351476041, -0.611444415313551, -0.5714989630169034, -0.5309601995366533, -0.49050862914183824, -0.45077036061458475, -0.4123025722724665, -0.37558280780816655, -0.34100226046141224, -0.3088629818615261, -0.27937875304279186, -0.252679189687841, -0.22881652934300223, -0.20777446930661242, -0.18947839064776884, -0.17380631360626142, -0.16059997694464417, -0.14967551112848582, -0.140833273728873, -0.13386652598161863, -0.12856874313933409, -0.1247394602134464, -0.12218865245038252, -0.12073973166863422, -0.12023130248609021, -0.12051786536104064, -0.12146967672796394, -0.12297198211920912, -0.12492382878564129 ], [ -0.4947690091069812, -0.5304266010662795, -0.5665209673164471, -0.6024524300896834, -0.6375723232494107, -0.6712003498304301, -0.7026445462155417, -0.7312230928310159, -0.7562870588689162, -0.7772430625119199, -0.7935747784964908, -0.8048622379979642, -0.8107979437766232, -0.811198963565526, -0.806014359375354, -0.795327548039991, -0.7793534537937565, -0.7584305895343848, -0.7330084713392745, -0.7036310129560457, -0.6709167475243913, -0.6355368700447662, -0.5981921775880003, -0.5595900011831845, -0.5204221748943414, -0.4813449796359132, -0.44296184165584984, -0.4058093712924057, -0.3703471114680401, -0.3369511429599802, -0.3059114797333242, -0.27743299578652864, -0.25163946568859413, -0.22858018171753142, -0.20823853516694985, -0.19054191840655216, -0.17537231491026872, -0.16257699129741182, -0.1519787811070143, -0.14338554600817982, -0.13659850751750008, -0.1314192524646529, -0.12765532078192737, -0.12512437845552216, -0.12365705710881181, -0.12309860191920402, -0.12330951036302307, -0.12416536614911061, -0.12555607742340846, -0.12738471861773787 ], [ -0.48502507200853506, -0.5194643541151973, -0.5543156458420849, -0.5889997621752591, -0.6228905520230688, -0.6553316784251711, -0.6856559011525238, -0.7132061261784521, -0.7373573401267353, -0.7575384462890272, -0.773252971808964, -0.7840976292736962, -0.7897777921261762, -0.7901190793237656, -0.7850744332851449, -0.7747263050411762, -0.7592838169834569, -0.739075039840266, -0.7145347787839085, -0.6861884967030342, -0.6546331953800958, -0.6205162154248045, -0.5845129951856077, -0.547304843943482, -0.5095577366925138, -0.47190303244667664, -0.43492086488895304, -0.3991267658726408, -0.3649618732086827, -0.33278685935470564, -0.30287951149844206, -0.27543570886978425, -0.2505733901600063, -0.22833898979259143, -0.2087157501952977, -0.19163328850750816, -0.17697780758201925, -0.16460238741233402, -0.15433686706436606, -0.145996920525727, -0.13939203396173722, -0.13433219838673088, -0.1306332333572663, -0.12812074797476147, -0.12663282088928174, -0.12602153849853337, -0.12615356919034276, -0.12690997183365527, -0.12818544055517056, -0.12988717781153458 ], [ -0.47478119961535215, -0.507966958761296, -0.5415415970576134, -0.5749470594831563, -0.607580344112851, -0.6388096861685689, -0.6679931396403482, -0.6944988463475796, -0.7177261419805275, -0.7371265516684569, -0.7522236832241269, -0.7626310402603544, -0.7680668516270388, -0.7683651454257804, -0.7634824781956915, -0.7534999517449068, -0.7386203973702506, -0.7191608636061384, -0.6955407920927218, -0.6682664901086588, -0.6379126930858614, -0.6051021443330126, -0.5704841944591469, -0.5347134362638942, -0.4984293433910106, -0.4622377784155617, -0.42669508758380903, -0.3922953173269409, -0.35946088585801994, -0.3285368361393848, -0.2997885981872115, -0.2734030113429617, -0.24949221060972487, -0.22809987222332762, -0.20920924581207978, -0.19275237404173295, -0.178619912823968, -0.1666710108108051, -0.15674277903021455, -0.14865897210391382, -0.14223760316760886, -0.13729731738123402, -0.13366244668552502, -0.13116675548178697, -0.12965595902501104, -0.12898915104874936, -0.129039313628535, -0.12969310112698662, -0.13085009300958017, -0.13242169998918474 ], [ -0.4641019910665296, -0.49600557424963676, -0.5282765621615191, -0.5603785584345463, -0.5917322281914904, -0.6217308701364452, -0.6497582812422937, -0.6752082299596492, -0.6975047196081895, -0.7161221311201177, -0.7306042924529947, -0.7405815363459907, -0.7457848803014706, -0.7460565901269606, -0.7413565642578961, -0.7317641897896705, -0.717475559027057, -0.6987961817549393, -0.6761295669158931, -0.6499622620514014, -0.6208461156304129, -0.5893786550695973, -0.5561825444249645, -0.5218850972628776, -0.4870987733765312, -0.4524034882556375, -0.41833142058853867, -0.3853548273489906, -0.3538771816356924, -0.32422774936069076, -0.2966595305006704, -0.27135032072008386, -0.248406509147362, -0.22786912441042517, -0.20972157701442729, -0.19389852192902235, -0.18029527814722596, -0.1687772869296959, -0.159189160686881, -0.15136296220154233, -0.14512545108818786, -0.140304133317051, -0.1367320434948459, -0.1342512728924043, -0.13271532498410682, -0.1319904321860363, -0.13195600178508127, -0.13250437636337015, -0.133540096089444, -0.13497883962903595 ], [ -0.45305300631073353, -0.4836522802725078, -0.5145991467464918, -0.5453792882106451, -0.5754374390016874, -0.6041923326736556, -0.6310538372317299, -0.6554416207614353, -0.6768045617709971, -0.6946400305436005, -0.708512128425637, -0.7180679865553814, -0.7230512955870823, -0.7233123609329306, -0.7188141473394303, -0.7096339820076036, -0.6959608138217664, -0.6780881625236647, -0.6564031200844048, -0.6313719718438432, -0.603523173711866, -0.573428543176195, -0.5416835889804043, -0.508887914182896, -0.47562658118666495, -0.44245323055369923, -0.4098756067399102, -0.37834397466323055, -0.3482427241904388, -0.319885268624738, -0.2935121609328312, -0.26929218905456004, -0.24732607816592217, -0.22765232936849134, -0.21025466404552845, -0.1950705211248619, -0.18200006805051627, -0.17091523046355905, -0.16166831386675323, -0.15409987538797332, -0.1480455973935329, -0.1433420097307675, -0.13983099728237858, -0.13736310904477045, -0.1357997503463917, -0.13501438891837342, -0.13489293764460297, -0.13533349260948951, -0.13624560626138116, -0.13754926462089795 ], [ -0.441700161773284, -0.4709794199884736, -0.5005881117995308, -0.5300343112266387, -0.5587871096992464, -0.5862909289195478, -0.6119819175196105, -0.6353058010421203, -0.655736432607943, -0.672794208034471, -0.6860634722110006, -0.6952080582508302, -0.6999841687331587, -0.7002499267220318, -0.6959710868427305, -0.6872225936685923, -0.6741858934081786, -0.6571421309532811, -0.636461582641909, -0.6125898710223732, -0.5860316685829312, -0.5573327126538721, -0.5270610167998854, -0.4957881722564627, -0.46407158765201467, -0.4324384215630332, -0.4013718288269802, -0.3712999789213953, -0.34258812554362406, -0.3155338236732975, -0.29036521616066024, -0.26724215704280807, -0.24625981189642138, -0.22745428241701365, -0.2108097459544519, -0.19626658091475374, -0.183729963118961, -0.17307846159812912, -0.1641722285519049, -0.15686046006787768, -0.1509878942204702, -0.14640020424394146, -0.14294823037596638, -0.1404910697008694, -0.13889810533656788, -0.13805010257274553, -0.13783952949443068, -0.13817027390514447, -0.1389569287116108, -0.14012380679200748 ], [ -0.4301091427743124, -0.45805896260269285, -0.48632168722183816, -0.5144279891938771, -0.5418714929183959, -0.5681224462052451, -0.5926433725653831, -0.6149061010509564, -0.634409454296864, -0.6506967961758985, -0.6633726058597851, -0.6721172598439757, -0.6766992689434232, -0.6769843309619498, -0.6729407155506044, -0.6646406862543243, -0.6522578738111571, -0.6360607306022975, -0.616402404307811, -0.5937075553761005, -0.5684567955741309, -0.5411695339662413, -0.5123860758344618, -0.48264982675234047, -0.4524904096029361, -0.4224084118032841, -0.3928623515119293, -0.3642582956615108, -0.33694239120005387, -0.3111963962718791, -0.2872361319656741, -0.2652126279844678, -0.2452156152739618, -0.22727893078659395, -0.21138734683786647, -0.19748431982873565, -0.18548016785747584, -0.17526022926951812, -0.166692618364423, -0.1596352733302378, -0.1539420778412368, -0.14946792484595794, -0.14607267295027176, -0.14362401772289213, -0.14199935887361503, -0.1410867876901108, -0.1407853468692517, -0.14100472766418265, -0.141664568783527, -0.14269351010785036 ], [ -0.4183448393980595, -0.4449618927114832, -0.47187691555930217, -0.49864328292566745, -0.524779219147439, -0.5497808243036297, -0.5731369795969489, -0.5943455560306534, -0.6129302404247063, -0.6284572178578914, -0.6405509172607465, -0.6489080416224393, -0.6533091673065414, -0.6536273059234842, -0.6498329711902847, -0.6419954731704369, -0.6302803616659209, -0.6149431461363205, -0.5963196175644756, -0.5748132749048138, -0.5508805034472454, -0.525014255417058, -0.4977270384257734, -0.46953402262809696, -0.4409370339851054, -0.4124101137407583, -0.3843872009292699, -0.3572523455236912, -0.3313326961243673, -0.3068943396472006, -0.2841409125023451, -0.26321476303269803, -0.2442003312085883, -0.22712932893523036, -0.2119872553005796, -0.19872076549424122, -0.18724542739495215, -0.17745344143736186, -0.16922096141876292, -0.16241472970365967, -0.15689782296807941, -0.15253438771552352, -0.1491933226440309, -0.1467509330594456, -0.14509263777132608, -0.1441138495321782, -0.14372017567492928, -0.1438270969167097, -0.14435928100226053, -0.14524967627900537 ], [ -0.4064708119297137, -0.4317576329651127, -0.45732903291870985, -0.48276109325912986, -0.507596600153365, -0.5313574245984848, -0.5535586814887127, -0.5737241194466979, -0.591402088821329, -0.6061813644913498, -0.6177060699257482, -0.6256889635879963, -0.6299224093249295, -0.6302864565492272, -0.6267535981563083, -0.6193899455587908, -0.6083527499389073, -0.593884394236185, -0.5763031683828695, -0.555991308256313, -0.53338091563777, -0.5089384734504634, -0.4831487220613051, -0.45649866629242086, -0.4294624403693828, -0.40248767402964997, -0.3759838849583424, -0.35031328025713465, -0.3257841936866659, -0.3026472271802354, -0.2810940152579732, -0.26125839875509554, -0.2432196869954149, -0.22700761006083164, -0.21260851740944997, -0.19997236552519565, -0.18902005301316438, -0.17965070221196044, -0.17174854628936587, -0.1651891535084422, -0.15984479934233803, -0.15558887620515477, -0.15229930439340061, -0.14986097215909921, -0.14816728471942658, -0.14712093984843588, -0.14663407116395005, -0.1466279100923013, -0.14703211541501798, -0.14778390753244508 ], [ -0.3945487913173136, -0.4185135058741484, -0.4427508932452604, -0.4668596495951206, -0.4904069842536808, -0.5129403552310944, -0.5340008855742503, -0.5531379398604074, -0.5699242414247782, -0.5839708442503642, -0.5949412453455569, -0.6025639378986425, -0.6066427635264907, -0.6070645212970314, -0.6038034264928361, -0.5969221750402024, -0.5865695496439028, -0.5729746889809079, -0.5564383193509783, -0.5373214069879382, -0.5160318182913014, -0.493009666325981, -0.46871206976473667, -0.44359805301423977, -0.41811427494468195, -0.39268219296898177, -0.36768715640988325, -0.3434697873696001, -0.32031985906732796, -0.29847273151452847, -0.27810826256635124, -0.2593519876041333, -0.24227826023355759, -0.22691497398365124, -0.21324944315081462, -0.20123500932441296, -0.1907979562726762, -0.18184435552861566, -0.17426652273067483, -0.1679488344065817, -0.16277273019045757, -0.15862080056680156, -0.15537993006695033, -0.15294352641348496, -0.15121291467108106, -0.15009801055773697, -0.14951740844843392, -0.1493980280634123, -0.14967446100000492, -0.15028814633306192 ], [ -0.38263821939696463, -0.4052942397925977, -0.42821244127132047, -0.4510139516192282, -0.4732901692228653, -0.4946138582025368, -0.5145518285246553, -0.5326787076878352, -0.5485912174862074, -0.5619223066698115, -0.5723544642136608, -0.5796315521330611, -0.5835685522505706, -0.5840587158756073, -0.5810777338346932, -0.574684698828287, -0.5650198026993362, -0.5522988865254947, -0.5368051296737291, -0.5188783137503415, -0.49890221880819374, -0.47729079449210093, -0.4544737930541702, -0.43088255252576185, -0.40693657816610107, -0.3830314929884886, -0.35952882060094393, -0.33674793457830465, -0.3149603679910321, -0.2943865346892335, -0.2751947800536756, -0.2575025614745955, -0.24137946426020057, -0.22685169126275628, -0.21390762614087744, -0.2025040604598632, -0.19257269133102944, -0.1840265349203848, -0.17676595667536066, -0.17068408566618676, -0.16567145206756834, -0.1616197579543962, -0.15842475746187878, -0.1559882792197549, -0.15421946926131652, -0.15303536500644005, -0.15236093025143382, -0.15212868818842862, -0.15227808592108194, -0.15275471186845124 ], [ -0.3707958328552784, -0.39216152327237674, -0.4137802385327387, -0.435295268779044, -0.45632187756057785, -0.47645776328020184, -0.4952950122288289, -0.5124330768321868, -0.5274922251152957, -0.540126848572746, -0.550037991426362, -0.5569844781799749, -0.5607920692665816, -0.5613601643504184, -0.5586656945715268, -0.5527639912351318, -0.543786579677848, -0.5319360125338991, -0.5174780151975608, -0.5007313572283516, -0.48205597740707273, -0.4618399698440999, -0.44048607933314765, -0.4183983543725587, -0.3959695673127975, -0.3735699371361285, -0.351537588028984, -0.33017105453366774, -0.3097240110462728, -0.290402269363452, -0.2723629619195515, -0.2557157181130073, -0.24052555275216259, -0.2268171231104536, -0.21457997608721047, -0.20377439906799782, -0.19433750488022133, -0.18618921880663047, -0.17923788893277476, -0.17338530457891793, -0.16853097555352697, -0.16457559220203138, -0.16142364819949367, -0.1589852612434654, -0.15717726888251166, -0.15592370647496917, -0.15515579161353193, -0.1548115451149527, -0.15483517442998584, -0.15517633313708817 ], [ -0.35907529410926364, -0.37917361111526726, -0.39951704590592396, -0.419770701075893, -0.43957329776004783, -0.45854701240006634, -0.47630871439121863, -0.49248216489877056, -0.5067106548373546, -0.5186695049295593, -0.5280778283608997, -0.534708970124098, -0.53839908743892, -0.5390534206497075, -0.536649919058433, -0.5312400241662474, -0.5229465648041725, -0.5119588744701237, -0.49852539030225435, -0.48294412541800924, -0.46555151302383446, -0.4467101949252741, -0.4267963645250535, -0.40618727358482387, -0.38524947430844103, -0.3643282977163578, -0.343738972110198, -0.3237596696178671, -0.30462664325113514, -0.28653149067369527, -0.2696204624980611, -0.25399562974870304, -0.23971764280987534, -0.2268097563840324, -0.21526276326279747, -0.2050404735434717, -0.19608539297460886, -0.1883242905921596, -0.18167339691590623, -0.17604303440002672, -0.17134154621821274, -0.16747845284589524, -0.1643668240418788, -0.16192490345859378, -0.1600770620481325, -0.1587541836170433, -0.15789360128973073, -0.1574387081260341, -0.1573383602429535, -0.15754617850691044 ], [ -0.34752687147610417, -0.3663849845672881, -0.3854814651642393, -0.40450280370249536, -0.42311069411867563, -0.4409512570937313, -0.4576655763387939, -0.4729011344225438, -0.48632365750635353, -0.497628826883892, -0.5065532945354123, -0.5128844530811727, -0.5164684582214734, -0.517216082069647, -0.5151060842755103, -0.5101859178018485, -0.5025697291873206, -0.49243375952034135, -0.4800093922210251, -0.465574217593518, -0.44944158370026227, -0.43194917203666683, -0.41344717073986725, -0.3942866162978415, -0.37480843828814586, -0.35533367443707026, -0.33615523123286617, -0.31753145598123217, -0.29968166795987866, -0.2827836777694181, -0.26697321311240424, -0.2523450729456637, -0.23895575552421933, -0.22682725267085674, -0.21595167403680998, -0.206296360598403, -0.19780916388031478, -0.1904236027631785, -0.1840636586436747, -0.17864802712221856, -0.17409370523389472, -0.17031885283515819, -0.16724492114182493, -0.16479808754203878, -0.16291007168478022, -0.16151843253101433, -0.16056645959150634, -0.16000277483523367, -0.15978075624395432, -0.15985788163794273 ], [ -0.33619717019854145, -0.3538460672225068, -0.3717276411036847, -0.38954927704020553, -0.40699508654845007, -0.4237345303221395, -0.4394322693241539, -0.45375885628180873, -0.4664018076170202, -0.4770765478429144, -0.4855366993896794, -0.4915832035517711, -0.4950718033743078, -0.4959184949891148, -0.4941026559628736, -0.489667681308068, -0.48271909195189405, -0.47342021763890874, -0.4619856871193702, -0.4486730741440345, -0.4337731405055465, -0.4175991811774325, -0.4004760077911391, -0.38272910405291727, -0.36467445157473477, -0.3466094606778982, -0.32880535370633246, -0.3115012453823814, -0.29490005367809535, -0.27916626361166647, -0.26442546283944185, -0.250765478335297, -0.2382388727412162, -0.22686651024586013, -0.21664187631275655, -0.20753583261927722, -0.19950150595594768, -0.19247904407423122, -0.18640001819827234, -0.18119130634845682, -0.17677834898386624, -0.17308772436267955, -0.17004904173526764, -0.16759619320615238, -0.16566803800574564, -0.16420861518103114, -0.16316699245081745, -0.16249686106075084, -0.16215598039247958, -0.16210556368895435 ], [ -0.325128915099956, -0.34160299734408084, -0.35830502486165666, -0.37496272253810764, -0.39128200079010916, -0.4069549929857026, -0.4216692394461324, -0.4351176552587569, -0.447008851806149, -0.4570773372441725, -0.4650931036165624, -0.4708701205401396, -0.4742732979669025, -0.4752235516814409, -0.4737007009492621, -0.4697440421376859, -0.4634505676826692, -0.4549709280024109, -0.4445033561039212, -0.43228588235730625, -0.4185872529929667, -0.40369702476346814, -0.38791533647634047, -0.3715428546773651, -0.35487135696750893, -0.33817535580584734, -0.32170508357121197, -0.3056810628527276, -0.2902903818757187, -0.275684691204597, -0.2619798414443793, -0.24925699858895, -0.23756500848809636, -0.22692373747407302, -0.21732809355844523, -0.20875243111880304, -0.20115505947441764, -0.19448260884668028, -0.1886740517660403, -0.18366422949626354, -0.17938678699926142, -0.1757764722414371, -0.17277080279018853, -0.17031114206500525, -0.16834325763691765, -0.16681745390728459, -0.1656883815069497, -0.1649146267343981, -0.1644581777400006, -0.16428385175422905 ], [ -0.31436078488002034, -0.32969745648400006, -0.3452581981640773, -0.36079046404750814, -0.3760212884288908, -0.39066475432127346, -0.4044305302016421, -0.4170331365576372, -0.428201541147833, -0.43768864039807986, -0.4452801682414269, -0.450802585441008, -0.4541295424873488, -0.4551865758730948, -0.45395378717173607, -0.4504663612849343, -0.44481289743567215, -0.4371316460367068, -0.42760485826228867, -0.4164515552117659, -0.4039191032386638, -0.3902740361806064, -0.3757925907092987, -0.36075141688624235, -0.3454188935600829, -0.3300474208464217, -0.31486698468613283, -0.30008019772090405, -0.28585892346441755, -0.2723424940656646, -0.259637442436552, -0.24781859272994922, -0.2369312933109503, -0.22699453605853676, -0.21800468597622108, -0.20993954497581224, -0.20276249121880657, -0.19642646734573832, -0.19087763335627467, -0.1860585485479706, -0.18191079755076844, -0.1783770242575114, -0.1754023811386286, -0.17293543764847308, -0.1709286186882643, -0.16933826178951644, -0.1681243900434069, -0.16725029772802108, -0.16668203848579055, -0.16638789350234706 ], [ -0.30392729733883833, -0.3181665535023215, -0.33262675739898323, -0.3470744332937014, -0.3612570151666536, -0.37490976440578117, -0.38776368064934835, -0.3995540910213633, -0.4100295447471771, -0.41896060168192084, -0.42614808850845703, -0.4314304075519325, -0.43468952073306644, -0.4358552935654164, -0.4349079677685489, -0.4318786307699993, -0.42684765951414694, -0.41994122716837623, -0.4113260668686503, -0.4012027793253157, -0.3897980446531909, -0.37735614843298704, -0.36413025486067074, -0.35037385508005353, -0.33633278769983016, -0.3222381742782324, -0.3083005400284081, -0.2947053051147352, -0.2816097412449141, -0.26914139843267887, -0.25739792393916094, -0.24644812467211075, -0.23633406960222336, -0.22707399239835985, -0.21866573725834232, -0.2110904920803925, -0.20431657063297293, -0.19830303617060302, -0.19300299927620462, -0.18836646855836092, -0.18434268022923883, -0.18088187794558752, -0.17793655463929037, -0.17546220120297013, -0.1734176314912566, -0.17176496865632213, -0.17046938463063932, -0.16949868350802827, -0.1688228120298071, -0.1684133680144282 ], [ -0.2938587441452817, -0.3070427623629194, -0.3204452556406562, -0.333851117344829, -0.347027414938075, -0.3597297760782428, -0.37170969622121786, -0.3827224758119414, -0.3925354411368307, -0.40093606734304554, -0.40773960860377423, -0.4127958510365176, -0.41599463913078394, -0.41726988461989245, -0.4166018446313333, -0.41401754865990803, -0.40958935527261564, -0.4034317225565722, -0.39569637403983343, -0.3865661274088861, -0.3762477210100492, -0.36496401845714577, -0.3529459920304814, -0.34042488023967066, -0.3276248851874809, -0.3147567242630769, -0.30201228274631775, -0.28956053471254434, -0.27754481533487135, -0.26608144445853366, -0.2552596248620907, -0.24514247370762265, -0.2357689958677468, -0.22715677522451072, -0.21930514530245254, -0.21219860295486292, -0.2058102462806049, -0.20010504758140357, -0.1950428104425223, -0.19058070314341258, -0.18667530486910122, -0.18328414325829767, -0.1803667389471854, -0.17788520294871346, -0.17580445475447354, -0.17409214256447747, -0.1727183523611649, -0.17165519055797007, -0.17087631700772643, -0.17035649284454701 ], [ -0.2841811731527165, -0.29635391142536743, -0.3087432000475823, -0.32115156519575194, -0.33336490667862584, -0.3451583727774382, -0.35630308837372127, -0.3665734664509997, -0.37575478309252286, -0.38365066326785024, -0.3900901123378232, -0.3949337382567665, -0.398078842233746, -0.3994631097217052, -0.39906670593769805, -0.39691266609438997, -0.39306556440695, -0.38762854129410407, -0.3807388584020085, -0.37256222989465193, -0.36328624050655933, -0.3531132020949621, -0.3422528184521012, -0.3309150223482304, -0.3193033203966089, -0.3076089332562012, -0.29600595518310635, -0.28464768324525735, -0.2736641883619822, -0.2631611234594177, -0.2532196937194147, -0.24389765455334117, -0.23523115779901094, -0.22723723762295817, -0.21991671522644435, -0.21325730490430272, -0.20723672136491872, -0.20182561669750027, -0.1969902116302194, -0.19269452620129618, -0.18890215620082773, -0.18557758063613528, -0.18268701950369742, -0.18019888850055638, -0.17808391692604886, -0.1763150066074216, -0.17486691359647116, -0.17371583153948467, -0.17283894732092403, -0.1722140273499682 ], [ -0.2749164157196994, -0.2861232213691393, -0.2975451014379625, -0.30900144993137807, -0.32029616986760173, -0.33122305808078384, -0.3415719785354383, -0.35113557536318396, -0.35971623071684733, -0.3671329422983286, -0.373227784132569, -0.3778716236197576, -0.3809687983807903, -0.3824605065886771, -0.3823267314590316, -0.3805866000856269, -0.37729716352012865, -0.3725506729340613, -0.3664705097350299, -0.35920599985807533, -0.35092639916627394, -0.34181437425851596, -0.3320593188136671, -0.3218508394030646, -0.31137271767200553, -0.3007976106653044, -0.290282691859262, -0.27996636705743816, -0.2699661270509456, -0.26037752816060067, -0.2512742273423466, -0.24270894450115565, -0.23471518397696728, -0.22730952153588357, -0.2204942530203261, -0.21426020526270662, -0.20858952708473655, -0.20345830553367567, -0.1988388867975736, -0.19470181915887097, -0.1910173736630052, -0.18775663402964843, -0.18489217840486516, -0.1823984002023461, -0.18025153259224624, -0.17842945094985557, -0.17691133017975813, -0.1756772301932623, -0.17470767420212302, -0.17398327236340472 ], [ -0.26608215602002866, -0.2763693883826625, -0.2868705723140607, -0.2974211823750359, -0.3078422743869858, -0.31794540212705985, -0.3275382611884349, -0.3364308314334594, -0.34444174700105, -0.35140459503553867, -0.3571738340186438, -0.3616300314505003, -0.36468414888074485, -0.3662806486884769, -0.3663992588556271, -0.3650553053039701, -0.3622986012262449, -0.35821096370417693, -0.3529025041030995, -0.3465069049324333, -0.3391759475110043, -0.33107358847891477, -0.32236989698231516, -0.3132351578199704, -0.30383442014403994, -0.29432272904221596, -0.28484122225030817, -0.27551421091891215, -0.26644729674669954, -0.2577265128248382, -0.24941841670356324, -0.24157101520432223, -0.2342153640378522, -0.2273676628508703, -0.2210316582039602, -0.21520117234149133, -0.20986259265020957, -0.20499718289297214, -0.20058310968104637, -0.19659711309283595, -0.1930157858600261, -0.18981645847949796, -0.1869777158570386, -0.18447959317288282, -0.18230351378588328, -0.18043204002583374, -0.1788485091048424, -0.17753662201375514, -0.1764800443854217, -0.175662066303588 ], [ -0.2576920389295354, -0.26710670882967685, -0.27673446916536537, -0.2864260716670853, -0.2960188597601302, -0.3053412396155748, -0.3142178204207505, -0.3224750145830537, -0.32994684956596915, -0.33648071756244646, -0.3419427798466136, -0.3462227509119049, -0.34923781360871736, -0.3509354592680187, -0.3512951037338194, -0.3503283976490378, -0.3480782226701886, -0.344616439415942, -0.34004052265698115, -0.33446927962413575, -0.32803789417398077, -0.320892569808644, -0.3131850564277361, -0.3050673388761234, -0.29668674097162, -0.2881816591965503, -0.2796780891304613, -0.27128704923722574, -0.26310294539778906, -0.2552028601501772, -0.2476466970880436, -0.24047806666562244, -0.23372576717754984, -0.22740569524344056, -0.221523013922044, -0.21607441275436384, -0.21105031085151027, -0.20643687920594705, -0.2022177889242902, -0.19837562514325086, -0.19489293921704887, -0.1917529419218208, -0.1889398659865404, -0.1864390459142511, -0.18423677612597422, -0.18232001488026367, -0.18067600166900805, -0.17929185076391696, -0.17815417447729148, -0.1772487778439436 ], [ -0.24975581275826508, -0.2583452412709133, -0.26714707453216435, -0.27602652785887577, -0.28483635846489314, -0.2934209136983986, -0.3016207939078083, -0.3092779389888706, -0.31624091190615167, -0.3223701291476654, -0.32754277955500216, -0.33165718064392713, -0.3346363455677205, -0.33643057318441055, -0.3370189259463737, -0.3364095221354702, -0.3346386360954815, -0.3317686678570472, -0.32788510710213226, -0.323092671274288, -0.3175108399908959, -0.3112690349398833, -0.30450170456136516, -0.29734356578341226, -0.2899252319960353, -0.28236941961263007, -0.27478787826482215, -0.2672791358515432, -0.2599270935698206, -0.2528004518833131, -0.24595289991583957, -0.23942396107200659, -0.2332403589560625, -0.22741775102751066, -0.22196267299905764, -0.21687454388429234, -0.2121475981643518, -0.2077726354941185, -0.20373850708979824, -0.2000332887169094, -0.1966451204583714, -0.19356272095507981, -0.19077560683263367, -0.1882740653897384, -0.18604893976019848, -0.18409129067787167, -0.1823919981758737, -0.1809413609289816, -0.17972874165268227, -0.1787422952819463 ] ], "zauto": true, "zmax": 0.9765073748425216, "zmin": -0.9765073748425216 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.36867663285355035, 0.359744546365488, 0.35115984548726054, 0.3431205409351067, 0.3358054552067831, 0.3293616919871153, 0.32389456430290386, 0.31946170807530083, 0.3160725349710896, 0.31369319065468926, 0.3122560428738326, 0.3116717895742744, 0.31184184401901205, 0.3126688166019664, 0.31406355435802247, 0.31594807982519024, 0.3182546449606693, 0.32092180334236214, 0.32388880820103993, 0.3270897386542821, 0.330448570496888, 0.3338760146044309, 0.3372684523077637, 0.3405088222041581, 0.3434689597980814, 0.3460127216338087, 0.3479992481193695, 0.34928589673826277, 0.3497306446646078, 0.34919404529450604, 0.34754106585502564, 0.3446432928775588, 0.3403820535989943, 0.3346529733325056, 0.3273724014440147, 0.3184860369137355, 0.3079800217491307, 0.2958947992093217, 0.2823421920027126, 0.26752643635008905, 0.2517701769063508, 0.23554621095756945, 0.21951377654896798, 0.20455153921179847, 0.19176375018283418, 0.18241116897491536, 0.1777077501289141, 0.17848848954917007, 0.18490825458437418, 0.1963977522555715 ], [ 0.36814326352030113, 0.3590846979907314, 0.3503610065506023, 0.34217410404243476, 0.33470828043198375, 0.3281174480315876, 0.32251457878206324, 0.31796508438745524, 0.3144853868497547, 0.3120469876916285, 0.31058521017336965, 0.3100108190276392, 0.3102222291562444, 0.31111612023745894, 0.3125948789068285, 0.3145701561697756, 0.3169626986165672, 0.3196992963620814, 0.3227080869260059, 0.32591353972419346, 0.32923225704473025, 0.33257034443204303, 0.33582263397941975, 0.3388736017753401, 0.3415994997481155, 0.34387107611630696, 0.3455562930166494, 0.34652262862630007, 0.34663881326620705, 0.345776127358841, 0.3438096254744831, 0.3406198054618982, 0.3360952985615852, 0.33013712323118427, 0.3226649516391254, 0.31362572958733465, 0.3030049239101411, 0.2908407028315083, 0.2772415278758242, 0.2624079496222568, 0.24665972212799706, 0.23046919098377994, 0.2144998881354696, 0.19964223802450234, 0.18702129080114624, 0.17792407474615538, 0.17358285155392697, 0.1748234501220201, 0.18175749307129657, 0.19375773288765574 ], [ 0.3678608986685053, 0.35869758267006013, 0.3498544629009309, 0.3415365446608957, 0.33393286427069685, 0.32720359844729474, 0.32146908459023843, 0.31680251121454256, 0.313227604375311, 0.31072175694621046, 0.3092239360938847, 0.3086457099932734, 0.3088831842658504, 0.3098276805900746, 0.311373547147854, 0.31342233155903876, 0.31588340832470246, 0.3186718323721499, 0.3217045808101983, 0.32489642535975294, 0.32815649069654385, 0.3313861841916551, 0.33447873795218186, 0.33732019290818105, 0.33979136307642266, 0.34177019315512774, 0.34313396714053734, 0.34376100537510434, 0.3435317455065295, 0.3423293761718098, 0.34004042495421577, 0.3365558548687119, 0.3317732786264839, 0.32560086323452453, 0.31796339766564696, 0.3088108802390613, 0.2981299081413417, 0.2859581790881684, 0.2724025910188424, 0.257661749295565, 0.24205402237158716, 0.2260521023138823, 0.21032285146291915, 0.19576369960695894, 0.18350882446852976, 0.1748500221548175, 0.17100809509130177, 0.17277245914432865, 0.18020221706282896, 0.19262578820225834 ], [ 0.36782121460039796, 0.3585744333608124, 0.34963111211744835, 0.34119852104912823, 0.3334696868774057, 0.32661044854479276, 0.32074813991613116, 0.3159636456270976, 0.31228821683792657, 0.3097056249477679, 0.30815915682537337, 0.30756194878825466, 0.3078085531128096, 0.3087856047054306, 0.3103799549955412, 0.31248344544938705, 0.31499433794776854, 0.31781609210309214, 0.32085456652303646, 0.3240148006321371, 0.3271983523254245, 0.3303018128025823, 0.3332167003835096, 0.33583055311424653, 0.33802877471185805, 0.3396966815726072, 0.34072125139486625, 0.3409922542022782, 0.34040270146449586, 0.33884881939606504, 0.3362299845331895, 0.332449213635057, 0.32741485617061805, 0.321044099750613, 0.3132687938696977, 0.304043972178889, 0.2933593679933195, 0.281254233761035, 0.26783593939131095, 0.2533031298796668, 0.23797450894905114, 0.22232400715696765, 0.20702061653219872, 0.19296307479438607, 0.18128092827443712, 0.17324609322799028, 0.17003553551548387, 0.1723756293410727, 0.18026798431563607, 0.19301498539535702 ], [ 0.3680123789828479, 0.3587025876242417, 0.3496775913437096, 0.34114610738629236, 0.3333043828123471, 0.32632327796875127, 0.3203366936834824, 0.31543305657722803, 0.31165129156418925, 0.3089819800776992, 0.3073733787594969, 0.30674096840521853, 0.30697855333118895, 0.30796883454189344, 0.30959181255190443, 0.311730134832247, 0.314271323723125, 0.3171074843019281, 0.32013347694789845, 0.3232446223877573, 0.3263348357307109, 0.3292957503251982, 0.3320169977358174, 0.3343874551933748, 0.3362970297876527, 0.3376384569282919, 0.3383086496049496, 0.338209314969836, 0.3372468071613838, 0.3353314546294352, 0.33237683448139227, 0.32829962519146544, 0.32302073018954186, 0.31646832879528214, 0.3085834022769207, 0.29932814766114074, 0.28869759076747453, 0.27673470516908993, 0.26354947869422174, 0.2493426234326794, 0.23443480425847013, 0.21930172218581775, 0.2046124721546052, 0.19125990017190472, 0.1803530754084155, 0.17311774257771764, 0.1706555497832563, 0.17360767879667224, 0.18191860836699464, 0.19488518579304676 ], [ 0.3684192584073261, 0.35906571293270834, 0.3499765179397521, 0.3413610470706478, 0.3334180047436877, 0.3263226139855594, 0.3202148699683751, 0.3151905249150683, 0.31129625681944567, 0.30852982759337083, 0.3068450753723264, 0.3061605958395183, 0.3063702801699324, 0.30735370951525076, 0.30898476384614504, 0.3111375057554818, 0.3136891889694474, 0.316520892767203, 0.31951666849166255, 0.3225621746497846, 0.32554361979837326, 0.3283475172310525, 0.3308613858563751, 0.33297520164497224, 0.3345831819679581, 0.33558540536393056, 0.33588883213678533, 0.3354074698010391, 0.33406167743872234, 0.3317768728164288, 0.32848214535503595, 0.32410944551516163, 0.3185940915377027, 0.3118773040607788, 0.3039113688931903, 0.29466788228315643, 0.2841494111819349, 0.27240486420108084, 0.2595489535192758, 0.24578629309969904, 0.23144068454061956, 0.2169892737959096, 0.20309781746127575, 0.19064415389274053, 0.18069936058176161, 0.1744172010791084, 0.17279716073047116, 0.1763805987681736, 0.18506031646734653, 0.19814739057239147 ], [ 0.36902369746803826, 0.3596441140703631, 0.350506822831164, 0.3418211086221234, 0.3337873980455127, 0.3265846213365828, 0.32035837111177073, 0.31521146006070094, 0.3111983349667908, 0.3083242444380639, 0.30654917003033755, 0.30579556900025684, 0.3059582620019671, 0.3069145624737254, 0.3085330220500705, 0.3106798035370741, 0.3132224425485939, 0.31603139457577767, 0.3189801497357207, 0.321944798345569, 0.3248037907054715, 0.3274383418768237, 0.32973358744428366, 0.3315802892165334, 0.33287668482412447, 0.33353000429190643, 0.3334572409098221, 0.33258493941391964, 0.3308480117497885, 0.32818786175218556, 0.32455034655675474, 0.3198842823099221, 0.31414128586655454, 0.3072777238151029, 0.29925943119306303, 0.290069704968871, 0.2797209290205554, 0.2682701051203308, 0.2558385741115622, 0.2426362461894474, 0.2289904298020803, 0.21537808129251237, 0.20245633467881716, 0.19107693855016034, 0.18225476008062935, 0.17704867479649417, 0.17633678193578486, 0.1805548044935544, 0.1895530309234172, 0.20267334868320225 ], [ 0.3698048596087768, 0.36041511121226594, 0.3512441634688487, 0.34250052953161625, 0.33438567026066773, 0.3270815915045004, 0.32073898149104313, 0.3154674145647743, 0.3113290664149444, 0.3083369135889063, 0.30645758356710073, 0.30561810106207504, 0.30571504448131326, 0.30662432516367893, 0.3082099956632624, 0.3103310569155988, 0.31284593639212577, 0.31561492513489925, 0.3185012475596726, 0.321371552072248, 0.32409649147092895, 0.32655179403349066, 0.32861990623753595, 0.3301920023240235, 0.33116996530994086, 0.3314678791986789, 0.3310126352040284, 0.32974342561588466, 0.3276101422828549, 0.3245709690138658, 0.3205897123859003, 0.315633610626397, 0.30967246266913884, 0.30267991413812173, 0.2946376328248144, 0.2855429374065422, 0.2754202619261289, 0.2643366957620299, 0.2524217469017845, 0.23989134048859828, 0.22707555218946285, 0.21444789234890926, 0.2026496164376985, 0.19249377622925878, 0.184921531646274, 0.1808790450019884, 0.1811128957506237, 0.1859555390548152, 0.1952257036114501, 0.2083080996465107 ], [ 0.3707396184066256, 0.3613534753310236, 0.35216140098484305, 0.34337053066995665, 0.33518273630997364, 0.32778251091174626, 0.32132515054314625, 0.31592667464394425, 0.31165690226376846, 0.30853671587856724, 0.30653982469025237, 0.3055984704828082, 0.30561178178148085, 0.3064551219033748, 0.30798888477687303, 0.31006567574864563, 0.3125354622826051, 0.3152488708418916, 0.31805919205179, 0.32082378562256536, 0.3234054808198955, 0.32567432650979394, 0.3275097498683583, 0.32880291705928527, 0.3294589106953083, 0.32939827745868333, 0.3285575585968075, 0.32688857965679624, 0.3243565134227667, 0.32093700260710917, 0.31661289312087476, 0.31137134164196456, 0.30520218612648464, 0.2980984827687366, 0.2900600177533197, 0.28110042228590143, 0.27125829898405035, 0.26061254865804984, 0.2493018668106217, 0.23754803986760872, 0.22568185580763983, 0.21416840004392348, 0.2036240641821249, 0.194809969982381, 0.1885783803115091, 0.1857514112371821, 0.18694283172706536, 0.19239036837305357, 0.20189213100500797, 0.2148828595448185 ], [ 0.37180298715963, 0.3624319066311525, 0.3532291250143855, 0.3443998825836413, 0.33614591889908585, 0.32865368607079976, 0.322082632201191, 0.3165549036114311, 0.31214784288739506, 0.30889035728117864, 0.30676360223281796, 0.30570561685911046, 0.30561881628383153, 0.3063788340117344, 0.3078432310849889, 0.3098589869546897, 0.3122682734665789, 0.3149125756083973, 0.31763560689134046, 0.3202856131005758, 0.3227175880470591, 0.3247957111419535, 0.32639604701233166, 0.32740930057005474, 0.32774325274344496, 0.3273244418051875, 0.3260987084168889, 0.3240303764698876, 0.3211000711583493, 0.31730144648962777, 0.3126373668500169, 0.3071163188425704, 0.3007499803846609, 0.29355291423868496, 0.28554527196927415, 0.2767592050991311, 0.267249415612902, 0.25710796864130714, 0.24648312124283991, 0.2356013606497803, 0.22479074679218847, 0.21450138498306068, 0.2053146789198355, 0.19792712974539428, 0.1930905756134744, 0.1914986078931823, 0.19363815363153858, 0.1996644025653609, 0.20936451367735961, 0.22222625253471723 ], [ 0.372968574587923, 0.3636215417018331, 0.3544162096955248, 0.345555505097804, 0.3372405837295369, 0.3296594039552039, 0.3229751583181752, 0.3173158158102704, 0.3127661008034279, 0.309363011334397, 0.30709544063809674, 0.3059077259188293, 0.30570623194207863, 0.30636762203183976, 0.3077474102894034, 0.3096876986740923, 0.3120235220751328, 0.31458775285564505, 0.3172148970474782, 0.31974427731710386, 0.3220230550429864, 0.3239093594572068, 0.32527554800020536, 0.32601139360603903, 0.326026835345725, 0.3252538679077553, 0.3236471902271075, 0.32118337522040474, 0.31785854064800856, 0.31368476691929603, 0.3086857857318938, 0.3028927130338767, 0.2963407783823827, 0.28906807288973335, 0.2811172764027637, 0.2725411295645431, 0.26341210557651884, 0.2538363278503994, 0.2439712503275391, 0.23404584045669447, 0.22438068800818886, 0.215403168032795, 0.2076492634764312, 0.20173987974115298, 0.1983193820794414, 0.19795458927790469, 0.20101656851290914, 0.20759152483903173, 0.2174634325509072, 0.2301728568376263 ], [ 0.37420905503804625, 0.36489247586994156, 0.3556903853798617, 0.34680308290674505, 0.33843079061258496, 0.3307626075764362, 0.3239651255956723, 0.3181718608574891, 0.3134747686912129, 0.3099189592713477, 0.307501283420961, 0.30617279078286086, 0.30584437083857097, 0.30639439745504, 0.3076770604670708, 0.30953028766774104, 0.3117826083552282, 0.31425879948320007, 0.31678453031494785, 0.3191904015468, 0.3213157607125495, 0.32301252202386666, 0.32414900137526725, 0.32461356690989185, 0.3243177542362386, 0.3231984323722109, 0.32121864109113946, 0.31836684710627927, 0.31465456986152807, 0.3101125843756137, 0.304786188217931, 0.29873028453152844, 0.2920052394449293, 0.284674575836877, 0.2768055298171862, 0.26847330196847413, 0.25976948180944237, 0.2508146160462291, 0.24177420578126943, 0.23287645738942353, 0.22442868161373447, 0.21682713926104372, 0.21055256197581448, 0.20614193245865647, 0.20412973730139203, 0.2049627115155216, 0.2089097907932816, 0.2160014256497303, 0.22602414668136114, 0.2385689046053408 ], [ 0.37549664264712174, 0.3662142886286464, 0.35701881233911154, 0.3481076819497291, 0.3396799440503398, 0.33192556952561547, 0.3250142785668375, 0.31908490125412875, 0.3142364768633026, 0.31052221407507535, 0.3079470732002981, 0.30646914070108866, 0.3060043067214073, 0.30643324007606504, 0.3076094444694573, 0.30936730946064545, 0.3115294421115136, 0.3139130125537187, 0.3163352132479329, 0.3186181285473821, 0.32059332659924944, 0.32210636384200464, 0.3230212019609686, 0.323224344923503, 0.32262835985810584, 0.3211743795103792, 0.3188332068862404, 0.3156047522040078, 0.3115157172553887, 0.30661568488721574, 0.30097204679471284, 0.2946644778275109, 0.28777989684006194, 0.2804089932253291, 0.2726453955155235, 0.26458837523205364, 0.2563495945891796, 0.24806381315617765, 0.23990265207775116, 0.2320894297552239, 0.22491166565436824, 0.21872614609991073, 0.21394995562654684, 0.21103101812215136, 0.21039576181000652, 0.21238089719532954, 0.21716782644940816, 0.2247431431644776, 0.23489983572783327, 0.24727551989514815 ], [ 0.3768035603052432, 0.36755656178776636, 0.358368644947645, 0.34943435399751266, 0.34095142988118554, 0.3331105496135627, 0.3260843748115504, 0.3200168702040929, 0.3150140283623211, 0.3111371185651308, 0.30839930080054606, 0.30676593237016014, 0.3061582732083861, 0.3064597609836788, 0.30752374824572565, 0.3091816344753567, 0.3112506203815107, 0.31354071292799923, 0.3158609654113022, 0.31802514997495596, 0.31985710565210623, 0.3211959161518793, 0.32190090892539197, 0.32185629308018093, 0.3209751170853295, 0.31920215761060994, 0.3165153609408218, 0.3129255486416133, 0.30847426220301283, 0.3032298444302292, 0.29728211953209804, 0.2907363115850986, 0.28370709297793956, 0.276313828890988, 0.26867812136535935, 0.26092460004171186, 0.2531855141439783, 0.2456090325868176, 0.23837025862719893, 0.2316828347006462, 0.22580772596644186, 0.22105456887746142, 0.21777047136220273, 0.21631247265400452, 0.21700418535106494, 0.22008421852714685, 0.225660579823436, 0.23368611160684655, 0.24396264516336919, 0.25617009594642925 ], [ 0.3781024957808512, 0.3688893819208081, 0.3597075771854857, 0.3507487196793536, 0.34220922779706864, 0.33428042628491295, 0.3271378223469398, 0.32093040034924225, 0.3157710037028112, 0.3117289113692742, 0.3088255195116356, 0.30703360236692184, 0.3062800476129684, 0.30645141431982476, 0.3074013199853744, 0.3089586162942261, 0.31093552816944947, 0.3131352828193959, 0.3153590985672225, 0.3174126320284654, 0.3191120588075944, 0.32028990783911426, 0.3208006352131195, 0.32052576791541687, 0.31937831851335047, 0.3173060984303523, 0.31429355413466264, 0.31036181994132306, 0.30556681894257726, 0.29999544132939143, 0.29376007398109943, 0.28699202593385237, 0.2798346580009168, 0.2724372319450525, 0.26495058019753415, 0.257525589230489, 0.25031512626572566, 0.2434793889728468, 0.23719374060222465, 0.2316569971617653, 0.22709704832822963, 0.22376997080918973, 0.221948998777523, 0.22190152849030165, 0.22385604985480373, 0.22796561126624124, 0.23427770332730427, 0.24271964580903158, 0.2531033291608028, 0.2651464088672001 ], [ 0.379367038894545, 0.3701838205789061, 0.3610043626031533, 0.35201752287853527, 0.3434184926034654, 0.3353992948332402, 0.3281382826628638, 0.3217894176956226, 0.3164723307546285, 0.31226425791486995, 0.309194823620942, 0.30724428198248255, 0.3063452938464864, 0.30638776323097344, 0.3072258571125358, 0.3086862002292387, 0.3105763710655111, 0.3126931262598817, 0.31483010952126794, 0.3167850454061092, 0.3183665265095172, 0.3194004823161417, 0.31973631270344033, 0.319252532526843, 0.3178616516384338, 0.3155139375160965, 0.31219969068377385, 0.30794971052146297, 0.3028337388067942, 0.2969568351841843, 0.29045385487034797, 0.2834824510739568, 0.27621528873068657, 0.2688323906342777, 0.26151467895356467, 0.2544397446621696, 0.24778059557785795, 0.24170755375914557, 0.236392619064649, 0.23201461731966924, 0.22876256377453105, 0.22683426911781665, 0.2264277224686899, 0.22772449406836182, 0.23086713409622617, 0.23593537812549245, 0.2429274296788223, 0.2517515675583738, 0.2622301018377749, 0.2741139552036106 ], [ 0.38057209502226513, 0.3714123874554395, 0.36222930393981523, 0.353209151806369, 0.3445460997707793, 0.3364330283465707, 0.32905123589345636, 0.32255969801851947, 0.31708481813835726, 0.3127117462011067, 0.3094782926431935, 0.3073721777234927, 0.30633186953171604, 0.3062507068794911, 0.30698354945495676, 0.3083549816075715, 0.3101681498385813, 0.31221356285497304, 0.3142774969489428, 0.3161499095490099, 0.317631904556129, 0.3185428084717722, 0.31872684067718116, 0.31805924370535604, 0.3164516246512852, 0.3138561780023637, 0.3102684295132611, 0.30572816560277516, 0.3003182921930432, 0.2941614977586758, 0.28741477393031445, 0.28026206784099755, 0.27290559135358555, 0.26555656640112935, 0.258426392524875, 0.2517193055448687, 0.24562746374167369, 0.2403289774588367, 0.23598868816859714, 0.23276062398744995, 0.2307902684551657, 0.23021442491749608, 0.23115685018042667, 0.23371906201408651, 0.2379675123392116, 0.24391999201728554, 0.2515349019225672, 0.2607064448289198, 0.27126711169207757, 0.2829968655853252 ], [ 0.38169427139526774, 0.3725494531163685, 0.36335470927215413, 0.35429412399709853, 0.3455611529726301, 0.33734979961259814, 0.32984450697929496, 0.3232093853497375, 0.3175776526539308, 0.3130423489969441, 0.30964940422531084, 0.3073939219488887, 0.3062201033492504, 0.3060246760297896, 0.3066631874224065, 0.30795822367607495, 0.3097085876916412, 0.3116986660316926, 0.31370751369032857, 0.31551746276071696, 0.3169222358239891, 0.3177345970843782, 0.3177935287179897, 0.3169708214432487, 0.315176860901037, 0.31236530692907205, 0.3085363186682244, 0.3037379805412747, 0.2980656317484103, 0.29165889245103777, 0.2846963123561434, 0.2773877439049688, 0.2699647650585, 0.26266974096806434, 0.2557443947614179, 0.2494189958695952, 0.24390337085918973, 0.23938077931943263, 0.23600519809043222, 0.2339017617588591, 0.23316922552823, 0.23388268745167676, 0.23609475435340427, 0.23983398205020845, 0.24510057582937395, 0.25186055100640514, 0.2600403233524685, 0.26952372691020665, 0.28015279437201446, 0.29173262646389814 ], [ 0.38271223359322704, 0.37357163900576756, 0.3643553128337673, 0.3552455338866535, 0.34643545285841065, 0.33812056384870226, 0.3304887533243122, 0.323709473724521, 0.3179228626640599, 0.31322985524692953, 0.30968441951579667, 0.3072888985810903, 0.3059930488004387, 0.30569680465862054, 0.3062562438526716, 0.3074918448783823, 0.3091980208931751, 0.31115305732680754, 0.31312886679991586, 0.3149002711750953, 0.3162537315079963, 0.3169955370106054, 0.31695944904508205, 0.31601371649758847, 0.3140672783340777, 0.31107488085000234, 0.3070407796715094, 0.30202067604709654, 0.29612155188943223, 0.28949911497037945, 0.2823526448513769, 0.2749171500881502, 0.26745292696959644, 0.26023287470965933, 0.2535282868710051, 0.24759427833513104, 0.2426564185274067, 0.23890033323670942, 0.23646578596547066, 0.23544593997201876, 0.2358912786054876, 0.23781645281217403, 0.2412076548302694, 0.2460283009251895, 0.25222175489194315, 0.25971110631651145, 0.2683971093219564, 0.278155927925921, 0.2888382458461951, 0.30027075065198905 ], [ 0.3836070302804305, 0.3744581731779596, 0.3652086594720782, 0.3560394625406708, 0.34714392726551396, 0.3387195031022214, 0.3309579154045785, 0.3240342542250864, 0.31809575004333324, 0.3132512739110102, 0.3095627449314702, 0.30703954865427985, 0.3056367201042925, 0.3052570843620256, 0.3057569374181918, 0.3069543845563378, 0.3086392630242243, 0.310583668182664, 0.3125523781096924, 0.31431279071264634, 0.31564423751862974, 0.31634666843574877, 0.31624871737488747, 0.31521509709986417, 0.3131531771754765, 0.3100185063268881, 0.30581896980578166, 0.3006172295263204, 0.294531076764997, 0.2877313285253503, 0.28043691892448197, 0.27290689023757564, 0.2654291118007989, 0.25830581138117686, 0.2518364630297559, 0.24629926268514876, 0.24193323144871576, 0.23892361131111825, 0.23739321161059307, 0.23740139012911388, 0.23895052339457556, 0.24199781040372714, 0.24646896400639348, 0.2522703287306217, 0.25929710150538654, 0.26743699121049647, 0.27657013193056446, 0.2865669293827331, 0.2972856854071833, 0.3085714746273908 ], [ 0.38436238462033756, 0.3751912106111641, 0.365895452124844, 0.35665534951531164, 0.3476650234853298, 0.3391244335461843, 0.3312296321062538, 0.32416172957393014, 0.31807529335951246, 0.31308721329924544, 0.30926727381892355, 0.30663165973638645, 0.305140314952697, 0.3046985071460699, 0.30516228423123737, 0.30634695496088166, 0.30803745217988765, 0.3099994802618488, 0.31199061822098206, 0.31377089709028977, 0.31511266351292966, 0.31580971336187247, 0.3156857255167824, 0.31460198143562534, 0.3124642663578629, 0.3092287502274942, 0.30490656221982865, 0.2995667079567921, 0.2933369279691643, 0.28640205086944587, 0.2789993527150951, 0.27141041368126667, 0.2639490211189984, 0.2569449106468777, 0.2507237022049892, 0.24558436483854165, 0.24177681753077243, 0.23948337974955605, 0.2388079773686683, 0.23977569379200173, 0.2423425961826209, 0.2464128550575597, 0.2518584011893588, 0.25853645052069824, 0.2663018339157177, 0.27501321780325566, 0.2845340946177034, 0.29473042545231376, 0.30546703505443257, 0.3166045207171837 ], [ 0.38496495094554734, 0.3757561170570279, 0.36639986174682565, 0.35707632682545265, 0.3479810631253035, 0.3393171767535698, 0.33128562234328435, 0.32407399819307864, 0.31784452446767475, 0.3127222382806472, 0.30878471058757223, 0.30605464208052535, 0.3044964274248034, 0.30401720059066717, 0.304472142632674, 0.30567318590897574, 0.3073998892005239, 0.3094112544953622, 0.3114575266789505, 0.31329139957061714, 0.3146783935707321, 0.3154063860876108, 0.3152943526770812, 0.3142003476741602, 0.31202866602563084, 0.30873602363852265, 0.3043364952885682, 0.29890486263903643, 0.2925779425977782, 0.2855533752697731, 0.2780852458002269, 0.27047581755807765, 0.26306264225543563, 0.25620054035340867, 0.2502386277376938, 0.24549386275544738, 0.24222436734401373, 0.24060737040758826, 0.2407269285666595, 0.24257475355800096, 0.24606384474425438, 0.2510508415915857, 0.2573609661176526, 0.2648098691671335, 0.2732189050379805, 0.28242297259861826, 0.2922720446303307, 0.3026285104349774, 0.3133626187256279, 0.3243479388160562 ], [ 0.3854045351949936, 0.37614171522218687, 0.36670979885609906, 0.3572895146265144, 0.34807855963434237, 0.33928389545384613, 0.33111203382082166, 0.3237576088452501, 0.3173908797585459, 0.31214520663219303, 0.3081058785679029, 0.3053017928076304, 0.3037012525905682, 0.3032125574505518, 0.303689254183525, 0.3049391665709107, 0.3067358734432197, 0.30883125797245015, 0.3109680305848283, 0.3128915543665371, 0.3143606985833701, 0.3151577084026656, 0.3150971854286169, 0.31403425746877495, 0.31187192896196747, 0.3085674904464291, 0.3041377521350009, 0.2986627586072757, 0.29228752861084417, 0.2852212288889157, 0.27773302501297736, 0.2701436807349059, 0.2628118978310028, 0.25611460589344515, 0.2504212220067041, 0.2460635354738459, 0.24330516375635292, 0.24231656881470134, 0.24316193938118197, 0.2458017841466969, 0.25011044932526216, 0.2559032538645664, 0.26296584563017933, 0.271079340800442, 0.2800376311690963, 0.2896562218187053, 0.299774017697458, 0.3102503972761237, 0.3209599740472007, 0.33178702970207313 ], [ 0.38567427740127597, 0.37634049171426837, 0.36681714535969095, 0.3572862775572714, 0.34794849775561465, 0.3390153933377885, 0.3306997587473128, 0.32320388578652576, 0.31670652598199117, 0.311349584316403, 0.3072260111858193, 0.30437054755783555, 0.3027547822820098, 0.3022873595782691, 0.30281928167865735, 0.30415338679419457, 0.30605654080219036, 0.3082729963959242, 0.3105376730436714, 0.31258859335784606, 0.314178170797631, 0.3150833552484532, 0.31511477800381466, 0.3141250312662649, 0.31201612702259823, 0.30874605588655046, 0.30433423680779903, 0.2988655189156783, 0.2924922544484471, 0.28543378548702847, 0.27797246501946, 0.2704450934954784, 0.26322851353935733, 0.25671832269499245, 0.2513006101977595, 0.24731859166483638, 0.2450387825096258, 0.24462376047926085, 0.24611878581715058, 0.24945639807837522, 0.25447755883573464, 0.2609628533413511, 0.26866531361999135, 0.27733794691584457, 0.2867524026512103, 0.2967084282054975, 0.3070358045076854, 0.31759125311073905, 0.328252765600474, 0.33891334620222513 ], [ 0.38577079416528737, 0.3763487626694451, 0.36671794461979773, 0.35706243980598856, 0.34758657310606417, 0.3385073772466264, 0.33004471491980214, 0.32240922284506995, 0.3157886589158826, 0.3103337376783469, 0.3061450240833577, 0.3032627169176549, 0.30166098923095835, 0.3012478936855677, 0.30187084264470454, 0.3033266781474813, 0.30537470671899447, 0.30775095820569054, 0.31018226161712414, 0.3123992829370733, 0.3141482004614527, 0.31520105636730256, 0.31536498451766265, 0.31449051380154214, 0.31247904871392496, 0.30928949039263315, 0.3049438136368605, 0.2995312641449751, 0.29321067029001724, 0.2862101504034393, 0.2788232253315897, 0.2714000499636608, 0.2643322947002072, 0.258030438998741, 0.25289332390391156, 0.249272084115561, 0.24743374828166123, 0.2475324587933745, 0.2495962923018433, 0.25353385092274827, 0.25915850072053415, 0.26622276365724806, 0.2744536727486039, 0.28358193546516614, 0.2933614899521684, 0.30357937755910386, 0.31405782855442044, 0.3246511388539542, 0.3352397888479503, 0.34572376662246695 ], [ 0.3856942786413171, 0.37616679536593267, 0.3664125468925522, 0.3566184559100232, 0.3469933888128685, 0.33776067861204817, 0.3291480889588314, 0.3213753430339759, 0.3146397711983972, 0.30910119845851614, 0.30486776357953926, 0.3019847025614746, 0.30042799430620354, 0.30010405396325857, 0.30085553434961293, 0.30247215259025834, 0.3047047148728228, 0.30728037467082425, 0.3099175453574569, 0.31233952632071627, 0.31428651300353755, 0.31552607773402835, 0.31586239257443127, 0.3151444653397709, 0.31327355030922355, 0.31020973909502647, 0.3059775697088866, 0.30067031889243195, 0.29445244731278164, 0.28755942179929905, 0.28029382795990165, 0.27301634858946716, 0.26612997547414563, 0.26005608363918986, 0.2552022167991092, 0.25192396365387165, 0.2504867679069284, 0.25103630128108306, 0.25358581267958114, 0.2580244956663452, 0.2641441128311748, 0.27167563807567213, 0.2803262764975387, 0.28980965521438773, 0.2998659544337204, 0.3102721129655528, 0.3208441270321374, 0.33143404260992254, 0.34192405581747143, 0.3522196351645326 ], [ 0.38544855512361775, 0.3757988824722277, 0.36590570636759245, 0.35595953313474593, 0.34617460471396755, 0.3367814293468265, 0.3280165365836155, 0.32010951822977585, 0.31326788340041467, 0.3076608951340213, 0.3034042243623869, 0.3005476854603399, 0.29906820897219877, 0.2988694240218429, 0.29978794392840963, 0.3016051344431226, 0.3040622902049779, 0.30687699834070503, 0.30975892707539665, 0.3124240205242502, 0.31460678258258035, 0.3160708032284891, 0.3166178833211875, 0.31609610841383307, 0.3144070952127166, 0.3115124572042255, 0.307439347155685, 0.30228473972542774, 0.29621789889379024, 0.2894802033356541, 0.28238116337145047, 0.2752891005741298, 0.26861474965838433, 0.2627863497046814, 0.2582161347301326, 0.2552608556811791, 0.254182599319706, 0.25511895197591594, 0.2580710739481502, 0.2629134763274113, 0.2694222329457838, 0.27731294638143034, 0.28627866140781966, 0.2960206018244576, 0.3062686709462193, 0.3167919756613533, 0.32740142924411875, 0.3379469998667191, 0.34831195621605926, 0.3584059653595173 ], [ 0.38504108492715344, 0.37525336493721445, 0.36520662511697016, 0.35509570005737834, 0.34514103310229033, 0.3355811855614063, 0.3266623327221834, 0.31862474111665534, 0.3116867298899728, 0.30602734143017407, 0.3017697265438228, 0.29896777573539274, 0.2975984423888621, 0.29756132807829033, 0.2986856349253662, 0.300743079267136, 0.3034643930223244, 0.30655690032138455, 0.30972121530785574, 0.31266597645360084, 0.3151203342100015, 0.31684443213991953, 0.3176383365231351, 0.3173498512495095, 0.3158815051041473, 0.31319679700034836, 0.3093255731510877, 0.30436819478015137, 0.2984979163774504, 0.29196060335403107, 0.2850705617468275, 0.27820088355833733, 0.27176651749864655, 0.2661986407983183, 0.2619103541695019, 0.25925655814123216, 0.25849454345875716, 0.2597544951661248, 0.26302837704681764, 0.26818067006481505, 0.2749773675488511, 0.28312440697229835, 0.29230581131606836, 0.30221458941552115, 0.31257346806993574, 0.32314575271011287, 0.33373832958708843, 0.3441992963910821, 0.3544124901732004, 0.3642907041631856 ], [ 0.38448291994642175, 0.3745425989633823, 0.3643289383912118, 0.3540418147690755, 0.3439086734196815, 0.3341769905479847, 0.3251034619806899, 0.31693983903366424, 0.30991588824870797, 0.30422076990421176, 0.299985039221528, 0.2972661108188385, 0.2960399598590969, 0.2962008389095442, 0.2975690994978559, 0.2999054714943214, 0.3029290692671744, 0.30633628501412624, 0.3098184181049577, 0.3130769073305929, 0.3158359421547247, 0.3178528019680049, 0.3189264910901662, 0.3189051984576271, 0.3176929327563275, 0.3152554547468535, 0.3116253933706802, 0.30690619703186867, 0.30127431628269696, 0.2949787105016869, 0.28833641034633617, 0.28172250969779683, 0.2755528034667839, 0.2702577193236175, 0.26624771453172724, 0.26387317891687306, 0.26338548092993225, 0.2649082590155096, 0.26842711861605995, 0.2738008673055254, 0.28079054737661474, 0.28909757912213896, 0.2984015677459523, 0.3083910570971764, 0.31878439056365226, 0.329340932531993, 0.3398645541828988, 0.35020175208643317, 0.3602365709409498, 0.3698840558771561 ], [ 0.3837886001171155, 0.3736828620843474, 0.3632906349558705, 0.3528175049846662, 0.34249867676524787, 0.3325913665023322, 0.32336363761351056, 0.3150795166215198, 0.30798083799011594, 0.30226719534753604, 0.2980764345482156, 0.2954688856320884, 0.2944184767384913, 0.2948127279755479, 0.29646166388457246, 0.29911369133773774, 0.3024752907693138, 0.30623131933950903, 0.3100635783811357, 0.31366648713044315, 0.31675972727059526, 0.3190983390607796, 0.3204809623802297, 0.32075684792998116, 0.31983205178630075, 0.3176749676277223, 0.3143210920650371, 0.3098766652466713, 0.3045205611550914, 0.29850349310616736, 0.29214324612655124, 0.2858143163416609, 0.27993023127206246, 0.2749173236093041, 0.2711802994330331, 0.26906276921459626, 0.26880932751063397, 0.270537974062304, 0.27423057497156406, 0.2797441630677266, 0.2868393642837071, 0.295217620086806, 0.3045581932794509, 0.31454851571845444, 0.32490508698821613, 0.3353850695445492, 0.3457903214481098, 0.3559660856852493, 0.3657963974381362, 0.37519786626304563 ], [ 0.38297599106177393, 0.37269419317465485, 0.36211390563857515, 0.35144703141966865, 0.3409372296861203, 0.33085222255858343, 0.32147223475286796, 0.3130743113570015, 0.305912931214545, 0.30019838950824473, 0.2960756531583881, 0.293607295677399, 0.2927640696541124, 0.293425341496391, 0.29538933370888587, 0.2983908408153811, 0.3021227785435383, 0.3062579721951145, 0.31046864832521337, 0.3144424771028564, 0.3178951506287084, 0.3205801324955218, 0.3222964084074722, 0.32289496141803514, 0.32228444463499245, 0.32043623399759835, 0.3173887617959993, 0.3132507626759843, 0.3082027878624433, 0.3024960362181767, 0.2964472142309081, 0.2904278445129217, 0.28484639672093076, 0.28012217563558356, 0.27665148153942243, 0.2747692769865507, 0.2747127589409306, 0.2765951549705519, 0.2803968766765245, 0.2859765211149439, 0.2930981731880143, 0.30146720242635067, 0.31076608781446946, 0.3206841357995653, 0.33093832341012647, 0.3412852586625107, 0.35152579729573163, 0.36150436098723615, 0.3711048974631226, 0.3802450679977425 ], [ 0.3820660585433092, 0.37160016134662793, 0.3608249130711166, 0.3499590651980296, 0.3392553456258836, 0.32899266506883096, 0.31946412146133935, 0.31096044338580414, 0.3037492548306869, 0.2980517455386757, 0.2940197589100339, 0.2917173715556712, 0.29111098523507095, 0.2920703854294345, 0.294380565499456, 0.2977615188190947, 0.3018918020863734, 0.30643185907082926, 0.31104439839791526, 0.31541071503950174, 0.3192430958158443, 0.3222941199057014, 0.32436382868710195, 0.32530558619419664, 0.32503115831081025, 0.3235152167798586, 0.32079917071203556, 0.3169939466663356, 0.3122810586341493, 0.3069110104630765, 0.3011977626325694, 0.29550775071769614, 0.2902419617898022, 0.28581018817548504, 0.2825981381892379, 0.2809306420320775, 0.28103705575943333, 0.28302659371799566, 0.28688009904615996, 0.29246046633940675, 0.29953843484536347, 0.30782657908178845, 0.3170136513255478, 0.3267934733240154, 0.3368856215978636, 0.3470477192179202, 0.35708064531193556, 0.3668285154766222, 0.3761752427282928, 0.3850391889450481 ], [ 0.38108257705277643, 0.3704275592398619, 0.3594534759031989, 0.3483863699699696, 0.337488551835136, 0.3270506949233025, 0.317379369453436, 0.30877953884294135, 0.30153236143498957, 0.2958700080136722, 0.2919508586829193, 0.2898396818991232, 0.2894973259451286, 0.2907826025798956, 0.2934659517203266, 0.29725153620932127, 0.30180294825707615, 0.30676808646423426, 0.31180035490995744, 0.3165751590011892, 0.3208020278931935, 0.32423336828085575, 0.32667097263970357, 0.3279711974678174, 0.3280493890307666, 0.3268837810578333, 0.324518766424433, 0.3210671540142559, 0.31671074297444224, 0.3116982618173743, 0.3063394415895358, 0.3009938008106933, 0.29605280246779486, 0.2919146955988785, 0.2889528652377606, 0.28748087621366436, 0.287719937953069, 0.2897758650716067, 0.2936313989808785, 0.299155859487342, 0.3061291702327962, 0.3142737777011175, 0.32328728133190543, 0.33287032597396987, 0.3427470173532001, 0.3526774861410825, 0.3624636712680796, 0.3719499716515535, 0.38102043664871277, 0.38959392460825853 ], [ 0.3800517709905084, 0.3692060172934029, 0.3580326616927684, 0.34676538006404556, 0.3356764597809626, 0.3250687764268449, 0.3152628255089858, 0.30657820456220114, 0.2993098444047865, 0.2937008429254292, 0.28991566203915947, 0.2880188816286515, 0.28796459354211573, 0.28959932688820594, 0.2926778088650707, 0.2968875640473845, 0.30187685475764303, 0.30728109105554374, 0.31274475918938777, 0.3179379749543111, 0.32256821364679195, 0.32638842858400335, 0.32920282981252197, 0.33087132645630996, 0.33131325243845244, 0.33051061326939596, 0.3285107533569622, 0.32542804696105077, 0.3214439419350657, 0.3168044193358073, 0.3118136904069941, 0.30682281556085905, 0.30221207128499744, 0.2983665672351599, 0.29564605439401237, 0.29435200852230997, 0.29469728912341525, 0.29678476562727363, 0.30060013907531297, 0.306020711046008, 0.3128374952450872, 0.3207849016143179, 0.3295714889625354, 0.33890670870588696, 0.3485209317818042, 0.35817820417766266, 0.3676825598769762, 0.37687933040312915, 0.3856529751359907, 0.3939227756290627 ], [ 0.37900188852179734, 0.36796753731326953, 0.3565982844084697, 0.3451356676153127, 0.3338622084645417, 0.3230932632632636, 0.3131635252175851, 0.3044074323701618, 0.2971337329602495, 0.2915962225259466, 0.28796485668489213, 0.28630308453639003, 0.28655707375812783, 0.28855990367031953, 0.29204966199392124, 0.2966967113541904, 0.3021339054526702, 0.30798446952706166, 0.31388454098957896, 0.31949965635161093, 0.3245359856416323, 0.3287477406208057, 0.33194217191551345, 0.33398323736874613, 0.3347945955636991, 0.3343621706250143, 0.3327361841021904, 0.3300322517310703, 0.32643087766967893, 0.3221744349164743, 0.31756051780188094, 0.31293046873293334, 0.3086520735715075, 0.30509610527527725, 0.30260774365515813, 0.30147581561051856, 0.3019047030524862, 0.3039946308326776, 0.3077349532125048, 0.3130119965583262, 0.3196292048161823, 0.3273345126866717, 0.3358491144366849, 0.3448929344988849, 0.3542041456281537, 0.3635520187196344, 0.37274369996359474, 0.38162614443668436, 0.39008457961458964, 0.39803875038234066 ], [ 0.3779627103348006, 0.3667459460916037, 0.35518830516527805, 0.3435392944492336, 0.33209177293463576, 0.3211736698956472, 0.3111339334028646, 0.3023218138295482, 0.2950596857888385, 0.28961160321581797, 0.28615227980032665, 0.28474304425028796, 0.2853210515792352, 0.28770497057209016, 0.2916156245858133, 0.2967060331739441, 0.3025938877156264, 0.3088907964018452, 0.3152252990817014, 0.3212591632088264, 0.3266980318177223, 0.331298064021283, 0.3348701167732113, 0.3372826178135187, 0.3384638095968019, 0.33840361450124357, 0.33715501334628806, 0.33483453323635953, 0.331621187492323, 0.3277529909552298, 0.32352001004461084, 0.3192528725618816, 0.3153058957917176, 0.31203467149861674, 0.30976919238184497, 0.3087852962098343, 0.3092788161461926, 0.31134749634770403, 0.3149847214707251, 0.3200864425518216, 0.32646937788183544, 0.3338960708518853, 0.34210162099522, 0.35081778382722306, 0.3597918644861158, 0.3687995547051137, 0.3776520923792619, 0.386198768186674, 0.3943260002112345, 0.40195413167080396 ], [ 0.3769649981953979, 0.36557627303678386, 0.35384213856163205, 0.3420200487662425, 0.3304131350117776, 0.31936178187542624, 0.3092290010657758, 0.300378552199937, 0.2931459682863773, 0.2878048818868094, 0.28453387336345753, 0.28339113638668356, 0.28430385544294495, 0.28707560238375973, 0.29140967967101095, 0.29694197505593506, 0.3032756154900394, 0.3100114292285814, 0.31677128288154127, 0.32321406866900115, 0.3290456929012669, 0.33402491232431303, 0.3379666864593639, 0.34074425075505066, 0.34229060802693595, 0.34259968935587864, 0.34172707354940474, 0.33978986359561975, 0.33696507966368133, 0.3334857341893455, 0.32963362812169833, 0.32572791680796376, 0.3221087586979825, 0.31911602262719624, 0.3170641666825103, 0.3162158781217289, 0.31675841388590315, 0.31878708842860864, 0.3222994345007079, 0.3272012595904915, 0.3333229781690058, 0.3404424061457092, 0.3483094457678615, 0.3566687450017422, 0.36527786091148784, 0.37391997317748027, 0.3824113332184071, 0.39060427908933243, 0.398386885691347, 0.40568030534263233 ], [ 0.3760398913217151, 0.3644940597029938, 0.3525998718150853, 0.34062257247231387, 0.32887532004967696, 0.3177106063676466, 0.307505037546182, 0.2986362682824797, 0.291452209422031, 0.28623512808016943, 0.2831664242939424, 0.28230014757595173, 0.2835527408766116, 0.2867123334813402, 0.29146487659082876, 0.2974297660190502, 0.304196525559706, 0.3113563026987109, 0.31852537038758966, 0.32536070231873165, 0.33156925158835376, 0.3369129696971139, 0.3412113356338903, 0.3443426414070511, 0.3462447417496491, 0.3469155178508415, 0.3464129431012481, 0.3448543563457777, 0.34241432530388816, 0.33932031424065856, 0.33584527820975274, 0.3322963528461914, 0.32899909444703146, 0.3262773602009261, 0.3244299450560272, 0.32370636773974126, 0.3242853170046126, 0.32625964178006905, 0.3296309376756843, 0.33431480589810525, 0.3401554300423272, 0.34694620117143143, 0.3544523866009855, 0.3624323070065996, 0.3706546783108158, 0.3789110936312123, 0.3870236633475732, 0.3948484635820151, 0.40227571534790607, 0.40922764743540413 ], [ 0.3752182620596268, 0.3635346136303943, 0.35150140968919624, 0.3393913922708556, 0.3275273124778888, 0.31627317488971274, 0.30601840912017864, 0.2971536111223935, 0.2900379501432118, 0.2849611064088872, 0.2821061077565458, 0.28152189391676696, 0.2831136391407034, 0.28665408391763997, 0.2918124667895659, 0.2981927781397141, 0.3053722583000846, 0.31293371564763733, 0.32048903951498897, 0.32769428146446267, 0.3342582000429884, 0.33994647338993195, 0.3445834308844807, 0.3480525786145762, 0.35029663043290254, 0.3513172921988034, 0.3511746887567337, 0.34998605113346726, 0.3479230755404605, 0.3452072216962215, 0.3421021572873147, 0.3389026323264301, 0.3359193646053258, 0.33346011750119875, 0.33180806910867966, 0.33119966492565195, 0.3318050640631802, 0.33371455258036037, 0.3369335529957398, 0.3413871710810759, 0.34693315307202294, 0.35338046476561746, 0.3605100052990566, 0.3680942867696542, 0.3759138810031398, 0.38376956930578987, 0.39149007404393843, 0.3989358599115317, 0.4059997867943011, 0.4126054652818604 ], [ 0.3745300459192531, 0.36273222376908903, 0.3505855646757229, 0.33836987605693036, 0.3264168735791571, 0.3151012235145318, 0.3048240911672751, 0.29598770300530436, 0.28896101578178063, 0.28403962542063715, 0.28140687354167687, 0.2811057112716389, 0.283029813167486, 0.28693702796616827, 0.2924810108725522, 0.29925187647272206, 0.3068162375495103, 0.31475011713763923, 0.32266233192389454, 0.3302090239838714, 0.33710147543664604, 0.3431095492000804, 0.34806266713805495, 0.3518496166689414, 0.35441789696026577, 0.35577285040182366, 0.3559764738857018, 0.355145544375727, 0.35344850447633364, 0.3511004324862038, 0.348355387606501, 0.34549552123991345, 0.34281664612856677, 0.34061051473085263, 0.33914487138422567, 0.3386432722052716, 0.3392674127003703, 0.34110487983392723, 0.344164582084353, 0.34838067448252624, 0.3536240432535236, 0.3597189808607681, 0.3664620298187377, 0.3736401738341984, 0.381046335029993, 0.3884911021639432, 0.39581045774195717, 0.40286984884504196, 0.4095652525620946, 0.4158219869779415 ], [ 0.3740035644415569, 0.3621193595781115, 0.3498891185496253, 0.337599145119179, 0.3255892967062953, 0.3142437907160285, 0.30397411931071283, 0.29519246956849854, 0.2882757686399878, 0.28352377371838045, 0.281118739119629, 0.2810968806002725, 0.2833404795652418, 0.2875934556352722, 0.29349549662638164, 0.3006247873695681, 0.3085392667987929, 0.31680989971516343, 0.3250438104707086, 0.3328982390064951, 0.3400876567318143, 0.3463864915992843, 0.35162941247130686, 0.35571046958285235, 0.3585817985832885, 0.360252133481944, 0.3607850319738545, 0.36029646955122924, 0.3589512867235559, 0.3569578731014196, 0.35456046072301767, 0.352028515986758, 0.3496430166784044, 0.34767991648625535, 0.34639181412130854, 0.34598962865341953, 0.3466266835808156, 0.34838771076574604, 0.3512846970221479, 0.3552602766040365, 0.36019789267690816, 0.36593671988181065, 0.3722887404655603, 0.3790554769974771, 0.38604250505720317, 0.39307068440250403, 0.3999837925383343, 0.4066527827440842, 0.4129771976230831, 0.41888439277631917 ], [ 0.373664862250524, 0.3617258801665626, 0.3494458875619189, 0.3371169812290923, 0.32508614671296465, 0.31374578806204756, 0.30351600358524944, 0.29481692775777746, 0.2880313210094236, 0.28346112857014294, 0.2812860754911759, 0.28153507017089496, 0.284079469116601, 0.2886506864227162, 0.2948765125789815, 0.30232551571978383, 0.310549160298304, 0.31911520927123194, 0.3276305132691858, 0.33575439431982185, 0.3432051193875795, 0.3497619844222081, 0.3552649775437886, 0.35961331525869106, 0.3627635541820394, 0.3647275257665309, 0.3655700107768325, 0.3654058365127261, 0.3643959234530093, 0.3627417255421387, 0.3606775149470134, 0.3584600897729636, 0.35635577089713766, 0.35462502458963063, 0.3535056711232237, 0.35319629730771224, 0.353841970364209, 0.3555244065558774, 0.35825822767569837, 0.3619939049369438, 0.36662674279378943, 0.37201020325314066, 0.3779713278658598, 0.38432605948309706, 0.3908927539682493, 0.39750285394852575, 0.4040083492054275, 0.41028614321068424, 0.4162397494833195, 0.42179888137587396 ], [ 0.3735370816267395, 0.3615782830088802, 0.34928582834971433, 0.3369567747054468, 0.3249440401324931, 0.31364661190346077, 0.3034911859011612, 0.294903523324944, 0.2882698092865683, 0.28389204210913, 0.2819459891127182, 0.28245288931697843, 0.28527400622259835, 0.29013009850328364, 0.29663952290887946, 0.3043638416752051, 0.31285042766907384, 0.3216657815509918, 0.33041790887005296, 0.33876916183525974, 0.3464421478957858, 0.3532212618592992, 0.35895181014968497, 0.3635380115013566, 0.36694057161985666, 0.3691740847644157, 0.3703041966889305, 0.37044424283056704, 0.36975093373659557, 0.36841859266410404, 0.3666714705818586, 0.3647537967972523, 0.36291749711558496, 0.3614079362757771, 0.3604485815078594, 0.3602260318981163, 0.36087723697857926, 0.36248074409039344, 0.3650533550359027, 0.3685526976110042, 0.37288516922354903, 0.3779178145868321, 0.38349221324253446, 0.38943845145775485, 0.3955876333720037, 0.4017819524153027, 0.4078819099767395, 0.4137707176397445, 0.4193562123500808, 0.42457076375554387 ], [ 0.37363989864840297, 0.3616990232540913, 0.34943422426435533, 0.33714656371280466, 0.3251935287680838, 0.31397887256065604, 0.3039336315626799, 0.2954866215307043, 0.2890248419853834, 0.28484812078899246, 0.28312691058038464, 0.28387465189859906, 0.2869436877038147, 0.29204633422286247, 0.2987942864193248, 0.3067449247598997, 0.3154440290728671, 0.32445881516735436, 0.3333998581243934, 0.34193344451393576, 0.34978700885369673, 0.3567502127650306, 0.36267361889467625, 0.3674662293817547, 0.3710925825985726, 0.3735696702810597, 0.37496363151244777, 0.3753859721232436, 0.3749889290303966, 0.3739595446079258, 0.37251204616856837, 0.3708782593679539, 0.3692960406478605, 0.3679960937680642, 0.3671880000330775, 0.36704674508445556, 0.3677013208900084, 0.36922696815691464, 0.3716422202511521, 0.3749111696713726, 0.37895049829956107, 0.38364005378434707, 0.38883532417346034, 0.39438013104098735, 0.4001181551110874, 0.40590237533871143, 0.41160198923586877, 0.41710678548369007, 0.42232921704265525, 0.4272045771557531 ], [ 0.37398904410133943, 0.36210593399296215, 0.3499109915066498, 0.3377082152518793, 0.32585815018635467, 0.3147673189316912, 0.30486864728957735, 0.2965912559580388, 0.29032023420013925, 0.28635101101042837, 0.2848474950437218, 0.2858154394105573, 0.2890997319345217, 0.29440673368412706, 0.3013444548013144, 0.30946903800596515, 0.3183272150170811, 0.3274888899681621, 0.3365685888082624, 0.3452373897241473, 0.35322798951706275, 0.3603354338828353, 0.3664154327021973, 0.37138151206802555, 0.3752016947801343, 0.37789498437887525, 0.3795276352230715, 0.3802089950463214, 0.38008658853274174, 0.3793400659480945, 0.37817367692682224, 0.3768070601477196, 0.375464376162307, 0.37436214722096356, 0.3736965646703102, 0.3736313968639257, 0.3742878584240572, 0.3757377670364184, 0.3780009588092672, 0.38104730770072903, 0.3848029573318881, 0.3891597325746943, 0.3939863214581709, 0.39913976726701955, 0.40447603584027114, 0.40985880608241065, 0.4151660473863624, 0.4202943058034617, 0.42516087877566705, 0.42970421202984843 ], [ 0.3745959298154234, 0.3628117747811687, 0.3507301407581031, 0.3386567937955521, 0.32695370303074506, 0.31602802938865193, 0.3063120090818632, 0.29823222854212594, 0.2921691261289017, 0.2884115858703895, 0.28711591932723846, 0.28828053343129406, 0.2917445507784332, 0.2972110329804854, 0.30428737414922136, 0.3125314473461113, 0.32149346069301904, 0.3307479378659535, 0.3399146890287374, 0.3486703950115239, 0.35675340838876496, 0.36396423946561435, 0.3701636047559466, 0.37526926899003865, 0.37925237239295495, 0.3821335348232106, 0.38397874883160765, 0.38489488848474607, 0.38502455230929333, 0.38453992159123257, 0.38363535422127526, 0.38251855869708157, 0.3814004081122876, 0.3804837492939674, 0.37995189850592387, 0.3799578186688508, 0.3806151457920439, 0.38199218298273213, 0.3841096688893718, 0.3869425990519406, 0.39042576192328254, 0.3944621119272009, 0.3989327749005086, 0.40370742064506643, 0.40865390874111407, 0.4136464264910053, 0.4185716905210146, 0.4233330986811088, 0.42785295564544024, 0.43207304524372037 ], [ 0.3754673968825227, 0.3638239302588405, 0.35189942288337894, 0.34000015422820357, 0.3284877929304367, 0.31776792408420534, 0.30826946320549026, 0.3004136291652957, 0.29457355417940384, 0.2910295959976829, 0.2899296282843676, 0.2912652570063945, 0.294871671364547, 0.30045134405324125, 0.3076140999346079, 0.3159224427132012, 0.3249324997673, 0.3342252709194842, 0.3434271248335195, 0.35222111269163625, 0.3603516053678597, 0.3676246359515124, 0.37390577065354774, 0.3791167162009262, 0.38323135725248914, 0.38627153498415245, 0.38830261131073274, 0.3894286878350513, 0.3897872478473916, 0.3895429576408327, 0.3888804025245824, 0.38799564868394043, 0.3870867151205622, 0.3863432964557162, 0.3859363600415627, 0.3860084860519789, 0.38666594743425503, 0.3879734677683377, 0.3899523224001216, 0.3925820022574487, 0.3958051446897645, 0.39953498333528276, 0.4036642877014924, 0.4080746989610283, 0.41264549836209735, 0.4172610990923022, 0.42181684996182023, 0.4262230142337526, 0.43040700154151923, 0.4343140734545588 ], [ 0.3766055965985942, 0.3651442731989104, 0.3534201772297099, 0.34173878233725863, 0.3304596770565481, 0.3199846307910107, 0.31073663462733914, 0.30312880832261235, 0.29752450368705163, 0.29419380587220034, 0.2932755427042661, 0.29475522901534984, 0.29846600601510054, 0.3041124118440204, 0.31130962108126026, 0.31962751811200735, 0.3286304572524802, 0.337907668767079, 0.3470932863833415, 0.35587745955129785, 0.3640109193402881, 0.3713052708907598, 0.3776307710654944, 0.38291277416941405, 0.3871275422522029, 0.390297752976797, 0.3924877839991804, 0.3937986863003769, 0.39436266431327505, 0.39433685164374516, 0.3938962081825794, 0.39322546968739436, 0.39251025162853515, 0.3919276295438316, 0.39163675355839933, 0.391770250763906, 0.39242726163906894, 0.3936688923628999, 0.3955166267189939, 0.39795386531474003, 0.4009303304695883, 0.40436869720015417, 0.40817257073995133, 0.41223486772686346, 0.416445756356458, 0.42069951732580113, 0.42489993722860686, 0.42896408422652743, 0.4328245082280021, 0.43643004140258246 ], [ 0.3780080083886794, 0.36676919740382824, 0.35528738901635837, 0.34386588999006806, 0.33286041412496503, 0.3226667090796212, 0.31369934342871164, 0.30636079666933647, 0.301002428641785, 0.2978825926664407, 0.29713069970790734, 0.2987270002228345, 0.3025044409143831, 0.3081721243142826, 0.3153532752069598, 0.32362768933272446, 0.33257007597828925, 0.3417795246913096, 0.35089906563107, 0.35962663733582617, 0.36771966089780084, 0.37499536528683935, 0.38132854916064657, 0.38664793409625, 0.3909318090594165, 0.39420332226741184, 0.3965255350707036, 0.3979961940057663, 0.398742087378523, 0.39891282495703295, 0.3986739123911694, 0.39819908548632194, 0.39766201803877216, 0.39722770408308955, 0.39704400934708967, 0.39723404141074836, 0.3978900521017286, 0.3990695189032293, 0.40079384468462126, 0.40304979856756046, 0.40579346360971885, 0.40895614248722245, 0.41245146930701415, 0.41618291619238673, 0.4200509574865542, 0.4239593218430667, 0.4278199714479799, 0.43155665256768677, 0.4351070324338185, 0.4384235607524691 ], [ 0.3796675919954818, 0.3686898164166037, 0.357489949582014, 0.34636775521434127, 0.3356733046276407, 0.32579420987329827, 0.3171342962210394, 0.3100831270931234, 0.3049781832852152, 0.30206494490063984, 0.30146326075839824, 0.303149010041277, 0.3069566913505118, 0.3126022345926162, 0.3197193260468071, 0.3278999308226134, 0.3367310267181216, 0.3458230468773473, 0.35482896681788717, 0.36345516870019284, 0.3714660872119809, 0.37868463800442836, 0.38499003257335224, 0.39031410330394134, 0.3946368410923569, 0.39798152516246094, 0.40040959566848033, 0.40201526856863273, 0.402919806130175, 0.40326532846785357, 0.4032080791788982, 0.40291113905850856, 0.402536708934502, 0.40223823930710295, 0.40215284219215763, 0.40239454065668573, 0.40304895309117544, 0.40416994238641885, 0.40577857998046357, 0.40786450884461556, 0.41038949324107676, 0.4132926825203954, 0.4164969458730939, 0.41991558108255894, 0.42345875664584415, 0.42703918234149585, 0.430576677579864, 0.43400148222486234, 0.43725630490238354, 0.4402972160745158 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.0141576 (SEM: 0)
x1: 0.0685762
x2: 0.718234
x3: 0.335965
x4: 0.897475
x5: 0.601168
x6: 0.710612", "Arm 10_0
hartmann6: -0.323145 (SEM: 0)
x1: 0.666982
x2: 0.664268
x3: 0.693438
x4: 0.80162
x5: 0.765403
x6: 0.152042", "Arm 11_0
hartmann6: -0.849672 (SEM: 0)
x1: 0.282084
x2: 0.0673875
x3: 0.413584
x4: 0.480315
x5: 0.0656645
x6: 0.636843", "Arm 12_0
hartmann6: -0.405476 (SEM: 0)
x1: 0.206254
x2: 6.60798e-14
x3: 0.298768
x4: 0.493777
x5: 6.34186e-14
x6: 0.702143", "Arm 13_0
hartmann6: -0.67418 (SEM: 0)
x1: 0.200045
x2: 0.0480718
x3: 0.441246
x4: 0.472412
x5: 0.0317254
x6: 0.712375", "Arm 14_0
hartmann6: -0.894065 (SEM: 0)
x1: 0.328193
x2: 0.0693257
x3: 0.450113
x4: 0.463215
x5: 0.0705689
x6: 0.60032", "Arm 15_0
hartmann6: -0.913914 (SEM: 0)
x1: 0.417384
x2: 0
x3: 0.699884
x4: 0.350061
x5: 0.0855929
x6: 0.580207", "Arm 16_0
hartmann6: -0.741567 (SEM: 0)
x1: 0.15606
x2: 0
x3: 0.587224
x4: 0.369418
x5: 0.0811765
x6: 0.401662", "Arm 17_0
hartmann6: -0.516029 (SEM: 0)
x1: 0.498267
x2: 0.0518496
x3: 0.671262
x4: 0.518782
x5: 0.0656804
x6: 0.668412", "Arm 18_0
hartmann6: -1.34079 (SEM: 0)
x1: 0.323201
x2: 0.20733
x3: 0.556927
x4: 0.334392
x5: 0.080051
x6: 0.669071", "Arm 19_0
hartmann6: -1.4463 (SEM: 0)
x1: 0.299306
x2: 0.252011
x3: 0.626811
x4: 0.28573
x5: 0.109757
x6: 0.855278", "Arm 1_0
hartmann6: -0.0935411 (SEM: 0)
x1: 0.949338
x2: 0.0491182
x3: 0.556218
x4: 0.320373
x5: 0.292361
x6: 0.187725", "Arm 20_0
hartmann6: -0.45554 (SEM: 0)
x1: 0.291316
x2: 0.280218
x3: 0.991354
x4: 0.257568
x5: 0.128539
x6: 0.385291", "Arm 21_0
hartmann6: -1.12908 (SEM: 0)
x1: 0.396724
x2: 0.37477
x3: 0.381043
x4: 0.285986
x5: 0.106864
x6: 0.787727", "Arm 22_0
hartmann6: -1.36787 (SEM: 0)
x1: 0.216635
x2: 0.150787
x3: 0.46828
x4: 0.286583
x5: 0.114892
x6: 0.859544", "Arm 23_0
hartmann6: -0.94263 (SEM: 0)
x1: 0.51546
x2: 0.196726
x3: 0.628195
x4: 0.223741
x5: 0.0811501
x6: 0.861798", "Arm 2_0
hartmann6: -0.478455 (SEM: 0)
x1: 0.581462
x2: 0.980194
x3: 0.132119
x4: 0.674815
x5: 0.0487189
x6: 0.327802", "Arm 3_0
hartmann6: -0.0166906 (SEM: 0)
x1: 0.462208
x2: 0.256397
x3: 0.975449
x4: 0.105526
x5: 0.872175
x6: 0.836164", "Arm 4_0
hartmann6: -0.201448 (SEM: 0)
x1: 0.336828
x2: 0.758475
x3: 0.6409
x4: 0.18382
x5: 0.883545
x6: 0.503031", "Arm 5_0
hartmann6: -0.188604 (SEM: 0)
x1: 0.705866
x2: 0.474217
x3: 0.486199
x4: 0.596891
x5: 0.19162
x6: 0.0200606", "Arm 6_0
hartmann6: -0.137807 (SEM: 0)
x1: 0.82591
x2: 0.55901
x3: 0.827168
x4: 0.39866
x5: 0.467513
x6: 0.40147", "Arm 7_0
hartmann6: -0.0149474 (SEM: 0)
x1: 0.194934
x2: 0.204444
x3: 0.0454832
x4: 0.819543
x5: 0.642837
x6: 0.88725", "Arm 8_0
hartmann6: -0.209356 (SEM: 0)
x1: 0.187192
x2: 0.903279
x3: 0.774756
x4: 0.51646
x5: 0.33764
x6: 0.753606", "Arm 9_0
hartmann6: -0.10929 (SEM: 0)
x1: 0.802279
x2: 0.361091
x3: 0.11798
x4: 0.202968
x5: 0.520776
x6: 0.269658" ], "type": "scatter", "x": [ 0.06857624650001526, 0.6669823881238699, 0.28208379726856947, 0.20625381555651892, 0.20004477506117838, 0.3281929068836651, 0.4173836341566283, 0.1560597207062898, 0.4982673714693427, 0.32320135841893866, 0.2993061269648042, 0.949337593279779, 0.291316309162491, 0.39672369558917003, 0.21663496343809097, 0.5154601731492084, 0.5814624270424247, 0.4622082654386759, 0.33682789001613855, 0.7058661617338657, 0.8259098790585995, 0.194933601655066, 0.18719230126589537, 0.8022791724652052 ], "xaxis": "x", "y": [ 0.7182344794273376, 0.6642681052908301, 0.0673874830827117, 6.607979944652964e-14, 0.04807176398020553, 0.06932566948914273, 0.0, 0.0, 0.051849595013033954, 0.207330343307123, 0.25201071586372265, 0.049118153750896454, 0.2802177518467135, 0.3747696646103233, 0.15078703563310938, 0.19672595672578147, 0.9801941029727459, 0.25639671459794044, 0.758475380949676, 0.4742168439552188, 0.5590100130066276, 0.20444396790117025, 0.9032792774960399, 0.36109117697924376 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.0141576 (SEM: 0)
x1: 0.0685762
x2: 0.718234
x3: 0.335965
x4: 0.897475
x5: 0.601168
x6: 0.710612", "Arm 10_0
hartmann6: -0.323145 (SEM: 0)
x1: 0.666982
x2: 0.664268
x3: 0.693438
x4: 0.80162
x5: 0.765403
x6: 0.152042", "Arm 11_0
hartmann6: -0.849672 (SEM: 0)
x1: 0.282084
x2: 0.0673875
x3: 0.413584
x4: 0.480315
x5: 0.0656645
x6: 0.636843", "Arm 12_0
hartmann6: -0.405476 (SEM: 0)
x1: 0.206254
x2: 6.60798e-14
x3: 0.298768
x4: 0.493777
x5: 6.34186e-14
x6: 0.702143", "Arm 13_0
hartmann6: -0.67418 (SEM: 0)
x1: 0.200045
x2: 0.0480718
x3: 0.441246
x4: 0.472412
x5: 0.0317254
x6: 0.712375", "Arm 14_0
hartmann6: -0.894065 (SEM: 0)
x1: 0.328193
x2: 0.0693257
x3: 0.450113
x4: 0.463215
x5: 0.0705689
x6: 0.60032", "Arm 15_0
hartmann6: -0.913914 (SEM: 0)
x1: 0.417384
x2: 0
x3: 0.699884
x4: 0.350061
x5: 0.0855929
x6: 0.580207", "Arm 16_0
hartmann6: -0.741567 (SEM: 0)
x1: 0.15606
x2: 0
x3: 0.587224
x4: 0.369418
x5: 0.0811765
x6: 0.401662", "Arm 17_0
hartmann6: -0.516029 (SEM: 0)
x1: 0.498267
x2: 0.0518496
x3: 0.671262
x4: 0.518782
x5: 0.0656804
x6: 0.668412", "Arm 18_0
hartmann6: -1.34079 (SEM: 0)
x1: 0.323201
x2: 0.20733
x3: 0.556927
x4: 0.334392
x5: 0.080051
x6: 0.669071", "Arm 19_0
hartmann6: -1.4463 (SEM: 0)
x1: 0.299306
x2: 0.252011
x3: 0.626811
x4: 0.28573
x5: 0.109757
x6: 0.855278", "Arm 1_0
hartmann6: -0.0935411 (SEM: 0)
x1: 0.949338
x2: 0.0491182
x3: 0.556218
x4: 0.320373
x5: 0.292361
x6: 0.187725", "Arm 20_0
hartmann6: -0.45554 (SEM: 0)
x1: 0.291316
x2: 0.280218
x3: 0.991354
x4: 0.257568
x5: 0.128539
x6: 0.385291", "Arm 21_0
hartmann6: -1.12908 (SEM: 0)
x1: 0.396724
x2: 0.37477
x3: 0.381043
x4: 0.285986
x5: 0.106864
x6: 0.787727", "Arm 22_0
hartmann6: -1.36787 (SEM: 0)
x1: 0.216635
x2: 0.150787
x3: 0.46828
x4: 0.286583
x5: 0.114892
x6: 0.859544", "Arm 23_0
hartmann6: -0.94263 (SEM: 0)
x1: 0.51546
x2: 0.196726
x3: 0.628195
x4: 0.223741
x5: 0.0811501
x6: 0.861798", "Arm 2_0
hartmann6: -0.478455 (SEM: 0)
x1: 0.581462
x2: 0.980194
x3: 0.132119
x4: 0.674815
x5: 0.0487189
x6: 0.327802", "Arm 3_0
hartmann6: -0.0166906 (SEM: 0)
x1: 0.462208
x2: 0.256397
x3: 0.975449
x4: 0.105526
x5: 0.872175
x6: 0.836164", "Arm 4_0
hartmann6: -0.201448 (SEM: 0)
x1: 0.336828
x2: 0.758475
x3: 0.6409
x4: 0.18382
x5: 0.883545
x6: 0.503031", "Arm 5_0
hartmann6: -0.188604 (SEM: 0)
x1: 0.705866
x2: 0.474217
x3: 0.486199
x4: 0.596891
x5: 0.19162
x6: 0.0200606", "Arm 6_0
hartmann6: -0.137807 (SEM: 0)
x1: 0.82591
x2: 0.55901
x3: 0.827168
x4: 0.39866
x5: 0.467513
x6: 0.40147", "Arm 7_0
hartmann6: -0.0149474 (SEM: 0)
x1: 0.194934
x2: 0.204444
x3: 0.0454832
x4: 0.819543
x5: 0.642837
x6: 0.88725", "Arm 8_0
hartmann6: -0.209356 (SEM: 0)
x1: 0.187192
x2: 0.903279
x3: 0.774756
x4: 0.51646
x5: 0.33764
x6: 0.753606", "Arm 9_0
hartmann6: -0.10929 (SEM: 0)
x1: 0.802279
x2: 0.361091
x3: 0.11798
x4: 0.202968
x5: 0.520776
x6: 0.269658" ], "type": "scatter", "x": [ 0.06857624650001526, 0.6669823881238699, 0.28208379726856947, 0.20625381555651892, 0.20004477506117838, 0.3281929068836651, 0.4173836341566283, 0.1560597207062898, 0.4982673714693427, 0.32320135841893866, 0.2993061269648042, 0.949337593279779, 0.291316309162491, 0.39672369558917003, 0.21663496343809097, 0.5154601731492084, 0.5814624270424247, 0.4622082654386759, 0.33682789001613855, 0.7058661617338657, 0.8259098790585995, 0.194933601655066, 0.18719230126589537, 0.8022791724652052 ], "xaxis": "x2", "y": [ 0.7182344794273376, 0.6642681052908301, 0.0673874830827117, 6.607979944652964e-14, 0.04807176398020553, 0.06932566948914273, 0.0, 0.0, 0.051849595013033954, 0.207330343307123, 0.25201071586372265, 0.049118153750896454, 0.2802177518467135, 0.3747696646103233, 0.15078703563310938, 0.19672595672578147, 0.9801941029727459, 0.25639671459794044, 0.758475380949676, 0.4742168439552188, 0.5590100130066276, 0.20444396790117025, 0.9032792774960399, 0.36109117697924376 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "906fd865", "metadata": { "papermill": { "duration": 0.068047, "end_time": "2024-11-13T05:10:21.994455", "exception": false, "start_time": "2024-11-13T05:10:21.926408", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "751e8841", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:22.131883Z", "iopub.status.busy": "2024-11-13T05:10:22.131603Z", "iopub.status.idle": "2024-11-13T05:10:22.675908Z", "shell.execute_reply": "2024-11-13T05:10:22.675196Z" }, "papermill": { "duration": 0.618494, "end_time": "2024-11-13T05:10:22.680975", "exception": false, "start_time": "2024-11-13T05:10:22.062481", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:22] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.8419707564826291, 0.8417074589753113, 0.8418923685765664, 0.8425288947427486, 0.8436198598940736, 0.8451674885987152, 0.8471733979124811, 0.8496385889108495, 0.852563439447496, 0.855947698170111, 0.8597904798210859, 0.8640902618475484, 0.868844882341239, 0.8740515393257191, 0.8797067914042093, 0.8858065597779077, 0.8923461316407557, 0.8993201649525899, 0.9067226945888027, 0.9145471398607885, 0.9227863133972103, 0.931432431372238, 0.9404771250633179, 0.9499114537163011, 0.9597259186928118, 0.9699104788700639, 0.9804545672602283, 0.9913471088122155, 1.0025765393556663, 1.0141308256430281, 1.025997486442566, 1.0381636146317792, 1.0506159002376574, 1.0633406543674175, 1.0763238339704244, 1.0895510673697424, 1.1030076804991404, 1.116678723779436, 1.1305489995659215, 1.1446030900972564, 1.158825385874164, 1.173200114395707, 1.1877113691791974, 1.2023431389895312, 1.2170793372030204, 1.2319038312304293, 1.2468004719239887, 1.2617531228933039, 1.2767456896556613, 1.2917621485466926 ], [ 0.8416264388469371, 0.8413999136039632, 0.8416223668182525, 0.8422971732302256, 0.843427119187309, 0.8450143918880852, 0.8470605697850833, 0.8495666141830056, 0.8525328620660526, 0.8559590201852915, 0.8598441604332524, 0.8641867165300936, 0.8689844820416317, 0.8742346097465385, 0.8799336123657289, 0.8860773646637187, 0.892661106927453, 0.8996794498246041, 0.9071263806390919, 0.914995270877802, 0.9232788852384949, 0.9319693919247731, 0.9410583742902956, 0.9505368437901058, 0.9603952542135246, 0.9706235171686981, 0.9812110187856457, 0.9921466376006303, 1.003418763581111, 1.0150153182473007, 1.0269237758428975, 1.0391311855040235, 1.0516241943731497, 1.064389071600915, 1.0774117331768376, 1.090677767526946, 1.1041724618141409, 1.1178808288750217, 1.1317876347247753, 1.145877426560431, 1.16013456119076, 1.1745432338203337, 1.1890875071140372, 1.2037513404674018, 1.218518619408099, 1.233373185052925, 1.2482988635453827, 1.2632794953984665, 1.2782989646682164, 1.2933412278840999 ], [ 0.8417508346388978, 0.8415623370629279, 0.8418233642387298, 0.8425372534212885, 0.8437067523949549, 0.8453340087848127, 0.8474205605292151, 0.8499673275502528, 0.8529746046554378, 0.8564420557014674, 0.8603687090470968, 0.8647529543190277, 0.8695925405112181, 0.874884575434356, 0.8806255265285694, 0.8868112230487653, 0.8934368596279889, 0.9004970012203877, 0.9079855894215837, 0.9158959501599346, 0.9242208027486196, 0.9329522702841444, 0.9420818913732281, 0.951600633165727, 0.9614989056678478, 0.9717665773055799, 0.982392991704873, 0.9933669856512609, 1.004676908188143, 1.0163106408093128, 1.0282556186982492, 1.0404988529632297, 1.0530269538145223, 1.0658261546267462, 1.078882336827162, 1.0921810555477423, 1.1057075659767954, 1.1194468503437704, 1.1333836454687798, 1.1475024708069357, 1.1617876569159393, 1.1762233742741872, 1.190793662375723, 1.205482459027434, 1.2202736297736767, 1.2351509973727821, 1.2500983712504643, 1.265099576854846, 1.2801384848385788, 1.2951990399942064 ], [ 0.8423455436892986, 0.8421962954952001, 0.8424968920788782, 0.8432506304725795, 0.8444602174413122, 0.8461277588685155, 0.8482547503049229, 0.8508420687171787, 0.8538899654694531, 0.8573980605683913, 0.8613653381984214, 0.8657901435710875, 0.8706701811084716, 0.8760025139772705, 0.8817835649865396, 0.8880091188577905, 0.8946743258732222, 0.9017737069029468, 0.9093011598089671, 0.9172499672192025, 0.9256128056611821, 0.9343817560408978, 0.9435483154482913, 0.9531034102672837, 0.9630374105639458, 0.9733401457227584, 0.9840009212973909, 0.9950085370382701, 1.0063513060561793, 1.0180170750773019, 1.0299932457420036, 1.0422667968962696, 1.0548243078220934, 1.0676519823495152, 1.080735673791302, 1.0940609106376207, 1.1076129229469274, 1.12137666936605, 1.135336864711423, 1.1494780080412985, 1.1637844111473254, 1.1782402273929065, 1.1928294808244548, 1.2075360954811696, 1.222343924828299, 1.2372367812385936, 1.2521984654468912, 1.2672127959025832, 1.2822636379455936, 1.29733493273198 ], [ 0.8434114321546768, 0.8433026183935177, 0.8436437422839758, 0.844438057935688, 0.8456882286768657, 0.847396316521237, 0.8495637727997842, 0.8521914299935002, 0.8552794948001717, 0.8588275424653201, 0.8628345124041275, 0.8672987051376521, 0.8722177805632592, 0.877588757575593, 0.8834080150506205, 0.8896712942016882, 0.896373702312492, 0.9035097178481739, 0.9110731969416294, 0.9190573812483758, 0.9274549071592078, 0.9362578163560045, 0.9454575676919175, 0.9550450503736571, 0.9650105984192567, 0.9753440063611688, 0.9860345461607484, 0.9970709852965575, 1.0084416059852268, 1.0201342254903778, 1.0321362174716904, 1.0444345343230226, 1.057015730445464, 1.069865986398469, 1.082971133869354, 1.0963166813990874, 1.1098878407999007, 1.1236695541982475, 1.1376465216347171, 1.1518032291506928, 1.1661239772903718, 1.180592909945426, 1.1951940434684787, 1.2099112959810123, 1.224728516800867, 1.239629515914011, 1.2545980934155492, 1.269618068844915, 1.2846733103409511, 1.2997477635430472 ], [ 0.84494862716722, 0.8448813932981752, 0.8452639622524099, 0.8460995425595959, 0.8473907517371554, 0.8491396058454923, 0.8513475102089918, 0.8540152513387365, 0.8571429900896972, 0.860730256082445, 0.8647759434156401, 0.8692783076925864, 0.8742349643814562, 0.8796428885251564, 0.885498415813331, 0.8917972450248599, 0.8985344418458585, 0.9057044440638549, 0.9133010681351976, 0.9213175171187056, 0.9297463899645404, 0.9385796921435385, 0.9478088475980342, 0.9574247119915469, 0.9674175872306621, 0.9777772372288092, 0.9884929048777171, 0.9995533301888795, 1.0109467695636867, 1.0226610161475844, 1.0346834212200955, 1.0470009165697567, 1.0596000377996366, 1.0724669485064993, 1.0855874652738837, 1.0989470834170263, 1.112531003415121, 1.1263241579643672, 1.1403112395835056, 1.1544767287016637, 1.1688049221571262, 1.1832799620343228, 1.1978858647653357, 1.2126065504217258, 1.2274258721216507, 1.2423276454773367, 1.257295678007842, 1.2723137984422077, 1.2873658858388977, 1.3024358984477493 ], [ 0.8469565133309458, 0.8469319623502877, 0.847356851448136, 0.8482343409643648, 0.8495670002797866, 0.8513567974665089, 0.8536050901045371, 0.8563126173000948, 0.8594794929385873, 0.8631052002013931, 0.8671885873730756, 0.871727864961511, 0.876720604150524, 0.882163736600829, 0.8880535556110801, 0.8943857186476728, 0.9011552512476471, 0.9083565522952599, 0.9159834006690228, 0.924028963252028, 0.9324858042942648, 0.9413458961119344, 0.9506006311046983, 0.9602408350678482, 0.9702567817728529, 0.9806382087855017, 0.9913743344874391, 1.0024538762633834, 1.0138650698123342, 1.0255956895381537, 1.037633069971382, 1.0499641281710714, 1.0625753870522563, 1.0754529995823134, 1.0885827737862341, 1.1019501984987812, 1.1155404697990872, 1.129338518061157, 1.1433290355519667, 1.1574965045071164, 1.17182522561267, 1.186299346820519, 1.200902892423864, 1.215619792318512, 1.2304339113751468, 1.2453290788479399, 1.2602891177442959, 1.275297874081348, 1.290339245954949, 1.3053972123477755 ], [ 0.8494337310843543, 0.849452920720734, 0.8499209598971348, 0.8508409582063261, 0.8522154346194679, 0.8540463072382192, 0.8563348842131295, 0.8590818558633816, 0.8622872880303234, 0.8659506166940973, 0.8700706438791357, 0.8746455348712194, 0.8796728167651489, 0.8851493783584226, 0.8910714714028569, 0.8974347132220658, 0.9042340906991458, 0.91146396563486, 0.919118081472864, 0.927189571384329, 0.9356709677009356, 0.944554212680538, 0.9538306705865058, 0.9634911410575466, 0.9735258737411367, 0.9839245841598131, 0.9946764707759107, 1.0057702332168286, 1.0171940916192441, 1.0289358070473242, 1.0409827029369416, 1.0533216875144313, 1.0659392771357767, 1.0788216204890237, 1.0919545236003998, 1.105323475581814, 1.1189136750555215, 1.1327100571893756, 1.1466973212744511, 1.1608599587751338, 1.175182281780354, 1.18964845178351, 1.2042425087176754, 1.2189484001720472, 1.233750010715049, 1.2486311912493406, 1.2635757883240673, 1.2785676733298612, 1.293590771502835, 1.3086290906641507 ], [ 0.8523781769435741, 0.8524421169284442, 0.8529540885813891, 0.8539171482482405, 0.8553337622745729, 0.8572057968663596, 0.8595345091160954, 0.8623205392294817, 0.865563903984615, 0.8692639914525712, 0.8734195570051209, 0.8780287206317166, 0.8830889655845919, 0.8885971383671121, 0.8945494500769688, 0.9009414791118415, 0.907768175241646, 0.9150238650473885, 0.922702258722886, 0.9307964582316153, 0.9392989668071754, 0.9482016997817311, 0.9574959967230511, 0.9671726348569928, 0.9772218437481099, 0.9876333212077296, 0.9983962503949387, 1.0094993180722664, 1.0209307339746274, 1.0326782512464456, 1.0447291878988239, 1.0570704492353507, 1.0696885511924146, 1.082569644536909, 1.0956995398615612, 1.1090637333160864, 1.1226474330095262, 1.1364355860176132, 1.1504129059268842, 1.1645639008458963, 1.178872901812196, 1.1933240915229115, 1.2079015333156764, 1.222589200325928, 1.2373710047463649, 1.2522308271139586, 1.2671525455500308, 1.2821200648792712, 1.2971173455539478, 1.312128432310621 ], [ 0.8557870056333099, 0.8558966550553851, 0.8564532917375931, 0.8574599163411509, 0.8589189404317674, 0.8608321764552411, 0.8632008288773869, 0.8660254865229919, 0.8693061161454159, 0.8730420572554718, 0.8772320182348424, 0.8818740737560736, 0.886965663527363, 0.8925035923773128, 0.8984840316906404, 0.9049025222024345, 0.9117539781546138, 0.9190326928144255, 0.9267323453510148, 0.9348460090620185, 0.9433661609384552, 0.9522846925522441, 0.9615929222465527, 0.9712816086056913, 0.9813409651772907, 0.9917606764157608, 1.0025299148123643, 1.0136373591738013, 1.0250712140076097, 1.0368192299693166, 1.0488687253231463, 1.061206608365019, 1.0738194007534758, 1.0866932616916758, 1.0998140129006917, 1.113167164322285, 1.126737940486726, 1.140511307479621, 1.1544720004396074, 1.1686045515172678, 1.1828933182243848, 1.1973225121013713, 1.2118762276297745, 1.226538471316363, 1.241293190874564, 1.256124304429014, 1.2710157296690026, 1.2859514128769611, 1.3009153577585029, 1.315891654001583 ], [ 0.859656634106527, 0.8598128988589668, 0.8604148810610415, 0.8614655233186006, 0.8629671803290162, 0.8649216089781375, 0.8673299595998023, 0.8701927684323654, 0.8735099513033369, 0.8772807985706558, 0.8815039713453663, 0.8861774990172633, 0.8912987781017859, 0.896864572422606, 0.9028710146408292, 0.9093136091380705, 0.9161872362566076, 0.923486157896523, 0.9312040244652218, 0.9393338831713687, 0.94786818765111, 0.9567988089107133, 0.9661170475657813, 0.9758136473534869, 0.985878809890427, 0.9963022106450153, 1.0070730160896748, 1.0181799019945803, 1.0296110728212138, 1.0413542821707193, 1.053396854238825, 1.0657257062259247, 1.0783273716483714, 1.091188024493688, 1.1042935041604756, 1.1176293411210176, 1.131180783242362, 1.144932822700024, 1.1588702234162898, 1.1729775489537067, 1.1872391907930249, 1.2016393969237231, 1.2161623006742683, 1.2307919497087632, 1.2455123351162043, 1.2603074205182045, 1.2751611711214426, 1.2900575826411882, 1.3049807100227717, 1.3199146958889427 ], [ 0.8639827474473194, 0.8641864777758851, 0.8648344318086478, 0.8659294917966445, 0.8674739535504143, 0.8694695166644857, 0.8719172759021194, 0.874817713774414, 0.878170694344752, 0.8819754582861847, 0.8862306192167746, 0.8909341613336459, 0.8960834383640571, 0.9016751738472067, 0.9077054627577673, 0.9141697744778003, 0.92106295712028, 0.9283792432034127, 0.936112256671421, 0.9442550212531143, 0.9527999701463152, 0.9617389570116965, 0.9710632682563282, 0.9807636365830235, 0.9908302557780494, 1.0012527967059666, 1.0120204244768558, 1.0231218167474911, 1.0345451831147983, 1.0462782855565842, 1.0583084598711885, 1.0706226380648936, 1.0832073716329524, 1.096048855677287, 1.1091329538016528, 1.1224452237221458, 1.1359709435296144, 1.1496951385375742, 1.1636026086482891, 1.1776779561677453, 1.191905613998832, 1.2062698741413223, 1.2207549164260663, 1.2353448374102391, 1.2500236793602026, 1.2647754592482974, 1.279584197689995, 1.2944339477481748, 1.3093088235318175, 1.324193028517297 ], [ 0.8687603066445815, 0.8690122948051264, 0.86970679078831, 0.8708466142667336, 0.8724340002195781, 0.8744705892905877, 0.8769574193036278, 0.8798949179693574, 0.8832828968136657, 0.887120546355219, 0.891406432556394, 0.8961384945685871, 0.9013140437891409, 0.906929764243888, 0.9129817143055754, 0.9194653297546939, 0.9263754281855998, 0.933706214756884, 0.9414512892812317, 0.9496036546462467, 0.9581557265535374, 0.9670993445599538, 0.9764257844008095, 0.9861257715710797, 0.9961894961371014, 1.0066066287473783, 1.0173663378076678, 1.0284573077819088, 1.0398677585773917, 1.0515854659688606, 1.0635977830136598, 1.0758916624064958, 1.088453679719872, 1.10127005747344, 1.1143266899729944, 1.127609168857456, 1.1411028092902606, 1.1547926767291934, 1.1686636142075337, 1.1827002700573068, 1.1968871260045368, 1.2112085255652059, 1.2256487026694884, 1.2401918104418805, 1.25482195006365, 1.2695231996446417, 1.2842796430309713, 1.299075398476024, 1.3138946471021673, 1.3287216610820354 ], [ 0.8739835582179962, 0.8742845362509477, 0.875026086215446, 0.8762109630620192, 0.877841339071705, 0.8799187943534529, 0.8824443084957255, 0.885418253405607, 0.8888403873653912, 0.8927098503338924, 0.897025160516222, 0.9017842122224633, 0.9069842750325161, 0.9126219942804543, 0.9186933928683803, 0.9251938744161059, 0.932118227749084, 0.9394606327233833, 0.9472146673827211, 0.9553733164385678, 0.9639289810607548, 0.9728734899619749, 0.9821981117560378, 0.9918935685656599, 1.0019500508522436, 1.0123572334360502, 1.0231042926721325, 1.0341799247432912, 1.0455723650285667, 1.0572694085020882, 1.069258431114231, 1.081526412103951, 1.0940599571882907, 1.1068453225725632, 1.119868439722067, 1.1331149408338097, 1.1465701849449619, 1.160219284612285, 1.174047133095623, 1.1880384319766133, 1.20217771914282, 1.21644939706613, 1.2308377613037529, 1.2453270291492264, 1.259901368360864, 1.2745449258944728, 1.2892418565678463, 1.303976351584353, 1.318732666843902, 1.3334951509702664 ], [ 0.8796460456708461, 0.8799966833003531, 0.8807857394106438, 0.8820159021706304, 0.8836892793779215, 0.8858073891012358, 0.8883711514733588, 0.8913808816671306, 0.8948362840843931, 0.8987364477844435, 0.9030798431754712, 0.9078643199890954, 0.9130871065545856, 0.9187448103861549, 0.9248334200926998, 0.9313483086160195, 0.9382842377997961, 0.9456353642876301, 0.9533952467450106, 0.961556854396044, 0.9701125768620571, 0.9790542352853093, 0.988373094717619, 0.9980598777493322, 1.0081047793513145, 1.018497482897993, 1.0292271773369015, 1.04028257546604, 1.0516519332774774, 1.0633230703220808, 1.07528339104749, 1.087519907058097, 1.1000192602435057, 1.1127677467188322, 1.1257513415178693, 1.1389557239782375, 1.152366303754884, 1.1659682473969637, 1.1797465054211298, 1.193685839813004, 1.2077708518869912, 1.2219860104341018, 1.2363156800861093, 1.2507441498240819, 1.2652556615589716, 1.2798344387117582, 1.2944647147207742, 1.309130761404286, 1.323816917106915, 1.3385076145593662 ], [ 0.8857406227383179, 0.886141525403074, 0.8869784783063166, 0.8882541008636833, 0.8899704346889183, 0.8921289343869561, 0.8947304594928998, 0.8977752675895585, 0.9012630086324839, 0.9051927205089438, 0.9095628258537405, 0.9143711301416291, 0.9196148210726011, 0.9252904692629298, 0.9313940302510633, 0.9379208478241156, 0.9448656586668502, 0.9522225983311893, 0.9599852085209393, 0.9681464456822257, 0.9766986908865609, 0.9856337609897409, 0.9949429210459475, 1.0046168979527472, 1.014645895299134, 1.025019609385061, 1.0357272463773755, 1.04675754056403, 1.0580987736644163, 1.0697387951514292, 1.0816650435368342, 1.0938645685693758, 1.106324054291845, 1.119029842900885, 1.131967959350795, 1.1451241366404388, 1.158483841720235, 1.172032301954326, 1.1857545320713703, 1.1996353615359947, 1.213659462271658, 1.2278113766646552, 1.2420755457782988, 1.2564363377056025, 1.2708780759885756, 1.2853850680322396, 1.2999416334412992, 1.3145321322081422, 1.3291409926812183, 1.3437527392437507 ], [ 0.8922594683931928, 0.8927111754159096, 0.893596352723555, 0.8949175490984889, 0.8966767383585164, 0.8988753103056923, 0.9015140628164584, 0.9045931951046737, 0.9081123021865484, 0.9120703705732655, 0.916465775213694, 0.9212962777066862, 0.9265590257988072, 0.9322505541798484, 0.9383667865850928, 0.9449030392095804, 0.9518540254360153, 0.9592138618740964, 0.9669760757056164, 0.9751336133256442, 0.9836788502666005, 0.9926036023880371, 1.0018991383115265, 1.011556193076303, 1.0215649829873774, 1.031915221624966, 1.0425961369798928, 1.0535964896767671, 1.0649045922431553, 1.0765083293800326, 1.0883951791855766, 1.1005522352816632, 1.112966229789502, 1.1256235570984552, 1.1385102983694781, 1.151612246712712, 1.1649149329761823, 1.1784036520814098, 1.192063489839496, 1.2058793501801215, 1.2198359827247511, 1.2339180106339591, 1.2481099586586293, 1.2623962813236196, 1.2767613911725912, 1.291189687002537, 1.305665582016488, 1.3201735318236854, 1.3346980622165805, 1.3492237966553988 ], [ 0.8991941035650179, 0.8996970864666909, 0.9006307513744116, 0.9019975746523377, 0.9037994608014863, 0.90603773356953, 0.9087131281963382, 0.9118257848268075, 0.9153752431191116, 0.9193604380738307, 0.9237796971060339, 0.9286307383792921, 0.9339106704169339, 0.9396159930027892, 0.9457425993797918, 0.9522857797514361, 0.95924022608746, 0.9666000382311264, 0.9743587313023484, 0.9825092443866666, 0.9910439504965005, 0.9999546677878486, 1.0092326720110445, 1.0188687101715428, 1.0288530153723427, 1.0391753228066831, 1.0498248868658322, 1.0607904993236723, 1.0720605085565564, 1.0836228397535774, 1.0954650160696913, 1.107574180671023, 1.1199371196191368, 1.132540285538439, 1.1453698220086297, 1.1584115886216269, 1.1716511866407056, 1.185073985197788, 1.1986651479626684, 1.2124096602174845, 1.2262923562675714, 1.2402979471196762, 1.2544110483572193, 1.2686162081420647, 1.2828979352719105, 1.297240727222231, 1.311629098102023, 1.3260476064529798, 1.340480882822223, 1.3549136570397406 ], [ 0.9065354095226816, 0.9070900704877548, 0.9080724205387329, 0.9094848619349802, 0.9113292284342138, 0.9136067765679905, 0.9163181780472118, 0.9194635133284171, 0.9230422663686598, 0.9270533205940021, 0.9314949561031551, 0.9363648481247266, 0.9416600667432196, 0.9473770779053677, 0.9535117457150581, 0.9600593360212474, 0.9670145213000256, 0.9743713868281826, 0.9821234381416607, 0.990263609769286, 0.9987842752277036, 1.0076772582604434, 1.0169338452999486, 1.0265447991280068, 1.0365003737065732, 1.0467903301471577, 1.057403953784005, 1.068330072312607, 1.0795570749520533, 1.0910729325866888, 1.1028652188395176, 1.114921132026943, 1.127227517941758, 1.1397708934089605, 1.1525374705564622, 1.1655131817405293, 1.1786837050640984, 1.1920344904239648, 1.2055507860216101, 1.2192176652708442, 1.233020054034231, 1.2469427581196222, 1.260970490967007, 1.2750879014557277, 1.2892796017615875, 1.3035301951934704, 1.3178243039393294, 1.3321465966516046, 1.346481815802875, 1.3608148047435988 ], [ 0.9142736478646096, 0.9148803183623782, 0.9159114843587388, 0.9173694724231051, 0.9192560442402837, 0.9215723880562978, 0.9243191112479614, 0.9274962340462478, 0.9311031844409675, 0.9351387942911449, 0.9396012966621663, 0.9444883244078948, 0.9497969100121467, 0.9555234867011219, 0.9616638908342218, 0.9682133655777228, 0.9751665658618907, 0.9825175646185876, 0.9902598602927917, 0.9983863856177204, 1.0068895176397972, 1.015761088975846, 1.0249924002814434, 1.0345742339056956, 1.0444968687044076, 1.0547500959797742, 1.0653232365119316, 1.0762051586438328, 1.0873842973782513, 1.0988486744423072, 1.1105859192722716, 1.1225832908683457, 1.13482770046681, 1.1473057349740643, 1.160003681105133, 1.1729075501668906, 1.1860031034243212, 1.1992758779864614, 1.2127112131470554, 1.2262942771135459, 1.240010094057149, 1.253843571415407, 1.2677795273783823, 1.2818027184888754, 1.2958978672867518, 1.3100496899278062, 1.3242429237074091, 1.3384623544196161, 1.3526928434834282, 1.3669193547683807 ], [ 0.9223984820552353, 0.9230574216224186, 0.9241374666890924, 0.92564086665377, 0.9275693098981183, 0.9299239154075942, 0.9327052255088837, 0.9359131997538324, 0.9395472099767737, 0.9436060365491661, 0.9480878658521432, 0.9529902889846591, 0.958310301721391, 0.9640443057312156, 0.9701881110637489, 0.9767369399077013, 0.9836854316215643, 0.9910276490333039, 0.9987570860020326, 1.006866676231618, 1.0153488033217282, 1.0241953120389127, 1.0333975207863542, 1.0429462352476813, 1.0528317631764157, 1.0630439302997012, 1.0735720973011522, 1.0844051778447432, 1.0955316575985015, 1.1069396142136234, 1.1186167382118481, 1.1305503547312432, 1.1427274460776984, 1.1551346750273959, 1.1677584088228636, 1.1805847438032904, 1.1935995306079492, 1.206788399889651, 1.2201367884738386, 1.2336299658974625, 1.2472530612607364, 1.2609910903239503, 1.274828982780895, 1.2887516096398959, 1.3027438106432923, 1.3167904216562523, 1.33087630195576, 1.3449863613514341, 1.3591055870700919, 1.3732190703372285 ], [ 0.9308990004409665, 0.9316103956299977, 0.932739314434785, 0.9342879277087826, 0.9362578494019709, 0.9386501283604289, 0.9414652412353272, 0.944703086530625, 0.94836297981573, 0.9524436501265299, 0.9569432375750064, 0.9618592921846063, 0.9671887739649998, 0.9729280542367926, 0.9790729182131575, 0.9856185688419308, 0.9925596319081598, 0.9998901623936542, 1.0076036520863625, 1.0156930384288947, 1.0241507145920123, 1.0329685407551639, 1.0421378565729096, 1.0516494948021122, 1.061493796062115, 1.0716606246957852, 1.0821393856969612, 1.0929190426659667, 1.1039881367521986, 1.11533480653957, 1.126946808827864, 1.1388115402603587, 1.150916059745459, 1.1632471116176635, 1.1757911494811004, 1.1885343606766081, 1.2014626913115678, 1.2145618717900115, 1.2278174427789943, 1.2412147815459673, 1.2547391286008, 1.2683756145750882, 1.2821092872711333, 1.2959251388119382, 1.3098081328239348, 1.3237432315837787, 1.3377154230609247, 1.351709747788107, 1.3657113254925268, 1.3797053814214557 ], [ 0.9397637406740031, 0.9405277041707913, 0.9417054223038982, 0.9432989861166527, 0.9453099341024267, 0.947739244187064, 0.9505873268128316, 0.9538540191528577, 0.9575385804815706, 0.9616396887241329, 0.9661554382045477, 0.971083338609182, 0.9764203151788236, 0.9821627101395134, 0.9883062853786397, 0.9948462263694935, 1.0017771473441064, 1.0090930977103734, 1.0167875697062154, 1.0248535072798344, 1.0332833161817372, 1.0420688752504645, 1.0512015488705746, 1.060672200578218, 1.0704712077857406, 1.0805884775940395, 1.0910134636576132, 1.101735184064528, 1.1127422401901264, 1.1240228364807618, 1.1355648011205774, 1.14735560753213, 1.1593823966587957, 1.1716319999748315, 1.1840909631663439, 1.1967455704250713, 1.2095818692941076, 1.2225856960040242, 1.2357427012356295, 1.24903837624477, 1.2624580792833207, 1.27598706224979, 1.2896104975022051, 1.3033135047656765, 1.3170811780667318, 1.3308986126265423, 1.3447509316454502, 1.358623312911648, 1.372501015167491, 1.3863694041678476 ], [ 0.9489807154672945, 0.9497972853819887, 0.9510236588978016, 0.9526618460940715, 0.9547133090880838, 0.9571789542039322, 0.9600591252347471, 0.9633535978264809, 0.967061575008453, 0.9711816838928797, 0.975711973562823, 0.9806499141645693, 0.985992397217235, 0.9917357371494643, 0.9978756740692057, 1.0044073777694966, 1.0113254529696272, 1.0186239457875554, 1.0262963514360592, 1.034335623131334, 1.042734182199612, 1.0514839293636986, 1.060576257187824, 1.0700020636559195, 1.079751766855197, 1.089815320733224, 1.1001822318940113, 1.1108415773951512, 1.121782023505232, 1.1329918453776808, 1.14445894759473, 1.1561708855322663, 1.168114887494041, 1.1802778775612413, 1.1926464991015013, 1.2052071388791215, 1.2179459517067566, 1.2308488855769613, 1.2439017072107998, 1.2570900279592279, 1.2703993299922078, 1.2838149927093871, 1.2973223193059567, 1.310906563426416, 1.3245529558393416, 1.338246731065774, 1.3519731538945048, 1.3657175457177195, 1.3794653106213346, 1.3932019611651443 ], [ 0.9585374395998718, 0.9594065789332463, 0.9606813940565769, 0.9623638130443558, 0.9644552208252029, 0.9669564515405911, 0.9698677819882742, 0.9731889261779404, 0.9769190310237971, 0.9810566731959247, 0.9855998571489503, 0.9905460143439027, 0.9958920036756232, 1.001634113114669, 1.007768062570028, 1.0142890079745794, 1.021191546592786, 1.028469723545984, 1.0361170395474588, 1.0441264598360775, 1.0524904242936115, 1.0612008587276613, 1.0702491872984365, 1.0796263460646218, 1.089322797619853, 1.09932854678853, 1.1096331573462257, 1.120225769726907, 1.131095119676532, 1.1422295578093236, 1.1536170700205615, 1.165245298707223, 1.177101564744979, 1.1891728901683354, 1.2014460214979679, 1.2139074536579006, 1.2265434544230305, 1.239340089336091, 1.2522832470316596, 1.2653586649037138, 1.2785519550521645, 1.2918486304429952, 1.3052341312161162, 1.318693851074593, 1.3322131636888586, 1.3457774490494594, 1.3593721197021364, 1.3729826467996773, 1.3865945859055382, 1.4001936024851243 ], [ 0.9684209580871899, 0.9693425543749531, 0.9706655273734386, 0.9723917222259707, 0.9745224459681259, 0.9770584600794949, 0.9799999741109235, 0.9833466404143187, 0.9870975499991562, 0.9912512295368163, 0.9958056395310307, 1.000758173669588, 1.0061056593692836, 1.011844359522726, 1.0179699754527518, 1.0244776510761346, 1.0313619782757577, 1.0386170034761553, 1.0462362354147734, 1.0542126540969465, 1.0625387209201351, 1.0712063899487552, 1.0802071203181574, 1.089531889742593, 1.0991712090991002, 1.1091151380557485, 1.1193533017098019, 1.1298749081981418, 1.140668767239731, 1.1517233095664996, 1.1630266071971054, 1.174566394504801, 1.186330090028773, 1.1983048189756764, 1.2104774363562147, 1.222834550699832, 1.235362548288302, 1.2480476178482944, 1.2608757756407556, 1.273832890884436, 1.28690471144952, 1.3000768897568016, 1.3133350088171305, 1.3266646083455276, 1.3400512108843465, 1.3534803478697948, 1.366937585576344, 1.380408550874382, 1.393878956736709, 1.4073346274307565 ], [ 0.9786178754276511, 0.9795917405643214, 0.9809625177880998, 0.9827319685006621, 0.9849013212494482, 0.9874712644751779, 0.9904419403254427, 0.9938129395607066, 0.9975832975762047, 1.0017514915604966, 1.0063154388082722, 1.0112724962021835, 1.0166194608750208, 1.0223525720608113, 1.0284675141396342, 1.034959420878021, 1.0418228808633856, 1.0490519441274317, 1.0566401299502828, 1.0645804358335533, 1.0728653476274317, 1.0814868507930149, 1.0904364427786994, 1.0997051464849947, 1.1092835247901012, 1.1191616961045872, 1.129329350920768, 1.1397757693196535, 1.1504898393948133, 1.161460076550646, 1.1726746436290147, 1.184121371816333, 1.1957877822806395, 1.2076611084859659, 1.2197283191290935, 1.2319761416424952, 1.2443910862048, 1.2569594701992213, 1.2696674430586077, 1.2825010114350837, 1.2954460646308184, 1.3084884002261603, 1.3216137498405576, 1.3348078049613972, 1.3480562427759983, 1.3613447519416446, 1.3746590582293747, 1.3879849499772405, 1.401308303289814, 1.414615106921437 ], [ 0.9891143858329863, 0.9901402560762778, 0.9915584141655231, 0.9933705370671649, 0.9955777743553411, 0.9981807411577979, 1.0011795121579643, 1.00457361667894, 1.0083620348721503, 1.012543195030998, 1.0171149720465351, 1.0220746870193882, 1.0274191080388804, 1.0331444521373698, 1.0392463884242815, 1.0457200424014266, 1.0525600014574712, 1.0597603215364808, 1.0673145349719921, 1.0752156594744657, 1.083456208257274, 1.0920282012823552, 1.1009231776038773, 1.1101322087850471, 1.1196459133595238, 1.1294544723066144, 1.139547645505629, 1.149914789132396, 1.160544873957826, 1.1714265045058883, 1.182547939025593, 1.193897110229332, 1.2054616467474473, 1.2172288952468548, 1.229185943159423, 1.2413196419641916, 1.2536166309655123, 1.2660633615081232, 1.278646121568553, 1.2913510606611454, 1.3041642149965351, 1.317071532828882, 1.3300588999285823, 1.3431121651160707, 1.3562171657927427, 1.3693597534049562, 1.3825258187772769, 1.395701317251807, 1.408872293571137, 1.4220249064431818 ], [ 0.9998963043469755, 1.0009738405031783, 1.0024388867635143, 1.0042930350832673, 1.0065373556885588, 1.0091723902231302, 1.0121981459408516, 1.015614090969057, 1.019419150665258, 1.0236117050864386, 1.0281895875879685, 1.0331500845654027, 1.0384899363500197, 1.0442053392653576, 1.050291948849094, 1.0567448842412668, 1.0635587337365908, 1.0707275614954272, 1.07824491540454, 1.0861038360755007, 1.0942968669655344, 1.102816065602062, 1.111653015889055, 1.1207988414703625, 1.1302442201218157, 1.139979399140789, 1.149994211699361, 1.1602780941238942, 1.1708201040612896, 1.1816089394895677, 1.1926329585276965, 1.2038801999974202, 1.2153384046873266, 1.2269950372675116, 1.2388373088011233, 1.2508521997971829, 1.2630264837476668, 1.2753467510902328, 1.2877994335367997, 1.300370828707008, 1.3130471250048068, 1.3258144266757126, 1.338658778981758, 1.3515661934309737, 1.364522672997841, 1.3775142372718026, 1.3905269474707764, 1.403546931257296, 1.4165604072956903, 1.4295537094896142 ], [ 1.0109490987544352, 1.0120778865446192, 1.0135892594899278, 1.015484724076537, 1.0177652709186975, 1.020431368108235, 1.023482955599232, 1.026919440652083, 1.0307396943589382, 1.0349420492693824, 1.0395242981324317, 1.0444836937680546, 1.0498169500782497, 1.0555202442047111, 1.0615892198369101, 1.0680189916713152, 1.0748041510191668, 1.0819387725569887, 1.0894164222108935, 1.0972301661623898, 1.1053725809600055, 1.1138357647184405, 1.122611349382848, 1.1316905140336584, 1.1410639992037148, 1.1507221221766466, 1.1606547932326223, 1.1708515328045406, 1.1813014895053018, 1.1919934589839534, 1.2029159035660943, 1.2140569726316452, 1.2254045236806612, 1.2369461440361422, 1.2486691731304167, 1.2605607253203575, 1.2726077131748021, 1.2847968711764273, 1.2971147797786386, 1.3095478897576152, 1.3220825467981923, 1.3347050162521248, 1.3474015080063206, 1.3601582013988764, 1.3729612701202372, 1.3857969070372274, 1.398651348877866, 1.4115109007155744, 1.4243619601919404, 1.437191041418218 ], [ 1.022257922180203, 1.0234374727864504, 1.0249945428478053, 1.0269305530417456, 1.0292464142174422, 1.0319425209498587, 1.035018746117901, 1.0384744365302543, 1.042308409620297, 1.0465189512282684, 1.0511038144863858, 1.056060219819459, 1.061384856070677, 1.0670738827590394, 1.0731229334720047, 1.0795271203936159, 1.0862810399651595, 1.0933787796725207, 1.1008139259507401, 1.1085795731934773, 1.1166683338516954, 1.1250723496028188, 1.1337833035683933, 1.1427924335553796, 1.1520905462929003, 1.161668032633783, 1.171514883686871, 1.1816207078436236, 1.1919747486597456, 1.2025659035502123, 1.2133827432530606, 1.2244135320158311, 1.235646248455693, 1.2470686070425534, 1.258668080152519, 1.2704319206373975, 1.2823471848543664, 1.2944007560985022, 1.3065793683797773, 1.3188696304850973, 1.3312580502650178, 1.3437310590843021, 1.3562750363749823, 1.3688763342303187, 1.3815213019780392, 1.3941963106713946, 1.40688777743687, 1.4195821896180172, 1.4322661286555163, 1.4449262936445804 ], [ 1.033807646275683, 1.0350373970659967, 1.0366394674652288, 1.0386151921208184, 1.040965402074138, 1.0436904185207767, 1.0467900475832477, 1.0502635761194454, 1.0541097685873744, 1.058326864983952, 1.0629125798728385, 1.0678641025135576, 1.0731780981007937, 1.0788507101202536, 1.0848775638240327, 1.0912537708253789, 1.0979739348098885, 1.1050321583565537, 1.1124220508594076, 1.1201367375370224, 1.1281688695142476, 1.1365106349570848, 1.145153771239063, 1.1540895781139635, 1.1633089318670922, 1.172802300414279, 1.1825597593149197, 1.1925710086628714, 1.2028253908161486, 1.213311908923968, 1.22401924620733, 1.234935785946992, 1.246049632130563, 1.2573486307085882, 1.26882039140744, 1.2804523100454035, 1.2922315912966524, 1.3041452718466184, 1.3161802438809471, 1.3283232788494268, 1.3405610514453836, 1.3528801637403636, 1.3652671694138276, 1.3777085980168369, 1.3901909792092515, 1.4027008669096792, 1.415224863298076, 1.4277496426112697, 1.4402619746725036, 1.4527487480969685 ], [ 1.0455828948895367, 1.0468622103194114, 1.0485085181050149, 1.0505230667603, 1.0529066075861202, 1.0556593886379009, 1.05878114969387, 1.0622711182466278, 1.0661280065379237, 1.0703500096538503, 1.0749348046949756, 1.079879551033001, 1.0851808916624306, 1.0908349556532233, 1.0968373617069647, 1.1031832228160317, 1.1098671520225505, 1.1168832692703201, 1.1242252093401406, 1.1318861308558, 1.1398587263447155, 1.1481352333343982, 1.1567074464629343, 1.1655667305782333, 1.1747040347986155, 1.184109907503853, 1.193774512223236, 1.2036876443848312, 1.2138387488869455, 1.2242169384509165, 1.2348110127117407, 1.245609478000799, 1.256600567772955, 1.2677722636284128, 1.279112316877812, 1.2906082705974367, 1.3022474821199803, 1.3140171459051166, 1.3259043167328008, 1.3378959331612783, 1.349978841191418, 1.3621398180778128, 1.3743655962271577, 1.3866428871240486, 1.3989584052243442, 1.4112988917563933, 1.4236511383709072, 1.4360020105806992, 1.4483384709322942, 1.4606476018524353 ], [ 1.0575680781174688, 1.0588962508056012, 1.0605859680482896, 1.0626383922397433, 1.0650541951168166, 1.067833551934838, 1.0709761366320838, 1.0744811180047047, 1.0783471569115604, 1.08257240452543, 1.0871545016447128, 1.0920905790765458, 1.097377259099575, 1.1030106580116101, 1.1089863897644863, 1.1152995706853805, 1.121944825280764, 1.128916293116129, 1.1362076367617848, 1.143812050791492, 1.1517222718182172, 1.1599305895479484, 1.1684288588295462, 1.1772085126759506, 1.186260576228882, 1.1955756816365746, 1.2051440838114869, 1.2149556770318446, 1.2250000123491305, 1.2352663157602768, 1.2457435071019596, 1.2564202196214962, 1.2672848201773257, 1.278325430019675, 1.2895299461008696, 1.3008860628626076, 1.3123812944463917, 1.3240029972719434, 1.3357383929275064, 1.3475745913147892, 1.3594986139906169, 1.3714974176471837, 1.3835579176717834, 1.39566701172734, 1.407811603294645, 1.4199786251176698, 1.4321550624935422, 1.444327976349495, 1.4564845260496375, 1.4686119918755642 ], [ 1.069747426626067, 1.0711236786010878, 1.0728559137455473, 1.0749452084641424, 1.0773921552143397, 1.0801968568911968, 1.0833589221882494, 1.0868774619560364, 1.0907510865765366, 1.0949779043700196, 1.09955552104726, 1.1044810402180003, 1.1097510649631743, 1.115361700475818, 1.1213085577724946, 1.1275867584741273, 1.1341909406522985, 1.1411152657337236, 1.1483534264530133, 1.1558986558404296, 1.1637437372287833, 1.17188101526031, 1.180302407871587, 1.1889994192317987, 1.197963153606699, 1.2071843301178975, 1.2166532983645653, 1.2263600548719933, 1.2362942603289255, 1.2464452575734533, 1.2568020902846802, 1.2673535223355676, 1.2780880577601723, 1.2889939612867762, 1.3000592793866237, 1.3112718617865289, 1.3226193833920386, 1.3340893665669804, 1.3456692037137183, 1.3573461800979456, 1.3691074968609862, 1.3809402941619553, 1.3928316743920501, 1.4047687254028234, 1.4167385436905457, 1.4287282574787392, 1.4407250496416808, 1.452716180411843, 1.4646890098154632, 1.4766310197809231 ], [ 1.0821050261448655, 1.0835285102593868, 1.0853023096286134, 1.087427414913263, 1.0899043396830106, 1.0927331150106674, 1.0959132850297737, 1.0994439034763037, 1.103323531232435, 1.1075502348880664, 1.112121586332588, 1.1170346633872672, 1.1222860514852526, 1.127871846403711, 1.133787658049589, 1.1400286152973984, 1.146589371875056, 1.153464113289887, 1.160646564785061, 1.168130000312776, 1.1759072525083671, 1.1839707236461308, 1.1923123975548529, 1.200923852468562, 1.2097962747848492, 1.2189204737006445, 1.2282868966927694, 1.2378856458078882, 1.2477064947243237, 1.2577389065456321, 1.2679720522838895, 1.2783948299883225, 1.288995884473281, 1.2997636275974458, 1.3106862590446824, 1.3217517875555247, 1.3329480525566724, 1.3442627461349685, 1.3556834353012455, 1.3671975844883122, 1.3787925782272745, 1.3904557439451704, 1.4021743748272302, 1.4139357526865008, 1.4257271707838444, 1.4375359565414438, 1.4493494940935434, 1.461155246618363, 1.4729407783963488, 1.4846937765405623 ], [ 1.0946248520214892, 1.0960946535291636, 1.0979090029770087, 1.1000688056411352, 1.1025744967004378, 1.1054260360402808, 1.1086229040066047, 1.1121640981304248, 1.1160481308402215, 1.12027302817711, 1.1248363295249142, 1.1297350883649502, 1.1349658740619424, 1.1405247746853082, 1.1464074008668348, 1.152608890692902, 1.1591239156267787, 1.1659466874531483, 1.1730709662347178, 1.1804900692672566, 1.18819688101697, 1.1961838640211513, 1.2044430707300569, 1.2129661562655836, 1.2217443920692062, 1.2307686804093607, 1.2400295697156822, 1.2495172707051927, 1.2592216732630934, 1.2691323640385865, 1.2792386447140025, 1.2895295509035551, 1.2999938716361024, 1.3106201693744255, 1.3213968005222796, 1.3323119363685667, 1.3433535844170952, 1.3545096100488432, 1.3657677584631058, 1.3771156768426724, 1.3885409366878645, 1.4000310562636447, 1.4115735231036766, 1.4231558165152753, 1.4347654300291468, 1.4463898937380146, 1.458016796468739, 1.469633807733115, 1.4812286994032866, 1.4927893670586623 ], [ 1.1072908037349916, 1.1088059420259637, 1.1106597687330202, 1.1128531042193186, 1.1153863058737261, 1.1182592631238324, 1.121471393386187, 1.1250216389729764, 1.1289084649720806, 1.133129858114693, 1.1376833266423314, 1.1425659011821496, 1.1477741366369438, 1.153304115093307, 1.1591514497487503, 1.1653112898556173, 1.1717783266768933, 1.1785468004461048, 1.1856105083206128, 1.192962813314894, 1.200596654197329, 1.2085045563316443, 1.2166786434408783, 1.225110650269505, 1.2337919361164402, 1.2427134992092277, 1.2518659918870942, 1.26123973655822, 1.270824742394399, 1.2806107227237302, 1.2905871130802444, 1.3007430898672003, 1.3110675895890553, 1.321549328605275, 1.3321768233576978, 1.3429384110218299, 1.353822270530939, 1.3648164439209325, 1.3759088579429621, 1.387087345890059, 1.3983396695831356, 1.4096535414618234, 1.421016646724743, 1.432416665464234, 1.4438412947402615, 1.4552782705387315, 1.4667153895597886, 1.47814053078225, 1.4895416767511207, 1.5009069345361528 ], [ 1.1200867392638956, 1.1216461697531384, 1.1235383441607896, 1.1257639985190673, 1.1283234131292608, 1.131216407783756, 1.13444233791166, 1.1380000916668145, 1.1418880879743873, 1.1461042755495534, 1.150646132899775, 1.1555106693188781, 1.1606944268789277, 1.1661934834229488, 1.1720034565589712, 1.1781195086527747, 1.1845363528142414, 1.1912482598693845, 1.1982490663069136, 1.205532183186095, 1.2130906059892208, 1.2209169253997694, 1.2290033389842916, 1.2373416637537338, 1.2459233495769735, 1.2547394934172016, 1.2637808543590032, 1.273037869391967, 1.2825006699140795, 1.2921590989162794, 1.3020027288074794, 1.312020879837083, 1.3222026390709571, 1.3325368798742867, 1.343012281854098, 1.3536173512120966, 1.3643404414577283, 1.3751697744303122, 1.3860934615777414, 1.3970995254390404, 1.408175921277232, 1.4193105588084443, 1.4304913239733414, 1.441706100696331, 1.4529427925787148, 1.4641893444717198, 1.475433763876121, 1.4866641421155642, 1.4978686752316461, 1.5090356845496395 ], [ 1.1329965092063985, 1.1345991253694359, 1.1365284632463104, 1.1387851752286036, 1.1413694653321205, 1.1442810846271607, 1.1475193275788371, 1.1510830293152006, 1.1549705638389773, 1.1591798431958862, 1.16370831761025, 1.1685529765958524, 1.173710351047486, 1.1791765163157997, 1.1849470962654853, 1.1910172683140972, 1.1973817694459403, 1.204034903192772, 1.2109705475704435, 1.2181821639575863, 1.2256628069000324, 1.233405134821785, 1.2414014216207112, 1.2496435691248564, 1.2581231203822012, 1.2668312737546878, 1.2757588977848824, 1.284896546801097, 1.2942344772248648, 1.303762664542591, 1.313470820900808, 1.3233484132832674, 1.333384682225674, 1.3435686610228086, 1.353889195380897, 1.3643349634671034, 1.3748944963065886, 1.3855561984766664, 1.3963083690467064, 1.4071392227117479, 1.4180369110671451, 1.4289895439712872, 1.4399852109432003, 1.451012002541771, 1.4620580316734226, 1.4731114547753688, 1.4841604928222363, 1.4951934521039938, 1.506198744724501, 1.5171649087703574 ], [ 1.1460039905526256, 1.1476486261021053, 1.1496138907368265, 1.1519003540039505, 1.1545081445330068, 1.1574369456736393, 1.1606859920293575, 1.1642540669045445, 1.1681395006797526, 1.1723401701278338, 1.1768534986810557, 1.1816764576564596, 1.1868055684447405, 1.1922369056646411, 1.1979661012826057, 1.2039883496947157, 1.2102984137649113, 1.216890631811297, 1.2237589255292365, 1.2308968088374088, 1.2382973976303948, 1.2459534204185652, 1.253857229833748, 1.2620008149762547, 1.2703758145766828, 1.2789735309434231, 1.287784944664309, 1.2968007300289097, 1.306011271135566, 1.315406678645346, 1.324976807143226, 1.3347112730647808, 1.3445994731451953, 1.3546306033457807, 1.3647936782116497, 1.3750775506130695, 1.3854709318218155, 1.395962411872814, 1.406540480160578, 1.4171935462193, 1.4279099606348487, 1.438678036036636, 1.4494860681171575, 1.4603223566268473, 1.4711752262922115, 1.4820330476053387, 1.4928842574334844, 1.5037173793979277, 1.5145210439722518, 1.5252840082509354 ], [ 1.1590931200103978, 1.1607785512070978, 1.1627784557208145, 1.1650933211537848, 1.1677232017431356, 1.1706677142048718, 1.1739260344597084, 1.177496895257408, 1.1813785847139084, 1.1855689457733658, 1.1900653766044873, 1.1948648319382913, 1.1999638253516711, 1.2053584324987678, 1.2110442952892557, 1.217016627010291, 1.2232702183861188, 1.2297994445665583, 1.2365982730331584, 1.2436602724090944, 1.2509786221562254, 1.2585461231401598, 1.2663552090418897, 1.2743979585917011, 1.282666108598876, 1.291151067748456, 1.2998439311338281, 1.3087354954918173, 1.3178162751049578, 1.3270765183335342, 1.336506224738174, 1.346095162751789, 1.3558328878585257, 1.3657087612352605, 1.37571196881017, 1.3858315406916994, 1.3960563709197862, 1.4063752374908263, 1.4167768226063515, 1.4272497330955718, 1.4377825209605248, 1.4483637039932222, 1.4589817864131114, 1.4696252794739133, 1.480282721988405, 1.4909427007206644, 1.501593870595166, 1.512224974673281, 1.5228248638480542, 1.5333825162094659 ], [ 1.1722479267890369, 1.1739728748800613, 1.1760060846517273, 1.1783479627615092, 1.1809984901397632, 1.1839572180386893, 1.1872232649486587, 1.1907953143980343, 1.194671613650285, 1.1988499733097286, 1.2033277678449081, 1.2081019370362072, 1.2131689883515886, 1.2185250002520847, 1.224165626425858, 1.2300861009472264, 1.23628124435427, 1.2427454706363439, 1.249472795119918, 1.256456843238675, 1.2636908601714798, 1.2711677213289647, 1.2788799436672453, 1.2868196978048723, 1.2949788209165751, 1.303348830375293, 1.311920938111541, 1.3206860656574302, 1.3296348598399619, 1.338757709087127, 1.3480447603076886, 1.3574859363045082, 1.3670709536791041, 1.3767893411841783, 1.3866304584790852, 1.3965835152422783, 1.4066375905936905, 1.416781652778888, 1.427004579066457, 1.437295175808965, 1.4476421986178674, 1.4580343726022194, 1.4684604126206897, 1.4789090434969516, 1.489369020147982, 1.4998291475758052, 1.5102783006732627, 1.5207054437950918, 1.531099650046693, 1.5414501202434077 ], [ 1.1854525647483543, 1.1872156985250406, 1.1892808337224174, 1.191648297150832, 1.1943179976084368, 1.1972894221333212, 1.2005616331086064, 1.204133266235802, 1.2080025293897347, 1.2121672023657055, 1.2166246375275283, 1.2213717613623534, 1.2264050769459107, 1.2317206673192536, 1.2373141997756596, 1.2431809310535311, 1.24931571342897, 1.2557130016989322, 1.2623668610432472, 1.2692709757516711, 1.2764186587990114, 1.2838028622496542, 1.291416188469778, 1.2992509021234795, 1.30729894292683, 1.3155519391313286, 1.324001221706361, 1.3326378391880556, 1.3414525731599896, 1.3504359543293003, 1.3595782791600004, 1.3688696270237037, 1.3782998778261537, 1.3878587300669616, 1.397535719288283, 1.4073202368671958, 1.4172015491054857, 1.4271688165697551, 1.4372111136337868, 1.447317448174867, 1.4574767813751168, 1.4676780475785687, 1.4779101741548486, 1.4881621013200719, 1.4984228018659769, 1.5086813007485051, 1.5189266944875655, 1.5291481703305516, 1.5393350251326035, 1.5494766839079097 ], [ 1.198691343823276, 1.2004912822911118, 1.2025869204996809, 1.2049785066043395, 1.2076658785312342, 1.2106484604308503, 1.2139252599697612, 1.2174948664754415, 1.2213554499465884, 1.2255047609394207, 1.2299401313376013, 1.2346584760117172, 1.239656295371097, 1.2449296788090234, 1.250474309039238, 1.2562854673197652, 1.2623580395571408, 1.2686865232818838, 1.275265035483473, 1.282087321290649, 1.289146763480502, 1.296436392797201, 1.3039488990591341, 1.3116766430307418, 1.3196116690331052, 1.327745718265285, 1.3360702428061266, 1.3445764202644401, 1.3532551690433865, 1.3620971641830901, 1.371092853743888, 1.3802324756908988, 1.3895060752390886, 1.3989035226167938, 1.4084145312042584, 1.4180286760026073, 1.4277354123879542, 1.43752409510416, 1.4473839974473701, 1.4573043305946445, 1.4672742630288416, 1.4772829400115415, 1.4873195030555995, 1.4973731093492721, 1.507432951083685, 1.5174882746360623, 1.5275283995615614, 1.5375427373470587, 1.5475208098812963, 1.557452267596447 ], [ 1.2119487606382582, 1.2137840757904832, 1.215908754732629, 1.2183229682481955, 1.2210264847339447, 1.224018666852768, 1.227298469009827, 1.230864435666483, 1.2347147005035641, 1.2388469864440845, 1.2432586065425073, 1.2479464657458998, 1.2529070635295745, 1.2581364974075298, 1.2636304673157026, 1.269384280863398, 1.2753928594459794, 1.281650745209343, 1.2881521088545111, 1.2948907582678633, 1.3018601479605836, 1.3090533892983496, 1.3164632614997889, 1.3240822233805736, 1.3319024258171186, 1.339915724902275, 1.3481136957630695, 1.356487647008803, 1.365028635775656, 1.3737274833325546, 1.3825747912109967, 1.3915609578202333, 1.4006761955077216, 1.4099105480233454, 1.419253908344716, 1.4286960368199586, 1.4382265795831384, 1.447835087197098, 1.4575110334773607, 1.4672438344507, 1.4770228674010941, 1.486837489956192, 1.4966770591666587, 1.5065309505313769, 1.5163885769214607, 1.526239407356348, 1.5360729855859825, 1.5458789484335322, 1.555647043853913, 1.5653671486645628 ], [ 1.2252095282292472, 1.2270787479158718, 1.2292309682520655, 1.2316662840201669, 1.2343843955091591, 1.2373846053644033, 1.2406658162459352, 1.2442265293087893, 1.2480648435166866, 1.2521784557983695, 1.2565646620533597, 1.2612203590118796, 1.2661420469512377, 1.2713258332685258, 1.2767674369073778, 1.2824621936338407, 1.2884050621542535, 1.294590631065514, 1.3010131266258265, 1.3076664213316562, 1.3145440432841493, 1.3216391863263117, 1.3289447209296474, 1.3364532058069836, 1.3441569002260336, 1.352047776996142, 1.3601175360987365, 1.3683576189300848, 1.3767592231230403, 1.3853133179129922, 1.394010660011251, 1.4028418099479878, 1.4117971488451058, 1.4208668955784132, 1.4300411242870787, 1.4393097821874892, 1.4486627076476937, 1.4580896484778267, 1.4675802803912712, 1.4771242255908528, 1.486711071434067, 1.4963303891310844, 1.5059717524291867, 1.5156247562374916, 1.5252790351459442, 1.5349242817930415, 1.5445502650371485, 1.554146847887023, 1.56370400514801, 1.5732118407410418 ], [ 1.2384586047953936, 1.2403602156787588, 1.2425384438825025, 1.2449933096423793, 1.2477244466364763, 1.250731099029353, 1.2540121193097953, 1.2575659669349184, 1.261390707791371, 1.26548401448243, 1.2698431674472908, 1.2744650569167095, 1.2793461857070247, 1.284482672851971, 1.2898702580697423, 1.2955043070600902, 1.3013798176241167, 1.3074914265970434, 1.3138334175819193, 1.3203997294698708, 1.3271839657303426, 1.3341794044524855, 1.3413790091166444, 1.348775440072833, 1.3563610667009067, 1.3641279802253565, 1.3720680071552853, 1.3801727233189405, 1.3884334684596402, 1.3968413613589272, 1.4053873154508663, 1.4140620548899605, 1.4228561310340069, 1.4317599393016212, 1.440763736363589, 1.4498576576255897, 1.4590317349594821, 1.468275914639348, 1.4775800754380255, 1.4869340468392835, 1.4963276273206196, 1.5057506026614276, 1.515192764231146, 1.5246439272123693, 1.5340939487137804, 1.5435327457285821, 1.5529503128942064, 1.5623367400101267, 1.5716822292710724, 1.5809771121741216 ], [ 1.2516812214067379, 1.2536136719948556, 1.2558163432928697, 1.2582891825245717, 1.261031758325619, 1.26404325797944, 1.2673224854316507, 1.270867860094937, 1.2746774164549317, 1.2787488044849828, 1.283079290875882, 1.2876657610841247, 1.292504722200354, 1.2975923066371229, 1.3029242766329798, 1.308496029567566, 1.3143026040800871, 1.3203386869813012, 1.3265986209469234, 1.333076412978017, 1.3397657436117958, 1.346659976864054, 1.3537521708824463, 1.3610350892875114, 1.36850121317649, 1.3761427537631299, 1.3839516656245001, 1.3919196605243678, 1.4000382217806755, 1.4082986191433942, 1.4166919241471143, 1.4252090259016783, 1.4338406472826304, 1.4425773614821338, 1.451409608880061, 1.4603277141937296, 1.469321903864255, 1.4783823236366977, 1.487499056290321, 1.496662139475549, 1.5058615836130629, 1.5150873898110888, 1.5243295677563953, 1.5335781535349668, 1.5428232273383147, 1.5520549310121026, 1.5612634854040102, 1.57043920746854, 1.579572527087342, 1.588654003564463 ], [ 1.264862908599128, 1.266824612347599, 1.269050133716555, 1.2715393485284783, 1.2742917620128154, 1.277306506230821, 1.2805823382634476, 1.2841176391741516, 1.287910413756237, 1.2919582910721774, 1.296258525790537, 1.3008080003236775, 1.3056032277673586, 1.3106403556411566, 1.3159151704263161, 1.3214231028956287, 1.3271592342272422, 1.333118302892706, 1.3392947123068482, 1.3456825392251555, 1.3522755428719726, 1.3590671747810426, 1.3660505893274508, 1.373218654928329, 1.3805639658875148, 1.3880788548575747, 1.3957554058907913, 1.4035854680488395, 1.4115606695394336, 1.4196724323464192, 1.4279119873185249, 1.4362703896806253, 1.4447385349297979, 1.4533071750777953, 1.4619669352002194, 1.4707083302516764, 1.479521782105893, 1.488397636778525, 1.4973261817903118, 1.5062976636275556, 1.51530230525692, 1.5243303236511179, 1.533371947282252, 1.5424174335396958, 1.5514570860296404, 1.5604812717138303, 1.5694804378456482, 1.5784451286622279, 1.587366001792249, 1.5962338443398685 ] ], "zauto": true, "zmax": 1.5962338443398685, "zmin": -1.5962338443398685 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.048756662731341834, 0.047232941787108754, 0.045796250812025596, 0.04444813525730884, 0.04318974882920913, 0.0420217930542708, 0.04094445858825435, 0.03995737171018994, 0.039059549789918026, 0.03824936954350514, 0.037524551518819636, 0.03688216345861299, 0.036318644016770665, 0.0358298468741194, 0.03541110379050357, 0.035057303743112216, 0.03476298422328504, 0.034522430128151656, 0.03432977554253896, 0.034179104030795195, 0.03406454375101082, 0.0339803546285978, 0.033921005838556464, 0.03388124281951216, 0.033856143886439524, 0.03384116717027112, 0.03383218907473781, 0.03382553571431737, 0.03381800890829622, 0.03380690828885365, 0.03379005096822773, 0.03376579002985438, 0.033733032880819774, 0.033691260240254, 0.033640546244669445, 0.03358157982375272, 0.03351568713233169, 0.03344485440505097, 0.033371750121468716, 0.03329974482466833, 0.033232926332115616, 0.03317610743486393, 0.03313482254775337, 0.033115309229091484, 0.03312447015213769, 0.03316981113736952, 0.03325935142028727, 0.033401503600618936, 0.03360492279759632, 0.0338783273953794 ], [ 0.046569097481099914, 0.045009280663311044, 0.04353713275787321, 0.04215450266143456, 0.04086287198567093, 0.03966328561820277, 0.03855628134163604, 0.03754182233074139, 0.036619237047181834, 0.035787171411924085, 0.03504355801213078, 0.03438560640020244, 0.03380981726730606, 0.033312021533467885, 0.03288744340760722, 0.03253078451731196, 0.032236324579162055, 0.031998033006729494, 0.03180968545577064, 0.0316649795791098, 0.03155764508889555, 0.03148154441217316, 0.031430761566466243, 0.03139967818700396, 0.03138303676819594, 0.03137599206129569, 0.03137415217399096, 0.03137361126305908, 0.031370975839776716, 0.03136338666902279, 0.0313485380858766, 0.031324696317441794, 0.031290718110457076, 0.031246070642618216, 0.031190853341214655, 0.031125821841417267, 0.031052413875101666, 0.03097277637275625, 0.030889792468598017, 0.030807106410492918, 0.03072914359372042, 0.030661122085901552, 0.030609051152600725, 0.030579711540916946, 0.030580611804279012, 0.030619914986049986, 0.03070633078653362, 0.03084897016460331, 0.03105716231055789, 0.031340237993361754 ], [ 0.044497161905671864, 0.04290178315247697, 0.04139443049245249, 0.03997725869099086, 0.03865209020944926, 0.037420337703801605, 0.03628292209007901, 0.035240190156278724, 0.034291836853968666, 0.033436838254471996, 0.03267340146866667, 0.031998937408317454, 0.03141006101626079, 0.03090262157481546, 0.030471763152944788, 0.030112012550281793, 0.0298173896751747, 0.029581533542193717, 0.029397836235896497, 0.0292595773147569, 0.029160052087941882, 0.029092688727727984, 0.029051150971027097, 0.029029424930195398, 0.02902189006528639, 0.029023375549098566, 0.029029204049166053, 0.029035225385800133, 0.029037842666647967, 0.029034033421524514, 0.029021368038037457, 0.028998027484877592, 0.028962821944181594, 0.028915211576751237, 0.028855330217172407, 0.02878401232931572, 0.028702823025311876, 0.028614090334784913, 0.02852093817706788, 0.028427317614170403, 0.028338032941624677, 0.02825875803609796, 0.028196037206484635, 0.028157263748783516, 0.028150628738887934, 0.028185032659619975, 0.02826995365194614, 0.028415268873454358, 0.028631029820139545, 0.028927198328006637 ], [ 0.04254558511257094, 0.04091556649575056, 0.039373632705502905, 0.037922236987633924, 0.03656354617136281, 0.03529935690429193, 0.034131003201319746, 0.03305925909275707, 0.032084241843127206, 0.031205322721987453, 0.030421053302325335, 0.029729115393805513, 0.02912630173063152, 0.02860853236683052, 0.02817090858969669, 0.02780780251030162, 0.02751297695686605, 0.027279727512428797, 0.027101036962995224, 0.026969732231514092, 0.02687863494047051, 0.02682069871414403, 0.02678912874260817, 0.026777481545896157, 0.026779744973131576, 0.026790400066072362, 0.02680446746175084, 0.026817541552480798, 0.0268258157649197, 0.026826102177649823, 0.026815848374819953, 0.02679315401182722, 0.02675678910048161, 0.026706215530112994, 0.02664161282849811, 0.026563908613468204, 0.026474813558862095, 0.026376859953024648, 0.026273442017206963, 0.026168855033849837, 0.026068328993990104, 0.025978050939423434, 0.025905168560447903, 0.02585776614699547, 0.025844803061311143, 0.025876005040312466, 0.025961700466156597, 0.026112597814253926, 0.026339507006308324, 0.026653015917681898 ], [ 0.04071857580840181, 0.03905528844843592, 0.03747984094413743, 0.03599496633092401, 0.03460316755356847, 0.03330663017194333, 0.032107121545758496, 0.031005879595311578, 0.03000349647338152, 0.029099804793975035, 0.028293776013238445, 0.027583441615771708, 0.02696584742372466, 0.0264370493164417, 0.025992154991310492, 0.025625411615068518, 0.025330334167408083, 0.025099864954462862, 0.02492655199257452, 0.024802733155340644, 0.024720714071674307, 0.024672930285559627, 0.02465208745617712, 0.02465127671461889, 0.024664065189645496, 0.02468456388786054, 0.024707476494734096, 0.024728133334531527, 0.024742514848561405, 0.024747268699837587, 0.024739724143197934, 0.02471790672804944, 0.02468055579706774, 0.024627146638103375, 0.024557918533728566, 0.024473909302808003, 0.024376996187687693, 0.02426994204196135, 0.02415644464199021, 0.024041185512074747, 0.023929872880415266, 0.023829271300904894, 0.0237472082383201, 0.023692545863918547, 0.023675105031401005, 0.023705528734496505, 0.023795075253854495, 0.02395533748993527, 0.024197894823091076, 0.024533916246351668 ], [ 0.039019676945454905, 0.03732499397327155, 0.03571761206410743, 0.03420051342053389, 0.03277651537420554, 0.03144818317287924, 0.030217724169172486, 0.029086865216890426, 0.028056717789708918, 0.02712763850921535, 0.026299095930723798, 0.025569556869466072, 0.02493640642817927, 0.0243959145130244, 0.02394325773886487, 0.023572599632156008, 0.023277225020978416, 0.023049717939757977, 0.022882167687692728, 0.02276638575078393, 0.022694117236741126, 0.022657233677222135, 0.022647898506051426, 0.022658701172025283, 0.02268275987925619, 0.02271379592697245, 0.022746184445359197, 0.022774987136683765, 0.02279597268591706, 0.02280563007490822, 0.022801179347946548, 0.022780583596706986, 0.02274256515222408, 0.022686628225241985, 0.022613089509795146, 0.02252311750834444, 0.022418780469976415, 0.022303101753679156, 0.022180120021556168, 0.0220549498203869, 0.021933835753101483, 0.021824190600894005, 0.021734604646928463, 0.021674810589798144, 0.021655586732933364, 0.02168858191005641, 0.021786050360395215, 0.021960494646210332, 0.022224229644022958, 0.022588898493823437 ], [ 0.037451607724565225, 0.03572794179130017, 0.034090772406491145, 0.03254328905623493, 0.031088587760143546, 0.02972958817441739, 0.02846892726451195, 0.027308829429165904, 0.02625095592007879, 0.025296240349614352, 0.024444721603331068, 0.023695389739581296, 0.023046063272117903, 0.02249331632364461, 0.022032470641291112, 0.02165766041274531, 0.021361968395459813, 0.02113762217167702, 0.02097623169831686, 0.02086904544883035, 0.020807202867525854, 0.020781964865622744, 0.020784910180671336, 0.02080809194127351, 0.020844154435450273, 0.020886414177200243, 0.020928911768243356, 0.02096644200273374, 0.02099456957191403, 0.021009637010842838, 0.021008770527030155, 0.020989888286213315, 0.020951714723945615, 0.020893803537922463, 0.020816571163699702, 0.020721341667795816, 0.020610402987351183, 0.020487073153975313, 0.02035577338716763, 0.02022210255657568, 0.020092904368111678, 0.01997631474709867, 0.019881772583147758, 0.0198199730580624, 0.0198027406416279, 0.019842800589784992, 0.01995343571683905, 0.020148030835925854, 0.0204395297433367, 0.020839854510169193 ], [ 0.03601610155454217, 0.03426641846287893, 0.03260220958796302, 0.031026820844318074, 0.029543578534953503, 0.028155715171147892, 0.02686626784199101, 0.025677946549578844, 0.02459297278544133, 0.023612893059495394, 0.022738377922233495, 0.021969023450002432, 0.021303177698832467, 0.02073781729755197, 0.02026849731300683, 0.019889389978951514, 0.019593415789617367, 0.019372456561285466, 0.019217628009552224, 0.01911958230114424, 0.019068810295955373, 0.019055918088875374, 0.019071860796308654, 0.019108125709147016, 0.019156864885497348, 0.01921098288678115, 0.019264188493874134, 0.019311020293004223, 0.01934685565260771, 0.01936791145756298, 0.01937124351489315, 0.019354750099521607, 0.019317183818933464, 0.01925817486663159, 0.01917826774870849, 0.019078972583744264, 0.01896283092177065, 0.018833494484928066, 0.01869581304668705, 0.018555924574815946, 0.018421336570498038, 0.01830098225642287, 0.01820522937104913, 0.018145814054776988, 0.018135669949174198, 0.01818862642491626, 0.018318963193431896, 0.01854083304181494, 0.0188675973010236, 0.01931115116086721 ], [ 0.034713752544872974, 0.03294155277276628, 0.03125365396865097, 0.02965350258953281, 0.02814459744543008, 0.02673042819176297, 0.02541438368500135, 0.024199624837235745, 0.023088918910250413, 0.022084436618275582, 0.02118752019028038, 0.020398439184054973, 0.019716159770493846, 0.019138159738128227, 0.0186603224568115, 0.01827693619648294, 0.017980810606200503, 0.017763502987918116, 0.017615628641902834, 0.017527217391458662, 0.01748807541023389, 0.0174881172381983, 0.017517644235626302, 0.01756755862762043, 0.017629513443823044, 0.01769600634948444, 0.017760429380921205, 0.017817087659026714, 0.017861199301917638, 0.017888886950040064, 0.01789716924376122, 0.017883958656439925, 0.017848070452061097, 0.017789246210160696, 0.017708194236529598, 0.017606648077401747, 0.01748744303286344, 0.0173546087162742, 0.017213472969153404, 0.017070768436384276, 0.016934727547998425, 0.01681514457621835, 0.01672337558759414, 0.016672240457121425, 0.01667578923404764, 0.01674890296752587, 0.016906721190037614, 0.01716392541190313, 0.01753395325075053, 0.01802825541074281 ], [ 0.03354388661666188, 0.03175314831772168, 0.030045468819623944, 0.028424339391626488, 0.02689336944123755, 0.02545624055955645, 0.02411662939887193, 0.02287809125003979, 0.02174389748509216, 0.020716823822873945, 0.019798893458222888, 0.01899108958406404, 0.01829306446025299, 0.017702883802421496, 0.017216851217491013, 0.016829453174169347, 0.01653344876338991, 0.016320103242794575, 0.0161795374889386, 0.01610114572367797, 0.01607402703975621, 0.016087382701570112, 0.01613084655356409, 0.01619473387842623, 0.016270209542340083, 0.01634938662726537, 0.016425371766461704, 0.016492274279947334, 0.016545194577603613, 0.01658020456507748, 0.016594329898655433, 0.01658554139102307, 0.016552760838939556, 0.016495884982853024, 0.016415830044455838, 0.016314598061282225, 0.01619536471402005, 0.016062586104447385, 0.015922118499159418, 0.015781339889455397, 0.015649254962594252, 0.015536555864635919, 0.01545560120371785, 0.015420268202954413, 0.01544563319500019, 0.015547450694503162, 0.015741436304597067, 0.016042411550079745, 0.016463424877261455, 0.01701499745557583 ], [ 0.03250447535785656, 0.030699556092483378, 0.028976474517127513, 0.02733871669190195, 0.02578994292679437, 0.024333958711984426, 0.02297465510811409, 0.02171590804489509, 0.02056142593037162, 0.019514537514327614, 0.018577918501142328, 0.017753266963109405, 0.017040953680683774, 0.01643969103090123, 0.015946276909860273, 0.015555471009745475, 0.015260044602858324, 0.0150510134216021, 0.014918025629608575, 0.014849846536289407, 0.014834868862289073, 0.014861584112223686, 0.014918971056194129, 0.014996782062639935, 0.015085729157169473, 0.015177585323838285, 0.01526522259504622, 0.015342608874989934, 0.015404782664484262, 0.015447820896182022, 0.015468811192293132, 0.015465836608494104, 0.015437978464883925, 0.015385341061307631, 0.015309100662891671, 0.015211579761302907, 0.015096345823875524, 0.014968330993785037, 0.014833964865363768, 0.014701305889690508, 0.014580147779361499, 0.01448206588842221, 0.014420357031779634, 0.01440981933256975, 0.01446632412804766, 0.014606158338454625, 0.014845166950558434, 0.01519779276210104, 0.01567616919760682, 0.016289438902541562 ], [ 0.03159211029771998, 0.02977761004043879, 0.028043835707603076, 0.026394228557795208, 0.024832448420533833, 0.023362361129712957, 0.02198799736408332, 0.02071347051181163, 0.019542839653589755, 0.018479904617069748, 0.01752792528924988, 0.016689268982877967, 0.015965008368907588, 0.015354515908494546, 0.014855121902015128, 0.014461911690961952, 0.01416772381156641, 0.013963373678983072, 0.013838077381644314, 0.01378000625785495, 0.013776881699475876, 0.013816526123100992, 0.013887312663859836, 0.013978489251164428, 0.014080380702051651, 0.014184489829091785, 0.01428352545163938, 0.014371384712673973, 0.01444311278503871, 0.014494857594634236, 0.014523832142494033, 0.014528293004950468, 0.014507540688067474, 0.014461945464412223, 0.014393000737121483, 0.014303404379420131, 0.014197166323579669, 0.01407973725162782, 0.013958147819722037, 0.013841139740155968, 0.013739259018715285, 0.013664868704827386, 0.013632027029682093, 0.01365617352592022, 0.013753580258047682, 0.013940566161759581, 0.014232538921658036, 0.014643002406653784, 0.015182713619784663, 0.015859158393952046 ], [ 0.03080205163651639, 0.02898264568964482, 0.02724303920420884, 0.025586602195847925, 0.024016955238960466, 0.022537971491556823, 0.0211537528070676, 0.01986856637683839, 0.01868672543908058, 0.017612396633079855, 0.01664931999107002, 0.015800438300534892, 0.015067452802713434, 0.014450350800179116, 0.013946980616605084, 0.01355276709502377, 0.013260651863602611, 0.013061301143668397, 0.012943560906344574, 0.012895079656338928, 0.012902987601630219, 0.012954526695861177, 0.013037559627028848, 0.013140928458736075, 0.013254669160984672, 0.01337010940509134, 0.01347988440793381, 0.013577903820003779, 0.013659296488081127, 0.013720352821515876, 0.013758478262457493, 0.013772166621317153, 0.013760998717390853, 0.013725669464643266, 0.013668044736902042, 0.01359124743222457, 0.013499769458679072, 0.013399602120346358, 0.01329837080812115, 0.013205450429804352, 0.013132025865039464, 0.013091048883544423, 0.013097034355199648, 0.013165642609678367, 0.013313021376416193, 0.013554935038036228, 0.013905782161745608, 0.014377666637787773, 0.014979706063176735, 0.015717711621987002 ], [ 0.03012835865269615, 0.028308614654987102, 0.026567983079789182, 0.024909749436833977, 0.023337470213806482, 0.02185498649253428, 0.02046641440601739, 0.019176098274075404, 0.017988508221971216, 0.016908061495802425, 0.015938848205637735, 0.015084251575749516, 0.014346473500142653, 0.013726008718836976, 0.013221148613659752, 0.01282762289229466, 0.012538484601379692, 0.012344299905407806, 0.01223362908845606, 0.01219371002462971, 0.01221121309109139, 0.012272941285543609, 0.012366390019885877, 0.012480133292610432, 0.012604045762409642, 0.012729394667380154, 0.01284884299381364, 0.012956401925957952, 0.013047362528115482, 0.013118227924302464, 0.01316665993740044, 0.013191448764707178, 0.013192510567626776, 0.013170915282241357, 0.013128944852267456, 0.013070179738699474, 0.012999608224981758, 0.012923747941745594, 0.012850761518863574, 0.012790538142791385, 0.01275470103512493, 0.012756490642253072, 0.012810470832698706, 0.01293201929721447, 0.01313660106566212, 0.013438884457585822, 0.013851824991500037, 0.014385883682993258, 0.015048532756934475, 0.01584413026134097 ], [ 0.029564099946124096, 0.0277482967556052, 0.02601118438417443, 0.024355961166506686, 0.022786106741693974, 0.02130540369897986, 0.019917938340169992, 0.01862806617737008, 0.017440322976202436, 0.016359258342778533, 0.015389168814459748, 0.014533715386468263, 0.01379543099513462, 0.013175158503971737, 0.01267150331092013, 0.012280419842028175, 0.011995054086555825, 0.01180591905929956, 0.011701395596919987, 0.011668462643317468, 0.011693509901548549, 0.011763089948122528, 0.011864513873777969, 0.011986254817359229, 0.01211817235848264, 0.012251597408172915, 0.01237932431336153, 0.012495551962449386, 0.012595805940919339, 0.012676863820049565, 0.012736697524685894, 0.012774440839257098, 0.012790386079494648, 0.012786011086110211, 0.012764035216822405, 0.01272850016242772, 0.012684867447743917, 0.01264011875096141, 0.012602837337781671, 0.012583239367339107, 0.01259311446119407, 0.012645629824862208, 0.012754957746887192, 0.012935709301624855, 0.013202200180709299, 0.013567630073392494, 0.014043304348190427, 0.014638039909503858, 0.01535786128817007, 0.0162060188412206 ], [ 0.02910163207387342, 0.027293598876787322, 0.025564096550466594, 0.02391623984346032, 0.022353426588628548, 0.020879363716891003, 0.01949807385206879, 0.01821386810349452, 0.0170312654556075, 0.015954834653567562, 0.014988933512573696, 0.014137327639274323, 0.013402690874008997, 0.012786026040912363, 0.01228609150312284, 0.011898958869130316, 0.011617833641328115, 0.011433224659323659, 0.011333457954327131, 0.011305434510299946, 0.011335474992266368, 0.0114100989157627, 0.01151663694915215, 0.011643640317367358, 0.01178110308725009, 0.011920540709468101, 0.01205497465801398, 0.012178866914046649, 0.012288037211473818, 0.012379585206306252, 0.012451831086552142, 0.012504281914069038, 0.012537626672947598, 0.012553759807048025, 0.012555830151048882, 0.012548308844456133, 0.012537065434730377, 0.012529435528013952, 0.012534256144889386, 0.012561837443737818, 0.012623834220502773, 0.012732981807964781, 0.01290267379710045, 0.013146386820838438, 0.013476998123403092, 0.013906083467744726, 0.014443307768752954, 0.015096012557093417, 0.015869060897709054, 0.016764937992137744 ], [ 0.02873292701281718, 0.026935918334872366, 0.0252175117525524, 0.023580743496741503, 0.022028927317355698, 0.020565681438250178, 0.0191949366628842, 0.017920911367519995, 0.016748033837386305, 0.015680787765143533, 0.014723455547153314, 0.013879740833238252, 0.01315227197161611, 0.012542024435229787, 0.01204774781561827, 0.011665523647762915, 0.011388587272888436, 0.011207500574568468, 0.011110670852272839, 0.011085113625692776, 0.01111730039071653, 0.011193937648251563, 0.011302576134430281, 0.011432015455991457, 0.01157252137719014, 0.011715900241722017, 0.011855480906068229, 0.01198604795336326, 0.012103758769408515, 0.012206066078221556, 0.012291658720805813, 0.012360427057843942, 0.012413454830429589, 0.012453035823232459, 0.012482710461040058, 0.012507313878921273, 0.012533022604329936, 0.01256738171493812, 0.012619288756895152, 0.012698906338531494, 0.012817474800399702, 0.012987003138517136, 0.01321983331546635, 0.013528100182545152, 0.0139231410164117, 0.014414934105250063, 0.01501165233209246, 0.015719398595850885, 0.01654215005189169, 0.017481892595498767 ], [ 0.02844992390504872, 0.02666654097411382, 0.02496201220468866, 0.023339297893522647, 0.021801623725540845, 0.020352505702655153, 0.01899575603061824, 0.017735455935817237, 0.016575876348710685, 0.015521323114700851, 0.014575882646368648, 0.013743051113974308, 0.013025250424158733, 0.012423269811945666, 0.011935717372402071, 0.011558603760526774, 0.011285184989127232, 0.011106144923130811, 0.011010109588869502, 0.010984392784561895, 0.011015819629776298, 0.011091481061764967, 0.011199323225851418, 0.0113285391582694, 0.011469779788421787, 0.011615227202020793, 0.011758578652428499, 0.01189498339672331, 0.012020963598536856, 0.01213433984050155, 0.012234173107273377, 0.012320728670442375, 0.012395462608919583, 0.012461027996567597, 0.012521294401712676, 0.012581370777517987, 0.012647617885666644, 0.012727632338907172, 0.01283018104124477, 0.012965063847945045, 0.01314288583217476, 0.013374730690024697, 0.013671744164110034, 0.014044658550768255, 0.014503310319903675, 0.015056214363384722, 0.015710253808167814, 0.016470523053545003, 0.01734033046074944, 0.01832133693049585 ], [ 0.028244879480928447, 0.026477041961078304, 0.024788430161930806, 0.023181926188044547, 0.021660659376283295, 0.020228026847118382, 0.018887694334692284, 0.01764356367033978, 0.01649968876615982, 0.015460118415099616, 0.014528644370486128, 0.013708441050811204, 0.013001603198258016, 0.012408621475398281, 0.0119278773712002, 0.01155527133455061, 0.011284098961828956, 0.01110524480235897, 0.011007681682865016, 0.010979180166785552, 0.01100708649347554, 0.011079034373493692, 0.011183502725275253, 0.011310189215663648, 0.01145021485041294, 0.011596198883337457, 0.011742248782578714, 0.011883904359522864, 0.012018065237709118, 0.012142920819054671, 0.012257893594230199, 0.012363600328976558, 0.01246183092150871, 0.012555540956928454, 0.012648850649667368, 0.012747039658413369, 0.012856524203820531, 0.012984800468552765, 0.013140337344039564, 0.013332403528772102, 0.01357082012458235, 0.013865640865987912, 0.014226776988274046, 0.01466359930968393, 0.015184561406420518, 0.015796889878333654, 0.016506378362971166, 0.01731730325655897, 0.018232456950103313, 0.019253275724229923 ], [ 0.028110694112212606, 0.02635966008282022, 0.024688279369132354, 0.023099348208428568, 0.02159588645567546, 0.020181152123889448, 0.018858635372907898, 0.01763201895363954, 0.016505088290051116, 0.015481571834479674, 0.014564893574693805, 0.013757828164121936, 0.013062068550937578, 0.012477746743050369, 0.012002984208378389, 0.011633574367266064, 0.011362896575507162, 0.011182118207555514, 0.011080669123982234, 0.011046901177192283, 0.01106880661017939, 0.011134676142703819, 0.011233618361747306, 0.01135591255069947, 0.01149320729338077, 0.01163859908009792, 0.011786630739579692, 0.011933245032727628, 0.012075720067855322, 0.012212604116947929, 0.012343659651988338, 0.012469820357315116, 0.012593160237931895, 0.012716870285687331, 0.01284523511998096, 0.012983599447553793, 0.013138312253554059, 0.01331663583868285, 0.013526607922699762, 0.013776848867214036, 0.01407631311251115, 0.014433993783636096, 0.014858600429009732, 0.01535823912819607, 0.015940128482925475, 0.016610382061884803, 0.017373877805730874, 0.018234220421525487, 0.01919378814668788, 0.020253844366490702 ], [ 0.02804119548763679, 0.02630762281033886, 0.02465412898546762, 0.023083412160020102, 0.02159836580411718, 0.02020208636202463, 0.018897859684650336, 0.017689114145476748, 0.0165793253326602, 0.015571855726379629, 0.014669715070371629, 0.01387523618642258, 0.013189679256235059, 0.012612804713324884, 0.012142484614722341, 0.011774441714473486, 0.011502199259004628, 0.011317285566208724, 0.01120967562346956, 0.011168392357083182, 0.011182158510417893, 0.011239996163103021, 0.011331705146601758, 0.011448194386393468, 0.011581674987851077, 0.011725743608504108, 0.011875390478188638, 0.012026963240586257, 0.01217811052854787, 0.012327721192521974, 0.012475868023783069, 0.012623759135152233, 0.012773695778372448, 0.012929032009603948, 0.01309412905241469, 0.013274295427950946, 0.013475703133030849, 0.013705270749335832, 0.013970506826801897, 0.014279311497543792, 0.014639740863089248, 0.015059746340642333, 0.015546908179501067, 0.01610818670532572, 0.016749714818886954, 0.01747665033938122, 0.018293097995705505, 0.01920210055855109, 0.020205689453402027, 0.02130497920449706 ], [ 0.028031367937350123, 0.026315407351656588, 0.024679901585902296, 0.02312743564627005, 0.021660757919664906, 0.020282780769358372, 0.018996559644358584, 0.0178052397461325, 0.016711957127632914, 0.01571968061586273, 0.014830984089234061, 0.014047747718844721, 0.013370803401521109, 0.012799562687794742, 0.012331689191794138, 0.011962891021483244, 0.011686900670241118, 0.011495675634498931, 0.011379801702328413, 0.011329032461100655, 0.011332872926737646, 0.011381119920001289, 0.011464299468779384, 0.01157397680816745, 0.01170294412215027, 0.011845308794226019, 0.011996510969780515, 0.012153297341003037, 0.012313672251842553, 0.01247684038445108, 0.01264314899322712, 0.012814032482979729, 0.012991958139736456, 0.013180368893365596, 0.01338361702656466, 0.01360688177483883, 0.013856063947705935, 0.014137652260279037, 0.014458559135452189, 0.014825928194419817, 0.015246920950577258, 0.01572849535276534, 0.01627719249817313, 0.016898948871328957, 0.01759894926941898, 0.01838153046530775, 0.019250138837199858, 0.02020733831925159, 0.021254859624560914, 0.022393678660348238 ], [ 0.028077521118578367, 0.026378930448212674, 0.024761086880304397, 0.023226446374542926, 0.02177759388255134, 0.020417237316376437, 0.019148180292209938, 0.01797326402238202, 0.016895267349041107, 0.015916754265880153, 0.015039861945795664, 0.014266030986041157, 0.013595694164996187, 0.013027958997517346, 0.012560337597404346, 0.012188586279109315, 0.01190670854408606, 0.011707146118090183, 0.01158114112436953, 0.011519213815685094, 0.011511679572961002, 0.01154913200169847, 0.01162284054511178, 0.011725039504853037, 0.0118491101217908, 0.011989672982615218, 0.01214261418830771, 0.012305068021503864, 0.01247537443716861, 0.012653024043925673, 0.012838597807841483, 0.013033704159531066, 0.013240912710873397, 0.013463681388611192, 0.013706272445887357, 0.01397365254250988, 0.014271372946397094, 0.014605427918776698, 0.014982092373396297, 0.015407743575258965, 0.015888675324018622, 0.016430915927808445, 0.01704006251885334, 0.017721143405205052, 0.018478517229480417, 0.019315813317862366, 0.02023591273699614, 0.02124096527238683, 0.022332434570900075, 0.023511162367908234 ], [ 0.02817739624182235, 0.026495665503786254, 0.02489487045823314, 0.023377323035148945, 0.021945428547948613, 0.02060167389094545, 0.019348595328429048, 0.018188717684424694, 0.01712445604396835, 0.016157972052950435, 0.01529098078889905, 0.01452451213874249, 0.013858642987740408, 0.013292231680705553, 0.012822699804218725, 0.012445911827555677, 0.012156194581096135, 0.011946514704080195, 0.011808799179555851, 0.011734353574218868, 0.011714315822904789, 0.011740084963302696, 0.01180368050205785, 0.01189801056578166, 0.012017047411815049, 0.012155922558254926, 0.012310959968237122, 0.012479666057752978, 0.012660692191938435, 0.012853780849388664, 0.013059702114552355, 0.01328018331136597, 0.013517831706268765, 0.01377604836583503, 0.014058930457969231, 0.014371159511804898, 0.014717874338845817, 0.015104529314740697, 0.015536741238201096, 0.016020130575590326, 0.016560165016164387, 0.0171620143668205, 0.017830425544878133, 0.01856962473122613, 0.019383250930198586, 0.020274321826655638, 0.02124522961395466, 0.022297761962238115, 0.023433141832174136, 0.024652079454613052 ], [ 0.028330210959204717, 0.0266646893431413, 0.025080181552842484, 0.02357884276245984, 0.022162885815421595, 0.02083456475402943, 0.019596139258524027, 0.018449813261818767, 0.017397640853911857, 0.01644139397092502, 0.015582390188836219, 0.014821285951593415, 0.014157850721499882, 0.013590749288106574, 0.013117369301938709, 0.012733734176141128, 0.012434533731633045, 0.012213285842731023, 0.012062616597980262, 0.011974622701692195, 0.01194126624405539, 0.011954752213061349, 0.012007850939023106, 0.012094144987983377, 0.012208196570516793, 0.012345643353117249, 0.01250323658215878, 0.012678836607503635, 0.012871378975017608, 0.013080820910971248, 0.013308074448208355, 0.013554929350974756, 0.013823966725122785, 0.014118462873687152, 0.014442282573374233, 0.014799761424116788, 0.015195578103758314, 0.015634618995542828, 0.016121839411273167, 0.016662127116316237, 0.017260174701190945, 0.017920367276698268, 0.01864669093029396, 0.0194426655316903, 0.02031130316423734, 0.02125509112255315, 0.022275996457414394, 0.023375487735230047, 0.024554569102129414, 0.025813821833226468 ], [ 0.02853664562422768, 0.026886662729846928, 0.025317665901370218, 0.023831643901534146, 0.022430608249515146, 0.02111657327151459, 0.019891518777625093, 0.018757330037216118, 0.017715709978434753, 0.0167680601281103, 0.01591533037244703, 0.01515784356899712, 0.014495109131793634, 0.013925648554205515, 0.013446862714488191, 0.013054972255543114, 0.012745055613025587, 0.012511194279165857, 0.012346715161405291, 0.012244501574453323, 0.012197333448942138, 0.012198216616224354, 0.012240669256841618, 0.012318946610585173, 0.01242819817849185, 0.012564561661855626, 0.012725203586028586, 0.012908318366887363, 0.01311309669829365, 0.013339671868327393, 0.01358904997796435, 0.01386302770152297, 0.014164099544831046, 0.014495355652386927, 0.014860371069260818, 0.015263087851335564, 0.01570769233291104, 0.01619849093695024, 0.016739788855887172, 0.017335776468159692, 0.017990428297296707, 0.01870741860717751, 0.019490056449165048, 0.020341241351782616, 0.021263439153464864, 0.022258675999242857, 0.02332854745094874, 0.024474239089300926, 0.02569655489762507, 0.02699595001468142 ], [ 0.028798774333993964, 0.027163749391058974, 0.025609590209917377, 0.02413811287768014, 0.022751122787347818, 0.02145039236087419, 0.020237623393469684, 0.019114389993381664, 0.018082058620263297, 0.017141683371792085, 0.016293877842497088, 0.015538669763914988, 0.014875350883975107, 0.014302340988378261, 0.013817089581827046, 0.01341603911991691, 0.013094668054076511, 0.012847620428183102, 0.01266891390561185, 0.012552204218307937, 0.012491075334654624, 0.012479323342095245, 0.012511207512777685, 0.012581651510602131, 0.012686387862592612, 0.01282204709835383, 0.012986198186277489, 0.013177349116882802, 0.013394916465490042, 0.013639171465322786, 0.01391116837106245, 0.014212659270136962, 0.014545998326366194, 0.01491403783378943, 0.015320018381056148, 0.01576745574055688, 0.01626002759957892, 0.01680146371946905, 0.017395443338943363, 0.018045503486875895, 0.01875496128917514, 0.01952685239672282, 0.02036388646704851, 0.021268419387474334, 0.022242440817647615, 0.023287574795121214, 0.024405090660628202, 0.025595921420839426, 0.02686068681948439, 0.028199718746530204 ], [ 0.029119944560635228, 0.02749947849563798, 0.025959684601182545, 0.024502203321535503, 0.023128632840227068, 0.02184050551311279, 0.020639251078438507, 0.019526143783364817, 0.01850223126060924, 0.017568244578033382, 0.016724491604410682, 0.015970739716491635, 0.015306098539470821, 0.014728917929179665, 0.014236719308884137, 0.013826178150223191, 0.013493170758950544, 0.013232889803456514, 0.013040022027118544, 0.012908971267163635, 0.012834103173088258, 0.012809986509791874, 0.012831609410654806, 0.012894555668542581, 0.012995133808585003, 0.013130458345798408, 0.013298487248375394, 0.013498022041144288, 0.013728677619137993, 0.013990828354808877, 0.014285536102576803, 0.014614464695010512, 0.014979784754674883, 0.015384072208288984, 0.01583020374860272, 0.016321252525106644, 0.016860387402580182, 0.01745077905940132, 0.018095515900361254, 0.01879753219370977, 0.01955955004255982, 0.02038403585974198, 0.02127317105793086, 0.02222883581851202, 0.023252604159062253, 0.02434574813070061, 0.02550924884548985, 0.026743812123825733, 0.02804988680247285, 0.029427684089671686 ], [ 0.02950460979739702, 0.027898556017796988, 0.02637292968042392, 0.02492919549548478, 0.023568746448686548, 0.022292879833671845, 0.021102762278588115, 0.01999938191813457, 0.01898348663427858, 0.018055508743856988, 0.017215478761343595, 0.016462933843924308, 0.015796829876492974, 0.015215469153228361, 0.014716457246557804, 0.014296701887307575, 0.013952462904649514, 0.013679455749789005, 0.013473003134219999, 0.013328221830030759, 0.01324022665434646, 0.013204332242821538, 0.013216235367385695, 0.013272165204303904, 0.013368994577857136, 0.013504310408793536, 0.013676445528887833, 0.013884476425907582, 0.014128192545515807, 0.014408042905717483, 0.014725065407503606, 0.015080803692027949, 0.015477215903714304, 0.015916579344713265, 0.016401394726970702, 0.016934293468895068, 0.017517951156608202, 0.01815500982960039, 0.018848011134475512, 0.019599341644426192, 0.020411190831745828, 0.02128552139284401, 0.022224050944495605, 0.02322824360060872, 0.024299309631629018, 0.0254382113029526, 0.02664567305453479, 0.027922194376943425, 0.02926806400919885, 0.030683374384749877 ], [ 0.029958120849552555, 0.028366631656905148, 0.02685529609134068, 0.02542540525365718, 0.02407815122598897, 0.02281460344489129, 0.02163567627057342, 0.020542086758310114, 0.019534302419296646, 0.01861248003276343, 0.017776398363524036, 0.017025389834561346, 0.016358278485389996, 0.015773333380205215, 0.01526824733966897, 0.01484014983424314, 0.014485659801381891, 0.014200979309013697, 0.013982023280868908, 0.013824575226011155, 0.013724455333698277, 0.013677686168701447, 0.013680642553693738, 0.01373017541739098, 0.013823703438398473, 0.013959270280806053, 0.014135568450248309, 0.014351933027447066, 0.014608309801802674, 0.014905202848645648, 0.015243606635242848, 0.015624927525633152, 0.016050899225358517, 0.01652349632512072, 0.01704484967092737, 0.017617166784106016, 0.0182426599571557, 0.018923483961770255, 0.01966168455349604, 0.02045915819738363, 0.021317622734715595, 0.022238598123268366, 0.023223395953594583, 0.0242731161903621, 0.025388649502559844, 0.026570683603532284, 0.027819712183068217, 0.029136045238509704, 0.030519819863132857, 0.03197101079819534 ], [ 0.030486483302297283, 0.02891003010424383, 0.027413446791500894, 0.02599785438763804, 0.02466424974228722, 0.023413482860861503, 0.022246227563296073, 0.02116294517954353, 0.02016384172787198, 0.01924882009033825, 0.01841743006680787, 0.01766882072092278, 0.017001700865897054, 0.01641431449745422, 0.015904438040803433, 0.015469405100703463, 0.015106161894992939, 0.014811352981921544, 0.014581432891306137, 0.014412795677867848, 0.014301912014436004, 0.014245462702585527, 0.014240458418366554, 0.014284337744868774, 0.014375038459315601, 0.014511040020716234, 0.014691377785478861, 0.014915631425730316, 0.015183891303215949, 0.015496707250177875, 0.0158550244682834, 0.01626011120674529, 0.01671348261518556, 0.017216824740459772, 0.017771922079610415, 0.018380591436272332, 0.019044624085948085, 0.019765737480491537, 0.020545536968405616, 0.021385487331695107, 0.022286893389794154, 0.023250888526292455, 0.02427842976404419, 0.025370297936993202, 0.02652710155639086, 0.02774928310998855, 0.02903712672962965, 0.030390766382488884, 0.03181019395926843, 0.033295266831102725 ], [ 0.031096091121721545, 0.029535458204368606, 0.02805441541276263, 0.026653917780742883, 0.02533477307873573, 0.024097620623926574, 0.022942905448969955, 0.021870848092290313, 0.020881410930358977, 0.019974262823512598, 0.019148744829548467, 0.018403840723084597, 0.017738156839046934, 0.01714991608410639, 0.016636970586851093, 0.01619683623556153, 0.015826750307936014, 0.015523750779202825, 0.015284773146818744, 0.015106758264720693, 0.014986763201901376, 0.014922066792364411, 0.014910262317461209, 0.014949331411293934, 0.01503769542239299, 0.015174242704698948, 0.015358332335889402, 0.01558977638511172, 0.015868804008843263, 0.016196011359554466, 0.0165723016054258, 0.01699881934855053, 0.017476883455437856, 0.018007921831392503, 0.018593411030703378, 0.019234822853420486, 0.019933579297673837, 0.020691016477970562, 0.021508357443783807, 0.022386693284658775, 0.023326971515205536, 0.024329990501251345, 0.025396398604131332, 0.026526696757035454, 0.027721243311765516, 0.02898026017219236, 0.03030383943142225, 0.031691949929910035, 0.033144443334648215, 0.03466105949600785 ], [ 0.03179344884587496, 0.030249702371957878, 0.028785277226865278, 0.027400966322958353, 0.02609739422152564, 0.024874997890181556, 0.02373400472299311, 0.02267440850370671, 0.021695944541961356, 0.020798065845786664, 0.019979922837920154, 0.019240349664358676, 0.01857786043387645, 0.017990658613882222, 0.017476662173696672, 0.017033545877646227, 0.016658800476271603, 0.016349806641867148, 0.016103919655303462, 0.01591855940447395, 0.015791299463676176, 0.01571994901309128, 0.015702622094193097, 0.015737790008178928, 0.01582431430645503, 0.015961459539254826, 0.016148886513354062, 0.01638662812239414, 0.016675050782029632, 0.01701480510885598, 0.01740676974047045, 0.017851992138329744, 0.01835162989101894, 0.0189068954989287, 0.019519006938665283, 0.020189145549373108, 0.02091842202831802, 0.021707850636602036, 0.022558331149824598, 0.023470637674021265, 0.02444541319262378, 0.025483168604641126, 0.026584285031791045, 0.027749018280377267, 0.028977504507979077, 0.030269766335244874, 0.031625718835177306, 0.033045175009541135, 0.034527850514549575, 0.036073367521770296 ], [ 0.032584896775944755, 0.03105933270720888, 0.029612831421122046, 0.02824602678592627, 0.026959365223248467, 0.025753088850431614, 0.02462721764809766, 0.023581531621640776, 0.02261555434910379, 0.02172853973184397, 0.02091946411809054, 0.020187026163041872, 0.019529656727490356, 0.018945540721766164, 0.018432652039036837, 0.017988801625904792, 0.017611697421267704, 0.017299013536580733, 0.01704846486556151, 0.016857882497257365, 0.016725284999789748, 0.016648940886958244, 0.016627418323450088, 0.01665961924016429, 0.016744796352808414, 0.016882552937018565, 0.017072826469266836, 0.017315858289817437, 0.017612152216347186, 0.01796242550234794, 0.018367555688442117, 0.018828526756580016, 0.019346377607307598, 0.01992215529834424, 0.020556874782928315, 0.021251486148572894, 0.022006849657400632, 0.022823718290667958, 0.023702727043018807, 0.024644387914012616, 0.025649089400028177, 0.026717099276870788, 0.027848569550455924, 0.02904354260532041, 0.03030195776602318, 0.03162365767931512, 0.033008394105706745, 0.03445583286725442, 0.035965557827603294, 0.03753707388050061 ], [ 0.03347635434003896, 0.03197043082925533, 0.030543313676771752, 0.02919547972683144, 0.027927201349572918, 0.02673853239142429, 0.025629294755395837, 0.024599066748409577, 0.02364717462165947, 0.022772688960474158, 0.021974427692272876, 0.02125096741395321, 0.02060066444155561, 0.02002168643181177, 0.019512054633998927, 0.019069695868269846, 0.01869250230547239, 0.018378396183468957, 0.018125395878237808, 0.017931679367082204, 0.017795641137114387, 0.017715939003774935, 0.017691528052897382, 0.0177216799072782, 0.017805986627907423, 0.017944349674482638, 0.01813695536747772, 0.018384239133903708, 0.018686841421816525, 0.019045558500243944, 0.019461291409688913, 0.019934996109115803, 0.020467637417834052, 0.02106014873749678, 0.021713398837876412, 0.02242816628117571, 0.023205121416655032, 0.024044815355857032, 0.024947674969309008, 0.025914002735398536, 0.02694398020656, 0.02803767390898367, 0.029195042624961972, 0.030415945187459412, 0.03170014811422472, 0.03304733260190476, 0.03445710057354501, 0.03592897961782118, 0.03746242677277249, 0.03905683119145598 ], [ 0.034473095908820195, 0.03298835700662567, 0.03158215588925697, 0.03025481342712242, 0.029006431227414364, 0.027836880798666985, 0.02674579477298474, 0.02573256138170353, 0.024796323534500307, 0.023935983911097844, 0.023150217395969223, 0.022437491934982855, 0.021796098453155457, 0.021224189855832038, 0.020719828387192395, 0.02028103981533195, 0.01990587215112698, 0.019592455989960622, 0.01933906318108136, 0.019144160435712588, 0.019006454700579125, 0.01892492762466977, 0.018898857178570747, 0.018927825370553843, 0.019011711956426744, 0.019150674977207138, 0.0193451198027735, 0.019595659045491327, 0.019903066182597025, 0.020268225955655868, 0.02069208458625597, 0.021175602572428, 0.021719712348929776, 0.022325282469476015, 0.022993089276546582, 0.02372379634430265, 0.024517941381444208, 0.025375929813269145, 0.026298033950539344, 0.027284396497716135, 0.02833503713563865, 0.029449861002991306, 0.030628668061228104, 0.031871162524868046, 0.03317696174532962, 0.034545604130861024, 0.03597655585489582, 0.037469216244168685, 0.039022921844793876, 0.0406369492416278 ], [ 0.035579570677788885, 0.03411756866156217, 0.03273380534662407, 0.031428446124107744, 0.03020142481668039, 0.029052436427433118, 0.027980933175110363, 0.02698612497326347, 0.026066985539164613, 0.025222265234787766, 0.024450511521913652, 0.02375009754629408, 0.02311925886020712, 0.022556137682005133, 0.02205883343091577, 0.021625457636505772, 0.021254190782488143, 0.02094333827317655, 0.020691382558000813, 0.02049702853884463, 0.020359239710759917, 0.020277263018421955, 0.020250641100341214, 0.02027921138079691, 0.020363092293971326, 0.02050265772293229, 0.020698501449100185, 0.02095139398010657, 0.021262234509504353, 0.021632000926351258, 0.02206170072248018, 0.022552325349595156, 0.023104810094219805, 0.023720000924000367, 0.02439862908772056, 0.025141293598825498, 0.025948451164305213, 0.02682041268386824, 0.027757345160822306, 0.028759277735456938, 0.029826110553781565, 0.0309576252890457, 0.032153496304462306, 0.033413301650327853, 0.034736533299465085, 0.03612260622176509, 0.03757086606922122, 0.03908059538179012, 0.040651018330350286, 0.042281304088864914 ], [ 0.03679927410110056, 0.035361497241622755, 0.03400160950208798, 0.03271962137581572, 0.031515302241769426, 0.03038817700134226, 0.029337527008873807, 0.028362396335073883, 0.027461604320972628, 0.026633765186069948, 0.02587731514101159, 0.025190547029023236, 0.024571652007617684, 0.02401876722400578, 0.023530027889656684, 0.023103621680680416, 0.022737843036758985, 0.022431144744765354, 0.022182184197192357, 0.021989861913354027, 0.02185335028609982, 0.02177211103863667, 0.02174590050474108, 0.021774762538159572, 0.021859009567238873, 0.021999192993110993, 0.022196064737146363, 0.022450532230453093, 0.022763609462990185, 0.023136366840287345, 0.02356988251584654, 0.024065197583185042, 0.024623277052727592, 0.02524497795838413, 0.025931025302074768, 0.026681995922808625, 0.02749830983173487, 0.028380228131644505, 0.029327856361535357, 0.0303411519756244, 0.03141993466423691, 0.032563898323195006, 0.033772623644940145, 0.0350455905066843, 0.03638218954106661, 0.03778173247308719, 0.0392434609806029, 0.04076655397812524, 0.0423501333336555, 0.0439932681077092 ], [ 0.03813467343204064, 0.03672248467126061, 0.035387765789793954, 0.03413037377664801, 0.03294991796525492, 0.03184576076091381, 0.03081702343101009, 0.02986259781852398, 0.028981164669542526, 0.028171218995654005, 0.027431102528252153, 0.026759042883544817, 0.026153198577687338, 0.025611708553838573, 0.02513274445463667, 0.024714563539151146, 0.024355559939027015, 0.02405431189589585, 0.02380962272739392, 0.02362055352369075, 0.02348644596038533, 0.023406934099985736, 0.023381944612352764, 0.02341168544335074, 0.02349662356743705, 0.02363745304109062, 0.02383505509261329, 0.024090452403063074, 0.024404760015619358, 0.024779135426774516, 0.02521473034476318, 0.025712646350013583, 0.026273896281442107, 0.026899372644535523, 0.027589823749694545, 0.028345837705198114, 0.029167833866625272, 0.030056060928011875, 0.031010600554890605, 0.03203137531109232, 0.03311815960785587, 0.03427059248121596, 0.03548819115203015, 0.036770364511887775, 0.03811642588101296, 0.03952560458041079, 0.04099705603607966, 0.0425298702804894, 0.04412307883283269, 0.04577566002604773 ], [ 0.03958718503412854, 0.03820177514537491, 0.03689332996751633, 0.0356615558469632, 0.034505908093706225, 0.03342559587302205, 0.03241959268387951, 0.03148665306709716, 0.030625335953973192, 0.029834034752567136, 0.02911101389118561, 0.028454451122170234, 0.027862484469024475, 0.02733326231443205, 0.026864994813128765, 0.026456004602127242, 0.026104774691530098, 0.025809991459418768, 0.025570580839825524, 0.02538573606932286, 0.02525493572641499, 0.025177951235641788, 0.025154843493568235, 0.025185948784115102, 0.02527185466388043, 0.025413366989483835, 0.025611469701281312, 0.025867279339872915, 0.02618199652269561, 0.026556856719821997, 0.026993082622888326, 0.027491840195558403, 0.0280542001432457, 0.028681106077050662, 0.029373350119626124, 0.03013155616304562, 0.030956170493950094, 0.031847459091740235, 0.03280551060946375, 0.03383024387448, 0.03492141869099404, 0.036078648771329755, 0.03730141574164909, 0.03858908333403634, 0.039940911064359055, 0.04135606688392723, 0.042833638467209445, 0.04437264294883264, 0.045972035045938046, 0.047630713596655896 ], [ 0.041157197054947366, 0.039799553778756755, 0.038518272171193156, 0.03731291273320718, 0.03618278473165861, 0.03512695518509677, 0.03414426372091349, 0.033233343713258236, 0.032392649840801764, 0.03162049187572684, 0.03091507415145861, 0.03027453978472911, 0.029697018379578628, 0.029180675647747567, 0.028723763168184896, 0.028324666396105175, 0.027981949027113408, 0.027694391922624177, 0.027461024998995456, 0.027281150759241236, 0.027154358485512297, 0.02708052849545148, 0.027059826280453256, 0.027092686773874903, 0.027179789427436055, 0.027322025187062175, 0.027520456834701272, 0.027776274475430164, 0.028090748173483105, 0.02846517985200047, 0.02890085655142128, 0.029399006983909456, 0.029960763034504935, 0.030587127467425524, 0.031278948635744694, 0.032036902509221574, 0.032861481875193874, 0.033752992170987026, 0.034711553102481835, 0.035737105006747955, 0.03682941882730018, 0.03798810857695796, 0.03921264524580734, 0.040502371247138014, 0.04185651465924823, 0.04327420269537693, 0.04475447400214157, 0.046296289537730066, 0.047898541908789234, 0.04956006314707185 ], [ 0.04284412832647721, 0.041515021087530406, 0.04026156767656713, 0.03908318969541278, 0.03797906036950753, 0.036948117415654486, 0.035989081846426206, 0.03510048288989591, 0.03428068891841862, 0.03352794396095396, 0.03284040904291666, 0.032216207282429236, 0.031653471398417475, 0.03115039207790462, 0.03070526552302679, 0.030316538461950055, 0.029982848961293745, 0.02970306151404473, 0.02947629508363397, 0.029301943047552986, 0.029179684287869323, 0.029109485008822957, 0.029091591212365844, 0.029126512121841627, 0.02921499520220992, 0.029357993770435985, 0.02955662850640931, 0.0298121444443722, 0.030125865225108874, 0.030499146499530654, 0.030933330377350382, 0.03142970270174558, 0.031989454705497196, 0.032613650281497146, 0.033303199709149, 0.034058840253621214, 0.03488112363672403, 0.0357704100026214, 0.03672686769729644, 0.03775047796544179, 0.03884104354738543, 0.039998200126867264, 0.04122142962367491, 0.04251007442513888, 0.043863351786998774, 0.04528036778836486, 0.04676013038164779, 0.0483015612247133, 0.049903506111361066, 0.05156474392363353 ], [ 0.044646513151348724, 0.043346491522097574, 0.042121309199482114, 0.040970257936790065, 0.03989238675429536, 0.03888651835297261, 0.03795127134156741, 0.03708508824353248, 0.03628626896973933, 0.03555300914850324, 0.03488344241865422, 0.03427568553682333, 0.03372788494749418, 0.0332382633288162, 0.03280516456807994, 0.032427095639091, 0.03210276394471487, 0.031831108841805275, 0.03161132626969357, 0.03144288564497912, 0.03132553845279226, 0.03125931824896911, 0.031244532081939225, 0.03128174364160826, 0.031371748739442706, 0.031515544011332164, 0.03171429000126504, 0.031969270015032324, 0.032281846311454865, 0.03265341530620738, 0.03308536348470386, 0.03357902564606352, 0.03413564692923963, 0.034756349814308016, 0.03544210696680881, 0.03619372042837935, 0.03701180728501889, 0.03789679159672475, 0.03884890207612723, 0.03986817477797126, 0.040954459915478206, 0.04210743185331169, 0.0433266013322359, 0.044611329043644184, 0.04596083977668834, 0.0473742364901046, 0.04885051379985582, 0.050388570510640496, 0.05198722094502682, 0.05364520493328293 ], [ 0.04656210181174082, 0.045291505010256944, 0.04409482896584106, 0.042971246476043536, 0.04191969565247079, 0.0409388994498316, 0.04002739073450672, 0.03918354267592324, 0.03840560398194547, 0.03769173823998502, 0.03704006638900772, 0.03644871115163003, 0.035915842115062206, 0.035439720073616815, 0.035018739236846064, 0.03465146596324007, 0.03433667279208049, 0.034073366704759384, 0.03386081074027523, 0.033698538306844356, 0.033586359763809935, 0.0335243610892164, 0.03351289469415452, 0.03355256269237932, 0.03364419317925901, 0.033788810312636995, 0.03398759921186075, 0.034241866888686856, 0.03455300058151241, 0.03492242496708165, 0.03535155975842659, 0.03584177915402398, 0.03639437447826633, 0.03701052115194506, 0.03769125086698529, 0.03843742953272872, 0.03924974123712471, 0.04012867815179297, 0.041074536029521755, 0.042087414715441834, 0.0431672229306627, 0.04431368649328012, 0.045526359113346446, 0.04680463492624285, 0.04814776200070138, 0.049554856159450204, 0.0510249145685668, 0.05255682867449605, 0.05414939618606522, 0.05580133190611311 ], [ 0.04858796784264544, 0.047346942215921055, 0.04617882111336394, 0.04508267070105099, 0.04405733245656981, 0.0431014453231529, 0.04221347301918085, 0.04139173613799019, 0.04063444843777648, 0.03993975650199624, 0.03930578176232423, 0.03873066373359366, 0.038212603221334226, 0.03774990423267703, 0.03734101334884582, 0.036984555396820315, 0.03667936438033337, 0.03642450878584538, 0.036219310557459125, 0.0360633572271376, 0.035956506886769025, 0.03589888589219519, 0.03589087939434169, 0.0359331149972751, 0.03602644004607267, 0.03617189324535253, 0.03637067149662861, 0.03662409301109264, 0.03693355789280388, 0.03730050748381912, 0.03772638380556044, 0.03821259041044366, 0.03876045587018943, 0.039371200973599814, 0.040045910495530655, 0.04078551014500287, 0.04159074902338799, 0.042462187645123335, 0.043400191314561326, 0.044404928431496314, 0.045476373127232336, 0.04661431151962761, 0.04781835081949587, 0.04908793051750776, 0.05042233492121366, 0.05182070638533719, 0.053282058673382364, 0.05480528999416365, 0.05638919536405287, 0.05803247804721896 ], [ 0.05072061490839624, 0.04950913644909202, 0.04836945764502773, 0.047300551301634505, 0.046301177002282846, 0.045369905372068586, 0.044505147041638014, 0.04370518583317376, 0.04296821548761648, 0.042292379072819575, 0.041675810069020984, 0.04111667403040551, 0.04061320967432561, 0.040163768253912574, 0.03976685012138991, 0.03942113748199091, 0.0391255224625848, 0.038879129766563554, 0.038681333347702185, 0.03853176670467006, 0.038430326569341075, 0.03837716993381989, 0.03837270453197131, 0.03841757306098376, 0.03851263159649585, 0.03865892281933823, 0.038857644828828926, 0.0391101164608656, 0.039417740150028316, 0.03978196346407056, 0.04020424048619684, 0.040685994217492825, 0.04122858111330044, 0.04183325875281373, 0.04250115747558217, 0.04323325661198609, 0.04403036570172603, 0.04489311085215949, 0.04582192615459833, 0.046817049867998194, 0.047878524908062714, 0.04900620305450802, 0.050199752212547834, 0.05145866603549281, 0.05278227522796559, 0.054169759895784264, 0.05562016237967562, 0.057132400096359705, 0.05870527800357323, 0.06033750039828679 ], [ 0.05295607810949962, 0.051773977437061046, 0.050662493678218276, 0.04962052000214402, 0.048646748819541806, 0.04773969764600767, 0.046897739173013625, 0.04611913498980583, 0.04540207222951907, 0.04474470227119315, 0.04414518052535128, 0.043601706270078894, 0.04311256148911954, 0.042676147691597395, 0.04229101975946817, 0.04195591596683646, 0.04166978343623057, 0.04143179843311626, 0.04124138104423187, 0.04109820393239292, 0.041002195007249456, 0.040953533996260075, 0.040952643042969104, 0.041000171600742735, 0.041096976029518055, 0.04124409444017578, 0.04144271746261884, 0.041694155735610666, 0.04199980502171932, 0.04236110993189419, 0.04277952729277279, 0.043256490198575026, 0.043793373752984, 0.04439146342314064, 0.045051926799855556, 0.045775789392318265, 0.046563914892202095, 0.04741699013472457, 0.04833551477721403, 0.04931979552336135, 0.05036994455546891, 0.05148588170650133, 0.052667339813385346, 0.053913872643786984, 0.05522486477774324, 0.056599542847759046, 0.05803698758930167, 0.059536146220167556, 0.06109584474455243, 0.0627147998589023 ], [ 0.05529001642315945, 0.054137004186956675, 0.05305335984887663, 0.05203791066766824, 0.0510892961710206, 0.05020599513721464, 0.04938635628306698, 0.04862863205253289, 0.04793101476202498, 0.04729167425080727, 0.04670879611345542, 0.046180619559848056, 0.04570547395603544, 0.04528181314313608, 0.04490824670606209, 0.04458356746202144, 0.044306774553222544, 0.044077091652220714, 0.04389397991624466, 0.04375714545460085, 0.04366654119881388, 0.043622363187555226, 0.04362504139811459, 0.04367522537383754, 0.04377376501325099, 0.04392168700085024, 0.04412016747025755, 0.04437050159413921, 0.044674070886698794, 0.04503230907784862, 0.04544666746606833, 0.04591858067351254, 0.04644943370686537, 0.0470405311684412, 0.04769306936465114, 0.048408111927311544, 0.04918656940483763, 0.05002918310512011, 0.05093651329148567, 0.05190893165944179, 0.052946617865724396, 0.054049559751176444, 0.055217556800968993, 0.05645022632215994, 0.05774701178920372, 0.05910719280949081, 0.060529896188515446, 0.06201410762177935, 0.0635586836014744, 0.0651623631945478 ], [ 0.057717794563533695, 0.05659348578264977, 0.05553724132586773, 0.05454783588786838, 0.05362386964689842, 0.052763795928412884, 0.05196595208616899, 0.05122859297106559, 0.05054992624882328, 0.04992814874862212, 0.049361482980132536, 0.04884821294690647, 0.04838671840819857, 0.04797550679478025, 0.04761324206197549, 0.04729876985807575, 0.04703113849261223, 0.04680961530061793, 0.0466336981118438, 0.04650312164470769, 0.04641785875228832, 0.04637811655142241, 0.04638432756680721, 0.0464371361206728, 0.046537380295871414, 0.046686069896187204, 0.04688436092098055, 0.04713352715965315, 0.04743492959072529, 0.04778998433591208, 0.048200129965552084, 0.048666794973012066, 0.049191366227422706, 0.049775159173757556, 0.05041939047624035, 0.05112515369777494, 0.051893398479502466, 0.052724913538221105, 0.0536203136441803, 0.054580030587626636, 0.05560430799864127, 0.056693199759550575, 0.05784657164852946, 0.0590641057804435, 0.06034530736783103, 0.06168951330956088, 0.06309590212429288, 0.06456350477568948, 0.0660912159815545, 0.06767780565412237 ], [ 0.06023455376121828, 0.0591384901273742, 0.05810914397608186, 0.05714525010860672, 0.05624538190055827, 0.055407979265550814, 0.054631379374827406, 0.053913849499044264, 0.05325362125437241, 0.05264892548009008, 0.05209802695094438, 0.05159925813423226, 0.051151051236359935, 0.05075196784231435, 0.050400725528431715, 0.0500962209189567, 0.049837548753905635, 0.04962401663586609, 0.049455155222483754, 0.04933072372754948, 0.049250710685930656, 0.049215330026000245, 0.04922501257845624, 0.049280393233727085, 0.04938229404201658, 0.049531703630906566, 0.04972975339448811, 0.04997769098344403, 0.05027685169431629, 0.0506286284145264, 0.05103444082304421, 0.051495704570256366, 0.05201380116072123, 0.05259004923607937, 0.05322567790164786, 0.053921802659833075, 0.05467940441020454, 0.05549931185480718, 0.056382187515318, 0.057328517433634665, 0.05833860449750151, 0.059412565215066236, 0.06055032966280669, 0.06175164425415272, 0.06301607692344462, 0.06434302429171787, 0.06573172037546773, 0.06718124641401625, 0.06869054142150412, 0.07025841311154833 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 1.51831 (SEM: 0)
x1: 0.0685762
x2: 0.718234
x3: 0.335965
x4: 0.897475
x5: 0.601168
x6: 0.710612", "Arm 10_0
l2norm: 1.61819 (SEM: 0)
x1: 0.666982
x2: 0.664268
x3: 0.693438
x4: 0.80162
x5: 0.765403
x6: 0.152042", "Arm 11_0
l2norm: 0.94644 (SEM: 0)
x1: 0.282084
x2: 0.0673875
x3: 0.413584
x4: 0.480315
x5: 0.0656645
x6: 0.636843", "Arm 12_0
l2norm: 0.932 (SEM: 0)
x1: 0.206254
x2: 6.60798e-14
x3: 0.298768
x4: 0.493777
x5: 6.34186e-14
x6: 0.702143", "Arm 13_0
l2norm: 0.984218 (SEM: 0)
x1: 0.200045
x2: 0.0480718
x3: 0.441246
x4: 0.472412
x5: 0.0317254
x6: 0.712375", "Arm 14_0
l2norm: 0.946071 (SEM: 0)
x1: 0.328193
x2: 0.0693257
x3: 0.450113
x4: 0.463215
x5: 0.0705689
x6: 0.60032", "Arm 15_0
l2norm: 1.06328 (SEM: 0)
x1: 0.417384
x2: 0
x3: 0.699884
x4: 0.350061
x5: 0.0855929
x6: 0.580207", "Arm 16_0
l2norm: 0.820718 (SEM: 0)
x1: 0.15606
x2: 0
x3: 0.587224
x4: 0.369418
x5: 0.0811765
x6: 0.401662", "Arm 17_0
l2norm: 1.19238 (SEM: 0)
x1: 0.498267
x2: 0.0518496
x3: 0.671262
x4: 0.518782
x5: 0.0656804
x6: 0.668412", "Arm 18_0
l2norm: 1.01168 (SEM: 0)
x1: 0.323201
x2: 0.20733
x3: 0.556927
x4: 0.334392
x5: 0.080051
x6: 0.669071", "Arm 19_0
l2norm: 1.17097 (SEM: 0)
x1: 0.299306
x2: 0.252011
x3: 0.626811
x4: 0.28573
x5: 0.109757
x6: 0.855278", "Arm 1_0
l2norm: 1.19849 (SEM: 0)
x1: 0.949338
x2: 0.0491182
x3: 0.556218
x4: 0.320373
x5: 0.292361
x6: 0.187725", "Arm 20_0
l2norm: 1.17366 (SEM: 0)
x1: 0.291316
x2: 0.280218
x3: 0.991354
x4: 0.257568
x5: 0.128539
x6: 0.385291", "Arm 21_0
l2norm: 1.07553 (SEM: 0)
x1: 0.396724
x2: 0.37477
x3: 0.381043
x4: 0.285986
x5: 0.106864
x6: 0.787727", "Arm 22_0
l2norm: 1.05976 (SEM: 0)
x1: 0.216635
x2: 0.150787
x3: 0.46828
x4: 0.286583
x5: 0.114892
x6: 0.859544", "Arm 23_0
l2norm: 1.22408 (SEM: 0)
x1: 0.51546
x2: 0.196726
x3: 0.628195
x4: 0.223741
x5: 0.0811501
x6: 0.861798", "Arm 2_0
l2norm: 1.37169 (SEM: 0)
x1: 0.581462
x2: 0.980194
x3: 0.132119
x4: 0.674815
x5: 0.0487189
x6: 0.327802", "Arm 3_0
l2norm: 1.64374 (SEM: 0)
x1: 0.462208
x2: 0.256397
x3: 0.975449
x4: 0.105526
x5: 0.872175
x6: 0.836164", "Arm 4_0
l2norm: 1.47206 (SEM: 0)
x1: 0.336828
x2: 0.758475
x3: 0.6409
x4: 0.18382
x5: 0.883545
x6: 0.503031", "Arm 5_0
l2norm: 1.16315 (SEM: 0)
x1: 0.705866
x2: 0.474217
x3: 0.486199
x4: 0.596891
x5: 0.19162
x6: 0.0200606", "Arm 6_0
l2norm: 1.48913 (SEM: 0)
x1: 0.82591
x2: 0.55901
x3: 0.827168
x4: 0.39866
x5: 0.467513
x6: 0.40147", "Arm 7_0
l2norm: 1.39784 (SEM: 0)
x1: 0.194934
x2: 0.204444
x3: 0.0454832
x4: 0.819543
x5: 0.642837
x6: 0.88725", "Arm 8_0
l2norm: 1.54915 (SEM: 0)
x1: 0.187192
x2: 0.903279
x3: 0.774756
x4: 0.51646
x5: 0.33764
x6: 0.753606", "Arm 9_0
l2norm: 1.08309 (SEM: 0)
x1: 0.802279
x2: 0.361091
x3: 0.11798
x4: 0.202968
x5: 0.520776
x6: 0.269658" ], "type": "scatter", "x": [ 0.33596500754356384, 0.6934377392753959, 0.41358438041061163, 0.29876807653200854, 0.44124616307402886, 0.45011318349525953, 0.6998844131158911, 0.5872237248413074, 0.6712621569678692, 0.5569266949820196, 0.6268109946515383, 0.5562175242230296, 0.9913544630663427, 0.381043470962352, 0.46828002271928193, 0.6281953350728643, 0.13211887422949076, 0.9754487359896302, 0.6409000540152192, 0.48619928304105997, 0.8271675733849406, 0.04548321943730116, 0.7747557805851102, 0.11797987390309572 ], "xaxis": "x", "y": [ 0.8974746465682983, 0.8016198761761189, 0.4803151162341237, 0.493777142942296, 0.4724117375028868, 0.4632148607238846, 0.35006125544785865, 0.3694181264368825, 0.5187820364258211, 0.3343921098462523, 0.2857295958491197, 0.3203734112903476, 0.25756763107611497, 0.28598577562913935, 0.28658330536845605, 0.2237408245009049, 0.6748145576566458, 0.10552586521953344, 0.18381960783153772, 0.5968908593058586, 0.39865962136536837, 0.8195431940257549, 0.5164598226547241, 0.2029675031080842 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 1.51831 (SEM: 0)
x1: 0.0685762
x2: 0.718234
x3: 0.335965
x4: 0.897475
x5: 0.601168
x6: 0.710612", "Arm 10_0
l2norm: 1.61819 (SEM: 0)
x1: 0.666982
x2: 0.664268
x3: 0.693438
x4: 0.80162
x5: 0.765403
x6: 0.152042", "Arm 11_0
l2norm: 0.94644 (SEM: 0)
x1: 0.282084
x2: 0.0673875
x3: 0.413584
x4: 0.480315
x5: 0.0656645
x6: 0.636843", "Arm 12_0
l2norm: 0.932 (SEM: 0)
x1: 0.206254
x2: 6.60798e-14
x3: 0.298768
x4: 0.493777
x5: 6.34186e-14
x6: 0.702143", "Arm 13_0
l2norm: 0.984218 (SEM: 0)
x1: 0.200045
x2: 0.0480718
x3: 0.441246
x4: 0.472412
x5: 0.0317254
x6: 0.712375", "Arm 14_0
l2norm: 0.946071 (SEM: 0)
x1: 0.328193
x2: 0.0693257
x3: 0.450113
x4: 0.463215
x5: 0.0705689
x6: 0.60032", "Arm 15_0
l2norm: 1.06328 (SEM: 0)
x1: 0.417384
x2: 0
x3: 0.699884
x4: 0.350061
x5: 0.0855929
x6: 0.580207", "Arm 16_0
l2norm: 0.820718 (SEM: 0)
x1: 0.15606
x2: 0
x3: 0.587224
x4: 0.369418
x5: 0.0811765
x6: 0.401662", "Arm 17_0
l2norm: 1.19238 (SEM: 0)
x1: 0.498267
x2: 0.0518496
x3: 0.671262
x4: 0.518782
x5: 0.0656804
x6: 0.668412", "Arm 18_0
l2norm: 1.01168 (SEM: 0)
x1: 0.323201
x2: 0.20733
x3: 0.556927
x4: 0.334392
x5: 0.080051
x6: 0.669071", "Arm 19_0
l2norm: 1.17097 (SEM: 0)
x1: 0.299306
x2: 0.252011
x3: 0.626811
x4: 0.28573
x5: 0.109757
x6: 0.855278", "Arm 1_0
l2norm: 1.19849 (SEM: 0)
x1: 0.949338
x2: 0.0491182
x3: 0.556218
x4: 0.320373
x5: 0.292361
x6: 0.187725", "Arm 20_0
l2norm: 1.17366 (SEM: 0)
x1: 0.291316
x2: 0.280218
x3: 0.991354
x4: 0.257568
x5: 0.128539
x6: 0.385291", "Arm 21_0
l2norm: 1.07553 (SEM: 0)
x1: 0.396724
x2: 0.37477
x3: 0.381043
x4: 0.285986
x5: 0.106864
x6: 0.787727", "Arm 22_0
l2norm: 1.05976 (SEM: 0)
x1: 0.216635
x2: 0.150787
x3: 0.46828
x4: 0.286583
x5: 0.114892
x6: 0.859544", "Arm 23_0
l2norm: 1.22408 (SEM: 0)
x1: 0.51546
x2: 0.196726
x3: 0.628195
x4: 0.223741
x5: 0.0811501
x6: 0.861798", "Arm 2_0
l2norm: 1.37169 (SEM: 0)
x1: 0.581462
x2: 0.980194
x3: 0.132119
x4: 0.674815
x5: 0.0487189
x6: 0.327802", "Arm 3_0
l2norm: 1.64374 (SEM: 0)
x1: 0.462208
x2: 0.256397
x3: 0.975449
x4: 0.105526
x5: 0.872175
x6: 0.836164", "Arm 4_0
l2norm: 1.47206 (SEM: 0)
x1: 0.336828
x2: 0.758475
x3: 0.6409
x4: 0.18382
x5: 0.883545
x6: 0.503031", "Arm 5_0
l2norm: 1.16315 (SEM: 0)
x1: 0.705866
x2: 0.474217
x3: 0.486199
x4: 0.596891
x5: 0.19162
x6: 0.0200606", "Arm 6_0
l2norm: 1.48913 (SEM: 0)
x1: 0.82591
x2: 0.55901
x3: 0.827168
x4: 0.39866
x5: 0.467513
x6: 0.40147", "Arm 7_0
l2norm: 1.39784 (SEM: 0)
x1: 0.194934
x2: 0.204444
x3: 0.0454832
x4: 0.819543
x5: 0.642837
x6: 0.88725", "Arm 8_0
l2norm: 1.54915 (SEM: 0)
x1: 0.187192
x2: 0.903279
x3: 0.774756
x4: 0.51646
x5: 0.33764
x6: 0.753606", "Arm 9_0
l2norm: 1.08309 (SEM: 0)
x1: 0.802279
x2: 0.361091
x3: 0.11798
x4: 0.202968
x5: 0.520776
x6: 0.269658" ], "type": "scatter", "x": [ 0.33596500754356384, 0.6934377392753959, 0.41358438041061163, 0.29876807653200854, 0.44124616307402886, 0.45011318349525953, 0.6998844131158911, 0.5872237248413074, 0.6712621569678692, 0.5569266949820196, 0.6268109946515383, 0.5562175242230296, 0.9913544630663427, 0.381043470962352, 0.46828002271928193, 0.6281953350728643, 0.13211887422949076, 0.9754487359896302, 0.6409000540152192, 0.48619928304105997, 0.8271675733849406, 0.04548321943730116, 0.7747557805851102, 0.11797987390309572 ], "xaxis": "x2", "y": [ 0.8974746465682983, 0.8016198761761189, 0.4803151162341237, 0.493777142942296, 0.4724117375028868, 0.4632148607238846, 0.35006125544785865, 0.3694181264368825, 0.5187820364258211, 0.3343921098462523, 0.2857295958491197, 0.3203734112903476, 0.25756763107611497, 0.28598577562913935, 0.28658330536845605, 0.2237408245009049, 0.6748145576566458, 0.10552586521953344, 0.18381960783153772, 0.5968908593058586, 0.39865962136536837, 0.8195431940257549, 0.5164598226547241, 0.2029675031080842 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "1473abd3", "metadata": { "papermill": { "duration": 0.083544, "end_time": "2024-11-13T05:10:22.846199", "exception": false, "start_time": "2024-11-13T05:10:22.762655", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "ff4f3447", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:23.016864Z", "iopub.status.busy": "2024-11-13T05:10:23.016571Z", "iopub.status.idle": "2024-11-13T05:10:23.080314Z", "shell.execute_reply": "2024-11-13T05:10:23.079605Z" }, "papermill": { "duration": 0.149249, "end_time": "2024-11-13T05:10:23.082085", "exception": false, "start_time": "2024-11-13T05:10:22.932836", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.8496722742239082, -0.8496722742239082, -0.8496722742239082, -0.8940648192989578, -0.9139139812673616, -0.9139139812673616, -0.9139139812673616, -1.3407925201568112, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.06857624650001526
x2: 0.7182344794273376
x3: 0.33596500754356384
x4: 0.8974746465682983
x5: 0.6011677384376526
x6: 0.7106116414070129", "
Parameterization:
x1: 0.949337593279779
x2: 0.049118153750896454
x3: 0.5562175242230296
x4: 0.3203734112903476
x5: 0.2923608757555485
x6: 0.1877248315140605", "
Parameterization:
x1: 0.5814624270424247
x2: 0.9801941029727459
x3: 0.13211887422949076
x4: 0.6748145576566458
x5: 0.04871890600770712
x6: 0.32780154794454575", "
Parameterization:
x1: 0.4622082654386759
x2: 0.25639671459794044
x3: 0.9754487359896302
x4: 0.10552586521953344
x5: 0.8721751552075148
x6: 0.8361638728529215", "
Parameterization:
x1: 0.33682789001613855
x2: 0.758475380949676
x3: 0.6409000540152192
x4: 0.18381960783153772
x5: 0.8835451053455472
x6: 0.5030313637107611", "
Parameterization:
x1: 0.7058661617338657
x2: 0.4742168439552188
x3: 0.48619928304105997
x4: 0.5968908593058586
x5: 0.19162049517035484
x6: 0.020060617476701736", "
Parameterization:
x1: 0.8259098790585995
x2: 0.5590100130066276
x3: 0.8271675733849406
x4: 0.39865962136536837
x5: 0.4675133517012
x6: 0.4014701982960105", "
Parameterization:
x1: 0.194933601655066
x2: 0.20444396790117025
x3: 0.04548321943730116
x4: 0.8195431940257549
x5: 0.6428373511880636
x6: 0.8872504653409123", "
Parameterization:
x1: 0.18719230126589537
x2: 0.9032792774960399
x3: 0.7747557805851102
x4: 0.5164598226547241
x5: 0.33764041401445866
x6: 0.7536060810089111", "
Parameterization:
x1: 0.8022791724652052
x2: 0.36109117697924376
x3: 0.11797987390309572
x4: 0.2029675031080842
x5: 0.5207759914919734
x6: 0.26965788193047047", "
Parameterization:
x1: 0.6669823881238699
x2: 0.6642681052908301
x3: 0.6934377392753959
x4: 0.8016198761761189
x5: 0.7654026299715042
x6: 0.15204226318746805", "
Parameterization:
x1: 0.28208379726856947
x2: 0.0673874830827117
x3: 0.41358438041061163
x4: 0.4803151162341237
x5: 0.06566453818231821
x6: 0.6368430508300662", "
Parameterization:
x1: 0.20625381555651892
x2: 6.607979944652964e-14
x3: 0.29876807653200854
x4: 0.493777142942296
x5: 6.341855511362468e-14
x6: 0.7021431662723225", "
Parameterization:
x1: 0.20004477506117838
x2: 0.04807176398020553
x3: 0.44124616307402886
x4: 0.4724117375028868
x5: 0.03172537793164969
x6: 0.7123747406156065", "
Parameterization:
x1: 0.3281929068836651
x2: 0.06932566948914273
x3: 0.45011318349525953
x4: 0.4632148607238846
x5: 0.07056885129041748
x6: 0.6003204640113363", "
Parameterization:
x1: 0.4173836341566283
x2: 0.0
x3: 0.6998844131158911
x4: 0.35006125544785865
x5: 0.0855928510100444
x6: 0.5802068834598822", "
Parameterization:
x1: 0.1560597207062898
x2: 0.0
x3: 0.5872237248413074
x4: 0.3694181264368825
x5: 0.08117648049638168
x6: 0.40166229877309295", "
Parameterization:
x1: 0.4982673714693427
x2: 0.051849595013033954
x3: 0.6712621569678692
x4: 0.5187820364258211
x5: 0.0656804066035784
x6: 0.6684115713836075", "
Parameterization:
x1: 0.32320135841893866
x2: 0.207330343307123
x3: 0.5569266949820196
x4: 0.3343921098462523
x5: 0.08005096221650344
x6: 0.6690713892460095", "
Parameterization:
x1: 0.2993061269648042
x2: 0.25201071586372265
x3: 0.6268109946515383
x4: 0.2857295958491197
x5: 0.10975727956764317
x6: 0.8552776686032254", "
Parameterization:
x1: 0.291316309162491
x2: 0.2802177518467135
x3: 0.9913544630663427
x4: 0.25756763107611497
x5: 0.12853945638951403
x6: 0.38529094715256657", "
Parameterization:
x1: 0.39672369558917003
x2: 0.3747696646103233
x3: 0.381043470962352
x4: 0.28598577562913935
x5: 0.10686415536430557
x6: 0.7877269861903665", "
Parameterization:
x1: 0.21663496343809097
x2: 0.15078703563310938
x3: 0.46828002271928193
x4: 0.28658330536845605
x5: 0.11489171153770336
x6: 0.8595439525403041", "
Parameterization:
x1: 0.5154601731492084
x2: 0.19672595672578147
x3: 0.6281953350728643
x4: 0.2237408245009049
x5: 0.08115011039710597
x6: 0.8617982711944913", "
Parameterization:
x1: 0.28315066943106526
x2: 0.254488510296101
x3: 0.5337379359485369
x4: 0.2081219853848367
x5: 0.12288753567650806
x6: 0.9874737752642867" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.8496722742239082, -0.8496722742239082, -0.8496722742239082, -0.8940648192989578, -0.9139139812673616, -0.9139139812673616, -0.9139139812673616, -1.3407925201568112, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ null, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.09354114949866305, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.1886042282362251, -0.8496722742239082, -0.8496722742239082, -0.8496722742239082, -0.8940648192989578, -0.9139139812673616, -0.9139139812673616, -0.9139139812673616, -1.3407925201568112, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762, -1.446304400043762 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Best objective found vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "1080e1cf", "metadata": { "papermill": { "duration": 0.087473, "end_time": "2024-11-13T05:10:23.255366", "exception": false, "start_time": "2024-11-13T05:10:23.167893", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "887099d7", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:23.428957Z", "iopub.status.busy": "2024-11-13T05:10:23.428668Z", "iopub.status.idle": "2024-11-13T05:10:23.459792Z", "shell.execute_reply": "2024-11-13T05:10:23.459132Z" }, "papermill": { "duration": 0.1194, "end_time": "2024-11-13T05:10:23.461186", "exception": false, "start_time": "2024-11-13T05:10:23.341786", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:23] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "2d80ec2b", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:23.634505Z", "iopub.status.busy": "2024-11-13T05:10:23.634214Z", "iopub.status.idle": "2024-11-13T05:10:23.758279Z", "shell.execute_reply": "2024-11-13T05:10:23.757556Z" }, "papermill": { "duration": 0.213279, "end_time": "2024-11-13T05:10:23.759888", "exception": false, "start_time": "2024-11-13T05:10:23.546609", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:23] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "16ee4acb", "metadata": { "papermill": { "duration": 0.08598, "end_time": "2024-11-13T05:10:23.931917", "exception": false, "start_time": "2024-11-13T05:10:23.845937", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "a7278dd0", "metadata": { "papermill": { "duration": 0.086253, "end_time": "2024-11-13T05:10:24.104651", "exception": false, "start_time": "2024-11-13T05:10:24.018398", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "1af0def7", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:24.279264Z", "iopub.status.busy": "2024-11-13T05:10:24.278974Z", "iopub.status.idle": "2024-11-13T05:10:24.289132Z", "shell.execute_reply": "2024-11-13T05:10:24.288496Z" }, "papermill": { "duration": 0.099078, "end_time": "2024-11-13T05:10:24.290562", "exception": false, "start_time": "2024-11-13T05:10:24.191484", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:24] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "bcf63869", "metadata": { "papermill": { "duration": 0.086234, "end_time": "2024-11-13T05:10:24.463099", "exception": false, "start_time": "2024-11-13T05:10:24.376865", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "e87fbb8d", "metadata": { "papermill": { "duration": 0.087738, "end_time": "2024-11-13T05:10:24.637416", "exception": false, "start_time": "2024-11-13T05:10:24.549678", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "e398fb83", "metadata": { "papermill": { "duration": 0.08804, "end_time": "2024-11-13T05:10:24.813624", "exception": false, "start_time": "2024-11-13T05:10:24.725584", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "e9c222f0", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:24.995493Z", "iopub.status.busy": "2024-11-13T05:10:24.994941Z", "iopub.status.idle": "2024-11-13T05:10:40.921399Z", "shell.execute_reply": "2024-11-13T05:10:40.920781Z" }, "papermill": { "duration": 16.016079, "end_time": "2024-11-13T05:10:40.923032", "exception": false, "start_time": "2024-11-13T05:10:24.906953", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:40] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.101709, 'x2': 0.253765, 'x3': 0.616791, 'x4': 0.354122, 'x5': 0.125383, 'x6': 0.870072} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:40] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "9546707d", "metadata": { "papermill": { "duration": 0.09384, "end_time": "2024-11-13T05:10:41.101697", "exception": false, "start_time": "2024-11-13T05:10:41.007857", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "08367455", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:41.275735Z", "iopub.status.busy": "2024-11-13T05:10:41.275002Z", "iopub.status.idle": "2024-11-13T05:10:41.281387Z", "shell.execute_reply": "2024-11-13T05:10:41.280865Z" }, "papermill": { "duration": 0.094698, "end_time": "2024-11-13T05:10:41.282725", "exception": false, "start_time": "2024-11-13T05:10:41.188027", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:41] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "e1af4898", "metadata": { "papermill": { "duration": 0.087318, "end_time": "2024-11-13T05:10:41.456192", "exception": false, "start_time": "2024-11-13T05:10:41.368874", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "code", "execution_count": null, "id": "d573429f", "metadata": { "papermill": { "duration": 0.087012, "end_time": "2024-11-13T05:10:41.629858", "exception": false, "start_time": "2024-11-13T05:10:41.542846", "status": "completed" }, "tags": [] }, "outputs": [], "source": [] }, { "cell_type": "markdown", "id": "b54102a2", "metadata": { "papermill": { "duration": 0.086203, "end_time": "2024-11-13T05:10:41.804519", "exception": false, "start_time": "2024-11-13T05:10:41.718316", "status": "completed" }, "tags": [] }, "source": [ "**Nonlinear parameter constraints and/or constraints on non-Range parameters:** Ax parameter constraints can currently only support linear inequalities ([discussion](https://github.com/facebook/Ax/issues/153)). Users may be able to simulate this functionality, however, by substituting the following `evaluate` function for that defined in section 3 above." ] }, { "cell_type": "code", "execution_count": 19, "id": "de8e895c", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:41.978766Z", "iopub.status.busy": "2024-11-13T05:10:41.978491Z", "iopub.status.idle": "2024-11-13T05:10:41.983167Z", "shell.execute_reply": "2024-11-13T05:10:41.982573Z" }, "papermill": { "duration": 0.093206, "end_time": "2024-11-13T05:10:41.984536", "exception": false, "start_time": "2024-11-13T05:10:41.891330", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # First calculate the nonlinear quantity to be constrained.\n", " l2norm = np.sqrt((x**2).sum())\n", " # Then define a constraint consistent with an outcome constraint on this experiment.\n", " if l2norm > 1.25:\n", " return {\"l2norm\": (l2norm, 0.0)}\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (l2norm, 0.0)}" ] }, { "cell_type": "markdown", "id": "cb0c2bbd", "metadata": { "papermill": { "duration": 0.08655, "end_time": "2024-11-13T05:10:42.157451", "exception": false, "start_time": "2024-11-13T05:10:42.070901", "status": "completed" }, "tags": [] }, "source": [ "For this to work, the constraint quantity (`l2norm` in this case) should have a corresponding outcome constraint on the experiment. See the outcome_constraint arg to ax_client.create_experiment in section 2 above for how to specify outcome constraints.\n", "\n", "This setup accomplishes the following:\n", "1. Allows computation of an arbitrarily complex constraint value.\n", "2. Skips objective computation when the constraint is violated, useful when the objective is relatively expensive to compute.\n", "3. Constraint metric values are returned even when there is a violation. This helps the model understand + avoid constraint violations." ] }, { "cell_type": "markdown", "id": "79727d16", "metadata": { "papermill": { "duration": 0.08587, "end_time": "2024-11-13T05:10:42.329495", "exception": false, "start_time": "2024-11-13T05:10:42.243625", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "a15b8453", "metadata": { "papermill": { "duration": 0.086148, "end_time": "2024-11-13T05:10:42.501989", "exception": false, "start_time": "2024-11-13T05:10:42.415841", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 20, "id": "0763dbab", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:42.678828Z", "iopub.status.busy": "2024-11-13T05:10:42.678549Z", "iopub.status.idle": "2024-11-13T05:10:42.691528Z", "shell.execute_reply": "2024-11-13T05:10:42.690890Z" }, "papermill": { "duration": 0.102962, "end_time": "2024-11-13T05:10:42.692863", "exception": false, "start_time": "2024-11-13T05:10:42.589901", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-13 05:10:42] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 21, "id": "d3c77496", "metadata": { "execution": { "iopub.execute_input": "2024-11-13T05:10:42.866920Z", "iopub.status.busy": "2024-11-13T05:10:42.866256Z", "iopub.status.idle": "2024-11-13T05:10:42.871325Z", "shell.execute_reply": "2024-11-13T05:10:42.870649Z" }, "papermill": { "duration": 0.094627, "end_time": "2024-11-13T05:10:42.872655", "exception": false, "start_time": "2024-11-13T05:10:42.778028", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 21, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.15" }, "papermill": { "default_parameters": {}, "duration": 141.380828, "end_time": "2024-11-13T05:10:45.859213", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.jh7tLjWjTJ/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.jh7tLjWjTJ/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2024-11-13T05:08:24.478385", "version": "2.6.0" } }, "nbformat": 4, "nbformat_minor": 5 }