{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ipy_plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "In WithDBSettings, db settings: None\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.43, 'x2': 0.97, 'x3': 0.14, 'x4': 0.76, 'x5': 0.13, 'x6': 0.41}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.31, 0.0), 'l2norm': (1.38, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.51, 'x2': 0.33, 'x3': 0.63, 'x4': 0.66, 'x5': 0.66, 'x6': 0.17}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.17, 0.0), 'l2norm': (1.29, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.81, 'x2': 0.7, 'x3': 0.21, 'x4': 0.17, 'x5': 0.62, 'x6': 0.04}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.27, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.14, 'x2': 0.33, 'x3': 0.89, 'x4': 0.31, 'x5': 0.55, 'x6': 0.22}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.18, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.64, 'x2': 0.27, 'x3': 0.01, 'x4': 0.65, 'x5': 0.92, 'x6': 0.58}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.0, 0.0), 'l2norm': (1.45, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.64, 'x2': 0.78, 'x3': 0.03, 'x4': 0.06, 'x5': 0.28, 'x6': 0.86}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:26] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.16, 0.0), 'l2norm': (1.36, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:33] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.24, 'x2': 0.21, 'x3': 0.84, 'x4': 0.43, 'x5': 0.53, 'x6': 0.13}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:33] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.12, 0.0), 'l2norm': (1.13, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:39] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.15, 'x2': 0.51, 'x3': 0.89, 'x4': 0.37, 'x5': 0.54, 'x6': 0.32}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:39] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.27, 0.0), 'l2norm': (1.27, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:45] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.15, 'x2': 0.44, 'x3': 0.88, 'x4': 0.36, 'x5': 0.54, 'x6': 0.29}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:45] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.26, 0.0), 'l2norm': (1.23, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:51] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.19, 'x2': 0.44, 'x3': 0.81, 'x4': 0.46, 'x5': 0.46, 'x6': 0.31}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:51] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.41, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:56] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.2, 'x2': 0.47, 'x3': 0.77, 'x4': 0.51, 'x5': 0.4, 'x6': 0.35}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:25:56] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.53, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:01] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.2, 'x2': 0.51, 'x3': 0.71, 'x4': 0.57, 'x5': 0.32, 'x6': 0.4}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:01] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.55, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:06] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.21, 'x2': 0.4, 'x3': 0.78, 'x4': 0.54, 'x5': 0.34, 'x6': 0.45}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:06] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.74, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:10] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.23, 'x2': 0.32, 'x3': 0.81, 'x4': 0.55, 'x5': 0.32, 'x6': 0.51}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:10] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.89, 0.0), 'l2norm': (1.21, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:15] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.26, 'x2': 0.24, 'x3': 0.82, 'x4': 0.57, 'x5': 0.3, 'x6': 0.56}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:16] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.94, 0.0), 'l2norm': (1.24, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:21] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.2, 'x2': 0.23, 'x3': 0.83, 'x4': 0.49, 'x5': 0.27, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:21] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.36, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:26] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.15, 'x2': 0.17, 'x3': 0.84, 'x4': 0.43, 'x5': 0.22, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:26] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.58, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:31] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.19, 'x2': 0.2, 'x3': 0.87, 'x4': 0.38, 'x5': 0.15, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:31] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.3, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:37] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.1, 'x2': 0.11, 'x3': 0.82, 'x4': 0.45, 'x5': 0.26, 'x6': 0.69}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:37] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.62, 0.0), 'l2norm': (1.2, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:41] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.12, 'x2': 0.17, 'x3': 0.76, 'x4': 0.44, 'x5': 0.24, 'x6': 0.74}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:41] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-1.85, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:46] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.12, 'x2': 0.21, 'x3': 0.69, 'x4': 0.43, 'x5': 0.22, 'x6': 0.81}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:46] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.87, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:50] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.14, 'x2': 0.13, 'x3': 0.68, 'x4': 0.43, 'x5': 0.23, 'x6': 0.74}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:50] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.08, 0.0), 'l2norm': (1.13, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:54] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.16, 'x2': 0.05, 'x3': 0.63, 'x4': 0.4, 'x5': 0.24, 'x6': 0.7}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:54] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.32, 0.0), 'l2norm': (1.07, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:58] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.16, 'x2': 0.0, 'x3': 0.56, 'x4': 0.37, 'x5': 0.26, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:26:58] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.63, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:02] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.15, 'x2': 0.0, 'x3': 0.48, 'x4': 0.3, 'x5': 0.28, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:02] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.96, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:02] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.43, 'x2': 0.97, 'x3': 0.14, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.51, 'x2': 0.33, 'x3': 0.63, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.81, 'x2': 0.7, 'x3': 0.21, 'x...
30Sobol3COMPLETED{'3_0': {'x1': 0.14, 'x2': 0.33, 'x3': 0.89, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.64, 'x2': 0.27, 'x3': 0.01, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.64, 'x2': 0.78, 'x3': 0.03, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.24, 'x2': 0.21, 'x3': 0.84, '...
71GPEI7COMPLETED{'7_0': {'x1': 0.15, 'x2': 0.51, 'x3': 0.89, '...
81GPEI8COMPLETED{'8_0': {'x1': 0.15, 'x2': 0.44, 'x3': 0.88, '...
91GPEI9COMPLETED{'9_0': {'x1': 0.19, 'x2': 0.44, 'x3': 0.81, '...
101GPEI10COMPLETED{'10_0': {'x1': 0.2, 'x2': 0.47, 'x3': 0.77, '...
111GPEI11COMPLETED{'11_0': {'x1': 0.2, 'x2': 0.51, 'x3': 0.71, '...
121GPEI12COMPLETED{'12_0': {'x1': 0.21, 'x2': 0.4, 'x3': 0.78, '...
131GPEI13COMPLETED{'13_0': {'x1': 0.23, 'x2': 0.32, 'x3': 0.81, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.26, 'x2': 0.24, 'x3': 0.82, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.2, 'x2': 0.23, 'x3': 0.83, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.15, 'x2': 0.17, 'x3': 0.84, ...
171GPEI17COMPLETED{'17_0': {'x1': 0.19, 'x2': 0.2, 'x3': 0.87, '...
181GPEI18COMPLETED{'18_0': {'x1': 0.1, 'x2': 0.11, 'x3': 0.82, '...
191GPEI19COMPLETED{'19_0': {'x1': 0.12, 'x2': 0.17, 'x3': 0.76, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.12, 'x2': 0.21, 'x3': 0.69, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.14, 'x2': 0.13, 'x3': 0.68, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.16, 'x2': 0.05, 'x3': 0.63, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.16, 'x2': 0.0, 'x3': 0.56, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.15, 'x2': 0.0, 'x3': 0.48, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.43, 'x2': 0.97, 'x3': 0.14, '... \n", "1 {'1_0': {'x1': 0.51, 'x2': 0.33, 'x3': 0.63, '... \n", "2 {'2_0': {'x1': 0.81, 'x2': 0.7, 'x3': 0.21, 'x... \n", "3 {'3_0': {'x1': 0.14, 'x2': 0.33, 'x3': 0.89, '... \n", "4 {'4_0': {'x1': 0.64, 'x2': 0.27, 'x3': 0.01, '... \n", "5 {'5_0': {'x1': 0.64, 'x2': 0.78, 'x3': 0.03, '... \n", "6 {'6_0': {'x1': 0.24, 'x2': 0.21, 'x3': 0.84, '... \n", "7 {'7_0': {'x1': 0.15, 'x2': 0.51, 'x3': 0.89, '... \n", "8 {'8_0': {'x1': 0.15, 'x2': 0.44, 'x3': 0.88, '... \n", "9 {'9_0': {'x1': 0.19, 'x2': 0.44, 'x3': 0.81, '... \n", "10 {'10_0': {'x1': 0.2, 'x2': 0.47, 'x3': 0.77, '... \n", "11 {'11_0': {'x1': 0.2, 'x2': 0.51, 'x3': 0.71, '... \n", "12 {'12_0': {'x1': 0.21, 'x2': 0.4, 'x3': 0.78, '... \n", "13 {'13_0': {'x1': 0.23, 'x2': 0.32, 'x3': 0.81, ... \n", "14 {'14_0': {'x1': 0.26, 'x2': 0.24, 'x3': 0.82, ... \n", "15 {'15_0': {'x1': 0.2, 'x2': 0.23, 'x3': 0.83, '... \n", "16 {'16_0': {'x1': 0.15, 'x2': 0.17, 'x3': 0.84, ... \n", "17 {'17_0': {'x1': 0.19, 'x2': 0.2, 'x3': 0.87, '... \n", "18 {'18_0': {'x1': 0.1, 'x2': 0.11, 'x3': 0.82, '... \n", "19 {'19_0': {'x1': 0.12, 'x2': 0.17, 'x3': 0.76, ... \n", "20 {'20_0': {'x1': 0.12, 'x2': 0.21, 'x3': 0.69, ... \n", "21 {'21_0': {'x1': 0.14, 'x2': 0.13, 'x3': 0.68, ... \n", "22 {'22_0': {'x1': 0.16, 'x2': 0.05, 'x3': 0.63, ... \n", "23 {'23_0': {'x1': 0.16, 'x2': 0.0, 'x3': 0.56, '... \n", "24 {'24_0': {'x1': 0.15, 'x2': 0.0, 'x3': 0.48, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.1603766378738894,\n", " 'x2': 3.7236782755712533e-16,\n", " 'x3': 0.56437601211232,\n", " 'x4': 0.3659604610715271,\n", " 'x5': 0.2568844307143093,\n", " 'x6': 0.6700580089528931}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.6299090243711065, 'l2norm': 0.9965619034219961}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:02] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.7040295181754979, -1.7418543049958606, -1.7750235857564878, -1.8028788889738652, -1.8248084269603881, -1.840274532815826, -1.8488412161801455, -1.8501994525042758, -1.8441876437294782, -1.830804894776492, -1.8102153489131037, -1.7827427490594763, -1.748855513627862, -1.7091437522374013, -1.664290579739201, -1.6150406175694187, -1.5621685983759264, -1.5064505546673974, -1.448639336678808, -1.3894453774634958, -1.329522882759417, -1.2694610733250655, -1.2097797747067685, -1.1509285062982226, -1.0932882162035429, -1.03717488718986, -0.9828443585041787, -0.9304978386957393, -0.8802877081183376, -0.8323233177089893, -0.7866765799324473, -0.7433872187201901, -0.702467599717487, -0.6639071026998629, -0.6276760272041304, -0.5937290426018935, -0.5620082070661312, -0.5324455878448557, -0.5049655193406208, -0.4794865367985604, -0.4559230227868313, -0.4341866017700475, -0.41418731542327014, -0.39583460827720784, -0.3790381500842853, -0.36370851813295846, -0.3497577597322824, -0.3370998523149321, -0.32565107610363164, -0.31533031206908946 ], [ -1.701332806046627, -1.7390280606276591, -1.7720358631519693, -1.7996924064637674, -1.821381499943885, -1.8365625848347507, -1.844798829589977, -1.8457828357048531, -1.8393573201552962, -1.8255283757796459, -1.804469542609843, -1.7765158747505194, -1.7421483310379615, -1.7019699768405292, -1.6566764409411465, -1.6070236175351138, -1.5537956258511394, -1.4977755764493048, -1.4397209140471539, -1.3803442356767905, -1.3202997113509618, -1.2601746712979063, -1.2004855934631358, -1.1416775938257324, -1.0841265320717643, -1.0281429383706044, -0.9739770978849546, -0.9218247678988352, -0.8718331307783337, -0.8241066963586684, -0.778712957510054, -0.7356876734569715, -0.6950397092513982, -0.656755399437934, -0.620802432152152, -0.587133269127148, -0.5556881294424922, -0.5263975720572792, -0.49918471561122274, -0.47396713474706476, -0.4506584711532991, -0.4291697952940725, -0.40941075186688014, -0.391290518760945, -0.3747186059307819, -0.35960551732197044, -0.34586329590065523, -0.33340596901171615, -0.3221499087564368, -0.3120141198488413 ], [ -1.6968788320369477, -1.7343641191217734, -1.767135098847921, -1.794524215696069, -1.8159125025270952, -1.8307581112515947, -1.8386248718581775, -1.8392083287961563, -1.8323565544107931, -1.818083306402002, -1.7965717643111203, -1.768168060468638, -1.7333649835947518, -1.6927774075883564, -1.6471119694193088, -1.5971340749909881, -1.5436353272072791, -1.4874039797871381, -1.4292002007353726, -1.3697370185041304, -1.3096670250707505, -1.2495743371254868, -1.1899709909340996, -1.1312968284776568, -1.073921958057247, -1.0181509797345254, -0.9642283074524172, -0.9123440649214671, -0.8626401646648166, -0.8152162917850505, -0.7701356045471835, -0.727430034236955, -0.6871051197033342, -0.6491443505950398, -0.6135130204604052, -0.5801616091432737, -0.5490287254076556, -0.5200436471950571, -0.49312849974455353, -0.46820011207038964, -0.4451715908315571, -0.4239536480747176, -0.4044557161573604, -0.3865868797018662, -0.37025665093438553, -0.3553756113859947, -0.34185593978165785, -0.329611843074589, -0.31855990502747966, -0.3086193645038511 ], [ -1.6906441226372317, -1.727836758683877, -1.7602935282324936, -1.7873448307037345, -1.808370670130361, -1.8228296293129147, -1.8302878062521324, -1.830445084172453, -1.823155974681269, -1.8084425764238785, -1.7864978998478347, -1.7576788197776883, -1.72248909619992, -1.6815540844234653, -1.635589730829991, -1.585369005754523, -1.5316889304674541, -1.4753408396867318, -1.417085666164975, -1.357635088879134, -1.2976385652257045, -1.2376756881986366, -1.1782529906879144, -1.1198042150025087, -1.0626931066497487, -1.0072179117343074, -0.9536169083448351, -0.9020744534959201, -0.852727162609421, -0.8056699518193382, -0.7609617638221374, -0.7186308675994969, -0.6786796742331087, -0.6410890485014451, -0.6058221220267652, -0.5728276310321694, -0.5420428124287564, -0.5133958977176778, -0.4868082464364201, -0.4621961606735767, -0.43947242034259437, -0.4185475760613271, -0.39933103308734297, -0.3817319561375502, -0.3656600213042862, -0.3510260378211463, -0.3377424592268291, -0.32572380057649486, -0.31488697578157065, -0.3051515669207756 ], [ -1.682612171499707, -1.7194276050223491, -1.7514910930446037, -1.778132804648414, -1.7987335808062783, -1.8127542713631632, -1.8197649518560859, -1.8194713184707458, -1.8117354478891876, -1.7965884509614511, -1.774233302106965, -1.7450371704501153, -1.709513769629495, -1.6682974195319038, -1.6221114779319412, -1.571734345288833, -1.5179662387181811, -1.461599395007759, -1.4033934799888181, -1.3440570099208533, -1.2842347528032267, -1.2245004952007175, -1.1653542496703575, -1.1072228878691848, -1.0504632398835023, -0.9953668325712426, -0.942165598959869, -0.8910380467719832, -0.8421155117908719, -0.7954882355747129, -0.751211096951421, -0.7093088953158936, -0.6697811344487314, -0.632606291854662, -0.5977455836053667, -0.5651462510093017, -0.5347444052843893, -0.5064674715075939, -0.48023627481934894, -0.4559668112245658, -0.4335717431608493, -0.41296165690105835, -0.3940461152657314, -0.37673453535692836, -0.36093691730828736, -0.3465644465206926, -0.3335299886075038, -0.32174849335469136, -0.31113732142795036, -0.30161650532815487 ], [ -1.6727741740370394, -1.7091264605915089, -1.740716365078817, -1.7668757433735087, -1.7869882487886273, -1.8005189429085906, -1.807043685286997, -1.8062755327036295, -1.7980852903820885, -1.7825137434687814, -1.7597739000903592, -1.7302426573594158, -1.694442500493343, -1.6530150037341227, -1.6066888388901819, -1.556245519962474, -1.5024860899988015, -1.4462014061390502, -1.3881477789769738, -1.3290287335793918, -1.2694828115806454, -1.2100767518037099, -1.1513030855379687, -1.09358110594447, -1.0372602396270538, -0.9826249909556425, -0.9299007957418441, -0.8792602805348234, -0.8308295628000045, -0.7846943409508876, -0.7409056122524875, -0.6994849239887283, -0.6604291126946937, -0.6237145213183466, -0.5893007080856406, -0.5571336762633983, -0.5271486631067469, -0.4992725307573896, -0.4734258030685515, -0.44952439130760935, -0.42748104921598146, -0.40720659457546227, -0.3886109306705027, -0.3716038971525748, -0.3560959760144131, -0.3419988748052497, -0.32922600594457374, -0.3176928780634115, -0.30731741273214574, -0.2980201977165453 ], [ -1.6611297748449105, -1.6969321594469822, -1.7279675107252674, -1.7535713769122099, -1.7731322939737442, -1.7861215738786917, -1.792122750172128, -1.7908578499133636, -1.782207599329825, -1.7662231051138861, -1.7431274126633465, -1.7133064623322045, -1.6772901664977902, -1.6357254550399571, -1.5893440253943798, -1.5389280183127148, -1.4852768009918795, -1.4291774842911273, -1.3713808972390016, -1.3125837477770983, -1.253416847692582, -1.194438700912331, -1.1361334621315806, -1.0789122078766524, -1.023116541701385, -0.9690237060635151, -0.9168525445603414, -0.8667698202920602, -0.8188965356457911, -0.7733140118971654, -0.730069574908933, -0.6891817592232014, -0.650644990918599, -0.6144337434611797, -0.5805061836497553, -0.5488073393126296, -0.5192718288006916, -0.4918261962380538, -0.4663908972569386, -0.44288197857497613, -0.42121249203971045, -0.40129368024042444, -0.3830359668870531, -0.36634978117526773, -0.3511462414952389, -0.3373377202281169, -0.3248383080842542, -0.3135641935079849, -0.30343397011423245, -0.2943688829237918 ], [ -1.647687793641713, -1.6828534072359629, -1.713253249432574, -1.7382286357319616, -1.7571751284622241, -1.7695723998089008, -1.7750136085188282, -1.7732314040740764, -1.7641176404204262, -1.7477343699787466, -1.724314611762529, -1.6942525518601905, -1.6580840342709169, -1.6164592727968237, -1.570110529766621, -1.5198179367098794, -1.466376573583665, -1.410567375594268, -1.3531335465434413, -1.2947631718445147, -1.23607787798307, -1.1776268118375273, -1.1198849291034616, -1.0632545254653245, -1.0080690320676284, -0.9545982536438965, -0.9030544021512368, -0.85359844206483, -0.8063464027849107, -0.7613754256785169, -0.718729399781343, -0.6784241047674385, -0.6404518265356407, -0.6047854434559912, -0.5713820032155705, -0.5401858239627217, -0.5111311611986116, -0.4841444852784195, -0.459146414759667, -0.43605334916897437, -0.4147788418025691, -0.3952347494889765, -0.37733219222827163, -0.3609823515658519, -0.34609713265102693, -0.3325897112945556, -0.3203749840435245, -0.309369936370519, -0.29949394153151887, -0.29066900047280253 ], [ -1.6324668888114857, -1.6669095570838923, -1.6965937478313273, -1.7208686641831834, -1.739139083788581, -1.750895189018694, -1.7557417446947594, -1.753423688566665, -1.743845201143623, -1.7270798695816905, -1.7033705554192284, -1.6731187916394505, -1.6368647281382707, -1.595259645265827, -1.54903376782888, -1.4989624643082173, -1.4458338363314043, -1.3904201781836747, -1.3334549300736582, -1.2756157878199055, -1.2175137981011341, -1.1596877020137764, -1.1026025113469606, -1.046651252191163, -0.9921589033763456, -0.9393877173695596, -0.8885432872715131, -0.8397808869123808, -0.7932117494499593, -0.7489090605692292, -0.7069135273706708, -0.6672384471641688, -0.6298742458372297, -0.5947924870694489, -0.5619493746669509, -0.5312887833333146, -0.502744860378765, -0.47624424384437797, -0.4517079425589371, -0.42905292172881215, -0.40819343452162116, -0.3890421362874288, -0.371511013959126, -0.35551215906220945, -0.3409584088271026, -0.3277638762507721, -0.31584438666343073, -0.3051178354497234, -0.2955044790547029, -0.28692716925879835 ], [ -1.6154961140714823, -1.6491312671817073, -1.6780213845479333, -1.701525694798517, -1.719060391223916, -1.730128318026706, -1.7343478163803625, -1.7314777540437234, -1.7214357989867757, -1.7043076097419498, -1.6803456909984664, -1.6499579384177858, -1.613687081935952, -1.5721831447538916, -1.5261716132939482, -1.4764202637228396, -1.4237074866829393, -1.3687944661267852, -1.3124027700916752, -1.2551979933990602, -1.1977792802858804, -1.1406739963823902, -1.0843365437204486, -1.0291502641256332, -0.975431470329444, -0.9234348047378398, -0.8733593014517429, -0.8253546894484804, -0.7795276117643659, -0.7359475445911823, -0.6946522836104398, -0.6556529266032041, -0.6189383256169247, -0.5844790125807161, -0.5522306224650188, -0.5221368504968347, -0.49413198664100966, -0.4681430731624722, -0.44409173084702314, -0.4218956973371263, -0.4014701177544622, -0.38272862386449014, -0.3655842338733577, -0.34995010080053335, -0.3357401334194995, -0.3228695101142218, -0.31125510272208057, -0.30081582454960354, -0.2914729142567868, -0.28315016519199787 ], [ -1.5968153240037868, -1.6295609857415831, -1.6575813200313754, -1.6802477055228249, -1.6969899247587081, -1.7073255930795352, -1.7108885405862577, -1.7074531371823038, -1.6969516236293374, -1.679482191099667, -1.6553067165989916, -1.6248384072774955, -1.588620784496342, -1.5473002344855775, -1.5015947613412814, -1.4522616976754898, -1.4000669953525415, -1.3457582910822141, -1.2900432281647087, -1.2335736613396786, -1.1769355903727765, -1.1206441175099682, -1.0651424467157866, -1.0108038907084282, -0.9579359426181473, -0.9067856271450733, -0.8575455195293643, -0.8103599808790805, -0.7653312933713267, -0.7225254861203396, -0.6819777243408647, -0.6436971948141649, -0.6076714638128153, -0.5738703133734471, -0.5422490813230549, -0.5127515423487533, -0.48531237369628866, -0.45985925138511646, -0.4363146223697756, -0.4145971957983612, -0.3946231931265458, -0.37630739285989634, -0.35956400149293033, -0.3443073780496517, -0.3304526356795292, -0.3179161401313261, -0.3066159216720181, -0.2964720141624697, -0.28740673254378035, -0.2793448979101022 ], [ -1.5764753884912759, -1.6082532141014392, -1.635331811610253, -1.657096788467175, -1.672993623162089, -1.68255672219943, -1.6854372084169147, -1.6814264057826245, -1.6704720940446742, -1.652685354136676, -1.6283370860752857, -1.597844708607214, -1.5617507249713718, -1.520695507076816, -1.4753868554014955, -1.426568849162471, -1.3749923325408089, -1.321389031702297, -1.2664506963652549, -1.210813890304987, -1.1550503139814599, -1.0996620000569417, -1.0450804392976487, -0.9916686334346947, -0.9397251547048884, -0.8894894442015844, -0.8411477505264131, -0.7948392674120488, -0.7506621615722644, -0.7086792874080978, -0.6689234655020604, -0.631402260990434, -0.5961022400908513, -0.5629927120488735, -0.5320289827127405, -0.5031551573986262, -0.4763065366848658, -0.4514116508433569, -0.42839397799378753, -0.4071733886754624, -0.3876673560676749, -0.3697919670636298, -0.3534627651817436, -0.3385954521351827, -0.3251064709435606, -0.3129134898620439, -0.3019358031777577, -0.2920946621018563, -0.2833135465647225, -0.2755183866825607 ], [ -1.5545381842686026, -1.5852745088640772, -1.6113442262127464, -1.6321491731078501, -1.6471525236866817, -1.6559073595692637, -1.6580837399805919, -1.6534912225551506, -1.642093926366225, -1.6240160417699379, -1.5995370523779415, -1.5690774555246165, -1.533176948574598, -1.4924675775441263, -1.4476443135391495, -1.3994352847746605, -1.3485736776664008, -1.2957730627130197, -1.2417074396815264, -1.1869966338076072, -1.1321969833314316, -1.077796724490694, -1.0242151862157525, -0.9718048313820394, -0.9208552524403721, -0.8715983729379869, -0.8242142699039648, -0.778837185264454, -0.7355614242699674, -0.6944469423028757, -0.6555245002746357, -0.6188003268888564, -0.5842602674166008, -0.5518734270069565, -0.5215953350504293, -0.4933706682371274, -0.46713557569225767, -0.4428196514777974, -0.4203475990172557, -0.3996406295422479, -0.380617633159551, -0.3631961570987162, -0.3472932214836487, -0.3328259988260346, -0.31971237952768294, -0.3078714421024744, -0.2972238436399105, -0.2876921432497137, -0.2792010688465064, -0.2716777356354194 ], [ -1.5310763431424803, -1.5607031981552715, -1.5857027206010366, -1.6054948676783338, -1.6195623641074772, -1.6274786709495688, -1.6289342194751941, -1.6237578589306474, -1.611930636187124, -1.5935898978667087, -1.5690231657830918, -1.5386528607317245, -1.5030141481539814, -1.4627285657714866, -1.4184758005521747, -1.3709655187453835, -1.320910880781621, -1.2690052209046947, -1.2159030741514723, -1.1622061973234707, -1.1084545988174408, -1.0551220670302957, -1.0026153787091276, -0.9512762737498743, -0.9013853374584603, -0.8531670632811239, -0.8067955247817737, -0.762400233919181, -0.7200718893387054, -0.679867819710333, -0.6418170045919683, -0.6059246124021569, -0.5721760357830703, -0.5405404325375758, -0.5109737984873155, -0.48342160949476887, -0.4578210754806264, -0.4341030510778834, -0.41219364677722437, -0.3920155819357404, -0.37348931751870373, -0.3565340024194671, -0.3410682630109465, -0.32701086146950575, -0.3142812445388873, -0.302800000866834, -0.29248924190079084, -0.2832729185901518, -0.2750770838057055, -0.26783010843152977 ], [ -1.5061727498682083, -1.5346288039589133, -1.5585035798036944, -1.5772369076677395, -1.590332739382636, -1.5973864025380853, -1.5981098874687762, -1.5923521291235092, -1.5801114380365657, -1.5615381575049985, -1.5369271779892757, -1.5067016722040592, -1.4713906430981125, -1.4316031252111734, -1.3880013098613324, -1.341274149795505, -1.2921126553413427, -1.2411880542349385, -1.1891338721194238, -1.1365325988613566, -1.0839070433827551, -1.0317159657126056, -0.9803532496667801, -0.9301497611642424, -0.8813770714549519, -0.8342523420348357, -0.7889438143446205, -0.745576489751518, -0.7042377083929933, -0.6649824345916391, -0.6278381326452642, -0.5928091730508314, -0.5598807493763311, -0.5290223135517598, -0.5001905552960901, -0.4733319621619922, -0.4483850021963939, -0.42528197299429804, -0.40395056013385167, -0.3843151455157382, -0.36629790265808704, -0.34981971201289275, -0.33480092522287863, -0.3211620031726897, -0.30882404886406944, -0.2977092526586146, -0.2877412643340278, -0.27884550370823435, -0.27094941929524186, -0.26398270254591083 ], [ -1.479919796876727, -1.5071511803118773, -1.5298542264776005, -1.5474902271429152, -1.55958583113322, -1.5657594727176294, -1.5657456090967914, -1.5594137600028102, -1.5467795521089773, -1.5280059321706219, -1.5033943484608279, -1.4733675388675103, -1.4384468340251844, -1.3992270061513121, -1.356350845346729, -1.3104846637643068, -1.2622954983236967, -1.2124308526939842, -1.1615018953217764, -1.1100707951262738, -1.0586423927180733, -1.0076599060732023, -0.9575040268994198, -0.9084946193583826, -0.8608942437874563, -0.8149128285561874, -0.7707129483438551, -0.7284153026426898, -0.6881041072864584, -0.6498322085620842, -0.6136258041954537, -0.579488710983563, -0.5474061585671357, -0.5173481161630349, -0.4892721769075792, -0.46312603518692474, -0.43884959785095323, -0.41637677201777845, -0.395636971435138, -0.37655638095717847, -0.3590590152857437, -0.3430676042036459, -0.32850433244410415, -0.3152914583367219, -0.30335183160583523, -0.2926093272673497, -0.28298920952636586, -0.27441843693756873, -0.26682591784833687, -0.26014272328010957 ], [ -1.4524184166624523, -1.4783793941242607, -1.4998719348927423, -1.5163801941777637, -1.5274547588815888, -1.5327381424639193, -1.5319878788680361, -1.5250942594532508, -1.5120899794138167, -1.4931499462455862, -1.4685812022812172, -1.438804847607316, -1.404333167154813, -1.3657451812139505, -1.323662725908922, -1.278727921053441, -1.2315823538080672, -1.1828484746909855, -1.133113967618, -1.0829197834527853, -1.0327521300604166, -0.9830382340126907, -0.9341453310550737, -0.8863821708664336, -0.8400023072599868, -0.7952085263219607, -0.7521578873112494, -0.7109669786981015, -0.6717171060279219, -0.6344592224053398, -0.599218485687147, -0.5659983812059735, -0.534784388211375, -0.5055471953981989, -0.4782454887018069, -0.4528283453055001, -0.4292372734004579, -0.40740793913973594, -0.38727162158269113, -0.3687564341146543, -0.3517883475098996, -0.33629204597161355, -0.3221916434807026, -0.30941128385684247, -0.29787564423968216, -0.2875103583323275, -0.27824237276414565, -0.27000024734422867, -0.26271440778545563, -0.25631735766233055 ], [ -1.4237769244275393, -1.4484303899069728, -1.468682301006317, -1.4840408733161974, -1.4940816281985694, -1.498471851681203, -1.4969924601384021, -1.4895543893199452, -1.4762068554164811, -1.4571358340315124, -1.432652843254718, -1.403176126125047, -1.3692076913569347, -1.3313096036899332, -1.2900815712593314, -1.2461403763554393, -1.2001010579428046, -1.152559998980571, -1.1040805110257645, -1.055181598165626, -1.0063302803696828, -0.9579374076332764, -0.9103565276548077, -0.8638851724166773, -0.8187678883799823, -0.7752003955696608, -0.733334368789424, -0.6932824526661181, -0.6551232311341654, -0.6189059630507441, -0.584654967321835, -0.5523735948709159, -0.5220477638218408, -0.4936490613729579, -0.46713743369800054, -0.4424634960867802, -0.4195705012709323, -0.3983960059251367, -0.3788732748304535, -0.3609324600068041, -0.3445015889265354, -0.329507392196863, -0.31587599719565196, -0.30353351030495346, -0.292406506770128, -0.2824224439171549, -0.27351001053934254, -0.26559942273661097, -0.2586226743520428, -0.2525137483820482 ], [ -1.3941097125653406, -1.4174274904779751, -1.436417533027868, -1.4506130935533057, -1.4596153697476744, -1.463116831695513, -1.460921785325094, -1.4529613828486299, -1.439300532017537, -1.420135151436408, -1.3957799739789065, -1.3666491543782036, -1.3332333363083217, -1.2960767095538441, -1.255756061132471, -1.2128621050196502, -1.1679826238601254, -1.121687247496437, -1.0745142798767067, -1.0269602279995211, -0.9794724842892175, -0.932445203769386, -0.8862180454640987, -0.8410772276072354, -0.7972582796845276, -0.7549499130980799, -0.7142985245017835, -0.6754129540765523, -0.6383692237283829, -0.6032150677577601, -0.5699741383813726, -0.5386498215535609, -0.5092286372345001, -0.48168322530853286, -0.45597493631463076, -0.43205605719443113, -0.4098717081868988, -0.38936144923567295, -0.3704606339530655, -0.3531015471715896, -0.3372143590674438, -0.3227279252479155, -0.3095704584067137, -0.2976700934121247, -0.2869553641642778, -0.27735560734003484, -0.26880130529086044, -0.2612243778917609, -0.25455843105558684, -0.2487389679085069 ], [ -1.3635358441563472, -1.3854987920168524, -1.4032146339747933, -1.41624240843043, -1.4242094727612835, -1.4268336158167951, -1.423942257713089, -1.4154860654554702, -1.4015445615370592, -1.3823222851410024, -1.3581358070317642, -1.3293939613731707, -1.2965750733174888, -1.2602048040473757, -1.2208365857227708, -1.1790347311457696, -1.1353594412148942, -1.0903532365972946, -1.0445290368330595, -0.9983604876514953, -0.9522750368834034, -0.9066498981668379, -0.8618106756712839, -0.8180321860114411, -0.7755409228093394, -0.7345186260492583, -0.6951064938853073, -0.6574096714556614, -0.6215017469183206, -0.5874290684003991, -0.5552147631886136, -0.5248623924960231, -0.49635921343000705, -0.46967904678726924, -0.4447847673830277, -0.4216304448705178, -0.4001631691630494, -0.3803245970406255, -0.3620522564187705, -0.34528064294103644, -0.3299421406845068, -0.31596779532694375, -0.3032879644675134, -0.29183286616669146, -0.281533043339649, -0.27231975850313017, -0.26412533059572507, -0.25688342318774826, -0.2505292913699467, -0.24499999294218555 ], [ -1.3321775946548986, -1.3527755134404098, -1.3692135487200379, -1.3810770351105723, -1.388019716050378, -1.3897845690365227, -1.3862215950876928, -1.377300038230035, -1.363112759201772, -1.3438714479585785, -1.3198930605263737, -1.291579895748415, -1.2593971333964742, -1.2238514867824237, -1.185472917225976, -1.1447993629787128, -1.1023634736905672, -1.0586806211256132, -1.0142382198248512, -0.9694868805418216, -0.9248339190941642, -0.8806394403994435, -0.8372148678659855, -0.7948235409283014, -0.7536828917144027, -0.7139677069986672, -0.6758140397483792, -0.6393234191969375, -0.6045670961308723, -0.5715901388322656, -0.5404152601441257, -0.5110463068331554, -0.48347138018297947, -0.457665583647331, -0.4335934115938418, -0.41121080464115534, -0.3904669035101629, -0.37130553604373573, -0.35366647219296654, -0.3374864801757692, -0.3227002143381844, -0.30924096197895345, -0.29704127288687476, -0.2860334918386199, -0.27615021097896486, -0.2673246559611224, -0.2594910170219076, -0.25258473382949775, -0.24654274097298823, -0.24130367934660768 ], [ -1.3001589895665513, -1.3193903573112324, -1.3345553434233564, -1.3452658523532386, -1.3512019899319718, -1.3521315451745541, -1.3479263396953276, -1.3385730653945649, -1.324176501068176, -1.3049539296281538, -1.281221213460263, -1.253372943659178, -1.2218604458009024, -1.1871712615625214, -1.1498120277560737, -1.1102946389806556, -1.069124537246731, -1.0267901960634305, -0.983753649802648, -0.9404424908209773, -0.8972438507646247, -0.8545006453797992, -0.8125100394155801, -0.7715238384462471, -0.7317503858024116, -0.6933575178998646, -0.6564761719571932, -0.6212043117514423, -0.5876109161240595, -0.5557398483302582, -0.5256134862766625, -0.49723604279994227, -0.47059654219376973, -0.4456714458960209, -0.4224269385345142, -0.40082089722230163, -0.3808045736869089, -0.36232402183676193, -0.34532130378259185, -0.3297355059857323, -0.3155035947462973, -0.30256113716142463, -0.2908429103325162, -0.28028341823322767, -0.27081733243808437, -0.2623798699633366, -0.25490711884991113, -0.2483363198512527, -0.24260611068013027, -0.23765673770513907 ], [ -1.267604381680381, -1.285475933143859, -1.2993804761179333, -1.30895652465451, -1.313910285445928, -1.3140337576285088, -1.3092196311625324, -1.2994707733096797, -1.2849023757172167, -1.2657357305510422, -1.242284154143591, -1.2149334279452972, -1.184120425895726, -1.1503134493896559, -1.113996158037264, -1.075654973211241, -1.0357687320353695, -0.9947995143093054, -0.9531843253882909, -0.9113279404235911, -0.8695973928055144, -0.8283184226118163, -0.7877739144451169, -0.7482041102643658, -0.7098082425290286, -0.6727471903340825, -0.6371467849777566, -0.6031014497339999, -0.5706779283346013, -0.5399189240551311, -0.510846529689569, -0.48346537586849203, -0.45776546130963164, -0.4337246549776095, -0.41131087843679104, -0.39048398856961386, -0.3711973877985467, -0.35339939226362904, -0.33703438910839056, -0.32204381294352613, -0.3083669693318699, -0.29594173025629833, -0.2847051233525961, -0.27459383346659627, -0.26554463200422795, -0.25749474669628514, -0.250382181863645, -0.24414599707366902, -0.2387265502318835, -0.23406570964342877 ], [ -1.2346371050710052, -1.2511632851106658, -1.2638272051143284, -1.2722938035795317, -1.276294905847967, -1.2756459222586287, -1.270259304171086, -1.2601527260625893, -1.2454502582178786, -1.2263756506787014, -1.2032382974587608, -1.1764141668534942, -1.1463251911017536, -1.1134204811631585, -1.0781612083310943, -1.0410090641973044, -1.002417083589257, -0.9628216672729232, -0.9226353426562146, -0.8822404418617509, -0.8419841227936954, -0.8021750622252919, -0.7630819072661149, -0.7249333418246144, -0.6879194785055542, -0.6521942291006242, -0.6178783148019955, -0.5850626223176898, -0.5538116720455533, -0.5241670253286173, -0.49615051217130246, -0.4697672056682189, -0.44500810436249205, -0.4218525096642931, -0.40027010369606864, -0.38022274496751507, -0.3616660065022739, -0.3445504846438773, -0.32882290776221623, -0.31442707327122676, -0.30130463938719143, -0.2893957953876962, -0.27863983113300106, -0.2689756235417743, -0.2603420547502262, -0.2526783739437588, -0.2459245124029893, -0.24002135918621015, -0.23491100308729818, -0.2305369450529755 ], [ -1.2013782354638038, -1.2165805559584164, -1.2280301684499362, -1.2354180398293533, -1.238500932876272, -1.2371167023953074, -1.2311963370776617, -1.2207708993422752, -1.2059718239689694, -1.1870238487792324, -1.1642311865548747, -1.137959111192459, -1.1086142289715042, -1.076626599461365, -1.0424354848806021, -1.0064787021219448, -0.9691844272806958, -0.9309642596212897, -0.8922069676357464, -0.8532729702128177, -0.8144899034249872, -0.7761495935734066, -0.7385065629126721, -0.7017779858284702, -0.6661448670792696, -0.6317541454733214, -0.5987214202779839, -0.5671340299167149, -0.5370542625785553, -0.5085225323111809, -0.48156040406911116, -0.45617339340728935, -0.43235350004077866, -0.41008145974879096, -0.38932871714977235, -0.37005913399029644, -0.352230455026706, -0.3357955574602087, -0.32070351116939233, -0.3069004764503901, -0.29433046424474874, -0.2829359813863346, -0.27265858058921555, -0.2634393319885303, -0.2552192302168509, -0.24793954836983745, -0.24154214786027783, -0.2359697511170823, -0.2311661823679555, -0.22707658034495115 ], [ -1.167945478481542, -1.1818518085508307, -1.192119154399614, -1.1984639229830474, -1.200666959652986, -1.1985874605855553, -1.192173646892549, -1.1814685376772829, -1.1666094775981313, -1.1478208399675718, -1.125400544226587, -1.099702428161001, -1.0711174934995364, -1.0400569560573514, -1.0069387991429615, -0.9721778803082771, -0.9361785478973172, -0.8993285930895643, -0.8619938772818292, -0.8245135693864019, -0.7871962574066492, -0.7503172281342416, -0.7141170646515833, -0.6788015292755711, -0.6445425590227578, -0.6114801254904526, -0.5797246931760203, -0.5493600306538411, -0.5204461693397477, -0.4930223513792916, -0.4671098533043986, -0.4427146113402439, -0.4198296060745479, -0.39843698860539467, -0.37850994801095716, -0.3600143320934045, -0.3429100409510736, -0.3271522170634453, -0.3126922571330788, -0.2994786706685716, -0.28745780881520056, -0.2765744847158432, -0.26677250406969055, -0.25799512181109996, -0.2501854381393962, -0.24328674461670197, -0.23724282879154845, -0.23199824384298107, -0.22749854808850223, -0.22369051785604566 ], [ -1.134452199463766, -1.1470960167723074, -1.1562180712785126, -1.1615594517300056, -1.1629240854027794, -1.160191302292461, -1.1533252037921558, -1.142379354994465, -1.1274956441729962, -1.108896868906764, -1.0868737067494354, -1.0617679665804116, -1.0339548726034276, -1.0038270605471065, -0.9717818890847505, -0.9382121931430101, -0.9034995668080502, -0.8680090591288145, -0.8320845732037304, -0.7960447992979052, -0.7601798562452042, -0.7247488940663445, -0.6899788152072922, -0.6560641199389285, -0.6231677513778, -0.5914227375056087, -0.5609344004943818, -0.5317829134999554, -0.5040260160941673, -0.47770173915721, -0.4528310301437487, -0.42942020562015476, -0.4074631878498759, -0.38694350555568957, -0.3678360562475552, -0.35010863950662674, -0.3337232783186317, -0.3186373498892078, -0.30480454918851907, -0.29217570847473395, -0.280699494817917, -0.2703230056468874, -0.26099227992293184, -0.2526527399669799, -0.24524957641668887, -0.23872808639371002, -0.23303397279992522, -0.22811361077951298, -0.2239142858000296, -0.22038440651956892 ], [ -1.1010066014916502, -1.1124262291936684, -1.1204441151588567, -1.1248251266220513, -1.1253951554303732, -1.1220523844075863, -1.1147754257865534, -1.103627026065626, -1.088752357868239, -1.0703715839726216, -1.0487673601797685, -1.0242690241701282, -0.9972359540342446, -0.9680425186233776, -0.937066114756745, -0.9046784864186445, -0.8712395547979357, -0.837092728019326, -0.8025609626397764, -0.7679433229364638, -0.7335121245840829, -0.6995108654454365, -0.6661530952594472, -0.6336222558627396, -0.6020724077982713, -0.5716296819813642, -0.5423942615912198, -0.5144427002915707, -0.4878304053318883, -0.4625941467693912, -0.4387544890405104, -0.41631807364079865, -0.39527970938493673, -0.3756242488289173, -0.35732824607987934, -0.34036140300510864, -0.32468781858019036, -0.31026706061575315, -0.2970550811410818, -0.28500499697065373, -0.2740677559916941, -0.2641927079330886, -0.2553280961533647, -0.24742148457699442, -0.2404201315009884, -0.23427131971730886, -0.22892265033424597, -0.22432230588061564, -0.22041928676155031, -0.21716362390559096 ], [ -1.0677110522811672, -1.0779489022342377, -1.0849071269678219, -1.0883733500887978, -1.0881942229077368, -1.0842854556215318, -1.0766388101615594, -1.065324914800171, -1.0504910841326296, -1.0323539404666493, -1.0111875024509938, -0.9873083396530385, -0.9610600165532457, -0.9327989949889619, -0.9028833740944058, -0.8716647180623268, -0.8394823400344336, -0.8066591137903448, -0.7734980937963131, -0.7402796261223485, -0.7072589567537056, -0.6746644853027967, -0.6426967997764303, -0.611528539203908, -0.581305032036169, -0.5521455852345312, -0.5241452617741286, -0.49737697811300596, -0.4718937680432664, -0.4477310854621484, -0.4249090485393288, -0.40343455672256845, -0.383303237401326, -0.36450119974816775, -0.34700658914132143, -0.3307909470302708, -0.3158203887787602, -0.3020566166223776, -0.2894577871036803, -0.27797925281686364, -0.26757419753242306, -0.2581941822080417, -0.24978961736162586, -0.2423101750416672, -0.23570515136590386, -0.22992378844299177, -0.22491556252992662, -0.22063044356159933, -0.21701912974305815, -0.21403325972359455 ], [ -1.034661555857309, -1.0437633946077653, -1.049709125624379, -1.052308014281095, -1.0514262061303583, -1.046995594874198, -1.0390197603454219, -1.0275759907961641, -1.012812720331534, -0.9949422726535734, -0.974229567539239, -0.9509782446938906, -0.9255161828698893, -0.8981823418817291, -0.869316187020788, -0.8392499861310094, -0.8083034773534744, -0.7767800898809285, -0.7449640279706504, -0.7131178583097437, -0.6814805383046503, -0.6502659783404132, -0.6196622501325988, -0.5898314936786, -0.5609104946168142, -0.5330118376121814, -0.5062255030370018, -0.48062076280765836, -0.4562482396656488, -0.43314201431396726, -0.4113216899014278, -0.39079434873296304, -0.3715563590162698, -0.35359500860759274, -0.3368899577130843, -0.32141451352401185, -0.3071367372968987, -0.2940203990338429, -0.2820257972879201, -0.27111046228022295, -0.26122975996113107, -0.25233741328633563, -0.2443859551339964, -0.23732712521256305, -0.23111222118653474, -0.22569241221078262, -0.2210190212023292, -0.21704378054565798, -0.21371906455081746, -0.21099810086981519 ], [ -1.0019473613738583, -1.009961611465946, -1.0149440010523787, -1.0167242555420586, -1.0151867148097458, -1.0102781163656478, -1.0020125720852346, -0.9904728941672589, -0.9758077317777646, -0.9582244890421479, -0.9379786640814081, -0.9153609265993896, -0.890683684892052, -0.8642688450968156, -0.8364379031388874, -0.8075046846307407, -0.7777703458855458, -0.747519929355787, -0.7170198286494393, -0.6865157801114118, -0.6562312626016782, -0.6263663467384206, -0.5970970778393475, -0.5685754431208954, -0.5409299113327478, -0.5142664754527619, -0.48867009174851045, -0.46420639368996425, -0.4409235624215842, -0.41885425032859724, -0.3980174747740458, -0.37842042096784423, -0.36006011336996846, -0.34292493253599576, -0.3269959683064835, -0.31224821072708664, -0.2986515873963389, -0.28617186056028676, -0.2747713997397433, -0.2644098464970889, -0.25504468758102883, -0.24663175151323513, -0.23912564201309228, -0.2324801197392412, -0.22664844184235522, -0.2215836669053325, -0.21723893108489523, -0.21356769971839984, -0.21052399735201488, -0.2080626180898154 ], [ -0.9696506989780275, -0.9766277845967607, -0.9806973496064768, -0.981708354186182, -0.9795620205020117, -0.9742186132519851, -0.96570154893612, -0.9540981174257972, -0.9395563913630207, -0.922278358723607, -0.9025098955446303, -0.8805287676805446, -0.856632205860725, -0.8311255513579707, -0.8043129974746126, -0.776490753883724, -0.7479423454670684, -0.7189354447459673, -0.689719647529631, -0.660524802087564, -0.6315597310030356, -0.6030113408152584, -0.5750441741508132, -0.5478004472694282, -0.5214005710036975, -0.49594410520940535, -0.4715110623035164, -0.4481634588925224, -0.42594701375993066, -0.4048929007997426, -0.38501948190361135, -0.36633396336021373, -0.34883393729396484, -0.3325087854734541, -0.3173409357289926, -0.30330697108037885, -0.2903785986863868, -0.27852349026463563, -0.267706008145862, -0.2578878320717045, -0.24902850163640577, -0.2410858882688811, -0.23401660914877898, -0.22777639368424774, -0.22232041132857838, -0.2176035677102105, -0.21358077438585, -0.21020719605837812, -0.2074384778616678, -0.2052309543141615 ], [ -0.937846631067287, -0.9438383740014495, -0.9470464342104065, -0.9473377591236443, -0.9446291485083427, -0.9388931159893935, -0.9301612226234498, -0.9185242804620547, -0.9041290998244087, -0.8871718667312016, -0.867888740183802, -0.8465447388199125, -0.8234222754227719, -0.7988106514329195, -0.772997427627391, -0.7462619989704544, -0.7188711669066243, -0.6910762052596, -0.6631108885517939, -0.6351900994141313, -0.607508824567063, -0.5802414953840522, -0.5535416987728473, -0.5275422898852932, -0.5023559090283096, -0.47807586731129575, -0.4547773350718805, -0.4325187502220658, -0.41134336015192996, -0.39128081746240073, -0.37234876258902294, -0.3545543418373005, -0.3378956249260012, -0.3223629002240971, -0.30793983763580024, -0.29460451825668543, -0.2823303365659591, -0.2710867853130897, -0.26084013577286835, -0.2515540270751797, -0.2431899782398086, -0.23570783569337095, -0.22906616769444288, -0.22322261546908062, -0.21813420913665682, -0.21375765481416487, -0.21004959771819043, -0.20696686469545877, -0.20446668844024385, -0.2025069147124552 ], [ -0.9066030064633706, -0.9116620758902241, -0.9140602519501523, -0.9136812182072829, -0.9104560709372278, -0.9043683446913632, -0.8954566582290873, -0.8838144799137442, -0.8695867696687811, -0.8529636230261246, -0.8341714762892323, -0.8134628326081017, -0.7911057018496144, -0.7673739014424922, -0.7425390330860728, -0.7168644560174521, -0.6906011159628831, -0.6639848123951064, -0.6372344329898431, -0.6105507879511471, -0.5841158353950866, -0.5580922223516736, -0.5326231403567874, -0.5078325136549539, -0.4838255225949244, -0.46068943672386053, -0.43849470643269056, -0.4172962459273073, -0.39713483509676073, -0.3780385716140079, -0.3600243142966524, -0.34309907141979457, -0.3272613009898049, -0.3125021023934704, -0.29880628944078413, -0.28615334324425434, -0.2745182495946944, -0.2638722296892265, -0.25418337553769366, -0.245417202456663, -0.23753713108849006, -0.23050491065988277, -0.22428099397988766, -0.21882487318523958, -0.21409538363918335, -0.2100509818050621, -0.2066500014384337, -0.20385089113140575, -0.20161243513534166, -0.19989395849771108 ], [ -0.8759805047659437, -0.880159922374834, -0.8817996927104262, -0.880798996696644, -0.8771019828023926, -0.8707020376310551, -0.8616438273545407, -0.850022697695298, -0.8359812594219075, -0.819703313542922, -0.8014056423676608, -0.7813285260274716, -0.759726030748131, -0.7368570703237475, -0.712977962997189, -0.6883367912113321, -0.6631694752085662, -0.6376972183082461, -0.6121249109398308, -0.5866401486290118, -0.5614126464054578, -0.5365939502871261, -0.5123174213145167, -0.48869849600361515, -0.46583522300682867, -0.44380905673805976, -0.4226858682696082, -0.4025171194068421, -0.3833411398616763, -0.36518444910551673, -0.3480630716180292, -0.331983804454409, -0.3169454072880433, -0.3029396958764117, -0.2899525293409272, -0.2779646893026081, -0.2669526546640413, -0.256889279780553, -0.2477443861471701, -0.23948527882635484, -0.2320771989462701, -0.22548372298456676, -0.21966711845913356, -0.2145886642752478, -0.21020894248929245, -0.20648810676520712, -0.20338613141008655, -0.20086304364045093, -0.19887914068593715, -0.19739519249972237 ], [ -0.8460327583003655, -0.8493854587241789, -0.8503177735094367, -0.84874316776924, -0.8446176449611962, -0.8379433402109896, -0.8287700346925645, -0.8171942556693668, -0.8033558469435716, -0.7874321837141781, -0.7696305239740959, -0.7501792650584643, -0.7293190225164646, -0.7072944048494618, -0.6843471224801484, -0.6607107212794778, -0.6366068915222457, -0.612243074292237, -0.5878110068640252, -0.5634858886837958, -0.53942594933365, -0.5157723022016628, -0.4926490396595332, -0.4701635598847607, -0.4484071203837206, -0.427455602258054, -0.4073704540202957, -0.38819977160809205, -0.3699794652245305, -0.35273446387144236, -0.33647991354891704, -0.3212223331960451, -0.30696070180696, -0.2936874594336135, -0.2813894130997149, -0.2700485455188236, -0.25964272976025193, -0.25014635667900365, -0.24153088418651913, -0.2337653185202232, -0.22681663782407402, -0.22065016782477453, -0.21522991839866912, -0.21051888856058176, -0.20647934601992424, -0.20307308605988772, -0.20026167318891308, -0.19800666785041154, -0.19626983949255095, -0.19501336651291268 ], [ -0.8168065395259569, -0.8193849848649515, -0.8196599343657462, -0.8175579605020484, -0.8130457794028625, -0.8061332404953516, -0.7968743851249465, -0.785366304916972, -0.7717457317594686, -0.7561835458918253, -0.7388776598551949, -0.7200449646969198, -0.6999131422950905, -0.6787131056074146, -0.6566726300540371, -0.6340114469327083, -0.6109377797264847, -0.5876460992733794, -0.5643157889762038, -0.5411104299088081, -0.5181774919014831, -0.4956483035080985, -0.4736382409700874, -0.45224711376097215, -0.43155973598868336, -0.41164666874636535, -0.39256510820991763, -0.37435988468330095, -0.3570645322995001, -0.3407023884905308, -0.3252876859059636, -0.3108266058107795, -0.29731826970337827, -0.2847556537836079, -0.2731264181384855, -0.2624136486090245, -0.25259651403927585, -0.24365084497456724, -0.2355496419829637, -0.2282635228096208, -0.2217611177518255, -0.21600942218165486, -0.21097411424106072, -0.2066198445659826, -0.20291050360427565, -0.1998094707899516, -0.19727984860799375, -0.1952846834884432, -0.19378717454203032, -0.19275087041086736 ], [ -0.7883420024331561, -0.7901978487692449, -0.7898643827632963, -0.7872801521842714, -0.7824215039376028, -0.7753050389188735, -0.7659882798341644, -0.7545683391878784, -0.7411785572026576, -0.7259833026786308, -0.7091713605300662, -0.690948518379559, -0.6715300569072367, -0.6511338084691378, -0.6299742802929, -0.6082580926680083, -0.5861807349727401, -0.5639244602812598, -0.5416570541080037, -0.5195312156269749, -0.49768434627677105, -0.47623861295919623, -0.45530121410593366, -0.4349648152930304, -0.41530813756132545, -0.3963966829999661, -0.3782835763399137, -0.36101049436852684, -0.3446086504070287, -0.329099800143283, -0.3144972375748276, -0.30080675475639795, -0.28802754534075825, -0.27615303854391726, -0.26517165640206464, -0.25506749253691063, -0.2458209148696212, -0.23740909776539543, -0.22980649102145223, -0.22298523407606496, -0.21691552399659608, -0.21156594538997042, -0.20690376954915102, -0.20289522906381996, -0.19950577291590588, -0.19670030585872178, -0.19444341472276694, -0.19269958325929837, -0.1914333962611402, -0.19060973300690287 ], [ -0.7606729672625954, -0.761856780417639, -0.7609624750316617, -0.7579394932119997, -0.7527727947741593, -0.7454848411684571, -0.7361359311486431, -0.724822723124597, -0.7116749439179453, -0.6968504787097085, -0.6805292327975978, -0.6629063111345586, -0.6441851337069104, -0.6245710667424937, -0.604266006815443, -0.5834641476358831, -0.5623489480073438, -0.541091158471544, -0.5198476812518873, -0.4987610294646968, -0.47795919207427595, -0.45755577022896365, -0.43765030492546, -0.4183287536578554, -0.3996640932746717, -0.3817170320454004, -0.36453681203260446, -0.3481620785254852, -0.332621789889735, -0.3179361402558136, -0.30411746920001204, -0.2911711364131605, -0.2790963444600719, -0.26788689827959533, -0.2575318953963386, -0.24801634545953155, -0.2393217214439094, -0.23142644755833353, -0.22430633064571404, -0.21793494273232883, -0.21228396254727855, -0.20732348344726015, -0.20302229440912434, -0.19934813973786403, -0.19626796200515728, -0.1937481315843027, -0.1917546650586872, -0.1902534338084616, -0.18921036325936336, -0.18859162262763118 ], [ -0.7338272387747149, -0.7343882561179265, -0.7329791242075654, -0.7295591541606972, -0.7241209668417019, -0.716692064546407, -0.7073348870291151, -0.6961452268626019, -0.6832490270851354, -0.6687977540238832, -0.6529627040934409, -0.6359287311146387, -0.6178879366017549, -0.599033829672756, -0.5795563413934444, -0.5596379031997467, -0.5394506185878543, -0.5191544155409487, -0.4988959882554986, -0.47880832020299613, -0.45901060818650946, -0.43960845464463416, -0.42069424289477053, -0.40234764587896, -0.38463624024332943, -0.36761620663032024, -0.35133309843205085, -0.33582265932250577, -0.32111166777022926, -0.30721878608711484, -0.2941553928788295, -0.2819263807821194, -0.2705309055138795, -0.2599630768609448, -0.25021258674146785, -0.2412652734598576, -0.23310362451355704, -0.2257072226916298, -0.21905314173982582, -0.21311629863694959, -0.20786976965536297, -0.20328507700687237, -0.19933245214552076, -0.19598108084342658, -0.19319933408864198, -0.1909549877702067, -0.1892154330880783, -0.18794787870796503, -0.18711954490802052, -0.1866978493545275 ], [ -0.7078269492437688, -0.7078128840655523, -0.705933225172313, -0.7021561859324467, -0.6964811630261651, -0.6889399493935693, -0.6795965572755633, -0.6685455596454091, -0.6559089905931528, -0.641831992871862, -0.626477541172281, -0.6100206746070994, -0.5926427149045168, -0.5745259133745921, -0.5558488654935256, -0.5367828835077904, -0.5174893631805235, -0.49811805636205897, -0.47880608718422835, -0.45967752799891953, -0.4408433686592781, -0.42240175036882666, -0.4044383761196003, -0.38702704304186986, -0.37023026386491276, -0.3540999560308197, -0.3386781810147037, -0.32399791661784527, -0.3100838441858109, -0.2969531325230209, -0.28461620140669863, -0.2730774500400549, -0.26233593915607745, -0.25238601929294013, -0.2432179015445436, -0.234818170486911, -0.2271702417638941, -0.22025476887699524, -0.2140500050531765, -0.2085321267194158, -0.20367552519418508, -0.1994530728345265, -0.19583636917913105, -0.19279597172059038, -0.19030161492991138, -0.18832242013056688, -0.18682709784747797, -0.18578414338895188, -0.1851620256905635, -0.18492936887734723 ], [ -0.6826889183133833, -0.6821458031263696, -0.67983808905181, -0.6757419851223866, -0.6698628447491266, -0.6622360683748378, -0.6529267346868881, -0.6420278961431132, -0.6296575923221541, -0.6159547625983016, -0.6010743582455664, -0.5851820401509906, -0.5684488811213588, -0.5510464607079042, -0.5331426510364741, -0.5148982659603702, -0.4964646137491603, -0.47798188445105244, -0.45957823471926806, -0.44136940812856773, -0.4234587386384574, -0.4059374140545613, -0.3888849109413295, -0.37236954275767087, -0.3564490846527826, -0.3411714511694104, -0.32657540915541616, -0.31269131023412045, -0.2995418276104427, -0.28714268237897256, -0.27550334563405066, -0.26462770473555075, -0.25451468486430806, -0.24515882015650714, -0.23655077186927287, -0.22867779389647125, -0.22152414831905587, -0.21507147543076466, -0.20929912380572113, -0.20418444650897583, -0.19970306957620887, -0.19582913850711792, -0.19253554783898819, -0.189794157999155, -0.18757600267314245, -0.1858514889511056, -0.18459059159311753, -0.18376304193246484, -0.18333851124730516, -0.18328678789279507 ], [ -0.6584250228062113, -0.657397087884013, -0.6547018800056519, -0.6503227579320957, -0.6442702775083413, -0.6365828275952912, -0.6273261055171631, -0.6165913901976976, -0.6044926756309128, -0.5911628380662581, -0.5767491104219137, -0.5614082079980633, -0.5453014743004908, -0.528590387069663, -0.5114326876103654, -0.493979288947423, -0.47637200500864746, -0.4587420475219048, -0.4412091746572169, -0.4238813491253629, -0.40685476711761304, -0.3902141416437618, -0.3740331528059284, -0.3583750047121127, -0.3432930495985149, -0.32883145333130226, -0.3150258840111283, -0.3019042089664611, -0.28948718697845177, -0.2777891435794382, -0.26681861853246835, -0.25657897642776206, -0.24706897367439895, -0.2382832777945989, -0.2302129375670483, -0.22284580496806572, -0.21616691184689307, -0.21015880574395385, -0.2048018501903779, -0.20007449524017606, -0.19595352394913323, -0.19241428011449258, -0.18943088192308866, -0.18697642531850844, -0.18502317997712525, -0.18354277985370193, -0.18250640937984042, -0.18188498561873878, -0.18164933602761912, -0.1817703709723727 ], [ -0.6350425705063318, -0.6335721540068961, -0.6305280486046676, -0.625899977063511, -0.6197030061103159, -0.6119779546059801, -0.6027907446210472, -0.5922306717075945, -0.580407663061871, -0.5674486879223655, -0.5534935690327774, -0.5386905017925238, -0.5231916061129719, -0.5071488095543966, -0.49071029381924186, -0.47401764467951457, -0.457203748000606, -0.44039139091610197, -0.4236924701599035, -0.4072076827950465, -0.391026573821749, -0.37522783155304873, -0.3598797456321515, -0.3450407665855667, -0.33076012547437794, -0.31707848606461686, -0.30402861051490115, -0.2916360243397338, -0.2799196689489034, -0.26889253166820204, -0.25856224462446653, -0.2489316456038453, -0.23999929602466918, -0.23175995338273592, -0.2242049977320968, -0.2173228137671005, -0.21109913172333306, -0.20551733152806895, -0.20055871537525893, -0.1962027541939897, -0.19242731337694163, -0.18920886271074067, -0.1865226747886185, -0.18434301537239517, -0.18264332828449215, -0.18139641652083094, -0.1805746204379549, -0.1801499931251006, -0.18009447245324872, -0.1803800488147641 ], [ -0.6125446728146594, -0.6106721589386874, -0.6073157569917922, -0.6024708270455201, -0.596156315344337, -0.5884149693593477, -0.5793125916476196, -0.5689363232833342, -0.5573920291375527, -0.5448009397948745, -0.5312957761437342, -0.5170166299804166, -0.502106887393053, -0.4867094574218837, -0.47096351088779786, -0.4550018553564574, -0.43894898827878587, -0.42291979715495365, -0.4070188238940933, -0.3913399841045939, -0.37596662808251013, -0.36097184199387744, -0.3464189073712223, -0.33236185804274154, -0.3188460918406535, -0.30590900814353683, -0.2935806515088434, -0.28188434731343015, -0.2708373186886298, -0.2604512762058738, -0.25073297350392854, -0.2416847237607257, -0.23330487373966524, -0.2255882340422397, -0.2185264660523749, -0.2121084277227856, -0.20632048171283157, -0.2011467703674431, -0.19656946260010233, -0.19256897792329886, -0.18912419270168912, -0.18621263325076765, -0.1838106597417971, -0.1818936440781651, -0.18043614405104402, -0.17941207522643077, -0.17879488121337306, -0.1785577022541529, -0.17867354148843106, -0.17911542779061618 ], [ -0.5909306120021798, -0.5886943937926283, -0.5850602919303377, -0.5800286343686062, -0.5736216727677486, -0.565883635075771, -0.5568799055133055, -0.546695334138807, -0.535431749908994, -0.5232048222500941, -0.510140476224621, -0.4963711050657415, -0.48203183340248473, -0.4672570622834991, -0.4521774770650894, -0.4369176313108612, -0.4215941473785664, -0.40631451026101595, -0.39117638462085835, -0.37626735938038747, -0.3616650180064477, -0.3474372406119275, -0.333642659864402, -0.32033121086876226, -0.3075447318542086, -0.29531758575578826, -0.2836772822771978, -0.27264508632037776, -0.2622366026986943, -0.25246232972336025, -0.2433281762581696, -0.2348359385976182, -0.22698373522566917, -0.21976639918309093, -0.21317582934595047, -0.2072013033026625, -0.20182975562566952, -0.19704602610853128, -0.1928330829581666, -0.18917222600664974, -0.18604327477515448, -0.18342474574062573, -0.18129402248971094, -0.17962752166204543, -0.17840085675202766, -0.17758900101203223, -0.17716644992890895, -0.17710738306656792, -0.1773858245056188, -0.17797580068122099 ], [ -0.5701961995452425, -0.5676326631270787, -0.5637534626624084, -0.558563279627593, -0.5520871510884962, -0.5443703867806129, -0.5354776951554828, -0.5254915294207324, -0.5145097276169573, -0.5026425819913815, -0.4900095235628835, -0.4767356393885401, -0.46294824658447714, -0.4487737268646722, -0.4343347817688873, -0.4197482101291278, -0.40512324659511023, -0.3905604438451973, -0.37615103915592585, -0.36197672162639427, -0.3481097086212702, -0.3346130450121939, -0.32154105147133827, -0.3089398636678815, -0.2968480192803018, -0.28529706234180785, -0.27431214396690773, -0.2639126052119808, -0.2541125323599648, -0.2449212780191845, -0.23634394369467648, -0.22838182133566076, -0.22103279300217826, -0.21429168930081066, -0.2081506085986229, -0.20259920018182376, -0.19762491542357974, -0.19321323162263548, -0.1893478534567975, -0.18601089697328055, -0.18318306074696356, -0.18084378832594905, -0.1789714254114242, -0.17754337444657442, -0.17653624847652416, -0.17592602534110147, -0.1756882025187153, -0.17579795228723227, -0.17623027633019728, -0.17696015850727576 ], [ -0.550334122716883, -0.5474776499946068, -0.5433839812268519, -0.5380615895979877, -0.531537828345012, -0.523858735964839, -0.5150881252368855, -0.505305973819006, -0.4946061894371032, -0.48309387536176557, -0.47088226454471505, -0.45808951659882, -0.4448355760271214, -0.4312392716089545, -0.4174157987786612, -0.4034746760867435, -0.3895182124092962, -0.3756404722657686, -0.3619266889358992, -0.3484530520951987, -0.3352867880142879, -0.3224864530652839, -0.310102371262713, -0.2981771598447489, -0.2867463003874854, -0.2758387247606604, -0.2654773945970835, -0.2556798598641121, -0.2464587870233701, -0.23782245071024288, -0.22977518537251163, -0.2223177952567139, -0.21544792275161884, -0.2091603764954999, -0.20344742185098508, -0.1982990373282414, -0.1937031412611896, -0.1896457934887451, -0.18611137695628577, -0.18308276404567803, -0.18054147209652371, -0.17846781204206885, -0.17684103340369217, -0.17563946812325826, -0.17484067491743993, -0.1744215850605848, -0.1743586497837617, -0.1746279888492157, -0.1752055393432822, -0.17606720333979775 ], [ -0.5313342772254966, -0.5282172642898211, -0.523937823522548, -0.5185077078010496, -0.5119561646977, -0.5043296504160419, -0.4956908960410391, -0.48611734884659724, -0.4756990598003662, -0.46453613370567837, -0.45273589439475714, -0.44040993843545906, -0.42767125325598804, -0.41463155875300295, -0.4013989981140941, -0.38807625953492275, -0.37475916318152536, -0.3615357044367684, -0.34848551069670175, -0.3356796475214723, -0.3231807007595586, -0.31104306217541744, -0.29931335385138946, -0.28803093785659317, -0.2772284696560017, -0.2669324646846444, -0.25716385655978424, -0.24793853237099828, -0.2392678356170569, -0.23115903106717417, -0.2236157285376782, -0.21663826463317992, -0.2102240431326513, -0.20436783603028885, -0.19906204832058927, -0.19429695045379536, -0.19006088297196555, -0.1863404381585888, -0.18312062359708758, -0.18038501235288484, -0.17811588410031431, -0.17629436095140572, -0.17490054105702624, -0.1739136322929068, -0.17331208756314886, -0.17307374249647467, -0.17317595561361832, -0.1735957504372294, -0.17430995851882414, -0.1752953619823342 ], [ -0.5131840842385755, -0.5098369729736443, -0.5053985699520424, -0.4998834426505053, -0.4933223551668865, -0.48576190876655, -0.47726359727687767, -0.46790230363319124, -0.4577643062153494, -0.44694490256015457, -0.43554578835888236, -0.4236723467891399, -0.41143100432013735, -0.3989267938182288, -0.38626123652526023, -0.3735306161404489, -0.36082467698062604, -0.3482257401008424, -0.3358082010056054, -0.3236383526650669, -0.3117744681723491, -0.30026707693514565, -0.2891593741793269, -0.2784877129610015, -0.2682821384532972, -0.25856693433062594, -0.24936115969972883, -0.24067916191762262, -0.2325310558833178, -0.224923164284614, -0.21785841616064272, -0.21133670330183807, -0.2053551956681483, -0.19990861829906748, -0.19498949318658, -0.1905883503132394, -0.18669391253182654, -0.18329325918462003, -0.1803719733395548, -0.1779142772777932, -0.1759031604331568, -0.17432050339837624, -0.17314720092066482, -0.17236328605748052, -0.17194805689712245, -0.17188020650993607, -0.1721379561189248, -0.17269919089087893, -0.17354159726952867, -0.17464280041167413 ] ], "zauto": true, "zmax": 1.8501994525042758, "zmin": -1.8501994525042758 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.3338416085661411, 0.31738819871287033, 0.30206722635534805, 0.28817671341098616, 0.27602843364036933, 0.26593627739756664, 0.25819653669285425, 0.25305991360005337, 0.25069909256659256, 0.251180214979236, 0.25444826912500845, 0.2603327194335914, 0.26857196534910316, 0.27884829661582106, 0.290822987088606, 0.30416402860403136, 0.31856372804594135, 0.3337471288821705, 0.3494739487177262, 0.3655368418640191, 0.38175811701093704, 0.3979861995254479, 0.4140924449644562, 0.42996847221000617, 0.44552396088583407, 0.4606847804301478, 0.47539132242415943, 0.4895969461296275, 0.5032664909957655, 0.5163748450706178, 0.5289055802366476, 0.5408496747247166, 0.5522043435309876, 0.5629719917951016, 0.5731592981057426, 0.5827764264726364, 0.5918363588456618, 0.6003543352978041, 0.608347386454862, 0.6158339421990223, 0.6228335016368177, 0.629366351280098, 0.6354533208490886, 0.6411155686653128, 0.6463743909668284, 0.6512510514683862, 0.655766629021077, 0.6599418822913721, 0.6637971310214871, 0.6673521537254392 ], [ 0.3308212239942183, 0.31408758567805906, 0.29847211408770885, 0.2842788841076793, 0.2718289831226302, 0.2614490564673092, 0.2534509081577132, 0.24810160514532936, 0.24558803066108204, 0.2459850824325637, 0.24923890939764293, 0.25517256937186417, 0.2635126396994729, 0.2739273357301049, 0.28606445169766415, 0.29958085171783694, 0.3141606701034061, 0.3295235340349468, 0.345425924442312, 0.3616587954968855, 0.3780437457448358, 0.3944290815568213, 0.41068636886807075, 0.42670760739519353, 0.44240293607388387, 0.4576987088991315, 0.4725357942881385, 0.4868679976691105, 0.5006605564842183, 0.5138886952392201, 0.5265362516759335, 0.53859439498616, 0.5500604568622575, 0.5609368901093538, 0.5712303609797337, 0.5809509728449903, 0.5901116118371094, 0.5987274003749433, 0.6068152421386911, 0.6143934417559086, 0.6214813837088375, 0.6280992571998714, 0.6342678164003186, 0.6400081682390103, 0.6453415823659054, 0.6502893199752628, 0.6548724797184475, 0.6591118599806804, 0.6630278373936914, 0.6666402616913354 ], [ 0.32824690151103336, 0.3112489148080937, 0.29535171039064284, 0.2808651363879254, 0.26811954032697444, 0.25745456060744326, 0.24919806735550146, 0.24363429623396832, 0.24096519361767815, 0.24127506982069977, 0.24451146709999727, 0.250490814728405, 0.2589273538690294, 0.26947465694830325, 0.28176659734586934, 0.2954486719363366, 0.31019679581562704, 0.32572528093032616, 0.3417875721106739, 0.3581731854804072, 0.37470330598665175, 0.3912264325342392, 0.4076146530101089, 0.4237606475339383, 0.439575292276783, 0.4549856748623665, 0.469933356069459, 0.4843727672041771, 0.4982696874800752, 0.5115997873191995, 0.5243472483310609, 0.5365034808859364, 0.5480659598369274, 0.559037192450293, 0.5694238236535173, 0.5792358749303775, 0.5884861061536155, 0.5971894850383119, 0.6053627467682827, 0.6130240263346086, 0.6201925476715693, 0.6268883561783142, 0.6331320841307574, 0.6389447413871163, 0.6443475263750538, 0.6493616544478044, 0.6540082022464279, 0.6583079677199745, 0.6622813460013649, 0.6659482215087567 ], [ 0.3260987310237756, 0.30885034356211694, 0.29268234268951054, 0.27791015487944304, 0.26487342990306284, 0.25392514036447256, 0.24540988155074056, 0.23962995783910926, 0.23680331156036086, 0.23702433812960133, 0.24024215307132407, 0.24626621866554485, 0.25479777173636103, 0.26547501263042267, 0.27791730663803876, 0.291758421548775, 0.306665910107246, 0.32234879933737975, 0.33855765267485477, 0.3550807873512928, 0.37173926797187823, 0.38838210953386687, 0.40488225608705136, 0.421133396580929, 0.43704745381353033, 0.45255252954238023, 0.4675911221194117, 0.48211849544090934, 0.49610113821673435, 0.5095152971395391, 0.5223455937549007, 0.5345837453628572, 0.5462274097768445, 0.5572791669588795, 0.5677456413247276, 0.5776367595955199, 0.586965132060076, 0.5957455406736947, 0.6039945155552822, 0.6117299817453153, 0.6189709599480776, 0.6257373077657041, 0.6320494910732738, 0.6379283782440504, 0.6433950526153164, 0.6484706407248159, 0.6531761553923077, 0.6575323536973106, 0.6615596103914759, 0.6652778073873475 ], [ 0.3243534278922699, 0.30686655058859136, 0.29043680174152753, 0.2753850746258036, 0.26206045216153295, 0.2508296746550703, 0.24205481473127965, 0.23605723176097904, 0.23307185895416188, 0.23320386221880765, 0.23640405560691433, 0.2424744785892589, 0.25110254276770266, 0.26191019075041544, 0.2745015523952004, 0.2884981880684606, 0.3035590528612303, 0.31938785067276704, 0.33573237259660316, 0.3523799517871873, 0.3691518199120292, 0.3858978403547295, 0.40249216654164316, 0.41882984988347804, 0.4348241972508056, 0.45040463348277915, 0.4655148669465411, 0.4801112259653039, 0.49416109911033373, 0.5076414598104618, 0.5205374833410094, 0.5328412752483492, 0.5445507297536497, 0.5556685297025195, 0.5662012902590936, 0.5761588396002937, 0.5855536229681901, 0.594400212233498, 0.6027149015700032, 0.6105153704805362, 0.6178203976035747, 0.6246496117973788, 0.6310232703618465, 0.6369620574710106, 0.6424868986573433, 0.6476187893585204, 0.652378637066962, 0.6567871175527435, 0.6608645460524798, 0.6646307643464072 ], [ 0.32298535362740977, 0.30526991572083556, 0.2885856921128615, 0.2732590078072874, 0.25964858313216116, 0.24813542907070257, 0.2390999141659971, 0.23288350011070183, 0.22973914939511855, 0.22978348745187469, 0.23296909783918443, 0.23909003311969035, 0.24781892221803076, 0.25876042823813694, 0.27150259895581114, 0.28565421025143595, 0.300865304895408, 0.31683416439760287, 0.3333058736003381, 0.3500669709918363, 0.36693913311441745, 0.3837734073519766, 0.4004455224855895, 0.41685226484385535, 0.4329086848482765, 0.4485458624731454, 0.4637090112952351, 0.47835577746192737, 0.4924546597302181, 0.5059835269579906, 0.5189282384666697, 0.531281384283605, 0.5430411619180605, 0.5542103993460415, 0.5647957245172711, 0.574806872851625, 0.5842561175021238, 0.5931578032565108, 0.6015279637499482, 0.6093840026668754, 0.6167444221366225, 0.6236285848796324, 0.6300565002404439, 0.636048627600165, 0.6416256935059209, 0.6468085210438499, 0.6516178714877875, 0.6560742991319294, 0.6601980205663182, 0.6640087996053566 ], [ 0.32196756678063987, 0.30403172083764707, 0.2870987915535914, 0.2715005660103249, 0.2576056574081352, 0.2458098870409835, 0.23651276451999606, 0.2300769223136649, 0.2267744024620241, 0.22673396603925955, 0.2299099841269453, 0.23608786798181058, 0.24492440008375846, 0.256005842202664, 0.2689032291794719, 0.28321190586306133, 0.2985726297486684, 0.3146781123607548, 0.33127076082939294, 0.34813648259316826, 0.3650976627230329, 0.3820068643150001, 0.3987417616773276, 0.4152012584538591, 0.4313025216720198, 0.4469786340442076, 0.46217662589161074, 0.4768557309475226, 0.49098578441175295, 0.5045457345163087, 0.517522269390379, 0.5299085733517144, 0.5417032267448966, 0.5529092566524385, 0.5635333366109162, 0.5735851248445845, 0.5830767241427646, 0.5920222429686373, 0.6004374365830853, 0.6083394083600184, 0.6157463543426941, 0.6226773377263243, 0.6291520837408154, 0.6351907888982958, 0.6408139414808562, 0.6460421523426059, 0.6508959965728519, 0.6553958673821334, 0.6595618438464651, 0.6634135740144173 ], [ 0.3212728466466052, 0.3031233022662001, 0.28594633638135564, 0.2700792802138193, 0.2559009202374122, 0.24382242493808068, 0.23426326710046888, 0.2276082872808768, 0.22414962537084837, 0.22402881668506636, 0.227201985537667, 0.23344518216400775, 0.24239821481682275, 0.2536277715657623, 0.26668690664015915, 0.2811568569646276, 0.2966686919069521, 0.31290937472197183, 0.32961863402219826, 0.34658188466219747, 0.36362246484505356, 0.38059477270837677, 0.39737879208365656, 0.4138759253558582, 0.43000583230408923, 0.445703952083215, 0.460919451540189, 0.47561343147736584, 0.4897573004834557, 0.5033312813785346, 0.5163230474025324, 0.5287264985312542, 0.5405406888463794, 0.5517689094708704, 0.5624179227238787, 0.572497334888539, 0.5820190890011239, 0.5909970559634481, 0.5994467019119484, 0.6073848115773999, 0.6148292505955787, 0.6217987536461641, 0.6283127292875963, 0.634391075970878, 0.6400540066819056, 0.6453218818608603, 0.6502150516790923, 0.654753709501416, 0.658957758553891, 0.6628466936012892 ], [ 0.32087464009025646, 0.30251709643094193, 0.2851001650760713, 0.2689668403476811, 0.2545063597353912, 0.24214573089556327, 0.2323251336829965, 0.225452561826636, 0.22184118524280658, 0.22164588197485174, 0.22482444162052054, 0.23114279813086858, 0.24022264527114423, 0.2516099343851242, 0.26483879119869724, 0.2794756839927548, 0.29514159524487193, 0.3115175526128547, 0.328340586803133, 0.3453957353099089, 0.3625075103349493, 0.3795324429470478, 0.3963531728704683, 0.4128739694324733, 0.42901735249166034, 0.4447214666176401, 0.45993793383810755, 0.4746300034453406, 0.48877089881458347, 0.5023423190011191, 0.5153330865724588, 0.5277379474620987, 0.5395565299218151, 0.5507924638089456, 0.5614526530918688, 0.5715466866869119, 0.5810863672516374, 0.5900853349483274, 0.598558763296221, 0.6065231064577622, 0.6139958808889331, 0.6209954684788135, 0.6275409324881661, 0.6336518413271518, 0.6393480982253612, 0.6446497770381584, 0.6495769658177384, 0.6541496204522216, 0.6583874307833567, 0.6623097013102517 ], [ 0.3207478929728728, 0.3021875356236223, 0.28453467228614787, 0.2681381017524791, 0.2533977613154743, 0.24075690377676867, 0.23067702545016788, 0.22359006022151626, 0.21983099218811597, 0.2195685006508602, 0.2227618946900302, 0.2291662337677518, 0.23838400239087282, 0.2499393283116868, 0.263346542948439, 0.2781567521628384, 0.2939804940762989, 0.3104926885223738, 0.32742764295241883, 0.344570112618433, 0.3617459767921017, 0.37881416698674575, 0.3956602958508311, 0.41219184185778435, 0.42833453087601864, 0.4440295455551496, 0.4592312705037051, 0.4739053783457521, 0.48802714616637294, 0.5015799518687181, 0.51455393528068, 0.5269448243908402, 0.5387529293148556, 0.5499823015112681, 0.5606400480764923, 0.5707357837954009, 0.5802811987230271, 0.5892897170169391, 0.5977762233524904, 0.6057568359223883, 0.6132487089692619, 0.6202698522695025, 0.6268389593582012, 0.6329752401217597, 0.6386982564361031, 0.6440277617041841, 0.6489835464780038, 0.653585292949094, 0.6578524411114638, 0.6618040690095566 ], [ 0.32086974049254896, 0.30211176757508407, 0.28422754693128943, 0.2675718326100525, 0.2525554587059757, 0.23963820632376903, 0.22930330968209375, 0.2220072049745995, 0.21810725985092239, 0.21778625756349076, 0.22100481575639147, 0.22750639237893006, 0.23687327553507767, 0.2486068293742766, 0.2622008717895662, 0.2771906710127481, 0.29317604221636684, 0.30982566488352076, 0.32687110521750395, 0.3440969152200906, 0.36133050329750377, 0.3784334303427724, 0.3952945584646003, 0.41182487906712706, 0.42795363613565096, 0.44362535516536505, 0.4587974692072468, 0.47343833370696775, 0.48752550865858824, 0.5010442485611533, 0.5139861775763459, 0.526348144134491, 0.5381312525414171, 0.5493400649771378, 0.5599819603970605, 0.5700666304250417, 0.5796056880974743, 0.588612363871205, 0.5971012644598169, 0.605088173188759, 0.6125898748723755, 0.6196239929564383, 0.6262088312215522, 0.6323632162786978, 0.6381063401711453, 0.6434576045524616, 0.6484364691853759, 0.6530623080266684, 0.6573542760952755, 0.6613311898411468 ], [ 0.32122004356931977, 0.30227018866885014, 0.28416028806473465, 0.2672512005750353, 0.2519647844155904, 0.23877747917158534, 0.22819444307893838, 0.22069688781759814, 0.21666485037309674, 0.2162953145192816, 0.21954992047384678, 0.22615986387052986, 0.23568642168330148, 0.2476074734505892, 0.26139581451619076, 0.27657056799802304, 0.2927206613083715, 0.3095084634285004, 0.3266628011447027, 0.34396809018920727, 0.361253396776141, 0.3783830945243268, 0.3952495211669545, 0.4117674351618705, 0.42786986543938127, 0.443504946331446, 0.45863341383970235, 0.47322654184482654, 0.48726438554519924, 0.5007342630245375, 0.5136294442585334, 0.525948035068964, 0.5376920480332289, 0.5488666492478714, 0.5594795638965092, 0.5695406179834686, 0.5790613901081355, 0.5880549463658125, 0.596535633178519, 0.6045189064535725, 0.6120211801477413, 0.6190596823228064, 0.625652311504827, 0.6318174901886338, 0.6375740154389292, 0.6429409086713308, 0.647937267913534, 0.652582126288478, 0.6568943203060837, 0.6608923709836474 ], [ 0.3217817698275042, 0.302646794434845, 0.2843185085131601, 0.267164015845081, 0.2516162441382452, 0.23816824646110663, 0.2273470166932137, 0.21965846754456098, 0.2155052395678856, 0.21509835488374585, 0.21840010353888975, 0.22512886013505284, 0.23482431461884581, 0.24694043162914922, 0.26092874527692356, 0.27629213758439897, 0.29260862654793357, 0.3095342812179747, 0.326795220561485, 0.3441757823633162, 0.36150678414905446, 0.3786555444731217, 0.395518044462188, 0.4120130047354873, 0.42807745096108446, 0.4436633440454368, 0.45873493733880816, 0.47326662710690787, 0.48724115242492894, 0.500648065534173, 0.5134824334473083, 0.5257437511143873, 0.5374350522152095, 0.5485622016796132, 0.559133349117001, 0.5691585176607686, 0.5786493000510045, 0.5876186336858806, 0.5960806286773637, 0.6040504270186802, 0.6115440760192936, 0.6185784044356958, 0.6251708946230188, 0.6313395481511296, 0.6371027454629359, 0.6424791022599391, 0.6474873264590861, 0.6521460799294716, 0.6564738489770973, 0.6604888268952719 ], [ 0.322541226857231, 0.303229361390858, 0.28469204796330133, 0.2673027606452661, 0.25150545322610585, 0.23780955809411156, 0.2267635122095, 0.21889745648582268, 0.21463615380162757, 0.21420419161686335, 0.21756403845322747, 0.22442082793490692, 0.23429239274345737, 0.24660871244960358, 0.2608001460546242, 0.2763534860255844, 0.29283598397338123, 0.30989751233767665, 0.327261549576679, 0.3447124069136512, 0.36208271002909426, 0.3792427995087443, 0.39609240345752394, 0.4125543338101518, 0.4285697622465911, 0.444094638204532, 0.45909689947251053, 0.4735542303669686, 0.4874522129841298, 0.5007827827433551, 0.5135429402852327, 0.5257336925534275, 0.5373592029008353, 0.5484261292922957, 0.5589431258477889, 0.5689204792667748, 0.5783698498408922, 0.5873040873946558, 0.5957370954019582, 0.6036837210811239, 0.6111596546876796, 0.6181813267582669, 0.6247657971229624, 0.6309306337092646, 0.6366937823187824, 0.6420734306414918, 0.6470878708760743, 0.6517553656156201, 0.6560940213365293, 0.6601216730978137 ], [ 0.32348816184766777, 0.3040094810246356, 0.2852749239602162, 0.2676644417144713, 0.25163287955872193, 0.23770561928479217, 0.22645182426431418, 0.2184249518584518, 0.21407093462810822, 0.2136270940613406, 0.21705549742611524, 0.22404779332984437, 0.23410005765904487, 0.24661863930983802, 0.26101317963668236, 0.27675480712188005, 0.2934003269735163, 0.3105936156270464, 0.32805561511007764, 0.345570654040258, 0.36297318495899883, 0.38013659004556194, 0.39696438041395055, 0.41338351830053327, 0.4293394033127136, 0.4447920744037259, 0.45971326830958337, 0.4740840796548821, 0.4878930583669797, 0.501134646133613, 0.5138078952907229, 0.525915435382001, 0.5374626608499994, 0.5484571137516338, 0.5589080326848221, 0.5688260364163881, 0.5782229097445256, 0.5871114605044924, 0.5955054201457154, 0.6034193653481411, 0.6108686439284091, 0.6178692940795518, 0.6244379512169137, 0.6305917409960136, 0.6363481602512201, 0.641724949667796, 0.6467399630528005, 0.6514110382927358, 0.6557558746889205, 0.6597919205563965 ], [ 0.32461574535699195, 0.3049824699249551, 0.28606515174661606, 0.268250303862284, 0.25200343751961896, 0.2378652573816678, 0.22642460193391326, 0.21825686613656567, 0.2138276851991295, 0.2133858877797737, 0.21689244719299078, 0.22402549544201072, 0.23425988222101649, 0.24697916012670423, 0.26157311758372354, 0.2774979344862751, 0.29430046925043274, 0.31161889721778513, 0.32917176096802925, 0.34674344024904696, 0.3641701934696418, 0.38132840550943853, 0.39812533802495104, 0.4144920909627129, 0.4303783043601949, 0.4457481440267148, 0.4605772044329195, 0.47485006594084644, 0.4885583332751579, 0.5016990481107493, 0.5142734107689225, 0.5262857687546347, 0.5377428391906507, 0.5486531338013199, 0.5590265535110231, 0.5688741180411828, 0.5782077958187815, 0.5870404016328089, 0.5953855336060611, 0.6032575265710906, 0.6106714050841133, 0.6176428253594253, 0.6241880007998576, 0.6303236101801007, 0.6360666907518361, 0.6414345205886082, 0.6464444954972443, 0.6511140059839043, 0.6554603192977321, 0.6595004707022274 ], [ 0.32592045819738175, 0.3061471803104612, 0.2870644628954024, 0.2690654403792769, 0.25262597434547207, 0.23830127173696888, 0.2266984581555261, 0.21841300664004476, 0.21392824938105096, 0.21350287976476434, 0.2170959758549274, 0.22437236809654973, 0.23478668893703578, 0.2477010497670225, 0.262486680057495, 0.2785858206860182, 0.29553605637770686, 0.31297024128054657, 0.33060468059161013, 0.3482238241502516, 0.36566567406152184, 0.382809521082768, 0.3995662777977991, 0.4158710989593412, 0.4316778087743476, 0.4469546734320645, 0.4616811472235394, 0.47584532320466655, 0.4894419079005581, 0.5024706049203539, 0.5149348345718885, 0.5268407399504754, 0.538196440261322, 0.5490114948201655, 0.5592965406715805, 0.5690630660822051, 0.5783232829717231, 0.5870900642077524, 0.5953769164246028, 0.6031979650205445, 0.610567934488539, 0.6175021135356343, 0.6240163000022632, 0.6301267250647246, 0.6358499594504089, 0.6412028064369245, 0.6462021873796074, 0.6508650256210163, 0.6552081341114883, 0.6592481111374483 ], [ 0.32740189963370936, 0.3075057331733009, 0.28827794926241296, 0.27011833136985053, 0.2535126845830878, 0.23902970693031686, 0.2272930915488468, 0.2189160523355344, 0.21439707461596985, 0.21400266308349686, 0.21768910799523652, 0.22510842940279496, 0.23569656010071408, 0.24879606550511738, 0.26376134384151767, 0.28002199328477934, 0.29710715817310307, 0.3146448229061766, 0.33234923247526743, 0.3500049057749609, 0.3674514843048463, 0.3845710119188548, 0.4012778887737037, 0.4175111748508026, 0.43322875658025434, 0.44840291235540153, 0.4630169027241249, 0.4770623119884919, 0.49053695477787174, 0.5034432254810888, 0.5157868103870236, 0.5275757061523024, 0.5388194992897115, 0.5495288650375961, 0.5597152444837739, 0.569390659094274, 0.5785676234516203, 0.5872591205887547, 0.595478609623314, 0.6032400418503381, 0.6105578682967359, 0.6174470282867898, 0.6239229142859946, 0.6300013128563897, 0.6356983248434672, 0.6410302699577117, 0.6460135818616984, 0.6506646999411171, 0.6549999633643282, 0.6590355120524707 ], [ 0.3290625328845537, 0.3090631926995787, 0.28971365384512826, 0.2714203350162391, 0.2546784819387255, 0.240069084073041, 0.22823036198574567, 0.2197904764818286, 0.2152600140753778, 0.21491086185761066, 0.21869557189100752, 0.22625414331513963, 0.23700584148969975, 0.25027611316219894, 0.26540467052870137, 0.2818100330235864, 0.2990138798336098, 0.3166398337504778, 0.33440026200738093, 0.3520797270659927, 0.3695193635873943, 0.38660376324152135, 0.4032505918463407, 0.41940260395436896, 0.435021565670751, 0.4500836217687136, 0.4645757326579451, 0.47849290564098995, 0.49183602960210454, 0.5046101851516479, 0.516823343621778, 0.5284853922027866, 0.5396074341867512, 0.5502013178049341, 0.5602793485901019, 0.5698541413701897, 0.5789385704582576, 0.587545780868283, 0.5956892292620535, 0.6033827302234464, 0.6106404906320079, 0.6174771216913892, 0.6239076240462548, 0.6299473460841397, 0.6356119188534852, 0.6409171730832864, 0.6458790447235221, 0.6505134754630472, 0.6548363140699698, 0.6588632233771301 ], [ 0.3309073808687559, 0.3108271962781782, 0.29138212449016315, 0.2729851501642776, 0.2561403510004731, 0.24143961929194, 0.2295333585685203, 0.22106146549103808, 0.21654312995541217, 0.21625288644705912, 0.22013859097005276, 0.22782932189487573, 0.23873020116941196, 0.25215247689481735, 0.26742369945396416, 0.28395311113100724, 0.30125602208638885, 0.31895224470073286, 0.33675244866881926, 0.35444118782891415, 0.3718609038417056, 0.3888984834116197, 0.40547458418865906, 0.4215353906273474, 0.4370463119438138, 0.45198716135459, 0.4663484441296792, 0.4801284784104039, 0.493331154988695, 0.5059642033592732, 0.5180378718465838, 0.5295639533835708, 0.5405551006104303, 0.551024379193988, 0.5609850105413726, 0.5704502570782805, 0.5794334064652436, 0.5879478160261128, 0.5960069850588573, 0.6036246299995839, 0.6108147448976109, 0.617591636669938, 0.6239699306380746, 0.6299645466127732, 0.6355906491821102, 0.6408635779342502, 0.6457987642780003, 0.6504116415445036, 0.6547175544161533, 0.6587316726778263 ], [ 0.3329436818448048, 0.31280754994853477, 0.2932959407685975, 0.274828262061693, 0.25791669440336384, 0.24316245227569622, 0.23122549456613267, 0.2227538836149424, 0.21827156251585797, 0.21805277343497173, 0.22203977560881036, 0.22985213760750905, 0.2408838011073111, 0.2544351578408862, 0.2698244398251132, 0.2864536120229318, 0.30383281065959694, 0.32157862145225957, 0.3394001910029988, 0.35708198666007074, 0.37446753528676796, 0.3914457248791254, 0.40793988694793903, 0.4238993252275513, 0.4392928090282811, 0.454103576497373, 0.46832547938542446, 0.48195999444254867, 0.4950139060670978, 0.5074975239290608, 0.5194233386614842, 0.5308050421583034, 0.5416568513440279, 0.551993080083321, 0.5618279068873829, 0.5711752888028924, 0.580048975745557, 0.5884625850197551, 0.5964297026362134, 0.6039639857158088, 0.6110792480418817, 0.6177895180466908, 0.6241090647033257, 0.6300523916582668, 0.6356342033917567, 0.6408693493012809, 0.6457727525457977, 0.6503593305046139, 0.6546439130548413, 0.6586411638037247 ], [ 0.33518051158610257, 0.3150157951982474, 0.29546921940961884, 0.2769663771875573, 0.2600266843071516, 0.2452589005974682, 0.23332965671671654, 0.22489132641077544, 0.2204685233484918, 0.22033217886081233, 0.22441818423341653, 0.23233830610367162, 0.24347862848970275, 0.2571323545740205, 0.27261148372072747, 0.28931285536047313, 0.30674270440704027, 0.3245149997216828, 0.34233753455665794, 0.35999459097857983, 0.3773305303811619, 0.39423591532663255, 0.410636397665894, 0.4264840524400417, 0.4417506876374644, 0.45642268432047983, 0.4704970047927469, 0.483978096606877, 0.49687549670436393, 0.5092019968721125, 0.5209722697713098, 0.5322018777359863, 0.5429065989441818, 0.5531020118008565, 0.5628032819612856, 0.5720250997886307, 0.5807817205087477, 0.5890870653173521, 0.5969548489866603, 0.6043987075294458, 0.6114323075114166, 0.6180694260210585, 0.624323996634823, 0.6302101216806185, 0.6357420546226048, 0.6409341585407712, 0.6458008476442135, 0.6503565187827507, 0.6546154792721581, 0.6585918762763228 ], [ 0.3376283764866972, 0.31746475015960623, 0.2979171000947394, 0.27941684859261057, 0.26248962124875397, 0.2477497478700662, 0.23586742606552877, 0.227495292415163, 0.22315445429168385, 0.22310957316861818, 0.22728960131156806, 0.23530047892994757, 0.24652401427080892, 0.2602501011239476, 0.2757877466529918, 0.2925309185999344, 0.30998328065007563, 0.3277568180482233, 0.3455581410903572, 0.36317123506883714, 0.3804410253888655, 0.39725939865873594, 0.4135539471023173, 0.42927914051479055, 0.4444094738840817, 0.45893415788061925, 0.4728529979608823, 0.48617319393500935, 0.49890686506913, 0.5110691603270471, 0.5226768499966132, 0.5337473172513598, 0.5442978805501077, 0.5543453843233063, 0.5639059994733674, 0.5729951791189052, 0.5816277199901184, 0.5898178863151747, 0.5975795606920026, 0.6049263947394141, 0.6118719405798337, 0.6184297517977582, 0.6246134489789716, 0.6304367499996724, 0.6359134688273077, 0.6410574887969406, 0.645882717327532, 0.6504030290909973, 0.6546322040114687, 0.6585838654083874 ], [ 0.3402987808428999, 0.3201680269000701, 0.30065521172373616, 0.2821970907751374, 0.26532429955659154, 0.250654567093546, 0.2388583761286579, 0.2305844845691192, 0.22634636837297786, 0.2263996557552446, 0.23066604733073576, 0.23874785520885247, 0.2500263407596361, 0.2637920579466446, 0.27935432671552535, 0.2961065491050056, 0.3135511869092007, 0.3312988987771408, 0.34905529163352406, 0.36660394067432894, 0.38379005572529623, 0.40050648317975734, 0.4166823585518883, 0.43227414991440033, 0.44725866523427865, 0.4616276072397653, 0.4753833317024459, 0.48853554633991075, 0.5010987571858111, 0.5130903213141499, 0.5245289999198642, 0.5354339273295591, 0.5458239237101656, 0.5557170859916961, 0.5651305959838793, 0.5740806890103186, 0.5825827317824206, 0.5906513650330991, 0.5983006743841612, 0.6055443614592981, 0.6123958957010415, 0.6188686350905998, 0.6249759105486775, 0.6307310739540033, 0.6361475133842056, 0.6412386414451294, 0.6460178636014876, 0.6504985335057057, 0.654693901713395, 0.6586170631306627 ], [ 0.34320377168230193, 0.32313952688534725, 0.3036991198150633, 0.28532398343489834, 0.26854837763974915, 0.25399107674313076, 0.2423194449480904, 0.2341742358544379, 0.23005736333913016, 0.2302129744487215, 0.23455550108975598, 0.2426859892471974, 0.25398891382825584, 0.2677594316470109, 0.2833104594753174, 0.3000371452017805, 0.31744214127103115, 0.3351354626792752, 0.35282191203408403, 0.37028455166583973, 0.38736859896397524, 0.4039674926201506, 0.4200115065562374, 0.4354586990737679, 0.4502878022748669, 0.4644926558414687, 0.47807785338389036, 0.4910553452165811, 0.5034418071095764, 0.5152566339641506, 0.5265204508746348, 0.5372540548068419, 0.5474777120787434, 0.5572107436902672, 0.5664713353047479, 0.5752765133786332, 0.5836422346708343, 0.5915835434497214, 0.599114758903695, 0.606249663984555, 0.6130016755069553, 0.6193839831883714, 0.6254096519946706, 0.6310916874023335, 0.6364430669321152, 0.6414767436359671, 0.6462056283219577, 0.6506425574332346, 0.6548002529281255, 0.6586912794979314 ], [ 0.346355465883832, 0.32639291877103405, 0.30706375848886164, 0.28881326662990237, 0.272177754164215, 0.25777452768560816, 0.24626437359499692, 0.2382760427259238, 0.23429627978890222, 0.23455571083001842, 0.23896178822117475, 0.24711674674145498, 0.25841195582546606, 0.2721509852763535, 0.2876535365781356, 0.30431877980565697, 0.321650960014872, 0.3392601602254854, 0.35685060785675804, 0.37420477289243126, 0.39116761825258256, 0.40763281478999963, 0.42353137126141743, 0.43882252452542037, 0.453486534188961, 0.467519010469283, 0.4809264581552611, 0.49372278852734836, 0.5059266123874177, 0.5175591739314928, 0.5286428170336818, 0.5391998954200832, 0.5492520498664475, 0.558819782454331, 0.5679222628873694, 0.5765773068302708, 0.5848014722232013, 0.5926102268250399, 0.600018148595242, 0.607039129377965, 0.6136865610510397, 0.6199734912533282, 0.6259127425666172, 0.6315169943517212, 0.6367988302562506, 0.6417707568083353, 0.6464451996779033, 0.6508344843764324, 0.654950807648253, 0.6588062048401329 ], [ 0.34976556670407205, 0.32994110609714095, 0.31076285504644424, 0.29267893541342993, 0.2762259570435654, 0.26201712404938454, 0.2507032061218964, 0.2428971882461532, 0.23906746973986434, 0.23942958281123528, 0.24388457920781692, 0.25203835251877543, 0.26329266779162097, 0.27696309619737813, 0.29237915356049266, 0.30894623942448884, 0.32617159119137984, 0.34366610291091987, 0.3611336958327027, 0.37835620352028737, 0.3951780989360651, 0.41149294259623576, 0.4272320845999449, 0.442355532588437, 0.4568446758169054, 0.47069652308905885, 0.4839191546095902, 0.496528149058837, 0.5085438035662951, 0.5199890077985866, 0.5308876634414035, 0.5412635593552738, 0.5511396239896585, 0.5605374835208349, 0.5694772592879845, 0.5779775432554481, 0.5860554963996462, 0.5937270223630153, 0.6010069771777792, 0.6079093847921316, 0.6144476368912507, 0.6206346635136172, 0.6264830677857295, 0.6320052234871877, 0.637213338045752, 0.6421194860307123, 0.646735619451103, 0.6510735614218413, 0.65514498930467, 0.6589614125193537 ], [ 0.35344487975609684, 0.33379569658335023, 0.31480836062589423, 0.296932648799688, 0.2807035599086684, 0.2667274892165072, 0.2556418535515839, 0.24804044355061014, 0.24437064754267485, 0.24483182186204863, 0.24931944625235236, 0.2574454787323644, 0.26862531512765636, 0.28218982354203076, 0.2974811569072585, 0.31391305541000325, 0.3309971363635049, 0.34834588090404356, 0.3656632212752335, 0.3827303567600291, 0.39939107227489173, 0.415538502879028, 0.4311039649481305, 0.44604784014102766, 0.46035225441977634, 0.4740152430763481, 0.4870461216018837, 0.49946183470564604, 0.511284106666766, 0.5225372564223432, 0.5332465689657045, 0.5434371326574987, 0.5531330629596047, 0.5623570399116439, 0.5711300918617372, 0.5794715632439263, 0.5873992104780008, 0.5949293775882672, 0.602077211641363, 0.6088568870553354, 0.6152818166088546, 0.621364835010648, 0.6271183477480933, 0.6325544433736439, 0.6376849713387814, 0.6425215900256872, 0.6470757909404579, 0.6513589053630535, 0.65538209936382, 0.6591563622496459 ], [ 0.3574028414112476, 0.33796648873177826, 0.3192099056220111, 0.3015831743059907, 0.2856176481712658, 0.2719101964599084, 0.2610817338934155, 0.25370384737764684, 0.25020080870074873, 0.25075519856010536, 0.2552579461010596, 0.2633293397154017, 0.2744013061201971, 0.2878229598363209, 0.30295167035305093, 0.31921151213749194, 0.33611984881264245, 0.3532915579985689, 0.3704309544316186, 0.38731866049710595, 0.40379762201532565, 0.4197602698304393, 0.4351375378171303, 0.4498898026344625, 0.4639995447263106, 0.4774654586852809, 0.49029775524560965, 0.5025144398803196, 0.5141383977539994, 0.5251951513624579, 0.5357111833093757, 0.545712733647816, 0.5552249916726206, 0.5642716087406888, 0.572874463918841, 0.5810536196097271, 0.5888274106420981, 0.5962126178493362, 0.603224685649885, 0.6098779520666591, 0.6161858683727215, 0.6221611935705795, 0.6278161557824149, 0.6331625781027832, 0.6382119704710902, 0.642975591731129, 0.647464487436543, 0.6516895093730887, 0.6556613224618275, 0.6593904039338122 ], [ 0.36164707491393666, 0.3424609944885796, 0.32397430232144425, 0.30663589371689953, 0.29097136176152205, 0.27756538948522086, 0.2670195074883453, 0.2598805736956498, 0.25654821670565897, 0.2571880889162646, 0.26168771720344663, 0.26967778093289707, 0.2806092517716009, 0.29385205715757934, 0.3087810928886259, 0.32483262640039323, 0.3415311038610614, 0.3584946404465449, 0.3754283629750784, 0.3921124364964351, 0.40838887188132317, 0.42414916142677955, 0.43932354132948526, 0.4538720283625605, 0.46777709147029567, 0.4810377270882403, 0.49366470547686786, 0.5056767874544139, 0.5170977489964481, 0.5279540837537975, 0.5382732774147008, 0.5480825636601113, 0.5574080814070778, 0.5662743595578378, 0.5747040606776229, 0.5827179203941232, 0.5903348256466364, 0.5975719824134424, 0.6044451319699082, 0.610968783576878, 0.617156440181192, 0.6230208016851405, 0.6285739371968823, 0.6338274231647262, 0.638792448348152, 0.643479889253532, 0.6479003611325657, 0.6520642501380537, 0.6559817320096908, 0.6596627819694675 ], [ 0.36618299069559396, 0.34728401808621695, 0.3291051185731755, 0.31209239687063284, 0.2967635424894939, 0.2836885191263857, 0.2734469292776172, 0.26655890283309264, 0.2633984678867854, 0.26411458836209173, 0.26859259704519794, 0.2764753676855706, 0.2872350123654053, 0.3002644327567485, 0.31495807274137144, 0.3307661015703114, 0.3472213441261713, 0.3639460217634638, 0.3806465620637679, 0.3971028590599174, 0.4131559544647021, 0.4286962190898256, 0.4436529165433757, 0.4579853789631339, 0.4716757193394434, 0.48472289285750914, 0.4971379020007964, 0.5089399609795293, 0.5201534658901847, 0.5308056452313438, 0.540924786808038, 0.5505389515959699, 0.559675094492404, 0.5683585181793717, 0.5766125914651972, 0.5844586688130111, 0.5919161540518971, 0.5990026586820586, 0.6057342134968727, 0.6121255009716559, 0.6181900844443156, 0.6239406180100393, 0.6293890278666769, 0.6345466613361204, 0.6394244038690222, 0.6440327670741501, 0.6483819523607339, 0.652481895365524, 0.6563422962036721, 0.6599726399758009 ], [ 0.371013447100048, 0.3524373104610063, 0.3346023448004871, 0.3179501876485736, 0.30298851019149375, 0.2902702180249398, 0.2803508358793827, 0.27372231030190847, 0.2707326468768586, 0.27151468682736857, 0.2759527749715133, 0.2837034901659437, 0.29426174723276455, 0.3070451692112366, 0.321469470308267, 0.3370002672417054, 0.3531800082823168, 0.36963591017195685, 0.3860762470034735, 0.40228089684032065, 0.4180899641764412, 0.433392572463606, 0.4481167839523368, 0.4622209570823918, 0.47568653098067654, 0.4885120953176552, 0.5007085698749345, 0.512295327294993, 0.5232971156261484, 0.5337416607721414, 0.5436578476533075, 0.5530743919895817, 0.5620189232847455, 0.5705174056015136, 0.5785938277422885, 0.5862700997213778, 0.5935660986107525, 0.6004998141301104, 0.6070875525096395, 0.6133441657212839, 0.6192832816067392, 0.6249175182181242, 0.6302586724355095, 0.6353178783924722, 0.6401057353415451, 0.6446324073763507, 0.6489076990480125, 0.6529411115838778, 0.65674188437619, 0.6603190258924045 ], [ 0.3761384858772717, 0.3579193157565641, 0.34046217232865905, 0.32420252023750856, 0.30963598395396597, 0.2972963261621563, 0.287713276643836, 0.2813496805690644, 0.27852758111425896, 0.27936451700238657, 0.2837449968485956, 0.29134050422867586, 0.3016699880578329, 0.3141771285648069, 0.3283003274245175, 0.3435220191591624, 0.3593954554969465, 0.3755537484192448, 0.39170761612327776, 0.4076372436378765, 0.4231818986455242, 0.43822939257020316, 0.4527064085728733, 0.4665700829809014, 0.47980089436922646, 0.4923967657202837, 0.5043682354046529, 0.5157345499751292, 0.5265205468699429, 0.5367542135708435, 0.5464648255038977, 0.5556815764690018, 0.5644326232550355, 0.5727444717435516, 0.5806416366591447, 0.5881465122796704, 0.5952793974855194, 0.6020586256512324, 0.6085007578500234, 0.6146208062145685, 0.6204324625542054, 0.6259483149780009, 0.6311800419304019, 0.636138578471976, 0.6408342537428056, 0.6452769013727004, 0.6494759462920117, 0.653440472152991, 0.6571792736246862, 0.6607008974022196 ], [ 0.38155515350237473, 0.36372502168956816, 0.3466768944342094, 0.33083837510863356, 0.3166911542232463, 0.3047480685588787, 0.2955117864514314, 0.2894156428766502, 0.2867561943855521, 0.2876366811261099, 0.2919428326468472, 0.29936192344671403, 0.30943775376874005, 0.32164099898997384, 0.33543386049116464, 0.3503167750523777, 0.365854898899825, 0.38168813703436283, 0.39753029280271324, 0.41316224525019707, 0.42842259406450883, 0.4431978375684954, 0.45741315683904166, 0.4710242625247983, 0.4840104213926973, 0.4963686156382986, 0.5081087233950539, 0.5192495943807064, 0.5298159014921756, 0.5398356623006806, 0.5493383369512644, 0.5583534186864653, 0.5669094401616077, 0.5750333239148514, 0.5827500099796027, 0.5900822986201879, 0.5970508520696606, 0.6036743060741698, 0.6099694497930921, 0.6159514407514196, 0.6216340295927895, 0.6270297768656213, 0.6321502506177429, 0.6370061989401551, 0.641607695695191, 0.6459642605221997, 0.6500849559659653, 0.6539784654119919, 0.6576531556589702, 0.6611171276319296 ], [ 0.38725741498368993, 0.36984591956360124, 0.35323493365820396, 0.33784257440446136, 0.32413490038695986, 0.3126023746323413, 0.30371978657978166, 0.297891015747312, 0.2953879498865369, 0.2963006527375174, 0.3005170096649759, 0.30774067049956966, 0.3175407188108189, 0.3294153877996678, 0.34285149179242563, 0.35736846008372875, 0.3725443604734994, 0.3880267717709525, 0.40353325568230686, 0.41884582977986434, 0.4338026604333164, 0.44828899582894444, 0.46222844899886106, 0.4755751494417733, 0.48830693988739116, 0.5004196183139147, 0.5119221470977248, 0.5228327253376404, 0.5331756190173388, 0.5429786513187074, 0.5522712645563548, 0.5610830729614014, 0.569442831434688, 0.5773777500400944, 0.5849130883355025, 0.5920719684221343, 0.5988753512856647, 0.6053421276982112, 0.6114892824441155, 0.6173320985271619, 0.6228843758379906, 0.6281586460550699, 0.6331663719593016, 0.637918124628416, 0.6424237360464137, 0.6466924275412653, 0.6507329162710374, 0.6545535028959226, 0.6581621438112101, 0.6615665110848883 ], [ 0.3932361618330472, 0.3762700732234872, 0.3601209908520632, 0.34519602699776625, 0.33194413824436664, 0.32083231863819134, 0.31230709067957807, 0.3067433383775321, 0.3043893652118944, 0.30532324158365387, 0.3094358055730304, 0.3164473874700991, 0.32595243880086905, 0.33747696802335975, 0.3505329281521135, 0.36465953183140676, 0.3794486571680629, 0.394556404331321, 0.40970478512495134, 0.4246774483171971, 0.43931242248155167, 0.4534938310619081, 0.4671437108424701, 0.4802145049108639, 0.492682461573768, 0.5045419849054351, 0.515800892393809, 0.5264764986582199, 0.536592434740131, 0.546176114544268, 0.5552567656096632, 0.5638639470291387, 0.5720264820388534, 0.5797717368047085, 0.5871251808896769, 0.5941101694080562, 0.6007478923224647, 0.6070574427756822, 0.6130559635667903, 0.6187588384995933, 0.6241799028989432, 0.629331654674054, 0.6342254535583238, 0.6388717013442465, 0.6432799999606879, 0.6474592871260519, 0.6514179511641763, 0.6551639275598758, 0.658704780156865, 0.6620477697637627 ], [ 0.3994793108315019, 0.3829822900148254, 0.36731630414821514, 0.35287608560332107, 0.3400922740006093, 0.3294076536564669, 0.3212404870386546, 0.31593746200759215, 0.31372457653487273, 0.314669104021918, 0.31866548869375483, 0.3254507972601131, 0.3346446301645714, 0.34580067893480265, 0.35845629024400055, 0.37217105006790313, 0.38655142452127866, 0.4012628329352883, 0.4160324322587774, 0.43064603178402117, 0.444941871358232, 0.45880313385270977, 0.4721503284131301, 0.48493415750768465, 0.4971291483707798, 0.5087281376574364, 0.5197375978604591, 0.5301737478392737, 0.5400593725835373, 0.5494212738669306, 0.558288275392043, 0.5666897094114147, 0.5746543151976378, 0.5822094829939513, 0.5893807805893079, 0.5961917038690042, 0.602663597860779, 0.6088157009446676, 0.6146652718126325, 0.6202277660855797, 0.6255170367898167, 0.6305455397481861, 0.6353245310170296, 0.6398642485754874, 0.6441740744473191, 0.6482626763179752, 0.6521381296000173, 0.6558080219561946, 0.6592795426992459, 0.6625595594423856 ], [ 0.4059719856469438, 0.3899643815060249, 0.3747990003352663, 0.3608569927748227, 0.34854973671584083, 0.3382954081952438, 0.33048436617749444, 0.32543617280716974, 0.32335592737195806, 0.32430127838981426, 0.3281707888419005, 0.3347181031719904, 0.3435874945774571, 0.3543599750685371, 0.3665982904437327, 0.3798827919119783, 0.39383518026112285, 0.40813092635509474, 0.42250301475013, 0.43673996816724814, 0.4506806311090085, 0.46420748325372, 0.47723960891351735, 0.48972596627290554, 0.5016392794406662, 0.5129706819743772, 0.5237251323776567, 0.5339175673169035, 0.5435697338407616, 0.5527076330219949, 0.5613595056984879, 0.5695542920188433, 0.5773204984591139, 0.5846854083917298, 0.5916745752799346, 0.5983115414084923, 0.6046177299105369, 0.6106124636832079, 0.6163130713814675, 0.6217350476859208, 0.6268922420446071, 0.6317970566949173, 0.636460640656862, 0.6408930713350828, 0.645103519271644, 0.6491003944584341, 0.652891474535612, 0.6564840163173983, 0.6598848525748648, 0.6631004760487187 ], [ 0.41269676965051655, 0.3971954977969805, 0.3825445174027922, 0.3691103897121464, 0.3572845595796876, 0.34746051445961224, 0.3400013639594722, 0.33520081931246004, 0.33324455831776784, 0.33418172471380564, 0.3379153806198827, 0.34421541102273173, 0.3527500753644842, 0.36312711403057374, 0.37493445276772336, 0.387773408861677, 0.4012814268132254, 0.4151446821033417, 0.4291026411409231, 0.4429471026144538, 0.456517942672498, 0.46969722116888235, 0.48240275039151015, 0.49458178925629526, 0.5062052210540418, 0.5172623792247334, 0.5277565718554852, 0.5377012936331116, 0.547117082955023, 0.5560289679083635, 0.564464439440319, 0.5724518886592477, 0.580019445651033, 0.5871941586773982, 0.594001455022141, 0.6004648281644707, 0.6066057004494614, 0.6124434159157177, 0.6179953241963049, 0.6232769230840997, 0.6283020340518569, 0.633082991361998, 0.6376308310809087, 0.6419554711153665, 0.6460658772110576, 0.6499702126922811, 0.6536759716567074, 0.6571900965044101, 0.660519081241154, 0.6636690621232355 ], [ 0.419634015690191, 0.4046525168961863, 0.39052607539948964, 0.37760586141244623, 0.3662629815464177, 0.35686643996777717, 0.3497529939409473, 0.3451919210890056, 0.34335097715774515, 0.34427185010966926, 0.34786236183252606, 0.3539081576887055, 0.3621006314300845, 0.37207347096599924, 0.3834393654948634, 0.39582061912265065, 0.4088707886920482, 0.42228731685357124, 0.4358167633986216, 0.44925476110934465, 0.46244266676973944, 0.475262441248182, 0.4876308220481209, 0.49949345936345474, 0.5108194010043096, 0.5215961218640048, 0.5318251765123492, 0.5415184857845303, 0.550695231452451, 0.559379314317864, 0.5675973221589456, 0.5753769501597121, 0.5827458153187359, 0.5897306068098517, 0.5963565160071076, 0.6026468928231138, 0.6086230791048389, 0.6143043749522089, 0.6197080997215401, 0.6248497158053432, 0.6297429896615138, 0.6344001706358106, 0.6388321735833583, 0.6430487559416735, 0.6470586836353177, 0.6508698829922477, 0.6544895777936365, 0.6579244117862039, 0.6611805576123472, 0.6642638133193645 ], [ 0.426762197204197, 0.4123104698880706, 0.39871517303375675, 0.38631149338878273, 0.3754500440582118, 0.36647579858691387, 0.3597002476375682, 0.35536974010079453, 0.35363559292066077, 0.3545330044810558, 0.35797471193781794, 0.3637615311806792, 0.37160701443646116, 0.3811698667381672, 0.3920869555256023, 0.40400142666182864, 0.41658317861205385, 0.4295413850956795, 0.4426302554577033, 0.4556497968532689, 0.4684433057625755, 0.48089299298714366, 0.49291475622862735, 0.5044527687504163, 0.5154742888777889, 0.5259649121659783, 0.5359243699297142, 0.5453629058891135, 0.5542982210614207, 0.5627529540020139, 0.5707526512697225, 0.5783241768161613, 0.5854945062596044, 0.5922898514186333, 0.5987350615037274, 0.604853249777895, 0.6106655981610224, 0.616191296980456, 0.6214475825907175, 0.6264498415565383, 0.6312117561465183, 0.6357454716713028, 0.6400617714332022, 0.6441702495334953, 0.6480794754050969, 0.6517971466880025, 0.655330229003451, 0.6586850824230291, 0.6618675751132446, 0.6648831849148048 ], [ 0.434058284840694, 0.42014298324677557, 0.40708208926010697, 0.39519441835706215, 0.38481016201791246, 0.3762509223195639, 0.3698041468510111, 0.3656948014042793, 0.3640592019453138, 0.3649269349219268, 0.36821571851116897, 0.37374086961206593, 0.3812370363363093, 0.3903868973679321, 0.40085077322368007, 0.41229235749573323, 0.4243979848581313, 0.4368889205748368, 0.4495275140904292, 0.46211865715941, 0.4745080434151691, 0.48657850078042914, 0.4982453524003078, 0.5094514624213831, 0.5201623830378054, 0.530361845518775, 0.5400477208674592, 0.5492285011362307, 0.5579203069358876, 0.56614439992806, 0.5739251638117493, 0.5812885088652345, 0.5882606507661938, 0.5948672127327037, 0.6011326002895611, 0.6070795998125075, 0.6127291552032895, 0.6181002813603607, 0.6232100782387265, 0.6280738148946151, 0.6327050586264364, 0.6371158298171632, 0.6413167680782578, 0.645317299597213, 0.6491257990955982, 0.6527497424936054, 0.6561958483025117, 0.6594702070307862, 0.6625783986241197, 0.665525598304528 ], [ 0.44149813352897566, 0.42812272137925245, 0.4155963719705356, 0.40422133533165394, 0.394307653125046, 0.3861543805601349, 0.38002623750473374, 0.3761283546502525, 0.3745834183456217, 0.3754161910197579, 0.3785493630104811, 0.38381202920537133, 0.39095881650794323, 0.399695253683283, 0.4097042771336372, 0.42066970370744766, 0.4322942719405589, 0.4443115942369118, 0.45649257747488486, 0.4686474676792097, 0.48062480057131085, 0.49230839686756805, 0.5036132927368309, 0.5144812411281721, 0.5248762047395421, 0.5347800989001565, 0.544188928564378, 0.5531093877928176, 0.5615559417605757, 0.5695483814781429, 0.577109823414019, 0.584265115632888, 0.5910396061690949, 0.5974582265708607, 0.6035448430218084, 0.6093218286974873, 0.614809813724827, 0.6200275729886806, 0.6249920167533608, 0.6297182542909459, 0.6342197060793782, 0.638508245327165, 0.6425943543308575, 0.6464872852874612, 0.6501952185628124, 0.6537254140357023, 0.657084353040305, 0.6602778697088453, 0.6633112712931738, 0.6661894474480577 ], [ 0.44905686649004584, 0.43622181494808254, 0.4242272993755704, 0.4133589879151813, 0.4039072145833771, 0.3961494385353131, 0.3903290191402581, 0.38663277210025904, 0.3851710450252367, 0.3859644766833715, 0.388940660295761, 0.39394171436237035, 0.4007411002182394, 0.4090660220637778, 0.4186211092703215, 0.4291097663633325, 0.440250986700532, 0.45179088214517327, 0.4635092563167382, 0.4752221301421076, 0.4867813040896944, 0.49807196646905333, 0.50900916835568, 0.519533773177869, 0.5296082993842478, 0.5392129248166639, 0.5483418119875214, 0.5569998378359902, 0.565199761362128, 0.5729598302311675, 0.5803018071057591, 0.5872493839568863, 0.5938269452331819, 0.6000586368959068, 0.6059676969944126, 0.6115760040891515, 0.6169038020286436, 0.6219695630115537, 0.6267899551729743, 0.6313798857723434, 0.6357525960816588, 0.6399197889612591, 0.6438917746081102, 0.6476776238843615, 0.6512853218786095, 0.654721916891796, 0.6579936619106944, 0.6611061469175983, 0.6640644211956215, 0.6668731052451948 ], [ 0.45670924472409696, 0.4444122633882684, 0.4329443033019271, 0.4225745927830283, 0.41357434062766346, 0.4062004509290752, 0.4006763081039393, 0.39717188228169026, 0.39578638445986497, 0.39653694699475256, 0.3993559491434451, 0.4040977655168212, 0.41055354263630334, 0.4184709593162949, 0.42757535335472535, 0.43758908964622556, 0.4482471626681424, 0.4593082370427826, 0.4705612722764202, 0.48182842948213833, 0.4929651659634908, 0.5038584029575104, 0.5144235148111381, 0.5246007143488232, 0.5343512445659938, 0.5436536506905593, 0.552500303246238, 0.5608942685824719, 0.5688465722918219, 0.5763738668436494, 0.5834964925048443, 0.5902369064104803, 0.5966184459106947, 0.6026643874002185, 0.6083972597054919, 0.6138383711072405, 0.6190075107513496, 0.6239227881627274, 0.6286005784611445, 0.6330555453257417, 0.637300718422432, 0.6413476065881915, 0.6452063323076545, 0.6488857767412352, 0.6523937276673384, 0.6557370251533879, 0.6589217016011566, 0.661953114095298, 0.6648360678207734, 0.6675749298157185 ], [ 0.4644300128226121, 0.45266630299347677, 0.441717347131379, 0.4318362131513058, 0.42327567807480543, 0.41627319013707836, 0.41103353544984406, 0.40771124099568185, 0.4063954908066461, 0.4071004508475065, 0.4097631332901798, 0.41424940282816675, 0.420366954926497, 0.4278827368528263, 0.4365417701909594, 0.4460846799310036, 0.4562621164432271, 0.46684525779666725, 0.4776323986806056, 0.4884521462067017, 0.49916396937159674, 0.5096568706393242, 0.5198468551381668, 0.5296737348057101, 0.5390976642742391, 0.548095683419512, 0.5566584451631008, 0.5647872354969061, 0.5724913416902163, 0.5797857894201519, 0.586689445818214, 0.593223469776594, 0.5994100808950822, 0.6052716125462237, 0.6108298116276926, 0.6161053469462011, 0.6211174893222892, 0.6258839289981211, 0.6304206993865598, 0.6347421802542258, 0.6388611577432605, 0.642788922905448, 0.6465353944044476, 0.6501092545621316, 0.6535180908810487, 0.6567685375326896, 0.659866413083835, 0.6628168520063101, 0.6656244283703339, 0.6682932706597972 ], [ 0.47219421431125985, 0.46095673477387855, 0.45051725423983846, 0.44111307521125853, 0.4329793200926227, 0.4263351111900791, 0.4213679827466996, 0.41821834322294626, 0.41696636657080444, 0.41762372180756946, 0.42013187432024357, 0.4243674256869615, 0.43015351094153104, 0.43727515129907396, 0.4454960061668733, 0.45457420503091306, 0.4642756310223052, 0.4743838517538232, 0.48470659897168283, 0.4950791700787825, 0.5053653584347964, 0.5154565726215106, 0.5252697485676242, 0.5347445516942816, 0.5438402483970373, 0.552532518624173, 0.5608103928022552, 0.5686734281920801, 0.5761291895988258, 0.5831910636416492, 0.5898764109871943, 0.5962050441398042, 0.6021980073541443, 0.607876628434191, 0.6132618085351216, 0.6183735148462371, 0.6232304416510125, 0.6278498072835207, 0.6322472575277446, 0.6364368496674306, 0.6404310953508516, 0.6442410443925969, 0.6478763953556862, 0.6513456220707716, 0.6546561080530151, 0.6578142830341581, 0.6608257575545394, 0.6636954528148437, 0.6664277238526378, 0.6690264746768859 ], [ 0.4799774719715501, 0.46925720882075883, 0.4593159854427943, 0.4503758280518505, 0.4426550406103439, 0.4363555572067805, 0.43164896041565765, 0.4286627806584592, 0.42746910815673106, 0.42807752078222494, 0.4304337390073197, 0.4344243694786396, 0.43988691466208535, 0.4466233003527009, 0.45441477249742174, 0.46303617031018734, 0.4722681222091568, 0.4819063859651181, 0.49176815898809234, 0.5016956115735595, 0.5115571286404976, 0.5212468212825195, 0.5306828429782672, 0.5398049659811389, 0.5485717765232471, 0.5569577539414197, 0.5649504186007306, 0.5725476694893499, 0.5797553837536062, 0.5865853148059735, 0.5930533002126931, 0.5991777728809808, 0.6049785571528732, 0.6104759238144484, 0.615689873696489, 0.6206396177159694, 0.6253432213100524, 0.6298173827730672, 0.6340773176087053, 0.6381367242802679, 0.6420078103455753, 0.6457013616110707, 0.6492268403997834, 0.6525925021325888, 0.6558055220700928, 0.6588721262133731, 0.6617977220272385, 0.664587025879584, 0.667244184958752, 0.6697728920218512 ], [ 0.48775623060028866, 0.47754246406120254, 0.46808686606737687, 0.45959674949010343, 0.4522744733432847, 0.4463059104001716, 0.44184793407425477, 0.4390163502748037, 0.43787600526435605, 0.43843473479916373, 0.4406423045966585, 0.4443946221229812, 0.44954252978516124, 0.45590372409283225, 0.46327599424537524, 0.4714500697017944, 0.4802207854282748, 0.48939582419587885, 0.49880180989668366, 0.5082879080748196, 0.517727315211686, 0.5270171090250279, 0.5360769291977552, 0.5448469020735986, 0.5532851449634705, 0.5613651056157798, 0.5690729206317301, 0.5764049172901173, 0.5833653367831506, 0.5899643218318973, 0.5962161860037923, 0.6021379637797819, 0.6077482278083293, 0.6130661515040544, 0.618110790197091, 0.6229005516605945, 0.6274528264499609, 0.6317837495930196, 0.6359080673541707, 0.6398390856812922, 0.6435886801995728, 0.6471673509576485, 0.6505843083318447, 0.6538475793897686, 0.6569641265038488, 0.6599399720459607, 0.6627803245922514, 0.6654897032655569, 0.6680720577073151, 0.6705308817779543 ], [ 0.4955079613797393, 0.48578852401417044, 0.4768047648633188, 0.4687499015486793, 0.46181124037624033, 0.45615969429840275, 0.45193860475444864, 0.4492531195886352, 0.4481615993688719, 0.44867043656864536, 0.450733226041148, 0.4542545036249559, 0.45909747377600585, 0.46509451301513005, 0.4720589293179119, 0.4797965108356136, 0.48811572134402426, 0.49683584757906024, 0.5057928393528248, 0.5148429223426098, 0.523864277087698, 0.5327571772331399, 0.541442995392774, 0.549862448796363, 0.5579733958912739, 0.5657484275849127, 0.5731724334501096, 0.5802402689199823, 0.5869546056429459, 0.5933240131898044, 0.599361294810845, 0.6050820813557471, 0.6105036743532352, 0.6156441204112328, 0.6205214936042247, 0.6251533596294964, 0.6295563946510226, 0.6337461324193125, 0.6377368150328542, 0.6415413252166446, 0.6451711809069608, 0.648636575970895, 0.6519464538327147, 0.655108603465845, 0.6581297695385944, 0.6610157704285683, 0.6637716193463828, 0.6664016449700573, 0.6689096088457716, 0.6712988174272226 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.43413763772696257, 0.19730751444756675, 0.19751679738611722, 0.21355282102645884, 0.23448520715756652, 0.25733623957826796, 0.19975427627456266, 0.15077880591433257, 0.18984569124974923, 0.09971548764326511, 0.1167240189855746, 0.5144911119714379, 0.12160781534632646, 0.143296294622118, 0.15764270578649853, 0.1603766378738894, 0.8116078386083245, 0.14312737341970205, 0.6365205738693476, 0.6417205417528749, 0.24426917104196152, 0.15374109356462698, 0.15414987463767546, 0.18579529988746893 ], "xaxis": "x", "y": [ 0.9719485333189368, 0.4652114945789433, 0.5072600635782516, 0.4002120972197617, 0.31790447256867355, 0.24379007088567353, 0.23203501998954595, 0.16708629284851223, 0.1955648537399401, 0.10959977840281686, 0.16990319663011166, 0.3260774752125144, 0.20717603832193046, 0.1313050531769679, 0.05095136177245756, 3.7236782755712533e-16, 0.6973032038658857, 0.3258649166673422, 0.27098294999450445, 0.778496784158051, 0.207305280478096, 0.5089794914442768, 0.4404732501049041, 0.44488964434776357 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.43413763772696257, 0.19730751444756675, 0.19751679738611722, 0.21355282102645884, 0.23448520715756652, 0.25733623957826796, 0.19975427627456266, 0.15077880591433257, 0.18984569124974923, 0.09971548764326511, 0.1167240189855746, 0.5144911119714379, 0.12160781534632646, 0.143296294622118, 0.15764270578649853, 0.1603766378738894, 0.8116078386083245, 0.14312737341970205, 0.6365205738693476, 0.6417205417528749, 0.24426917104196152, 0.15374109356462698, 0.15414987463767546, 0.18579529988746893 ], "xaxis": "x2", "y": [ 0.9719485333189368, 0.4652114945789433, 0.5072600635782516, 0.4002120972197617, 0.31790447256867355, 0.24379007088567353, 0.23203501998954595, 0.16708629284851223, 0.1955648537399401, 0.10959977840281686, 0.16990319663011166, 0.3260774752125144, 0.20717603832193046, 0.1313050531769679, 0.05095136177245756, 3.7236782755712533e-16, 0.6973032038658857, 0.3258649166673422, 0.27098294999450445, 0.778496784158051, 0.207305280478096, 0.5089794914442768, 0.4404732501049041, 0.44488964434776357 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:04] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.1851875895108055, 1.1772633542066275, 1.169268066942522, 1.1612322608247314, 1.1531890698842533, 1.1451741429400706, 1.1372255168957983, 1.1293834464372028, 1.1216901874343712, 1.1141897318171616, 1.1069274923149528, 1.0999499362630938, 1.0933041687100655, 1.0870374663376217, 1.0811967652468835, 1.0758281074649003, 1.0709760530613175, 1.0666830669732412, 1.0629888919179793, 1.0599299209853361, 1.0575385854597135, 1.055842774912345, 1.0548653073980767, 1.0546234674769046, 1.0551286285965586, 1.0563859740468315, 1.058394327279013, 1.0611460980674765, 1.0646273461057725, 1.0688179586156377, 1.0736919338912074, 1.079217758862963, 1.0853588660987614, 1.092074154344037, 1.0993185567185086, 1.1070436418164549, 1.1151982348419782, 1.12372904811771, 1.1325813124185573, 1.1416994022692897, 1.1510274494099255, 1.1605099390310825, 1.1700922832081742, 1.17972136541933, 1.1893460493763002, 1.1989176448970627, 1.208390323430712, 1.2177214762630972, 1.2268720094436016, 1.2358065710395645 ], [ 1.1828859219087793, 1.1747470095545391, 1.1665296767273503, 1.158265226302887, 1.1499876987072155, 1.1417337912121108, 1.1335427352358776, 1.125456128254717, 1.1175177172233535, 1.1097731308303544, 1.102269558507475, 1.0950553749113774, 1.0881797096397172, 1.0816919632674615, 1.0756412724192073, 1.0700759285368917, 1.0650427572395542, 1.0605864676452916, 1.0567489836306896, 1.0535687715832194, 1.0510801815474218, 1.0493128205230227, 1.048290977764864, 1.0480331219935817, 1.048551489237617, 1.0498517774809648, 1.0519329604249184, 1.0547872277036687, 1.0584000532196332, 1.0627503874254565, 1.0678109639849027, 1.0735487068721223, 1.0799252210574761, 1.0868973486939653, 1.094417773111228, 1.1024356546432872, 1.1108972848777403, 1.1197467487541901, 1.1289265865268854, 1.1383784495357085, 1.14804374478047, 1.1578642634465963, 1.1677827879440041, 1.1777436709820397, 1.1876933790630886, 1.1975809918859894, 1.2073586487985686, 1.216981933813975, 1.2264101918691073, 1.2356067708869956 ], [ 1.1808395758509425, 1.1724949188394471, 1.1640643419106347, 1.155579873107491, 1.1470764134178275, 1.1385916621208005, 1.1301659988272728, 1.1218423184535098, 1.1136658156117727, 1.1056837152811778, 1.0979449471769662, 1.090499762011002, 1.0833992888790331, 1.076695034367122, 1.0704383256779764, 1.0646797021571608, 1.0594682620391436, 1.0548509739821657, 1.0508719659130048, 1.0475718066886184, 1.0449867988651942, 1.0431483031505402, 1.0420821165687502, 1.0418079266523084, 1.042338862815361, 1.043681163289778, 1.0458339716403369, 1.0487892711585596, 1.052531958840619, 1.0570400538480744, 1.062285029092928, 1.0682322496065253, 1.0748414981949959, 1.082067567808042, 1.0898609009625297, 1.0981682590511417, 1.1069334077841178, 1.116097808624874, 1.1256013092159518, 1.1353828279601774, 1.1453810288844088, 1.1555349826927608, 1.1657848087590912, 1.176072291113811, 1.186341459715734, 1.19653912691815, 1.206615368406305, 1.2165239382265858, 1.2262226089042279, 1.23567342994733 ], [ 1.1790689943176054, 1.1705290039285512, 1.1618955191299156, 1.1532012445966813, 1.1444818910807935, 1.1357761073391002, 1.1271253675691242, 1.1185738102290896, 1.1101680243067857, 1.1019567794266187, 1.0939906966895439, 1.0863218578786662, 1.0790033516910211, 1.0720887570315445, 1.065631565178308, 1.0596845448326593, 1.0542990567067214, 1.0495243273311974, 1.0454066950848835, 1.041988844874261, 1.0393090511649359, 1.037400451845156, 1.036290377286323, 1.035999759542166, 1.0365426455337512, 1.0379258350697622, 1.0401486596348195, 1.0432029113069359, 1.0470729235017124, 1.051735797301855, 1.057161759867579, 1.0633146357504324, 1.07015240853711, 1.0776278494357352, 1.0856891910354292, 1.094280827951058, 1.1033440305526663, 1.1128176625238468, 1.1226388967514012, 1.132743926435268, 1.1430686690756084, 1.1535494602333838, 1.164123732036824, 1.1747306688625498, 1.185311830068611, 1.1958117276745417, 1.2061783459256303, 1.2163635900125551, 1.226323652891995, 1.23601929200088 ], [ 1.1775939720116637, 1.168870553641932, 1.1600460529818954, 1.1511537994131493, 1.1422302582115609, 1.1333149694765443, 1.1244504415132752, 1.1156819941891674, 1.1070575479132714, 1.0986273541497922, 1.0904436638233876, 1.0825603306632687, 1.0750323475318448, 1.0679153151615044, 1.0612648445451225, 1.055135896541677, 1.0495820650871264, 1.0446548137133935, 1.0404026787769551, 1.0368704566978735, 1.034098396323342, 1.0321214208682512, 1.0309684062775508, 1.0306615437949997, 1.0312158135445673, 1.0326385927143087, 1.0349294164122789, 1.0380799017212308, 1.0420738365783075, 1.0468874258464718, 1.052489678513157, 1.0588429134979798, 1.0659033579348625, 1.0736218113764109, 1.0819443519179046, 1.0908130649813923, 1.100166781308514, 1.1099418163634645, 1.120072707795691, 1.1304929501691188, 1.1411357265928368, 1.1519346353769842, 1.162824406910437, 1.173741602337459, 1.184625282086228, 1.1954176295983236, 1.206064514282367, 1.2165159780805497, 1.2267266321222927, 1.2366559534965815 ], [ 1.176433400352496, 1.1675399508247408, 1.1585378844816923, 1.1494611007080866, 1.1403467602323178, 1.1312352313473326, 1.1221699896614377, 1.1131974665587716, 1.1043668416122088, 1.0957297743860648, 1.0873400714454347, 1.0792532850185113, 1.0715262407139052, 1.0642164930588336, 1.0573817094768359, 1.0510789857334513, 1.045364098883497, 1.0402907073427585, 1.0359095117932475, 1.0322673950278973, 1.029406563239444, 1.0273637152225321, 1.0261692689378337, 1.0258466762688259, 1.0264118559992506, 1.0278727716181453, 1.0302291743847805, 1.0334725234478772, 1.0375860844903368, 1.0425451975801234, 1.048317695126714, 1.0548644435135774, 1.0621399781750522, 1.0700932020374485, 1.0786681210037894, 1.0878045964876772, 1.0974391024168264, 1.1075054810749647, 1.117935697341495, 1.12866059353326, 1.1396106469497278, 1.150716729704498, 1.1619108662177347, 1.1731269787905423, 1.1843016069789172, 1.1953745829297842, 1.2062896431123877, 1.2169949573372079, 1.2274435585987091, 1.2375936617500656 ], [ 1.1756050023579352, 1.1665563874814866, 1.1573917455165645, 1.1481454890270766, 1.138855411970113, 1.1295626433528128, 1.1203115536237842, 1.1111496086560393, 1.1021271661751977, 1.0932972096095956, 1.0847150146449365, 1.0764377443264825, 1.068523969451498, 1.0610331123281467, 1.0540248138419794, 1.0475582262547911, 1.041691237324353, 1.036479635187299, 1.031976227921088, 1.0282299366120153, 1.0252848857793795, 1.0231795196577886, 1.0219457764861537, 1.0216083548603612, 1.0221841056461882, 1.0236815793459466, 1.0261007519359608, 1.0294329423293735, 1.0336609226728413, 1.0387592101330865, 1.0446945175001685, 1.051426331634543, 1.0589075848534915, 1.0670853852896247, 1.0759017775582111, 1.085294513351, 1.0951978209128201, 1.1055431707888794, 1.116260041189605, 1.1272766889247796, 1.1385209309839406, 1.1499209380121063, 1.1614060351265731, 1.1729074989475894, 1.1843593336090597, 1.1956990039734836, 1.2068681021147472, 1.2178129237714115, 1.2284849348623201, 1.238841113793504 ], [ 1.1751250617951527, 1.165937572642882, 1.1566268442545844, 1.14722774410379, 1.1377786347173826, 1.1283213347545178, 1.1189010321434572, 1.1095661438337843, 1.1003681166520283, 1.0913611637982714, 1.0826019317497346, 1.0741490928213342, 1.0660628594660775, 1.05840441768651, 1.0512352787866077, 1.0446165512298244, 1.0386081376695697, 1.0332678663189003, 1.0286505706785676, 1.024807137074694, 1.0217835451335213, 1.0196199317129933, 1.0183497131993515, 1.0179988035962326, 1.0185849655876569, 1.0201173280007718, 1.0225960954738549, 1.0260124649168827, 1.030348749573383, 1.035578696932941, 1.041667973659281, 1.048574781338546, 1.0562505628766643, 1.0646407613629563, 1.073685600456767, 1.0833208660062745, 1.0934786802049814, 1.1040882696783865, 1.115076735604531, 1.1263698363570298, 1.137892791223516, 1.149571108277115, 1.1613314317418606, 1.1731023956978937, 1.184815463225322, 1.1964057244145787, 1.2078126240587967, 1.2189805907750815, 1.2298595436657687, 1.2404052597350386 ], [ 1.1750081516632733, 1.1656994384140669, 1.1562605473567977, 1.1467267418197227, 1.1371368865276748, 1.1275334159235408, 1.1179622539762235, 1.1084726797601983, 1.099117132957917, 1.0899509534132126, 1.0810320490133085, 1.0724204865802585, 1.064178001210546, 1.056367420732475, 1.0490520037848778, 1.0422946925885297, 1.0361572848950196, 1.0306995339220932, 1.0259781902985292, 1.0220460059905463, 1.0189507265262372, 1.0167341040074154, 1.0154309685925031, 1.0150683993430403, 1.015665035466546, 1.0172305651150104, 1.019765420497989, 1.023260695368347, 1.0276982851167855, 1.0330512328970325, 1.0392842501586417, 1.0463543694712758, 1.054211683626753, 1.0628001283625, 1.0720582756672923, 1.0819201181002855, 1.0923158387359413, 1.1031725732211473, 1.114415177818221, 1.1259670192362707, 1.1377507987310247, 1.1496894154776816, 1.161706864210391, 1.1737291513990815, 1.1856852046003188, 1.1975077426666918, 1.20913407141633, 1.2205067707241937, 1.231574244611948, 1.2422911148415565 ], [ 1.1752668676582383, 1.1658558503349818, 1.1563080656325857, 1.1466591135055832, 1.1369482934822284, 1.1272185798815564, 1.1175165480336269, 1.1078922455453863, 1.0983990024605415, 1.0890931740688612, 1.0800338101923197, 1.071282245096839, 1.062901602856879, 1.0549562141641042, 1.0475109423670772, 1.0406304191080438, 1.03437819342471, 1.028815802706196, 1.0240017794432172, 1.0199906141623032, 1.0168317019461497, 1.0145683069178149, 1.0132365851131715, 1.0128647101294865, 1.013472146529011, 1.0150691120197353, 1.017656260226011, 1.0212246015610067, 1.025755661648449, 1.0312218574375887, 1.0375870539658627, 1.0448072530595691, 1.0528313616143177, 1.0616019921933793, 1.0710562611559666, 1.0811265662617684, 1.0917413427484708, 1.1028258105937554, 1.1143027335806939, 1.1260932119688296, 1.1381175255283875, 1.1502960338902517, 1.1625501285714333, 1.17480321779568, 1.1869817134528862, 1.199015981133984, 1.210841210594752, 1.2223981659448466, 1.233633782046626, 1.244501584776838 ], [ 1.1759115727250322, 1.1664183287240397, 1.1567821504200626, 1.147038915522337, 1.137228290566787, 1.1273937125181688, 1.117582320960299, 1.10784483470579, 1.0982353664081128, 1.088811168601566, 1.079632304593371, 1.070761237874319, 1.0622623343125563, 1.0542012724877168, 1.0466443592695034, 1.039657750318622, 1.033306578755064, 1.0276539999281442, 1.0227601660796917, 1.0186811516140484, 1.0154678573508047, 1.013164929914127, 1.0118097393334908, 1.0114314626900072, 1.0120503227320854, 1.0136770263719503, 1.0163124379318293, 1.0199475060086949, 1.0245634423480223, 1.0301321291276737, 1.0366167115831373, 1.0439723200902673, 1.0521468626540833, 1.0610818360057308, 1.070713119328975, 1.0809717350370014, 1.0917845811222535, 1.103075155086492, 1.1147642976264212, 1.1267709843605183, 1.1390131868171656, 1.1514088115285892, 1.163876710678176, 1.1763377417438192, 1.1887158393930382, 1.2009390528053296, 1.2129404974492908, 1.2246591730266083, 1.236040608424524, 1.247037308403542 ], [ 1.176950159086351, 1.1673957880310688, 1.1576928084144158, 1.1478773176056618, 1.1379892814704184, 1.1280725216935084, 1.1181746533216723, 1.1083469661791119, 1.0986442435130241, 1.089124511012289, 1.079848709275262, 1.0708802829713548, 1.062284680463064, 1.0541287586761077, 1.0464800896983413, 1.039406168144505, 1.0329735219359528, 1.0272467339737097, 1.0222873883106371, 1.0181529617844747, 1.0148956903490916, 1.0125614478947895, 1.0111886831333428, 1.0108074656866184, 1.0114386941242464, 1.0130935146394822, 1.015772988154853, 1.0194680258755222, 1.0241595902932388, 1.029819133841468, 1.0364092256008341, 1.0438843025982047, 1.0521914798656349, 1.061271363292011, 1.0710588289242253, 1.0814837567269178, 1.0924717299676643, 1.1039447283863266, 1.1158218513478264, 1.1280201058768295, 1.1404552852025542, 1.1530429484359925, 1.1656994937406988, 1.1783432984126887, 1.1908958823866478, 1.2032830396266296, 1.2154358770084281, 1.2272917038715079, 1.238794726900146, 1.2498965221356597 ], [ 1.1783878342182128, 1.1687943013556905, 1.1590470428597188, 1.1491823187291985, 1.1392403269888516, 1.129265195929436, 1.119304926225169, 1.1094112764355586, 1.0996395850645566, 1.090048522088876, 1.08069976274392, 1.0716575764609404, 1.0629883243025977, 1.0547598591989302, 1.0470408249253433, 1.0398998522968328, 1.0334046546944216, 1.0276210299824, 1.0226117822350564, 1.0184355844326973, 1.015145812120549, 1.0127893872971492, 1.0114056803985974, 1.011025524575519, 1.011670398560672, 1.0133518303078222, 1.0160710618060231, 1.0198189958843262, 1.0245764202190721, 1.0303144761209033, 1.036995315624154, 1.0445728757442718, 1.0529936975882557, 1.0621977309629245, 1.072119088930907, 1.0826867451584108, 1.093825192836574, 1.105455101920255, 1.1174940187902613, 1.129857149426948, 1.1424582557467096, 1.1552106773754218, 1.168028470215466, 1.1808276312072525, 1.1935273587096102, 1.2060512834227337, 1.2183285989517159, 1.230295025668028, 1.2418935558139412, 1.2530749488022288 ], [ 1.1802269370962708, 1.1706168971610762, 1.1608486289241526, 1.150958499190069, 1.140986871722839, 1.1309781034806308, 1.1209804903908567, 1.111046156059263, 1.101230876443853, 1.0915938332275268, 1.0821972884563114, 1.0731061730639648, 1.0643875823016298, 1.0561101719899746, 1.0483434511040808, 1.0411569687103583, 1.034619396936504, 1.0287975166892958, 1.0237551193892136, 1.0195518460611783, 1.0162419944393448, 1.0138733346499111, 1.0124859833577216, 1.0121113932709767, 1.0127715174174772, 1.0144782033710704, 1.0172328599189449, 1.0210264172532688, 1.0258395736245411, 1.031643291054113, 1.038399476653265, 1.0460617710511129, 1.054576365973092, 1.0638827895541654, 1.073914626192478, 1.0846001699761971, 1.095863038758069, 1.1076227939629462, 1.1197956171357606, 1.1322950892729566, 1.1450331057833298, 1.1579209409394324, 1.1708704527304954, 1.183795394141961, 1.1966127733345946, 1.2092441875251423, 1.2216170480785962, 1.2336656198998304, 1.245331815808186, 1.2565657121380205 ], [ 1.1824667906470328, 1.1728633948106943, 1.1630979306685374, 1.1532068172094718, 1.1432305183607752, 1.1332135421982392, 1.12320438934884, 1.1132554438972673, 1.1034227997275876, 1.0937660149109294, 1.0843477865537512, 1.0752335385397362, 1.06649091495617, 1.0581891728540027, 1.0503984695489426, 1.0431890421628713, 1.0366302807836068, 1.03078970172817, 1.0257318341056298, 1.0215170412130314, 1.018200308011372, 1.0158300363503092, 1.0144468995150604, 1.0140828152071215, 1.0147600988684797, 1.0164908548007519, 1.0192766488847038, 1.0231084835218802, 1.0279670648921482, 1.0338233198880142, 1.0406390925235962, 1.0483679348104684, 1.0569559100168475, 1.066342346840871, 1.076460515711302, 1.0872382338893134, 1.0985984349841627, 1.1104597551136173, 1.1227371913619022, 1.1353428811567117, 1.148187037172422, 1.1611790532995665, 1.174228773484593, 1.1872478877097803, 1.2001513915222533, 1.2128590235171097, 1.2252965855950368, 1.2373970573406965, 1.2491014373498421, 1.260359275234366 ], [ 1.1851035957026075, 1.175530284870744, 1.1657917662828035, 1.1559244575555807, 1.1459688580002219, 1.1359695497187552, 1.1259751475213813, 1.1160381909243855, 1.1062149711025446, 1.0965652853401147, 1.087152111314603, 1.078041193548398, 1.0693005347005105, 1.0609997852075645, 1.0532095263243806, 1.046000444101705, 1.0394423955370606, 1.0336033733024788, 1.0285483822846748, 1.0243382497105213, 1.0210284006342079, 1.0186676413528504, 1.0172970036201208, 1.0169487103864012, 1.0176453266654502, 1.0193991542855305, 1.022211914615909, 1.0260747384889148, 1.0309684499188907, 1.0368640956139785, 1.0437236439373492, 1.0515007632788878, 1.0601415959318323, 1.0695854687502284, 1.0797655188448878, 1.0906092502237594, 1.1020390652671999, 1.1139728280215009, 1.1263245156988397, 1.1390050056322065, 1.1519230317711153, 1.164986328284838, 1.1781029554914064, 1.191182773699874, 1.2041389972356022, 1.2168897327333374, 1.229359392597691, 1.2414798818389676, 1.2531914825831902, 1.2644433977334617 ], [ 1.1881303708866766, 1.1786106591638013, 1.1689233272134971, 1.1591047385418374, 1.1491953636981296, 1.1392397821269904, 1.1292866324378095, 1.1193885043302383, 1.1096017650344945, 1.0999863128005576, 1.0906052497640566, 1.0815244665195054, 1.0728121310696612, 1.0645380756576943, 1.056773076534576, 1.049588024213476, 1.0430529854888353, 1.037236163717012, 1.0322027707732333, 1.028013832765571, 1.024724961761098, 1.022385136765423, 1.0210355476707313, 1.0207085638020956, 1.021426891369637, 1.0232029786975314, 1.0260387123356267, 1.0299254207413062, 1.0348441679317635, 1.0407662837571852, 1.0476540493176467, 1.0554614445718835, 1.0641348755202094, 1.0736138286229897, 1.0838314410791883, 1.094715013966841, 1.1061865197214487, 1.1181631619711265, 1.13055803887632, 1.1432809497518583, 1.1562393750050215, 1.1693396496677593, 1.1824883333956744, 1.1955937489809993, 1.2085676207792535, 1.221326707166601, 1.2337943024149487, 1.2459014912908801, 1.2575880714049956, 1.2688031029378992 ], [ 1.1915369417775576, 1.1820941943566219, 1.1724821554672582, 1.1627370822632705, 1.1528993527782887, 1.1430134673901036, 1.1331279982656093, 1.1232954800338462, 1.1135722345733026, 1.1040181224951544, 1.094696213719166, 1.085672369564683, 1.077014729141041, 1.068793093685499, 1.0610782040704712, 1.053940909233609, 1.0474512270474992, 1.0416773044094734, 1.0366842903005147, 1.032533144280326, 1.029279413100526, 1.026972019103923, 1.0256521144623445, 1.0253520629665378, 1.026094613251646, 1.0278923210640427, 1.030747261232164, 1.0346510422295843, 1.0395851008017896, 1.045521218136425, 1.0524221723286489, 1.0602424339378957, 1.0689288271049133, 1.0784211146938714, 1.0886525105392013, 1.0995501592928099, 1.1110356421389944, 1.1230255625084564, 1.1354322493005349, 1.1481646009095696, 1.16112909060392, 1.1742309573087644, 1.1873755990276438, 1.2004701554360395, 1.2134252150347469, 1.2261565313076228, 1.2385866053780235, 1.250646001297361, 1.2622742990468796, 1.2734206437638997 ], [ 1.1953099814396027, 1.185967191460648, 1.1764541818000422, 1.1668070511636448, 1.157066021432534, 1.1472754376138663, 1.1374837153064294, 1.127743228967766, 1.1181101339393944, 1.1086441149175486, 1.099408053411692, 1.0904676068023322, 1.0818906920192628, 1.0737468677756805, 1.0661066109202118, 1.0590404850527138, 1.052618203361001, 1.0469075929353808, 1.0419734747988547, 1.0378764825788314, 1.0346718528601637, 1.0324082310340912, 1.0311265464701518, 1.0308590179119166, 1.0316283513226956, 1.0334471850340539, 1.0363178188669067, 1.040232235008991, 1.045172382513659, 1.0511106620559438, 1.058010523533469, 1.0658270860301766, 1.0745077118847453, 1.0839925090816396, 1.0942147843523737, 1.1051015042917574, 1.116573829331834, 1.1285477652248148, 1.1409349448940804, 1.1536435345216425, 1.1665792665440873, 1.1796466288201268, 1.1927502518781699, 1.2057965072594319, 1.2186952627673757, 1.2313616687821418, 1.2437178113820506, 1.2556940784504516, 1.2672301337278342, 1.2782754576589022 ], [ 1.1994331030360543, 1.1902126720754325, 1.1808218257577667, 1.1712964520565847, 1.1616765529227544, 1.1520062416434103, 1.1423336872311496, 1.1327109992009543, 1.1231940458055745, 1.1138421985815008, 1.1047179959700848, 1.0958867189121302, 1.0874158717942812, 1.0793745631147385, 1.0718327819379616, 1.0648605688622657, 1.0585270840904337, 1.0528995805168475, 1.0480422966940155, 1.0440152931100908, 1.0408732650726324, 1.0386643758379703, 1.0374291629782686, 1.0371995771313824, 1.0379982124353768, 1.0398377792546067, 1.0427208503667234, 1.0466398820847882, 1.051577476041517, 1.0575068139047339, 1.0643921771378873, 1.0721894669838863, 1.0808466697673162, 1.0903042624844859, 1.1004956057991566, 1.1113474031922623, 1.1227802990957532, 1.134709646069326, 1.1470464157961056, 1.1596982001467042, 1.1725702740968917, 1.1855667568117985, 1.198591953275529, 1.211551933362298, 1.2243563118669711, 1.2369200900193322, 1.2491653662106095, 1.2610227393273103, 1.2724322908055556, 1.283344107346679 ], [ 1.2038870037930771, 1.1948105305814036, 1.1855641567022197, 1.1761835066515456, 1.1667082983398283, 1.1571823368568062, 1.1476534547799397, 1.1381733924870572, 1.1287976117027236, 1.1195850353546137, 1.1105977068031814, 1.101900361725678, 1.0935599065071513, 1.085644798076405, 1.0782243219218637, 1.0713677677600317, 1.065143506251093, 1.059617975483078, 1.0548545928118471, 1.0509126159962956, 1.0478459870276668, 1.0457022017479856, 1.0445212567707909, 1.0443347301469912, 1.0451650509340726, 1.047025002655952, 1.0499174850142006, 1.0538355280728657, 1.058762518241012, 1.0646725645940398, 1.0715309187820645, 1.0792943718730246, 1.0879115899328315, 1.0973234083816616, 1.1074631624369164, 1.1182571599466613, 1.1296253817082218, 1.1414824220191038, 1.1537385912551386, 1.1663010541687688, 1.1790749246365628, 1.191964362641051, 1.2048738209350731, 1.2177095667385633, 1.2303814653686878, 1.2428048631489097, 1.2549023398838146, 1.2666051302596275, 1.2778540958735025, 1.2886002175867803 ], [ 1.2086496581389206, 1.1997377398640503, 1.1906571131256398, 1.1814430855667102, 1.1721350265310344, 1.162776356335361, 1.1534144816176939, 1.1441006703591918, 1.1348898600135948, 1.1258403921035542, 1.117013666720845, 1.1084737106863494, 1.100286653806748, 1.092520108863522, 1.0852424528748839, 1.078522009997977, 1.0724261404078324, 1.0670202447895294, 1.062366700800346, 1.0585237558901328, 1.0555444097698954, 1.0534753286623466, 1.0523558407109956, 1.0522170653876837, 1.0530812268287064, 1.0549611893385322, 1.0578602316595578, 1.0617720464579434, 1.0666809180726402, 1.0725620041781219, 1.079381637160914, 1.0870975784880335, 1.0956592066182578, 1.1050076863429905, 1.1150762316051128, 1.1257906027529252, 1.137069943603973, 1.148827955980837, 1.1609742664988467, 1.1734157538782048, 1.1860576754172116, 1.1988046514212187, 1.2115617593438408, 1.2242359649175807, 1.2367378984639346, 1.2489837691595236, 1.2608971382349174, 1.2724103305929728, 1.283465372101854, 1.2940144366728314 ], [ 1.2136965564575135, 1.204968606601703, 1.1960737758178577, 1.1870470008532759, 1.1779272375982937, 1.1687574450954215, 1.1595845152015218, 1.1504591416725949, 1.1414356223549644, 1.1325715881833087, 1.1239276528676343, 1.1155669775853865, 1.10755474579922, 1.0999575446436962, 1.0928426513430294, 1.086277226033407, 1.0803274163602332, 1.075057384451904, 1.070528273374142, 1.066797137771945, 1.0639158716027306, 1.0619301736774625, 1.060878597605255, 1.0607917345761695, 1.0616915728148768, 1.063591064418207, 1.0664939079348954, 1.0703945253862863, 1.0752781811117156, 1.0811211662906408, 1.0878909687141491, 1.09554637191543, 1.104037483364, 1.113305767977553, 1.1232842361097866, 1.1338979681993846, 1.1450651130027667, 1.1566983514856475, 1.168706605276997, 1.1809966124000548, 1.1934740802228896, 1.2060444929114855, 1.2186139927269746, 1.231090706837632, 1.2433865263592434, 1.2554190457547099, 1.2671133252432392, 1.278403252177288, 1.2892324114487745, 1.2995544706412618 ], [ 1.2190009846319643, 1.2104750707441945, 1.201784688884602, 1.1929643503078564, 1.1840525324142692, 1.175091656874336, 1.1661280130556455, 1.1572116207293461, 1.1483960260347277, 1.1397380247986568, 1.1312973076026993, 1.12313602155041, 1.1153182446227867, 1.107909369960537, 1.100975399541009, 1.0945821496985408, 1.0887943749302005, 1.0836748215377692, 1.0792832288620076, 1.075675302931125, 1.072901694705465, 1.071007021741574, 1.0700289764922344, 1.0699975646172755, 1.070934510448054, 1.072852852432367, 1.0757567287354535, 1.0796413245516137, 1.084492923981077, 1.0902889899182473, 1.0969981964148412, 1.1045803686565894, 1.1129863483073246, 1.1221578868969726, 1.132027752639117, 1.1425202777422494, 1.153552526294201, 1.165036085931401, 1.17687918844168, 1.188988594745733, 1.2012707601639114, 1.2136323834713834, 1.2259810253403487, 1.2382263576845343, 1.2502819842789927, 1.2620673955492427, 1.2735096698055983, 1.2845447292803036, 1.2951181063438433, 1.3051852510961337 ], [ 1.2245343384623861, 1.2162270426097772, 1.2077582212948583, 1.199161905394482, 1.1904760289985479, 1.1817424011931117, 1.1730066228961098, 1.1643179429659, 1.155729047898864, 1.1472957796594208, 1.139076776603684, 1.1311330331483382, 1.1235273749046268, 1.1163238475719381, 1.109587020111527, 1.1033812057455081, 1.0977696082732549, 1.0928134061214962, 1.0885707923687094, 1.085095995412351, 1.0824383113627993, 1.0806411846238042, 1.0797413759827348, 1.0797682560589266, 1.0807432542835191, 1.0826794784248883, 1.0855814972314728, 1.0894452517494422, 1.0942580352411737, 1.0999984664326796, 1.106636386593734, 1.1141326464692212, 1.1224388168200392, 1.131496947790456, 1.1412395943293479, 1.1515903780264938, 1.1624653152743276, 1.1737749446934915, 1.185426901878882, 1.197328161111908, 1.2093861895518543, 1.2215091516752563, 1.2336062507352756, 1.2455889865043945, 1.2573730760440769, 1.2688803926155745, 1.2800405309636667, 1.2907918937933707, 1.3010823185330451, 1.3108692968451838 ], [ 1.230266466165254, 1.2221927700795459, 1.2139609606114958, 1.2056045334946377, 1.1971608154103957, 1.1886709291472102, 1.1801797036910533, 1.1717355237443623, 1.1633901133665154, 1.1551982487695638, 1.1472173958454683, 1.1395072688220065, 1.1321293076406633, 1.1251460733360013, 1.11862056299616, 1.1126154489171092, 1.1071922504126668, 1.1024104514144515, 1.0983265823584512, 1.0949932905581419, 1.0924584286592756, 1.090764194843648, 1.0899463598162675, 1.090033612648129, 1.091047048717288, 1.0929998074259673, 1.0958968456813096, 1.099734808261953, 1.1045019339972466, 1.1101779256720101, 1.116733721468994, 1.1241311447309768, 1.1323224795804405, 1.1412501153873464, 1.1508465021072998, 1.161034722503734, 1.17172995741466, 1.1828419160121553, 1.1942778471084217, 1.205945142624486, 1.2177524593097404, 1.22960953501093, 1.241427310917444, 1.2531193274862913, 1.2646037807058654, 1.2758053741209865, 1.2866566604572103, 1.2970989027515067, 1.3070825388968295, 1.3165673106553757 ], [ 1.236166031526593, 1.2283392277021568, 1.2203581298651247, 1.2122556444867745, 1.2040684280823204, 1.1958368456406487, 1.187604874017151, 1.1794199450947809, 1.171332723817, 1.1633968166514679, 1.1556684067089675, 1.148205812687921, 1.1410689701271948, 1.1343188352274225, 1.128016713845313, 1.1222235212635385, 1.1169989820349167, 1.1124007835529963, 1.1084837018299134, 1.1052987228771536, 1.1028921874229847, 1.1013049894880869, 1.1005718593190479, 1.100720756955397, 1.1017723930801075, 1.1037398783062404, 1.1066284816411502, 1.1104354566220398, 1.1151498751219269, 1.1207524018975816, 1.1272149563707037, 1.1345002493269358, 1.142561254015319, 1.1513407677541407, 1.1607713224846574, 1.170775773240114, 1.181268871137497, 1.1921599210550298, 1.2033561238896988, 1.214765464794359, 1.2262978105403228, 1.2378644335418496, 1.2493780643361962, 1.2607545097726498, 1.271914792812473, 1.2827868198522938, 1.2933064348119843, 1.303418030416347, 1.3130748471198237, 1.322239016246327 ], [ 1.2422008899030454, 1.2346325191504155, 1.2269140181769225, 1.2190776513328865, 1.2111593442425599, 1.203198635571589, 1.1952385739621747, 1.187325555276244, 1.1795090956872525, 1.171841536728594, 1.1643776791892388, 1.157174343807014, 1.1502898581207168, 1.143783470685104, 1.137714696204748, 1.1321425980595616, 1.1271250181818393, 1.12271776821894, 1.118973800155229, 1.1159423786573486, 1.113668280694476, 1.1121910495627574, 1.1115443292021645, 1.1117552994900617, 1.112844223164647, 1.1148241000646917, 1.1177004057006736, 1.1214708718997952, 1.1261252526187127, 1.1316450150229544, 1.1380029123508297, 1.1451624375066982, 1.1530772274752912, 1.1616905835830005, 1.1709353735710255, 1.180734651302162, 1.1910033056901272, 1.201650836638303, 1.212584838085495, 1.223714002630454, 1.2349492588515367, 1.246203310067121, 1.2573908155629783, 1.2684301495530992, 1.2792454704617806, 1.2897681323355763, 1.2999374479916956, 1.3097010668292464, 1.3190151218435329, 1.3278441941856391 ], [ 1.2483384691451769, 1.2410382843923413, 1.2335924157136786, 1.2260324344028988, 1.2183934772266976, 1.2107141917577922, 1.203036627267482, 1.1954060666743347, 1.1878707955445948, 1.1804818048130883, 1.1732924247826577, 1.1663578891182067, 1.1597348290382028, 1.1534806997839273, 1.1476531437676571, 1.1423092975897435, 1.137505053341887, 1.1332942881608095, 1.1297280796125901, 1.1268539277506808, 1.1247150069762382, 1.123349471319878, 1.1227898345195013, 1.1230624403971823, 1.1241870289894258, 1.1261763898627977, 1.1290360774762327, 1.1327641473754928, 1.1373508612163332, 1.1427783093272994, 1.1490199184641874, 1.1560398552435638, 1.1637924047235646, 1.1722214939240638, 1.181260624274995, 1.1908335375744832, 1.2008559028817574, 1.2112380850518674, 1.2218885523725072, 1.2327168145955087, 1.243634710405467, 1.2545563477214599, 1.2653985650612722, 1.2760826230290783, 1.2865360252512055, 1.296693659091828, 1.3064983188899264, 1.3159008954943148, 1.3248603947110031, 1.3333438302967358 ], [ 1.2545461476458244, 1.2475221031362058, 1.2403570438422375, 1.233081799661301, 1.2257306640093653, 1.2183413330903066, 1.2109547913111365, 1.2036151387106289, 1.1963693568602318, 1.189267010465363, 1.1823598828773239, 1.175701544962696, 1.1693468583140496, 1.163351415665442, 1.157770923627098, 1.152660535471975, 1.148074144633195, 1.1440636526588601, 1.1406782283541514, 1.1379635773046952, 1.1359612423453955, 1.134707955103256, 1.1342350557375325, 1.134567991777386, 1.1357258972472506, 1.137721240528648, 1.140559515178944, 1.1442389351242743, 1.1487500885873656, 1.15407550920598, 1.1601891437355718, 1.1670557381361588, 1.1746302291123438, 1.1828573108632718, 1.191671428891268, 1.2009974964690204, 1.2107525730341935, 1.220848510869682, 1.2311951299003008, 1.2417029954148062, 1.252284948673836, 1.2628566486303625, 1.2733373568919024, 1.2836514246784596, 1.2937297655123434, 1.3035107412295246, 1.3129405085370087, 1.3219730722353655, 1.330570201685473, 1.3387012595238552 ], [ 1.260791622073092, 1.254049886554124, 1.2471719719039374, 1.2401879215255236, 1.2331311351311711, 1.2260383024385209, 1.2189492837939562, 1.2119069339689397, 1.2049568660496468, 1.1981471531930927, 1.1915279670808925, 1.1851511531953622, 1.1790697446024156, 1.1733374177753575, 1.1680078961391007, 1.1631343094270732, 1.158768519539298, 1.1549604262057769, 1.1517572681251742, 1.149202936973386, 1.1473373222481917, 1.146195703738918, 1.1458082048951663, 1.1461993140912048, 1.1473874717132746, 1.1493847097797243, 1.1521963190334685, 1.1558205088464015, 1.1602480216769682, 1.1654616708301044, 1.1714357925402992, 1.1781356443977808, 1.1855168420565494, 1.1935249984134786, 1.2020957953669968, 1.2111557416032974, 1.2206237971496536, 1.2304138252963093, 1.2404374764146358, 1.250606803856308, 1.2608360469193656, 1.2710427210959636, 1.2811486793621933, 1.2910813996048596, 1.300775124852838, 1.3101715253645296, 1.3192199153997866, 1.3278772122731068, 1.336107775911975, 1.3438831820022805 ], [ 1.2670432579057453, 1.2605882499472307, 1.2540020128074763, 1.2473137621249464, 1.2405559582817187, 1.2337642351099278, 1.2269772764959566, 1.2202366375055855, 1.2135865074002612, 1.2070734128364937, 1.2007458606553798, 1.194653920996777, 1.1888487530283502, 1.1833820773696124, 1.178305601301351, 1.173670405032276, 1.16952629954681, 1.165921168707932, 1.162900310075956, 1.1605057899721665, 1.1587758282262934, 1.15774422632198, 1.1574398488706237, 1.1578861622728531, 1.1591008262304714, 1.1610953242226005, 1.1638746097387025, 1.1674367384603128, 1.1717724560277785, 1.176864720336014, 1.1826881600937535, 1.1892085098838865, 1.1963821150273686, 1.2041556594666827, 1.2124663181773463, 1.2212425402399676, 1.2304055891304577, 1.2398717775026515, 1.2495550734747114, 1.2593695777904759, 1.269231487070802, 1.2790605580442833, 1.2887813587410872, 1.298324423629865, 1.3076271496141638, 1.316634284305998, 1.3252980473380416, 1.333578024985138, 1.3414409540221697, 1.348860449374674 ], [ 1.2732704166161146, 1.2671048598478787, 1.2608130905928603, 1.254423459784162, 1.2479674480555043, 1.2414795901069455, 1.234997348115721, 1.2285609311851404, 1.2222130586309123, 1.2159986658789015, 1.2099645529011158, 1.204158976455437, 1.1986311889213528, 1.1934309282289974, 1.1886078652312002, 1.1842110168042832, 1.1802881348714125, 1.1768850832507984, 1.1740452154966126, 1.1718087674115052, 1.170212277304406, 1.1692880449846006, 1.1690636366466411, 1.1695614371463203, 1.1707982440013962, 1.1727848896151485, 1.1755258712296317, 1.1790189641925681, 1.1832547960798148, 1.1882163701014155, 1.1938785486399894, 1.200207542756921, 1.2071604987016264, 1.2146853195515719, 1.2227208921143051, 1.2311978803529566, 1.2400401700017356, 1.2491668978555135, 1.2584948172219292, 1.267940643668919, 1.277423095566384, 1.2868645549133735, 1.2961924221542669, 1.3053401982045012, 1.3142482332150236, 1.3228641020000398, 1.3311426627055316, 1.3390459106655643, 1.3465427249782183, 1.353608561912487 ], [ 1.2794437542076191, 1.2735687500195705, 1.2675725742011448, 1.2614826807674058, 1.2553295357571692, 1.2491465379443722, 1.2429698899022361, 1.236838416768303, 1.2307933309105694, 1.2248779417059545, 1.2191373108136834, 1.2136178546549978, 1.2083668972869406, 1.2034321784582893, 1.1988613233164769, 1.1947012819212004, 1.1909977482987557, 1.1877945700765542, 1.185133160552441, 1.1830519251153904, 1.181585712959133, 1.180765302763049, 1.1806169273068199, 1.1811618369017698, 1.1824158954658155, 1.184389196903345, 1.1870856845773774, 1.1905027550093912, 1.194630830815119, 1.1994528995941391, 1.204944036708617, 1.2110709606075882, 1.2177917063899042, 1.2250555384496502, 1.2328032418632278, 1.240967915621251, 1.2494763231545891, 1.2582507397527247, 1.267211109284286, 1.2762772498362334, 1.2853708789286105, 1.2944173365378449, 1.303346973986629, 1.3120961948868226, 1.3206081284997266, 1.3288329473223794, 1.3367278955211168, 1.344257124151712, 1.351391417992227, 1.3581078671969014 ], [ 1.285535486774584, 1.2799506018729905, 1.2742495728489236, 1.2684589296015554, 1.2626080945383846, 1.2567293003304938, 1.2508574594684128, 1.2450299833016516, 1.2392865491288996, 1.2336688149369255, 1.2282200825582148, 1.2229849113178586, 1.2180086856486958, 1.2133371416360843, 1.2090158589568314, 1.2050897261216085, 1.2016023882037514, 1.198595687189086, 1.1961091055244502, 1.194179223164208, 1.1928391972045096, 1.1921182708924738, 1.1920413153579945, 1.1926284029991008, 1.193894406517317, 1.1958486129857517, 1.1984943392957876, 1.2018285354916398, 1.2058413676781397, 1.2105157840159122, 1.215827086669333, 1.2217425586624693, 1.2282212238512185, 1.2352138431763076, 1.2426632595258842, 1.2505051837876469, 1.2586694577925668, 1.2670817421931715, 1.2756654860106575, 1.2843439793171791, 1.2930422969382678, 1.3016889954868065, 1.3102174861038554, 1.3185670447188722, 1.3266834517260735, 1.3345192908935504, 1.3420339749441959, 1.3491935824404553, 1.35597058174754, 1.3623434942452632 ], [ 1.2915196197754868, 1.2862229859274201, 1.2808151896104625, 1.2753218145969558, 1.2697712165525536, 1.2641944385229291, 1.2586250797869565, 1.2530991160700906, 1.24765467001356, 1.2423317318310583, 1.237171831241123, 1.2322176630203174, 1.2275126698503342, 1.2231005874892003, 1.2190249586245845, 1.2153286229850808, 1.2120531922876319, 1.2092385192530275, 1.2069221700718988, 1.205138909188103, 1.2039202039406558, 1.203293754387216, 1.203283050557412, 1.2039069556766895, 1.205179310039288, 1.2071085469739984, 1.2096973108267426, 1.2129420683983363, 1.2168327111836454, 1.221352157119879, 1.2264759776061311, 1.2321720970254124, 1.2384006343166292, 1.2451139729494907, 1.252257148271978, 1.2597686210291545, 1.2675814591241272, 1.275624883005594, 1.2838260622828268, 1.2921120066442087, 1.300411388185389, 1.3086561601310025, 1.316782879795223, 1.3247336866496082, 1.332456927267228, 1.3399074580104253, 1.3470466867596342, 1.353842427776604, 1.3602686377423414, 1.3663050835266672 ], [ 1.2973721387621975, 1.2923605620743877, 1.2872427310160348, 1.2820432664701684, 1.2767894401766058, 1.271511088608721, 1.2662404818778896, 1.2610121459427073, 1.2558626373074488, 1.2508302704213818, 1.2459547991182789, 1.2412770546369745, 1.236838544003284, 1.2326810137842206, 1.2288459853859521, 1.225374269080035, 1.222305464711803, 1.2196774574580678, 1.2175259169359405, 1.2158838073033906, 1.214780914648307, 1.2142433959168322, 1.2142933509775238, 1.2149484164143987, 1.2162213767577217, 1.2181197867969833, 1.2206455982870192, 1.2237947867852872, 1.227556980507863, 1.2319151035527498, 1.2368450604023855, 1.242315505765373, 1.248287760266765, 1.2547159430914183, 1.2615473911240902, 1.2687234149818496, 1.2761804042315568, 1.2838512427229343, 1.2916669433019785, 1.2995583747941373, 1.3074579434026443, 1.3153011053394823, 1.3230276191424533, 1.330582485362612, 1.3379165618863706, 1.3449868798874722, 1.3517567120309877, 1.3581954562613798, 1.3642783955578741, 1.3699863816246602 ], [ 1.303071160353807, 1.2983402375105921, 1.2935078716485289, 1.2885977092069458, 1.283635926640097, 1.2786511432998966, 1.2736742910804608, 1.268738439356507, 1.2638785746488566, 1.2591313354569795, 1.2545347037865773, 1.2501276560380796, 1.245949777069335, 1.2420408423531393, 1.238440374157198, 1.2351871785077975, 1.2323188702757628, 1.229871393951535, 1.2278785474644613, 1.2263715156717945, 1.2253784188560455, 1.224923879752997, 1.2250286104179868, 1.2257090178966432, 1.2269768256343874, 1.2288387064423731, 1.231295923372109, 1.234343977805982, 1.2379722700757116, 1.2421637872077316, 1.2468948444710468, 1.2521349207096057, 1.257846639125233, 1.2639859512135894, 1.2705025774963812, 1.2773407412125617, 1.284440200076994, 1.291737541179933, 1.2991676640950822, 1.3066653477508854, 1.3141667850971899, 1.3216109776186897, 1.3289409054530905, 1.3361044219486224, 1.3430548574369447, 1.3497513495837814, 1.3561589413897481, 1.3622484995006625, 1.3679965053754186, 1.3733847636698227 ], [ 1.308597043253105, 1.3041412822691072, 1.2995887738314436, 1.2949621834594036, 1.2902865865957391, 1.285589381059312, 1.280900158045587, 1.2762505304334864, 1.271673918042184, 1.267205290458021, 1.2628808690922484, 1.2587377911994686, 1.2548137396420984, 1.251146543177745, 1.2477737529158914, 1.2447322012727735, 1.2420575501777513, 1.2397838353794124, 1.2379430134004117, 1.2365645169537194, 1.235674823455739, 1.2352970397147702, 1.235450504088063, 1.2361504056521864, 1.237407418610586, 1.2392273497735151, 1.2416107980622468, 1.2445528281562657, 1.248042665985805, 1.2520634317537613, 1.2565919359101563, 1.2615985735276556, 1.2670473604648758, 1.2728961575021243, 1.2790971232220398, 1.2855974208188738, 1.2923401786785644, 1.2992656730979313, 1.3063126703049424, 1.313419841293984, 1.3205271524737028, 1.3275771397107012, 1.334515991234552, 1.3412943916601394, 1.3478681095317262, 1.354198338668549, 1.3602518245292077, 1.3660008182511016, 1.3714229031312826, 1.3765007335269164 ], [ 1.3139324600477813, 1.3097454032632436, 1.3054661635236642, 1.3011164238243083, 1.2967201582414747, 1.2923035444618702, 1.2878948366788001, 1.2835241978125123, 1.279223490872925, 1.2750260302221488, 1.2709662944815845, 1.2670796038269507, 1.2634017653811225, 1.259968691300063, 1.2568159948977278, 1.2539785707142497, 1.2514901647404155, 1.2493829410172288, 1.247687050491216, 1.246430207307999, 1.2456372766913775, 1.2453298772647552, 1.245525999283102, 1.2462396390037962, 1.2474804486696816, 1.24925340171473, 1.251558474258965, 1.254390347096821, 1.2577381373709693, 1.2615851757829006, 1.2659088528329687, 1.2706805648967854, 1.2758657960215416, 1.2814243719018008, 1.2873109164935905, 1.2934755280446533, 1.299864670624006, 1.306422252366112, 1.3130908372419021, 1.3198129184399885, 1.3265321725415673, 1.3331946164287736, 1.3397496024050994, 1.3461506082413288, 1.3523558034252898, 1.3583283961834582, 1.3640367840508678, 1.3694545417459882, 1.3745602837318878, 1.379337436657765 ], [ 1.3190624313919666, 1.3151367786421626, 1.3111233644467726, 1.3070428922789912, 1.3029182395452794, 1.2987743706397523, 1.294638212200312, 1.2905384896970162, 1.2865055253134818, 1.282570997978461, 1.2787676673359414, 1.275129064370295, 1.2716891522858305, 1.268481962030631, 1.2655412075046328, 1.2628998859520193, 1.2605898692635868, 1.2586414918679893, 1.257083140550662, 1.2559408509093566, 1.2552379142770695, 1.2549944979082133, 1.2552272801853146, 1.25594910178099, 1.257168633383648, 1.258890061081292, 1.2611127921008762, 1.263831186538827, 1.2670343250224452, 1.270705827643275, 1.2748237453313547, 1.2793605499766905, 1.284283252553451, 1.2895536776189263, 1.2951289164687734, 1.3009619693692427, 1.30700257039274, 1.313198168685444, 1.3194950209073693, 1.325839334884403, 1.3321783972809291, 1.3384616198481436, 1.3446414490880556, 1.3506741008146539, 1.356520100790712, 1.3621446317817354, 1.367517702968613, 1.372614167883032, 1.3774136215315453, 1.3819002070658295 ], [ 1.3239743249050917, 1.3203020550207971, 1.31654629325079, 1.3127267708414483, 1.3088652779165173, 1.3049855774475005, 1.3011132832620913, 1.297275701371075, 1.2935016346889567, 1.2898211520737106, 1.2862653234847412, 1.2828659239181877, 1.279655109584218, 1.2766650704985014, 1.2739276642268345, 1.27147403590714, 1.2693342298422092, 1.267536797886533, 1.2661084095341602, 1.2650734680704407, 1.2644537364304902, 1.2642679756047543, 1.2645315976892835, 1.2652563351834343, 1.266449928116904, 1.2681158312775953, 1.2702529454172067, 1.2728553789432058, 1.2759122502052578, 1.2794075447442732, 1.2833200461806107, 1.2876233628524525, 1.2922860737272985, 1.2972720153250736, 1.3025407255249637, 1.3080480499465188, 1.3137469028192696, 1.3195881586351377, 1.3255216359524833, 1.3314971232512332, 1.337465391000712, 1.3433791352698192, 1.3491938060542035, 1.354868286469946, 1.3603654046223497, 1.365652275573467, 1.3707004840330983, 1.3754861276680397, 1.3799897458025512, 1.3841961592488274 ], [ 1.3286578217385454, 1.3252303107736776, 1.321723419159524, 1.3181559171590327, 1.314548521301509, 1.3109238096059257, 1.3073061026676978, 1.3037213100186282, 1.3001967419258709, 1.2967608875977534, 1.2934431615809296, 1.2902736209284453, 1.2872826564536877, 1.2845006620211952, 1.2819576863247089, 1.2796830719324142, 1.2777050865142954, 1.2760505510938154, 1.2747444698902686, 1.2738096658666316, 1.273266425526702, 1.2731321559053363, 1.2734210561921069, 1.2741438061791346, 1.2753072739038371, 1.276914245637351, 1.2789631828767032, 1.2814480132688388, 1.2843579653157697, 1.2876774599729124, 1.2913860753225523, 1.2954586026394326, 1.2998652125015444, 1.3045717473139196, 1.309540151154463, 1.314729039182993, 1.3200943976362998, 1.3255903930394757, 1.3311702575953497, 1.336787208798909, 1.3423953568342304, 1.3479505541360772, 1.353411147512847, 1.358738603331507, 1.36389798866547, 1.3688583039557172, 1.3735926738018067, 1.378078410731678, 1.3822969716976665, 1.3862338288098677 ], [ 1.333104854235119, 1.3299129890629011, 1.3266456920189835, 1.3233207872088997, 1.319957935150835, 1.316578549539342, 1.313205681676732, 1.3098638720932743, 1.3065789695927703, 1.303377918713432, 1.3002885173548293, 1.2973391470561784, 1.2945584790835574, 1.2919751600586948, 1.2896174813075907, 1.28751303639716, 1.2856883714449097, 1.284168632725912, 1.2829772158745407, 1.2821354206181688, 1.2816621145428369, 1.2815734089595054, 1.281882349622033, 1.2825986249713197, 1.283728294876885, 1.285273543633968, 1.2872324623208224, 1.28959886751275, 1.292362165649332, 1.2955072747694933, 1.2990146174141866, 1.3028601996647693, 1.3070157908977451, 1.311449216328056, 1.3161247694569316, 1.3210037442104308, 1.3260450774320276, 1.3312060825556693, 1.3364432461616076, 1.3417130522005438, 1.3469727951895965, 1.3521813442970476, 1.3572998248722299, 1.362292191856393, 1.3671256793210715, 1.3717711205957162, 1.3762031426600208, 1.3804002456709643, 1.3843447831818345, 1.3880228608172378 ], [ 1.33730951843779, 1.3343438046013198, 1.331306442998631, 1.3282143296110613, 1.3250860900110135, 1.3219419979092284, 1.318803863144273, 1.315694888731493, 1.312639497262637, 1.3096631276523412, 1.306792003935257, 1.3040528784955414, 1.3014727527268932, 1.2990785786444792, 1.2968969453733705, 1.294953754700419, 1.2932738899870215, 1.291880882699661, 1.2907965806401547, 1.2900408216818329, 1.289631116495396, 1.289582343452053, 1.2899064587117266, 1.2906122245404852, 1.2917049592503, 1.2931863128908474, 1.2950540739760807, 1.297302014052805, 1.2999197786712027, 1.302892835038967, 1.3062024879613081, 1.3098259761373687, 1.3137366600352112, 1.3179043100223549, 1.3222954990091378, 1.3268740976974263, 1.3316018631159443, 1.336439103310318, 1.3413453939153106, 1.3462803169736521, 1.3512041896797262, 1.3560787512055819, 1.3608677793702426, 1.3655376150780547, 1.3700575802219008, 1.3744002829877908, 1.378541812133022, 1.3824618280228185, 1.3861435625511407, 1.3895737424693284 ], [ 1.3412679653946673, 1.3385186283355577, 1.335701262369131, 1.33283185621631, 1.32992802463898, 1.3270089289748963, 1.3240951688526783, 1.3212086447873512, 1.3183723919893235, 1.3156103863776845, 1.3129473244454182, 1.310408379250404, 1.3080189353724891, 1.3058043061564188, 1.3037894369300234, 1.301998598130853, 1.3004550723859398, 1.2991808395731845, 1.2981962637676916, 1.297519785775259, 1.2971676247273471, 1.2971534920196433, 1.2974883207930168, 1.2981800142576003, 1.2992332165149645, 1.300649110184437, 1.3024252460883274, 1.304555411436887, 1.3070295442390392, 1.3098337028266345, 1.312950100120557, 1.3163572122441551, 1.3200299699710742, 1.3239400390320075, 1.3280561914162132, 1.332344764640889, 1.33677019994406, 1.3412956441447592, 1.3458835943190939, 1.350496560280848, 1.3550977177908425, 1.3596515258098836, 1.3641242839306118, 1.3684846109680358, 1.3727038318580242, 1.376756266663059, 1.380619421794746, 1.3842740888800895, 1.387704360627088, 1.3908975754641413 ], [ 1.3449782752637305, 1.3424353542785008, 1.33982785881133, 1.337170893646224, 1.3344810895349246, 1.3317765258894698, 1.3290766263502327, 1.3264020270022934, 1.3237744176045636, 1.3212163568087578, 1.3187510629542005, 1.3164021826031205, 1.3141935395032223, 1.3121488671063593, 1.3102915281149374, 1.3086442247591057, 1.3072287036242622, 1.3060654588572498, 1.3051734374993564, 1.3045697505562501, 1.3042693932617844, 1.3042849778769567, 1.3046264823449236, 1.3053010182542752, 1.3063126218910739, 1.307662072706954, 1.3093467442801558, 1.311360493732475, 1.3136935964619239, 1.3163327337723585, 1.319261041292831, 1.3224582257253086, 1.325900756206133, 1.3295621342579087, 1.3334132429217243, 1.3374227713495315, 1.341557706251269, 1.3457838766461003, 1.3500665339757842, 1.3543709464082299, 1.3586629845774394, 1.3629096763356172, 1.3670797103189707, 1.371143871955895, 1.3750754004615473, 1.3788502607372939, 1.382447329300828, 1.3858484978951735, 1.3890387019219612, 1.3920058831756164 ], [ 1.348440318157412, 1.346093752641053, 1.3436859046139489, 1.3412310203466329, 1.3387447756535327, 1.3362442008835806, 1.3337475804344046, 1.3312743266262794, 1.3288448283238832, 1.3264802752631935, 1.3242024596050916, 1.3220335567720876, 1.3199958881072025, 1.3181116683036873, 1.3164027408751875, 1.314890305158628, 1.3135946384653947, 1.312534817028271, 1.3117284393500361, 1.3111913554724566, 1.3109374055883192, 1.3109781713567132, 1.3113227432979526, 1.3119775077797207, 1.3129459573889057, 1.3142285289201625, 1.3158224737777817, 1.3177217662161553, 1.3199170554260404, 1.3223956678572744, 1.3251416661712103, 1.3281359706505738, 1.3313565475994762, 1.334778667148805, 1.33837522995519, 1.3421171586914693, 1.3459738462589539, 1.3499136487087313, 1.3539044074057935, 1.3579139824589608, 1.3619107782302253, 1.3658642420232143, 1.3697453188218023, 1.3735268479908778, 1.3771838917837655, 1.3806939898541264, 1.3840373382660824, 1.3871968953256966, 1.3901584196326464, 1.392910447930772 ], [ 1.3516556054997364, 1.3494953132264431, 1.3472768709107725, 1.3450136934885348, 1.3427205328053522, 1.3404134050198657, 1.3381094941273817, 1.3358270314957674, 1.3335851518190358, 1.3314037264222975, 1.329303175374083, 1.327304260356771, 1.3254278606927916, 1.3236947353054855, 1.3221252736957747, 1.3207392392318695, 1.3195555081790276, 1.3185918079481513, 1.3178644580319732, 1.3173881170499588, 1.3171755392683173, 1.3172373439337595, 1.3175818007926132, 1.318214635289074, 1.3191388571636196, 1.3203546165020414, 1.3218590916874702, 1.323646414121866, 1.3257076349161223, 1.3280307388776829, 1.3306007109127806, 1.3333996592709316, 1.3364069987842617, 1.3395996953428424, 1.3429525703319185, 1.3464386607703298, 1.3500296276645525, 1.3536962019427912, 1.3574086546118878, 1.3611372758251203, 1.364852846626769, 1.3685270873928779, 1.3721330684092459, 1.3756455704591681, 1.3790413864538968, 1.3822995586751516, 1.3854015497451442, 1.3883313486727626, 1.3910755160060426, 1.393623174116371 ], [ 1.35462713541733, 1.3526430827772504, 1.3506038568132432, 1.348522069733768, 1.3464115819216134, 1.3442874318415832, 1.3421657436108914, 1.340063612173112, 1.3379989664936636, 1.3359904116842682, 1.334057051446971, 1.3322182926861552, 1.330493634551362, 1.32890244452949, 1.3274637244906595, 1.3261958698021674, 1.325116424759983, 1.3242418376548089, 1.323587218804196, 1.3231661048638554, 1.322990232705033, 1.3230693261371351, 1.323410898790909, 1.324020076575991, 1.3248994432955825, 1.3260489132311999, 1.3274656347722296, 1.3291439294044693, 1.3310752705118072, 1.333248306390014, 1.3356489315173141, 1.3382604093760222, 1.3410635489032356, 1.3440369349431078, 1.3471572109209813, 1.3503994094768146, 1.3537373241710882, 1.3571439128546567, 1.3605917211440886, 1.36405331291992, 1.3675016940642317, 1.3709107158817604, 1.3742554457995453, 1.3775124948966044, 1.3806602943675117, 1.3836793159059704, 1.3865522339253804, 1.3892640302586354, 1.3918020443023174, 1.3941559733693345 ] ], "zauto": true, "zmax": 1.3941559733693345, "zmin": -1.3941559733693345 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.10794330986760234, 0.10690687637209369, 0.10588097767755737, 0.10486758634833977, 0.10386865730361433, 0.10288615645965889, 0.10192208829811071, 0.1009785183022099, 0.10005758584440734, 0.0991615030689366, 0.09829253566427842, 0.09745296221827925, 0.09664501012185488, 0.09587076772695864, 0.09513207461270325, 0.09443039425275064, 0.09376667592516845, 0.09314121511969596, 0.09255352368884644, 0.0920022222569357, 0.09148496767407881, 0.0909984273917051, 0.09053831048396346, 0.09009946174988645, 0.08967602117594288, 0.08926164642725762, 0.08884979145468484, 0.08843403023537935, 0.0880084114970292, 0.08756782824060601, 0.08710838500552343, 0.08662774595241807, 0.08612544766153397, 0.08560316167834799, 0.08506489293104426, 0.08451710097519208, 0.08396873158334307, 0.08343114675257449, 0.08291794228300585, 0.08244464442464995, 0.08202828150659068, 0.08168683360564584, 0.08143857339574972, 0.08130132382156134, 0.08129167169557637, 0.08142418834453301, 0.08171071610088078, 0.0821597800155543, 0.08277617605716824, 0.08356077057521899 ], [ 0.10709829750267054, 0.10601014101428971, 0.10492982271548354, 0.10385931828715807, 0.10280062907479189, 0.10175581807320654, 0.10072704439778823, 0.09971659169624818, 0.0987268855078396, 0.09776049446388715, 0.09682011053150646, 0.0959085043050574, 0.09502845269636723, 0.09418263827589453, 0.0933735219291044, 0.09260319330150872, 0.09187320651647082, 0.09118441158359454, 0.09053679442598027, 0.08992934016305663, 0.08935993483587737, 0.08882531988870475, 0.08832111131814728, 0.08784189157129237, 0.08738137734089069, 0.08693266088124092, 0.08648851697554139, 0.0860417628474686, 0.08558565463362115, 0.08511430181364692, 0.08462308025950613, 0.08410902507898609, 0.08357118575116955, 0.08301092764280274, 0.08243216534503131, 0.08184151403700451, 0.08124834520773715, 0.0806647328548322, 0.08010527641597041, 0.07958678818819606, 0.0791278370259865, 0.07874814774104183, 0.07846786740664106, 0.0783067252958013, 0.07828313073573415, 0.07841326963097248, 0.07871027173056831, 0.07918352289918214, 0.07983818718087311, 0.0806749825229972 ], [ 0.10629295052260311, 0.1051537200081388, 0.104019391276042, 0.10289191530012386, 0.10177331341231372, 0.10066572151534482, 0.09957143248671978, 0.09849293173498122, 0.09743292031562943, 0.09639431980311855, 0.0953802533498104, 0.09439399813695755, 0.09343890581093682, 0.09251828953726104, 0.09163527897453426, 0.0907926476686833, 0.08999262089196167, 0.08923667548936524, 0.08852534643671932, 0.0878580570888837, 0.0872329910391532, 0.0866470227538405, 0.08609572151112466, 0.08557343874664279, 0.08507348306853812, 0.08458838058800501, 0.08411021161264155, 0.08363100897701355, 0.08314319900025353, 0.08264006364759603, 0.08211620195998703, 0.08156796987645383, 0.08099387960166089, 0.0803949419168552, 0.07977493657645755, 0.07914059666316817, 0.07850169234640071, 0.07787099823695372, 0.0772641273166149, 0.07669921458640215, 0.07619643676931677, 0.07577736223982248, 0.07546413890036169, 0.07527854685289043, 0.07524096547791967, 0.07536932692510473, 0.07567814443276517, 0.07617770853344112, 0.0768735331761742, 0.07776610708466582 ], [ 0.10552960404897539, 0.10434037473346462, 0.10315290779700045, 0.10196909957269136, 0.1007909616680241, 0.09962067418485063, 0.0984606370158395, 0.09731351369597699, 0.09618226161066641, 0.09507014202809876, 0.09398070355109397, 0.09291773328968496, 0.09188517144379867, 0.09088698712635515, 0.08992701616256192, 0.08900876519262638, 0.08813519048311284, 0.08730846407661591, 0.08652974380277714, 0.08579896665885606, 0.08511468654765349, 0.08447397683042397, 0.08387241533009926, 0.0833041643536225, 0.08276215142237743, 0.08223834848775105, 0.08172413947379524, 0.08121075907637583, 0.08068978072611979, 0.0801536289973709, 0.07959609155470505, 0.0790128075352616, 0.07840171225378553, 0.07776342127120281, 0.07710153919221956, 0.07642287931274207, 0.07573757914627569, 0.07505909426202911, 0.07440404981164014, 0.0737919273344549, 0.07324456615313027, 0.07278546626546194, 0.07243889492820514, 0.07222882247678189, 0.07217774225531044, 0.0723054597483159, 0.07262795942965004, 0.07315646611103815, 0.07389680474333159, 0.0748491282838416 ], [ 0.10480997349555107, 0.10357225601092238, 0.10233300390796823, 0.1010940276949682, 0.09985729703045162, 0.09862500357083683, 0.09739962198726639, 0.09618396317563464, 0.09498121286949197, 0.09379494838513182, 0.09262912621471067, 0.09148803377723419, 0.09037619997489466, 0.08929826139459046, 0.08825878409627926, 0.08726204489902482, 0.0863117807298958, 0.08541091958258955, 0.08456131139907061, 0.08376348104442746, 0.08301642773546272, 0.08231749512886095, 0.0816623333463386, 0.08104496848924499, 0.08045798714584668, 0.07989283396606497, 0.07934021084055197, 0.07879055792091451, 0.07823459079281075, 0.07766386523892965, 0.07707134126666826, 0.07645192085948863, 0.07580293816814121, 0.07512458523522379, 0.0744202594983181, 0.0736968202023605, 0.07296473900246894, 0.07223812576767384, 0.07153460513137828, 0.07087501484130322, 0.07028289639937334, 0.06978375518543148, 0.06940408412129004, 0.06917017313957695, 0.06910676424456573, 0.0692356524187223, 0.06957436559310808, 0.07013507036234974, 0.07092383513666697, 0.0719403379372963 ], [ 0.10413511956831853, 0.10285085895970265, 0.1015616623010338, 0.10026922283860931, 0.09897543449617449, 0.09768246476256862, 0.09639282606363918, 0.0951094392329131, 0.09383568173462752, 0.0925754126463543, 0.09133296622220223, 0.09011310629456593, 0.08892093500322085, 0.08776175152203326, 0.08664085969353068, 0.08556332778932199, 0.08453370884206927, 0.08355573578337427, 0.08263201137245135, 0.08176371779592045, 0.08095037391866952, 0.08018966857495705, 0.07947739538131868, 0.07880750818920682, 0.07817230696649044, 0.07756275272378141, 0.07696889866373262, 0.07638041475157117, 0.07578717586796538, 0.07517988051543123, 0.07455066781894618, 0.07389370457893538, 0.07320572001623608, 0.07248647182672463, 0.0717391314533608, 0.07097057765864438, 0.07019158480920527, 0.06941688600015257, 0.06866508264112212, 0.06795836403815399, 0.0673219966418438, 0.06678354755787755, 0.06637182499399812, 0.06611555201886031, 0.06604183765361012, 0.06617456308565475, 0.06653284657643556, 0.06712977132140863, 0.06797154279264846, 0.06905718397445783 ], [ 0.10350543208069886, 0.10217699583369043, 0.10084017727790176, 0.09949652178184186, 0.09814781327873916, 0.09679615735876751, 0.09544406338295124, 0.09409451888427277, 0.09275104841083345, 0.09141774814049569, 0.09009928721121034, 0.08880086694945918, 0.08752813024538318, 0.08628701542302541, 0.08508355225716217, 0.08392360236959033, 0.08281255200429867, 0.08175497179399795, 0.08075426495139651, 0.07981233141114266, 0.07892927967001369, 0.07810321927136901, 0.07733016417223412, 0.07660407030241828, 0.07591701994513554, 0.07525955243474143, 0.07462112701438763, 0.07399069170390588, 0.07335732362153981, 0.07271090259278716, 0.07204278126602318, 0.07134642047134643, 0.07061796645680367, 0.06985675464843617, 0.06906573038497427, 0.06825177876476185, 0.067425952230574, 0.06660357589300278, 0.06580419837026139, 0.0650513432299094, 0.06437200772798986, 0.06379585753632754, 0.0633540848557866, 0.06307793711489225, 0.06299698349835736, 0.06313725742461253, 0.06351947585900151, 0.0641575667650727, 0.06505771449702479, 0.0662180563083511 ], [ 0.10292063428012105, 0.101550788993855, 0.10016913462734899, 0.09877703995194899, 0.09737614533802967, 0.09596845594255453, 0.09455643466259418, 0.09314308784388522, 0.09173203547680145, 0.09032755660294356, 0.08893460005403164, 0.08755875065013487, 0.0862061418319925, 0.08488330764708249, 0.08359697028774002, 0.08235376414574115, 0.08115990358327513, 0.08002080903288122, 0.07894071397599972, 0.07792228277026383, 0.0769662748485268, 0.07607129305190062, 0.07523365158384447, 0.07444739171882259, 0.07370446135915394, 0.07299505926214842, 0.07230812858186135, 0.07163197000409817, 0.07095493467099587, 0.07026615290388656, 0.06955625678390993, 0.06881806191841182, 0.06804718404180359, 0.06724257661861137, 0.06640698336820722, 0.06554730211565578, 0.06467485206197776, 0.06380552531046267, 0.06295978685652115, 0.06216246884775594, 0.061442290584176405, 0.06083103336518148, 0.06036231778901243, 0.06006997759164474, 0.059986099249159666, 0.06013888924712916, 0.060550615852330444, 0.061235915261342116, 0.0622007248279319, 0.06344200408225018 ], [ 0.10237980862990957, 0.1009716854923937, 0.09954841291325932, 0.09811115723567655, 0.09666138350174894, 0.09520095834328955, 0.09373225356008341, 0.09225824317797446, 0.09078258538720943, 0.08930967957332021, 0.08784468782901557, 0.0863935100858582, 0.08496270259010308, 0.08355933116851742, 0.08219075389180477, 0.08086433258657594, 0.07958707924677104, 0.078365251534191, 0.07720392060109596, 0.07610654329739386, 0.07507457788984581, 0.07410718595882555, 0.07320106157330963, 0.0723504212840985, 0.07154717515434507, 0.07078128153448911, 0.07004126931578412, 0.06931489429396039, 0.06858988417024453, 0.06785472173385923, 0.0670994184701582, 0.06631624006455099, 0.06550035840153366, 0.06465041816531127, 0.06376901631791712, 0.06286309636105611, 0.06194425429197195, 0.061028939050124874, 0.06013850855341372, 0.05929907715662239, 0.058541068496688504, 0.05789837928062722, 0.05740707678841714, 0.05710360662503459, 0.05702258071655323, 0.05719433579950759, 0.05764256600077486, 0.05838239174846941, 0.059419190900250524, 0.060748380987286174 ], [ 0.10188144417041675, 0.1004384939606221, 0.09897720754211461, 0.09749852671393283, 0.0960037122293868, 0.09449445572415102, 0.09297299339019661, 0.09144221407248149, 0.08990575295553575, 0.08836806065412527, 0.08683443648271018, 0.08531101416654191, 0.08380468855261522, 0.08232297332057727, 0.0808737826509294, 0.0794651346112779, 0.07810478085284203, 0.07679977595111061, 0.0755560097974901, 0.07437773669712991, 0.07326714352819612, 0.0722240043897854, 0.07124546861540722, 0.07032602155479059, 0.06945764311370994, 0.06863016930049111, 0.06783184007632152, 0.06704999663959534, 0.06627187678223771, 0.06548545089417541, 0.06468024443667879, 0.06384810400330797, 0.06298388033797496, 0.06208601861627353, 0.061157059354795915, 0.06020405848033007, 0.05923892960483577, 0.058278694452123976, 0.057345600025663315, 0.05646702781969003, 0.05567508928035296, 0.055005785375917965, 0.05449762283221205, 0.05418964139605928, 0.054118922276842236, 0.05431780280811695, 0.05481117138383978, 0.05561429334076602, 0.05673156657242946, 0.058156420230980686 ], [ 0.10142350474198365, 0.09994944364831518, 0.09845407815958612, 0.09693810772143313, 0.09540256342770018, 0.09384892807235984, 0.0922792590960048, 0.09069630706609037, 0.08910362072466431, 0.08750562814220585, 0.08590768228008495, 0.08431605849943984, 0.08273789155056949, 0.081181040702671, 0.07965387435286458, 0.07816497010236566, 0.07672273319999176, 0.0753349454309965, 0.0740082674850978, 0.07274772942590056, 0.07155625425522658, 0.07043426634744517, 0.06937943729219682, 0.06838661465244979, 0.06744796395137816, 0.0665533323967809, 0.06569081788085386, 0.0648475033269847, 0.06401029922725254, 0.06316682973349944, 0.06230630123451538, 0.061420305692761495, 0.06050353055780127, 0.05955436777042294, 0.05857543073358781, 0.057573995232563166, 0.056562374582361345, 0.05555821918633728, 0.05458469720691953, 0.05367047064770531, 0.052849339088680496, 0.052159397030730435, 0.05164156175916655, 0.05133739972059893, 0.05128632271207981, 0.05152242334574768, 0.05207141180827134, 0.052948210892273154, 0.05415568770356451, 0.05568474823745926 ], [ 0.10100351653392686, 0.09950226459931633, 0.09797701903484632, 0.09642822373885598, 0.09485665887025924, 0.0932635679033209, 0.09165078876928968, 0.09002088175596597, 0.08837724516044747, 0.0867242080820237, 0.0850670883392756, 0.08341220250298205, 0.08176681474562535, 0.08013901200500795, 0.07853749530973482, 0.07697128150860195, 0.0754493164852735, 0.07398001035595872, 0.07257071677507235, 0.07122719122766588, 0.06995307515508119, 0.06874946133075835, 0.06761459823283517, 0.06654378496096734, 0.06552949270298884, 0.06456172523889643, 0.06362860314060804, 0.06271712948749203, 0.06181407468218658, 0.06090690868032297, 0.0599847124930203, 0.05903901597587719, 0.058064531699604426, 0.057059779277964656, 0.056027614465377226, 0.054975686735200965, 0.053916843453998074, 0.052869475806267795, 0.051857761709356166, 0.050911708471617884, 0.050066843244251404, 0.049363361157410496, 0.04884454736679709, 0.048554371885671195, 0.04853433399390692, 0.04881988497426978, 0.049437001583995444, 0.050399591769386166, 0.051708290005323475, 0.05335085667750666 ], [ 0.10061867266626738, 0.09909428710662507, 0.09754355116756676, 0.09596664462872326, 0.0943640797243501, 0.09273683392186553, 0.09108648798142945, 0.08941536205827667, 0.08772664088961787, 0.08602447741937606, 0.08431406268206613, 0.08260164858546497, 0.08089450968513563, 0.07920083052377283, 0.07752950710684661, 0.07588985515008746, 0.07429122435866223, 0.0727425274415628, 0.07125170460198206, 0.06982515789809823, 0.06846720323507194, 0.06717959806010872, 0.06596120689087674, 0.06480786182035733, 0.06371245978106589, 0.06266531366864808, 0.061654744152731845, 0.06066786895821468, 0.059691523039390224, 0.05871323165802764, 0.057722161422882105, 0.05670999083995911, 0.05567166756493566, 0.054606047808164436, 0.05351643685893282, 0.05241106159460553, 0.0513035006789856, 0.050213072575173816, 0.04916513502209166, 0.04819118624330415, 0.0473285892771126, 0.04661968917861798, 0.046110094650380594, 0.04584599426534388, 0.04587060015231147, 0.04622013040231054, 0.04692004132882058, 0.04798233073198395, 0.0494045331856463, 0.051170565731577 ], [ 0.1002659518426591, 0.09872255780404553, 0.09715083393549606, 0.09555069166862683, 0.09392236248707192, 0.092266535045065, 0.09058449873117068, 0.08887828657642836, 0.08715080866768488, 0.08540596549217132, 0.08364872902081737, 0.08188517801482069, 0.08012247328484601, 0.07836875883026602, 0.07663297643843761, 0.07492458501297451, 0.07325318219117971, 0.07162803507589778, 0.07005753906409395, 0.06854863796872802, 0.06710625307908318, 0.06573278066356239, 0.064427723238995, 0.06318751647459538, 0.06200559900497022, 0.060872747313050604, 0.059777665828866566, 0.058707789617447825, 0.05765023067249092, 0.05659278503323597, 0.055524919929414204, 0.05443867723940418, 0.05332945726098907, 0.05219667805622427, 0.0510443323037223, 0.049881477903074144, 0.048722694061365895, 0.04758850668892365, 0.046505733889044165, 0.04550762737988078, 0.04463360134041792, 0.04392827421972177, 0.04343954847977035, 0.04321557618331247, 0.04330074095277156, 0.04373118614495996, 0.04453077341309569, 0.045708437160991336, 0.04725757796278995, 0.04915752610695904 ], [ 0.09994224755183843, 0.0983839690477386, 0.09679579322715476, 0.09517736276427194, 0.0935286193360928, 0.09184994364551902, 0.09014230300439953, 0.08840739954918903, 0.08664781042804715, 0.08486710955030217, 0.08306995882759007, 0.0812621554246655, 0.07945062063175531, 0.07764331593917201, 0.07584907323272277, 0.07407732932870802, 0.07233776093910763, 0.07063982505923479, 0.06899222175219887, 0.06740231069337002, 0.06587552795407181, 0.06441486257547727, 0.06302045994458154, 0.06168941726871823, 0.06041582319793338, 0.05919106897676346, 0.05800442573341653, 0.05684384785694057, 0.05569693353482973, 0.05455195730415346, 0.0533988898402561, 0.05223033688192905, 0.05104235772089396, 0.04983515666076961, 0.04861366962258235, 0.04738808419193873, 0.046174327426109926, 0.04499452566569451, 0.04387738091545341, 0.04285832113666653, 0.04197918097143618, 0.04128708981045073, 0.040832247416914186, 0.04066443028595293, 0.040828437291717416, 0.04135917805292891, 0.042277498674883424, 0.04358783485245572, 0.0452782729760537, 0.04732281996224895 ], [ 0.09964450384894107, 0.09807539763880814, 0.09647526220780447, 0.0948434741906678, 0.09317967957976105, 0.09148393521379398, 0.08975685888675908, 0.08799978135001954, 0.08621489177134667, 0.0844053664837241, 0.08257546919379051, 0.0807306093735543, 0.07887734456415703, 0.0770233121234263, 0.07517707702194865, 0.07334788521758938, 0.07154531753779284, 0.06977884738453363, 0.06805731710663714, 0.06638836204647458, 0.06477782657241643, 0.06322923023865248, 0.06174335103792506, 0.060317992798806834, 0.058947992386902175, 0.05762549909309233, 0.0563405262836416, 0.055081740067253145, 0.053837419236773335, 0.05259650242204268, 0.05134963673674072, 0.050090157339602696, 0.048814954965240485, 0.04752522116988298, 0.046227090000468846, 0.04493221128844016, 0.04365828654817673, 0.042429565833421716, 0.04127723697632025, 0.040239537883314316, 0.039361304410692, 0.038692576483648045, 0.03828590644080859, 0.03819224560642317, 0.03845576771791967, 0.0391085873341504, 0.04016670885317291, 0.04162835030456856, 0.04347501170442372, 0.04567472639905479 ], [ 0.0993698534178832, 0.09779384844991487, 0.09618613017629826, 0.09454581426306571, 0.0928722476242621, 0.09116514997626425, 0.08942476502616714, 0.0876520147882317, 0.08584864885428016, 0.08401737875578234, 0.08216198592862795, 0.08028739036044762, 0.07839966597794125, 0.07650598853541293, 0.07461450263418375, 0.07273409708607688, 0.07087408273810818, 0.06904377462907912, 0.06725199118393212, 0.06550649670270671, 0.06381342839124209, 0.0621767632350787, 0.060597889789179404, 0.05907535173709382, 0.0576048209081024, 0.05617933647583171, 0.054789816591166135, 0.05342581428028263, 0.052076458695360345, 0.050731503187903995, 0.04938239794236378, 0.04802331745479526, 0.04665209787518621, 0.04527106893003517, 0.043887791352682885, 0.04251572497857597, 0.041174846183629446, 0.03989219649649096, 0.03870226785944586, 0.03764701271385748, 0.03677513034200011, 0.03614018918052328, 0.03579721362319978, 0.03579771838023425, 0.03618382419386512, 0.03698278087955928, 0.0382034714837194, 0.03983593148399349, 0.04185380973224188, 0.04421870984515219 ], [ 0.09911575339811442, 0.09753659815273741, 0.09592549441020497, 0.09428130352766152, 0.09260307174149852, 0.09089017046123106, 0.08914244718456472, 0.08736038076617954, 0.08554523315817275, 0.08369918811582489, 0.08182546580338074, 0.07992840086219402, 0.07801347050888825, 0.07608725889910987, 0.07415734471856308, 0.07223210124931394, 0.07032040256785145, 0.06843123657391441, 0.0665732354931155, 0.0647541470944837, 0.06298028405729197, 0.06125600263486684, 0.059583271966319074, 0.05796139859249287, 0.056386963979824414, 0.054854014989573444, 0.053354519983794854, 0.05187907152270648, 0.050417787436825845, 0.048961342536938304, 0.04750205795241092, 0.04603498440911837, 0.04455893563959325, 0.043077451657751495, 0.041599691103615936, 0.040141259624123474, 0.03872496849477379, 0.03738147234364809, 0.0361496432107288, 0.035076396748232874, 0.03421552764865396, 0.03362503530109614, 0.033362596732936185, 0.033479419922837296, 0.0340135999264194, 0.0349848137148368, 0.03639206948430568, 0.03821510884511863, 0.04041862699202992, 0.04295766604240303 ], [ 0.09888011434912854, 0.09730133400451296, 0.09569080948728494, 0.09404715542809064, 0.09236911699400278, 0.09065570769869868, 0.088906358822454, 0.08712107442948817, 0.08530058441780203, 0.08344648649180728, 0.0815613664814927, 0.07964888515333453, 0.07771381873711194, 0.07576204007942619, 0.07380042797568115, 0.07183669426820152, 0.06987912222708507, 0.06793621601590583, 0.06601626995275629, 0.06412687764463514, 0.062274414044011496, 0.060463536305717505, 0.05869675939502311, 0.056974166619242476, 0.05529331088472985, 0.05364934826824855, 0.05203542270793997, 0.05044329340195829, 0.04886417104222126, 0.04728971158365487, 0.045713110781023525, 0.04413024903143437, 0.042540849785723124, 0.040949629158051594, 0.03936742247224069, 0.037812268919964066, 0.03631040955776371, 0.03489709103540455, 0.03361694693766525, 0.032523544695262654, 0.03167749510369601, 0.03114249530448994, 0.03097908098989993, 0.031236846475330496, 0.03194710279899788, 0.033118456598091386, 0.03473685217720697, 0.03676966852331359, 0.039171921243127066, 0.041892422835847876 ], [ 0.09866141772210442, 0.09708628254655555, 0.09548002833064227, 0.09384103098302492, 0.09216773501461391, 0.09045878776806841, 0.08871318628054378, 0.0869304310391504, 0.0851106794030962, 0.08325489001104613, 0.08136494813487671, 0.07944376078141842, 0.07749530953043528, 0.0755246488446984, 0.07353783819051969, 0.07154179813583103, 0.06954408406683485, 0.06755257667559597, 0.06557509615282357, 0.06361895695714519, 0.06169049144393594, 0.05979458211010168, 0.05793425160193055, 0.05611036437063471, 0.05432149162640103, 0.0525639809255687, 0.0508322543231361, 0.04911933796921644, 0.04741760650251287, 0.04571971273020007, 0.04401966966671277, 0.04231405677629746, 0.04060332996890311, 0.03889321831794508, 0.03719618309429401, 0.03553289106635396, 0.03393360470543461, 0.03243929504031596, 0.03110210455495938, 0.029984518138682793, 0.02915634713042024, 0.02868872063314992, 0.02864516487622868, 0.029071595210660623, 0.029988630606063216, 0.031389368967441295, 0.03324321554792082, 0.035503468618639004, 0.03811537960764791, 0.04102245127444769 ], [ 0.09845881731242012, 0.09689032310299628, 0.0952917291681541, 0.09366118083069401, 0.09199682299574619, 0.09029692984815693, 0.08856004827612746, 0.08678514957022238, 0.08497178252896503, 0.08312021974024016, 0.08123158756817038, 0.07930796934891098, 0.07735247061418281, 0.07536923499778092, 0.07336340007774333, 0.07134098406353608, 0.06930869728513787, 0.06727367718510202, 0.06524315213200806, 0.06322404776523884, 0.06122255920752109, 0.05924372223879066, 0.057291024751148674, 0.055366104527154535, 0.05346857885884646, 0.05159604500130391, 0.049744278890885896, 0.04790764586489659, 0.04607972550768748, 0.04425414708569238, 0.04242563368753496, 0.040591259411265034, 0.03875192800656381, 0.03691407484581153, 0.03509156984430269, 0.03330775105384129, 0.031597434077879225, 0.03000858491273142, 0.028603050494491206, 0.02745528868974313, 0.026647640167209174, 0.026261011317300346, 0.02636175030794383, 0.026988696394990137, 0.028146188016957913, 0.029806346442623217, 0.03191862156066238, 0.034421313102359026, 0.03725075041762438, 0.0403467104385306 ], [ 0.09827222038756166, 0.0967130811544289, 0.09512522273819825, 0.09350656807803188, 0.09185496424558103, 0.09016830682009348, 0.08844467918512873, 0.0866825016035607, 0.0848806835738175, 0.0830387716996483, 0.08115708418426812, 0.07923682217035188, 0.07728014759917808, 0.07529021720039653, 0.07327116283531987, 0.07122800992648123, 0.06916652835676668, 0.0670930142257425, 0.06501400631470979, 0.06293594792852716, 0.06086481251825655, 0.05880571930901894, 0.05676257185606591, 0.054737756665199436, 0.05273193965228001, 0.050743995053328925, 0.04877109558900901, 0.04680898688144831, 0.044852466783694124, 0.042896094153680085, 0.04093516168096289, 0.03896697937425104, 0.03699252082861143, 0.03501847325909227, 0.03305969578051172, 0.031142020005023946, 0.029305199951750988, 0.02760556564618325, 0.026117423258075603, 0.024931392729291946, 0.02414709424802198, 0.0238583780592785, 0.02413345818132501, 0.024998357938197747, 0.02643315784947076, 0.028382639391194106, 0.030773602182488372, 0.033529814450454005, 0.03658069706397084, 0.03986453622391551 ], [ 0.09810234453576759, 0.09655499701211415, 0.09498063442651163, 0.0933769657485008, 0.09174154302977865, 0.09007187984039297, 0.08836558595193807, 0.08662051344882535, 0.08483490815139574, 0.08300755904724527, 0.08113793741590454, 0.07922631657252431, 0.0772738627396375, 0.07528268759487733, 0.07325585367327257, 0.07119732518101474, 0.06911185905990565, 0.06700483444983366, 0.06488202306144113, 0.06274930826251479, 0.060612366541334936, 0.05847633082482975, 0.05634546009170646, 0.054222843031781605, 0.05211016472800911, 0.05000756485287689, 0.04791361521049506, 0.0458254462740325, 0.0437390597234763, 0.04164987887000813, 0.039553610297236405, 0.03744751271567301, 0.035332183388067734, 0.03321396729286391, 0.03110805962533251, 0.02904229654138812, 0.027061472488854096, 0.025231650140992854, 0.023643036924049527, 0.02240829089064854, 0.021651315469564978, 0.0214831889567559, 0.021971201737141073, 0.023118741922695543, 0.024870521294859182, 0.02713742658655843, 0.02982274649941338, 0.03283820780098517, 0.03610960902450369, 0.039576486411037545 ], [ 0.09795074677961525, 0.09641736574991933, 0.09485895659563305, 0.0932730232604293, 0.09165682713654683, 0.09000749912735634, 0.08832216943241496, 0.08659811057452332, 0.08483288793556354, 0.08302451094992885, 0.08117157718791237, 0.07927340091556687, 0.07733011741662843, 0.07534275448835583, 0.07331326316688704, 0.0712445009909663, 0.06914016305446356, 0.06700465876626316, 0.06484293559113823, 0.0626602549278462, 0.06046192938442642, 0.05825303459563115, 0.056038111913125715, 0.053820880465604376, 0.05160397838196323, 0.049388754357646704, 0.04717513421286862, 0.044961595509036875, 0.0427452996508288, 0.04052245693360236, 0.03828903445237719, 0.03604195424132721, 0.03378096032176458, 0.03151134864652637, 0.02924774656118263, 0.027019089692201837, 0.024874819254873722, 0.02289186959185177, 0.02118055499626556, 0.019883981629091597, 0.019161038722037897, 0.019145763191433813, 0.019897630315800822, 0.021380718112349314, 0.02348996770656921, 0.02609750648828905, 0.029085657954348296, 0.03235907589730831, 0.03584430312552775, 0.03948505515333022 ], [ 0.09781982216569508, 0.09630234507987265, 0.09476206717966464, 0.09319629728862183, 0.09160201266821041, 0.08997596445770141, 0.08831480247259711, 0.08661521522921257, 0.0848740798392538, 0.0830886153508497, 0.08125653226916382, 0.07937617043364177, 0.07744661721913765, 0.07546779821964884, 0.0734405332151206, 0.07136655135038728, 0.06924846108253908, 0.06708967254622204, 0.06489427244579175, 0.0626668542230331, 0.06041230879962842, 0.05813558334685908, 0.05584141706165364, 0.05353406388031952, 0.051217013049901026, 0.04889272094828086, 0.04656237391079919, 0.04422571524601064, 0.041880993275583436, 0.039525123012697796, 0.0371542011639947, 0.034764568127858934, 0.032354664882678845, 0.029927982861491596, 0.027497456867559434, 0.02509171942430024, 0.022763683767348167, 0.020601603193363068, 0.01874069919470559, 0.017366617039452623, 0.016690039818682348, 0.01687511475292244, 0.01795764551752984, 0.019835309106887647, 0.022337774426608132, 0.025298947240266604, 0.028587696530432312, 0.0321088533418707, 0.035794502170214675, 0.03959515329844604 ], [ 0.09771276989500055, 0.09621292879762354, 0.09469271167040981, 0.09314924356224642, 0.09157922695334106, 0.08997904050736544, 0.08834485897840776, 0.0866727904924247, 0.08495902620952546, 0.08319999633399552, 0.08139252564251595, 0.07953398120573255, 0.07762240482962113, 0.07565662297203739, 0.07363632750982745, 0.07156212173302069, 0.06943552728193518, 0.06725894933188914, 0.06503559902324692, 0.0627693737276291, 0.06046469699491983, 0.0581263207319723, 0.05575909227591752, 0.053367688858792575, 0.05095632244649105, 0.048528420851784174, 0.046086299077049676, 0.043630851442119624, 0.041161323605289436, 0.03867526638265528, 0.036168830318382195, 0.03363762872829939, 0.031078474873758716, 0.028492391594358225, 0.025889429437205888, 0.023296085346991877, 0.02076656426205675, 0.018399476044832372, 0.016359562220238495, 0.014891871913812672, 0.014285246481398263, 0.01474051467002209, 0.016235484941768522, 0.01856275108348731, 0.021477978970347412, 0.024787736622500566, 0.028359986068380846, 0.032107811046481374, 0.035972897156399154, 0.03991422069640751 ], [ 0.09763352611075747, 0.09615288458405578, 0.09465444691686555, 0.0931351676204452, 0.09159148716138656, 0.09001942413722545, 0.08841469055159144, 0.0867728267583206, 0.08508935142058079, 0.08335992079484993, 0.08158049087142627, 0.07974747543730272, 0.07785789300759184, 0.07590949580886654, 0.07390087457572463, 0.07183153379316214, 0.06970193309692707, 0.06751349170274774, 0.06526855379795599, 0.06297031358489473, 0.06062269890493542, 0.0582302119642703, 0.05579772470933593, 0.053330225346375354, 0.05083251248241575, 0.04830883632959396, 0.045762495194997414, 0.0431954135735116, 0.04060775912418632, 0.03799770229354678, 0.0353614852221406, 0.03269404522405573, 0.029990534406748114, 0.027249207807490145, 0.02447638038011383, 0.02169464567030266, 0.01895663435442243, 0.016368468646629396, 0.014127213426487354, 0.01255852796589028, 0.01206739158341213, 0.012887930606463812, 0.014874715348322161, 0.01767762448889891, 0.020991311275255338, 0.024617738187710025, 0.0284378861329625, 0.03237909797914192, 0.03639454865922909, 0.040451825930165525 ], [ 0.09758666371070152, 0.09612665632432767, 0.09465154668691433, 0.09315813426102897, 0.09164261414771303, 0.09010066295905164, 0.08852754986047019, 0.08691826969316689, 0.08526769383292865, 0.08357073338354898, 0.08182250851471116, 0.08001851728711631, 0.07815479718647411, 0.07622807280665858, 0.07423588364123376, 0.07217668668561462, 0.0700499294040861, 0.0678560894216195, 0.06559667787012184, 0.06327420344739687, 0.06089209375827254, 0.05845456933448032, 0.05596646404454495, 0.05343298399177085, 0.05085939665449644, 0.048250644926208834, 0.0456108896682249, 0.04294300283010501, 0.04024806466842202, 0.037524965966486995, 0.03477028096194831, 0.03197865984053653, 0.02914409648538905, 0.02626258402767282, 0.023336970428277298, 0.020385540004563035, 0.017457654445299123, 0.014663933387202763, 0.012233952206111044, 0.010593780249290235, 0.01030033583343071, 0.011580739342610537, 0.014082449963945554, 0.017318638878102754, 0.020965425162123047, 0.024844403338887967, 0.028857300631447834, 0.032946523846697384, 0.037075453906481634, 0.04121866262886936 ], [ 0.09757726097970036, 0.09613923267184589, 0.0946888706674119, 0.09322283733664137, 0.0917371032063519, 0.09022702694517667, 0.0886874626806265, 0.08711289188478374, 0.08549757576093105, 0.08383572296026172, 0.08212166663315913, 0.08035004432393773, 0.07851597406914268, 0.076615220238599, 0.07464434310791561, 0.07260082677439599, 0.07048318069061346, 0.06829101062282332, 0.0660250550541629, 0.06368718275717344, 0.061280346318604635, 0.05880848480314503, 0.056276366730726106, 0.05368936275552654, 0.05105313708859678, 0.048373249731863896, 0.04565467067832029, 0.042901225675212644, 0.040115024430096964, 0.037295969336192406, 0.03444150817795293, 0.03154688043338708, 0.02860622258317927, 0.025615078193948905, 0.022575221937212415, 0.019503613110342214, 0.016449746881363886, 0.013532017353910821, 0.011015120283660043, 0.009426181079005084, 0.009439573006523623, 0.011176783729288233, 0.014080648480935525, 0.01761339928661899, 0.021475470827600186, 0.02551457810638739, 0.029649069302593353, 0.03383119478088639, 0.03803033845757204, 0.04222498821722122 ], [ 0.09761074240056701, 0.09619598529187535, 0.09477170044981824, 0.09333443361101634, 0.09187995568281938, 0.09040333737371561, 0.08889905336667718, 0.08736111357928181, 0.08578321768271562, 0.0841589278836638, 0.08248185409047859, 0.08074584503904611, 0.07894517875787582, 0.0770747458780717, 0.07513021967196555, 0.07310820722430084, 0.07100637665695954, 0.0688235556712677, 0.06655979666031442, 0.0642164031158665, 0.06179591091640731, 0.05930201638285108, 0.05673944102359547, 0.054113721341141806, 0.05143091215030434, 0.04869719543263138, 0.04591839640194576, 0.043099427382682694, 0.0402437118712486, 0.037352689361314, 0.03442556987084547, 0.03145960129743742, 0.028451247943241918, 0.02539890297470782, 0.022308219461601993, 0.01920227381461442, 0.016141719949135665, 0.013267208542810107, 0.010885590536650627, 0.009569399030113867, 0.00993170782230984, 0.011935902371021427, 0.014998312795250162, 0.018629987798371824, 0.022562383674284016, 0.026655736757995777, 0.03083290908693885, 0.035047701408718324, 0.03927004813068458, 0.04347873284854952 ], [ 0.09769269661952049, 0.09630248198521027, 0.09490554797358537, 0.09349834648739429, 0.09207647769165596, 0.09063475990875135, 0.0891673312661133, 0.08766778092439623, 0.08612930626218994, 0.08454489114536626, 0.08290749945268305, 0.08121027741781887, 0.07944675809311659, 0.07761106130837822, 0.07569808281124243, 0.07370366671690834, 0.07162475581644519, 0.06945951452955368, 0.06720741917719997, 0.06486930966423507, 0.06244739555631444, 0.059945208015529244, 0.057367487478622255, 0.054719996039683194, 0.0520092444522296, 0.04924212832900278, 0.046425479024962815, 0.04356555507563938, 0.04066753380913119, 0.03773511441598686, 0.03477041927726575, 0.03177448991860101, 0.028748841171027457, 0.025698824114762583, 0.022640118812290003, 0.019610930295269474, 0.016695156360793974, 0.014065917349868342, 0.012052710138299293, 0.011156566160431827, 0.011778210911819601, 0.013809768100821684, 0.016799741538368645, 0.020351690547948418, 0.02422153844016103, 0.028269442984373772, 0.03241301817280601, 0.036600929747391556, 0.040799146080089624, 0.044983649138036416 ], [ 0.09782867810932486, 0.096464281600061, 0.09509594375380512, 0.09372004742803353, 0.09233205434955592, 0.0909265709481762, 0.08949744809518141, 0.08803791283318019, 0.08654072864397482, 0.0849983794641124, 0.08340327161799532, 0.08174794715334416, 0.08002530174538011, 0.07822880034828135, 0.07635268403388591, 0.07439216184910229, 0.07234358190044095, 0.07020457608325634, 0.06797417277653643, 0.0656528713312505, 0.0632426712960417, 0.060747048212566226, 0.05817086688326953, 0.05552022302741781, 0.05280220642947914, 0.05002458487612933, 0.04719542090897805, 0.04432265602189231, 0.041413733646180825, 0.03847538855611492, 0.03551381390052546, 0.03253554087740686, 0.029549555909022862, 0.02657149089841081, 0.02363126120281832, 0.020786429553922157, 0.01814458280803714, 0.015896092796054247, 0.014340544130648981, 0.013836472351853552, 0.014600579903324721, 0.016533708026211253, 0.01933175724442618, 0.022694847435580583, 0.026407970440804656, 0.030331772806665856, 0.0343768570674549, 0.03848442413752984, 0.04261431217388117, 0.046737897507641755 ], [ 0.09802400045099262, 0.09668671914337523, 0.09534821384669039, 0.09400482463199875, 0.0926519097997956, 0.09128390834668455, 0.08989443837261824, 0.0884764297470824, 0.08702228772217324, 0.08552408275122018, 0.0839737606454451, 0.08236336644063587, 0.0806852749653319, 0.07893242106575134, 0.0770985226689769, 0.07517829023756491, 0.07316761654818503, 0.07106374097650804, 0.06886538247838436, 0.06657283517111405, 0.06418801989053105, 0.06171448454592244, 0.0591573459724738, 0.05652316708231614, 0.053819766677958486, 0.05105596711724518, 0.0482412995904569, 0.045385711368411935, 0.04249935821576558, 0.03959262361021216, 0.03667659153089942, 0.03376432119351967, 0.030873443910085795, 0.0280308380170759, 0.025280417552479232, 0.022695178732037687, 0.020393598871914238, 0.0185551797471462, 0.017415415939316895, 0.017205411278499318, 0.018038090394425138, 0.019841476632698144, 0.022417503709132095, 0.02554772526854151, 0.02905220398469799, 0.03279945160798175, 0.03669715450634225, 0.04068064028725159, 0.04470388774755277, 0.04873334738333984 ], [ 0.0982835301910486, 0.09697469063650077, 0.09566725573061367, 0.09435754984234014, 0.09304086467265793, 0.09171151903609126, 0.09036295644265445, 0.08898787900303078, 0.08757841446158555, 0.08612631164280184, 0.08462315838668948, 0.08306061521612486, 0.08143065754210771, 0.0797258191379933, 0.07793942982145391, 0.07606584066050719, 0.07410063043920191, 0.07204078745830587, 0.06988486091986273, 0.06763307613298705, 0.0652874076731264, 0.06285160468278282, 0.060331163202748554, 0.05773324256320537, 0.055066527637757594, 0.05234104785783878, 0.049567979559526555, 0.04675948335906661, 0.04392866625217828, 0.041089812732421946, 0.038259103715090725, 0.035456137153769884, 0.032706671617205495, 0.030047096481327883, 0.027531065709947764, 0.025238160751355734, 0.02328254144465906, 0.02181512014025878, 0.02100685837306037, 0.021003191784457025, 0.021865306124522442, 0.023543740827491933, 0.025907924315447674, 0.028800449390331717, 0.03207634349406791, 0.03561810016043887, 0.039335936256997654, 0.04316275966573183, 0.04704854734067519, 0.05095567450850229 ], [ 0.09861149077526878, 0.09733244786199555, 0.09605732392842795, 0.09478245483097311, 0.0935031033101541, 0.09221351672558983, 0.09090702421853099, 0.0895761720016887, 0.08821289367785519, 0.08680871088763095, 0.0853549582997722, 0.08384302605989159, 0.08226461232734121, 0.08061197842601459, 0.0788781993369133, 0.07705740266167163, 0.07514498966834987, 0.07313783248765926, 0.07103444189359831, 0.06883510038373827, 0.06654195558777622, 0.06415906965027242, 0.061692421635003145, 0.05914986293234608, 0.0565410311934488, 0.05387723791294478, 0.051171360249704215, 0.04843779107460762, 0.04569253451197017, 0.042953578349470285, 0.040241727611556276, 0.03758213595427744, 0.035006796990850755, 0.03255819250289374, 0.030294000317767654, 0.028291986202332923, 0.026652632088490728, 0.025494850362769796, 0.024939320142014013, 0.02507907757140355, 0.025949301273004398, 0.02751581790878953, 0.029690054224332817, 0.03235786869107489, 0.035404701428864246, 0.03872948286073693, 0.042249044819853636, 0.045897353422721575, 0.04962278957238355, 0.053385138807909224 ], [ 0.09901128598829657, 0.09776341308505175, 0.09652183612664914, 0.09528292901167103, 0.09404196292975892, 0.092793162619089, 0.09152980339450713, 0.09024434779575817, 0.08892861883895695, 0.08757400518271663, 0.086171692167205, 0.08471291173043208, 0.08318920367896637, 0.08159268066419097, 0.07991628941904208, 0.07815406124298983, 0.07630134527511956, 0.07435501867258733, 0.07231366836324878, 0.07017773958792645, 0.06794964711479266, 0.06563384606039921, 0.06323686113020835, 0.0607672764486616, 0.0582356938697504, 0.055654676843726145, 0.053038710775990844, 0.0504042303943006, 0.04776979019282426, 0.0451564837419961, 0.04258874525386912, 0.040095677094816304, 0.037713008507602536, 0.03548564588274762, 0.033470433656599526, 0.03173811306755191, 0.030372579540916756, 0.02946488708841188, 0.02910027634171399, 0.029340109617338267, 0.03020574449300044, 0.03167291320034777, 0.03367950178817829, 0.03614146693754004, 0.038968778635933655, 0.04207645506027184, 0.045390053131011375, 0.04884717845076811, 0.0523968228085166, 0.055997806096667255 ], [ 0.09948535157144923, 0.09827002302848775, 0.09706320967899706, 0.09586134867767752, 0.09465975583248835, 0.09345268086346441, 0.09223340444829069, 0.09099437602715858, 0.08972738942038302, 0.08842379158458058, 0.08707471842636302, 0.08567135059220136, 0.08420518159159583, 0.08266829046647042, 0.08105361142625228, 0.07935519333009802, 0.0775684425124732, 0.07569034312992913, 0.07371964991188837, 0.071657048951005, 0.06950528308709214, 0.0672692397583847, 0.06495600128880706, 0.06257486097126964, 0.0601373136472987, 0.057657037484733366, 0.05514989491138209, 0.052633995273747215, 0.05012987865161551, 0.04766089581356962, 0.04525386552459397, 0.042940071997819365, 0.0407565966455334, 0.03874782358037185, 0.03696668299176446, 0.03547480796877255, 0.034340415402344046, 0.033632747993971195, 0.03341286122804203, 0.03372256088547635, 0.03457535780660668, 0.035953403613001866, 0.03781166931611151, 0.04008707196082424, 0.04270863833502915, 0.04560571239019962, 0.0487131208793102, 0.05197361866295255, 0.05533846569919819, 0.05876695082961868 ], [ 0.10003504225270099, 0.098853609839803, 0.09768273672402349, 0.09651894656464431, 0.09535763379927732, 0.09419311827878055, 0.09301874234581485, 0.09182700942704619, 0.09060976125479539, 0.0893583890668886, 0.08806407268680473, 0.08671804034954694, 0.08531184154818218, 0.08383762501426029, 0.08228841415019424, 0.08065837271273385, 0.07894305420628352, 0.07713962920158227, 0.07524708560706848, 0.07326639780602284, 0.07120066163094023, 0.06905519356995321, 0.06683759468007071, 0.06455778279764633, 0.062228001210513514, 0.05986281835039253, 0.057479141370577566, 0.05509627613676072, 0.052736075348533536, 0.05042322118834576, 0.04818568163612279, 0.046055348561397716, 0.044068795099456604, 0.042267964550883164, 0.04070042261551037, 0.039418610738158756, 0.038477448865960336, 0.03792984838722932, 0.037820379547549424, 0.03817838211121392, 0.03901263253702685, 0.04030952027260931, 0.04203536623933439, 0.04414184737442615, 0.0465725662551629, 0.049268990813321666, 0.052174810415893745, 0.05523855798389776, 0.05841481114076444, 0.061664422667992415 ], [ 0.10066055939288063, 0.09951432461071352, 0.09838050380818311, 0.09725572792452902, 0.0961355011059581, 0.09501425498061414, 0.09388544565521124, 0.09274169257668087, 0.09157495643174973, 0.09037675146858759, 0.08913838615260997, 0.08785122500526174, 0.08650696385942933, 0.08509791058424304, 0.08361726352740756, 0.08205938040867508, 0.08042003107972658, 0.07869662836384683, 0.07688843205852251, 0.07499672213329887, 0.07302493825716265, 0.0709787841888029, 0.06886629746910305, 0.06669788751807508, 0.06448634889005778, 0.062246861182610976, 0.05999699269989491, 0.05775673057358864, 0.055548563688754105, 0.05339764286967486, 0.05133202972457333, 0.04938301386034759, 0.04758542041951235, 0.045977743752246496, 0.044601841041376884, 0.04350184204929785, 0.0427219522969756, 0.04230303486066708, 0.042278283186278666, 0.04266882514457363, 0.04348043519833793, 0.044702377889852256, 0.04630873728405382, 0.04826175245002193, 0.05051614079209742, 0.05302335878174171, 0.05573508865420513, 0.05860567209972306, 0.06159353820777608, 0.06466183673258433 ], [ 0.10136092200098183, 0.10025110638040427, 0.09915535909099703, 0.09807043628586913, 0.09699197936796386, 0.09591456905854512, 0.09483182208041316, 0.09373652965044113, 0.09262083500870663, 0.09147644541889968, 0.09029487259171985, 0.08906769440267369, 0.08778683013951082, 0.08644482131195762, 0.08503511023337701, 0.08355230905835699, 0.08199245264112871, 0.08035322938781103, 0.07863418516138329, 0.07683689625684008, 0.07496510854268608, 0.07302484116357325, 0.07102445485742966, 0.06897468710749588, 0.06688865912280292, 0.06478186296383687, 0.0626721406349444, 0.06057966974874547, 0.05852697073107963, 0.056538945768577306, 0.05464294613524865, 0.05286883825317193, 0.05124899763821018, 0.04981810697226488, 0.0486125837496455, 0.04766944281179023, 0.04702444986723576, 0.04670957753333513, 0.04675002790606208, 0.04716135408127528, 0.047947354817003414, 0.04909930928136295, 0.0505967665910389, 0.052409664552395, 0.054501232373680916, 0.05683105088816161, 0.05935777280043696, 0.06204122927388184, 0.06484385764178553, 0.06773152258974117 ], [ 0.10213398122986, 0.10106169672527003, 0.10000492719176567, 0.09896056886752432, 0.09792442402284729, 0.09689125487177624, 0.0958548796140472, 0.09480830983372515, 0.09374392653561951, 0.09265369032172584, 0.0915293797302656, 0.09036285067199558, 0.08914630924510443, 0.08787258998366101, 0.08653543174523591, 0.08512974389309362, 0.0836518560895536, 0.08209974581084512, 0.08047323856626488, 0.07877417673872773, 0.07700655398499015, 0.07517661330565321, 0.07329290830472043, 0.07136632888531481, 0.06941009468987033, 0.06743972186302914, 0.065472970808147, 0.06352978374249718, 0.06163221973364881, 0.05980438968822404, 0.05807238235076756, 0.056464153116120415, 0.05500932068836995, 0.053738786826714686, 0.052684072483074273, 0.05187626717469537, 0.05134453732986301, 0.05111424425150004, 0.05120486881462443, 0.051628079284913926, 0.05238634045761847, 0.05347239366509984, 0.05486974449730314, 0.056554051967414344, 0.05849511905221507, 0.060659106357633386, 0.06301063055659628, 0.06551452093699056, 0.06813713350611593, 0.07084722292680702 ], [ 0.10297647588900444, 0.10194269729014863, 0.10092566882010917, 0.09992243853141503, 0.09892898901881644, 0.0979402911316051, 0.09695039897463906, 0.09595258543981756, 0.09493951560446935, 0.09390345358465388, 0.09283649696869786, 0.09173083187022339, 0.09057900097387903, 0.08937417669623249, 0.08811043170318732, 0.08678299944079575, 0.08538851796470263, 0.08392525111722088, 0.08239328194359101, 0.08079467413439399, 0.07913359823750143, 0.07741642043776134, 0.07565175290739796, 0.07385046612235434, 0.07202566509894236, 0.07019263309061231, 0.06836874756043723, 0.06657337360554205, 0.06482773854564092, 0.06315478695904832, 0.061579006970344, 0.06012620563866832, 0.05882319506341545, 0.05769733527548216, 0.05677587254644424, 0.05608502251499629, 0.055648785735119805, 0.05548755088170908, 0.055616625792118415, 0.05604491067762139, 0.056773955711024005, 0.05779760233599276, 0.05910229846254628, 0.06066803816899155, 0.06246975662379521, 0.06447894846273311, 0.06666528188369819, 0.06899803390181507, 0.07144724573826863, 0.07398456610610162 ], [ 0.10388412424855538, 0.1028896652137078, 0.10191297979893019, 0.10095127650590978, 0.10000073351735145, 0.09905655209106913, 0.09811305007514975, 0.09716379478849876, 0.09620177266202633, 0.09521959133298905, 0.09420970845224479, 0.09316468038939997, 0.09207742334752386, 0.09094147912528167, 0.08975127784916076, 0.08850239037445798, 0.08719176364213081, 0.08581793300494255, 0.08438120634321652, 0.0828838156463922, 0.08133003263800756, 0.07972624598856969, 0.07808099872233631, 0.07640498559558119, 0.07471101147209086, 0.07301391292068779, 0.07133044614435202, 0.06967914448259946, 0.06808014750500566, 0.06655500046470841, 0.0651264171129857, 0.06381799069595978, 0.06265382863497936, 0.06165807889223521, 0.0608543150603326, 0.06026475834359712, 0.059909341903017894, 0.059804665757958855, 0.059962940098323245, 0.06039105541049783, 0.0610899307301153, 0.06205426458792324, 0.06327274933645617, 0.06472872673311067, 0.06640118703384049, 0.06826596729626933, 0.07029699577533988, 0.07246745268735327, 0.07475075921550128, 0.0771213515467284 ], [ 0.10485174565429665, 0.10389723955325186, 0.10296132215959289, 0.10204136811626464, 0.10113376237509628, 0.10023395309492787, 0.09933654320713228, 0.09843541988624868, 0.0975239193848679, 0.09659502304852252, 0.09564157893540262, 0.09465654241157175, 0.09363322841811, 0.09256556781304394, 0.09144836024234325, 0.09027751632954734, 0.08905028252007273, 0.08776544260375056, 0.08642349071165141, 0.08502677140648704, 0.08357958334926795, 0.08208824393709606, 0.08056111328411553, 0.07900857696411377, 0.07744298801548057, 0.07587856972517441, 0.0743312814596601, 0.07281864999078587, 0.07135956798402253, 0.0699740591946196, 0.06868300626433087, 0.06750783210344123, 0.06647012073445036, 0.06559116020432554, 0.06489139162953511, 0.06438975762761438, 0.06410296202659868, 0.06404467951161674, 0.06422478322477972, 0.06464868104641427, 0.06531685733534492, 0.06622470002233133, 0.06736265445893055, 0.06871669483261524, 0.07026905540586939, 0.0719991301975474, 0.07388443770568907, 0.0759015559387717, 0.07802695582929893, 0.08023768956220736 ], [ 0.1058734043482562, 0.10495929064840281, 0.10406437879513682, 0.10318621255249094, 0.10232139097245048, 0.10146562057895595, 0.10061380452557427, 0.09976016795244119, 0.09889841707188014, 0.09802192793975571, 0.097123959531145, 0.09619788471435829, 0.09523743204910529, 0.09423693102620546, 0.09319155338739302, 0.09209754346023374, 0.09095243094919898, 0.08975522027485291, 0.08850655129573942, 0.08720882704715206, 0.08586630497276962, 0.08448514901069938, 0.08307344083275559, 0.08164114952381404, 0.08020005999700369, 0.07876366139058395, 0.07734699743768693, 0.07596648112759899, 0.07463967563537234, 0.07338504226937805, 0.07222165402219355, 0.07116887049290124, 0.07024596726364554, 0.06947171160931889, 0.06886387843885028, 0.06843870723375992, 0.06821031313737627, 0.06819008207370297, 0.06838609731431435, 0.06880265787430938, 0.0694399519000273, 0.07029393735818897, 0.07135645850030267, 0.07261559486663101, 0.07405620789642618, 0.07566062622968345, 0.07740939931595037, 0.07928205065453275, 0.08125777400057345, 0.08331603348649814 ], [ 0.10694256742980432, 0.10606908391217124, 0.10521522272675377, 0.10437869730947473, 0.10355632461435973, 0.10274407634258058, 0.10193716526068974, 0.1011301658193617, 0.1003171666795648, 0.09949195126131687, 0.0986482011532659, 0.09777971623466493, 0.09688064470624518, 0.0959457159091823, 0.0949704688069882, 0.09395146926665916, 0.09288650974437987, 0.09177478559901384, 0.09061704297423426, 0.0894156939734509, 0.08817489568358063, 0.08690059048078007, 0.08560050597576632, 0.08428411392375033, 0.08296254840809207, 0.08164848454467394, 0.08035597973705481, 0.0791002799899081, 0.07789759379329633, 0.0767648354965817, 0.07571933890023613, 0.07477854024206472, 0.07395962839569266, 0.07327915981045367, 0.07275263755498705, 0.07239405866961346, 0.07221544211864238, 0.07222636006689345, 0.07243350576377694, 0.07284033880103302, 0.0734468496802861, 0.07424947849202689, 0.07524120736525917, 0.07641182600979037, 0.0777483486551911, 0.07923554367475528, 0.0808565274810279, 0.08259337295860536, 0.08442768864137179, 0.08634113551940112 ], [ 0.10805226905402349, 0.10721944974891563, 0.10640649230778483, 0.10561127827261158, 0.10483084315114419, 0.10406142644358556, 0.10329855473322971, 0.10253715703881178, 0.10177171012064863, 0.1009964100287279, 0.10020536497297873, 0.09939280365443016, 0.09855329256096854, 0.09768195541147345, 0.09677468790777234, 0.09582836118510714, 0.09484100778770586, 0.09381198458448359, 0.0927421077358856, 0.09163375559386319, 0.090490936244337, 0.08931931727800833, 0.08812621629844894, 0.08692055163834739, 0.0857127537312612, 0.08451463852584017, 0.08333924514858604, 0.0822006406093754, 0.08111369458565945, 0.08009382713776417, 0.07915673161657812, 0.07831807420441411, 0.07759317086157187, 0.07699664250351601, 0.07654205064921484, 0.07624151905654288, 0.07610535205604164, 0.07614166677783278, 0.07635606283849734, 0.0767513573788036, 0.07732741369686191, 0.07808108691107447, 0.07900630023098626, 0.08009425209368255, 0.08133374028177574, 0.0827115770647011, 0.08421306164846779, 0.08582247380335271, 0.08752355515448726, 0.0892999509540395 ], [ 0.10919527364205701, 0.10840295205299388, 0.10763056452562127, 0.1068761573471184, 0.10613698249001105, 0.10540954619630231, 0.10468968850797997, 0.10397269293117704, 0.10325342401872702, 0.10252648934482488, 0.10178642121215078, 0.101027872541458, 0.100245820784907, 0.09943577338795782, 0.09859396828592722, 0.09771756312711105, 0.09680480732090192, 0.09585519157073326, 0.09486957022728972, 0.09385025255631671, 0.0928010598378324, 0.09172734608899633, 0.0906359811243694, 0.08953529562378051, 0.08843498884555774, 0.08734600055734948, 0.08628034959108288, 0.08525094207850754, 0.08427135280530772, 0.08335558318190703, 0.08251779908610327, 0.08177205141571056, 0.08113198185917407, 0.08061051651999374, 0.08021955101721155, 0.07996963281630678, 0.07986964982226394, 0.07992653826005842, 0.0801450266922102, 0.08052743548759153, 0.08107355099040481, 0.08178059030563452, 0.08264326604960189, 0.08365395151751753, 0.08480293707228156, 0.08607875996590689, 0.08746858378584918, 0.08895860111829346, 0.09053443387520461, 0.09218150939183607 ], [ 0.11036423192954632, 0.10961204888300032, 0.10887971979439647, 0.10816545085553368, 0.10746670609170234, 0.1067802542813056, 0.1061022446570007, 0.10542831056993829, 0.10475369900143344, 0.10407342259113478, 0.1033824297957208, 0.10267578795755494, 0.10194887348549735, 0.10119756304251061, 0.100418419586778, 0.09960886729771978, 0.09876734979839809, 0.09789346662139388, 0.096988083519658, 0.09605341296783729, 0.09509306201253302, 0.09411204549823812, 0.09311676360839807, 0.09211494360379194, 0.09111554658879445, 0.090128641050566, 0.08916524574097187, 0.08823714513939243, 0.08735668118287378, 0.08653652513998183, 0.08578943345085921, 0.08512799115031232, 0.08456434631214987, 0.08410993904770098, 0.08377522921561542, 0.083569428327076, 0.08350024314475296, 0.08357364089004934, 0.08379364822891179, 0.08416219755869414, 0.08467903384052715, 0.08534169284654741, 0.08614555721363434, 0.08708399064228241, 0.08814854390945188, 0.08932922022048082, 0.09061478283081739, 0.09199308547610119, 0.093451406121398, 0.09497676658126301 ], [ 0.11155182495013508, 0.11083924026783833, 0.1101462930816624, 0.10947134346560816, 0.10881206117065091, 0.10816547068434364, 0.10752802290017921, 0.10689569257847246, 0.10626409958865533, 0.10562865080424425, 0.10498469854698643, 0.10432771070092821, 0.10365344707544052, 0.1029581363020982, 0.10223864749758682, 0.1014926510919331, 0.10071876357715875, 0.09991667144128955, 0.09908723018358259, 0.09823253503113429, 0.09735596077336281, 0.0964621689829878, 0.09555708178565092, 0.09464782225786822, 0.0937426224494652, 0.09285070090564607, 0.09198211235770422, 0.09114757290586661, 0.09035826448308054, 0.08962562263571824, 0.08896111169671465, 0.08837599132416009, 0.08788107825791018, 0.08748650717511251, 0.08720149487137063, 0.08703411276790506, 0.08699107393189019, 0.08707754221086639, 0.08729697236376195, 0.08765099075128327, 0.08813932576831832, 0.08875979545954323, 0.0895083566369831, 0.09037921562607233, 0.09136499609583507, 0.09245695501054733, 0.09364523426474063, 0.09491913351713686, 0.09626738931130382, 0.09767844664862292 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.13548159506171942, 0.7715970023607761, 0.70715186787552, 0.779877294460537, 0.8054095631704994, 0.8216189984552362, 0.8260330970081138, 0.8386134307724713, 0.8742978490790047, 0.8222262713513913, 0.7559055906501213, 0.6283103805035353, 0.6928945518794042, 0.6822510192984066, 0.6307574199161775, 0.56437601211232, 0.21400925889611244, 0.8884426606819034, 0.005685089156031609, 0.030895396135747433, 0.8373321079022971, 0.8896320122204858, 0.8840449486301265, 0.8099996009464986 ], "xaxis": "x", "y": [ 0.7561056585982442, 0.5061531990241815, 0.56669967831188, 0.5390836500437907, 0.5509956046826343, 0.5664201204191455, 0.4857367755810991, 0.4342234580085252, 0.3785755207399448, 0.4470981108888929, 0.44244709244167457, 0.660033899359405, 0.43066747727341664, 0.4250607631481191, 0.4048254297863961, 0.3659604610715271, 0.17033363413065672, 0.31031820084899664, 0.6535384561866522, 0.05934012681245804, 0.4289783835679664, 0.36828767222529085, 0.35650578954017487, 0.4611910175198948 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.13548159506171942, 0.7715970023607761, 0.70715186787552, 0.779877294460537, 0.8054095631704994, 0.8216189984552362, 0.8260330970081138, 0.8386134307724713, 0.8742978490790047, 0.8222262713513913, 0.7559055906501213, 0.6283103805035353, 0.6928945518794042, 0.6822510192984066, 0.6307574199161775, 0.56437601211232, 0.21400925889611244, 0.8884426606819034, 0.005685089156031609, 0.030895396135747433, 0.8373321079022971, 0.8896320122204858, 0.8840449486301265, 0.8099996009464986 ], "xaxis": "x2", "y": [ 0.7561056585982442, 0.5061531990241815, 0.56669967831188, 0.5390836500437907, 0.5509956046826343, 0.5664201204191455, 0.4857367755810991, 0.4342234580085252, 0.3785755207399448, 0.4470981108888929, 0.44244709244167457, 0.660033899359405, 0.43066747727341664, 0.4250607631481191, 0.4048254297863961, 0.3659604610715271, 0.17033363413065672, 0.31031820084899664, 0.6535384561866522, 0.05934012681245804, 0.4289783835679664, 0.36828767222529085, 0.35650578954017487, 0.4611910175198948 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.4140247365715448, -0.5342261320108047, -0.5540633060604094, -0.7369082791906303, -0.8934067504634703, -0.9421418215111894, -1.3615704822905055, -1.575304034484366, -1.575304034484366, -1.6242168173244302, -1.8532439502531282, -1.8739156226741267, -2.0829785650037738, -2.318413598725758, -2.629910433268494, -2.9571120706950236 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.43413763772696257
x2: 0.9719485333189368
x3: 0.13548159506171942
x4: 0.7561056585982442
x5: 0.1279012355953455
x6: 0.41060026176273823", "
Parameterization:
x1: 0.5144911119714379
x2: 0.3260774752125144
x3: 0.6283103805035353
x4: 0.660033899359405
x5: 0.6633850391954184
x6: 0.16821173392236233", "
Parameterization:
x1: 0.8116078386083245
x2: 0.6973032038658857
x3: 0.21400925889611244
x4: 0.17033363413065672
x5: 0.6235534008592367
x6: 0.04481180850416422", "
Parameterization:
x1: 0.14312737341970205
x2: 0.3258649166673422
x3: 0.8884426606819034
x4: 0.31031820084899664
x5: 0.5521565461531281
x6: 0.2246497981250286", "
Parameterization:
x1: 0.6365205738693476
x2: 0.27098294999450445
x3: 0.005685089156031609
x4: 0.6535384561866522
x5: 0.9199645705521107
x6: 0.583699544891715", "
Parameterization:
x1: 0.6417205417528749
x2: 0.778496784158051
x3: 0.030895396135747433
x4: 0.05934012681245804
x5: 0.27596268244087696
x6: 0.8647943297401071", "
Parameterization:
x1: 0.24426917104196152
x2: 0.207305280478096
x3: 0.8373321079022971
x4: 0.4289783835679664
x5: 0.5324167719413223
x6: 0.12682723920793812", "
Parameterization:
x1: 0.15374109356462698
x2: 0.5089794914442768
x3: 0.8896320122204858
x4: 0.36828767222529085
x5: 0.5412235670309816
x6: 0.3238808515454347", "
Parameterization:
x1: 0.15414987463767546
x2: 0.4404732501049041
x3: 0.8840449486301265
x4: 0.35650578954017487
x5: 0.5417597936659393
x6: 0.2913468936107752", "
Parameterization:
x1: 0.18579529988746893
x2: 0.44488964434776357
x3: 0.8099996009464986
x4: 0.4611910175198948
x5: 0.4644651189845204
x6: 0.3071397613751825", "
Parameterization:
x1: 0.19730751444756675
x2: 0.4652114945789433
x3: 0.7715970023607761
x4: 0.5061531990241815
x5: 0.3989468715122135
x6: 0.3496267755424289", "
Parameterization:
x1: 0.19751679738611722
x2: 0.5072600635782516
x3: 0.70715186787552
x4: 0.56669967831188
x5: 0.31708771863259483
x6: 0.39617611268526337", "
Parameterization:
x1: 0.21355282102645884
x2: 0.4002120972197617
x3: 0.779877294460537
x4: 0.5390836500437907
x5: 0.3412236648892386
x6: 0.4492213224885043", "
Parameterization:
x1: 0.23448520715756652
x2: 0.31790447256867355
x3: 0.8054095631704994
x4: 0.5509956046826343
x5: 0.32058533649906557
x6: 0.5144466721396936", "
Parameterization:
x1: 0.25733623957826796
x2: 0.24379007088567353
x3: 0.8216189984552362
x4: 0.5664201204191455
x5: 0.303388642809209
x6: 0.5610326534747718", "
Parameterization:
x1: 0.19975427627456266
x2: 0.23203501998954595
x3: 0.8260330970081138
x4: 0.4857367755810991
x5: 0.26894898795596817
x6: 0.5739364908235973", "
Parameterization:
x1: 0.15077880591433257
x2: 0.16708629284851223
x3: 0.8386134307724713
x4: 0.4342234580085252
x5: 0.21906642648464802
x6: 0.6508141328179886", "
Parameterization:
x1: 0.18984569124974923
x2: 0.1955648537399401
x3: 0.8742978490790047
x4: 0.3785755207399448
x5: 0.15265182483734832
x6: 0.6292924263479385", "
Parameterization:
x1: 0.09971548764326511
x2: 0.10959977840281686
x3: 0.8222262713513913
x4: 0.4470981108888929
x5: 0.25521057724898966
x6: 0.6904891544159615", "
Parameterization:
x1: 0.1167240189855746
x2: 0.16990319663011166
x3: 0.7559055906501213
x4: 0.44244709244167457
x5: 0.24023657037286802
x6: 0.7395210908131238", "
Parameterization:
x1: 0.12160781534632646
x2: 0.20717603832193046
x3: 0.6928945518794042
x4: 0.43066747727341664
x5: 0.21856848345923818
x6: 0.8087826603125855", "
Parameterization:
x1: 0.143296294622118
x2: 0.1313050531769679
x3: 0.6822510192984066
x4: 0.4250607631481191
x5: 0.23194416708818705
x6: 0.7367671903978374", "
Parameterization:
x1: 0.15764270578649853
x2: 0.05095136177245756
x3: 0.6307574199161775
x4: 0.4048254297863961
x5: 0.2421622150680818
x6: 0.7017629276409911", "
Parameterization:
x1: 0.1603766378738894
x2: 3.7236782755712533e-16
x3: 0.56437601211232
x4: 0.3659604610715271
x5: 0.2568844307143093
x6: 0.6700580089528931", "
Parameterization:
x1: 0.1458641750205541
x2: 3.272165113777831e-16
x3: 0.47933067831538995
x4: 0.30450283603229594
x5: 0.2781258188166349
x6: 0.6383327489208733" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.4140247365715448, -0.5342261320108047, -0.5540633060604094, -0.7369082791906303, -0.8934067504634703, -0.9421418215111894, -1.3615704822905055, -1.575304034484366, -1.575304034484366, -1.6242168173244302, -1.8532439502531282, -1.8739156226741267, -2.0829785650037738, -2.318413598725758, -2.629910433268494, -2.9571120706950236 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.30550909019944583, -0.4140247365715448, -0.5342261320108047, -0.5540633060604094, -0.7369082791906303, -0.8934067504634703, -0.9421418215111894, -1.3615704822905055, -1.575304034484366, -1.575304034484366, -1.6242168173244302, -1.8532439502531282, -1.8739156226741267, -2.0829785650037738, -2.318413598725758, -2.629910433268494, -2.9571120706950236 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:05] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:06] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "In WithDBSettings, db settings: None\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:06] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "In WithDBSettings, db settings: DBSettings(creator=None, decoder=, encoder=, url='postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar')\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:08] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.13, 'x2': 0.0, 'x3': 0.39, 'x4': 0.25, 'x5': 0.3, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:08] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:08] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:08] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-10 18:27:08] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "In WithDBSettings, db settings: None\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.1" } }, "nbformat": 4, "nbformat_minor": 2 }