{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:56] ipy_plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.88, 'x2': 0.68, 'x3': 0.21, 'x4': 0.64, 'x5': 0.66, 'x6': 0.02}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.04, 0.0), 'l2norm': (1.46, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.02, 'x2': 0.67, 'x3': 0.47, 'x4': 0.84, 'x5': 0.24, 'x6': 0.13}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.08, 0.0), 'l2norm': (1.2, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.3, 'x2': 0.94, 'x3': 0.94, 'x4': 0.58, 'x5': 0.99, 'x6': 0.84}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.0, 0.0), 'l2norm': (1.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.03, 'x2': 0.47, 'x3': 0.6, 'x4': 0.09, 'x5': 0.78, 'x6': 0.11}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.12, 0.0), 'l2norm': (1.1, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.38, 'x2': 0.9, 'x3': 0.16, 'x4': 0.19, 'x5': 0.24, 'x6': 0.59}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.31, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.48, 'x2': 0.54, 'x3': 0.36, 'x4': 0.75, 'x5': 0.6, 'x6': 0.34}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:17:57] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.25, 0.0), 'l2norm': (1.3, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:02] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.4, 'x2': 0.79, 'x3': 0.2, 'x4': 0.32, 'x5': 0.32, 'x6': 0.55}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:02] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.61, 0.0), 'l2norm': (1.15, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:07] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.42, 'x2': 0.73, 'x3': 0.22, 'x4': 0.39, 'x5': 0.36, 'x6': 0.54}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:07] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.66, 0.0), 'l2norm': (1.15, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:12] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.33, 'x2': 0.71, 'x3': 0.22, 'x4': 0.35, 'x5': 0.38, 'x6': 0.51}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:12] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.75, 0.0), 'l2norm': (1.09, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:16] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.28, 'x2': 0.61, 'x3': 0.18, 'x4': 0.32, 'x5': 0.41, 'x6': 0.51}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:16] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.95, 0.0), 'l2norm': (1.01, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:19] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.25, 'x2': 0.52, 'x3': 0.14, 'x4': 0.27, 'x5': 0.43, 'x6': 0.54}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:19] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-1.16, 0.0), 'l2norm': (0.95, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:23] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.22, 'x2': 0.42, 'x3': 0.09, 'x4': 0.23, 'x5': 0.44, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:23] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-1.34, 0.0), 'l2norm': (0.9, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:26] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.17, 'x2': 0.32, 'x3': 0.0, 'x4': 0.26, 'x5': 0.45, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:26] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.39, 0.0), 'l2norm': (0.85, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:28] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.24, 'x2': 0.23, 'x3': 0.06, 'x4': 0.19, 'x5': 0.41, 'x6': 0.56}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:29] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.7, 0.0), 'l2norm': (0.79, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:32] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.3, 'x2': 0.11, 'x3': 0.08, 'x4': 0.14, 'x5': 0.37, 'x6': 0.54}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:32] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.72, 0.0), 'l2norm': (0.75, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:35] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.32, 'x2': 0.18, 'x3': 0.04, 'x4': 0.12, 'x5': 0.44, 'x6': 0.52}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:36] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.15, 0.0), 'l2norm': (0.79, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:39] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.2, 'x2': 0.17, 'x3': 0.09, 'x4': 0.22, 'x5': 0.36, 'x6': 0.59}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:39] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.3, 0.0), 'l2norm': (0.77, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:43] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.14, 'x2': 0.12, 'x3': 0.14, 'x4': 0.26, 'x5': 0.31, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:43] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.67, 0.0), 'l2norm': (0.78, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:47] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.08, 'x2': 0.12, 'x3': 0.15, 'x4': 0.24, 'x5': 0.24, 'x6': 0.62}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:47] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.32, 0.0), 'l2norm': (0.73, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:50] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.14, 'x2': 0.07, 'x3': 0.18, 'x4': 0.33, 'x5': 0.33, 'x6': 0.69}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:50] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.68, 0.0), 'l2norm': (0.86, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:54] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.16, 'x2': 0.12, 'x3': 0.13, 'x4': 0.32, 'x5': 0.3, 'x6': 0.69}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:54] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.68, 0.0), 'l2norm': (0.85, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:58] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.12, 'x2': 0.12, 'x3': 0.16, 'x4': 0.26, 'x5': 0.32, 'x6': 0.7}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:18:58] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.7, 0.0), 'l2norm': (0.84, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:02] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.13, 'x2': 0.16, 'x3': 0.19, 'x4': 0.32, 'x5': 0.31, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:02] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.78, 0.0), 'l2norm': (0.85, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:05] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.06, 'x2': 0.16, 'x3': 0.16, 'x4': 0.36, 'x5': 0.32, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:05] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.45, 0.0), 'l2norm': (0.85, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:09] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.17, 'x2': 0.16, 'x3': 0.25, 'x4': 0.29, 'x5': 0.3, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:09] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.0, 0.0), 'l2norm': (0.86, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:09] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.88, 'x2': 0.68, 'x3': 0.21, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.02, 'x2': 0.67, 'x3': 0.47, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.3, 'x2': 0.94, 'x3': 0.94, 'x...
30Sobol3COMPLETED{'3_0': {'x1': 0.03, 'x2': 0.47, 'x3': 0.6, 'x...
40Sobol4COMPLETED{'4_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.16, 'x...
50Sobol5COMPLETED{'5_0': {'x1': 0.48, 'x2': 0.54, 'x3': 0.36, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.4, 'x2': 0.79, 'x3': 0.2, 'x4...
71GPEI7COMPLETED{'7_0': {'x1': 0.42, 'x2': 0.73, 'x3': 0.22, '...
81GPEI8COMPLETED{'8_0': {'x1': 0.33, 'x2': 0.71, 'x3': 0.22, '...
91GPEI9COMPLETED{'9_0': {'x1': 0.28, 'x2': 0.61, 'x3': 0.18, '...
101GPEI10COMPLETED{'10_0': {'x1': 0.25, 'x2': 0.52, 'x3': 0.14, ...
111GPEI11COMPLETED{'11_0': {'x1': 0.22, 'x2': 0.42, 'x3': 0.09, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.17, 'x2': 0.32, 'x3': 0.0, '...
131GPEI13COMPLETED{'13_0': {'x1': 0.24, 'x2': 0.23, 'x3': 0.06, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.3, 'x2': 0.11, 'x3': 0.08, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.32, 'x2': 0.18, 'x3': 0.04, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.2, 'x2': 0.17, 'x3': 0.09, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.14, 'x2': 0.12, 'x3': 0.14, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.08, 'x2': 0.12, 'x3': 0.15, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.14, 'x2': 0.07, 'x3': 0.18, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.16, 'x2': 0.12, 'x3': 0.13, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.12, 'x2': 0.12, 'x3': 0.16, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.13, 'x2': 0.16, 'x3': 0.19, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.06, 'x2': 0.16, 'x3': 0.16, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.17, 'x2': 0.16, 'x3': 0.25, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.88, 'x2': 0.68, 'x3': 0.21, '... \n", "1 {'1_0': {'x1': 0.02, 'x2': 0.67, 'x3': 0.47, '... \n", "2 {'2_0': {'x1': 0.3, 'x2': 0.94, 'x3': 0.94, 'x... \n", "3 {'3_0': {'x1': 0.03, 'x2': 0.47, 'x3': 0.6, 'x... \n", "4 {'4_0': {'x1': 0.38, 'x2': 0.9, 'x3': 0.16, 'x... \n", "5 {'5_0': {'x1': 0.48, 'x2': 0.54, 'x3': 0.36, '... \n", "6 {'6_0': {'x1': 0.4, 'x2': 0.79, 'x3': 0.2, 'x4... \n", "7 {'7_0': {'x1': 0.42, 'x2': 0.73, 'x3': 0.22, '... \n", "8 {'8_0': {'x1': 0.33, 'x2': 0.71, 'x3': 0.22, '... \n", "9 {'9_0': {'x1': 0.28, 'x2': 0.61, 'x3': 0.18, '... \n", "10 {'10_0': {'x1': 0.25, 'x2': 0.52, 'x3': 0.14, ... \n", "11 {'11_0': {'x1': 0.22, 'x2': 0.42, 'x3': 0.09, ... \n", "12 {'12_0': {'x1': 0.17, 'x2': 0.32, 'x3': 0.0, '... \n", "13 {'13_0': {'x1': 0.24, 'x2': 0.23, 'x3': 0.06, ... \n", "14 {'14_0': {'x1': 0.3, 'x2': 0.11, 'x3': 0.08, '... \n", "15 {'15_0': {'x1': 0.32, 'x2': 0.18, 'x3': 0.04, ... \n", "16 {'16_0': {'x1': 0.2, 'x2': 0.17, 'x3': 0.09, '... \n", "17 {'17_0': {'x1': 0.14, 'x2': 0.12, 'x3': 0.14, ... \n", "18 {'18_0': {'x1': 0.08, 'x2': 0.12, 'x3': 0.15, ... \n", "19 {'19_0': {'x1': 0.14, 'x2': 0.07, 'x3': 0.18, ... \n", "20 {'20_0': {'x1': 0.16, 'x2': 0.12, 'x3': 0.13, ... \n", "21 {'21_0': {'x1': 0.12, 'x2': 0.12, 'x3': 0.16, ... \n", "22 {'22_0': {'x1': 0.13, 'x2': 0.16, 'x3': 0.19, ... \n", "23 {'23_0': {'x1': 0.06, 'x2': 0.16, 'x3': 0.16, ... \n", "24 {'24_0': {'x1': 0.17, 'x2': 0.16, 'x3': 0.25, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.12859024975029584,\n", " 'x2': 0.15594040991809416,\n", " 'x3': 0.18911064178937825,\n", " 'x4': 0.32202352725995437,\n", " 'x5': 0.3142047735342513,\n", " 'x6': 0.6618478596982934}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.7789765595087665, 'l2norm': 0.8468072270748745}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:09] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.7460374440255557, -1.8192327561513733, -1.8867560388313467, -1.9469652215278908, -1.9982669468221455, -2.0392180204349915, -2.0686284101804033, -2.0856496523908508, -2.0898335618738892, -2.081152261500344, -2.0599796167761633, -2.027042368758865, -1.9833533727009622, -1.930138601286579, -1.8687657779830809, -1.800678463215456, -1.7273369848112534, -1.6501669584040657, -1.57051636410994, -1.4896222544943196, -1.4085877395555655, -1.3283690561091064, -1.2497716478798717, -1.1734535611663033, -1.0999342114514519, -1.0296066497701075, -0.9627517322544251, -0.8995529515674265, -0.8401110402588398, -0.7844577585263347, -0.7325685170453451, -0.6843736611979041, -0.6397683656538585, -0.5986211693229095, -0.5607812308999521, -0.5260844134157286, -0.4943583192248292, -0.46542639978708367, -0.43911126107615717, -0.4152372780431355, -0.3936326220337558, -0.374130794588, -0.3565717504121413, -0.34080268199318087, -0.32667852861454194, -0.3140622635893484, -0.30282500542559987, -0.29284599139273837, -0.28401244555285454, -0.27621936771288547 ], [ -1.7667717549641964, -1.8418080792764921, -1.9111000011855557, -1.972938443101265, -2.025658613586537, -2.0677484657334464, -2.0979599226633323, -2.1154047371639773, -2.119617752051611, -2.110577339503926, -2.0886834248737727, -2.0547030528289696, -2.0096979330524527, -1.9549469735768192, -1.8918719193175684, -1.8219694121401702, -1.746750247411377, -1.6676862823220884, -1.5861660398856228, -1.503460325893892, -1.4206986940290385, -1.3388566004351612, -1.2587520666803889, -1.1810499780531154, -1.1062718933270614, -1.0348093547227175, -0.9669390120297781, -0.9028382745243013, -0.8426005873030051, -0.7862497503723488, -0.7337529468717928, -0.6850323261999085, -0.6399751105947539, -0.5984422731277189, -0.5602758828612315, -0.5253052385383606, -0.49335192276659945, -0.4642339094377239, -0.43776885178283087, -0.41377666955137216, -0.39208154305629894, -0.37251341038650754, -0.35490905268499984, -0.3391128414745779, -0.3249772118407612, -0.3123629159841417, -0.3011391032812858, -0.29118326554254237, -0.282381079594086, -0.2746261735900808 ], [ -1.784322616075706, -1.8609915795800567, -1.9318578630140517, -1.9951516193487755, -2.049142559335027, -2.0922549777819897, -2.1231868712224315, -2.141013025238234, -2.1452526510974863, -2.135890073444461, -2.1133492476401714, -2.0784338527499866, -2.032249508945599, -1.9761224186655038, -1.9115226227636533, -1.8399945011336003, -1.7630945982517252, -1.6823369742616183, -1.5991472915245502, -1.5148272724109595, -1.4305305894631843, -1.34725006660452, -1.2658148924435795, -1.1868957848368205, -1.111015799822886, -1.038564635022534, -0.9698146558090013, -0.9049373166261514, -0.8440190634019206, -0.7870761427285078, -0.7340680003904198, -0.6849091342945813, -0.6394793894582788, -0.597632760315218, -0.559204810946828, -0.524018846918054, -0.49189098061804293, -0.4626342307044411, -0.43606178915115235, -0.41198957904829603, -0.3902382143979636, -0.37063446079291174, -0.3530122837476286, -0.3372135599828483, -0.3230885163690951, -0.3104959516154209, -0.29930328717212107, -0.2893864861817226, -0.28062987261444894, -0.2729258769024372 ], [ -1.7984501211069635, -1.8765129513179983, -1.9487286718478676, -2.0132744365010975, -2.068362215260923, -2.1123597160205296, -2.143916746845152, -2.1620750002512983, -2.1663397005674305, -2.156700369373795, -2.133601906791883, -2.0978795702790123, -2.050676491747091, -1.9933591901443144, -1.9274391429899476, -1.8545022026970934, -1.7761452084436657, -1.6939198088768879, -1.6092849718848283, -1.523570207215549, -1.4379508164538257, -1.3534350851019232, -1.270861990476043, -1.1909071710453933, -1.114094667555901, -1.0408121511949533, -0.9713277858174284, -0.9058073586057347, -0.8443307561479486, -0.786907219389014, -0.7334890758923185, -0.6839838330082015, -0.6382646378250556, -0.5961791855790475, -0.5575572011612432, -0.522216638970487, -0.4899687522943559, -0.46062218010014855, -0.4339861903406377, -0.40987320715918185, -0.3881007363821257, -0.3684927904746359, -0.3508809013583045, -0.3351047975161996, -0.32101281083368627, -0.3084620687162891, -0.2973185181928846, -0.2874568209170685, -0.27876015116251707, -0.2711199229997021 ], [ -1.8089385475188648, -1.88812794158033, -1.961439106573983, -2.0270054236293236, -2.082990673438618, -2.1277149501898784, -2.159787283664873, -2.1782212468866193, -2.1825100313569012, -2.1726471164573278, -2.1490941852222316, -2.1127116485218864, -2.0646723632800477, -2.0063749458788696, -1.9393644095731595, -1.8652609568121146, -1.7856955648324668, -1.7022522925811403, -1.616419152965491, -1.5295500252233758, -1.4428391918481709, -1.3573084469822918, -1.2738052172553447, -1.1930092474473333, -1.1154451833593075, -1.0414986381228486, -0.9714338120579079, -0.9054112646749395, -0.8435049072914322, -0.7857176568640146, -0.7319954641962403, -0.68223961740179, -0.6363173435172051, -0.5940708052772339, -0.5553246307786516, -0.5198921320275847, -0.4875803721208596, -0.45819423560919414, -0.4315396462218428, -0.40742606312358143, -0.38566837286016, -0.3660882801485643, -0.3485152872901658, -0.3327873395601397, -0.31875120261203516, -0.30626262777856095, -0.2951863521312523, -0.2853959722289614, -0.27677372356760865, -0.26921019176267413 ], [ -1.8156022199950725, -1.8956254019424286, -1.9697518069053292, -2.036081565310295, -2.092741472319336, -2.1380147789913537, -2.1704787568630013, -2.1891249049484918, -2.193436645945371, -2.1834097281649405, -2.159517460693549, -2.122637748498987, -2.073964168540126, -2.014918142744947, -1.9470694101093629, -1.872064625950594, -1.7915620858935697, -1.7071725311846166, -1.6204083371984137, -1.532644049484992, -1.4450901282487334, -1.3587798776616806, -1.274567870161977, -1.193137232568979, -1.1150129576902867, -1.0405787057391045, -0.9700950924746343, -0.9037180277278807, -0.8415161633725389, -0.7834868968398762, -0.7295706562696496, -0.6796633838078404, -0.6336272555327507, -0.5912997491421319, -0.552501209174497, -0.5170410756117102, -0.48472294340755084, -0.4553486134881287, -0.4287212839072546, -0.40464801563175734, -0.38294159248145754, -0.36342188003556286, -0.3459167744051197, -0.330262818952356, -0.316305555434508, -0.30389966568133553, -0.2929089507433331, -0.28320618640265405, -0.2746728869393589, -0.2671990030061451 ], [ -1.8182909218098442, -1.898833868562817, -1.9734732418965328, -2.040287497387576, -2.097379036394402, -2.1430065845992154, -2.175726088414893, -2.194513979348377, -2.1988464798878207, -2.1887195727939868, -2.1646122403657784, -2.1274112472729767, -2.078320937140779, -2.0187754044210675, -1.9503595594298333, -1.87473793534182, -1.7935887116101286, -1.7085430563108277, -1.6211326143792686, -1.5327486155691485, -1.4446147400100273, -1.357773750615852, -1.2730860834916735, -1.1912375929808856, -1.1127534590929042, -1.0380156071279427, -0.9672815656879417, -0.9007032911270347, -0.8383450059885373, -0.780199500601104, -0.7262026346282825, -0.676245968825323, -0.630187579504749, -0.5878611796481844, -0.54908370736138, -0.5136615563974397, -0.48139562324017726, -0.45208533655859473, -0.42553182159376335, -0.40154033673291656, -0.37992210373377533, -0.3604956377212756, -0.34308766870822893, -0.32753373324288826, -0.31367850294812416, -0.30137590618126797, -0.2904890897515551, -0.2808902595007705, -0.27246043149041776, -0.265089119454615 ], [ -1.8168945635337135, -1.8976272814292656, -1.9724606112705143, -2.0394636534574073, -2.0967280180240397, -2.142501377930489, -2.1753298679137147, -2.19418262200992, -2.1985315223034245, -2.188370577971781, -2.164178005662614, -2.126840190524468, -2.077561692777317, -2.0177785842716283, -1.9490808373243467, -1.8731417246556532, -1.7916513270068013, -1.706254498066606, -1.618496675931317, -1.529781526706188, -1.4413428361729712, -1.3542307055115181, -1.2693101458828955, -1.1872691200714947, -1.1086328976058895, -1.0337819653185543, -0.9629713497551148, -0.8963498419102558, -0.833978157437497, -0.7758454817820356, -0.7218841453568452, -0.6719823708076926, -0.6259951572643979, -0.5837534369296004, -0.5450716744074164, -0.5097540912991378, -0.47759969655942147, -0.44840629286995803, -0.42197361477368434, -0.39810573802582094, -0.3766128830943013, -0.35731271987220703, -0.34003126592159605, -0.32460345716267414, -0.31087345790826526, -0.29869476648769355, -0.28793016332855936, -0.27845154017386986, -0.27013964200655516, -0.2628837471378229 ], [ -1.811346850926441, -1.8919294887879763, -1.966627306928427, -2.033512755580844, -2.0906808024634222, -2.13638218823212, -2.169165383224171, -2.188000484478335, -2.192358158844241, -2.1822282799957256, -2.15808176252839, -2.1207952123033866, -2.0715626608960243, -2.011811207956656, -1.9431254354906053, -1.867177796516764, -1.7856618435134792, -1.7002289634540544, -1.6124325779666162, -1.523684298874009, -1.4352247421684816, -1.3481091300045143, -1.263205711010921, -1.1812039238464518, -1.102629043383025, -1.027860448704391, -0.9571512992098548, -0.8906480691642609, -0.8284089564967624, -0.7704206129524398, -0.7166129468550747, -0.6668719504647561, -0.6210506275911037, -0.5789781667488192, -0.5404675386147335, -0.5053217068974867, -0.47333863803555787, -0.444315283493098, -0.4180506927916837, -0.3943483982902667, -0.37301819560020644, -0.35387742723899085, -0.3367518621097587, -0.3214762498133934, -0.3078946166764087, -0.29586035965310287, -0.285236184839716, -0.2758939291157516, -0.26771429629853505, -0.26058653306328083 ], [ -1.8016277488691776, -1.8817172552538666, -1.9559465528284559, -2.022404150262865, -2.079202556963439, -2.1246097759041263, -2.1571888782476076, -2.1759193506689596, -2.180273990449962, -2.170236650162795, -2.1462647201701377, -2.109215929621989, -2.0602632523662807, -2.0008139307090564, -1.932436598643174, -1.8567930947171907, -1.7755717187121607, -1.6904229472757846, -1.6029021219993873, -1.5144241003907926, -1.4262328830653987, -1.3393864588577613, -1.254754869786342, -1.1730283216988167, -1.094731964704509, -1.0202443831985766, -0.9498175109940163, -0.8835963798434687, -0.8216376978104374, -0.7639267004478623, -0.7103920305089451, -0.6609186064719449, -0.6153585646628402, -0.5735404285823893, -0.5352766910130364, -0.5003700031849078, -0.46861816008263013, -0.43981805809660246, -0.4137687846544911, -0.3902739816763072, -0.3691436071258911, -0.3501952023711852, -0.3332547578904681, -0.318157256199346, -0.30474695871333735, -0.2928774925226796, -0.28241178363102803, -0.2732218749845161, -0.26518866048431655, -0.2582015600366834 ], [ -1.7877646077039064, -1.8670215904147809, -1.9404529751146136, -2.0061756632968732, -2.0623334135137528, -2.1072251809820313, -2.1394404935971236, -2.157976478056124, -2.162311557203338, -2.152422148034178, -2.1287465771949625, -2.0921153210838335, -2.04367036384149, -1.9847885868370168, -1.917012283237527, -1.8419828904118996, -1.7613746525422411, -1.6768295725333693, -1.589898703076979, -1.501995279124008, -1.4143630544647217, -1.3280602399806938, -1.2439570494855108, -1.1627435977834253, -1.0849446674282732, -1.010938287211871, -0.940975768004371, -0.8752015626076045, -0.8136719268804319, -0.7563718206187362, -0.7032298074876354, -0.6541309211983, -0.6089275901259046, -0.5674487804523098, -0.529507548409692, -0.4949071993934089, -0.46344624521322375, -0.43492233686776227, -0.40913533295006477, -0.3858896455447206, -0.364995987649253, -0.34627262947486526, -0.3295462557787241, -0.31465250274023493, -0.3014362407773856, -0.2897516590074094, -0.27946219766966407, -0.27044036663011584, -0.262567480968775, -0.25573333851861846 ], [ -1.7698318941922238, -1.8479273251614723, -1.9202420095905701, -1.98493285412209, -2.0401876325046038, -2.084348914341883, -2.1160436508740657, -2.134294356716336, -2.1385886226653854, -2.1288946039583854, -2.10562697137403, -2.0695816146095214, -2.021860511468031, -1.9638003668816006, -1.8969072136919127, -1.8227926191107127, -1.7431081738800773, -1.6594799434923315, -1.5734484686996397, -1.4864203683235369, -1.3996353068529594, -1.314148916968748, -1.2308297047588845, -1.1503666075236283, -1.0732836163342812, -0.9999583136878529, -0.930641907092931, -0.8654790884990551, -0.8045266811303269, -0.7477705094117757, -0.6951402548695499, -0.6465222709052717, -0.6017704541459376, -0.5607153367373344, -0.5231715929713755, -0.48894415949782, -0.4578331608341425, -0.4296378172892692, -0.4041594947152305, -0.3812040370567692, -0.36058350480731005, -0.342117425870073, -0.32563365024177315, -0.31096888643476306, -0.29796898556794216, -0.2864890284746193, -0.27639326187199553, -0.2675549214948678, -0.25985597301198005, -0.2531867954279574 ], [ -1.7479495454146834, -1.8245709734001996, -1.8954672088902982, -1.9588457579719818, -2.012949854029397, -2.056176896897927, -2.0872009523758566, -2.1050768869109917, -2.109304915935441, -2.099844709016101, -2.077083759330804, -2.0417772674021917, -1.9949793402771767, -1.9379776690221622, -1.8722329246681606, -1.799318023027196, -1.7208538469104506, -1.6384434119424403, -1.5536106485636, -1.4677504760560285, -1.3820943795055858, -1.2976922842496414, -1.2154087688082673, -1.135930202780368, -1.059779118317352, -0.9873325821315769, -0.9188420967615658, -0.8544533356988883, -0.7942246661142259, -0.7381438960543922, -0.6861430134193345, -0.6381108941227979, -0.593904080353114, -0.5533557949044288, -0.5162833851346017, -0.4824943948937316, -0.4517914545480195, -0.42397616428587537, -0.3988521281179299, -0.3762272776520298, -0.3559156070889493, -0.33773842455467884, -0.3215252100912427, -0.3071141573909213, -0.2943524645971505, -0.28309642908886334, -0.27321139198952116, -0.2645715700855076, -0.25705980580611043, -0.25056725982869055 ], [ -1.7222800365242388, -1.7971370185777034, -1.866335650365277, -1.9281433848473624, -1.9808687656843218, -2.022973506413945, -2.0531869373195226, -2.0706022386672505, -2.0747354660442987, -2.065538091818721, -2.043367957139367, -2.0089347564262923, -1.9632381665384124, -1.9075092734157584, -1.8431554707477251, -1.7717033370468007, -1.694735899836925, -1.6138266180321865, -1.5304769628583015, -1.4460649981447962, -1.3618096437147462, -1.278751585608501, -1.1977488410791095, -1.1194834568450782, -1.0444755483385886, -0.9731013830989488, -0.9056130087143839, -0.8421577243931738, -0.7827963548510599, -0.7275197707357661, -0.6762634286927987, -0.6289199114731062, -0.5853495693279116, -0.5453894269626435, -0.5088605465959024, -0.47557404176414597, -0.4453359280785669, -0.4179509823289763, -0.39322576390366726, -0.37097093463826636, -0.3510029960948169, -0.3331455474577656, -0.31723015290837653, -0.30309689450153354, -0.29059467512846604, -0.2795813259856026, -0.2699235639669184, -0.26149683645431954, -0.25418508401581463, -0.24788044546795773 ], [ -1.6930243194162926, -1.765852851687929, -1.8331017574196626, -1.8931063822319427, -1.9442486791295823, -1.985062277535802, -2.0143382397702134, -2.031212874155853, -2.0352208894171353, -2.026306192790124, -2.004795405704205, -1.9713491283632214, -1.9269074337613916, -1.8726386981037018, -1.8098906750175945, -1.740137421786184, -1.6649182155033593, -1.5857712750536455, -1.5041700973275454, -1.4214706509279007, -1.3388745520841276, -1.2574092493243334, -1.1779231002649948, -1.1010916744973969, -1.0274314014118628, -0.9573172380425679, -0.8910018670069917, -0.828634747106085, -0.7702799976331195, -0.7159325757060594, -0.6655325268550091, -0.6189772900792319, -0.5761321552620734, -0.5368390315136684, -0.5009237102563066, -0.4682018107999836, -0.43848358809782007, -0.41157776824568815, -0.3872945607046806, -0.36544797925309624, -0.34585758741536377, -0.3283497690719721, -0.31275861129088534, -0.2989264741237361, -0.2867043110900971, -0.2759517942200327, -0.26653728873856974, -0.25833771467242217, -0.2512383257768196, -0.2451324301685005 ], [ -1.6604168455708248, -1.7309826555719325, -1.796059926565357, -1.8540583585173653, -1.903439608766889, -1.9428149167540485, -1.9710418326112076, -1.98730338592076, -1.9911552043760112, -1.9825344022062807, -1.9617355159437815, -1.9293675706232007, -1.8863072792793223, -1.833655897187431, -1.7726970612578075, -1.7048479815257425, -1.6315998140449792, -1.5544508141167164, -1.4748413395609394, -1.3940998924985943, -1.3134056367353661, -1.233768280505998, -1.1560229464107936, -1.080836179829214, -1.008719157159733, -0.9400447985553859, -0.8750663587673628, -0.8139358798076956, -0.756721529609666, -0.7034233092677593, -0.6539869167611646, -0.6083157459469528, -0.5662811107345671, -0.527730842601527, -0.49249643432238566, -0.4603989072501895, -0.43125357251790364, -0.40487384373186297, -0.3810742435312985, -0.35967273074726136, -0.3404924598400145, -0.32336307029137035, -0.30812159082562696, -0.29461303171874853, -0.28269072795388994, -0.2722164865037584, -0.2630605824900365, -0.2551016413301075, -0.24822643719269433, -0.24232963211828773 ], [ -1.6247199282336453, -1.6928205754611074, -1.7555363980502872, -1.8113564086541254, -1.858826492308255, -1.8966393521728793, -1.923722128441486, -1.9393069380302381, -1.9429719425599385, -1.9346481895387064, -1.914597765822469, -1.8833766178289244, -1.841795772207034, -1.790886812648274, -1.731866932098067, -1.6660942759856088, -1.595009175672719, -1.5200661691555637, -1.4426675871431545, -1.3641088776436614, -1.285541146264277, -1.2079513580408894, -1.132157390108871, -1.058813881515603, -0.988424946689029, -0.9213605705281913, -0.8578743912614809, -0.798121359721648, -0.7421743640703814, -0.6900393328055682, -0.6416686105537217, -0.5969725784114209, -0.5558295952138149, -0.5180943921826285, -0.4836050783198317, -0.45218891976170983, -0.4236670512259644, -0.39785826692091575, -0.37458202505997484, -0.35366078628443876, -0.3349217928130026, -0.3181983824484149, -0.3033309198291274, -0.2901674165222312, -0.27856390166514267, -0.26838459582137486, -0.2595019324781447, -0.25179646415653734, -0.24515668341918362, -0.23947878314316728 ], [ -1.5862177226005043, -1.651683535034169, -1.7118808199035889, -1.765381387858367, -1.8108181952500355, -1.8469675516875392, -1.8728277538215121, -1.887681196377018, -1.8911294955660138, -1.8830981924922545, -1.863816923634283, -1.8337879506577799, -1.793755740156662, -1.7446816365276476, -1.6877163683347605, -1.624159000031372, -1.5553979611137494, -1.4828411360590994, -1.4078480418915889, -1.3316751560653768, -1.2554394479844406, -1.1800997027488918, -1.1064522160163646, -1.0351366194426193, -0.9666480136076239, -0.9013524500858023, -0.839503681309765, -0.7812598170555465, -0.7266990607136495, -0.6758340723636198, -0.6286247563314917, -0.5849894319368347, -0.5448144439638535, -0.5079623239645488, -0.4742786395660874, -0.4435976771327863, -0.4157471007902739, -0.3905517228108706, -0.3678365096993108, -0.34742893674968744, -0.3291607922915345, -0.31286952173765425, -0.2983991910551942, -0.2856011394437499, -0.27433438181389325, -0.26446581310618256, -0.25587025857624535, -0.24843040691278584, -0.2420366564783476, -0.23658689909420483 ], [ -1.5452101051830192, -1.6079040498300297, -1.66545793545453, -1.7165284482997984, -1.7598369065713835, -1.7942438191847685, -1.8188188200271787, -1.8328946925472183, -1.8360967594371007, -1.8283454274319424, -1.809838223638742, -1.7810240334153016, -1.7425814046469787, -1.695402931902372, -1.6405751852877135, -1.5793402203575642, -1.513034849011669, -1.4430178492905437, -1.3706009701053044, -1.2969953574718576, -1.223277336397398, -1.1503717875955015, -1.0790489481493015, -1.0099302960579963, -0.9434999610391683, -0.8801190590741415, -0.8200411646701506, -0.7634277498935126, -0.7103628603396729, -0.6608666083810051, -0.6149072783807609, -0.5724119822677511, -0.53327589550174, -0.4973701575975411, -0.46454854967019965, -0.4346530729369835, -0.40751855333927656, -0.38297639289208296, -0.36085758084587605, -0.340995068900664, -0.32322560543363354, -0.3073911144299266, -0.2933396957415493, -0.2809263145325467, -0.27001323935089316, -0.2604702802466392, -0.2521748707879854, -0.24501203077686928, -0.23887423999988067, -0.23366124752884265 ], [ -1.5020067149460736, -1.5618233570697253, -1.6166397757436768, -1.665198291112335, -1.7063084634126233, -1.7389142143483984, -1.7621554719149184, -1.7754145648929298, -1.7783401942403234, -1.770847898117983, -1.7531038881959304, -1.7255050385197723, -1.6886662566726522, -1.6434149596086232, -1.5907780493725876, -1.531944382091087, -1.4682002859404657, -1.4008529532830012, -1.3311609122955894, -1.2602830942275673, -1.189248370852325, -1.1189419446875328, -1.0501036330378317, -0.9833337894856637, -0.9191037742386047, -0.8577688683792295, -0.7995822151077574, -0.7447088343283955, -0.693239080423434, -0.6452011500687934, -0.6005724230300975, -0.5592895461438548, -0.5212572576070218, -0.48635600372499777, -0.454448431859545, -0.42538485895989286, -0.39900782059553075, -0.37515580493219713, -0.3536662722228501, -0.33437805467210446, -0.3171332248372516, -0.30177851351166196, -0.2881663505494869, -0.27615559449181015, -0.26561200926800677, -0.25640853879002523, -0.24842542305122706, -0.241550192504965, -0.23567757114263954, -0.23070931291299734 ], [ -1.4569213815372575, -1.5137851264280366, -1.5657986648282765, -1.6117894945702251, -1.6506540368783678, -1.6814176294242251, -1.7032883889084673, -1.7156965321912574, -1.718313362943914, -1.7110498732319503, -1.6940424303340955, -1.6676385772454714, -1.6323936830679286, -1.5890756221701898, -1.5386579912054226, -1.4822813915426343, -1.4211829002141652, -1.3566149761140414, -1.2897766480539878, -1.2217672413287337, -1.1535613097889725, -1.085998885611346, -1.0197854339547203, -0.9554976340403267, -0.8935926046072655, -0.8344190980315604, -0.7782296658244091, -0.7251930657591464, -0.6754063699733871, -0.6289063945631922, -0.5856802113738068, -0.54567461646542, -0.508804514077425, -0.4749602321646498, -0.444013821335006, -0.41582440949198884, -0.3902426949046116, -0.3671146645395852, -0.34628462470745736, -0.32759762883939025, -0.3109013833574952, -0.29604770762037935, -0.28289361813516734, -0.2713021008690828, -0.2611426287788292, -0.2522914748037466, -0.24463186373102586, -0.23805399971755148, -0.232455000004115, -0.2277387596180973 ], [ -1.4102671144837136, -1.4641299456171353, -1.5133012534274717, -1.556692162873373, -1.5932834694816271, -1.6221788889913806, -1.6426517212502232, -1.6541777484108984, -1.656449805943955, -1.6493749137152258, -1.6330620133791416, -1.6078136287525622, -1.5741317395773704, -1.5327323124916488, -1.4845434021730675, -1.430662602123143, -1.3722781328037297, -1.310583218538303, -1.2467100526663324, -1.181690622647232, -1.1164386182642305, -1.0517440953886263, -0.9882749987504469, -0.926582440111517, -0.8671082974207958, -0.8101943849894058, -0.7560926302993882, -0.7049757323857782, -0.6569478270348494, -0.6120547753949215, -0.5702938038393319, -0.5316223278581729, -0.4959658768834415, -0.46322509743534535, -0.4332818523726526, -0.4060044596928736, -0.38125212999804636, -0.3588786708123186, -0.3387355305748565, -0.3206742566435956, -0.30454844083089827, -0.29021522337902517, -0.2775364222699681, -0.2663793496901141, -0.2566173716460094, -0.2481302604439357, -0.2408043832736968, -0.23453276372016618, -0.2292150468772618, -0.2247573930315918 ], [ -1.3623517674898753, -1.413190694887783, -1.4595036924085099, -1.5002830062761885, -1.5345903833726526, -1.5616040194276501, -1.5806586666198894, -1.5912728445183841, -1.5931597067521397, -1.5862232947658317, -1.570548705790898, -1.5463996432954303, -1.5142330746448243, -1.4747225713626324, -1.42875921070889, -1.377402134778765, -1.3217892617970786, -1.2630481447408306, -1.202235727051933, -1.140308953181553, -1.07811491208933, -1.0163899963610363, -0.9557625328677559, -0.8967570143003307, -0.839799645240119, -0.7852252141871569, -0.7332851260755567, -0.6841562285381245, -0.637949988170334, -0.594721609895796, -0.5544787857402012, -0.5171898609205594, -0.4827912909963069, -0.45119432787735736, -0.4222909174489988, -0.3959588224271664, -0.3720660051233703, -0.3504743190511783, -0.3310425675890438, -0.31362899335729577, -0.29809326431906946, -0.2842980224461369, -0.272110058591325, -0.2614011734307411, -0.2520487794022066, -0.2439362928616049, -0.23695335956001773, -0.2309959503236696, -0.2259663577609894, -0.22177311913975828 ], [ -1.3134744304392287, -1.361288843851571, -1.4047479523145117, -1.4429218248073432, -1.4749489933207502, -1.5000775832866466, -1.5176995495963417, -1.527373004370058, -1.5288302150246122, -1.5219737597707028, -1.506869689957745, -1.4837510067273816, -1.4530402502250437, -1.4153797345533858, -1.371632239818358, -1.3228213164503293, -1.2700304352693321, -1.2143128192547654, -1.1566409695517366, -1.0978896880741857, -1.0388350893370895, -0.980157723355086, -0.9224454884791575, -0.8661961383239242, -0.8118203550002054, -0.7596461173835751, -0.7099245141851926, -0.6628367236890167, -0.6185017061548461, -0.5769841607617493, -0.538302387390659, -0.5024357968906593, -0.469331901818255, -0.43891268663055305, -0.4110803051836346, -0.38572208910308636, -0.36271487701220595, -0.34192869413295823, -0.3232298258261128, -0.30648333810549766, -0.2915551037320969, -0.2783133947842107, -0.2666301022057176, -0.25638164032926714, -0.24744959029621416, -0.239721131144643, -0.23308930155157048, -0.2274531291757218, -0.22271765857056658, -0.21879390297638746 ], [ -1.2639225447743698, -1.3087316308129133, -1.3493592000755807, -1.3849492414008606, -1.4147123848246241, -1.437961728526263, -1.4541419145920107, -1.462847419564864, -1.4638285972537974, -1.4569886331121218, -1.4423803900838061, -1.420215864496788, -1.3908955179068057, -1.3550426180764228, -1.3134997065401959, -1.2672551226774014, -1.2173306218953166, -1.1646944360525058, -1.110225345357172, -1.0547102577278304, -0.9988518214116067, -0.943274326281494, -0.8885257821511006, -0.8350779775891448, -0.7833267319072394, -0.7335936585669564, -0.6861297789453813, -0.6411207126859191, -0.598692939713906, -0.5589206328504748, -0.5218326568315937, -0.48741943785246766, -0.4556394976765493, -0.4264255146125364, -0.3996898252717519, -0.3753293210491292, -0.35322972488366244, -0.3332692586634327, -0.3153217304911513, -0.2992590845268841, -0.28495346488852813, -0.27227884979275885, -0.26111231347299313, -0.2513349721238183, -0.24283266686014504, -0.2354964320457329, -0.22922279186697958, -0.2239139221515647, -0.21947770852570359, -0.2158277263584225 ], [ -1.2139696911154618, -1.2558100267221277, -1.2936440706348904, -1.3266854340462049, -1.3542118856766212, -1.3755964130700216, -1.3903318620243679, -1.3980460453840762, -1.3985067535782092, -1.391620407525791, -1.377433260663367, -1.356146824586519, -1.3281525220499342, -1.2940667612435701, -1.25471849139309, -1.2110584692854693, -1.164036665109305, -1.114524547383657, -1.063298888397966, -1.0110550869495263, -0.9584220690352815, -0.9059692412529037, -0.8542064867689757, -0.8035811214911894, -0.7544751087147487, -0.7072042441527383, -0.6620196873317525, -0.6191114833870913, -0.5786134869582676, -0.5406091320459563, -0.5051376074419962, -0.4722001106875797, -0.441765942079961, -0.41377826724463596, -0.38815942972018747, -0.3648157387666, -0.3436416942398792, -0.32452364041699644, -0.30734286425802604, -0.2919781710460474, -0.27830798219818886, -0.2662120070443248, -0.2555725433681557, -0.24627546134970468, -0.23821092303315683, -0.2312738852786791, -0.22536442895235553, -0.2203879513761151, -0.2162552532152977, -0.21288254534881657 ], [ -1.1638739651967185, -1.2027973485106247, -1.2378896282429401, -1.2684295653979327, -1.2937570947864907, -1.313300177574169, -1.3265957285208605, -1.3333023751029285, -1.333205295310034, -1.326217336387267, -1.3123850268997146, -1.2919096889127493, -1.2651857496455063, -1.2328331248421638, -1.195671496940457, -1.1546093098072725, -1.110513124471648, -1.0641463959965445, -1.0161779554985273, -0.9672108699904932, -0.9178023856365263, -0.8684699596549431, -0.8196880125764398, -0.7718813073714383, -0.7254190833655297, -0.6806118194835739, -0.6377108828569198, -0.5969105486136266, -0.5583517015916531, -0.5221266182124684, -0.48828436635160954, -0.4568364755224419, -0.4277626121953635, -0.40101605787246697, -0.3765288405035152, -0.3542164169238011, -0.3339818455509498, -0.3157194237852101, -0.29931779279477455, -0.2846625336091335, -0.27163829320397515, -0.26013048839279906, -0.2500266398369848, -0.2412173893462939, -0.23359725178892932, -0.22706514917609488, -0.22152476952028466, -0.21688478745934048, -0.21305897784772565, -0.20996624789649765 ], [ -1.1138768412314726, -1.149948372364446, -1.1823628034810068, -1.2104596090144222, -1.2336361479324376, -1.2513708783061581, -1.2632412836642353, -1.26893505995759, -1.2682555120580659, -1.2611256551599779, -1.2475990766363687, -1.2278859095110857, -1.2023927358079307, -1.171749287082021, -1.1367668339267354, -1.098305251579274, -1.0571366251236283, -1.0139079825310295, -0.9691780501981396, -0.9234598480128811, -0.8772429842072891, -0.830996974943629, -0.785163891513122, -0.7401479430572236, -0.6963066670227636, -0.6539455372168846, -0.6133159839023784, -0.5746160989077276, -0.537993237206363, -0.5035478883717112, -0.4713383522736988, -0.44138586117046397, -0.4136798611014232, -0.3881832214888371, -0.36483719412911064, -0.34356599314600444, -0.32428091400264103, -0.3068839499684266, -0.2912708971158624, -0.27733396369944585, -0.2649639171796663, -0.254051813186986, -0.24449035653103124, -0.23617494609845924, -0.22900445419585513, -0.22288178748860532, -0.21771427192336867, -0.2134138985220484, -0.20989746119325625, -0.20708661210287116 ], [ -1.0642024200788418, -1.0974988051277905, -1.1273101153313505, -1.1530323201555828, -1.174115890267216, -1.1900859489557811, -1.2005578784393733, -1.2052476260790248, -1.203978211317582, -1.196686998731218, -1.1834409241700288, -1.1644658130422245, -1.140185268091879, -1.111239222635155, -1.0784264964555819, -1.0425512526333858, -1.0042832859376511, -0.9641503087130475, -0.9226035923833185, -0.8800713058631632, -0.8369808515535779, -0.793758277081412, -0.7508163916529844, -0.7085406076296998, -0.6672774811113286, -0.6273275039127046, -0.5889417684120447, -0.552321539661315, -0.5176198692252445, -0.4849446287528737, -0.4543625127966632, -0.42590365078442793, -0.39956652164954953, -0.375322912375069, -0.3531227134635413, -0.33289839845189695, -0.31456908625832214, -0.29804413043162725, -0.2832262162126653, -0.270013974287997, -0.25830413984802614, -0.2479932982160602, -0.23897926522422264, -0.23116215297352016, -0.22444517079014648, -0.21873520806920754, -0.21394324110115348, -0.20998460056909485, -0.20677913071037501, -0.20425126555329687 ], [ -1.0150569703597743, -1.045664996757765, -1.072957534656469, -1.0963831817733118, -1.1154417653736894, -1.1297019924668605, -1.1388153614824366, -1.1425261585574351, -1.140679406858281, -1.1332311419520065, -1.1202670038157765, -1.1020327973015884, -1.078969381112151, -1.0517209158677339, -1.0210636702633136, -0.987737986948843, -0.9523095758578679, -0.915191636488569, -0.8767355579307325, -0.8372920871246753, -0.797232530523084, -0.7569438508897957, -0.7168122878025852, -0.6772057611861064, -0.6384601677642097, -0.6008707241075695, -0.5646875334611678, -0.5301141795151183, -0.49730844558143916, -0.46638457483567997, -0.4374166510081041, -0.4104427404123505, -0.3854694690719632, -0.36247674854293765, -0.3414224164710764, -0.32224661655877296, -0.30487579964789435, -0.2892262776986314, -0.27520730305121033, -0.26272367608603586, -0.25167790605776785, -0.24197196383867214, -0.2335086730788758, -0.22619278931187203, -0.21993181606389856, -0.21463660412680996, -0.21022177569385048, -0.20660600973218157, -0.20371221932070438, -0.20146764613068857 ], [ -0.9666286897318404, -0.9946438114852661, -1.0195104042974212, -1.0407262524191814, -1.057837384655424, -1.070453748576283, -1.0782619665902566, -1.0810354370664823, -1.078643810680165, -1.0710657529991, -1.058409508569315, -1.0409423288135473, -1.019118488748183, -0.9935754232989653, -0.9650513526901837, -0.934213667090451, -0.9015296029423093, -0.8673103454824747, -0.8318189013814639, -0.7953374495920726, -0.7581874546604745, -0.7207207604847307, -0.6832991699823117, -0.6462739165319035, -0.609970185632596, -0.5746773629572813, -0.5406437178553286, -0.5080741356893053, -0.4771300155447692, -0.4479308165926562, -0.4205568693436469, -0.39505309123700083, -0.3714332577285835, -0.3496845143300644, -0.32977187022278787, -0.311642478216384, -0.2952295683419224, -0.2804559568829448, -0.2672370964990214, -0.25548366605924144, -0.24510372194578456, -0.23600444750946759, -0.2280935457480393, -0.221280323692012, -0.21547651676535273, -0.21059689865281106, -0.20655971785424176, -0.20328699685590612, -0.20070472425879937, -0.1987429646972927 ], [ -0.9190876360538718, -0.9446126122529861, -0.9671533888275141, -0.9862539309188616, -1.001503872753962, -1.0125526776365796, -1.0191216601289341, -1.021014422563995, -1.018127688911077, -1.0104657465022366, -0.9981613675755259, -0.9815018128951316, -0.96094772461243, -0.9371162573626961, -0.9106905279708024, -0.8822569021754141, -0.8521947645254176, -0.8207303714474216, -0.788052282710818, -0.7543838289616106, -0.7200028028224945, -0.6852294154697144, -0.6504026598500259, -0.6158575090165967, -0.5819081486941732, -0.5488374379318446, -0.5168908681354841, -0.4862735158061422, -0.45714918095901025, -0.42964128163700843, -0.4038351546136453, -0.3797813928920899, -0.3574998445410398, -0.3369839301709858, -0.3182049966639746, -0.30111649525339534, -0.2856578399211074, -0.27175786047053196, -0.2593378110693021, -0.24831392965280163, -0.23859956772545776, -0.23010692562588408, -0.22274843708128178, -0.2164378505240414, -0.21109105458151656, -0.20662669252661847, -0.20296660621283813, -0.20003614484029408, -0.19776436837432576, -0.1960841699908027 ], [ -0.8725857996733692, -0.8957293452095145, -0.9160504731368566, -0.9331367162089179, -0.946619168491162, -0.9561855055258376, -0.961591554862703, -0.9626721047342287, -0.959352696562349, -0.9516647385789275, -0.9397651482438301, -0.9239570235534422, -0.9046981413121185, -0.8825717629665356, -0.8581924515792162, -0.832061893770133, -0.8044826422225354, -0.7756132009102664, -0.7455824205624461, -0.7145648787482651, -0.6828006771941973, -0.6505814917254844, -0.6182248200724136, -0.5860496457057971, -0.5543588315530208, -0.5234280286331524, -0.49349901392994877, -0.4647759250150191, -0.437423705520923, -0.41156842182353315, -0.3872991222207832, -0.36467085038871794, -0.34370840775929223, -0.3244104954864997, -0.3067539342346457, -0.29069773718475767, -0.2761868843570239, -0.26315570781850783, -0.25153084558223004, -0.24123375758667787, -0.23218282180098138, -0.22429504428803937, -0.2174874259530959, -0.2116780324381018, -0.20678681362982854, -0.20273621669502484, -0.19945163236409846, -0.1968617090833209, -0.19489856420745366, -0.19349791603380173 ], [ -0.8272573051759631, -0.8481327338324631, -0.8663450570705343, -0.8815230713541415, -0.8933374865964278, -0.9015130784071741, -0.9058399438455816, -0.906184542098504, -0.9025018784080002, -0.8948502132714521, -0.8834079750494995, -0.8684878218787115, -0.8505346838123227, -0.8300866860988765, -0.807682800045193, -0.7837416544629794, -0.7584984913403172, -0.7320584346155409, -0.7045042971746865, -0.6759715089791472, -0.6466680163749899, -0.6168597428059368, -0.5868439021642523, -0.5569238350826939, -0.527390918579393, -0.49851306535562845, -0.4705274989659266, -0.44363633225550425, -0.41800440569686226, -0.39375911907187955, -0.3709919297157469, -0.3497611009630661, -0.3300952648665423, -0.3119974069251146, -0.29544895662984905, -0.2804137511216578, -0.2668417158502103, -0.25467216966948336, -0.2438367109816395, -0.2342616774433397, -0.2258701964354941, -0.21858385921317725, -0.21232406046960617, -0.20701304873475435, -0.20257473303274454, -0.19893528870132182, -0.19602360114719497, -0.19377158129061267, -0.19211438109525547, -0.1909905323026675 ], [ -0.7832187417948334, -0.8019426036780125, -0.818160201841521, -0.8315394990229703, -0.8417891192586198, -0.8486697989843217, -0.8520053328654649, -0.8516935723399341, -0.8477183545805609, -0.840162807653691, -0.8292224539020737, -0.815212172584298, -0.7985549137047236, -0.7797363090382614, -0.7592187769045916, -0.7373434409139887, -0.7142868684303743, -0.6901120260608317, -0.6648668757519359, -0.6386557604299785, -0.6116591515912385, -0.5841196575003625, -0.5563154260412727, -0.5285347158635595, -0.5010575264079137, -0.4741437254206117, -0.4480252903704104, -0.4229013105516808, -0.3989353315504285, -0.37625481395304483, -0.35495236027205723, -0.33508825981342394, -0.3166938878790051, -0.2997755500472272, -0.28431844692047004, -0.27029052347095317, -0.257646046320275, -0.24632881677385843, -0.236274976662463, -0.22741539962308122, -0.2196776847245101, -0.21298778469295887, -0.20727130954496675, -0.20245454996381795, -0.19846526469456993, -0.19523327371877852, -0.19269089489763802, -0.19077325684012503, -0.1894185155007153, -0.1885679968456231 ], [ -0.7405696259867551, -0.7572603594426336, -0.7715990757098271, -0.7832909091037811, -0.7920806954261406, -0.7977637937162005, -0.8001966249784359, -0.7993072806868463, -0.7951065690898899, -0.7876991210442462, -0.777292089222842, -0.7641953001590907, -0.7488026078590075, -0.7315438770860655, -0.7128083874007995, -0.6928676535826923, -0.6718480175209519, -0.6497791876232202, -0.6266826287631432, -0.6026375454333879, -0.5778004722433576, -0.5523926894480424, -0.526674466838872, -0.5009197384531002, -0.4753974862968049, -0.45035943275832235, -0.42603176100710016, -0.4026096432346058, -0.38025422734834713, -0.3590918462885886, -0.33921506583368255, -0.32068508563919607, -0.30353500838095826, -0.28777355823545125, -0.2733889221369745, -0.2603524796605643, -0.24862226772015372, -0.23814609054157687, -0.22886423381722332, -0.22071177662615216, -0.2136205181749249, -0.20752055114810397, -0.20234152158852448, -0.1980136185075656, -0.1944683362518167, -0.1916390501255616, -0.18946144175072832, -0.18787380581039526, -0.18681726468876403, -0.1862359124818025 ], [ -0.6993929983952349, -0.7141696284925904, -0.7267456269762629, -0.7368613187551877, -0.7442959407524016, -0.7488778313719617, -0.7504944026572503, -0.7491020009867987, -0.7447355458495717, -0.7375169245202149, -0.7276591870010379, -0.7154607805367373, -0.7012818472681026, -0.6854966472813442, -0.6684274347159351, -0.6502851435574849, -0.6311542069750987, -0.6110383359585456, -0.58993850168916, -0.567912852817984, -0.5450964386992835, -0.5216906734593463, -0.49793896397986026, -0.47410170728180157, -0.4504373310566564, -0.42718941752237394, -0.40457790612735367, -0.3827932608833393, -0.36199324091002305, -0.34230198142746504, -0.3238109483231395, -0.30658124872169235, -0.29064679880837874, -0.27601792847951523, -0.2626851004897732, -0.25062251605256414, -0.23979145887381081, -0.23014329259536925, -0.2216220735575416, -0.2141667740773694, -0.20771313379292988, -0.2021951705408589, -0.1975463898223635, -0.1937007348737354, -0.19059331903429477, -0.18816097955016242, -0.18634268798849707, -0.18507984770549712, -0.18431650380872422, -0.18399948615603723 ], [ -0.6597561522725459, -0.6727370727142933, -0.683665488049953, -0.6923148821394459, -0.6984969106873841, -0.7020709064525872, -0.7029531042039495, -0.7011254405838417, -0.6966434176088948, -0.6896415764030388, -0.6803335019779724, -0.6690013811931637, -0.6559694548425666, -0.6415590601954947, -0.6260329706753625, -0.609550823416514, -0.5921630008050729, -0.5738531547522222, -0.5546061732958181, -0.534462090902431, -0.5135362004654345, -0.4920110351960374, -0.47011383544587193, -0.4480920433330765, -0.42619387743128123, -0.4046547434673997, -0.38368791573637895, -0.36347844354757997, -0.34417982870657204, -0.32591308031267574, -0.3087676464429281, -0.2928036767679101, -0.2780551113033989, -0.2645331801000572, -0.25223000092015746, -0.241122056483009, -0.23117341133337455, -0.2223385892505605, -0.21456507696483973, -0.20779545147580003, -0.20196914926765763, -0.19702390867005448, -0.19289692356909138, -0.18952574926335042, -0.18684900076115518, -0.18480688122290134, -0.1833415743425595, -0.18239752984108892, -0.18192166638179108, -0.18186351146975377 ], [ -0.6217114834131087, -0.633013356925099, -0.6424070908745945, -0.6496972100878725, -0.6547256157552968, -0.6573803315626764, -0.6576038149123917, -0.6554004646443896, -0.6508425180371044, -0.6440726624837372, -0.6353004475846046, -0.6247885099982352, -0.6128250405599933, -0.599682775231377, -0.5855730779580136, -0.5706132001218236, -0.554826544604588, -0.5381815417101411, -0.5206504620412659, -0.5022576917345164, -0.48310022276022835, -0.46334239713974945, -0.4431956127971679, -0.4228945421723973, -0.4026772185022973, -0.382770650869966, -0.3633809805930488, -0.34468719267227077, -0.32683778334051783, -0.30994985785689333, -0.294110086584372, -0.2793769477597845, -0.2657837514884025, -0.25334203982277836, -0.24204506289272043, -0.2318711246594003, -0.2227866679242987, -0.2147490263726144, -0.20770881381983086, -0.2016119503612579, -0.19640134462293957, -0.1920182632106926, -0.18840342472229032, -0.1854978578750126, -0.18324356260959163, -0.18158401039461625, -0.18046451609947778, -0.17983250929676498, -0.17963772813830103, -0.17983235435883493 ], [ -0.5852974445804087, -0.5950342499701279, -0.6030029553491303, -0.6090369140877803, -0.6130059267067013, -0.6148241529224386, -0.6144573816867438, -0.6119291140536142, -0.6073244682196182, -0.6007901916707341, -0.5925282237129736, -0.5827798518731023, -0.5717986081379223, -0.5598138512500481, -0.5469935013298102, -0.5334205576649191, -0.5190975840466107, -0.5039817799508579, -0.48803573858684124, -0.4712705522462999, -0.45376641832253606, -0.43567010464027, -0.41717718367103074, -0.3985092851794021, -0.37989385270500364, -0.3615490030142947, -0.34367317116473717, -0.32643865285835494, -0.3099882949494075, -0.2944346648204983, -0.27986105059686084, -0.2663236954827979, -0.2538547622874765, -0.24246563522154796, -0.23215027345792527, -0.22288842307973078, -0.21464856727578874, -0.2073905498136217, -0.2010678465858955, -0.19562948746167375, -0.1910216486113474, -0.18718894628023586, -0.18407546854361856, -0.18162558334624923, -0.17978456023782896, -0.17849904053089372, -0.1777173868052726, -0.1773899382922013, -0.17746919410393058, -0.17790994184592956 ], [ -0.550539581657717, -0.5588218258340397, -0.565471100607642, -0.5703472958230353, -0.5733456372698204, -0.5744037061577297, -0.573507593005947, -0.5706965207765777, -0.5660648675510749, -0.5597599701408494, -0.5519736102210357, -0.5429251822435067, -0.5328359941007466, -0.5218975866574566, -0.5102418875109268, -0.49792480589374444, -0.4849332987603727, -0.4712167098380108, -0.456730588274316, -0.4414750862860892, -0.4255152888126844, -0.408981096690766, -0.392052109496678, -0.3749362669721129, -0.35784961339849874, -0.3410005867530843, -0.32457920770213056, -0.3087504521706925, -0.29365095216426984, -0.27938822548866327, -0.2660417118734928, -0.2536649929285979, -0.24228869283782473, -0.23192367863546814, -0.2225642887576873, -0.2141914092845123, -0.20677528776067766, -0.20027802672776285, -0.1946557362918715, -0.18986035043068972, -0.18584112814852172, -0.182545870320435, -0.17992188792404828, -0.17791675871596957, -0.17647890831989232, -0.17555804896097071, -0.17510550533289004, -0.17507445280978606, -0.17542008879830062, -0.17609975375887177 ], [ -0.5174516251235569, -0.5243857274020067, -0.5298165244438613, -0.5336281019127407, -0.5357385692557747, -0.5361061546360286, -0.5347342231618967, -0.5316744899604193, -0.5270273655035257, -0.5209380008299532, -0.5135864190214917, -0.5051705469828202, -0.49588251894681357, -0.4858815518279561, -0.4752702942663395, -0.4640837217731927, -0.45229760786478856, -0.4398563534906932, -0.4267108710385521, -0.41285269598569585, -0.3983336297628238, -0.3832675710715173, -0.36781799325859266, -0.3521783046777045, -0.3365520672639213, -0.32113702407055134, -0.3061139468070331, -0.29163983657419346, -0.2778445942004566, -0.2648302682957362, -0.2526720950192074, -0.24142068168228148, -0.2311048297255276, -0.22173462528975008, -0.21330453833818086, -0.2057963611181619, -0.19918188489088995, -0.1934252635077176, -0.1884850472695323, -0.18431589399753578, -0.18086997922801595, -0.17809813617438808, -0.17595076030026657, -0.1743785143187424, -0.17333286815733828, -0.17276650565448803, -0.17263362606124888, -0.172890164264895, -0.1734939493838823, -0.1744048172790864 ], [ -0.4860366092109456, -0.4917244548345414, -0.49603269783901305, -0.4988672707747973, -0.500166622948522, -0.49990688916225223, -0.4981058033956689, -0.49482461599309047, -0.49016702235980003, -0.4842739043470563, -0.4773127299027419, -0.46946107386279556, -0.4608852274884152, -0.45171725697404475, -0.4420364224063116, -0.43186197385076486, -0.4211622231185712, -0.4098791546851648, -0.39796122435172876, -0.3853935576457046, -0.3722165467196811, -0.3585291042423999, -0.3444785467136673, -0.33024292043149694, -0.3160121350968752, -0.30197210865543545, -0.2882934483059816, -0.27512450025939406, -0.2625879436762697, -0.25077999904810366, -0.23977142309697186, -0.2296096215271728, -0.22032137208703828, -0.2119157923865589, -0.20438730277666473, -0.1977184241877432, -0.19188231727944105, -0.18684501683211785, -0.18256734822365295, -0.1790065347134122, -0.17611751800442055, -0.17385402240434145, -0.17216939652485408, -0.17101726708773857, -0.17035203796969456, -0.1701292648151682, -0.17030593191586063, -0.17084065401648885, -0.17169382158806212, -0.17282770416454674 ], [ -0.45628799209047377, -0.46082664321091693, -0.4641030278566153, -0.46604261145400816, -0.46660169938321194, -0.4657717071401969, -0.463582041576893, -0.46010087896134677, -0.4554329592958102, -0.44971344518575107, -0.44309709362835614, -0.4357426890364313, -0.42779404776684327, -0.41936079571054563, -0.41050387383601694, -0.4012311608250798, -0.3915066135577523, -0.38127196297998, -0.370475124165369, -0.35909681201364885, -0.34716781927124085, -0.33477319705256536, -0.32204427587340967, -0.30914309124407313, -0.29624482913732897, -0.28352247532105235, -0.2711355481903528, -0.2592230546362906, -0.24789997714546552, -0.2372563848681828, -0.22735832902066178, -0.21824984312755702, -0.20995553807775136, -0.2024834300709757, -0.19582775801500119, -0.18997163672476547, -0.1848894576926141, -0.18054899530273794, -0.17691320780323005, -0.173941742959012, -0.17159217106427627, -0.16982097512218708, -0.16858433114054283, -0.16783871184192312, -0.16754134552666278, -0.16765055901534387, -0.16812603003732196, -0.16892897051408196, -0.1700222582157458, -0.17137053048058526 ], [ -0.42819075317895083, -0.43167229917962013, -0.43400225128912673, -0.4351233697608031, -0.43500744576004335, -0.4336587255161456, -0.4311158605230412, -0.42745172548796084, -0.4227703559684538, -0.41720029091266075, -0.4108839009103641, -0.4039629909070901, -0.39656214433548853, -0.3887727313603554, -0.3806416708770105, -0.37216906807619055, -0.36331708053755474, -0.3540289851195717, -0.3442537675426973, -0.33396945651821164, -0.32319890726908307, -0.31201449081453503, -0.30053195311198033, -0.28889696143833943, -0.27726914928492086, -0.26580761359018434, -0.25465993369845297, -0.2439551260906725, -0.23380002216819928, -0.22427823850719197, -0.21545092230985352, -0.20735859668307866, -0.20002359712493822, -0.19345273996990264, -0.18763998312846186, -0.1825689293852697, -0.1782150873461701, -0.1745478502922524, -0.1715321836420105, -0.169130031436304, -0.16730146429272064, -0.16600559787263158, -0.16520131369175606, -0.16484781425552741, -0.16490504286487262, -0.1653339956447235, -0.16609694987222956, -0.16715762889061314, -0.16848132007318406, -0.17003495866812846 ], [ -0.4017224476438569, -0.4042339728051739, -0.40569773171694223, -0.40607165274605683, -0.40534079776881515, -0.4035200117767901, -0.40065506105302595, -0.396821675477828, -0.392121884948447, -0.38667714721046154, -0.3806181080055925, -0.3740715030086388, -0.3671456967935781, -0.35991744968015427, -0.35242325098375704, -0.3446583635758964, -0.3365851991901816, -0.32815001441720804, -0.3193041486573045, -0.3100243605482871, -0.30032703373107883, -0.2902730519014276, -0.2799631988404856, -0.26952675246541014, -0.25910729467236826, -0.24884932334964027, -0.23888777923289384, -0.22934111667259782, -0.22030760036609065, -0.21186411384909798, -0.2040667170644701, -0.19695229959771576, -0.1905408294396107, -0.18483784192605368, -0.1798369317048778, -0.17552209994168977, -0.17186987329934755, -0.16885115581910326, -0.16643280467759136, -0.16457893995857376, -0.16325201015744328, -0.162413641397259, -0.16202530090574285, -0.1620488053439202, -0.16244670292312713, -0.1631825555063755, -0.16422114351821593, -0.16552861283205722, -0.1670725791339156, -0.16882220178155727 ], [ -0.37685420276359993, -0.37847784769664017, -0.3791506427527944, -0.37884369672258444, -0.37755331127658, -0.3753029398318999, -0.3721436399894945, -0.3681525175642604, -0.3634286847402488, -0.3580864095870153, -0.3522454909768895, -0.3460194957218077, -0.33950329850342587, -0.33276217337959246, -0.32582514054145917, -0.3186849640359535, -0.31130590441900385, -0.3036382742472308, -0.29563672065484403, -0.2872778386453243, -0.27857279383641376, -0.26957215149332603, -0.26036254247084734, -0.2510571639246819, -0.2417834076438785, -0.23267076436427403, -0.22384104545438488, -0.2154016952299449, -0.2074420604983933, -0.20003204120204798, -0.19322243972308817, -0.18704639523927802, -0.18152142066903165, -0.17665169409047743, -0.1724303702286374, -0.168841765103263, -0.16586333042002543, -0.1634673784150733, -0.16162254737273019, -0.16029501692899184, -0.15944949363847316, -0.15904999339381498, -0.1590604497757857, -0.1594451774386818, -0.16016921802533401, -0.16119859345687937, -0.1625004881967771, -0.16404337858107088, -0.16579712379323452, -0.16773302973619897 ], [ -0.353551645500066, -0.35436473912077315, -0.3543170292855977, -0.3533909757839233, -0.3515922899921824, -0.34895129296453753, -0.34552280737086116, -0.34138416510296676, -0.3366309731493955, -0.3313704607786281, -0.3257125774175851, -0.3197595360873857, -0.31359513915353276, -0.30727580799921794, -0.3008254930868839, -0.29423628662833257, -0.2874754781558626, -0.28049817709229075, -0.27326298424688567, -0.2657471503028286, -0.25795766984077484, -0.24993590998078652, -0.2417552989696654, -0.23351355100395632, -0.22532207656679804, -0.21729526986647252, -0.20954156445695205, -0.20215710536418485, -0.19522206126992048, -0.18879914328452485, -0.1829337445195609, -0.17765514182389452, -0.17297830468396924, -0.168905975263147, -0.16543078956545032, -0.16253729365307534, -0.16020377080026438, -0.1584038389613167, -0.15710780718701356, -0.1562837984162928, -0.1558986574019965, -0.1559186686479097, -0.15631011176498677, -0.1570396817557791, -0.15807480023171916, -0.1593838410510382, -0.16093629077081895, -0.16270286096082298, -0.16465556607625587, -0.1667677774169145 ], [ -0.33177575504317636, -0.3318509956452269, -0.33114874598737853, -0.32966115669201046, -0.3274017254386714, -0.32440614510967625, -0.32073175331868486, -0.31645524508594747, -0.3116683951490298, -0.3064717260970695, -0.3009663797568196, -0.2952448957334568, -0.2893821048115941, -0.28342775974598244, -0.27740264723293073, -0.27129956441927616, -0.2650896433651986, -0.25873323099583856, -0.252193255943054, -0.2454481935888151, -0.2385017267113836, -0.23138707992873986, -0.22416552214978847, -0.21692011356577146, -0.20974679685378428, -0.20274508407071945, -0.19601003353461288, -0.18962638102011842, -0.1836649696547621, -0.17818117885453932, -0.17321486984188517, -0.16879135479093743, -0.16492297090350472, -0.16161094098703033, -0.15884729761763317, -0.15661672656180192, -0.15489824458943247, -0.15366666926768646, -0.15289386723047382, -0.15254978616037973, -0.1526032871235734, -0.153022800135854, -0.15377682850832142, -0.15483432777463602, -0.15616498366032405, -0.1577394112092212, -0.15952929426463913, -0.16150748133379111, -0.1636480506845126, -0.16592635451279025 ], [ -0.31148363792666833, -0.310889304643329, -0.30959427800428285, -0.30759891214828294, -0.30492307135056973, -0.30160655576853257, -0.29770821548018533, -0.29330348733058, -0.2884801875237093, -0.2833325801041966, -0.2779540297408616, -0.2724289189356428, -0.26682489923414776, -0.26118683361073614, -0.2555338216700067, -0.24986035526545614, -0.24414190727338725, -0.23834424623577988, -0.23243477568808046, -0.22639355727830424, -0.22022165817166783, -0.21394514208501403, -0.20761421023691873, -0.20129826574171594, -0.1950785435255089, -0.18904015494715254, -0.18326502444486859, -0.17782655328132613, -0.17278623812963634, -0.1681920610514005, -0.16407826993207952, -0.16046612761983647, -0.15736525411969104, -0.15477526627300375, -0.15268750235575634, -0.15108669064443636, -0.149952476917405, -0.1492607667092487, -0.148984866437607, -0.14909642614445384, -0.1495661980913332, -0.1503646318633829, -0.15146232951260918, -0.15283038473523902, -0.15444062894608068, -0.15626580497323883, -0.15827968637912315, -0.16045715743613642, -0.16277426578516185, -0.16520825695721153 ] ], "zauto": true, "zmax": 2.1988464798878207, "zmin": -2.1988464798878207 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.2980827029311532, 0.2820687633517546, 0.2676467449806495, 0.25507900082833057, 0.24463545524960006, 0.23658360072378992, 0.23115700502638858, 0.22850504325501877, 0.22864222742162107, 0.2314240270326102, 0.23656691697529575, 0.2437077213201841, 0.2524781331218117, 0.26256692962886846, 0.27375267265959424, 0.2859039603164556, 0.29895531373274303, 0.3128719279601331, 0.32761605014779016, 0.3431234680459854, 0.35929305709691534, 0.3759878348286834, 0.3930436351173791, 0.4102812103532556, 0.42751848299270945, 0.44458095802900127, 0.4613094427165046, 0.4775649978280812, 0.4932314730209717, 0.5082161492576778, 0.5224490239961469, 0.5358812079500537, 0.548482806086083, 0.5602405584848364, 0.5711554322044312, 0.5812402879870399, 0.5905176954771294, 0.5990179353460574, 0.6067772033718052, 0.6138360171412227, 0.6202378180138707, 0.6260277571784396, 0.6312516534016308, 0.6359551102172794, 0.6401827810105152, 0.6439777712037582, 0.6473811672707087, 0.6504316824878924, 0.6531654091974267, 0.6556156669906101 ], [ 0.29059494972043703, 0.2744902855198887, 0.2600417550498568, 0.24749185381112654, 0.23708623053698327, 0.22907022260992818, 0.2236637993229366, 0.22101460970257764, 0.22114570128114308, 0.22392573913688196, 0.22908274318546892, 0.23625968557357158, 0.24508891966024163, 0.25525673769664126, 0.2665387790047558, 0.2788019014923428, 0.2919802906972966, 0.3060395536819156, 0.3209422798982948, 0.3366240134096973, 0.35298268062569377, 0.36987979121510706, 0.387149348842415, 0.4046101613005888, 0.4220782261624851, 0.4393772059156959, 0.45634616080801643, 0.4728444876213936, 0.4887544356855043, 0.5039817350448196, 0.5184548784415033, 0.5321235272607465, 0.544956412317361, 0.5569390015077288, 0.5680711211457685, 0.5783646506229564, 0.5878413605513435, 0.5965309302842853, 0.6044691584813155, 0.6116963670672156, 0.6182559918128828, 0.6241933496460783, 0.629554572021259, 0.6343856940506387, 0.6387318898311338, 0.6426368450176634, 0.6461422579569568, 0.6492874605463527, 0.6521091494751067, 0.6546412177669151 ], [ 0.2839292112969165, 0.26778257819678797, 0.2533572700018285, 0.24087312828835808, 0.23054691779520223, 0.22259612209237065, 0.2172218745970737, 0.2145672688447339, 0.2146648846560364, 0.21740136630610016, 0.22252321299544195, 0.22968629227188356, 0.23852833660871248, 0.2487351105499856, 0.26007878555327474, 0.27242225428728745, 0.2856964590893415, 0.2998647272556772, 0.31488813669025495, 0.3307012394064134, 0.34720131466670434, 0.3642494513547616, 0.3816793543613209, 0.3993095493621014, 0.41695566960266095, 0.4344408514253795, 0.45160341488956385, 0.4683017797876962, 0.48441698643259523, 0.49985335212542154, 0.5145377999194332, 0.5284183241746799, 0.5414619578383972, 0.553652507622671, 0.5649882385806323, 0.5754796233449071, 0.5851472230342661, 0.5940197339122368, 0.6021322129560094, 0.6095244833178443, 0.6162397144384499, 0.6223231690776931, 0.6278211091016901, 0.6327798523441952, 0.6372449734926806, 0.6412606423067747, 0.6448690923717992, 0.6481102130078032, 0.6510212559919547, 0.6536366475699825 ], [ 0.27812887479699466, 0.2619778803219499, 0.24761178226193511, 0.23522614433888664, 0.22500577924768098, 0.21713616990765208, 0.2117954970476036, 0.20911983508778936, 0.20915190794712002, 0.21180033549365848, 0.216836298794196, 0.2239349128443357, 0.23274395033637021, 0.24295070284308123, 0.2543233761597434, 0.26671855854112475, 0.2800607760869372, 0.2943080555937638, 0.309417812714355, 0.3253226517944029, 0.34191940112712754, 0.35906979432734654, 0.376608803933842, 0.39435640148359263, 0.41212949236296864, 0.4297520756363526, 0.44706279863275117, 0.4639198357503287, 0.48020343725039394, 0.49581665803770936, 0.5106847861134647, 0.5247539217599022, 0.5379890616575482, 0.5503719455577455, 0.5618988404390463, 0.5725783727627823, 0.5824294730631779, 0.5914794659370186, 0.5997623190988413, 0.607317054214748, 0.6141863168863693, 0.6204151012008629, 0.6260496240616672, 0.6311363449532987, 0.6357211271769356, 0.6398485365511515, 0.64356127297193, 0.646899729102084, 0.6499016689519653, 0.6526020174163473 ], [ 0.273231820421607, 0.2571012648309676, 0.24281430111068908, 0.23054194030507924, 0.22043588949829446, 0.21264753182174395, 0.2073295563871713, 0.2046091435964777, 0.20453924927987618, 0.20705322557872263, 0.21195186353633105, 0.2189351008764994, 0.22766525540912144, 0.23783344316167393, 0.24920372252529072, 0.26162420037349676, 0.27500975892162594, 0.2893098880158071, 0.30447590792395146, 0.32043724837745907, 0.3370902667150043, 0.35429826132046005, 0.3718989613137392, 0.3897154898756662, 0.40756767708252617, 0.42528181073544147, 0.4426979765661965, 0.459674875041924, 0.4760924155583295, 0.49185255958120455, 0.5068789025348017, 0.5211154231120868, 0.5345247376818338, 0.5470861054409571, 0.5587933509723444, 0.5696528097090918, 0.579681358138418, 0.5889045616813215, 0.5973549555887085, 0.6050704645597965, 0.612092962294564, 0.6184669706593846, 0.6242384980087775, 0.6294540164274133, 0.6341595776160734, 0.6384000665423583, 0.6422185907408949, 0.6456560013643831, 0.6487505399380794, 0.6515376024852312 ], [ 0.26927012043312204, 0.2531714275423804, 0.23896650015244417, 0.22680293218478767, 0.21680027457160703, 0.2090760300561933, 0.20375669585318795, 0.2009594077576466, 0.2007468387929087, 0.20307830592862275, 0.20778750732851906, 0.21460375305566454, 0.22320821492386878, 0.23329852324324338, 0.244634974419487, 0.2570554408053243, 0.27046208573741765, 0.2847925270740128, 0.2999892931030406, 0.3159770780970731, 0.3326514202983052, 0.3498778304129444, 0.3674980896738364, 0.3853400654213695, 0.40322811784936063, 0.42099224778060046, 0.4384751134837913, 0.4555367442953152, 0.4720571869946403, 0.4879375001721142, 0.5030995422174885, 0.5174849487055905, 0.5310536131580292, 0.543781900427134, 0.5556607487937908, 0.5666937604278726, 0.5768953399750697, 0.5862889150721277, 0.5949052571423217, 0.6027809126114074, 0.6099567509832602, 0.6164766349536622, 0.6223862174706586, 0.6277318704418251, 0.6325597491217075, 0.6369149948682434, 0.6408410769314242, 0.6443792713694898, 0.6475682723006838, 0.6504439277519465 ], [ 0.2662691796646548, 0.2502009418418753, 0.2360644185492793, 0.22398625226811808, 0.21405684519869128, 0.2063623507890364, 0.2010042424449518, 0.19808923706831136, 0.1976886399647796, 0.19978740763675637, 0.2042537178963467, 0.21084969288025715, 0.2192794680296788, 0.2292503679457231, 0.24052005082735056, 0.25291502213538336, 0.26632197707308064, 0.28066333754284256, 0.2958699079998487, 0.3118597071155918, 0.32852668484155134, 0.3457388294152235, 0.3633429733233625, 0.381173124085039, 0.3990596701498161, 0.4168377082348484, 0.4343536021795752, 0.4514695309042999, 0.46806617931550737, 0.4840439130393342, 0.49932282260292077, 0.5138419874959677, 0.5275582415217727, 0.540444646628308, 0.5524888177187347, 0.5636911911875205, 0.5740632951787902, 0.5836260573595958, 0.5924081731030856, 0.6004445502969894, 0.6077748439990024, 0.6144420929757557, 0.6204914695140062, 0.6259691530048591, 0.6309213362762275, 0.6353933713621333, 0.6394290584171586, 0.6430700780013598, 0.6463555632360868, 0.6493218046511895 ], [ 0.2642462828197461, 0.24819576764456766, 0.23409926707766426, 0.22206603620200277, 0.2121621033162595, 0.20444683128578509, 0.19899952424154757, 0.19591688305046664, 0.19527736975626458, 0.1970899484161602, 0.2012573161472657, 0.20757681488767604, 0.21577945598167206, 0.2255859259674205, 0.23675314878187045, 0.24909584292340706, 0.26248292301664816, 0.276818391174947, 0.29201819986298616, 0.30799135757327606, 0.3246289812370529, 0.34180134681280794, 0.3593609676723795, 0.3771491278800726, 0.39500358543488795, 0.4127658377796061, 0.430287060028256, 0.44743240076907237, 0.4640836932966605, 0.4801408307666576, 0.49552211331989177, 0.5101638576251919, 0.5240195068820662, 0.537058419408838, 0.5492644609327509, 0.5606344850786065, 0.5711767586005366, 0.5809093704416367, 0.58985865382328, 0.5980576455142851, 0.6055446040110878, 0.6123616069983757, 0.6185532471369867, 0.624165443366222, 0.6292443822626966, 0.6338356005507481, 0.6379832157505487, 0.6417293074192455, 0.6451134467808267, 0.6481723680595184 ], [ 0.26320871580462246, 0.24715404538012964, 0.2330571764177376, 0.22101426993155915, 0.21107301727743472, 0.2032720663718588, 0.19767275767185166, 0.19436294583449468, 0.19342671449385476, 0.19489460827055866, 0.198702795897371, 0.20468542870127265, 0.2126040949982661, 0.2221968756344242, 0.23322253460371897, 0.24548425692654718, 0.25883132603640246, 0.2731462520044782, 0.2883268550020729, 0.3042704253060816, 0.3208635238581784, 0.3379780499555842, 0.35547242941520885, 0.3731960679418002, 0.3909952464025264, 0.4087190608155522, 0.4262245498674059, 0.44338062835300596, 0.46007077824450804, 0.47619463553571123, 0.4916686839573489, 0.5064262690756165, 0.5204171146511383, 0.533606481954681, 0.5459740752770811, 0.5575127683276686, 0.5682272070338752, 0.5781323326697558, 0.5872518628631487, 0.5956167646638548, 0.603263751810862, 0.6102338364750659, 0.616570963400732, 0.6223207512020897, 0.6275293615188345, 0.63224251189435, 0.6365046428247899, 0.6403582437177161, 0.6438433368129246, 0.6469971127758015 ], [ 0.2631518169499397, 0.2470644692093178, 0.23291808192248784, 0.22080027942780336, 0.21074706454496644, 0.20278330977314196, 0.19695753031195573, 0.19335067353757532, 0.19205129387534164, 0.19310898860645268, 0.19649189117875282, 0.20207205259640007, 0.209645106062967, 0.21897070241617728, 0.22981244109001928, 0.24196272468529356, 0.2552497353002039, 0.26953156229220276, 0.284684496272478, 0.30059108107926763, 0.3171311739386695, 0.33417720088602915, 0.3515933594609756, 0.3692377394546466, 0.3869661039454304, 0.4046362217500759, 0.4221119709352614, 0.4392667797671232, 0.45598624395200327, 0.4721699299752656, 0.48773245745604044, 0.5026039778587212, 0.516730160585571, 0.5300717801623607, 0.542603980865968, 0.5543152821127143, 0.565206379763542, 0.5752887940199751, 0.584583412181923, 0.5931189728330039, 0.6009305360542965, 0.6080579814969718, 0.6145445723390569, 0.6204356182993266, 0.6257772651097199, 0.6306154313742384, 0.6349949068431624, 0.6389586191198735, 0.6425470690233136, 0.6457979285754485 ], [ 0.26405741999912546, 0.24790472459340473, 0.23365424094518839, 0.22138937935356473, 0.21114101145293498, 0.20292733768883284, 0.1967896765206436, 0.19280478162189166, 0.19106538907828957, 0.19163828174082287, 0.1945223129181737, 0.19962842785076615, 0.2067895529371485, 0.21579097275266387, 0.22640419434724215, 0.23841178308152508, 0.2516195264408004, 0.26585821603466825, 0.2809791040131072, 0.29684671222008063, 0.31333172623924566, 0.33030567441036746, 0.34763809614606445, 0.3651960981184538, 0.382845714222962, 0.4004543358009822, 0.41789356218046414, 0.43504200644811986, 0.451787778172545, 0.4680305061283138, 0.48368285265452177, 0.4986715194716775, 0.51293776883938, 0.5264374963847306, 0.5391408998831845, 0.5510317946338464, 0.5621066313743296, 0.5723732765437233, 0.5818496166534599, 0.5905620483289123, 0.5985439132763222, 0.605833933239338, 0.6124746942611767, 0.6185112226129093, 0.6239896869302678, 0.6289562527535402, 0.6334561071151823, 0.6375326623963778, 0.6412269407045557, 0.6445771328230229 ], [ 0.26589312778243984, 0.24964051967618936, 0.23522901529540857, 0.22274143745834601, 0.21220933612991877, 0.20365084529236482, 0.19710577126066997, 0.19265013042719137, 0.19038181804354906, 0.19038429725421127, 0.19268688412002402, 0.19724080057983243, 0.2039194146995723, 0.21253740188604162, 0.22287695451826484, 0.2347115333436577, 0.24782308071040382, 0.26201206745768935, 0.2771010399368887, 0.2929330496599787, 0.30936696524805957, 0.3262718231939559, 0.3435219217975665, 0.36099358348152505, 0.3785637835559224, 0.3961103772791614, 0.4135134630380888, 0.43065740827527815, 0.44743313903414, 0.46374038980042454, 0.47948969888310733, 0.4946040084537555, 0.5090197885696159, 0.522687653431709, 0.5355724772527074, 0.5476530470779463, 0.5589213111900891, 0.5693812950734002, 0.5790477634103445, 0.5879447075440555, 0.5961037346007518, 0.6035624282276648, 0.6103627426493388, 0.6165494822361149, 0.6221689085805483, 0.6272675066247808, 0.6318909310322789, 0.6360831440735327, 0.6398857471047839, 0.6433374995529628 ], [ 0.2686127033498019, 0.25222561808672805, 0.23759647639253267, 0.22481008415733902, 0.21390320218006226, 0.20489944546082722, 0.19784243268396132, 0.19281151572373464, 0.18991221728463342, 0.18924605827975433, 0.19087420109650965, 0.19479048132242813, 0.20091205953658722, 0.20908642021101823, 0.21910860465146975, 0.2307430156193025, 0.2437456817391895, 0.2578832689530065, 0.27294567641816025, 0.2887509227965385, 0.30514340101419096, 0.321988088690151, 0.33916348411825714, 0.35655532115421146, 0.37405214706834417, 0.39154304557745234, 0.4089172848794293, 0.4260654301902983, 0.44288139499679546, 0.4592649392832318, 0.4751242061960258, 0.49037799084677, 0.5049575381212711, 0.5188077594110254, 0.531887834910129, 0.5441712261000066, 0.5556451627233308, 0.5663096922431624, 0.5761763907078061, 0.5852668354367089, 0.5936109349810628, 0.6012452027691372, 0.6082110494620063, 0.6145531565120833, 0.620317980513692, 0.6255524251702324, 0.6303027054336128, 0.6346134168880452, 0.6385268130181792, 0.6420822838743858 ], [ 0.2721576324091075, 0.2556030373872159, 0.2407021415290042, 0.22754303346203067, 0.2161705918394598, 0.206617980066563, 0.19893719267566023, 0.19321533423786277, 0.18956947034575064, 0.1881226858167166, 0.18897152804436518, 0.19215638164908921, 0.19764229465026575, 0.20531285784969242, 0.21497731951277133, 0.22638989024112463, 0.2392774296612874, 0.25336842501695483, 0.26841572361959604, 0.28420866520162436, 0.3005746626514538, 0.3173733113660997, 0.33448697625561924, 0.35181114786654105, 0.3692466305343696, 0.38669446608524816, 0.4040536583542105, 0.4212212646369142, 0.4380941903837789, 0.45457198076336514, 0.4705599765937792, 0.4859723370133855, 0.5007345857097018, 0.514785483406697, 0.528078150549161, 0.5405804544825569, 0.5522747355527431, 0.5631569809872387, 0.5732355702021664, 0.5825297162291678, 0.5910677202440358, 0.5988851434404039, 0.6060229852947845, 0.6125259412387987, 0.6184407968474441, 0.6238150004074462, 0.6286954414629992, 0.6331274498709645, 0.6371540182350094, 0.6408152405282652 ], [ 0.2764596729646675, 0.25970729988618335, 0.24448482622834383, 0.2308835992510037, 0.21895774975485946, 0.20875230953076257, 0.2003310673381904, 0.19379320312357226, 0.18927232918688644, 0.18691863448048993, 0.18687005797402562, 0.18921975772924632, 0.1939863105961514, 0.2010931184955526, 0.2103641918640209, 0.22154076723713614, 0.23431544932756773, 0.24837276275355188, 0.26342338276079524, 0.27922424029717907, 0.2955835756236508, 0.3123547385042774, 0.3294240582382073, 0.34669743524527896, 0.36408877009802076, 0.3815118025129502, 0.3988757360969162, 0.4160842422950374, 0.4330370214062877, 0.4496329670695094, 0.4657740440081543, 0.4813691632978198, 0.4963375556019831, 0.5106113514821883, 0.5241372508819426, 0.5368772906671111, 0.5488088010751031, 0.5599236867816113, 0.5702271857563923, 0.5797362582726638, 0.5884777466809514, 0.5964864291104618, 0.60380307053837, 0.6104725546894302, 0.6165421610673445, 0.6220600335822949, 0.6270738709489468, 0.6316298544057202, 0.635771815460185, 0.6395406354284738 ], [ 0.28144403507928956, 0.2644674007485802, 0.24887931412842298, 0.23477313344131304, 0.22221164938995164, 0.21125222610802902, 0.20197237161806988, 0.19448698521118302, 0.1889516457666944, 0.18555074708583938, 0.18447213182940858, 0.18587091311971096, 0.1898274279485923, 0.19630987551766663, 0.20515703243193006, 0.21609233984234624, 0.22876655111074068, 0.24281245667532342, 0.25789243253544364, 0.2737271627642598, 0.29010397167655755, 0.306869757654001, 0.32391553322755456, 0.34115871642466367, 0.3585273886059384, 0.37594877653094094, 0.3933426451897767, 0.4106192044740945, 0.427680515069227, 0.4444241511111385, 0.46074793339745534, 0.4765547720507064, 0.49175694880308074, 0.5062794518738837, 0.5200622085109242, 0.5330612268047029, 0.5452487625617205, 0.5566126809860259, 0.5671552011186051, 0.5768912064104265, 0.5858462874534995, 0.5940546596224773, 0.6015570734202541, 0.6083988109998593, 0.6146278397438922, 0.6202931733154434, 0.6254434723200994, 0.630125900612143, 0.6343852393351272, 0.63826324905693 ], [ 0.2870327635409173, 0.26981004848564677, 0.2538193827273433, 0.23915388884814012, 0.2258829106169112, 0.2140748011949631, 0.2038209479154979, 0.19525427499633663, 0.18855723154993997, 0.18395621016459504, 0.181699641912947, 0.18201726019059117, 0.1850632085193944, 0.19085799318649052, 0.19925516511493294, 0.20995323718419917, 0.22255032525759105, 0.23661712948824065, 0.25176029190667615, 0.26766026678891436, 0.2840822813130924, 0.3008673993157047, 0.31791281392921866, 0.3351491427057541, 0.35252004862724284, 0.36996710871214533, 0.38742089806571994, 0.40479786105969445, 0.4220017104925245, 0.4389277696950359, 0.4554687314597908, 0.471520600153839, 0.48698796686944995, 0.5017881372991438, 0.5158539303322642, 0.5291351737724421, 0.5415990488538083, 0.5532294957140406, 0.5640259080753847, 0.5740013346041505, 0.5831803796721097, 0.5915969659793678, 0.5992920906418616, 0.6063116773801639, 0.6127046013506507, 0.6185209401159254, 0.6238104841063296, 0.6286215224666012, 0.6329999052688247, 0.6369883706614448 ], [ 0.2931479270882092, 0.2756627433417756, 0.2592407041099248, 0.24397175966343976, 0.22992852402171027, 0.21718739031768675, 0.2058518822468733, 0.19607329220090222, 0.18806424188210363, 0.18210036434124063, 0.17850271179994323, 0.17759198521953617, 0.17961329727877226, 0.18465113710808026, 0.19257478431171257, 0.20304827688765034, 0.21560246282309514, 0.22973241901296024, 0.24498002345665784, 0.2609813342235044, 0.27747894864713296, 0.2943096591729199, 0.3113792298420111, 0.32863381594685726, 0.3460344204157237, 0.3635379106867621, 0.3810857832240001, 0.3986001471077477, 0.41598534812107113, 0.43313323661058245, 0.44993016260588764, 0.46626416590859376, 0.4820313263748137, 0.4971407108287476, 0.5115177238508379, 0.5251059201875033, 0.5378674798356538, 0.5497826097140819, 0.5608481459787527, 0.5710756110981648, 0.5804889456877543, 0.5891220966977623, 0.5970166062451296, 0.6042193116033351, 0.6107802373183683, 0.6167507349579151, 0.6221819041795104, 0.6271233101840766, 0.6316219969048197, 0.6357217823261644 ], [ 0.29971431889773564, 0.28195635951285886, 0.26508323681892587, 0.2491784511909656, 0.23431384890625892, 0.22056965163152217, 0.2080579278281022, 0.1969462676201571, 0.18747808994309423, 0.17998340088697085, 0.1748678057174004, 0.17256259830370468, 0.1734273350625819, 0.1776284278268737, 0.1850542719396501, 0.19532261906032503, 0.2078779461182776, 0.2221223965938814, 0.23752217981487758, 0.25366456687435457, 0.2702697013369772, 0.28717269610240753, 0.30429123887754034, 0.3215900579506672, 0.33904961850202553, 0.356643071825979, 0.37432276748478066, 0.3920155981608549, 0.40962517613673366, 0.4270383451600731, 0.44413366329905823, 0.46079000251916047, 0.47689404941983027, 0.4923460795722016, 0.5070638257860771, 0.5209845507843237, 0.5340655905337559, 0.5462836938097476, 0.5576334829178691, 0.5681253280150217, 0.5777828819466059, 0.5866404749410429, 0.5947405243846091, 0.6021310763301593, 0.6088635626052721, 0.6149908297838313, 0.620565473064778, 0.6256384885662104, 0.630258241224935, 0.6344697321509188 ], [ 0.30666150304909245, 0.2886270401897589, 0.27129288413620695, 0.25473281464853503, 0.23901357380081556, 0.22421419991597494, 0.21045015304352946, 0.1979006947584131, 0.18683713064042973, 0.17764514923679725, 0.17082456856697523, 0.16693879422568342, 0.16649238104940436, 0.16976049550160754, 0.17665879793620498, 0.18674522974114288, 0.19935368095872769, 0.21377158477147976, 0.22937638317283218, 0.24570188887160327, 0.2624467172784982, 0.2794479749206944, 0.2966396214175971, 0.3140086928310841, 0.33155757394672847, 0.3492766944687747, 0.36712894882358554, 0.3850447681897578, 0.4029252841696368, 0.4206504788300076, 0.43808944500564945, 0.45511056294435553, 0.47159021212340196, 0.4874193573500807, 0.5025078748367146, 0.5167868076154039, 0.530208899345894, 0.5427478035765699, 0.5543963483078752, 0.5651641870545663, 0.5750751087306994, 0.5841642211465925, 0.5924751718673947, 0.6000575270619665, 0.6069643933184928, 0.6132503380573764, 0.618969639908668, 0.624174880263543, 0.6289158705197065, 0.6332388959880001 ], [ 0.3139251650679669, 0.29561735615038576, 0.2778223603074436, 0.26060128398447857, 0.24401157704009732, 0.22812582226175016, 0.21305667824276608, 0.19898816401070607, 0.1862126225770576, 0.17516731782594144, 0.16645080320464758, 0.16077918862532023, 0.15883943530464742, 0.16105437900671934, 0.16738355022652102, 0.17731108279831057, 0.19003019311719999, 0.20468638896494906, 0.22055259018621953, 0.23710411250831906, 0.25401976321082964, 0.2711434471235872, 0.2884307538101859, 0.30589543353322596, 0.32356452083117404, 0.34144663921036233, 0.3595146021373676, 0.3777007135759907, 0.39590147100975936, 0.4139878236217919, 0.4318175301305954, 0.44924707518970525, 0.46614162804716525, 0.4823823935172519, 0.49787130747957603, 0.5125333754661746, 0.5263171045974542, 0.5391935062140271, 0.5511541063764807, 0.5622083329686128, 0.5723805742953068, 0.5817071361607579, 0.5902332666788047, 0.5980103708899811, 0.6050934992972296, 0.6115391638506381, 0.6174035100283501, 0.622740853211709, 0.6276025707395249, 0.6320363274417424 ], [ 0.32144781941291745, 0.3028767899250076, 0.28463134055828987, 0.26675751804958125, 0.24929983525806448, 0.2323194475644051, 0.21591968584226373, 0.20028082958620863, 0.18570572961820525, 0.17267263811592434, 0.16187496674758634, 0.1541965400702492, 0.1505488267766428, 0.15155690001611472, 0.1572551034986621, 0.1670417232973558, 0.17993223582665852, 0.19489596276545051, 0.21108214570664247, 0.22790209771903414, 0.2450174388044732, 0.26228489890673046, 0.27968808186546273, 0.29727247924959194, 0.31509268462105866, 0.3331762448232981, 0.35150485801082554, 0.37001056013193356, 0.38858264404656, 0.4070805656482838, 0.42534873578709725, 0.44323031884254777, 0.46057843690403094, 0.4772642002200449, 0.49318165234132677, 0.5082500707998658, 0.5224141925049017, 0.5356429281344329, 0.547927060045402, 0.5592763267812235, 0.5697162073693836, 0.5792846404245191, 0.5880288492609148, 0.5960023937460472, 0.6032625300728106, 0.6098679284135401, 0.6158767733868031, 0.6213452518787175, 0.6263264160767483, 0.6308693961344117 ], [ 0.32917898500742937, 0.3103616763383584, 0.29168605463613445, 0.27318145640931185, 0.2548766634127455, 0.236817244985777, 0.21909113589124263, 0.20186585956790748, 0.18544158536842711, 0.1703204329839025, 0.1572754387801264, 0.1473610370315029, 0.14175452726282364, 0.1413565932327863, 0.14633089492126122, 0.15598430229293955, 0.16910862339466576, 0.18445288980116248, 0.2010189624514751, 0.21814816917868693, 0.23548873411643498, 0.2529176386068178, 0.2704539404292701, 0.2881804443133633, 0.3061822642765259, 0.32450628335325277, 0.34314154402672664, 0.36201715548196717, 0.38101223186139543, 0.39997204184006435, 0.41872556651583176, 0.4371012826838289, 0.4549395608112957, 0.47210124486919675, 0.4884726952858186, 0.5039679117327471, 0.5185284389173822, 0.5321217098040948, 0.5447383751525263, 0.5563890514061962, 0.5671008127659922, 0.5769136655488382, 0.5858771740741636, 0.5940473545647275, 0.601483913257752, 0.6082478737408465, 0.6143996138387456, 0.6199973123988038, 0.6250957900119415, 0.6297457145754937 ], [ 0.3370749640329007, 0.31803475772666523, 0.2989585161139482, 0.27985803654462893, 0.26074462275016286, 0.2416453120689543, 0.2226277762855865, 0.20383848656650716, 0.18556078309713803, 0.16829835025963977, 0.152875757797978, 0.14050125496931298, 0.13264811855356368, 0.1305853545339067, 0.13469783056772874, 0.144210150162753, 0.15763237821332488, 0.17343457118044278, 0.19044144156819495, 0.20791819521303484, 0.22550518095414634, 0.24310873624135965, 0.26079188692954636, 0.27868074640348106, 0.2968937945180068, 0.3154971950466011, 0.3344851951985388, 0.3537807829789938, 0.37324956566804834, 0.39271978892564685, 0.41200295883923976, 0.43091164973999446, 0.4492729812051979, 0.4669375689878403, 0.4837844843649828, 0.4997230453628523, 0.5146922871951453, 0.5286588550422885, 0.5416139159804614, 0.5535695434675981, 0.5645549060083872, 0.5746124957102839, 0.5837945599625027, 0.5921598456442959, 0.5997707251822627, 0.6066907433152696, 0.6129825995633541, 0.6187065621588699, 0.6239192934780684, 0.6286730543320287 ], [ 0.3450983571567703, 0.3258645073492495, 0.3064255709484799, 0.286775805493454, 0.2669084141656545, 0.2468304073753133, 0.226586096668404, 0.2062944970808427, 0.1862091062521472, 0.16681054484505428, 0.1489352889557018, 0.13390260539342871, 0.12348442604970161, 0.11942319809712451, 0.12247310788414414, 0.13181555035956907, 0.14560334290865706, 0.16194676995946267, 0.1794559934674833, 0.19731483429826824, 0.21516392776828738, 0.23295005405622593, 0.250789725544509, 0.2688585734337094, 0.2873109505701834, 0.30623161208169714, 0.32561719846770415, 0.34538087153602604, 0.3653711479205298, 0.3853964055451124, 0.4052487980697059, 0.4247240409078808, 0.44363578021418215, 0.46182468966419804, 0.47916314185163067, 0.495556508732247, 0.5109420856142168, 0.5252864635383668, 0.5385819847896233, 0.5508427468376765, 0.5621004844564602, 0.5724005577017365, 0.5817981990618695, 0.5903551195373328, 0.5981365344813245, 0.6052086409519408, 0.6116365557287787, 0.6174827049331706, 0.6228056412427467, 0.6276592525740138 ], [ 0.3532174297898847, 0.3338243492904259, 0.3140679136404732, 0.2939256087489446, 0.2733730051521905, 0.2523971026157764, 0.2310178314035351, 0.2093231138347823, 0.18752678111410065, 0.16606343497378678, 0.14573545776566246, 0.1279032696052982, 0.11459238019686553, 0.10811320937536006, 0.10981377071339879, 0.11892964797294145, 0.13315661134445292, 0.15013120853285922, 0.1682031239359005, 0.1864724716262993, 0.2045920721233869, 0.22256230317942197, 0.24056337801033018, 0.25882650763239096, 0.27754379971794024, 0.29681711231035796, 0.31664196743909795, 0.3369175735948547, 0.3574716756630418, 0.3780901046712404, 0.39854410233646353, 0.41861193285120013, 0.4380938822484641, 0.456821236779869, 0.4746604505743998, 0.4915138013859807, 0.5073176701396324, 0.5220393380138139, 0.535672960624196, 0.5482351857292936, 0.5597607344382429, 0.5702981601880478, 0.5799059254264499, 0.5886488839913235, 0.5965952203175974, 0.603813869478987, 0.6103724211009454, 0.6163354932131745, 0.621763548064935, 0.6267121104473826 ], [ 0.3614054176318135, 0.341891868714977, 0.3218691725951551, 0.3012994730028976, 0.2801421431833149, 0.25836559819980115, 0.2359664671592492, 0.21300114801977724, 0.1896387579377044, 0.16625091637210748, 0.14356240323287886, 0.1228867080844523, 0.10639425427473322, 0.09699807979689258, 0.0969464532194553, 0.1057372704189081, 0.12048118182279986, 0.13817921703229036, 0.1568669224937619, 0.17556426813968504, 0.19395252229218027, 0.21210029968117344, 0.23026167556753732, 0.24872878212993854, 0.26773238758539564, 0.2873890270941522, 0.30768893766721267, 0.32851299697671316, 0.34966462215497357, 0.37090479062018167, 0.39198274320001975, 0.41265915290387967, 0.43272142694549315, 0.4519922795413125, 0.47033318473619057, 0.48764425153686053, 0.5038617826504342, 0.5189544614246066, 0.5329188361503562, 0.5457745581386031, 0.5575596763405772, 0.5683261847151313, 0.5781359461640899, 0.587057067762137, 0.595160767973244, 0.6025187518327131, 0.6092010909900875, 0.6152745899307617, 0.6208016066301509, 0.625839285091869 ], [ 0.3696398324100665, 0.35004807150695794, 0.3298151198799547, 0.3088897336806398, 0.28721730977249216, 0.26475029229844216, 0.24146497490639615, 0.21738898274044038, 0.19264726152578657, 0.16754102475729252, 0.14268704552449205, 0.11926654760104528, 0.0994287544032365, 0.08659017875011685, 0.08423511907905512, 0.0925279288194818, 0.1078538494703931, 0.12635299928145835, 0.14568837648439273, 0.1648114991193697, 0.1834514807816436, 0.2017594108333703, 0.22007194302631622, 0.2387459296888991, 0.2580503367757877, 0.2781129401883596, 0.2989140213742496, 0.32031176533639133, 0.3420821070776293, 0.36395945232570875, 0.38567055161076913, 0.40695884725367426, 0.4275997062463169, 0.4474083014370904, 0.46624216240154615, 0.48400016484450237, 0.5006193210129186, 0.516070344976634, 0.5303526557089606, 0.5434892539921549, 0.5555217524370687, 0.5665057332441569, 0.5765065396154523, 0.5855955614887433, 0.5938470456145594, 0.6013354379877208, 0.6081332495925924, 0.6143094222989507, 0.6199281596865645, 0.6250481774547647 ], [ 0.37790180471768287, 0.35827672282618606, 0.3378930224963031, 0.31668840499602546, 0.2945970868257965, 0.271559050924486, 0.24753472415737826, 0.22252847801426642, 0.19662712808692126, 0.17006531593347313, 0.14334316848401796, 0.11745519686030056, 0.09435276561821761, 0.07767053016730444, 0.07231052667863026, 0.07978683968287303, 0.09569314339150603, 0.11501488176424048, 0.13498213970049663, 0.15449485205894245, 0.17334720478698273, 0.19178274460960054, 0.210225814125468, 0.22909918230170095, 0.24870778993855616, 0.26918624104219435, 0.29049996377066206, 0.31248045530855806, 0.33487371466731153, 0.3573866326229576, 0.3797236502730457, 0.40161182409873025, 0.42281560958541836, 0.4431437954485098, 0.4624510088358564, 0.4806357551785176, 0.4976364258984417, 0.5134262544816781, 0.5280078630264239, 0.5414078064004079, 0.5536713653232082, 0.5648577393358869, 0.5750357269014774, 0.5842799391805671, 0.592667567073847, 0.6002757019393925, 0.6071791953986849, 0.6134490309674548, 0.6191511691707593, 0.6243458183362314 ], [ 0.3861754824031005, 0.36656377276229635, 0.3460911264679447, 0.32468675601810754, 0.3022768539050298, 0.2787930287940307, 0.25418533523612047, 0.22844246628014855, 0.20162366807050472, 0.17391130246741276, 0.1457045860581596, 0.1178090567933761, 0.09187122514340984, 0.07134690824890229, 0.06227064727900137, 0.06834481449925735, 0.08463440487000722, 0.10466187714507641, 0.12515468161748405, 0.14496617045816773, 0.16395867288374882, 0.1824677094114945, 0.20100391112992635, 0.22005331782062534, 0.23995252314075338, 0.2608377430107869, 0.2826548240348865, 0.30520534237215463, 0.3282038729354404, 0.3513297284635673, 0.3742658693248601, 0.39672419698048705, 0.418459545229063, 0.4392754726644456, 0.45902463740852995, 0.47760587051391457, 0.49495941977316366, 0.5110613304903595, 0.5259175729037149, 0.539558288759376, 0.5520323780248352, 0.5634025524633576, 0.573740924898181, 0.5831251671501428, 0.591635246442054, 0.5993507336611329, 0.6063486638614043, 0.6127019180819421, 0.6184780854042368, 0.6237387553197545 ], [ 0.39444749055368594, 0.37489686445859816, 0.3543982519512492, 0.3328750422590636, 0.3102487169685634, 0.2864468581366989, 0.2614151506520398, 0.23513533182795346, 0.20765244876806063, 0.1791180411920736, 0.14986506318475804, 0.12055896344385067, 0.09256019809056085, 0.06887579096854932, 0.055821125072402805, 0.05955875897038701, 0.07560659302547501, 0.09595414014095628, 0.11671753370206156, 0.13665637807381276, 0.15567066468248034, 0.1741688945376128, 0.19273673586102347, 0.21191571767166156, 0.2320674348891612, 0.253324012223306, 0.27560762814463435, 0.29868783403424953, 0.3222474214456288, 0.34593892101975315, 0.36942515350206373, 0.3924043008128783, 0.41462284497152707, 0.4358801079386939, 0.4560274776154837, 0.47496454381872166, 0.49263362553326384, 0.5090136262452752, 0.5241137873242043, 0.5379676747868045, 0.5506275899299219, 0.5621595071222077, 0.5726385902568845, 0.5821453083344738, 0.5907621510573815, 0.5985709315225478, 0.6056506519225755, 0.6120758981182581, 0.6179157196388453, 0.6232329433766091 ], [ 0.40270645205655886, 0.3832649145404727, 0.36280347499566123, 0.3412423450802301, 0.31850158127298817, 0.29450905074841177, 0.2692120625123769, 0.24259427181227977, 0.2147005852757451, 0.1856754740745984, 0.15582766410481932, 0.12575716759589708, 0.09665360629883639, 0.07109540795290695, 0.054818682311462814, 0.055259084093398546, 0.06982052355044618, 0.08970432216804719, 0.11028036588095044, 0.13007013077769233, 0.14892829960251627, 0.16729184758956683, 0.18579753500847793, 0.20502842154688458, 0.22536209644569824, 0.24692085285656942, 0.2696002348545296, 0.2931370585582182, 0.3171831153007304, 0.34136565014906156, 0.36532896519652897, 0.38875892717087296, 0.41139471364732444, 0.4330320847627839, 0.45352150661834156, 0.47276341726871096, 0.49070210488846705, 0.5073190961018463, 0.5226265822761843, 0.5366611825636453, 0.5494782054059161, 0.5611464902538319, 0.5717438653420419, 0.581353230796748, 0.5900592600439114, 0.5979457010303721, 0.6050932492331456, 0.6115779555114907, 0.6174701233134097, 0.6228336419727502 ], [ 0.41094256469323054, 0.39165775521195034, 0.3712958757489942, 0.3497764839570821, 0.32702131015322683, 0.30296251928423984, 0.27755455479711083, 0.2507910665719966, 0.22272949247894172, 0.19352839654999363, 0.16350940178564716, 0.13327444029871724, 0.10396408351625802, 0.07789512167760419, 0.05991663847535474, 0.05688975197286023, 0.06847350314676752, 0.0867663048748906, 0.1064972693044945, 0.1257517830180344, 0.14421067465309265, 0.1622703998363091, 0.18058192743706955, 0.19974962599747761, 0.2201561134204621, 0.241908670633548, 0.2648748003965491, 0.2887594024121624, 0.3131850794972041, 0.33775574826476557, 0.36209883054996855, 0.3858890232817566, 0.4088588504361935, 0.43080074471641944, 0.45156416890609485, 0.4710501064536086, 0.4892043684766277, 0.5060105747544162, 0.5214832965584595, 0.5356616268603173, 0.54860331402602, 0.5603795218086569, 0.5710702377803396, 0.5807603296991749, 0.5895362358410579, 0.5974832659009228, 0.6046834809605052, 0.6112141130955117, 0.6171464773417831, 0.6225453214414295 ], [ 0.41914723022221173, 0.4000658295662213, 0.3798643396842914, 0.3584639816063238, 0.3357909412679946, 0.31178518054642684, 0.2864129201235834, 0.25968433531869145, 0.23167912067273194, 0.2025850906759666, 0.17276105969244887, 0.1428504110156105, 0.11400986616727833, 0.08839925353648255, 0.07003008229200854, 0.064305278174582, 0.07214382175298488, 0.08778810213478308, 0.10594445972983052, 0.12420897593318452, 0.14197472541386522, 0.1595217435029255, 0.17747065244748353, 0.1964225793812445, 0.21675339594969745, 0.23855155188689303, 0.2616570836398496, 0.2857454050143811, 0.3104126476840574, 0.3352416242033332, 0.35984435163870754, 0.38388510940274767, 0.4070899372028349, 0.4292476888198817, 0.45020629436017573, 0.4698665868949718, 0.4881751192019927, 0.505116793347651, 0.5207077572690663, 0.5349888060400043, 0.5480194024687207, 0.5598723638823331, 0.5706292255922294, 0.5803762721156528, 0.589201216122946, 0.5971904973613471, 0.6044271669254345, 0.6109893151998501, 0.6169489945774522, 0.622371581211323 ], [ 0.4273127315895164, 0.40847993445926467, 0.3884974044920426, 0.3672900731415599, 0.34479095065697807, 0.3209506312629383, 0.2957506382405277, 0.2692222237399465, 0.24147336865193697, 0.21272908010996677, 0.18339515845845916, 0.15416652888253177, 0.1262230760162534, 0.10158069009771614, 0.08353134591235398, 0.07608586059286025, 0.0804537034868725, 0.0929482132012462, 0.10895679728779183, 0.12580247078017606, 0.1425735377562997, 0.1593822327060851, 0.17677798878484924, 0.19533424065553032, 0.21540952429692647, 0.23707198197532964, 0.2601371864573599, 0.284255264442498, 0.30899953130509705, 0.3339341907832453, 0.35865718437135957, 0.3828227709589922, 0.4061502471746823, 0.42842421099179306, 0.4494901434303099, 0.46924769535862837, 0.4876430957440569, 0.5046614813377773, 0.5203195779600589, 0.5346589502811512, 0.5477399181536571, 0.5596361736222267, 0.570430099529866, 0.5802087736620288, 0.5890606331091485, 0.5970727671920472, 0.6043288014488548, 0.6109073289150364, 0.6168808382921744, 0.6223150822001606 ], [ 0.4354319553266361, 0.4168910074371053, 0.3971831488472018, 0.3762387552333393, 0.35399955915509734, 0.33042888278127636, 0.30552586589077696, 0.27934532635805087, 0.252025935407527, 0.22383135502910628, 0.19521266728107484, 0.16690685804189273, 0.14009428631494633, 0.11662801037267292, 0.09920268437540601, 0.09078006609055386, 0.0924443758472293, 0.10190901058826704, 0.11551925821752307, 0.1306489552199828, 0.14617643483716386, 0.1620418748020428, 0.17869837347952797, 0.1966726302759123, 0.21629856287679666, 0.23762566113638198, 0.26045080310773816, 0.28440504110262915, 0.30904372156038373, 0.3339154741465041, 0.358605609930386, 0.38275864757322353, 0.40608665994243065, 0.4283690592199193, 0.44944771465907835, 0.46921984053218635, 0.4876300831423302, 0.504662601989295, 0.5203335641251038, 0.5346842564979855, 0.5477749033962833, 0.5596792139525704, 0.5704796532373978, 0.5802634150464885, 0.5891190665109238, 0.5971338293671841, 0.6043914577199186, 0.610970666542712, 0.6169440590742866, 0.622377495306164 ], [ 0.4434981568426853, 0.4252899552336841, 0.4059091201885273, 0.3852928706805878, 0.36339306988434467, 0.3401871207527081, 0.3156929329445388, 0.2899895267773865, 0.2632456957941533, 0.23576055936847115, 0.20802199105682867, 0.18079136463035675, 0.15522171947710306, 0.13299075641586952, 0.11631078643703782, 0.10740256145025028, 0.10713025486958423, 0.11402285621596313, 0.12529557502011793, 0.13859595049707887, 0.15273104025885556, 0.167505529833893, 0.1832709395453173, 0.20049656672302446, 0.21948859159819506, 0.2402825285166177, 0.26266492593023455, 0.2862560785471661, 0.310599725534479, 0.335232925517729, 0.35973035524573255, 0.38372734461345526, 0.4069283627836088, 0.42910671126733657, 0.4500994410323703, 0.4698000099390926, 0.4881501509716547, 0.5051317642355996, 0.5207592565801732, 0.535072532083518, 0.5481307162825448, 0.5600066341097485, 0.5707820301986329, 0.5805435053055638, 0.5893791352634113, 0.597375734246277, 0.6046167197424328, 0.6111805316111802, 0.6171395520126142, 0.6225594674683638 ], [ 0.4515047665689802, 0.43366752146386417, 0.414662297952635, 0.3944342209240238, 0.37294621787038956, 0.35019043968256486, 0.3262037152292323, 0.3010884381843387, 0.27504088632419804, 0.24838977737376083, 0.22164863324735629, 0.19558500320758004, 0.17130285722957236, 0.1503053958129392, 0.1344202111225172, 0.12534464286875663, 0.12373610162799585, 0.12858150305029808, 0.13776383233849157, 0.14928338174267017, 0.161988475079498, 0.17560009878946617, 0.19037752088899798, 0.20672939020572229, 0.2249340761015736, 0.24501940426238267, 0.2667714904848311, 0.28980984126428017, 0.31367451595491574, 0.33789630207811416, 0.3620422114870766, 0.38573961922933186, 0.4086854672277821, 0.4306463161126063, 0.4514533765981064, 0.4709951422049765, 0.4892091668997133, 0.5060738444139431, 0.5216006365405393, 0.5358269645850887, 0.5488098506955811, 0.5606203291079264, 0.5713386142194439, 0.5810499967541561, 0.5898414318142984, 0.5977987781586056, 0.6050046440100192, 0.6115367900887039, 0.6174670354077589, 0.6228606062418162 ], [ 0.4594452348851213, 0.44201419083483073, 0.4234290877519943, 0.4036436970166595, 0.38263251005554433, 0.36040250292901727, 0.3370087783269507, 0.3125752441526865, 0.28732181802821466, 0.26159989272804324, 0.23593747248562635, 0.211092943412488, 0.18810737441449044, 0.1683188958807653, 0.1532470619732562, 0.14421030965925588, 0.14169655641230902, 0.1449569681238043, 0.15235959149975153, 0.1622476663910552, 0.17357428299846472, 0.18602232951097417, 0.19977410702148368, 0.21517869170760254, 0.23248747040356715, 0.25172631321475436, 0.272690509517296, 0.29500925073803974, 0.31822792047435294, 0.34187759551738445, 0.36552176447444573, 0.3887820473923551, 0.4113486778110439, 0.4329813929173088, 0.45350493562934724, 0.4728019074593444, 0.490804615381841, 0.5074868388101348, 0.5228560072794407, 0.5369460279930692, 0.5498108632153965, 0.5615188837475106, 0.5721479875387158, 0.5817814546386836, 0.5905045011478087, 0.5984014899610658, 0.6055537520470419, 0.6120379676018858, 0.6179250515731597, 0.6232794832687055 ], [ 0.4673129136350971, 0.4503201269769483, 0.43219534177950564, 0.4129014201804042, 0.39242453845822106, 0.3707860967150648, 0.34805824534551444, 0.3243839079078196, 0.30000225692896587, 0.27528038575451214, 0.25075082173997915, 0.22715101805305463, 0.20545151516451257, 0.18683815837511872, 0.17258063876731097, 0.16371495206771286, 0.1605966360999268, 0.16263990591435834, 0.16856474665923754, 0.17701314137456, 0.18706694788444053, 0.1984025062584916, 0.21114047337141162, 0.22557321098657632, 0.24192531250742927, 0.2602241365275837, 0.28028161293214243, 0.30174606255991365, 0.3241772805560622, 0.34711396139239953, 0.37012123816818204, 0.3928181887549096, 0.41489003245201045, 0.4360903049170573, 0.4562371984837562, 0.47520690687137235, 0.49292572983342725, 0.5093619532433604, 0.5245180569712713, 0.5384235290065164, 0.5511284093169628, 0.5626976028823276, 0.5732059577471442, 0.5827340822672049, 0.5913648650123648, 0.5991806548091068, 0.6062610538856601, 0.6126812726065536, 0.6185109895866607, 0.6238136564477564 ], [ 0.47510097197083717, 0.4585751411031338, 0.4409464015578744, 0.42218688625233763, 0.4022942589800905, 0.38130357323948255, 0.3593024068367157, 0.33644986035029173, 0.31299986842868116, 0.28932871170567676, 0.2659650278269664, 0.24361668359300623, 0.22318016864042325, 0.20570236029593156, 0.19224738070625683, 0.18363556577755985, 0.18012174329806188, 0.18122995461647495, 0.1859411214771336, 0.1931459569049693, 0.20205595411139152, 0.21235956689134955, 0.22412894983675513, 0.2376033646810448, 0.25297993671911045, 0.27028815329920997, 0.2893608248671649, 0.3098724952942686, 0.33140538489275473, 0.3535130971513044, 0.3757681426517671, 0.3977910744899939, 0.41926461360816997, 0.4399374488736042, 0.45962174843278475, 0.4781872693067318, 0.4955539243714984, 0.5116839206591389, 0.5265740966710719, 0.5402487890816409, 0.5527533858412538, 0.5641486256668079, 0.5745056517195398, 0.5839018001421794, 0.5924170900944842, 0.6001313740358634, 0.6071221014869485, 0.6134626446078555, 0.619221129163831, 0.6244597100395114 ], [ 0.4828023442751827, 0.46676868911093305, 0.4496671606747003, 0.43147911267222794, 0.41221323916956154, 0.3919172020063212, 0.3706921378909717, 0.34871035007173645, 0.32623617763339957, 0.30364923063225063, 0.28146732692362064, 0.26036254676552356, 0.2411564605844958, 0.22476985909004962, 0.21209596485368215, 0.20378785406917857, 0.20002541155304454, 0.20041345715261466, 0.20413170600753616, 0.21027440687281532, 0.21817257264057083, 0.22753640269542558, 0.2384003360613547, 0.250954789975711, 0.26536853201253974, 0.28167162266095647, 0.29971872506082886, 0.31921469234852634, 0.33977020094017335, 0.36096017859817686, 0.38237019013400103, 0.4036266923514279, 0.424413029821936, 0.4444750347945104, 0.46361995968054937, 0.4817115933146161, 0.49866349082446454, 0.514431523539078, 0.5290064574111613, 0.5424069509471795, 0.5546731715542845, 0.5658611177133968, 0.5760376719410262, 0.5852763754861804, 0.5936538972449331, 0.6012471587630387, 0.6081310701128662, 0.6143768257280089, 0.620050704180288, 0.6252133114199779 ], [ 0.4904097079594253, 0.4748898952164372, 0.4583421466709785, 0.4407567904296889, 0.42215288614360164, 0.402589462359352, 0.3821792050135089, 0.36110463991497443, 0.3396364105852064, 0.31815229638679066, 0.29715368307172474, 0.27727260071392607, 0.259256679077152, 0.24391293685468918, 0.23199177226498044, 0.22401549720872208, 0.2201094981946216, 0.21994239285465272, 0.22284907952482322, 0.2280894546590198, 0.23509987966311557, 0.24361635402465692, 0.2536444254246872, 0.2653305809517005, 0.2788148811539273, 0.2941253102740028, 0.3111368296294316, 0.3295857682809471, 0.34911489017557684, 0.3693253661751146, 0.3898208432084077, 0.410238061609766, 0.43026440560361484, 0.4496452857910962, 0.4681846247484175, 0.485741159880776, 0.502222510506601, 0.5175782863498392, 0.5317930220475929, 0.5448793922006674, 0.5568719531507288, 0.5678215317801274, 0.5777903081219689, 0.5868475966628516, 0.5950663074120435, 0.602520053738543, 0.609280864767858, 0.615417453213453, 0.6209939838017717, 0.6260692827332032 ], [ 0.49791548890284504, 0.4829276004804919, 0.46695562214266434, 0.44999844528499966, 0.4320846687196673, 0.41328331177473104, 0.3937165364083494, 0.37357418808899195, 0.35312943508073075, 0.33275375845702443, 0.3129276763902537, 0.29424050695163173, 0.27736832401063544, 0.26301618409913147, 0.2518150205124857, 0.24418463883581926, 0.24021180416355892, 0.239617984068147, 0.24186150556940683, 0.24633696769558117, 0.25257130334277184, 0.2603271487645393, 0.26958838524252743, 0.2804629774487864, 0.2930628875727844, 0.30741129135425826, 0.32340040660260977, 0.34079689122986084, 0.3592769081026895, 0.3784710126844011, 0.39800489040446174, 0.41752948502297826, 0.4367396003187534, 0.45538286916739434, 0.4732617928489293, 0.4902313279703646, 0.5061939198151754, 0.5210932952884759, 0.5349078614646539, 0.5476442240539778, 0.5593311206234046, 0.5700139250012427, 0.5797497950061153, 0.5886034854649254, 0.5966438187506952, 0.6039407869681934, 0.6105632480968579, 0.6165771698901923, 0.6220443687121873, 0.6270216853134021 ], [ 0.5053118921195867, 0.4908704344674176, 0.47549170503356064, 0.45918261217925993, 0.44198034565662586, 0.42396245625300066, 0.4052585043155515, 0.38606288782570575, 0.36664788047523367, 0.3473748818778377, 0.32870018590728234, 0.3111691119543717, 0.29538966704831043, 0.28197625533068743, 0.27146007623379065, 0.26418060943102817, 0.2601980619869975, 0.2592788749636872, 0.26098084629452895, 0.26480819855439613, 0.2703646038865081, 0.27743840973026584, 0.2859977024463764, 0.29611751269281245, 0.30788329912881734, 0.3213112560490033, 0.3363072757049717, 0.3526656891331459, 0.3700954681372386, 0.3882579577173814, 0.4068035694935816, 0.425400622090728, 0.44375439945302103, 0.46161737623028903, 0.47879269013142484, 0.495133021453193, 0.5105366646332719, 0.5249420987278727, 0.5383219414192795, 0.5506768505518498, 0.562029713709134, 0.5724203189156059, 0.5819006058868521, 0.5905305391448986, 0.5983746085099022, 0.6054989400233147, 0.6119689855812291, 0.6178477491400468, 0.623194499578849, 0.6280639144628599 ], [ 0.5125909548747802, 0.4987069077295199, 0.48393450707817565, 0.4682880244557709, 0.4518122063491252, 0.43459163596181316, 0.4167612388872115, 0.3985173817204151, 0.3801284177652249, 0.3619425623770209, 0.34438952927907274, 0.32797053573359897, 0.31322984026557227, 0.30070192079846, 0.2908349821000746, 0.2839056617240853, 0.27995656785840967, 0.2787928847265814, 0.28005327671960945, 0.28333129102690513, 0.28829505027770025, 0.29475679059760357, 0.3026735028273877, 0.31209272297244706, 0.32307576726915205, 0.33563049678143847, 0.3496730244298762, 0.36502194521460707, 0.38141710926947325, 0.39855058168540747, 0.4160989277974226, 0.4337501222822648, 0.4512224723360326, 0.46827569438063493, 0.48471560532653357, 0.5003942215546202, 0.5152068804527516, 0.5290876419423759, 0.5420038657058766, 0.5539505627053728, 0.5649449002011747, 0.5750210876971186, 0.5842257706058683, 0.5926139934401682, 0.6002457527866732, 0.6071831334853595, 0.6134880035328109, 0.6192202306942584, 0.6244363746705728, 0.6291888019904078 ], [ 0.5197446189675655, 0.506425521950268, 0.49226828772486186, 0.47729381621904543, 0.46155332355898504, 0.44513692588734877, 0.42818296855490695, 0.41088742746922124, 0.3935121309372289, 0.37638967889082553, 0.35992176693037486, 0.3445663943850199, 0.3308089435121753, 0.3191139833005622, 0.3098608860692353, 0.3032772082452981, 0.2993944540152357, 0.2980512976849752, 0.29895251589950905, 0.3017645403769838, 0.30620933983547366, 0.3121208279207153, 0.3194485901208314, 0.32821770242943904, 0.33846815888938087, 0.35019895067553364, 0.36333345756804736, 0.3777109542526241, 0.39309944594612417, 0.40922053957047827, 0.42577727458819303, 0.4424786620056848, 0.459057954393302, 0.4752841528991034, 0.49096764619683503, 0.5059613913504388, 0.5201590419600639, 0.5334911933364876, 0.5459206231645153, 0.5574371428272624, 0.5680524672259549, 0.5777953600222617, 0.5867072067082686, 0.594838097692239, 0.6022434570712245, 0.6089812218358731, 0.6151095552517578, 0.6206850634269762, 0.6257614734499242, 0.630388723838251 ], [ 0.5267648183466981, 0.5140148936128971, 0.5004776190974558, 0.48617973285637917, 0.47117781175454415, 0.4555660409868719, 0.43948436628609455, 0.42312627292073723, 0.40674489877793124, 0.39065544548887554, 0.3752309692380346, 0.36088791679475984, 0.34805795638520476, 0.3371449398742963, 0.32847131198310464, 0.32222633049633925, 0.31843498079631644, 0.31696484495020194, 0.3175749428534024, 0.31999126273319034, 0.3239806284412742, 0.32939632648982686, 0.336183377700683, 0.3443488760107748, 0.35391448530658026, 0.36487045945873936, 0.3771451311990765, 0.39059507023030204, 0.4050133698951947, 0.42014926618400117, 0.4357317140383106, 0.45149132413201176, 0.46717757608499333, 0.48257036550843707, 0.49748629863949145, 0.5117807753246776, 0.525347036007433, 0.5381132256258196, 0.5500383098366347, 0.5611074566368789, 0.5713273079488245, 0.5807214208235832, 0.5893260529096032, 0.5971863934434193, 0.6043532906763092, 0.610880492200689, 0.6168223907762974, 0.622232251372328, 0.627160882990464, 0.6316557101479631 ], [ 0.5336435777400701, 0.5214638862181492, 0.5085475560796006, 0.49492634223271165, 0.4806610806102398, 0.46584862967602264, 0.4506288750342981, 0.43519099630454205, 0.4197777184673912, 0.40468566746956774, 0.39025933568493726, 0.3768758562036986, 0.3649184031199921, 0.354738399913706, 0.34661129297117743, 0.3406964419294383, 0.33701545173184116, 0.33546076004983943, 0.33583599226660105, 0.3379158767361649, 0.34150455411252073, 0.34647245227272583, 0.3527621727924223, 0.36036669015835493, 0.36929228256876123, 0.3795210780002178, 0.3909846809589739, 0.40355397171393503, 0.4170440431710156, 0.43122943872930697, 0.4458638369007018, 0.4606993323122856, 0.47550231574227964, 0.49006473188272187, 0.504210747087563, 0.5177995349778305, 0.5307251237725901, 0.5429142232130714, 0.5543228026674695, 0.564932014034687, 0.574743888360185, 0.5837771006234053, 0.5920629949965595, 0.5996419885507818, 0.606560418598875, 0.6128678616817127, 0.6186149258908489, 0.6238514993695968, 0.6286254242113591, 0.6329815552303669 ], [ 0.5403731176685026, 0.5287617455422547, 0.5164638047386452, 0.5035152377824078, 0.48998007163374585, 0.4759565383515579, 0.46158298714347384, 0.44704277601458386, 0.4325669250022914, 0.41843285121849094, 0.4049571248343786, 0.3924801828994485, 0.38134179624545034, 0.3718483165599603, 0.36423640900521265, 0.35864204077690487, 0.3550855015987652, 0.35348049286672467, 0.3536673712629768, 0.3554608169592269, 0.35869601183230343, 0.36325845483978236, 0.36908991980118616, 0.37617251740487867, 0.3844998939087221, 0.3940469615935847, 0.40474746532463224, 0.4164840870019774, 0.429091012641548, 0.4423656151802619, 0.4560846975558945, 0.4700212008808255, 0.48395859498585053, 0.49770159272137215, 0.5110829389152519, 0.5239666987152368, 0.536248770005769, 0.5478553953797748, 0.5587403669207167, 0.568881483409335, 0.5782766815256136, 0.5869401420385035, 0.5948985756136118, 0.6021878198043049, 0.6088498250487405, 0.6149300685178218, 0.6204754064439184, 0.625532355039625, 0.6301457751586252, 0.6343579250957242 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8797882786020637, 0.2538099753164488, 0.2177893246192005, 0.16999427478054266, 0.24169164426547812, 0.29757370112642145, 0.31989624212997736, 0.19994776537094644, 0.1388164109700411, 0.07752875423244698, 0.13713930360355236, 0.016140553168952465, 0.16446011821755116, 0.12007657925041298, 0.12859024975029584, 0.06180464689375986, 0.3029253203421831, 0.032071989960968494, 0.3842473151162267, 0.4766513640061021, 0.39657712352396607, 0.41602849023981653, 0.33392672736758633, 0.2841098403409172 ], "xaxis": "x", "y": [ 0.6763492235913873, 0.5209962634593468, 0.42251996880594267, 0.3237038658071498, 0.2298918199768204, 0.11234113271493425, 0.17607168485731015, 0.1660214102755224, 0.12119471039119202, 0.11516090785973897, 0.06824533878418548, 0.6657499736174941, 0.11744680886520979, 0.12025329675406109, 0.15594040991809416, 0.16043639372985674, 0.9376350296661258, 0.47153512574732304, 0.8953125085681677, 0.5385769698768854, 0.7869350652489563, 0.7332864943901622, 0.706868474955653, 0.6094740850009792 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8797882786020637, 0.2538099753164488, 0.2177893246192005, 0.16999427478054266, 0.24169164426547812, 0.29757370112642145, 0.31989624212997736, 0.19994776537094644, 0.1388164109700411, 0.07752875423244698, 0.13713930360355236, 0.016140553168952465, 0.16446011821755116, 0.12007657925041298, 0.12859024975029584, 0.06180464689375986, 0.3029253203421831, 0.032071989960968494, 0.3842473151162267, 0.4766513640061021, 0.39657712352396607, 0.41602849023981653, 0.33392672736758633, 0.2841098403409172 ], "xaxis": "x2", "y": [ 0.6763492235913873, 0.5209962634593468, 0.42251996880594267, 0.3237038658071498, 0.2298918199768204, 0.11234113271493425, 0.17607168485731015, 0.1660214102755224, 0.12119471039119202, 0.11516090785973897, 0.06824533878418548, 0.6657499736174941, 0.11744680886520979, 0.12025329675406109, 0.15594040991809416, 0.16043639372985674, 0.9376350296661258, 0.47153512574732304, 0.8953125085681677, 0.5385769698768854, 0.7869350652489563, 0.7332864943901622, 0.706868474955653, 0.6094740850009792 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:10] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.833465503449015, 0.8331789028564958, 0.8334045846867737, 0.83414914680553, 0.8354177805373774, 0.8372142399346458, 0.839540787646959, 0.842398119346716, 0.845785275111019, 0.8496995502448459, 0.854136418832413, 0.8590894811379428, 0.8645504420152903, 0.8705091231054836, 0.8769535078562939, 0.8838698158044138, 0.8912426011653332, 0.8990548703454584, 0.9072882132026104, 0.9159229434413547, 0.9249382442256642, 0.934312315793362, 0.9440225224989732, 0.9540455372698995, 0.9643574819332976, 0.9749340622647299, 0.9857506969354192, 0.9967826398018297, 1.0080050951973554, 1.0193933260584827, 1.0309227548516013, 1.0425690573678277, 1.054308249525609, 1.0661167673698484, 1.0779715404856243, 1.0898500590585825, 1.1017304348165777, 1.1135914560813895, 1.125412637148325, 1.1371742621976908, 1.1488574239276683, 1.1604440570841548, 1.1719169670513745, 1.183259853657786, 1.194457330345656, 1.2054949388496161, 1.2163591595299106, 1.227037417508809, 1.2375180847643716, 1.247790478343131 ], [ 0.833324874618373, 0.8330689204838461, 0.8333279910829419, 0.8341086228467464, 0.8354159880244771, 0.8372538750312217, 0.8396246352022361, 0.8425290977145861, 0.8459664634406988, 0.849934194192118, 0.8544279148381935, 0.8594413426774341, 0.8649662529898235, 0.8709924839019659, 0.8775079789694986, 0.8844988628107452, 0.8919495436483559, 0.8998428363336951, 0.9081600998781273, 0.9168813843146429, 0.9259855826077349, 0.9354505841789268, 0.9452534273596653, 0.9553704487083592, 0.9657774276428676, 0.9764497252594146, 0.987362416549476, 0.9984904155012807, 1.009808592792369, 1.021291885952498, 1.0329154020086821, 1.0446545127220968, 1.0564849425952823, 1.0683828498725176, 1.0803249007809055, 1.0922883372693002, 1.10425103850025, 1.1161915763404107, 1.1280892650803653, 1.1399242055979524, 1.1516773241620435, 1.1633304060578942, 1.1748661242016456, 1.1862680629012103, 1.197520736913736, 1.2086096059464326, 1.2195210847476423, 1.2302425489378765, 1.2407623367365832, 1.2510697467479905 ], [ 0.8336513176541022, 0.8334291455936506, 0.8337241807051821, 0.8345428573838214, 0.8358902971949922, 0.8377703042664335, 0.840185314597607, 0.8431363004867329, 0.8466226437713815, 0.8506419994750768, 0.8551901727231058, 0.8602610273210898, 0.8658464369101128, 0.8719362819998511, 0.8785184902988346, 0.8855791142195188, 0.893102437969212, 0.9010711066106357, 0.9094662702480374, 0.9182677375873328, 0.9274541342405279, 0.9370030621535739, 0.9468912573845281, 0.9570947441478631, 0.9675889835924456, 0.9783490162209232, 0.9893495972093512, 1.0005653241650379, 1.0119707570810674, 1.0235405304167022, 1.0352494573620514, 1.0470726264389574, 1.0589854906539595, 1.070963949458543, 1.0829844237917445, 1.0950239244848987, 1.107060114302238, 1.1190713638772936, 1.1310368017873043, 1.1429363589881683, 1.154750807812878, 1.166461795718859, 1.1780518739546548, 1.1895045213050306, 1.2008041630659436, 1.2119361853971138, 1.2228869451999116, 1.23364377567134, 1.24419498769117, 1.2545298672074112 ], [ 0.8344504676507993, 0.8342652231364628, 0.8345988133408462, 0.835457528614925, 0.8368464054313642, 0.8387692416662786, 0.8412285508407265, 0.844225455315329, 0.8477595356717273, 0.8518286644439714, 0.8564288538963758, 0.8615541411168393, 0.8671965234752665, 0.8733459476059018, 0.8799903478913297, 0.8871157264770392, 0.8947062655274856, 0.9027444627902316, 0.911211282718654, 0.920086316839226, 0.9293479484206625, 0.938973517675336, 0.948939484671759, 0.9592215878830006, 0.9697949968775641, 0.9806344581137133, 0.9917144331539663, 1.0030092288958445, 1.0144931196323839, 1.0261404609224716, 1.0379257953750842, 1.0498239505396563, 1.0618101291531539, 1.073859992028466, 1.0859497338836002, 1.0980561524112338, 1.1101567108779307, 1.1222295945252168, 1.1342537610236862, 1.1462089852092718, 1.1580758983091772, 1.16983602184594, 1.1814717963919172, 1.1929666053343853, 1.204304793803436, 1.2154716829109307, 1.2264535794487608, 1.2372377811981525, 1.2478125780082432, 1.2581672488109072 ], [ 0.8357262688429611, 0.8355810613317421, 0.8359557748069952, 0.8368565142382185, 0.8382881948418404, 0.8402545829973571, 0.8427582587069273, 0.8458004972930436, 0.8493810916878439, 0.8534981518099782, 0.8581479193250584, 0.8633246268563728, 0.8690204168465627, 0.875225322612028, 0.8819273055826726, 0.8891123385084719, 0.8967645234257509, 0.9048662340528952, 0.913398273961387, 0.9223400436848019, 0.9316697115602228, 0.9413643844318299, 0.9514002753872944, 0.961752866491246, 0.9723970650829054, 0.9833073526658183, 0.9944579257725207, 1.005822828461782, 1.0173760763174264, 1.0290917719779673, 1.0409442123436508, 1.0529079876895646, 1.0649580729658998, 1.077069911595216, 1.0892194920864968, 1.101383417781684, 1.1135389700364677, 1.125664165116734, 1.1377378050686617, 1.149739522796169, 1.161649821556282, 1.1734501090627052, 1.185122726370805, 1.1966509717047846, 1.208019119379367, 1.2192124339645294, 1.2302171798419816, 1.2410206263058758, 1.2516110483672467, 1.2619777234310008 ], [ 0.837480956346828, 0.83737880918125, 0.8377971491089854, 0.8387418579750126, 0.8402176935986292, 0.8422283628349063, 0.8447764966196973, 0.8478635206318075, 0.8514894475134467, 0.8556526376249991, 0.8603495773195777, 0.8655747104838577, 0.8713203404762323, 0.8775766037360275, 0.8843315064930312, 0.8915710117694721, 0.899279163411612, 0.9074382354089005, 0.9160288969851385, 0.925030386162715, 0.9344206863924727, 0.9441767023297415, 0.9542744319584527, 0.9646891330945874, 0.9753954829144195, 0.9863677296122356, 0.9975798356403908, 1.0090056122507103, 1.0206188452588252, 1.0323934121051725, 1.0443033903963275, 1.056323158185892, 1.068427486300928, 1.0805916230435164, 1.0927913716027764, 1.105003160504964, 1.1172041074120942, 1.1293720765568793, 1.141485730076183, 1.1535245734793953, 1.1654689954638666, 1.177300302268303, 1.1890007467376325, 1.2005535522599433, 1.2119429317277781, 1.2231541016723881, 1.2341732917199433, 1.244987749523113, 1.2555857413287614, 1.2659565483525363 ], [ 0.8397150798107058, 0.8396588792736583, 0.8401232378070631, 0.8411137837857601, 0.8426350842618757, 0.8446907570272559, 0.8472834637203267, 0.8504147708703014, 0.854084909654588, 0.8582924944167877, 0.8630342619488638, 0.8683048745898099, 0.8740968056313905, 0.8804003062590207, 0.8872034423950534, 0.8944921858507968, 0.9022505444514286, 0.9104607180384621, 0.9191032700518436, 0.9281573070068491, 0.9376006603200053, 0.9474100665643296, 0.9575613434213108, 0.9680295594499705, 0.9787891964084074, 0.98981430331361, 1.0010786417612292, 1.0125558222811537, 1.0242194316964541, 1.0360431515962936, 1.048000868135722, 1.060066773444523, 1.0722154589688278, 1.0844220010886056, 1.0966620393563977, 1.1089118476919493, 1.1211483988482915, 1.133349422440086, 1.145493456798271, 1.15755989488824, 1.1695290245038024, 1.1813820629275544, 1.193101186230688, 1.2046695533723728, 1.2160713252507132, 1.2272916788538266, 1.2383168166605862, 1.2491339714452419, 1.2597314066483078, 1.2700984124865786 ], [ 0.8424275653925688, 0.8424200138772544, 0.8429326260273511, 0.8439707583312812, 0.8455387604036873, 0.8476401323311616, 0.8502775420963437, 0.8534526795012545, 0.8571659821361857, 0.8614163095001997, 0.8662006425358177, 0.8715138589554488, 0.8773486032493467, 0.8836952478351279, 0.8905419304127797, 0.897874649181971, 0.9056773986341068, 0.9139323315910706, 0.9226199365091592, 0.9317192220541831, 0.9412079033211003, 0.9510625858184426, 0.9612589445761411, 0.971771896599463, 0.982575765498616, 0.9936444375581924, 1.0049515088304957, 1.0164704230759998, 1.0281746005544996, 1.0400375578036922, 1.052033018637578, 1.0641350166604766, 1.0763179896299984, 1.0885568660184386, 1.1008271441220765, 1.1131049640551594, 1.1253671729451824, 1.1375913836201954, 1.1497560270516674, 1.1618403987891324, 1.1738246995977917, 1.1856900704885383, 1.1974186223124772, 1.2089934600793657, 1.22039870215158, 1.2316194944622778, 1.2426420199078299, 1.2534535030699938, 1.2640422104318931, 1.27439744626316 ], [ 0.845615804179967, 0.8456593838859067, 0.8462222864762289, 0.8473095948243473, 0.8489254262544141, 0.8510731392211146, 0.8537553810621434, 0.8569739383265323, 0.8607294295469101, 0.8650209355336475, 0.8698456611005408, 0.8751986849873007, 0.8810728161424697, 0.8874585497354436, 0.8943441048576823, 0.90171552312462, 0.9095568091747719, 0.9178500976580287, 0.9265758351459131, 0.9357129687264707, 0.9452391356205223, 0.9551308500072968, 0.9653636845230874, 0.9759124447610646, 0.9867513356911497, 0.9978541193331595, 1.0091942633167594, 1.0207450801857247, 1.0324798574720613, 1.0443719786903811, 1.056395035492328, 1.068522931280264, 1.0807299766141338, 1.0929909767598742, 1.1052813117265528, 1.1175770091264061, 1.129854810171175, 1.1420922290926123, 1.154267606247821, 1.166360155143074, 1.1783500035850798, 1.1902182291474406, 1.2019468891229994, 1.2135190451206752, 1.2249187824581325, 1.2361312244991947, 1.2471425420869557, 1.2579399582294997, 1.2685117482044106, 1.278847235260216 ], [ 0.8492757465317005, 0.8493727009939132, 0.8499877038929713, 0.8511255833326807, 0.8527902270166259, 0.8549848376307375, 0.8577120146260868, 0.860973605292202, 0.864770368341399, 0.8691015653931233, 0.8739645902442301, 0.8793546972683627, 0.8852648457287986, 0.8916856507406499, 0.89860542043969, 0.9060102566368491, 0.9138841985293281, 0.9222093931322938, 0.9309662803615366, 0.9401337843358597, 0.9496895052281861, 0.9596099079342897, 0.9698705051286197, 0.9804460331329446, 0.9913106195922713, 1.0024379423435952, 1.013801379143074, 1.0253741481257217, 1.0371294390290804, 1.0490405353300731, 1.0610809275292823, 1.0732244178741712, 1.0854452168462372, 1.0977180317517166, 1.11001814775442, 1.122321501677188, 1.134604748878568, 1.146845323486664, 1.1590214922459412, 1.1711124022066748, 1.1830981224629178, 1.1949596801244298, 1.2066790906917442, 1.218239382992208, 1.229624618828213, 1.2408199074870436, 1.2518114152645448, 1.262586370161333, 1.2731330619202672, 1.2834408375862991 ], [ 0.853401975799065, 0.8535543160739237, 0.8542229945983418, 0.8554126253103838, 0.8571268909020846, 0.8593688390524966, 0.8621409966992063, 0.8654452267096177, 0.8692823717011521, 0.8736518176335687, 0.8785510993083021, 0.8839756119642367, 0.8899184449921226, 0.8963703272250358, 0.9033196620149662, 0.9107526280388352, 0.9186533242716995, 0.9270039420027103, 0.9357849513926323, 0.9449752939840776, 0.9545525755006121, 0.9644932552831732, 0.9747728300270725, 0.9853660103238644, 0.9962468890562834, 1.0073891010612774, 1.0187659737368315, 1.0303506684631354, 1.0421163128571846, 1.054036123992996, 1.0660835228025725, 1.0782322399296926, 1.090456413343422, 1.1027306780341903, 1.1150302481164218, 1.1273309916517678, 1.13960949848895, 1.1518431413937602, 1.1640101307181947, 1.1760895628331356, 1.1880614625267376, 1.1999068195512193, 1.2116076194857086, 1.2231468690723044, 1.2345086161766559, 1.24567796452351, 1.2566410833609258, 1.2673852122141671, 1.2778986609008742, 1.2881708049921394 ], [ 0.8579877350330578, 0.8581972739143171, 0.8589209903492041, 0.8601633429658238, 0.8619278557562726, 0.8642174393525247, 0.8670345289682629, 0.8703809515717266, 0.8742575655889178, 0.8786638131723659, 0.883597312915948, 0.8890535595823796, 0.8950257481739047, 0.9015047124509805, 0.9084789559267863, 0.9159347505456014, 0.9238562806447772, 0.9322258144355585, 0.9410238901441843, 0.9502295080987995, 0.9598203231086876, 0.9697728335498432, 0.9800625648894417, 0.99066424620358, 1.0015519787612253, 1.0126993960914403, 1.0240798151949286, 1.0356663787448237, 1.0474321882644673, 1.0593504283809707, 1.0713944823367774, 1.0835380390006222, 1.095755191657106, 1.10802052887362, 1.1203092177480736, 1.1325970798344143, 1.1448606600280211, 1.1570772886736396, 1.169225137136222, 1.181283267052922, 1.1932316734638713, 1.2050513220015626, 1.216724180304947, 1.2282332438148458, 1.2395625561025758, 1.2506972238833969, 1.2616234268705862, 1.2723284226338158, 1.2828005466366905, 1.293029207641968 ], [ 0.8630248898288194, 0.8632932995133029, 0.8640732543275835, 0.8653691259658742, 0.8671843400742713, 0.8695217017332743, 0.8723835428360356, 0.875771603781776, 0.8796866878100801, 0.8841282212397619, 0.8890938454781144, 0.8945791101799063, 0.9005772888136531, 0.9070793093773986, 0.9140737792648448, 0.9215470793922287, 0.9294835047022166, 0.9378654328347354, 0.9466735078462882, 0.9558868301718031, 0.9654831471817692, 0.9754390407882536, 0.9857301098673054, 0.99633114606597, 1.0072163020579559, 1.01835925163679, 1.0297333412667369, 1.0413117328883175, 1.0530675379157957, 1.0649739424759272, 1.0770043240240121, 1.0891323595367859, 1.1013321255249058, 1.1135781901323185, 1.1258456975999822, 1.1381104453693873, 1.1503489540910385, 1.1625385307871503, 1.1746573253989692, 1.1866843809296626, 1.198599677375357, 1.210384169621169, 1.2220198194666965, 1.2334896219373763, 1.2447776260343728, 1.255868950076293, 1.2667497917909976, 1.2774074333241896, 1.2878302413434348, 1.2980076624302341 ], [ 0.8685038304548776, 0.8688327085406978, 0.8696700080528863, 0.871020079873554, 0.8728863124891206, 0.8752714415028853, 0.8781776923550959, 0.881606678464216, 0.8855590856570227, 0.890034257848753, 0.895029800574857, 0.900541273940522, 0.9065620018722719, 0.9130829946881074, 0.9200929661189732, 0.9275784205588434, 0.9355237876557405, 0.9439115858642328, 0.9527226017155849, 0.9619360759514141, 0.9715298908706459, 0.9814807553493243, 0.9917643852945441, 1.0023556780743528, 1.0132288799428313, 1.024357745790534, 1.0357156907737253, 1.0472759335496953, 1.0590116309869075, 1.0708960043346314, 1.0829024569292232, 1.0950046835846206, 1.1071767718645467, 1.1193932954659056, 1.13162939995927, 1.1438608811364748, 1.1560642562104435, 1.1682168281009464, 1.180296743025258, 1.1922830415963388, 1.2041557036157093, 1.2158956867344917, 1.2274849591456334, 1.238906526463622, 1.2501444529454835, 1.261183877208356, 1.2720110226046928, 1.2826132024253407, 1.2929788201130419, 1.303097364683619 ], [ 0.8744133417472104, 0.8748042646797006, 0.8756999816363, 0.8771048757834057, 0.8790223482100374, 0.881455096777207, 0.8844052445305963, 0.8878742536642765, 0.8918626479088403, 0.8963696356317585, 0.9013927359529288, 0.90692747897739, 0.9129672124269693, 0.9195030168466642, 0.9265237137360249, 0.9340159439540168, 0.941964294131597, 0.9503514529139889, 0.9591583838434662, 0.9683645060384435, 0.9779478770084107, 0.9878853740351967, 0.9981528718328683, 1.0087254149620566, 1.0195773839384181, 1.0306826542780567, 1.0420147479428377, 1.0535469768234293, 1.0652525780437863, 1.0771048409934425, 1.0890772260943213, 1.1011434753880511, 1.1132777150885647, 1.1254545502850712, 1.1376491520049035, 1.1498373368570574, 1.161995639478434, 1.1741013779990386, 1.1861327127319996, 1.1980686982819237, 1.2098893292526836, 1.2215755797245482, 1.2331094366622015, 1.2444739274099523, 1.2556531414292724, 1.266632246436295, 1.277397499103407, 1.2879362504989418, 1.2982369464518309, 1.3082891230433056 ], [ 0.8807404867444203, 0.8811950348434886, 0.8821502423505572, 0.8836105585121766, 0.8855794290358106, 0.8880595365185396, 0.8910529097335438, 0.8945608509025805, 0.8985836967971974, 0.9031204847437255, 0.9081686095848854, 0.9137235387360432, 0.9197786210234494, 0.9263249964834479, 0.9333515954449962, 0.9408452067219494, 0.9487905939870858, 0.9571706427987187, 0.965966525370229, 0.975157874328775, 0.9847229597964359, 0.9946388661668514, 1.004881666204257, 1.015426590839766, 1.026248193495377, 1.0373205080667254, 1.048617199916652, 1.0601117094113646, 1.0717773876837187, 1.083587624439686, 1.095515967734369, 1.1075362357335037, 1.1196226205453563, 1.1317497842581288, 1.143892947351345, 1.1560279696691014, 1.168131424151471, 1.1801806635206107, 1.1921538801130176, 1.204030159041271, 1.2157895248596597, 1.2274129818997253, 1.2388825484356338, 1.2501812848357665, 1.2612933158571034, 1.2722038472425052, 1.2828991767884064, 1.2933667000608375, 1.3035949109512088, 1.3135733972788326 ], [ 0.8874705475765441, 0.8879902979298162, 0.8890060711296662, 0.8905223961084119, 0.8925427770093012, 0.8950698931404208, 0.8981056876030713, 0.9016513045912486, 0.9057068857727512, 0.9102712794976298, 0.9153417331871561, 0.9209136293300473, 0.9269803014950407, 0.9335329414687881, 0.940560590006978, 0.9480501941953154, 0.9559867125080581, 0.9643532511528233, 0.9731312193265217, 0.9823004948252492, 0.9918395943590042, 1.0017258448741866, 1.0119355534009555, 1.0224441736742933, 1.033226468227976, 1.0442566649621012, 1.055508607410272, 1.0669558981188099, 1.0785720347124095, 1.0903305383622937, 1.1022050744944847, 1.1141695656768276, 1.126198296703812, 1.1382660119590522, 1.1503480051787147, 1.1624202017674643, 1.1744592338347557, 1.1864425081264, 1.1983482670268228, 1.2101556428041298, 1.2218447052649701, 1.2333965029809288, 1.244793098244388, 1.2560175959103435, 1.2670541662820873, 1.2778880622035025, 1.2885056305288651, 1.298894318152161, 1.3090426727919615, 1.3189403387438423 ], [ 0.8945870469486784, 0.895173540840405, 0.896250932346492, 0.8978238264467527, 0.8998957842032425, 0.9024694838777092, 0.9055467892732957, 0.9091286939326938, 0.9132151477930149, 0.9178048067538617, 0.9228947616634076, 0.9284802990698133, 0.9345547285249082, 0.9411092899757106, 0.9481331375387265, 0.9556133861469335, 0.963535204676698, 0.9718819406752012, 0.9806352651033999, 0.9897753288602364, 0.9992809255039209, 1.009129656411003, 1.0192980957726527, 1.029761953538114, 1.0404962348610953, 1.0514753949080733, 1.0626734881186632, 1.0740643112026909, 1.0856215393301298, 1.0973188551230015, 1.109130070191533, 1.1210292390702115, 1.1329907655016964, 1.1449895010888391, 1.1570008363890718, 1.169000784563355, 1.1809660577165761, 1.192874136080588, 1.204703330197836, 1.2164328362653094, 1.2280427847975564, 1.2395142827655374, 1.2508294493670962, 1.2619714455851194, 1.2729244976927463, 1.2836739148707992, 1.2942061011116979, 1.3045085615959877, 1.3145699037420941, 1.3243798331463121 ], [ 0.9020718500581852, 0.9027265458346907, 0.903866545386574, 0.9054965134418358, 0.9076200551489836, 0.9102398420061165, 0.9133576613893925, 0.916974365180528, 0.9210897216293493, 0.9257022009729952, 0.9308087396947617, 0.9364045274993833, 0.9424828486310218, 0.9490349920552329, 0.9560502299030911, 0.9635158541039345, 0.9714172575847094, 0.9797380469828373, 0.9884601762990363, 0.9975640937116945, 1.0070288961005134, 1.0168324874866561, 1.0269517386800324, 1.0373626461059215, 1.0480404882204641, 1.0589599782288808, 1.0700954120566917, 1.0814208107265302, 1.092910056474348, 1.1045370221024398, 1.1162756932121196, 1.128100283084305, 1.1399853400808233, 1.1519058475235764, 1.1638373160734927, 1.175755868679372, 1.187638318200102, 1.199462237825948, 1.2112060244378111, 1.2228489550505208, 1.2343712364897437, 1.245754048453767, 1.256979580112948, 1.268031060402443, 1.2788927821684637, 1.2895501203355788, 1.2999895442725347, 1.310198624546654, 1.320166034271894, 1.3298815452724273 ], [ 0.9099053315204182, 0.9106295531748767, 0.911833041513103, 0.9135204966909903, 0.9156955477988309, 0.9183608481268479, 0.9215181079914149, 0.9251680461195632, 0.929310262243884, 0.9339430540518953, 0.939063213882773, 0.9446658415210387, 0.9507442008122999, 0.9572896344996784, 0.964291538971955, 0.9717373919480096, 0.9796128222474328, 0.9879017105656911, 0.9965863118524585, 1.005647392092623, 1.0150643742479162, 1.0248154895775228, 1.0348779315439731, 1.0452280101512876, 1.0558413049856217, 1.0666928155306779, 1.077757107569833, 1.089008454695738, 1.1004209741377746, 1.111968756291663, 1.1236259874920553, 1.1353670657063777, 1.1471667089450177, 1.1590000562788123, 1.1708427614311354, 1.1826710789699977, 1.1944619431683907, 1.2061930396311282, 1.2178428698065262, 1.2293908085141663, 1.2408171546281488, 1.2521031750605378, 1.2632311421945, 1.2741843649214262, 1.2849472134429472, 1.2955051380072766, 1.3058446817602747, 1.315953487904958, 1.3258203013787542, 1.3354349652750024 ], [ 0.9180665865805414, 0.9188614756587301, 0.9201291802257561, 0.921874407454946, 0.9241007863778802, 0.9268109371928192, 0.9300064898082779, 0.9336880370166237, 0.9378550241068242, 0.9425055925700266, 0.947636405665767, 0.9532424853755462, 0.959317084419651, 0.9658516068924511, 0.9728355807465937, 0.9802566777597463, 0.9881007727134005, 0.9963520326781492, 1.0049930282632478, 1.0140048603060026, 1.0233672970477246, 1.0330589180803338, 1.0430572622207104, 1.053338977057103, 1.0638799683131994, 1.0746555474699435, 1.0856405763254002, 1.0968096073854108, 1.108137019174468, 1.1195971457385694, 1.1311643997788212, 1.1428133890029908, 1.1545190254107731, 1.1662566273359312, 1.1780020141559102, 1.1897315936479287, 1.2014224420226447, 1.2130523767046935, 1.2246000219563844, 1.2360448674598064, 1.247367319985341, 1.258548748284121, 1.2695715213494625, 1.2804190401999036, 1.291075763344709, 1.3015272261027002, 1.311760053957336, 1.3217619701450125, 1.3315217976897196, 1.3410294561149154 ], [ 0.9265336668324791, 0.9274001423299543, 0.928732599684127, 0.9305357235799705, 0.932813117845598, 0.9355673532891329, 0.9387999744315215, 0.9425114540144973, 0.9467010966294999, 0.9513669050090865, 0.9565054306889865, 0.9621116327667086, 0.9681787646021838, 0.9746983007796136, 0.9816599084806971, 0.9890514609805557, 0.9968590872656728, 1.0050672505375338, 1.0136588487352118, 1.0226153312938224, 1.0319168275446178, 1.0415422831638448, 1.0514696018202527, 1.061675789692383, 1.0721371008968679, 1.0828291821504856, 1.0937272152246975, 1.1048060559649815, 1.1160403688481735, 1.1274047562403844, 1.1388738816936177, 1.1504225867779627, 1.1620260010854022, 1.1736596451598726, 1.185299526206284, 1.1969222265098067, 1.2085049845579625, 1.2200257689044678, 1.2314633448478967, 1.2427973340229632, 1.2540082670202164, 1.2650776291631876, 1.2759878995830163, 1.2867225837405152, 1.2972662395558427, 1.3076044973175214, 1.3177240735556066, 1.3276127790787648, 1.3372595213917648, 1.3466543017280388 ], [ 0.9352838241284731, 0.9362225526064195, 0.9376200800516694, 0.9394810401569011, 0.9418089872043189, 0.9446064264807646, 0.9478748115359028, 0.9516144998853389, 0.9558246682444221, 0.9605031977306961, 0.9656465459681516, 0.9712496250174435, 0.9773057015554435, 0.9838063302316089, 0.9907413248014512, 0.998098766323986, 1.0058650443310366, 1.0140249254205709, 1.0225616436394704, 1.0314570076441514, 1.0406915204589693, 1.0502445084173342, 1.0600942564727016, 1.0702181475108536, 1.0805928036252421, 1.0911942275788564, 1.1019979429034152, 1.1129791312976014, 1.1241127661886958, 1.1353737415159915, 1.1467369949769257, 1.158177625144355, 1.1696710020123258, 1.181192870656547, 1.1927194478040841, 1.2042275111950589, 1.2156944816894, 1.2270984981261737, 1.2384184849840816, 1.249634212922531, 1.2607263523055314, 1.2716765198281839, 1.2824673183796438, 1.293082370289023, 1.303506344112965, 1.3137249751367048, 1.3237250797746514, 1.333494564072422, 1.3430224265295698, 1.3522987554810069 ], [ 0.9442937503120383, 0.9453051266771011, 0.9467678037891839, 0.9486863381859473, 0.9510642123229804, 0.9539038510865154, 0.9572066116593566, 0.9609727404373022, 0.9652012979195894, 0.9698900596524509, 0.975035406421333, 0.9806322187190899, 0.9866737889690913, 0.9931517610364796, 1.000056101745599, 1.0073751048298274, 1.0150954247663688, 1.0232021364163286, 1.0316788159794763, 1.0405076390205048, 1.0496694918378446, 1.0591440929848657, 1.0689101222113626, 1.0789453544525391, 1.0892267967749945, 1.0997308264249865, 1.1104333283374086, 1.1213098306690195, 1.1323356371203543, 1.1434859550073506, 1.154736018231328, 1.166061204470517, 1.177437146073991, 1.1888398342768611, 1.2002457164733602, 1.2116317863820474, 1.2229756670161327, 1.2342556864341157, 1.2454509462940857, 1.2565413832714838, 1.2675078234281796, 1.2783320296420917, 1.2889967422242665, 1.299485712865338, 1.309783732067814, 1.3198766502352008, 1.3297513926045066, 1.339395968225459, 1.3487994732078095, 1.3579520884772702 ], [ 0.9535398040413858, 0.9546239422694428, 0.9561516017673668, 0.9581272388413088, 0.960554244598559, 0.9634349505284052, 0.9667706127485659, 0.9705613702045991, 0.9748061776263351, 0.9795027195168915, 0.9846473154611042, 0.9902348286630467, 0.9962585887234541, 1.0027103368825412, 1.0095801983435457, 1.0168566828862775, 1.024526712431331, 1.0325756727109425, 1.0409874855823367, 1.0497446984776206, 1.058828587729535, 1.0682192728445108, 1.0778958391110895, 1.0878364662015987, 1.0980185606529242, 1.108418890315744, 1.1190137190563152, 1.1297789401895375, 1.1406902073187746, 1.151723061454232, 1.162853053472348, 1.1740558611588512, 1.1853074002427881, 1.1965839289751388, 1.2078621459319825, 1.2191192808281404, 1.2303331782142715, 1.241482373999906, 1.2525461647995726, 1.2635046701416008, 1.27433888761176, 1.2850307410296973, 1.295563121776827, 1.3059199234122367, 1.3160860697296655, 1.3260475364249766, 1.3357913665601986, 1.3453056800281291, 1.3545796772402126, 1.3636036372800888 ], [ 0.9629982190442106, 0.9641549514667437, 0.9657471781622623, 0.9677792355205155, 0.9702544068111005, 0.9731749192820874, 0.976541924241439, 0.9803554566015525, 0.9846143745890968, 0.9893162845116374, 0.9944574586140625, 1.000032755466465, 1.0060355518627782, 1.0124576932788611, 1.0192894672683759, 1.026519601510719, 1.0341352860866315, 1.0421222181476313, 1.0504646664090227, 1.059145552644717, 1.0681465473900622, 1.0774481772101019, 1.0870299410744213, 1.0968704335595514, 1.1069474727691826, 1.1172382310290612, 1.1277193665848841, 1.1383671547122631, 1.1491576168372803, 1.1600666464595204, 1.1710701308613887, 1.1821440677713162, 1.1932646763188142, 1.2044085017725634, 1.2155525136867034, 1.2266741971939983, 1.2377516372792494, 1.2487635959424628, 1.2596895822224712, 1.2705099150994017, 1.281205779331787, 1.2917592743138386, 1.302153456062367, 1.3123723724634047, 1.3224010919273557, 1.3322257256192944, 1.3418334434493202, 1.3512124840266218, 1.3603521588004344, 1.3692428506314747 ], [ 0.9726452906152281, 0.9738741741032775, 0.9755303103456754, 0.9776178995222271, 0.980140103586281, 0.9830990368634588, 0.9864957431263423, 0.9903301565131549, 0.9946010468996637, 0.9993059535514318, 1.0044411133489144, 1.0100013910879415, 1.015980219183593, 1.0223695527967591, 1.0291598444524173, 1.0363400401604037, 1.0438975972852629, 1.0518185231351573, 1.0600874324575174, 1.0686876216362218, 1.077601157245824, 1.0868089766178695, 1.0962909981385875, 1.1060262390897513, 1.1159929389541046, 1.1261686862324707, 1.1365305469644122, 1.147055193307888, 1.1577190307120988, 1.1684983224064351, 1.1793693101188416, 1.1903083301228212, 1.201291923886707, 1.2122969427577637, 1.2233006462538007, 1.2342807936556348, 1.245215728694647, 1.2560844572125602, 1.2668667177371666, 1.277543044970825, 1.2880948262303153, 1.2985043509101886, 1.3087548530689304, 1.3188305472605175, 1.328716657754751, 1.3383994413093692, 1.3478662036765956, 1.3571053100464894, 1.3661061896499629, 1.3748593347651916 ], [ 0.982457539063669, 0.9837578664201061, 0.9854770224154454, 0.9876190579203451, 0.990187002897163, 0.9931828520784983, 0.9966075399357492, 1.0004609029628821, 1.0047416297997114, 1.0094472022025798, 1.0145738318142508, 1.0201163987192945, 1.0260683977828655, 1.0324218979086357, 1.039167517946078, 1.0462944214040013, 1.0537903306915375, 1.0616415604801728, 1.069833069001465, 1.0783485256163354, 1.087170392730663, 1.0962800200097929, 1.105657748805072, 1.1152830247179253, 1.1251345162769575, 1.1351902377874714, 1.145427674527747, 1.1558239086100264, 1.1663557439901342, 1.1769998292905943, 1.1877327772897377, 1.1985312801149273, 1.2093722193552237, 1.2202327704716127, 1.2310905010285647, 1.2419234623966695, 1.2527102746831253, 1.2634302047350798, 1.27406323713296, 1.284590138148387, 1.2949925126876152, 1.3052528542783048, 1.315354588187897, 1.3252821077876062, 1.3350208042989868, 1.3445570900814356, 1.353878415639983, 1.3629732805535288, 1.3718312385451172, 1.3804428969372748 ], [ 0.9924118502004389, 0.9937826652075927, 0.9955637327231914, 0.997758944094475, 1.0003711891137916, 1.0034023380207147, 1.0068532150514127, 1.0107235620463753, 1.015011992565231, 1.0197159388860777, 1.024831595809981, 1.0303538660752518, 1.0362763123136767, 1.0425911199367193, 1.0492890743410537, 1.056359554632008, 1.0637905449074683, 1.0715686631674526, 1.079679207170858, 1.0881062160387656, 1.0968325460596624, 1.1058399589363594, 1.1151092205890254, 1.1246202085694847, 1.134352026136083, 1.1442831210800404, 1.1543914074784505, 1.1646543886704657, 1.175049279904212, 1.1855531292734993, 1.1961429357457205, 1.206795763266478, 1.2174888501043208, 1.228199712764609, 1.238906243950905, 1.2495868041830065, 1.2602203067923465, 1.2707862961088834, 1.2812650187300183, 1.2916374878241264, 1.3018855404712013, 1.311991888083584, 1.3219401599830258, 1.331714940238538, 1.34130179789467, 1.3506873107428126, 1.359859082810596, 1.3688057557663864, 1.3775170144581845, 1.3859835868283839 ], [ 1.0024855939017054, 1.003925708691446, 1.005767376875025, 1.0080143225865243, 1.0106692894169165, 1.0137340197100229, 1.017209227208984, 1.0210945619249974, 1.0253885676115984, 1.0300886337377027, 1.0351909450873384, 1.0406904328711604, 1.046580731430981, 1.0528541442981834, 1.0595016226696359, 1.0665127584715808, 1.073875793259156, 1.0815776433636641, 1.0896039410098748, 1.0979390905912707, 1.1065663388955014, 1.1154678577891273, 1.1246248376767183, 1.1340175899289444, 1.143625656417755, 1.1534279242978018, 1.1634027442265755, 1.1735280503139944, 1.1837814802265427, 1.194140494031403, 1.2045824905415239, 1.215084920103263, 1.225625392945288, 1.2361817823743695, 1.2467323222553444, 1.2572556983468655, 1.267731133179899, 1.2781384642632523, 1.2884582154809086, 1.2986716616116705, 1.308760885955007, 1.3187088310905377, 1.3284993428346559, 1.3381172074883994, 1.3475481824977291, 1.3567790206722532, 1.3657974881320933, 1.374592376175832, 1.3831535072855643, 1.3914717355080282 ], [ 1.0126567223804583, 1.0141647360443193, 1.016065508335175, 1.0183625906397296, 1.021058576116517, 1.0241550770375034, 1.0276526969159747, 1.0315509965615899, 1.0358484543915618, 1.0405424225196622, 1.0456290811418152, 1.0511033943876902, 1.0569590710412913, 1.063188533368396, 1.0697828968131093, 1.0767319626617988, 1.0840242250408971, 1.0916468929080285, 1.099585927068593, 1.107826091724585, 1.1163510196398554, 1.1251432896765878, 1.1341845152118801, 1.1434554417725296, 1.1529360521251182, 1.162605677022335, 1.1724431098299373, 1.1824267233335615, 1.1925345871415574, 1.2027445842479303, 1.2130345254865533, 1.2233822607835503, 1.23376578628949, 1.24416334663968, 1.2545535317436123, 1.2649153676410896, 1.2752284010807793, 1.2854727775772472, 1.295629312786403, 1.3056795571080093, 1.3156058534805197, 1.3253913883797241, 1.33502023607129, 1.3444773962001493, 1.3537488248286302, 1.3628214590617767, 1.3716832354233595, 1.380323102170373, 1.38873102575793, 1.3968979916901016 ], [ 1.0229038501212189, 1.024478167724131, 1.026436379075145, 1.0287818590844637, 1.0315170477253421, 1.0346434260017472, 1.0381614878421752, 1.042070707263365, 1.046369501089643, 1.0510551884648616, 1.0561239492073338, 1.0615707836196722, 1.0673894766156191, 1.073572568967306, 1.0801113381620973, 1.0869957908693442, 1.0942146684400613, 1.1017554662680435, 1.109604467278632, 1.1177467893084743, 1.1261664457080167, 1.1348464181409688, 1.1437687402715828, 1.1529145908202387, 1.1622643943294424, 1.1717979279132142, 1.1814944322582188, 1.1913327251974017, 1.201291316275988, 1.2113485208643486, 1.2214825725297795, 1.231671732548635, 1.2418943956113218, 1.2521291909373324, 1.262355078170423, 1.2725514375611358, 1.2826981540639908, 1.292775695079142, 1.3027651816546086, 1.3126484530366342, 1.3224081245147388, 1.3320276385568242, 1.3414913092705423, 1.3507843602620146, 1.3598929559937945, 1.3688042267720957, 1.3775062875196304, 1.3859882505159928, 1.3942402323123178, 1.4022533550515137 ], [ 1.0332063175574695, 1.0348451689407296, 1.0368590027857398, 1.0392510152856151, 1.0420234916701245, 1.0451777812468124, 1.0487142692714335, 1.052632345146311, 1.0569303671991892, 1.0616056250618695, 1.0666543013383603, 1.0720714347392213, 1.0778508871121448, 1.0839853168118214, 1.0904661606541775, 1.0972836263444448, 1.104426696814269, 1.1118831474055404, 1.1196395763390155, 1.1276814484333078, 1.135993151612018, 1.1445580653652314, 1.1533586400230913, 1.1623764854594827, 1.1715924676750527, 1.1809868116116122, 1.1905392085200837, 1.2002289262353787, 1.210034920793395, 1.219935947946048, 1.2299106732776754, 1.2399377797878828, 1.249996071971956, 1.2600645755917017, 1.2701226324808446, 1.280149989866181, 1.2901268838062696, 1.300034116453448, 1.3098531269328149, 1.319566055705399, 1.3291558023437575, 1.338606076699183, 1.3479014434824634, 1.3570273603169907, 1.36597020935542, 1.3747173225807592, 1.3832570009402845, 1.3915785274874977, 1.3996721747328835, 1.4075292064296607 ], [ 1.0435442405573758, 1.04524569850549, 1.04731320308789, 1.0497497707531338, 1.0525575313835844, 1.0557377027552959, 1.0592905625420566, 1.0632154174821715, 1.0675105699363678, 1.0721732826897767, 1.0771997434095608, 1.0825850305938733, 1.0883230830962896, 1.0944066753692838, 1.10082740045612, 1.107575662504708, 1.1146406802206648, 1.1220105022608247, 1.1296720351272063, 1.1376110836827902, 1.1458124039954078, 1.154259767840567, 1.1629360378713767, 1.1718232522030436, 1.1809027169677702, 1.1901551052750083, 1.199560560960785, 1.2090988055213703, 1.2187492466918728, 1.2284910872375123, 1.238303432661664, 1.2481653966882011, 1.2580562035356475, 1.26795528615799, 1.277842379775799, 1.2876976101569046, 1.297501576226244, 1.3072354266888155, 1.3168809304386784, 1.3264205406017966, 1.3358374521232115, 1.345115652861623, 1.3542399681990258, 1.3631960992114425, 1.3719706544808679, 1.3805511756593556, 1.3889261569253153, 1.397085058499437, 1.4050183144145423, 1.4127173347594728 ], [ 1.0538985476790854, 1.0556605451789716, 1.0577796490032454, 1.0602586958089644, 1.0630996602841598, 1.066303629294056, 1.069870774137176, 1.0738003206246063, 1.0780905171938868, 1.0827386017837712, 1.0877407686660936, 1.0930921368023139, 1.098786721530492, 1.1048174114772729, 1.1111759525340814, 1.1178529405558841, 1.1248378241614287, 1.132118918665799, 1.1396834317875788, 1.147517501368968, 1.1556062449501514, 1.1639338206679422, 1.172483498619868, 1.1812377415611703, 1.1901782935938892, 1.1992862753679185, 1.2085422842444467, 1.2179264978665636, 1.2274187796318696, 1.2369987846555073, 1.246646064937549, 1.256340172592843, 1.2660607601544065, 1.2757876771136796, 1.2855010620058824, 1.2951814294820494, 1.3048097519284685, 1.3143675352981363, 1.3238368889081689, 1.3332005890327763, 1.3424421361852263, 1.351545806036165, 1.3604966939615788, 1.3692807532536144, 1.3778848270627702, 1.3862966741722424, 1.3945049887352101, 1.4024994141343843, 1.4102705511507758, 1.417809960655097 ], [ 1.0642510069990194, 1.0660713534405148, 1.0682398797213892, 1.0707592434490418, 1.0736312648697368, 1.076856900909783, 1.080436217774967, 1.084368361897353, 1.0886515294301873, 1.093282934920609, 1.0982587801889612, 1.1035742247705043, 1.1092233594999914, 1.1151991849256613, 1.1214935962248371, 1.1280973761679074, 1.1350001974581991, 1.1421906354832847, 1.1496561921709287, 1.1573833312731563, 1.1653575250257142, 1.1735633117687825, 1.1819843637860363, 1.1906035643393582, 1.199403092656735, 1.20836451547837, 1.2174688836814513, 1.2266968324839078, 1.2360286837632461, 1.2454445491078263, 1.2549244323318616, 1.2644483303204934, 1.2739963312164295, 1.283548709105625, 1.293086014500074, 1.3025891600457071, 1.3120395010004209, 1.321418910130222, 1.3307098467602354, 1.3398954197934039, 1.348959444574063, 1.3578864935286061, 1.366661940562372, 1.3752719992331286, 1.383703754757858, 1.3919451899431017, 1.3999852051599777, 1.4078136325145783, 1.4154212443926812, 1.422799756584939 ], [ 1.0745842441314355, 1.0764606403890196, 1.0786763204571173, 1.081233764269263, 1.0841346388594926, 1.0873797724624235, 1.090969127528097, 1.0949017725023849, 1.099175852567757, 1.1037885599004564, 1.1087361043422914, 1.114013685674179, 1.1196154688886084, 1.1255345639727228, 1.1317630117273905, 1.1382917770629126, 1.1451107510394727, 1.1522087626741686, 1.1595736012348736, 1.1671920494030852, 1.1750499273346293, 1.1831321472987808, 1.1914227782531788, 1.1999051194307353, 1.2085617817891623, 1.2173747760115847, 1.226325605650955, 1.2353953639782387, 1.2445648331178871, 1.2538145841232176, 1.2631250767474786, 1.2724767577917002, 1.2818501570473213, 1.2912259799908499, 1.3005851965230255, 1.3099091251708703, 1.3191795122853311, 1.3283786058682563, 1.3374892237503495, 1.34649481591756, 1.3553795208479724, 1.3641282157767871, 1.3727265608549095, 1.3811610372086627, 1.3894189789456484, 1.3974885991860988, 1.405359010231015, 1.4130202380086239, 1.420463230969689, 1.4276798636299972 ], [ 1.084881752863905, 1.086811805265631, 1.0890722909486525, 1.091665514060006, 1.0945929900349296, 1.0978554198862933, 1.1014526636934627, 1.1053837131925615, 1.1096466636604914, 1.1142386855926962, 1.1191559969701586, 1.124393837167585, 1.1299464437494153, 1.1358070335176418, 1.1419677892071505, 1.1484198531693728, 1.1551533292482727, 1.1621572938439608, 1.1694198168923173, 1.1769279931805805, 1.18466798408859, 1.192625069512769, 1.2007837094158773, 1.2091276141675256, 1.2176398226128757, 1.2263027866393692, 1.235098460906972, 1.2440083963648139, 1.253013836189495, 1.2620958128386004, 1.2712352450053694, 1.2804130333761807, 1.2896101542207634, 1.2988077499770831, 1.3079872161221373, 1.3171302837411676, 1.326219097318725, 1.3352362873736179, 1.3441650376463745, 1.3529891466227923, 1.3616930832415808, 1.3702620366901286, 1.3786819602405374, 1.3869396091210588, 1.3950225724562986, 1.4029192993445652, 1.4106191191736646, 1.418112256307188, 1.4253898393030393, 1.4324439048542543 ], [ 1.0951278996424316, 1.0971091328776925, 1.099412007917435, 1.10203865542575, 1.1049904411677345, 1.1082679405931983, 1.111870912848727, 1.1157982741629462, 1.1200480707977616, 1.1246174520223136, 1.1295026438241114, 1.1346989242996857, 1.1402006018468636, 1.1460009973965595, 1.1520924319649952, 1.15846622077348, 1.1651126750736134, 1.1720211126372824, 1.179179877633792, 1.186576370335198, 1.1941970867830096, 1.202027668234421, 1.2100529599037335, 1.2182570782430906, 1.226623485780769, 1.2351350723651746, 1.24377424155271, 1.252523000827101, 1.2613630543407786, 1.2702758969169214, 1.2792429081331809, 1.2882454454141334, 1.2972649351789625, 1.30628296121545, 1.3152813495740792, 1.3242422493924138, 1.3331482091667088, 1.3419822480837087, 1.3507279221100537, 1.3593693846106576, 1.367891441331351, 1.376279599636928, 1.384520111944275, 1.3926000133336267, 1.4005071533598707, 1.4082302221214946, 1.4157587706782537, 1.4230832259400752, 1.4301949001798282, 1.4370859953513566 ], [ 1.105307922960316, 1.1073377920074403, 1.1096805825982774, 1.1123382545608396, 1.1153120261845952, 1.118602349183932, 1.1222088832758412, 1.1261304703530488, 1.1303651084473831, 1.1349099259070772, 1.1397611564373566, 1.144914115857343, 1.1503631815908422, 1.156101776020493, 1.1621223548838768, 1.1684164018710483, 1.174974430494565, 1.1817859941491553, 1.1888397050665525, 1.1961232626143667, 1.203623491101805, 1.2113263869580964, 1.2192171748606915, 1.2272803721277727, 1.235499860468115, 1.2438589640114879, 1.2523405324295727, 1.2609270279006926, 1.269600614666523, 1.2783432499678944, 1.2871367752195373, 1.2959630063801457, 1.3048038225849854, 1.3136412522248588, 1.3224575557714076, 1.3312353047595362, 1.3399574564403034, 1.3486074237103305, 1.357169140005979, 1.3656271189230613, 1.3739665083858947, 1.382173139245001, 1.39023356823142, 1.3981351152391002, 1.4058658949461906, 1.4134148428222928, 1.4207717356024856, 1.4279272063411026, 1.4348727541885267, 1.4416007490636014 ], [ 1.1154079285397471, 1.1174838297109109, 1.119864014259073, 1.1225502741115845, 1.1255436825082479, 1.1288445694152267, 1.1324524967058467, 1.1363662331205282, 1.1405837292039396, 1.1451020926171966, 1.1499175644220208, 1.155025497115595, 1.160420335345414, 1.166095600339223, 1.1720438791367611, 1.1782568197007526, 1.1847251329119535, 1.191438602318772, 1.1983861023223867, 1.2055556252436088, 1.2129343174526837, 1.2205085244646516, 1.2282638446289802, 1.2361851907905543, 1.2442568590843013, 1.2524626038582025, 1.2607857176050599, 1.2692091147221318, 1.2777154179060104, 1.2862870460206226, 1.2949063023399645, 1.3035554621546037, 1.312216858833061, 1.320872967537881, 1.3295064859055765, 1.3381004111046182, 1.346638112783645, 1.3551034015112562, 1.363480592388341, 1.3717545635846844, 1.3799108096134987, 1.3879354892124094, 1.395815467747972, 1.4035383541042536, 1.4110925320556804, 1.4184671861608429, 1.4256523222481352, 1.4326387825965172, 1.4394182559453916, 1.4459832824970436 ], [ 1.125414881047157, 1.1275341622546122, 1.1299491804619641, 1.1326615628791648, 1.1356722403306998, 1.138981423179106, 1.142588577142479, 1.146492399045033, 1.1506907927023986, 1.1551808453193189, 1.1599588049533405, 1.1650200597611173, 1.170359119880635, 1.1759696029016404, 1.1818442239278464, 1.1879747912314866, 1.1943522084398643, 1.2009664840752785, 1.207806749098751, 1.2148612828934091, 1.2221175478780961, 1.2295622326815683, 1.237181303549344, 1.244960063416049, 1.2528832178693532, 1.2609349470684539, 1.2690989825659496, 1.2773586879176395, 1.2856971419475254, 1.2940972235582124, 1.3025416970322916, 1.311013296848837, 1.3194948111326754, 1.32796916295496, 1.3364194888059682, 1.34482921366013, 1.3531821221466078, 1.3614624254239773, 1.369654823434609, 1.3777445622828957, 1.385717486542124, 1.3935600863489717, 1.4012595391925058, 1.4088037463481844, 1.4161813639468166, 1.4233818287052644, 1.4303953783800512, 1.4372130670375582, 1.443826775265556, 1.4502292154803382 ], [ 1.1353165929530806, 1.1374765632999309, 1.1399238246730983, 1.14265984296655, 1.1456854094172735, 1.1490006170884532, 1.1526048373542577, 1.1564966964481396, 1.1606740522803758, 1.1651339718860236, 1.1698727100208357, 1.1748856895686517, 1.1801674845476204, 1.185711806593823, 1.191511495850182, 1.197558517189006, 1.2038439626443282, 1.2103580608248228, 1.217090193923315, 1.224028922742417, 1.2311620199292725, 1.2384765113701126, 1.2459587254532711, 1.2535943496829685, 1.2613684939291436, 1.2692657594409398, 1.2772703126388991, 1.2853659626350349, 1.2935362414078888, 1.3017644855760793, 1.3100339187612513, 1.3183277336015728, 1.3266291725620292, 1.334921606781032, 1.3431886122880852, 1.3514140430206, 1.3595821001561899, 1.3676773973582135, 1.3756850216062964, 1.3835905893499478, 1.3913802977825995, 1.3990409710864027, 1.406560101545613, 1.413925885469555, 1.4211272539056583, 1.4281538981598172, 1.4349962901757345, 1.4416456978577321, 1.4480941954524336, 1.4543346691344348 ], [ 1.1451017110346584, 1.1472996498267232, 1.1497765417046777, 1.1525336948443963, 1.1555717639072616, 1.1588907271258475, 1.1624898634836152, 1.1663677300704498, 1.1705221398233667, 1.174950139999949, 1.179647991871343, 1.1846111522522396, 1.1898342575970535, 1.195311111474728, 1.2010346762804862, 1.206997070045019, 1.21318956915571, 1.2196026177096575, 1.2262258440775615, 1.233048085077418, 1.2400574179480433, 1.2472412000877229, 1.254586116297269, 1.2620782330541396, 1.269703059157518, 1.2774456119331372, 1.2852904880768534, 1.2932219381492227, 1.3012239437076658, 1.3092802960732162, 1.3173746757690246, 1.3254907317299707, 1.3336121594599937, 1.34172277739913, 1.349806600850962, 1.3578479129082672, 1.3658313318981095, 1.373741874944961, 1.3815650173213656, 1.3892867473195851, 1.3968936164353134, 1.4043727847063208, 1.4117120610956693, 1.418899938851865, 1.4259256258174555, 1.4327790696944462, 1.4394509783090261, 1.4459328349510434, 1.4522169088946086, 1.458296261235768 ], [ 1.1547597009227324, 1.1569928661879914, 1.1594967613697427, 1.1622725407042294, 1.165320725467382, 1.1686411816996678, 1.1722330981058304, 1.1760949642281777, 1.1802245491060783, 1.184618880757436, 1.1892742269420995, 1.1941860777841655, 1.1993491309303603, 1.2047572799968382, 1.2104036070986266, 1.216280380258171, 1.222379056448272, 1.2286902909385045, 1.2352039534857842, 1.2419091517445704, 1.2487942620797665, 1.2558469677576025, 1.263054304279612, 1.2704027114260952, 1.2778780913994345, 1.2854658723139325, 1.293151076172398, 1.30091839040321, 1.3087522420028592, 1.3166368733343383, 1.3245564186650056, 1.3324949805824997, 1.340436705496529, 1.3483658575127568, 1.3562668900465793, 1.3641245146261467, 1.3719237664121926, 1.3796500660357323, 1.387289277422175, 1.3948277613321691, 1.4022524244050507, 1.4095507635414684, 1.416710905507509, 1.4237216416848413, 1.4305724579302355, 1.4372535595441853, 1.443755891382702, 1.450071153178782, 1.456191810171164, 1.4621110991673065 ], [ 1.1642808300155876, 1.1665464666048166, 1.1690747306452147, 1.1718666263804511, 1.174922545065281, 1.1782422433611264, 1.1818248219782177, 1.1856687046774264, 1.1897716178469426, 1.194130570978985, 1.1987418384826953, 1.2036009433737251, 1.208702643470729, 1.2140409207960563, 1.2196089749153451, 1.2253992209522022, 1.2314032929762289, 1.2376120533838473, 1.2440156087736278, 1.2506033326664014, 1.257363895243416, 1.264285300084147, 1.2713549276908256, 1.2785595854017229, 1.2858855631303145, 1.2933186942313537, 1.3008444206927823, 1.3084478617865436, 1.3161138852803747, 1.3238271803136406, 1.3315723310673089, 1.3393338904060341, 1.3470964527324647, 1.3548447253649563, 1.3625635978250874, 1.3702382084970564, 1.3778540081943222, 1.385396820238321, 1.3928528967183056, 1.4002089706605345, 1.4074523038888473, 1.4145707304077537, 1.42155269518411, 1.428387288244778, 1.4350642740461013, 1.4415741161070397, 1.447907996931792, 1.454057833280067, 1.4600162868739786, 1.465776770659708 ], [ 1.1736561490155761, 1.1759514963438702, 1.1785014945709282, 1.181307002053824, 1.184368283560993, 1.1876849893654313, 1.1912561346489723, 1.1950800793427103, 1.1991545086204698, 1.2034764143607124, 1.2080420779911676, 1.2128470552236996, 1.2178861632664624, 1.2231534711600087, 1.2286422939164532, 1.23434519114109, 1.2402539707803129, 1.246359698566962, 1.2526527136261811, 1.2591226505658435, 1.2657584682131748, 1.272548484982725, 1.2794804206814376, 1.2865414443849494, 1.2937182278654746, 1.3009970039234342, 1.3083636288776015, 1.3158036484037683, 1.3233023658797085, 1.330844912390801, 1.3384163175727313, 1.346001580508472, 1.3535857399524809, 1.3611539432189903, 1.3686915131404067, 1.3761840125716953, 1.3836173059852142, 1.3909776177657676, 1.3982515868766372, 1.405426317624002, 1.4124894262988548, 1.4194290835232741, 1.4262340521716421, 1.4328937207779469, 1.4393981323781362, 1.4457380087720477, 1.4519047702230066, 1.4578905506452962, 1.4636882083601055, 1.4692913325295822 ], [ 1.1828774722924245, 1.1851997717670408, 1.187768876059428, 1.1905855018964309, 1.1936497912614663, 1.1969612912080911, 1.200518934043155, 1.2043210180144994, 1.2083651887209015, 1.21264842155005, 1.2171670055387267, 1.2219165291320344, 1.2268918683890233, 1.2320871782342226, 1.2374958873823034, 1.243110697561796, 1.2489235876298261, 1.2549258231026075, 1.2611079715269016, 1.2674599239901176, 1.2739709229177676, 1.280629596145059, 1.2874239970842543, 1.2943416506509524, 1.3013696044695708, 1.3084944847581859, 1.3157025562002458, 1.3229797850479479, 1.3303119046684255, 1.337684482737537, 1.3450829893027354, 1.3524928649716266, 1.3598995885317633, 1.367288743365051, 1.3746460820829791, 1.3819575888733993, 1.3892095391134625, 1.3963885558644498, 1.4034816629222409, 1.4104763341509077, 1.417360538876809, 1.4241227831666086, 1.4307521468552453, 1.4372383162295077, 1.4435716123099636, 1.4497430147090513, 1.4557441810762326, 1.4615674621727515, 1.4672059126486703, 1.47265329762348 ], [ 1.191937357236055, 1.1942838594023248, 1.1968694547516816, 1.1996947227791974, 1.202759686545735, 1.206063793230679, 1.209605895107686, 1.2133842310863638, 1.2173964090373248, 1.2216393891969344, 1.226109469026856, 1.2308022699766317, 1.235712726659608, 1.2408350789977818, 1.246162867914232, 1.2516889351486458, 1.257405427738904, 1.2633038076490555, 1.2693748669323406, 1.2756087487008498, 1.2819949740370888, 1.2885224748342785, 1.295179632400755, 1.3019543215178764, 1.3088339595085285, 1.3158055597612415, 1.3228557890673711, 1.329971028068075, 1.3371374340737048, 1.344341005509084, 1.3515676472502718, 1.3588032361481788, 1.36603368607732, 1.3732450118996187, 1.3804233917904147, 1.3875552274330731, 1.3946272016475982, 1.4016263330763459, 1.4085400276041957, 1.4153561262419971, 1.4220629492498063, 1.4286493363208193, 1.4351046826882743, 1.4414189710562686, 1.447582799291709, 1.4535874038490126, 1.459424678931767, 1.4650871914267514, 1.4705681916752835, 1.475861620175241 ], [ 1.2008290827310424, 1.203197054155452, 1.2057965450255692, 1.2086280021364209, 1.2116913336429402, 1.2149858903668742, 1.2185104475756532, 1.2222631873822791, 1.2262416819823987, 1.2304428780153494, 1.2348630824058917, 1.239497950108028, 1.2443424742264346, 1.2493909790299917, 1.2546371163905108, 1.260073866174936, 1.2656935410876693, 1.2714877964013167, 1.277447644929484, 1.2835634774879647, 1.2898250889659328, 1.296221709993034, 1.302742044049592, 1.3093743097331307, 1.3161062877722913, 1.3229253722749421, 1.3298186256148872, 1.3367728363031919, 1.3437745791559366, 1.3508102770586745, 1.357866263636165, 1.3649288461607265, 1.3719843680698278, 1.37901927050969, 1.3860201523732187, 1.3929738283549304, 1.399867384600161, 1.4066882315794578, 1.4134241538704058, 1.4200633565778178, 1.4265945081688178, 1.4330067795421164, 1.439289879190806, 1.4454340843555769, 1.4514302681007059, 1.4572699222788486, 1.4629451763826646, 1.4684488123118846, 1.4737742751135403, 1.4789156797809921 ] ], "zauto": true, "zmax": 1.4789156797809921, "zmin": -1.4789156797809921 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.03930518091000739, 0.03789451445616892, 0.036799376676914464, 0.03604853798742881, 0.03566602152519814, 0.03566747792295971, 0.03605737849595272, 0.03682789276788235, 0.037959783562812474, 0.039424953618825746, 0.04118980759535886, 0.04321855395012785, 0.04547585918983327, 0.04792863844198739, 0.05054704126348431, 0.05330482138462101, 0.056179299114673155, 0.0591510900957759, 0.06220372407790568, 0.06532323249447276, 0.06849775019387681, 0.07171715437915241, 0.0749727500543907, 0.07825700337101077, 0.08156332007955183, 0.0848858643458642, 0.08821941253127762, 0.0915592365786535, 0.09490101204227232, 0.09824074634930599, 0.10157472347251677, 0.10489946176856496, 0.10821168226418276, 0.11150828514123276, 0.11478633257823385, 0.1180430364525209, 0.12127574969871256, 0.12448196036160818, 0.12765928758147807, 0.13080547891322652, 0.13391840851383113, 0.13699607584018486, 0.14003660458629175, 0.14303824165875478, 0.14599935604570424, 0.14891843747940853, 0.15179409482886344, 0.15462505418734024, 0.15741015664246266, 0.1601483557339422 ], [ 0.03614818161469008, 0.03465880411991678, 0.033490329786012255, 0.03267734317207392, 0.03224988120588475, 0.032228489679542366, 0.03262019182138812, 0.03341676707768303, 0.03459592853054193, 0.03612483528058635, 0.03796462426512532, 0.04007465544375809, 0.04241569616990962, 0.04495186382037667, 0.047651520114065246, 0.050487438993541786, 0.053436546866571004, 0.056479454996192176, 0.05959992383214431, 0.06278433817281384, 0.06602123198922444, 0.06930087786494177, 0.07261494292437932, 0.07595620662464446, 0.07931833305124021, 0.08269568964971445, 0.08608320463470039, 0.08947625608284929, 0.09287058663720078, 0.0962622386752438, 0.09964750564985547, 0.10302289607253473, 0.10638510726507552, 0.10973100656277443, 0.11305761811809344, 0.11636211383890864, 0.11964180731080958, 0.12289414980878983, 0.12611672770957874, 0.1293072607803812, 0.13246360095043083, 0.13558373127490123, 0.13866576488183974, 0.1417079437563601, 0.14470863726591984, 0.14766634036916967, 0.15057967148073592, 0.15344736998723524, 0.15626829342719645, 0.15904141436037347 ], [ 0.03313970064069719, 0.03156763371477919, 0.03032004545817764, 0.029438397529215194, 0.028960243536887337, 0.028912478827817552, 0.02930549665657902, 0.030130539677790027, 0.0313613010667653, 0.032958880599248876, 0.03487797453366489, 0.0370723342254178, 0.03949851244052084, 0.0421178519345079, 0.04489714827017096, 0.04780849974617578, 0.05082874961378917, 0.05393878148734408, 0.057122812808268815, 0.060367755343009484, 0.06366266798672532, 0.06699830443673173, 0.07036674783257879, 0.07376112057704862, 0.07717535695645344, 0.08060402707047432, 0.08404220203245999, 0.08748535195883811, 0.09092926972898102, 0.09437001478824183, 0.09780387237003363, 0.10122732443730867, 0.10463702940860656, 0.10802980836068914, 0.11140263590914798, 0.11475263437904935, 0.11807707020614708, 0.12137335176971793, 0.12463902806305828, 0.12787178776766966, 0.13106945842103213, 0.13423000546311684, 0.13735153101948908, 0.1404322723340122, 0.14347059980571616, 0.14646501461541428, 0.1494141459506141, 0.1523167478538915, 0.15517169573167308, 0.15797798256822054 ], [ 0.03029311513282818, 0.02863492139533523, 0.02730235206390237, 0.026344887701032237, 0.025809472235186894, 0.025731306395011814, 0.026125286378717163, 0.026981886768958217, 0.028269414055383937, 0.029941164283087685, 0.03194397680391415, 0.034225215245012125, 0.03673702788624785, 0.03943817835990027, 0.04229427317828878, 0.04527715207859085, 0.048363954894177885, 0.05153614817082678, 0.05477864217787961, 0.05807904381812437, 0.06142704917654054, 0.06481396177412461, 0.06823231701664556, 0.0716755932686878, 0.07513799210930855, 0.07861427306366665, 0.08209963077443712, 0.08558960492618779, 0.08908001520800105, 0.09256691521606476, 0.09604656050729256, 0.09951538706829592, 0.1029699973077405, 0.10640715135296601, 0.10982376196578078, 0.11321689181354008, 0.11658375216145318, 0.11992170230815656, 0.12322824928357227, 0.12650104747812072, 0.12973789798534888, 0.132936747524319, 0.13609568687009235, 0.13921294876575213, 0.14228690532169333, 0.1453160649305266, 0.1482990687414122, 0.1512346867476195, 0.15412181354708937, 0.15695946383855344 ], [ 0.02762352346883694, 0.025876747248024558, 0.02445351924320711, 0.023412452806197217, 0.022812176788125006, 0.022698851896482002, 0.023093487431347873, 0.023985439267618786, 0.025335691981820525, 0.027087439590047533, 0.029178013041890244, 0.031547684315929886, 0.03414423388516664, 0.03692427920662664, 0.03985279517997523, 0.04290189044231429, 0.046049434060349614, 0.04927779992980131, 0.05257281768867169, 0.05592293651093744, 0.05931857645490841, 0.06275163391239767, 0.06621510922405119, 0.06970282924341269, 0.07320924281826308, 0.0767292718032944, 0.08025820405682721, 0.08379161793220209, 0.08732533017152533, 0.09085536097808955, 0.0943779114997191, 0.09788935009111145, 0.10138620461000138, 0.10486515869379416, 0.10832305050129828, 0.1117568728204093, 0.11516377376205147, 0.11854105750350477, 0.12188618472672133, 0.12519677253240055, 0.12847059370928335, 0.1317055753087962, 0.13489979652475087, 0.13805148591163804, 0.14115901799725336, 0.14422090935918314, 0.14723581424233279, 0.1502025197979738, 0.15311994102487775, 0.1559871154909884 ], [ 0.025148436772907713, 0.023312270788212915, 0.021793418587039502, 0.02066049151968481, 0.019986504292877776, 0.019832188400305855, 0.02022701273654571, 0.02115870549905327, 0.022578189556061598, 0.024415577993418036, 0.026596882910319728, 0.02905481715637436, 0.031733183365306124, 0.03458717920247522, 0.037581887456292574, 0.04069029808669872, 0.04389146190455528, 0.04716896772251924, 0.05050975711289883, 0.05390322936595109, 0.05734057709426294, 0.060814298540031904, 0.06431784283061745, 0.06784535434459607, 0.07139149057168107, 0.07495129423572816, 0.078520105271433, 0.08209350184871742, 0.0856672623315676, 0.0892373420807043, 0.09279986053979322, 0.09635109521024346, 0.09988748001119278, 0.10340560620399754, 0.10690222458232873, 0.11037424802533127, 0.11381875380969525, 0.11723298529829997, 0.120614352785452, 0.12396043339519201, 0.12726897001077273, 0.13053786926871191, 0.1337651986868397, 0.13694918301763026, 0.14008819992990024, 0.14318077512679256, 0.1462255770078656, 0.14922141097977604, 0.15216721351455442, 0.15506204604750673 ], [ 0.022888589103648962, 0.020964866082427716, 0.01934709163748838, 0.018114090489029323, 0.01735617557554741, 0.017153492000130995, 0.017547453064155037, 0.01852347175328022, 0.020018576866249613, 0.021946074198183545, 0.024218893349248382, 0.026762195361668618, 0.029516674230685946, 0.03243714353168115, 0.035489673637806585, 0.038648775598620726, 0.041895101867196666, 0.045213706253771246, 0.048592772085754285, 0.052022698185902966, 0.05549544805559415, 0.05900408959741756, 0.06254247196507794, 0.06610500094594023, 0.06968648510306658, 0.07328203263973027, 0.07688698444947345, 0.08049687274077752, 0.08410739745549571, 0.08771441476650091, 0.09131393346793738, 0.09490211621347389, 0.09847528341733656, 0.10202991828099447, 0.10556267189588281, 0.10907036773657905, 0.11255000512736787, 0.11599876145994656, 0.11941399307819435, 0.12279323484102861, 0.1261341984372981, 0.12943476956569705, 0.1326930041147067, 0.13590712348738243, 0.13907550921738648, 0.1421966970187248, 0.14526937040418444, 0.14829235399787705, 0.15126460665650382, 0.15418521450260123 ], [ 0.020868761448996527, 0.018863369950534798, 0.017146720018262576, 0.015806788465831376, 0.014953708271828528, 0.01469321545671734, 0.015083855248567044, 0.01610794177243601, 0.01768345565690155, 0.019702566696695335, 0.022063812786434177, 0.024685565869439003, 0.027506817033793585, 0.03048326790542963, 0.033582888721061833, 0.036782283349163516, 0.040064022834228045, 0.043414771479704586, 0.04682399187813438, 0.05028305586278203, 0.05378463627260199, 0.057322292621164596, 0.06089019102912914, 0.06448291747810284, 0.06809535608752049, 0.07172261265574563, 0.07535996951456789, 0.07900286174791217, 0.08264686763047156, 0.08628770814484375, 0.0899212518913364, 0.09354352277687492, 0.09715070866598455, 0.1007391697697591, 0.10430544598839692, 0.10784626274533952, 0.11135853508394748, 0.11483936996157677, 0.11828606678775187, 0.12169611632575204, 0.12506719812060862, 0.12839717663944775, 0.13168409631835953, 0.13492617570835055, 0.1381218009048212, 0.14126951843296034, 0.14436802774722338, 0.14741617348774286, 0.15041293762097804, 0.15335743157657006 ], [ 0.019118361445565092, 0.01704309410573693, 0.01523368180145082, 0.013784171507195343, 0.012825310674229904, 0.012495287912996604, 0.012877219393753284, 0.013949877186833496, 0.015605954967399228, 0.017712215679292147, 0.020152571139320993, 0.022840299426971373, 0.02571449625383261, 0.028733041827165934, 0.03186656465117636, 0.03509413597912275, 0.03840037890281129, 0.04177356214159323, 0.04520434697574369, 0.04868496280087127, 0.0522086648220066, 0.0557693789072947, 0.059361471664105867, 0.06297960490161779, 0.06661864717593478, 0.07027362387387849, 0.07393969304491567, 0.07761213804345453, 0.08128637068434384, 0.08495794046814793, 0.08862254676267882, 0.09227605179669374, 0.09591449303475089, 0.09953409402712234, 0.10313127321244951, 0.10670265042724968, 0.11024505107084438, 0.11375550800641589, 0.11723126136414302, 0.12066975646283604, 0.12406864009193014, 0.1274257554033283, 0.1307391356582838, 0.13400699706244618, 0.1372277309054438, 0.14039989520216284, 0.1435222060126933, 0.1465935285976474, 0.14961286854585187, 0.15257936299262542 ], [ 0.017671236877708753, 0.015545762260574827, 0.013659537384699877, 0.012107239648683389, 0.011037128778165293, 0.010624730566336586, 0.010987033213353424, 0.012100538199709725, 0.013827128833151386, 0.016005549430328954, 0.018506520493699465, 0.021240612979452157, 0.02414876152828001, 0.027191942114915987, 0.030343794894486027, 0.03358589267939141, 0.036904784484377826, 0.04029014800647135, 0.043733627692075866, 0.04722810035546074, 0.050767211041987746, 0.054345082027265464, 0.057956134059216555, 0.06159498100277681, 0.06525637264646622, 0.06893516894008989, 0.0726263343604357, 0.07632494465028633, 0.08002620056380383, 0.08372544490628402, 0.08741818033282976, 0.09110008622217289, 0.09476703356354925, 0.0984150972477656, 0.10204056548025196, 0.10563994626437957, 0.10920997106059475, 0.1127475958287212, 0.11624999972139564, 0.1197145817269679, 0.1231389555692318, 0.12652094316573886, 0.12985856693122663, 0.13315004119182955, 0.13639376295169095, 0.13958830222845545, 0.1427323921489679, 0.14582491897213862, 0.14886491218281242, 0.1518515347787616 ], [ 0.01656388141390816, 0.014416856212398056, 0.012483222114720994, 0.010851563644592638, 0.009678798655386088, 0.009174750196983201, 0.00949753170889035, 0.01062730522441737, 0.0123956379115434, 0.014615025013917732, 0.017146017714943573, 0.019898552081290738, 0.022816217742552512, 0.025863130938889676, 0.029015637043002376, 0.03225738468429442, 0.03557641164139036, 0.03896340113832007, 0.042410626941459244, 0.04591131175076186, 0.049459238186132126, 0.05304851661629447, 0.05667345164216836, 0.06032847117190395, 0.06400809525068647, 0.06770692984457807, 0.07141967576943989, 0.07514114614985401, 0.07886628790912203, 0.08259020424370592, 0.08630817606183373, 0.09001568110536154, 0.09370841001056146, 0.09738227895091187, 0.10103343878008027, 0.10465828078299179, 0.10825343926746084, 0.11181579130469074, 0.11534245396665337, 0.11883077942206142, 0.12227834824839107, 0.12568296130108733, 0.12904263045737652, 0.13235556852433122, 0.13562017857119596, 0.1388350429162917, 0.14199891196982714, 0.14511069310643773, 0.1481694397154371, 0.151174340552775 ], [ 0.01583113922487828, 0.013698680717482876, 0.011760569007946685, 0.0100940683874478, 0.008851529018292786, 0.008259648586985415, 0.008512938017204104, 0.009608346785475652, 0.01136262319069316, 0.013571271170016412, 0.01608814459678568, 0.018822798899292805, 0.02172051453037502, 0.024747336928027823, 0.027881203898122327, 0.031106908585039304, 0.03441322364741146, 0.03779123516204321, 0.0412333669381447, 0.04473280752045461, 0.04828317646263975, 0.05187833499223606, 0.0555122849186885, 0.05917912188712694, 0.06287302203022227, 0.06658824872874325, 0.07031917083194197, 0.07406028659940975, 0.077806249527688, 0.08155189351930635, 0.08529225576210266, 0.08902259633959433, 0.09273841406413476, 0.09643545836129938, 0.10010973726939477, 0.10375752177630829, 0.10737534681580649, 0.11096000930162037, 0.11450856360199425, 0.11801831485907455, 0.1214868105437724, 0.12491183061306424, 0.12829137660716963, 0.13162365999159265, 0.13490709001572246, 0.13814026132680626, 0.1413219415466279, 0.14445105898842897, 0.1475266906638876, 0.1505480507042384 ], [ 0.015499376398080172, 0.013419333802838407, 0.01152559536468885, 0.009882405168625558, 0.008625313908755691, 0.007969442854751329, 0.008121384862576202, 0.009109256064625756, 0.010768599255935832, 0.012896492959772113, 0.01534369726925283, 0.01801748956741882, 0.02086205649846836, 0.023842982684398245, 0.026937969206118507, 0.030131590685369365, 0.033412339236735596, 0.036770942181231364, 0.040199397997165195, 0.043690423916446675, 0.04723714301872486, 0.050832912606977296, 0.054471236950025474, 0.05814573078038561, 0.061850113204202424, 0.0655782193504371, 0.06932402163864536, 0.07308165535186756, 0.07684544501311448, 0.080609929287059, 0.08436988298326213, 0.08812033534656681, 0.09185658425644856, 0.09557420626582028, 0.0992690626225864, 0.10293730155741254, 0.10657535720675486, 0.1101799455852338, 0.11374805803718593, 0.1172769525924146, 0.12076414363254595, 0.12420739024700629, 0.12760468362530944, 0.13095423379768623, 0.13425445600095492, 0.1375039569121704, 0.14070152095966243, 0.1438460968900555, 0.1469367847409075, 0.14997282334173445 ], [ 0.015579130611366943, 0.013582150923836437, 0.011773183336702187, 0.010203909334045363, 0.008985962445634817, 0.008299529469817893, 0.008332389621630822, 0.009144849724935246, 0.010624987691274733, 0.012596613138778965, 0.014914209725852301, 0.01748136553846381, 0.020238051636267365, 0.02314658483169166, 0.026182276168960506, 0.02932789662290719, 0.032570498680485886, 0.035899600090056064, 0.03930614558958485, 0.042781914298051615, 0.046319184567284795, 0.049910549282616935, 0.05354882017312964, 0.057226985253427745, 0.06093819791920236, 0.06467578444691613, 0.06843326147923647, 0.07220435803010347, 0.07598303843403867, 0.07976352393058689, 0.08354031145260944, 0.08730818880742061, 0.09106224587976154, 0.09479788179434248, 0.0985108081866554, 0.1021970488686978, 0.10585293625975292, 0.10947510499590954, 0.113060483146947, 0.11660628146394643, 0.12010998106246669, 0.12356931991896941, 0.12698227852611144, 0.1303470650181966, 0.13366210004303847, 0.13692600162210122, 0.14013757020768078, 0.14329577411447678, 0.14639973547341625, 0.14944871682810282 ], [ 0.016061019492967014, 0.014162840980368565, 0.012458379555444668, 0.010987222668346654, 0.009835309365129066, 0.00914063915099123, 0.009055974988926789, 0.009660074068609059, 0.010903131200440685, 0.012656466680244585, 0.014790382223038119, 0.01720765271957904, 0.019842970048912507, 0.022653396422057506, 0.025609991374867556, 0.028692227621254143, 0.03188458013325472, 0.03517450770864977, 0.038551271624219924, 0.04200524681742847, 0.04552752198844301, 0.04910967036447207, 0.052743622460791895, 0.05642160046107668, 0.06013608992353743, 0.06387983376930331, 0.06764583896995903, 0.07142738969972165, 0.07521806286292504, 0.0790117433389179, 0.08280263727196875, 0.08658528242437472, 0.09035455509727214, 0.09410567346321323, 0.09783419738676864, 0.1015360249625398, 0.10520738609480863, 0.10884483349568265, 0.1124452315007625, 0.11600574310232709, 0.11952381558655643, 0.12299716513844676, 0.126423760749423, 0.12980180773105365, 0.13312973110522988, 0.1364061591082507, 0.13962990701400688, 0.1427999614505054, 0.1459154653546071, 0.14897570368216148 ], [ 0.016917607770665873, 0.015116957269731397, 0.013514111372442688, 0.012137187687357281, 0.011048813025325434, 0.010349830801552986, 0.01015820935608466, 0.010556148145639358, 0.011542644833965103, 0.013042176200191713, 0.014953127589608501, 0.017184928310406643, 0.01966938756054138, 0.022358195613422675, 0.025217204008872573, 0.02822151766653327, 0.031352097914155365, 0.034593594975498666, 0.037933009870905275, 0.04135887822145221, 0.044860774302886514, 0.04842901091829873, 0.05205445985394782, 0.05572844731251448, 0.0594426962129356, 0.06318929761209581, 0.06696069977476135, 0.07074970733639814, 0.07454948554242774, 0.07835356624923182, 0.08215585354248164, 0.08595062764584314, 0.08973254636728782, 0.09349664373167012, 0.0972383257251377, 0.10095336326307831, 0.10463788261354376, 0.10828835358032786, 0.11190157578788294, 0.11547466342383203, 0.11900502879159273, 0.12249036501091325, 0.1259286281820293, 0.12931801930250517, 0.1326569661966587, 0.13594410568727397, 0.13917826620900037, 0.1423584510330642, 0.14548382224421033, 0.1485536855833215 ], [ 0.018110143742003218, 0.01639238958547778, 0.01487239109486028, 0.013568321772125674, 0.01252413618448247, 0.011812513260578571, 0.011523548030265483, 0.011734230031414258, 0.012473174733673697, 0.013710086100884004, 0.015377206429061655, 0.017398868891947066, 0.019709056880524333, 0.022256067643155898, 0.0250008431119865, 0.02791373283312319, 0.03097160850455332, 0.03415575330533455, 0.037450435228027545, 0.04084197428104729, 0.04431814045963033, 0.04786776721035119, 0.05148050443073146, 0.05514666203075804, 0.05885711242123111, 0.0626032312283364, 0.06637686247659114, 0.07017029898114237, 0.07397627168000617, 0.07778794367134612, 0.0815989061316309, 0.08540317428024825, 0.08919518225444227, 0.09296977625010427, 0.09672220562773938, 0.10044811191953477, 0.10414351583244316, 0.10780480244478964, 0.11142870485584315, 0.11501228658037636, 0.11855292299214105, 0.12204828211741835, 0.12549630506709114, 0.12889518637626263, 0.13224335449674868, 0.13553945266158723, 0.13878232031321028, 0.14197097525907218, 0.1451045966909189, 0.1481825091770213 ], [ 0.01959636895030774, 0.017939620011958254, 0.01647659041539809, 0.015217728655216355, 0.014193269923760462, 0.013455953270681791, 0.013075275881449362, 0.013119892556544175, 0.013633154941185818, 0.014617046514235097, 0.01603596425831474, 0.017834366254028133, 0.019953944238794593, 0.022343005893554497, 0.024959087393962034, 0.027768181542736897, 0.03074295833018611, 0.03386103869731781, 0.037103632817575324, 0.040454552450250605, 0.0438995214190729, 0.04742570286067309, 0.05102137820191061, 0.054675730649334224, 0.05837870010076498, 0.062120886522487935, 0.06589348586763169, 0.06968824746503521, 0.07349744517812648, 0.07731385699581135, 0.08113074938774766, 0.08494186394476383, 0.08874140467319779, 0.09252402491676134, 0.09628481330929858, 0.1000192784644459, 0.10372333231852639, 0.10739327218575478, 0.11102576167843128, 0.11461781070239982, 0.11816675476970666, 0.12167023388304782, 0.1251261712460119, 0.1285327520428712, 0.13188840251499967, 0.13519176953991796, 0.13844170089515498, 0.1416372263637248, 0.14477753981204344, 0.14786198234508857 ], [ 0.021336276069532128, 0.019716791286289972, 0.018284233598498612, 0.017043616894632612, 0.01601565147978691, 0.01523934760953854, 0.014769366763542135, 0.014665794271163782, 0.014977624208524469, 0.015727271414033385, 0.0169052822344047, 0.01847734393465185, 0.020396964601086188, 0.02261619357714138, 0.02509147954914232, 0.02778557467060679, 0.030667329940740347, 0.03371071670391683, 0.03689374496189728, 0.04019753118808498, 0.04360557148417537, 0.04710320180320285, 0.05067720738865487, 0.05431554434226629, 0.05800714284621167, 0.06174176869312377, 0.06550992581291888, 0.06930278717779315, 0.07311214498451013, 0.07693037360737384, 0.080750400714195, 0.08456568332257075, 0.08837018658164458, 0.09215836379646108, 0.09592513674168666, 0.09966587569281891, 0.10337637887517002, 0.10705285122254825, 0.11069188246967256, 0.114290424690407, 0.11784576944943255, 0.12135552476634935, 0.12481759210503243, 0.12823014360194013, 0.13159159973870466, 0.13490060764942743, 0.13815602023370777, 0.14135687622411164, 0.14450238133279708, 0.14759189057719202 ], [ 0.023294977030596655, 0.021690655057866087, 0.02026497204466921, 0.01901946081668311, 0.017968484091998554, 0.017141702612747972, 0.01658314026771039, 0.01634521724992558, 0.016477669702768483, 0.017014600957740957, 0.017965673126978412, 0.019315813403356048, 0.021032262263761765, 0.02307391630479222, 0.02539872374556497, 0.02796782190218253, 0.03074707620171412, 0.03370714122477284, 0.036822890014329306, 0.040072681554334195, 0.04343767573659878, 0.0469012657966832, 0.05044863542081363, 0.054066424297827056, 0.05774248018582654, 0.061465676855975954, 0.06522578075659552, 0.06901335294904966, 0.07281967611164594, 0.07663669902740516, 0.08045699300353527, 0.08427371621277036, 0.08808058310305304, 0.09187183688212797, 0.09564222371976512, 0.09938696777826983, 0.10310174652373968, 0.10678266601779343, 0.11042623606588073, 0.11402934522128924, 0.11758923572696861, 0.12110347853016809, 0.12456994853530469, 0.1279868002740302, 0.1313524441726792, 0.1346655235894633, 0.1379248927794946, 0.14112959592697916, 0.1442788473623289, 0.1473720130586508 ], [ 0.025443378963724405, 0.023835477975341347, 0.022397359740556327, 0.021128571076024602, 0.02003940445247825, 0.01915319209233522, 0.018506308338024195, 0.018144707856037518, 0.018116465760427494, 0.018461576655135856, 0.01920256997058706, 0.02034009394638511, 0.021855053909660332, 0.023715163062080442, 0.025882220627446186, 0.02831760376399948, 0.03098536859273373, 0.03385348401107643, 0.0368939640735705, 0.04008248843197369, 0.04339785856123875, 0.046821459871519165, 0.05033679690607517, 0.05392911754394945, 0.05758512000299457, 0.06129272890800396, 0.06504092573917229, 0.06881962060647442, 0.0726195546579126, 0.07643222474599065, 0.08024982397065632, 0.08406519333147383, 0.08787178098693668, 0.09166360659144088, 0.09543522891911027, 0.09918171553963598, 0.10289861372646668, 0.10658192208473609, 0.11022806261087496, 0.11383385305728441, 0.11739647958871399, 0.12091346979366945, 0.12438266616285794, 0.12780220017442034, 0.13117046713748748, 0.13448610194572913, 0.13774795588401845, 0.14095507461671078, 0.1441066774672182, 0.14720213807709204 ], [ 0.027757684260311614, 0.02613135907161049, 0.024665977647304847, 0.023360171466882986, 0.022221747529095275, 0.021269782650493504, 0.020535119808362975, 0.0200583991465458, 0.0198849940475378, 0.020057176929966683, 0.020605476981497155, 0.02154242436216761, 0.022861185944260926, 0.024539053562275398, 0.026543453275216455, 0.02883780286956362, 0.031385717496298156, 0.0341533540275244, 0.037110351965072126, 0.040229939248678015, 0.04348863542829246, 0.046865813989423896, 0.050343258129571467, 0.05390476734741211, 0.05753583170556469, 0.061223371821465325, 0.06495553535930733, 0.0687215390918082, 0.07251154631239255, 0.07631657094392497, 0.08012840139333802, 0.0839395387499276, 0.08774314522587988, 0.09153299978551889, 0.09530345873351705, 0.09904941966928199, 0.10276628770130311, 0.10644994318278984, 0.11009671050423103, 0.11370332768020491, 0.11726691661316674, 0.12078495401888228, 0.12425524306661274, 0.12767588583003572, 0.13104525666823347, 0.13436197666483815, 0.13762488925124008, 0.14083303712970743, 0.1439856405966442, 0.14708207734685724 ], [ 0.03021845601128475, 0.0285626404728398, 0.02705927850504431, 0.025706816687970167, 0.024511657083923576, 0.023490041184811843, 0.022668783477195406, 0.022084197460428202, 0.02177862053671284, 0.021794450357055645, 0.022166700059386875, 0.02291629787986666, 0.02404660402341101, 0.025544255051096473, 0.02738336160256949, 0.029530901378864965, 0.03195144238570242, 0.034610361262936463, 0.03747558506192888, 0.04051826587546289, 0.043712825413569134, 0.04703669273628283, 0.050469931959633785, 0.05399486328262257, 0.05759572326201613, 0.06125837907378412, 0.06497009637552263, 0.06871935411224747, 0.07249569781764141, 0.07628962323496088, 0.0800924831649709, 0.0838964117368157, 0.08769426152291956, 0.09147954997997453, 0.09524641257293286, 0.09898956063885758, 0.10270424259665677, 0.10638620753259238, 0.11003167051412678, 0.11363727922643056, 0.11720008170385553, 0.12071749505660778, 0.12418727518176216, 0.12760748750650025, 0.13097647884706545, 0.1342928504848355, 0.13755543256567437, 0.14076325992364416, 0.14391554941811338, 0.14701167885648295 ], [ 0.03280964721768174, 0.031116631645102956, 0.029568093756759194, 0.028162770571372044, 0.026906380869348594, 0.02581329995881089, 0.02490738134132405, 0.02422141780839466, 0.023794725978418727, 0.02366860578037002, 0.02388013965910394, 0.024455795031883165, 0.025406897778942228, 0.02672852237768433, 0.028401827676619296, 0.030398449267822054, 0.03268517385076492, 0.035227685365894254, 0.037992988793755955, 0.04095066943470823, 0.044073344768719734, 0.04733664671139862, 0.05071897615432705, 0.0542011766851955, 0.05776620551193163, 0.061398836997109456, 0.06508541059403178, 0.06881362318405437, 0.07257236070972636, 0.07635156239270391, 0.08014211090192526, 0.0839357426218721, 0.08772497317089453, 0.09150303430386504, 0.09526381920635295, 0.09900183391988807, 0.1027121532319234, 0.1063903798345857, 0.11003260592194244, 0.1136353766746582, 0.11719565529018844, 0.12071078937012408, 0.1241784785856669, 0.12759674361711854, 0.13096389641139952, 0.13427851182917472, 0.13753940076518573, 0.14074558482574975, 0.14389627263930474, 0.14699083786184697 ], [ 0.03551776041898883, 0.03378266440901837, 0.032184647485363656, 0.030723027917343153, 0.029403310239813008, 0.028238659959663952, 0.027250728073019807, 0.026469427723027406, 0.02593123061608853, 0.025675691329818853, 0.025740368778631513, 0.02615507056588199, 0.026937009823122172, 0.02808843447691087, 0.02959735061346979, 0.03144068237330064, 0.0335884570650839, 0.03600770461341204, 0.03866536124672921, 0.041530057560973534, 0.04457300195639866, 0.04776825932388666, 0.05109268397675662, 0.054525687003267174, 0.05804894688427205, 0.06164612152629112, 0.06530258838267276, 0.06900522163747415, 0.07274220639642737, 0.07650288580280361, 0.08027763565997334, 0.08405776114416878, 0.08783541078319464, 0.09160350366837713, 0.09535566666531382, 0.09908617910892865, 0.10278992307989941, 0.10646233786000212, 0.11009937756256226, 0.11369747124485445, 0.11725348504646045, 0.1207646860747145, 0.12422870788726667, 0.1276435175124308, 0.13100738400860026, 0.13431884860141036, 0.1375766964568004, 0.1407799301542985, 0.14392774492102783, 0.14701950567606828 ], [ 0.03833118263582088, 0.036551427457561333, 0.03490193228352319, 0.03338275714646248, 0.03199948511541754, 0.03076451097578358, 0.02969782192427021, 0.02882695511136812, 0.028185776135056458, 0.027811795590036915, 0.027742039733794882, 0.028008042941209163, 0.028631126165508614, 0.029619336652185736, 0.030966935068371435, 0.032656329462965976, 0.034661501293497425, 0.036951726410908985, 0.03949471643761486, 0.042258819363518, 0.045214312070470296, 0.04833400111281824, 0.051593374898326806, 0.05497050369525214, 0.058445820965234714, 0.06200186626128059, 0.06562303269365642, 0.06929533878464246, 0.07300623134463954, 0.07674441915762724, 0.08049973414732932, 0.08426301562927484, 0.0880260132355001, 0.09178130455950821, 0.09552222420195489, 0.09924280154592582, 0.10293770518210346, 0.1066021924103216, 0.11023206266064176, 0.11382361400958224, 0.11737360222629675, 0.12087920198071274, 0.12433796999186834, 0.12774780999996185, 0.13110693951810998, 0.1344138583667887, 0.13766731902102136, 0.14086629881240723, 0.14400997402882823, 0.1470976959472836 ], [ 0.04123968696956932, 0.03941451636071284, 0.03771333436717993, 0.03613701330896667, 0.03469138592566166, 0.03338836469187293, 0.03224665542268526, 0.03129181315939947, 0.03055534990484629, 0.030072640979479506, 0.029879572404568705, 0.030008267012433, 0.030482717268738233, 0.03131545143960388, 0.032506169603603356, 0.034042605975325387, 0.03590308920681808, 0.03805984014386301, 0.040482113250610643, 0.043138655762214644, 0.0459993439729562, 0.049036100841414104, 0.05222329129782218, 0.05553778704535951, 0.0589588484549379, 0.06246792210953262, 0.06604841300729081, 0.06968546311593775, 0.07336575091482456, 0.07707731675785542, 0.08080941373180685, 0.08455238129809893, 0.08829753817445536, 0.09203709089397434, 0.09576405484190845, 0.0994721850761202, 0.1031559147604052, 0.10681029952051277, 0.1104309664461747, 0.11401406680347445, 0.11755623179419873, 0.1210545309104903, 0.12450643259327818, 0.12790976702057286, 0.13126269093499413, 0.1345636544757207, 0.13781137001450056, 0.1410047830132824, 0.14414304492642965, 0.1472254881667518 ], [ 0.04423407339831115, 0.042364141510150735, 0.04061242566734494, 0.038980620480981436, 0.03747489682400242, 0.03610686942940409, 0.034894234213907555, 0.033860872349137774, 0.03303618490992456, 0.03245344028232904, 0.0321470463015041, 0.032148940733150624, 0.032484678438011415, 0.0331700986039521, 0.03420944143056126, 0.035595359421345785, 0.03731063099102698, 0.039330891525635014, 0.04162757629126129, 0.04417047344462206, 0.04692960763045284, 0.04987643901349271, 0.05298450483193837, 0.056229669868574084, 0.05959013416751825, 0.06304630821782146, 0.06658062826994102, 0.07017735519982596, 0.0738223802943424, 0.07750304877372867, 0.08120800458130122, 0.0849270560899288, 0.0886510605551435, 0.09237182450087619, 0.09608201720629879, 0.09977509474530105, 0.10344523242938708, 0.10708726392102481, 0.11069662566884492, 0.11426930564774247, 0.11780179566075706, 0.12129104667790506, 0.12473442685610572, 0.12812968201117575, 0.13147489840475993, 0.13476846777270848, 0.1380090545624958, 0.14119556537079778, 0.14432712058243977, 0.1474030282118914 ], [ 0.04730591812203109, 0.0453929476894237, 0.043592864398709005, 0.041908155936797135, 0.0403453648067513, 0.03891592171494825, 0.037636705675053755, 0.03653016632186405, 0.03562381649630297, 0.03494891172824104, 0.03453822079400763, 0.03442299245572672, 0.03462951797942078, 0.03517596365069113, 0.03607022449719355, 0.03730931374523687, 0.03888032781660485, 0.04076255937882616, 0.042930101070833775, 0.04535434120043348, 0.048005983051177134, 0.05085646574126168, 0.05387883396072326, 0.05704818083589466, 0.060341799071308155, 0.06373915360144346, 0.06722175781715178, 0.07077300701479157, 0.07437800111930488, 0.07802337400819036, 0.08169713749654693, 0.08538854261792737, 0.08908795791126335, 0.09278676303332818, 0.09647725551349338, 0.10015256844625646, 0.10380659713129248, 0.10743393297895017, 0.11102980332335037, 0.11459001608617181, 0.11811090849466614, 0.12158929927240561, 0.12502244389231507, 0.1284079926130447, 0.1317439511175073, 0.13502864364188266, 0.13826067853013227, 0.14143891617757967, 0.14456243934153953, 0.14763052580068073 ], [ 0.05044740377642995, 0.048493909883829164, 0.04664836315550105, 0.044913991144575685, 0.04329770609070857, 0.0418108207356513, 0.04046953488039052, 0.03929505860917059, 0.03831321598876531, 0.03755337665972227, 0.037046622907475596, 0.036823203979869996, 0.03690955203003222, 0.03732536591765725, 0.03808138419636841, 0.0391783574189774, 0.040607400060721235, 0.04235150435476782, 0.04438772557712699, 0.046689499525902976, 0.04922868692473939, 0.05197714164821039, 0.054907772311265673, 0.05799516929012023, 0.06121590708468139, 0.06454862894042894, 0.06797399952919665, 0.07147458680231938, 0.07503471278474955, 0.07864029713178626, 0.0822787064211598, 0.08593861528853458, 0.08960988145583255, 0.09328343448517026, 0.09695117701777474, 0.10060589685560174, 0.10424118821199102, 0.107851380611267, 0.11143147414731346, 0.1149770800567011, 0.11848436579169593, 0.12195000397793102, 0.1253711248062166, 0.12874527153853893, 0.13207035890792487, 0.13534463426482918, 0.13856664137333952, 0.1417351867930916, 0.14484930880098645, 0.14790824881391232 ], [ 0.053651207664223884, 0.05166027910896782, 0.04977269627976924, 0.047992360121670144, 0.04632652902066714, 0.044786432394719466, 0.043387689719350274, 0.04215042514302898, 0.04109895027172526, 0.04026088890947551, 0.039665659729361924, 0.03934233720769326, 0.039317078614669675, 0.03961049368164327, 0.04023545687312351, 0.04119582864985085, 0.04248633697484821, 0.04409355546591602, 0.04599764486140398, 0.04817440934189785, 0.05059726932935409, 0.053238898170393366, 0.056072426396744195, 0.05907223106823154, 0.062214386504986126, 0.06547686847377467, 0.06883959508256118, 0.07228436921087894, 0.07579476813471447, 0.07935601003117235, 0.08295481524974517, 0.08657927220812257, 0.09021871265538052, 0.09386359798662167, 0.09750541659584253, 0.10113659141164176, 0.10475039642826453, 0.10834088099844891, 0.11190280075523823, 0.11543155419383037, 0.11892312412411285, 0.12237402337462688, 0.12578124427708592, 0.12914221158330155, 0.1324547385631015, 0.13571698610496952, 0.13892742469359584, 0.14208479917368336, 0.1451880962305368, 0.1482365145279289 ], [ 0.05691043005686331, 0.05488555926906321, 0.05295972734251033, 0.051137436290778666, 0.049426254798517574, 0.04783734343136709, 0.04638581309704234, 0.045090826308168325, 0.0439753369498737, 0.04306536439518632, 0.042388728009549, 0.04197324442605645, 0.0418445159644666, 0.04202358922449442, 0.04252487922760665, 0.04335476521281782, 0.04451113301644474, 0.04598390336855634, 0.04775634484108577, 0.04980682386058069, 0.052110631076872485, 0.05464161245150645, 0.05737346077048397, 0.060280635010129424, 0.06333894652322922, 0.06652588273910642, 0.06982074309166697, 0.07320465146096002, 0.07666049416132362, 0.0801728177988265, 0.08372770937473056, 0.08731267224896212, 0.09091650559846153, 0.09452919116259077, 0.09814178873866787, 0.10174634057232054, 0.10533578411237311, 0.10890387231464434, 0.1124451006170155, 0.11595463976372898, 0.11942827376618768, 0.12286234241292275, 0.1262536878625824, 0.1295996049605234, 0.13289779500784368, 0.1361463227810021, 0.1393435766516477, 0.1424882316922295, 0.145579215675754, 0.14861567789019034 ], [ 0.06021854894675011, 0.05816350160072815, 0.05620344406585086, 0.05434340623415815, 0.052591225353670015, 0.0509579951330428, 0.04945837072833801, 0.04811065476028891, 0.04693657865647696, 0.045960693364446345, 0.045209305560071446, 0.044708951987372396, 0.044484499696936054, 0.04455707882243967, 0.04494215741863975, 0.045648101208883546, 0.04667548783438096, 0.048017276692474006, 0.049659735016075575, 0.05158386873846027, 0.05376705235849915, 0.05618459199239804, 0.05881104892794243, 0.06162125041828546, 0.06459099014996136, 0.06769746395942114, 0.07091950207166359, 0.07423765740559259, 0.07763419944490267, 0.0810930509244111, 0.08459969336099268, 0.08814105850616671, 0.09170541625126102, 0.0952822650265082, 0.09886222781872306, 0.10243695513516991, 0.1059990351998575, 0.10954191111452867, 0.11305980446338279, 0.11654764476348757, 0.12000100418179255, 0.12341603700506693, 0.12678942343111493, 0.1301183173317294, 0.13340029771117096, 0.1366333236447744, 0.13981569252950088, 0.14294600151265788, 0.14602311198783893, 0.1490461170603106 ], [ 0.0635693912188423, 0.06148810744837895, 0.059497992635460885, 0.05760453370098786, 0.055815793000467184, 0.054142792064056894, 0.05259976985295631, 0.051204253278369125, 0.04997686924886874, 0.04894082720732793, 0.048121017609037434, 0.04754271416372097, 0.04722993992430876, 0.047203650629616144, 0.04747997638561422, 0.04806880544673532, 0.04897295858452846, 0.05018808672628585, 0.05170326557730259, 0.05350211881096799, 0.05556422491967909, 0.057866565082336376, 0.06038482899226123, 0.0630944765617125, 0.0659715258703426, 0.06899308700014924, 0.07213768634029884, 0.07538543255306714, 0.07871807121889315, 0.08211896632982489, 0.08557303713290289, 0.08906667028018943, 0.09258762050365661, 0.09612490810464762, 0.09966871814253085, 0.10321030396606783, 0.10674189632404352, 0.1102566184541529, 0.11374840708455901, 0.11721193905248245, 0.12064256315498131, 0.12403623683754879, 0.12738946735736228, 0.130699257106327, 0.1339630528305567, 0.13717869853010645, 0.14034439186204, 0.14345864389988872, 0.1465202421235963, 0.14952821652678333 ], [ 0.06695711309141719, 0.06485363325867267, 0.06283770663969071, 0.06091521060015615, 0.05909439002718319, 0.05738618500212771, 0.05580444848320415, 0.054366001961448876, 0.053090470443541586, 0.051999837905173506, 0.05111767694225784, 0.05046803854532286, 0.050074043233632584, 0.049956287990712576, 0.050131256538641124, 0.050609964923140446, 0.05139706280533122, 0.05249053430763486, 0.05388202079538984, 0.05555766385641011, 0.05749928242004939, 0.05968567444755568, 0.06209386417909336, 0.06470017617575005, 0.06748108125694938, 0.07041380981713559, 0.07347675903747798, 0.07664973420028291, 0.07991406600593727, 0.08325264090278536, 0.08664987400145563, 0.0900916465826624, 0.0935652236888161, 0.09705916218362377, 0.10056321591840184, 0.10406824203157675, 0.10756611066301686, 0.11104961924656899, 0.11451241185918036, 0.11794890370833708, 0.121354210627927, 0.1247240833552254, 0.12805484633100003, 0.13134334077034682, 0.13458687177447085, 0.13778315928178567, 0.14093029268376958, 0.14402668895366436, 0.14707105415289604, 0.15006234819087305 ], [ 0.07037618494020718, 0.06825459401807119, 0.06621712819979599, 0.0642699939908216, 0.062421578616739935, 0.06068272960864846, 0.059066937382490116, 0.057590377098097834, 0.05627176094461428, 0.055131951942582934, 0.05419330016317648, 0.05347868707453352, 0.05301030644189758, 0.05280826774988907, 0.05288916827169, 0.05326482208363911, 0.05394133670371967, 0.05491867955559546, 0.05619078634630868, 0.057746160014945314, 0.05956882629083745, 0.06163947311028516, 0.06393660897343575, 0.06643761559133157, 0.06911962241139384, 0.07196017801191856, 0.07493772720674555, 0.07803192164065174, 0.08122379860487804, 0.08449586200486102, 0.08783209464472454, 0.09121792489750487, 0.0946401649336617, 0.09808693268460178, 0.10154756581696019, 0.10501253311694714, 0.10847334665602375, 0.11192247673270322, 0.11535327068400113, 0.11875987609167907, 0.12213716856550685, 0.12548068409039606, 0.12878655582240445, 0.13205145517328368, 0.13527253701023478, 0.1384473888011865, 0.14157398354655196, 0.14465063635035846, 0.1476759644937615, 0.15064885088079152 ], [ 0.07382137736761823, 0.07168576307508033, 0.06963102048203097, 0.06766362958852401, 0.06579208289825543, 0.06402712372014008, 0.06238189841659057, 0.0608719856938905, 0.05951526204911271, 0.058331562598226416, 0.057342104322299754, 0.05656865815797866, 0.05603248967260097, 0.05575313347900581, 0.055747115702084085, 0.056026776858504185, 0.056599357468390135, 0.057466479640813806, 0.05862409262306343, 0.06006286699261214, 0.061768946768656734, 0.06372492282321912, 0.06591088265075029, 0.06830541447909862, 0.07088648334617442, 0.07363213837387218, 0.07652104422345411, 0.07953285183284617, 0.08264843469351447, 0.08585001995070819, 0.08912124168575808, 0.09244713945008075, 0.09581412019376535, 0.09920989713030139, 0.10262341522615434, 0.10604476999583483, 0.10946512405039255, 0.11287662425418096, 0.11627232124560939, 0.11964609234241023, 0.12299256837504159, 0.12630706469299957, 0.12958551640873667, 0.13282441784105173, 0.13602076606504412, 0.13917200844980857, 0.14227599405501878, 0.14533092875542833, 0.14833533396304904, 0.15128800881765822 ], [ 0.07728774669875736, 0.07514216752441305, 0.07307437188650866, 0.07109106325204541, 0.06920080572604012, 0.06741422684208984, 0.06574414359147242, 0.06420558038602607, 0.06281564458395947, 0.061593225476628335, 0.06055848898624814, 0.05973215569620173, 0.05913457608627211, 0.05878465288582077, 0.05869870049709426, 0.058889364738921444, 0.05936473967514534, 0.06012780220988515, 0.06117623885479899, 0.06250267364222398, 0.06409524053220518, 0.06593839640396164, 0.06801385210414322, 0.07030150813629747, 0.07278030919679863, 0.07542896605905379, 0.07822652470064109, 0.08115278586982848, 0.08418859236909902, 0.08731600759741209, 0.09051840971507093, 0.09378052347772223, 0.09708840808509703, 0.10042941543346251, 0.10379212955833111, 0.10716629506022789, 0.11054273996520896, 0.11391329672056576, 0.11727072376137954, 0.12060862919659174, 0.12392139755755711, 0.12720412014876875, 0.1304525292786905, 0.13366293648356783, 0.13683217475578366, 0.13995754472834582, 0.1430367647325559, 0.14606792462641593, 0.14904944328006034, 0.15198002959727205 ], [ 0.08077061905446255, 0.07861907918740141, 0.07654239291596851, 0.07454744245448387, 0.07264283315259007, 0.07083906565761781, 0.06914863924021276, 0.06758605960861656, 0.06616772219708729, 0.06491164232467632, 0.06383700888970285, 0.06296355062626639, 0.062310724854107866, 0.06189676743835562, 0.061737675268127054, 0.061846221149902625, 0.062231115649839665, 0.06289642276814537, 0.0638413041177839, 0.06506011585442785, 0.06654282736557589, 0.06827568574483228, 0.07024202585984488, 0.07242312478227761, 0.07479901649265236, 0.07734920935079159, 0.08005327636058009, 0.08289131106028573, 0.08584425755347116, 0.0888941319129812, 0.09202415544159437, 0.0952188199159409, 0.09846390260858932, 0.101746445762749, 0.10505471202310622, 0.10837812449246931, 0.11170719774000615, 0.11503346424836264, 0.11834939940040444, 0.12164834709275169, 0.12492444734119326, 0.12817256674019362, 0.13138823229564223, 0.13456756892047403, 0.1377072407319347, 0.14080439619175492, 0.14385661706816819, 0.14686187115890093, 0.1498184686884904, 0.15272502227577187 ], [ 0.08426557283252303, 0.08211200178155517, 0.08003050713361773, 0.07802810997762252, 0.07611342962640628, 0.07429682927557947, 0.07259049962041723, 0.07100845760736602, 0.06956643573632441, 0.06828163786278353, 0.0671723419028, 0.06625733992264707, 0.06555522292010468, 0.06508354075428945, 0.06485789424214188, 0.06489104068223833, 0.06519210843209666, 0.06576601378704873, 0.06661315138499717, 0.06772939104428757, 0.06910636855402243, 0.07073201723427652, 0.07259126072012646, 0.07466677953774435, 0.07693977270572103, 0.07939065485785793, 0.08199965230266718, 0.08474728248169747, 0.08761471737698262, 0.09058404172871679, 0.09363842213112487, 0.09676220451165482, 0.0999409565618218, 0.10316146952151982, 0.1064117311221371, 0.10968087895149092, 0.11295914126275233, 0.11623777040103588, 0.11950897256575535, 0.12276583652006984, 0.12600226303998985, 0.129212896303643, 0.1323930580012025, 0.1355386846529635, 0.1386462684214991, 0.1417128015667686, 0.14473572460044815, 0.1477128781333324, 0.1506424583670307, 0.15352297615153312 ], [ 0.08776841987662899, 0.08561665519644451, 0.08353433779575517, 0.08152859208267255, 0.07960802679461693, 0.07778285763995749, 0.07606497375665508, 0.07446792838812609, 0.07300683288111337, 0.0716981337454161, 0.07055925634530852, 0.06960810712024044, 0.06886243991465736, 0.06833911074765234, 0.06805326704865418, 0.06801753778251182, 0.0682413042386351, 0.06873013202255493, 0.06948543000011753, 0.07050437312458455, 0.07178008942895023, 0.07330207589948018, 0.0750567817706145, 0.07702828576842918, 0.0791989960793321, 0.08155031467459309, 0.08406322575844638, 0.08671878659805612, 0.08949851451415286, 0.09238467488820863, 0.09536048165269906, 0.09841022468046495, 0.10151933886610905, 0.10467442851876138, 0.10786325875738315, 0.11107472345558714, 0.11429879724152832, 0.11752647727734884, 0.12074971907520059, 0.12396136944634353, 0.12715509879000242, 0.13032533426294243, 0.1334671948823309, 0.13657642926196345, 0.1396493564308656, 0.14268281000617763, 0.14567408586814887, 0.1486208933982019, 0.15152131027992713, 0.1543737408193142 ], [ 0.09127518587598207, 0.08912895793698268, 0.08704969175068367, 0.08504458326664963, 0.083122208494885, 0.08129262608440707, 0.07956742880229925, 0.07795972702985737, 0.07648404647162653, 0.07515612299118651, 0.07399258083123454, 0.07301048744204941, 0.07222678937905945, 0.07165764902548911, 0.07131771966957157, 0.0712194135426568, 0.0713722294225039, 0.07178220890852251, 0.0724515807389579, 0.07337863099539642, 0.07455780781450391, 0.07598003891127901, 0.07763321566110633, 0.07950278341882767, 0.08157237547308278, 0.08382443561991937, 0.08624078796410624, 0.08880312810326906, 0.09149342410219795, 0.09429422679218732, 0.09718889638529127, 0.10016175650458321, 0.10319818825660372, 0.10628467675685647, 0.10940882129996952, 0.1125593186936541, 0.11572592751307811, 0.11889941938963983, 0.12207152202584157, 0.1252348574562319, 0.12838287814331772, 0.13150980277769334, 0.13461055310712325, 0.13768069271443675, 0.14071636836700221, 0.14371425434476146, 0.14667149999815798, 0.14958568067521733, 0.15245475207630718, 0.15527700803634434 ], [ 0.09478209065893055, 0.09264500880462948, 0.0905725420798468, 0.08857192946459569, 0.08665169413727533, 0.08482172850448878, 0.08309333257243086, 0.08147919108084253, 0.07999327420244343, 0.07865064739379309, 0.07746717894039995, 0.076459139632531, 0.07564269832156383, 0.07503332966758224, 0.07464516499771205, 0.07449033144820033, 0.07457833510755553, 0.07491554721913711, 0.07550484623525869, 0.07634545250726407, 0.07743296928708683, 0.07875961833433891, 0.08031463624708866, 0.08208478298072788, 0.08405490879310352, 0.08620852934913185, 0.08852836836453268, 0.0909968397134354, 0.09359645347744155, 0.09631014103120387, 0.09912150204831602, 0.10201498121098139, 0.10497598485946706, 0.10799094846475067, 0.11104736528723472, 0.11413378542089696, 0.11723979299555314, 0.12035596786510343, 0.12347383678509186, 0.12658581794231424, 0.12968516175879294, 0.13276589014141332, 0.1358227357632636, 0.13885108251511322, 0.14184690792819954, 0.14480672811810696, 0.1477275456135558, 0.15060680029698498, 0.15344232358283746, 0.15623229588490223 ], [ 0.09828552905824282, 0.09616106880140514, 0.09409901076161221, 0.09210661124671278, 0.09019232225000527, 0.08836586108457528, 0.08663823726834695, 0.08502172404879091, 0.08352976158269215, 0.08217677961779461, 0.08097793016530638, 0.07994872568800686, 0.07910458611259041, 0.07846030835541659, 0.07802948409892672, 0.0778239034322015, 0.07785299109348687, 0.07812332567330962, 0.0786382882164316, 0.07939787477753829, 0.08039868931013842, 0.0816341122889422, 0.08309462097168226, 0.08476822293943029, 0.08664095762418307, 0.08869742102380586, 0.09092127513217496, 0.09329571333202244, 0.0958038636547771, 0.09842912152769462, 0.10115541132553463, 0.1039673813756009, 0.10685054019829357, 0.10979134313726506, 0.11277723865783021, 0.1157966829394787, 0.11883913032948176, 0.12189500602138047, 0.12495566613972482, 0.1280133493421099, 0.13106112313132043, 0.13409282731213737, 0.13710301641849632, 0.14008690245837802, 0.1430402989540241, 0.14595956697287704, 0.1488415636310779, 0.15168359339068568, 0.15448336235111698, 0.1572389356445631 ], [ 0.10178205296553644, 0.09967354409444812, 0.0976253523971754, 0.09564472822173217, 0.09374003552991639, 0.09192080799435412, 0.09019776581502399, 0.08858278233525925, 0.08708878936093792, 0.08572961095083344, 0.08451971782623083, 0.08347389888747812, 0.08260685287885894, 0.08193271187107302, 0.08146451819943173, 0.08121368638203261, 0.08118948935058773, 0.08139861189452548, 0.08184481185724098, 0.0825287207973255, 0.08344780157129195, 0.08459646310909387, 0.08596631584636762, 0.08754653798177729, 0.08932431501228029, 0.09128531341561211, 0.09341415303862961, 0.09569484996313926, 0.09811121036820572, 0.10064716448979205, 0.10328703706092163, 0.10601575606674751, 0.1088190052173047, 0.11168332747545005, 0.11459618766102754, 0.11754600198117743, 0.12052214165275633, 0.12351491684763334, 0.1265155461847891, 0.1295161160263616, 0.13250953296798315, 0.135489472171874, 0.1384503235769717, 0.14138713752451731, 0.14429557094459244, 0.14717183494220787, 0.15001264438431575, 0.15281516990701438, 0.15557699262298064, 0.15829606170274857 ], [ 0.10526835508511063, 0.10317897069794628, 0.101147939779773, 0.09918248552137543, 0.09729086832654182, 0.09548242998934264, 0.0937676016945507, 0.092157866382712, 0.09066566600301004, 0.08930424506010015, 0.08808742401785587, 0.08702929988900072, 0.08614387689289041, 0.08544463727126121, 0.08494407062526442, 0.08465318836323008, 0.08458105647625085, 0.08473438318877505, 0.08511719668498445, 0.08573064153864185, 0.08657291129835576, 0.08763932068689119, 0.08892250658576517, 0.09041273495596006, 0.09209828298545969, 0.0939658628436386, 0.09600105510725948, 0.09818872501541122, 0.10051340166352131, 0.1029596075955164, 0.10551213290197758, 0.10815625325097308, 0.11087789505749367, 0.11366375332713666, 0.11650136884642379, 0.11937917164938006, 0.12228649736611442, 0.12521358240070973, 0.12815154307576943, 0.13109234304323336, 0.13402875247066662, 0.1369543018086443, 0.13986323234321973, 0.14275044523788122, 0.14561145036355017, 0.14844231589088114, 0.15123961936315222, 0.15400040076772545, 0.15672211796819216, 0.1594026047383206 ], [ 0.10874125476493716, 0.1066740013368101, 0.10466325183456106, 0.10271618292651481, 0.1008409371179826, 0.09904665642959562, 0.09734348269895679, 0.09574251631636382, 0.09425572531220815, 0.09289579760265654, 0.09167593116226459, 0.0906095601790122, 0.08971001997798633, 0.08899015954751399, 0.0884619173866257, 0.08813588323689957, 0.08802087385209499, 0.08812355396076005, 0.08844813287556744, 0.08899616228480253, 0.08976645198965433, 0.09075510899804952, 0.09195569336411476, 0.09335947352877978, 0.09495575633075301, 0.09673226319094422, 0.09867552420404718, 0.10077126524167182, 0.10300476852246256, 0.10536119322457228, 0.10782584860568002, 0.11038441709622271, 0.1130231286318056, 0.11572889005650731, 0.11848937490493697, 0.12129307948731365, 0.12412935120527474, 0.1269883946375309, 0.1298612603301934, 0.13273982053472505, 0.13561673544188052, 0.13848541281354257, 0.1413399633417244, 0.1441751535742559, 0.14698635783847297, 0.14976951026044488, 0.1525210577082812, 0.1552379142735367, 0.15791741773484627, 0.16055728831401803 ], [ 0.11219768614254597, 0.11015539476947524, 0.108167864222958, 0.10624220691807378, 0.10438643421980467, 0.10260948088163467, 0.10092119865394328, 0.09933231197968158, 0.09785432889926125, 0.09649940117021215, 0.09528012939610993, 0.09420931184023926, 0.09329963964726262, 0.0925633462890709, 0.0920118247943411, 0.09165523201587608, 0.09150210388240779, 0.09155900822269061, 0.09183026144504816, 0.09231773165042907, 0.09302074385352313, 0.09393609379179549, 0.09505816676009464, 0.0963791486507596, 0.09788930931657032, 0.09957733436919312, 0.10143068075532471, 0.10343593347624509, 0.10557914479544908, 0.10784614224537173, 0.11022279682621548, 0.11269524734958664, 0.11525008055182137, 0.11787446926387338, 0.12055627262843828, 0.12328410325349931, 0.12604736647706066, 0.1288362767789971, 0.1316418559748521, 0.13445591728825312, 0.13727103881311367, 0.14008052930216233, 0.1428783886889367, 0.1456592652829238, 0.14841841117723656, 0.15115163707311607, 0.15385526744967, 0.15652609678301876, 0.15916134733834922, 0.16175862891371498 ], [ 0.11563468870877992, 0.11362000767756433, 0.1116584427025305, 0.10975702570324433, 0.1079236247113081, 0.10616696019426108, 0.10449659288195468, 0.1029228769807857, 0.10145687293996802, 0.10011021480220944, 0.09889492880386754, 0.09782320242265889, 0.09690710654651362, 0.09615827773915048, 0.09558757237845508, 0.09520470918227493, 0.09501792056005089, 0.09503363551170999, 0.095256216723516, 0.095687771695315, 0.09632805227921243, 0.09717444956471533, 0.09822208269815835, 0.09946397225855882, 0.10089128240233, 0.10249361193507045, 0.10425931305399265, 0.1061758175108873, 0.10822995278977748, 0.11040823482417463, 0.11269712806275288, 0.11508326774339478, 0.11755364267246043, 0.12009573944911367, 0.12269765090429015, 0.12534815262652424, 0.12803675196214992, 0.13075371395895075, 0.13349006851204612, 0.1362376025862673, 0.1389888409195183, 0.14173701811917347, 0.14447604458858232, 0.14720046828637698, 0.14990543393834965, 0.1525866409930948, 0.15524030133614333, 0.1578630975481701, 0.16045214230497118, 0.16300493936406965 ], [ 0.11904940027205024, 0.11706478908549715, 0.11513173916728464, 0.11325718708390538, 0.11144884636756089, 0.10971521673742007, 0.10806556697379009, 0.10650988617881386, 0.1050587984906021, 0.10372343716219647, 0.10251527540635189, 0.10144591363903069, 0.1005268257463946, 0.09976907064285118, 0.09918297940682214, 0.09877783222415605, 0.09856154263985609, 0.0985403685655759, 0.0987186695455223, 0.09909872762235693, 0.09968064481406927, 0.10046232417898437, 0.10143953452937227, 0.10260605205927219, 0.10395386644175, 0.10547343503624719, 0.10715396705765352, 0.10898371982536015, 0.11095029114454942, 0.11304089490619113, 0.11524261052740167, 0.11754260037317923, 0.11992829243317035, 0.12238752806284797, 0.12490867646714184, 0.12748071883794912, 0.1300933057475951, 0.13273679166663785, 0.13540225043568418, 0.13808147528251818, 0.14076696662278665, 0.1434519104777542, 0.14613014993014584, 0.14879615164626572, 0.15144496913528308, 0.15407220410168054, 0.15667396697587538, 0.15924683747882776, 0.16178782588511742, 0.16429433549082956 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.21401266008615494, 0.13775307498925274, 0.08914692267749635, 0.001310306181458153, 0.057246894339104695, 0.08296009293444023, 0.03503378513710986, 0.09466105435626983, 0.1390223615894533, 0.1483213890104709, 0.18287495609858878, 0.4747074628248811, 0.12526680198784965, 0.16398913611124366, 0.18911064178937825, 0.16224217643124902, 0.9366196496412158, 0.5990437539294362, 0.16362912952899933, 0.364520781673491, 0.20150838370825488, 0.21680243384441397, 0.21696986340044036, 0.18210075046936666 ], "xaxis": "x", "y": [ 0.6408708151429892, 0.27442450103428706, 0.22847089327136874, 0.25557508088498176, 0.1851537105965222, 0.14127014090250442, 0.11738300214379942, 0.21529999762133475, 0.26110481067973873, 0.238093537053619, 0.3283043059238869, 0.8391615319997072, 0.3221511691815012, 0.264714956758182, 0.32202352725995437, 0.3649215135016143, 0.5802635364234447, 0.08869760483503342, 0.19225758034735918, 0.754353323020041, 0.3196049601082128, 0.39320404695203026, 0.35439249342085466, 0.3202225429838045 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.21401266008615494, 0.13775307498925274, 0.08914692267749635, 0.001310306181458153, 0.057246894339104695, 0.08296009293444023, 0.03503378513710986, 0.09466105435626983, 0.1390223615894533, 0.1483213890104709, 0.18287495609858878, 0.4747074628248811, 0.12526680198784965, 0.16398913611124366, 0.18911064178937825, 0.16224217643124902, 0.9366196496412158, 0.5990437539294362, 0.16362912952899933, 0.364520781673491, 0.20150838370825488, 0.21680243384441397, 0.21696986340044036, 0.18210075046936666 ], "xaxis": "x2", "y": [ 0.6408708151429892, 0.27442450103428706, 0.22847089327136874, 0.25557508088498176, 0.1851537105965222, 0.14127014090250442, 0.11738300214379942, 0.21529999762133475, 0.26110481067973873, 0.238093537053619, 0.3283043059238869, 0.8391615319997072, 0.3221511691815012, 0.264714956758182, 0.32202352725995437, 0.3649215135016143, 0.5802635364234447, 0.08869760483503342, 0.19225758034735918, 0.754353323020041, 0.3196049601082128, 0.39320404695203026, 0.35439249342085466, 0.3202225429838045 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04475526481096161, -0.0816738097380185, -0.0816738097380185, -0.11620094614748015, -0.31377367087636204, -0.31377367087636204, -0.6051533384912477, -0.6553528871536329, -0.753990913915385, -0.9453611703715217, -1.1641928294688733, -1.34279726958082, -1.3874695306923575, -1.7004347429742845, -1.7165365062363744, -1.7165365062363744, -2.303141326939199, -2.669144329494822, -2.669144329494822, -2.6809614959244845, -2.6809614959244845, -2.6989493334298653, -2.778978551415144, -2.778978551415144, -2.995125689677274 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.8797882786020637
x2: 0.6763492235913873
x3: 0.21401266008615494
x4: 0.6408708151429892
x5: 0.6572143631055951
x6: 0.02032325603067875", "
Parameterization:
x1: 0.016140553168952465
x2: 0.6657499736174941
x3: 0.4747074628248811
x4: 0.8391615319997072
x5: 0.23691669572144747
x6: 0.1284338030964136", "
Parameterization:
x1: 0.3029253203421831
x2: 0.9376350296661258
x3: 0.9366196496412158
x4: 0.5802635364234447
x5: 0.9899731473997235
x6: 0.8370648017153144", "
Parameterization:
x1: 0.032071989960968494
x2: 0.47153512574732304
x3: 0.5990437539294362
x4: 0.08869760483503342
x5: 0.7755283201113343
x6: 0.11378925386816263", "
Parameterization:
x1: 0.3842473151162267
x2: 0.8953125085681677
x3: 0.16362912952899933
x4: 0.19225758034735918
x5: 0.241867920383811
x6: 0.587614974938333", "
Parameterization:
x1: 0.4766513640061021
x2: 0.5385769698768854
x3: 0.364520781673491
x4: 0.754353323020041
x5: 0.5995120909065008
x6: 0.33834195975214243", "
Parameterization:
x1: 0.39657712352396607
x2: 0.7869350652489563
x3: 0.20150838370825488
x4: 0.3196049601082128
x5: 0.32138696272785555
x6: 0.5471424751510052", "
Parameterization:
x1: 0.41602849023981653
x2: 0.7332864943901622
x3: 0.21680243384441397
x4: 0.39320404695203026
x5: 0.35812730440337187
x6: 0.5384440783622826", "
Parameterization:
x1: 0.33392672736758633
x2: 0.706868474955653
x3: 0.21696986340044036
x4: 0.35439249342085466
x5: 0.3794732618419721
x6: 0.5139916465638126", "
Parameterization:
x1: 0.2841098403409172
x2: 0.6094740850009792
x3: 0.18210075046936666
x4: 0.3202225429838045
x5: 0.4133797153099563
x6: 0.511701126921508", "
Parameterization:
x1: 0.2538099753164488
x2: 0.5209962634593468
x3: 0.13775307498925274
x4: 0.27442450103428706
x5: 0.4282875458457658
x6: 0.5352801888118471", "
Parameterization:
x1: 0.2177893246192005
x2: 0.42251996880594267
x3: 0.08914692267749635
x4: 0.22847089327136874
x5: 0.442041719541776
x6: 0.5714723324717691", "
Parameterization:
x1: 0.16999427478054266
x2: 0.3237038658071498
x3: 0.001310306181458153
x4: 0.25557508088498176
x5: 0.44881459022827047
x6: 0.5672069244141027", "
Parameterization:
x1: 0.24169164426547812
x2: 0.2298918199768204
x3: 0.057246894339104695
x4: 0.1851537105965222
x5: 0.4137832437113726
x6: 0.5583554273893564", "
Parameterization:
x1: 0.29757370112642145
x2: 0.11234113271493425
x3: 0.08296009293444023
x4: 0.14127014090250442
x5: 0.37381622868953
x6: 0.5382936657604851", "
Parameterization:
x1: 0.31989624212997736
x2: 0.17607168485731015
x3: 0.03503378513710986
x4: 0.11738300214379942
x5: 0.4414085286783707
x6: 0.5232389577834683", "
Parameterization:
x1: 0.19994776537094644
x2: 0.1660214102755224
x3: 0.09466105435626983
x4: 0.21529999762133475
x5: 0.35881446110845105
x6: 0.5860033485365331", "
Parameterization:
x1: 0.1388164109700411
x2: 0.12119471039119202
x3: 0.1390223615894533
x4: 0.26110481067973873
x5: 0.30809674932472697
x6: 0.6262186893974482", "
Parameterization:
x1: 0.07752875423244698
x2: 0.11516090785973897
x3: 0.1483213890104709
x4: 0.238093537053619
x5: 0.23831221615606926
x6: 0.6161781707029588", "
Parameterization:
x1: 0.13713930360355236
x2: 0.06824533878418548
x3: 0.18287495609858878
x4: 0.3283043059238869
x5: 0.32835300731971484
x6: 0.6854888157083167", "
Parameterization:
x1: 0.16446011821755116
x2: 0.11744680886520979
x3: 0.12526680198784965
x4: 0.3221511691815012
x5: 0.30371928833453987
x6: 0.6876622173757034", "
Parameterization:
x1: 0.12007657925041298
x2: 0.12025329675406109
x3: 0.16398913611124366
x4: 0.264714956758182
x5: 0.31921299088139743
x6: 0.6953362887551043", "
Parameterization:
x1: 0.12859024975029584
x2: 0.15594040991809416
x3: 0.18911064178937825
x4: 0.32202352725995437
x5: 0.3142047735342513
x6: 0.6618478596982934", "
Parameterization:
x1: 0.06180464689375986
x2: 0.16043639372985674
x3: 0.16224217643124902
x4: 0.3649215135016143
x5: 0.32044287652366116
x6: 0.6564984730677291", "
Parameterization:
x1: 0.17151652479335416
x2: 0.15869339061238497
x3: 0.2494013002304854
x4: 0.2927168980342504
x5: 0.300731241043093
x6: 0.6730358726907785" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04475526481096161, -0.0816738097380185, -0.0816738097380185, -0.11620094614748015, -0.31377367087636204, -0.31377367087636204, -0.6051533384912477, -0.6553528871536329, -0.753990913915385, -0.9453611703715217, -1.1641928294688733, -1.34279726958082, -1.3874695306923575, -1.7004347429742845, -1.7165365062363744, -1.7165365062363744, -2.303141326939199, -2.669144329494822, -2.669144329494822, -2.6809614959244845, -2.6809614959244845, -2.6989493334298653, -2.778978551415144, -2.778978551415144, -2.995125689677274 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04475526481096161, -0.0816738097380185, -0.0816738097380185, -0.11620094614748015, -0.31377367087636204, -0.31377367087636204, -0.6051533384912477, -0.6553528871536329, -0.753990913915385, -0.9453611703715217, -1.1641928294688733, -1.34279726958082, -1.3874695306923575, -1.7004347429742845, -1.7165365062363744, -1.7165365062363744, -2.303141326939199, -2.669144329494822, -2.669144329494822, -2.6809614959244845, -2.6809614959244845, -2.6989493334298653, -2.778978551415144, -2.778978551415144, -2.995125689677274 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:12] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:12] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:12] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:16] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.21, 'x2': 0.16, 'x3': 0.33, 'x4': 0.28, 'x5': 0.29, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:16] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:16] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:16] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 07-17 16:19:16] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.1" } }, "nbformat": 4, "nbformat_minor": 2 }