{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.07, 'x2': 0.71, 'x3': 0.15, 'x4': 0.22, 'x5': 0.84, 'x6': 0.1}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.1, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.49, 'x2': 0.85, 'x3': 0.15, 'x4': 0.28, 'x5': 0.23, 'x6': 0.18}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.96, 0.0), 'l2norm': (1.07, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.43, 'x2': 0.6, 'x3': 0.07, 'x4': 0.83, 'x5': 1.0, 'x6': 0.85}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:54] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.0, 0.0), 'l2norm': (1.72, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.14, 'x2': 0.66, 'x3': 0.51, 'x4': 0.69, 'x5': 0.92, 'x6': 0.98}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.73, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.16, 'x2': 0.91, 'x3': 0.31, 'x4': 0.11, 'x5': 0.85, 'x6': 0.58}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.07, 0.0), 'l2norm': (1.42, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.66, 'x2': 0.95, 'x3': 0.85, 'x4': 0.78, 'x5': 0.4, 'x6': 0.92}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:55] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.91, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:59] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.44, 'x2': 0.86, 'x3': 0.1, 'x4': 0.27, 'x5': 0.13, 'x6': 0.14}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:32:59] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-1.1, 0.0), 'l2norm': (1.03, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:04] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.5, 'x2': 0.86, 'x3': 0.16, 'x4': 0.25, 'x5': 0.02, 'x6': 0.11}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:04] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.85, 0.0), 'l2norm': (1.05, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:08] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.36, 'x2': 0.89, 'x3': 0.0, 'x4': 0.31, 'x5': 0.15, 'x6': 0.15}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:08] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-1.26, 0.0), 'l2norm': (1.03, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:11] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.28, 'x2': 0.86, 'x3': 0.0, 'x4': 0.37, 'x5': 0.14, 'x6': 0.07}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:11] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-1.51, 0.0), 'l2norm': (0.98, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:14] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.24, 'x2': 0.85, 'x3': 0.0, 'x4': 0.47, 'x5': 0.13, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:14] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-1.71, 0.0), 'l2norm': (1.01, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:18] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.14, 'x2': 0.82, 'x3': 0.0, 'x4': 0.56, 'x5': 0.1, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:18] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.87, 0.0), 'l2norm': (1.01, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:21] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.34, 'x2': 0.88, 'x3': 0.01, 'x4': 0.45, 'x5': 0.14, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:21] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-2.4, 0.0), 'l2norm': (1.05, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:25] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.4, 'x2': 0.91, 'x3': 0.0, 'x4': 0.5, 'x5': 0.15, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:25] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-2.84, 0.0), 'l2norm': (1.12, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:29] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.46, 'x2': 0.94, 'x3': 0.0, 'x4': 0.55, 'x5': 0.18, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:29] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-2.75, 0.0), 'l2norm': (1.2, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:32] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.44, 'x2': 0.87, 'x3': 0.0, 'x4': 0.53, 'x5': 0.09, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:32] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-2.9, 0.0), 'l2norm': (1.11, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:36] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.42, 'x2': 0.94, 'x3': 0.0, 'x4': 0.53, 'x5': 0.02, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:36] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.88, 0.0), 'l2norm': (1.16, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:37] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.42, 'x2': 0.89, 'x3': 0.08, 'x4': 0.54, 'x5': 0.08, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:37] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-3.0, 0.0), 'l2norm': (1.13, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:40] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.4, 'x2': 0.88, 'x3': 0.05, 'x4': 0.59, 'x5': 0.1, 'x6': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:40] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-3.03, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:44] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.41, 'x2': 0.88, 'x3': 0.07, 'x4': 0.59, 'x5': 0.09, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:44] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-3.07, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:47] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.42, 'x2': 0.85, 'x3': 0.14, 'x4': 0.62, 'x5': 0.02, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:47] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.98, 0.0), 'l2norm': (1.15, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:49] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.41, 'x2': 0.84, 'x3': 0.12, 'x4': 0.59, 'x5': 0.15, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:50] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.04, 0.0), 'l2norm': (1.12, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:52] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.4, 'x2': 0.83, 'x3': 0.07, 'x4': 0.58, 'x5': 0.06, 'x6': 0.05}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:52] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-3.02, 0.0), 'l2norm': (1.09, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:55] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.4, 'x2': 0.91, 'x3': 0.13, 'x4': 0.59, 'x5': 0.11, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:55] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.08, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:56] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.5, 'x2': 0.64, 'x3': 0.35, 'x4': 0.67, 'x5': 0.27, 'x6': 0.01}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:56] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-1.58, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:56] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.07, 'x2': 0.71, 'x3': 0.15, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.49, 'x2': 0.85, 'x3': 0.15, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.43, 'x2': 0.6, 'x3': 0.07, 'x...
30Sobol3COMPLETED{'3_0': {'x1': 0.14, 'x2': 0.66, 'x3': 0.51, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.16, 'x2': 0.91, 'x3': 0.31, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.66, 'x2': 0.95, 'x3': 0.85, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.44, 'x2': 0.86, 'x3': 0.1, 'x...
71GPEI7COMPLETED{'7_0': {'x1': 0.5, 'x2': 0.86, 'x3': 0.16, 'x...
81GPEI8COMPLETED{'8_0': {'x1': 0.36, 'x2': 0.89, 'x3': 0.0, 'x...
91GPEI9COMPLETED{'9_0': {'x1': 0.28, 'x2': 0.86, 'x3': 0.0, 'x...
101GPEI10COMPLETED{'10_0': {'x1': 0.24, 'x2': 0.85, 'x3': 0.0, '...
111GPEI11COMPLETED{'11_0': {'x1': 0.14, 'x2': 0.82, 'x3': 0.0, '...
121GPEI12COMPLETED{'12_0': {'x1': 0.34, 'x2': 0.88, 'x3': 0.01, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.4, 'x2': 0.91, 'x3': 0.0, 'x...
141GPEI14COMPLETED{'14_0': {'x1': 0.46, 'x2': 0.94, 'x3': 0.0, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.44, 'x2': 0.87, 'x3': 0.0, '...
161GPEI16COMPLETED{'16_0': {'x1': 0.42, 'x2': 0.94, 'x3': 0.0, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.42, 'x2': 0.89, 'x3': 0.08, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.4, 'x2': 0.88, 'x3': 0.05, '...
191GPEI19COMPLETED{'19_0': {'x1': 0.41, 'x2': 0.88, 'x3': 0.07, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.42, 'x2': 0.85, 'x3': 0.14, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.41, 'x2': 0.84, 'x3': 0.12, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.4, 'x2': 0.83, 'x3': 0.07, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.4, 'x2': 0.91, 'x3': 0.13, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.5, 'x2': 0.64, 'x3': 0.35, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.07, 'x2': 0.71, 'x3': 0.15, '... \n", "1 {'1_0': {'x1': 0.49, 'x2': 0.85, 'x3': 0.15, '... \n", "2 {'2_0': {'x1': 0.43, 'x2': 0.6, 'x3': 0.07, 'x... \n", "3 {'3_0': {'x1': 0.14, 'x2': 0.66, 'x3': 0.51, '... \n", "4 {'4_0': {'x1': 0.16, 'x2': 0.91, 'x3': 0.31, '... \n", "5 {'5_0': {'x1': 0.66, 'x2': 0.95, 'x3': 0.85, '... \n", "6 {'6_0': {'x1': 0.44, 'x2': 0.86, 'x3': 0.1, 'x... \n", "7 {'7_0': {'x1': 0.5, 'x2': 0.86, 'x3': 0.16, 'x... \n", "8 {'8_0': {'x1': 0.36, 'x2': 0.89, 'x3': 0.0, 'x... \n", "9 {'9_0': {'x1': 0.28, 'x2': 0.86, 'x3': 0.0, 'x... \n", "10 {'10_0': {'x1': 0.24, 'x2': 0.85, 'x3': 0.0, '... \n", "11 {'11_0': {'x1': 0.14, 'x2': 0.82, 'x3': 0.0, '... \n", "12 {'12_0': {'x1': 0.34, 'x2': 0.88, 'x3': 0.01, ... \n", "13 {'13_0': {'x1': 0.4, 'x2': 0.91, 'x3': 0.0, 'x... \n", "14 {'14_0': {'x1': 0.46, 'x2': 0.94, 'x3': 0.0, '... \n", "15 {'15_0': {'x1': 0.44, 'x2': 0.87, 'x3': 0.0, '... \n", "16 {'16_0': {'x1': 0.42, 'x2': 0.94, 'x3': 0.0, '... \n", "17 {'17_0': {'x1': 0.42, 'x2': 0.89, 'x3': 0.08, ... \n", "18 {'18_0': {'x1': 0.4, 'x2': 0.88, 'x3': 0.05, '... \n", "19 {'19_0': {'x1': 0.41, 'x2': 0.88, 'x3': 0.07, ... \n", "20 {'20_0': {'x1': 0.42, 'x2': 0.85, 'x3': 0.14, ... \n", "21 {'21_0': {'x1': 0.41, 'x2': 0.84, 'x3': 0.12, ... \n", "22 {'22_0': {'x1': 0.4, 'x2': 0.83, 'x3': 0.07, '... \n", "23 {'23_0': {'x1': 0.4, 'x2': 0.91, 'x3': 0.13, '... \n", "24 {'24_0': {'x1': 0.5, 'x2': 0.64, 'x3': 0.35, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.3971602386022429,\n", " 'x2': 0.9078710743114302,\n", " 'x3': 0.12903130053077205,\n", " 'x4': 0.5892123106611511,\n", " 'x5': 0.11049169082431023,\n", " 'x6': 0.056961656211474004}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -3.075527297559285, 'l2norm': 1.1667218239102974}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:56] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.26378146802867297, -0.2792449397988157, -0.2971081612519002, -0.3173546857614282, -0.33990887480681575, -0.3646306911530892, -0.39131248430925014, -0.4196782068518319, -0.4493854023382087, -0.4800301717715654, -0.5111551653587947, -0.5422604717639121, -0.5728171009857532, -0.6022825908946761, -0.6301181204725568, -0.655806391691774, -0.6788694522922643, -0.6988855793844053, -0.7155043362326878, -0.7284589604717668, -0.7375753494007642, -0.7427770807990299, -0.7440861418718108, -0.741619319826577, -0.7355805098279877, -0.7262494866297036, -0.7139679300518398, -0.6991236616983907, -0.6821341220770221, -0.6634300895019045, -0.6434405255555451, -0.6225792488644466, -0.6012339183648165, -0.5797575786587028, -0.558462808896498, -0.5376183410531477, -0.5174478833858902, -0.49813080249900943, -0.4798042790744943, -0.46256655043476824, -0.446480878426494, -0.43157992430829384, -0.41787026507357194, -0.40533684125001623, -0.3939471798012173, -0.3836552841253451, -0.3744051245481237, -0.3661336964975206, -0.3587736398627279, -0.35225543251537283 ], [ -0.2614558570787062, -0.2776863220366843, -0.29647110201491866, -0.31779790794512364, -0.3415911692085247, -0.36770617994452404, -0.3959253792667068, -0.4259572575626427, -0.4574382750794934, -0.4899380322551432, -0.5229677545564373, -0.5559919618904807, -0.5884429985401309, -0.6197379168702046, -0.6492970464622905, -0.6765634465683288, -0.7010223390612877, -0.7222195573570154, -0.7397780324097893, -0.7534113805022338, -0.7629337697946645, -0.768265429770429, -0.7694334268531375, -0.7665676447774081, -0.7598922506972661, -0.7497132587613298, -0.7364030805516191, -0.7203831408438999, -0.7021057155009605, -0.6820361115870597, -0.6606361713271032, -0.6383498683616144, -0.6155915111224428, -0.5927368085776881, -0.5701168171056776, -0.5480145939828667, -0.5266642431416348, -0.5062519538172194, -0.48691859713893293, -0.4687634502659894, -0.4518486513362481, -0.43620404053691186, -0.42183210370413127, -0.4087127977123124, -0.3968080963543983, -0.38606614821084384, -0.3764249825169801, -0.36781573481635754, -0.3601653915944867, -0.35339907298021167 ], [ -0.25905092204370384, -0.2760737230794905, -0.29581350658146066, -0.3182628581650697, -0.343346772407479, -0.3709160832271743, -0.40074317680397686, -0.43252053896394016, -0.4658625742563365, -0.5003109729165842, -0.5353437069589595, -0.5703875238926925, -0.6048335927030781, -0.6380557561176863, -0.669430666049688, -0.6983589318817287, -0.724286298528388, -0.7467237987533182, -0.765265801287315, -0.779604915880479, -0.789542832445737, -0.794996373366462, -0.7959983245006987, -0.7926929644985521, -0.7853266004125858, -0.7742337946718383, -0.7598202851459153, -0.7425438140324003, -0.7228941666707365, -0.7013736735434664, -0.6784792642780755, -0.6546869140772305, -0.6304390313696495, -0.6061350408505104, -0.5821251515869259, -0.558707087652804, -0.5361254091972347, -0.5145729650507387, -0.49419398662281666, -0.4750883453957848, -0.4573165398081851, -0.4409050394440912, -0.4258516848246887, -0.41213091182923267, -0.3996986354415253, -0.3884966849091278, -0.378456730045146, -0.36950367609455315, -0.3615585329592286, -0.3545407847376232 ], [ -0.256568018035064, -0.27440818413880597, -0.2951363068469286, -0.31875063408322246, -0.34517728988069796, -0.3742629136620099, -0.40576973757629187, -0.4393737203974033, -0.47466623241882067, -0.5111596089876747, -0.5482966751154492, -0.5854641086727876, -0.622009274238658, -0.6572599397958563, -0.6905460949259397, -0.7212229277664199, -0.7486938922984989, -0.7724327127794877, -0.7920031385301802, -0.8070752955948901, -0.8174376000485786, -0.8230034145010536, -0.8238119456140717, -0.8200232782606149, -0.8119078830194185, -0.799831364335216, -0.7842355783874682, -0.7656174922411902, -0.7445072486217825, -0.721446839002764, -0.6969705923390563, -0.6715883972531129, -0.6457722401484336, -0.6199463075414009, -0.5944806055490119, -0.5696878171617636, -0.5458229588903651, -0.5230853110253126, -0.5016220703213712, -0.48153319629350766, -0.4628769772731005, -0.4456759159191592, -0.4299226145210093, -0.4155854196718898, -0.4026136581384838, -0.3909423578664126, -0.3804963988144847, -0.37119407780423974, -0.36295010074914513, -0.3556780358835465 ], [ -0.25400915334998575, -0.27269127531831105, -0.29444081564058866, -0.3192625462382339, -0.34708435660215065, -0.3777490203264544, -0.4110085618782, -0.44652191626843685, -0.48385644015828944, -0.522493638733663, -0.5618392349514219, -0.6012374482593881, -0.6399890908518033, -0.6773728490266715, -0.7126689065052476, -0.7451838904789578, -0.7742759815966069, -0.799378930371411, -0.8200236756769184, -0.835856285170641, -0.8466510558198301, -0.8523178441064139, -0.8529030441701763, -0.848584079316751, -0.839657773924043, -0.8265234654118283, -0.8096621298127069, -0.7896130696512627, -0.7669498132988448, -0.7422567961783275, -0.7161081620387084, -0.6890496849166017, -0.6615844268620543, -0.6341623677518606, -0.607173914291544, -0.5809469418686708, -0.5557468549483586, -0.5317790653786971, -0.5091932705231164, -0.48808894742372, -0.4685215474737541, -0.45050896248920425, -0.4340379249875168, -0.4190700938624907, -0.4055476557777222, -0.3933983395218019, -0.38253979436181473, -0.37288332457053097, -0.36433700209037334, -0.3568081994445014 ], [ -0.251377066768534, -0.2709251659372216, -0.2937287855400039, -0.3198001605123726, -0.3490696582290469, -0.3813765838092338, -0.41646275416596623, -0.453969616032573, -0.4934395382788328, -0.5343216953674537, -0.575982695960537, -0.6177218239122197, -0.6587904740284425, -0.6984151024981518, -0.7358227834402109, -0.7702682719003571, -0.8010613194566734, -0.827592874045638, -0.8493587325825507, -0.8659792263779811, -0.8772136348447742, -0.8829682683169079, -0.8832975446119449, -0.8783978868901429, -0.8685948416620333, -0.8543243803509274, -0.8361098221792129, -0.814536128678267, -0.7902234284257861, -0.7638015305593984, -0.7358869096169116, -0.7070632504561016, -0.6778661988269294, -0.6487725343108905, -0.6201936161282051, -0.5924726769109183, -0.5658853635658405, -0.5406428410604702, -0.5168967679307035, -0.49474550089234715, -0.4742409695513159, -0.45539576302126816, -0.4381900744881737, -0.4225782478808766, -0.4084947570891977, -0.3958595199210728, -0.3845825056985148, -0.3745676379710843, -0.3657160239890822, -0.35792856238637794 ], [ -0.2486753089847733, -0.2691126996772202, -0.2930024728317764, -0.3203653455875777, -0.3511349565429467, -0.38514761417582366, -0.42213498837297303, -0.4617206121930335, -0.5034209045182663, -0.5466511894348385, -0.5907368972773108, -0.6349298151562768, -0.6784289416848512, -0.7204052148131723, -0.7600291351167541, -0.7965001007761254, -0.8290761011195339, -0.8571022832720646, -0.8800368235984362, -0.8974725297982428, -0.9091527082755277, -0.9149800893303787, -0.9150180244408215, -0.9094837358732727, -0.8987340505474388, -0.883244698256107, -0.8635847989632388, -0.840388519214764, -0.8143259937753168, -0.7860754821821425, -0.7562984016314451, -0.725618418130832, -0.6946052685650759, -0.6637635012891998, -0.6335259164741172, -0.6042511895214864, -0.5762249782896791, -0.549663737125538, -0.5247204669519774, -0.5014916962389095, -0.48002508885042316, -0.46032719159387514, -0.44237095187978803, -0.426102744316766, -0.4114487386936314, -0.39832051833379656, -0.3866199172406932, -0.3762430882145542, -0.3670838443857405, -0.35903633581854644 ], [ -0.24590832768617776, -0.26725747426167357, -0.29226470653180314, -0.3209603255001672, -0.3532821194248632, -0.3890639522086159, -0.4280274744868593, -0.4697779267703124, -0.5138048351909907, -0.559488141870867, -0.6061099895780808, -0.6528720293693213, -0.6989177758740861, -0.7433592244284231, -0.7853066795715382, -0.8239005237700922, -0.8583434704126491, -0.887931692924024, -0.9120831149271424, -0.9303611176728565, -0.9424920178976819, -0.9483749376563996, -0.9480831501128658, -0.9418566226220596, -0.9300862230527072, -0.9132908008965164, -0.8920889810706304, -0.8671679126078011, -0.8392513378920726, -0.8090691889802355, -0.7773305269004571, -0.7447011035714604, -0.7117862409828304, -0.6791191744588343, -0.6471545571029069, -0.616266501968675, -0.5867503513136993, -0.5588272931856832, -0.532650968489585, -0.5083152972821534, -0.4858628741525497, -0.46529341707746097, -0.44657188609562826, -0.4296360073508727, -0.4144030391409148, -0.4007756977974435, -0.38864722312201194, -0.37790560773260395, -0.36843704472614025, -0.3601286663843646 ], [ -0.24308155561767775, -0.2653639252141853, -0.29151896224177465, -0.3215877373005793, -0.35551315557942886, -0.39312727430416006, -0.4341419268784086, -0.47814373676697053, -0.5245944222246104, -0.572837008058906, -0.6221082029139728, -0.6715568117208086, -0.7202676749813983, -0.7672902902145922, -0.8116709884590871, -0.852487304586585, -0.8888829800562693, -0.9201018625282894, -0.9455188307565477, -0.964665814631863, -0.9772510587657331, -0.983170053665801, -0.9825070644741326, -0.9755269055044392, -0.9626574610940472, -0.9444643126233255, -0.9216195531402285, -0.8948673313608135, -0.864988796809994, -0.8327689182068642, -0.7989671820920841, -0.764293552757999, -0.7293904029567626, -0.6948205071322548, -0.6610606928265523, -0.6285004031277277, -0.5974442339154751, -0.5681174529667921, -0.5406735514034462, -0.5152029869445027, -0.49174242204580576, -0.47028391394876734, -0.45078366096504396, -0.4331700397223184, -0.4173507766599833, -0.403219182686567, -0.3906594439376949, -0.37955100669933706, -0.3697721240397378, -0.36120264881395237 ], [ -0.24020150076097813, -0.26343741305155555, -0.2907694404515162, -0.3222506936921612, -0.35783025413337954, -0.39733910136764083, -0.44047953487979474, -0.48681929920802247, -0.5357914261662104, -0.5867004933699373, -0.6387356007617024, -0.6909899354709237, -0.7424863800722687, -0.7922082559136563, -0.8391339939468787, -0.8822742796672357, -0.9207100040905555, -0.9536291542854552, -0.980360606025706, -1.000402684152174, -1.0134444078740703, -1.0193776166436896, -1.01829872429118, -1.0104996592259918, -0.9964485258114518, -0.9767615144195076, -0.9521684203369885, -0.9234746561032995, -0.8915227768752394, -0.8571562884813685, -0.8211879538004584, -0.7843740824344985, -0.747395518251992, -0.7108453441427718, -0.6752227781027176, -0.6409323708746495, -0.6082874278874744, -0.5775165384895065, -0.5487721638522378, -0.5221403709848038, -0.49765096912469065, -0.4752874798383835, -0.4549965357131598, -0.43669644440625977, -0.4202847707537689, -0.4056448793749361, -0.39265144594138546, -0.38117499046872827, -0.37108551449619287, -0.3622553395987771 ], [ -0.2372758375242492, -0.26148431304072495, -0.2900211486947504, -0.3229528503566266, -0.36023582911301166, -0.4017008119772967, -0.4470409360997496, -0.4958048763858445, -0.5473961458402061, -0.601079360819899, -0.6559938207872116, -0.7111742728902974, -0.7655782753428946, -0.8181191820814767, -0.8677034567463064, -0.9132707693086867, -0.9538351009626819, -0.9885248581775391, -1.0166197840235562, -1.0375823089497769, -1.0510809971960953, -1.0570040199357917, -1.0554611868533925, -1.046773982421258, -1.0314541759522298, -1.0101727228867219, -0.9837216371565904, -0.9529721120277048, -0.9188323044482041, -0.8822078856537093, -0.8439678005366551, -0.804916825436826, -0.7657756311279693, -0.7271682770668297, -0.689616466324672, -0.6535395076638737, -0.6192587499198927, -0.5870052364437117, -0.5569294257340325, -0.5291119915562512, -0.5035749126839553, -0.48029226027215355, -0.45920027144281694, -0.4402064511840831, -0.42319756773401696, -0.4080465000236362, -0.3946179626862534, -0.38277317889496487, -0.3723735983897345, -0.36328377173025683 ], [ -0.23431349757073128, -0.2595121063880368, -0.28927998672493715, -0.32369847746828406, -0.3627325686482339, -0.40621365999291204, -0.4538261929298999, -0.5050996619740837, -0.5594072854448899, -0.6159722316562879, -0.6738818030554001, -0.7321094473582057, -0.789543962972064, -0.8450248454952267, -0.8973823949109402, -0.9454809434924312, -0.9882633262709002, -1.0247944629442347, -1.0543016574901158, -1.0762090139840865, -1.090163329909391, -1.0960490912842733, -1.093990845164174, -1.0843422585867901, -1.0676624656106553, -1.0446816356737259, -1.0162588105099126, -0.9833357377636878, -0.9468905660221143, -0.9078948764028906, -0.8672767387150244, -0.8258914849674562, -0.784500882438272, -0.7437605141319203, -0.7042145247914233, -0.6662964918066736, -0.6303350109767998, -0.5965625983579463, -0.5651266434387483, -0.5361013514742028, -0.5094998405246121, -0.4852857810149678, -0.4633841638479883, -0.44369094823852895, -0.42608147024559573, -0.41041758948881046, -0.39655361906831166, -0.38434112747292115, -0.3736327264783348, -0.3642849704264617 ], [ -0.2313247586164866, -0.25752947142903926, -0.2885528335940424, -0.3244925346492482, -0.3653234885509875, -0.4108787966462868, -0.4608347726337658, -0.5147017086923034, -0.5718218199755611, -0.6313753798704378, -0.6923955066875658, -0.7537914675448638, -0.8143798130936347, -0.8729222064882072, -0.9281684735665897, -0.9789031422878564, -1.023993494755728, -1.0624368723153088, -1.0934046525021621, -1.1162800313700747, -1.1306866392519042, -1.1365052580964865, -1.1338766119199277, -1.1231893711626983, -1.1050540028649363, -1.080264645695682, -1.049752480242154, -1.01453484055875, -0.9756644431700005, -0.9341826242967625, -0.8910795374295383, -0.8472631024461003, -0.8035373424967738, -0.7605897685938827, -0.7189867685822233, -0.6791755470986538, -0.6414910127645939, -0.6061660561680104, -0.5733438380923919, -0.5430909500244483, -0.5154105704255993, -0.49025498835841486, -0.4675370823436975, -0.4471405188475128, -0.42892857077855884, -0.4127515552989951, -0.3984529576936102, -0.38587435020633, -0.3748592375810289, -0.3652559697523101 ], [ -0.22832132919807369, -0.25554637304735306, -0.2878476351866248, -0.32534074831805637, -0.36801198966684323, -0.4156972969706212, -0.4680655313107338, -0.5246078581958238, -0.5846348599537878, -0.6472825218269791, -0.7115276162681763, -0.7762123449870135, -0.840077490110432, -0.901802845263809, -0.9600533563996968, -1.0135291514062348, -1.0610173918815917, -1.101443566660199, -1.1339194552080811, -1.1577846072809832, -1.172637990249366, -1.1783566582042542, -1.1750990533244534, -1.163291874468501, -1.143601171810672, -1.116890127506032, -1.0841674812863502, -1.046531442676112, -1.005114047725774, -0.9610303139420092, -0.9153354275887411, -0.8689918441900978, -0.8228468654539604, -0.7776201696938458, -0.7339000167602292, -0.6921464335438758, -0.652699563414785, -0.6157914547598335, -0.581559788411087, -0.5500623310636279, -0.5212911997500962, -0.4951862976112593, -0.4716475157213842, -0.45054548318335486, -0.4317307891089843, -0.41504170060431833, -0.4003104674520921, -0.38736834408024334, -0.3760494793122686, -0.36619383001977424 ], [ -0.2253164270521517, -0.2535741481705407, -0.287173490381903, -0.3262496900294214, -0.3708019180933131, -0.4206701901920038, -0.4755167018836981, -0.5348136738264062, -0.5978395165197741, -0.6636846024040826, -0.731267239635391, -0.7993596968310737, -0.8666234571639868, -0.9316523689518983, -0.9930220205422873, -1.0493434343726495, -1.099318936294122, -1.1417977111872677, -1.1758280824603329, -1.2007030519121544, -1.2159953255473785, -1.221578197681434, -1.2176294748312704, -1.2046171232953746, -1.1832673216451435, -1.154517700387056, -1.1194602928757242, -1.0792797251198691, -1.0351922637256052, -0.988390589845597, -0.9399978318057021, -0.8910328128242075, -0.8423869703918365, -0.7948122006055718, -0.7489180744933723, -0.705176461979953, -0.6639315144842053, -0.6254131029936552, -0.5897520891879584, -0.5569961440575031, -0.5271251655496938, -0.5000656499530638, -0.4757036243510331, -0.45389594514898546, -0.4344799135468671, -0.41728125994875365, -0.4021206141401561, -0.3888186149822568, -0.3771998298074739, -0.3670956558357701 ], [ -0.2223248483647342, -0.25162558477122743, -0.28654073358516685, -0.32722685398841267, -0.3736976269900292, -0.42579849341154374, -0.48318588606218893, -0.5453133767809535, -0.6114267680016721, -0.6805695792444639, -0.751599599056253, -0.8232163360509228, -0.8939984612724522, -0.962449792022968, -1.0270520374772987, -1.086322323872897, -1.1388732956000869, -1.183473213027788, -1.2191028986130457, -1.2450057347985997, -1.260726457806812, -1.2661345585281032, -1.2614289621815047, -1.2471223652841659, -1.2240059278409143, -1.193097474150108, -1.1555783816654523, -1.1127254761679228, -1.0658443038883325, -1.0162092176890491, -0.9650141223115317, -0.9133358899714694, -0.862110754788087, -0.8121226680432586, -0.7640017447926053, -0.7182305354122618, -0.6751558213067321, -0.6350038446049175, -0.5978972263042994, -0.5638722185678464, -0.5328953154018206, -0.5048785776965479, -0.47969329885241896, -0.4571818440998232, -0.437167645801835, -0.41946343766271754, -0.40387787293166966, -0.39022070488454585, -0.3783067202693202, -0.3679586146470679 ], [ -0.2193630247444589, -0.24971499134599529, -0.28596101088759385, -0.3282807314451479, -0.37670403826831267, -0.4310832475425799, -0.4910700499737246, -0.5560997861286037, -0.6253853291052864, -0.6979222069240607, -0.7725057181890245, -0.8477598520549751, -0.9221770024645884, -0.9941668936885493, -1.062112823774009, -1.1244331761552397, -1.1796459593348043, -1.2264337310115672, -1.2637055822454135, -1.2906520292745984, -1.3067880126172056, -1.3119791605392297, -1.3064473826492529, -1.2907538018148879, -1.2657597320963658, -1.232569285312728, -1.192459547265006, -1.1468055537478845, -1.0970072897998815, -1.0444247768769677, -0.9903254150626448, -0.9358456174168501, -0.881966846400682, -0.8295047083996504, -0.7791088736139393, -0.7312712198041325, -0.6863396286029231, -0.6445351502156793, -0.6059706689851443, -0.5706696525332189, -0.5385839890655484, -0.5096102778737919, -0.4836042250482464, -0.46039301121065335, -0.4397856492061123, -0.42158144861747404, -0.40557676245439467, -0.391570220066384, -0.37936665814033455, -0.36877995561409427 ], [ -0.2164490643613033, -0.247858253359464, -0.2854473465825542, -0.3294208791341824, -0.37982670193528123, -0.43652555402605975, -0.49916552282514837, -0.5671642629223859, -0.6397015238627859, -0.7157238230492331, -0.7939621076732808, -0.872962185287596, -0.9511267911864799, -1.0267675571128199, -1.0981648668790656, -1.163633493957505, -1.2215917746943799, -1.2706316437233207, -1.3095860483811037, -1.3375892116758754, -1.3541243276935897, -1.3590530834988666, -1.3526223532647705, -1.3354456250433333, -1.3084598697054661, -1.2728619332804554, -1.230031280579552, -1.1814473724391075, -1.1286098664833109, -1.0729683944469923, -1.0158664091217064, -0.9585011245387651, -0.9018993999584588, -0.846907835403737, -0.7941944320334435, -0.7442588469312181, -0.6974483830593952, -0.6539772314745018, -0.6139469798057005, -0.5773669144921898, -0.5441731108686236, -0.5142456939160873, -0.4874239548931203, -0.4635192301519404, -0.44232559996007725, -0.42362856102620006, -0.40721188018618615, -0.39286286012540694, -0.38037625068458314, -0.3695570286293257 ], [ -0.21360277328320065, -0.24607287263710043, -0.2850141961933115, -0.33065797831834076, -0.3830718502779198, -0.4421266103218753, -0.5074679975444061, -0.5784966584009581, -0.6543591634325672, -0.7339521384910752, -0.8159404526651843, -0.8987892002120403, -0.9808081993563281, -1.0602070966656167, -1.1351589328663976, -1.20387002532657, -1.2646539526597236, -1.3160069835664165, -1.3566813339467387, -1.3857513230613216, -1.4026663162964903, -1.4072839580286622, -1.3998781850102715, -1.3811190409938596, -1.3520249952942316, -1.3138924284413105, -1.268210147523993, -1.2165684278304507, -1.160571863672459, -1.1017635316977388, -1.041565281280724, -0.9812361103392757, -0.9218481452830601, -0.8642780343021125, -0.809210639066156, -0.7571516516796382, -0.7084459743205003, -0.6632991780681448, -0.6217999426977732, -0.583941959669757, -0.5496442925453384, -0.5187696050387056, -0.49113998294570904, -0.466550301641359, -0.4447792409904585, -0.42559814092006953, -0.4087779388438839, -0.3940944474960817, -0.3813322287402834, -0.3702873032816145 ], [ -0.2108456526566902, -0.24437798518345466, -0.2846774815632718, -0.33200388033544703, -0.3864464434056074, -0.4478877415605096, -0.5159725318542121, -0.590085265950899, -0.669339429747924, -0.7525810341542236, -0.8384073061544633, -0.9252002619471353, -1.0111737117102622, -1.0944315810876084, -1.1730352650237625, -1.2450778479401616, -1.308763054571134, -1.3624863471017117, -1.404914456798379, -1.4350580038245542, -1.4523303054079364, -1.456584836028731, -1.4481248146318686, -1.4276812913110262, -1.3963604205757574, -1.3555652667155749, -1.3069012131222557, -1.252075873104229, -1.1928040178423267, -1.1307258361703894, -1.0673436467236144, -1.0039788888334618, -0.9417484935789411, -0.8815579074516945, -0.8241071284406907, -0.7699059458363091, -0.7192949054838578, -0.6724691180121793, -0.6295027089038472, -0.590372359590156, -0.5549789460326768, -0.5231667227723034, -0.4947398278194053, -0.46947611133575395, -0.4471384379362222, -0.4274836978730643, -0.41026980339871844, -0.3952609571664676, -0.3822314703865899, -0.37096838755557604 ], [ -0.20820086703803553, -0.24279435241525604, -0.2844546029439765, -0.333471633841133, -0.38995820193209063, -0.4538104250382695, -0.5246735476385378, -0.6019167760950555, -0.684620765865203, -0.7715803668569754, -0.8613237924660264, -0.9521478228300421, -1.0421673855394022, -1.1293771623436273, -1.211722784460649, -1.287179451172417, -1.3538359720723288, -1.4099817949233708, -1.4541932616973692, -1.485413314632361, -1.5030168622694298, -1.5068530547457744, -1.4972567388515858, -1.475024689449417, -1.4413572809311734, -1.3977717481252565, -1.3459975237470445, -1.2878661650378609, -1.225207770848486, -1.1597630728626218, -1.0931165972439287, -1.0266525068354297, -0.9615317085724895, -0.8986868759351159, -0.8388311622428167, -0.7824763299753164, -0.7299564937535532, -0.6814544012288719, -0.6370279604824993, -0.5966354445944342, -0.560158405504223, -0.5274217939051844, -0.4982111179119433, -0.4722867004286413, -0.44939523670451464, -0.42927893149752694, -0.4116825283162766, -0.39635854626043554, -0.3830710242522879, -0.3715980460457542 ], [ -0.20569317891968275, -0.24134432036171272, -0.284364422414928, -0.3350754882127973, -0.39361562178335263, -0.45989630345702825, -0.5335648257821155, -0.6139762332859207, -0.7001787736615572, -0.790915787071437, -0.8846453259705543, -0.9795770263075811, -1.0737243285875542, -1.1649694221390274, -1.2511383065982737, -1.3300838312064527, -1.3997749166782485, -1.4583897578313385, -1.5044092701903322, -1.5367045607277898, -1.5546096265076559, -1.5579691121599584, -1.5471519694694498, -1.5230256908093358, -1.4868917512823625, -1.4403893603837483, -1.3853796682870378, -1.3238247990828218, -1.2576751628379559, -1.1887751496964425, -1.1187928290788038, -1.0491749432475466, -0.9811251489156229, -0.9156014413438278, -0.8533278937841701, -0.7948159444764169, -0.7403911013772722, -0.6902218059601077, -0.64434809058516, -0.6027084583332092, -0.5651640576815147, -0.5315197089189441, -0.5015416805801054, -0.4749723382212936, -0.45154192197056786, -0.4309777781855475, -0.41301139458791725, -0.39738358313257627, -0.38384813218230973, -0.37217421745885715 ], [ -0.2033488443515583, -0.2400517410376819, -0.2844272124216767, -0.33683086686205455, -0.39742796529193924, -0.46614718196350546, -0.5426394929020872, -0.6262469927203385, -0.7159861192822128, -0.8105485714432679, -0.9083213507155914, -1.0074253368347488, -1.1057702067819495, -1.2011227505954691, -1.2911857904814048, -1.3736856180286625, -1.4464664390751454, -1.5075899701110589, -1.555436555498595, -1.5888011408348122, -1.6069741693148003, -1.6097955756802695, -1.5976710322001697, -1.5715440206773668, -1.5328243359320488, -1.483281252369856, -1.4249154423270074, -1.3598261557408107, -1.290088838838499, -1.2176542532214107, -1.1442748727149012, -1.0714593987573795, -1.000452587747402, -0.9322355111877534, -0.8675406813212244, -0.8068767600151792, -0.7505583963764153, -0.6987377670448711, -0.651435399306457, -0.6085687229796233, -0.5699774792163732, -0.5354456148186431, -0.504719633795299, -0.4775235958443036, -0.4535710759336007, -0.43257445753071266, -0.4142519460951397, -0.39833267560828634, -0.3845602509703412, -0.3726950311745596 ], [ -0.20119546457440696, -0.23894184999037948, -0.2846645627763331, -0.33875430354360425, -0.40140522192166106, -0.47256500316423944, -0.5518899955718357, -0.6387106747690103, -0.7320124464503925, -0.8304354731928931, -0.9322951074562995, -1.0356222058993132, -1.138220795627559, -1.2377397744496959, -1.331755641361322, -1.4178642571728985, -1.4937805026725157, -1.557444455378923, -1.6071306683036204, -1.6415534467650126, -1.6599569060915431, -1.6621760511666108, -1.6486560371790087, -1.6204218888766946, -1.5789992618457152, -1.5262958266357445, -1.464459642938187, -1.3957334830206705, -1.3223221900055564, -1.246285111205053, -1.1694594369736753, -1.0934146843027737, -1.019434614481236, -0.948520790457177, -0.8814114533318341, -0.8186099070362397, -0.760417641875748, -0.7069686245214715, -0.658262303466415, -0.614193813572008, -0.5745805796915011, -0.5391850310828317, -0.5077334791938679, -0.47993142022455504, -0.4554756365876529, -0.43406351783206176, -0.4154000248298797, -0.39920269799252495, -0.3852050728630241, -0.3731588226363849 ], [ -0.19926178881658818, -0.23804109402023044, -0.2850992391954792, -0.34086333421475024, -0.40555803121984635, -0.4791517934321845, -0.5613080568003614, -0.6513471139618652, -0.7482242974537066, -0.8505285937144568, -0.956503435431134, -1.0640887859112826, -1.1709815915225232, -1.274710855366732, -1.372724090955133, -1.4624832736377673, -1.5415696409210253, -1.6077965957343834, -1.659327644777685, -1.6947918454227355, -1.7133840946871466, -1.7149342451502356, -1.699929854986836, -1.6694833258344361, -1.6252440102530075, -1.5692664847628972, -1.5038540253070716, -1.4313990421963527, -1.354239651763989, -1.2745453990109992, -1.194237879185067, -1.11494571570328, -1.0379891227087024, -0.9643872406586215, -0.8948811249459556, -0.8299660427661893, -0.7699280120598688, -0.714880890405402, -0.6648015582226339, -0.619561739559318, -0.578955748547821, -0.5427239672944171, -0.5105721953266378, -0.4821872073226696, -0.4572489547242744, -0.43543988005911505, -0.416451804483301, -0.39999081646828993, -0.3857805445436935, -0.37356414734939447 ], [ -0.19757746391723963, -0.23737690335611683, -0.28575498644022046, -0.3431763366808047, -0.40989756000398025, -0.4859095730559633, -0.5708846087407711, -0.6641342988406653, -0.7645850413495168, -0.8707752789659876, -0.9808766172143646, -1.092737705508449, -1.2039475019514083, -1.3119136825416384, -1.4139526841823897, -1.5073896504752624, -1.5896682334964694, -1.658470320898803, -1.7118431343958624, -1.748325781298781, -1.7670609579690555, -1.7678731598980957, -1.7512954388669628, -1.7185336813736036, -1.671369027431439, -1.6120115643297628, -1.542927456026688, -1.4666644462103482, -1.3856971818394646, -1.3023063063328968, -1.2184968121907802, -1.1359541203982495, -1.0560318865420848, -0.9797636061575217, -0.9078900638254376, -0.8408957532509568, -0.7790489319424987, -0.7224415308586383, -0.6710264879477073, -0.624651131295763, -0.5830860040241392, -0.54604904086676, -0.5132253298200498, -0.48428287361189337, -0.45888484885536096, -0.4366988796448943, -0.4174038219141454, -0.4006945125106156, -0.38628488431165, -0.3739097932709423 ], [ -0.19617272729108426, -0.23697740321058203, -0.2866562694751791, -0.345712310272571, -0.4144353254721964, -0.49284022222362545, -0.5806096949555997, -0.677048298462898, -0.7810548087505114, -0.8911180446267859, -1.0053382761063276, -1.1214729218341577, -1.237002636463481, -1.3492129876668646, -1.4552879059732629, -1.552413360106694, -1.637891942606373, -1.7092694606200043, -1.7644716920072603, -1.8019430447959954, -1.8207709770093377, -1.8207744687504324, -1.802535341597766, -1.7673593349344299, -1.717167662014865, -1.654334511316812, -1.5814963012021526, -1.5013612216255348, -1.4165429411994508, -1.3294332797532296, -1.242118857152989, -1.15633896020437, -1.073477225724624, -0.9945780058822077, -0.9203786023070641, -0.85134998673381, -0.7877404372517707, -0.7296182603242782, -0.6769112233568542, -0.6294414289264538, -0.5869551419967456, -0.549147593157034, -0.5156830890911115, -0.48621092473378447, -0.4603776572312419, -0.4378363054742942, -0.41825300601604787, -0.4013116039542355, -0.3867165971869544, -0.37419479139484113 ], [ -0.1950780410064168, -0.23687106074275532, -0.2878279468973348, -0.34849058828352564, -0.41918295603442, -0.4999452946288989, -0.5904723352013006, -0.6900631710313574, -0.7975904325474141, -0.9114945345417386, -1.029805336813089, -1.150189667521075, -1.2700202234879192, -1.3864604144784105, -1.496560986835942, -1.597367092372479, -1.6860373573366676, -1.7599773108493932, -1.8169862863513249, -1.8554092598914205, -1.874275409758432, -1.8733981280186447, -1.8534114842597258, -1.815727674047179, -1.762416382956597, -1.6960243366646164, -1.6193650902450791, -1.5353116256876482, -1.4466181999327756, -1.3557869545235812, -1.26498354855342, -1.1759975713457522, -1.0902387574044319, -1.0087585863884039, -0.9322875909890449, -0.8612805134533237, -0.7959635498372306, -0.7363798435745639, -0.682430941450977, -0.6339130708365095, -0.5905478824431742, -0.5520078021677288, -0.5179364242144398, -0.48796452025216874, -0.4617222861330694, -0.4388484354491575, -0.4189967035219815, -0.4018402633733764, -0.38707448769062003, -0.37441842434774686 ], [ -0.19432366646282895, -0.23708626510794684, -0.28929487233191, -0.35153047701087026, -0.4241518823798669, -0.5072257708330301, -0.600460345792585, -0.7031508501884374, -0.814145394216034, -0.9318375177421722, -1.0541880616259323, -1.1787745124084048, -1.3028626812600461, -1.4234945793024538, -1.537587931082163, -1.6420462294946727, -1.7338819009887463, -1.8103564719774048, -1.8691380856569746, -1.9084676537331813, -1.9273130997307624, -1.9254822916753969, -1.9036652438215838, -1.8633874065164553, -1.806875339035161, -1.7368564099828308, -1.6563274978825007, -1.5683297493969621, -1.475758487759725, -1.3812242856979924, -1.286968394233878, -1.1948265196772228, -1.1062302296024775, -1.022234229983558, -0.9435589871940699, -0.8706404056746561, -0.8036806631259568, -0.7426964010363903, -0.6875621044706719, -0.6380476786160934, -0.5938500111350284, -0.5546187899829558, -0.519977111526085, -0.4895375334368477, -0.4629142536412274, -0.4397320680396075, -0.4196327013134582, -0.4022790334604407, -0.3873576700759793, -0.3745802328394914 ], [ -0.19393918136589283, -0.23765084055195795, -0.2910814216801709, -0.3548508171745759, -0.42935295284460095, -0.5146817446464245, -0.6105601094011688, -0.7162810051544994, -0.8306697760866284, -0.9520749304014695, -1.078390175920163, -1.2071055623164946, -1.3353818742311157, -1.460141363034663, -1.5781698166379476, -1.686229124236658, -1.7811840635275793, -1.8601490255869393, -1.9206565900814048, -1.9608391807704824, -1.979600649926737, -1.9767436060113315, -1.9530179368449567, -1.910069280538838, -1.85028932696679, -1.7765936464448142, -1.6921676868656663, -1.600222934985428, -1.5037950048169615, -1.405599884081469, -1.3079500887634006, -1.2127226650094787, -1.1213664281455729, -1.0349353091216629, -0.9541364699393827, -0.8793845305225853, -0.8108559313350603, -0.7485397122463437, -0.6922826937580147, -0.6418282353370319, -0.5968485140986255, -0.5569707230752994, -0.5217978265690222, -0.49092460504453017, -0.4639497281237266, -0.44048454927395886, -0.42015924484240985, -0.4026268391265517, -0.38756557581857853, -0.3746800198360325 ], [ -0.19395294340925662, -0.23859149546723968, -0.2932109471440789, -0.3584694664074819, -0.4347959697527408, -0.5223120379807784, -0.6207562899068888, -0.7294208723460041, -0.847110221294053, -0.9721299705147108, -1.1023090984898665, -1.2350528193063588, -1.3674195889873508, -1.496214478379807, -1.6180934197434853, -1.729677743128276, -1.827684028187354, -1.9090771244787768, -1.9712501903565725, -2.0122230847996887, -2.0308330488123136, -2.026877973100104, -2.001171787198193, -1.9554872951720528, -1.892389239933508, -1.814988143808453, -1.7266620513432254, -1.6307935312580664, -1.5305563022274726, -1.4287675562010071, -1.3278058727787105, -1.2295843237948128, -1.1355641452597023, -1.0467944756861582, -0.9639660712604585, -0.8874700470198523, -0.8174556554303348, -0.7538835118773162, -0.6965724342153783, -0.6452392538563774, -0.599531702377472, -0.5590549036554502, -0.523392210041518, -0.49212119012753663, -0.46482556075071324, -0.44110379467695826, -0.4205750523243976, -0.40288299609064304, -0.38769795820883624, -0.3747178523544459 ], [ -0.1943915082521166, -0.23993321397020573, -0.29570516291003424, -0.36240270555960774, -0.4404891472957657, -0.530113743140127, -0.631031490946206, -0.742535058642398, -0.8634099052502247, -0.9919212549219057, -1.1258362938898214, -1.2624787294543935, -1.3988082654397729, -1.5315163583530007, -1.6571322208887096, -1.7721387410036853, -1.8731047673619938, -1.9568440786709833, -2.020607241770423, -2.062297993575649, -2.0806848472874298, -2.0755618837215675, -2.0478114756202856, -1.9993404900933107, -1.9328940704124697, -1.8517833241019215, -1.7595813949108103, -1.659841002241314, -1.555870233403031, -1.4505820395566982, -1.346415024269087, -1.2453125142498416, -1.1487431942505544, -1.0577474711941766, -0.9729968120614666, -0.8948568977178711, -0.8234486582528724, -0.7587037725025603, -0.7004130049543666, -0.6482669318702667, -0.6018893246935735, -0.5608638503245158, -0.524754924503696, -0.4931235969912455, -0.46553931142311944, -0.441588305737433, -0.4208793244224922, -0.40304721577434033, -0.38775489393337903, -0.3746940608133149 ], [ -0.19527901292438843, -0.2416986008146731, -0.29858347223518633, -0.36666457680731224, -0.4464384968430921, -0.5380816966015058, -0.6413658613617088, -0.7555853203209646, -0.8795085255253078, -1.0113630504999298, -1.148857765338211, -1.2892389448277979, -1.4293720192123427, -1.565839412170099, -1.6950478490926604, -1.8133450352939215, -1.9171536872354864, -2.003136026909008, -2.068397751874226, -2.1107236517546437, -2.1288119974119675, -2.122454431253194, -2.092606376847115, -2.0413154067432115, -1.9715135388951148, -1.88671662732779, -1.7906935668933082, -1.6871643928618305, -1.579566165787841, -1.4709009147720393, -1.3636604602038624, -1.2598122624595565, -1.1608274509109886, -1.0677339415214318, -0.9811813292072552, -0.9015082845105232, -0.8288066408643402, -0.7629789681495447, -0.7037882317597235, -0.6508992905468836, -0.6039126657400316, -0.5623913664291254, -0.5258817007293606, -0.49392901753844276, -0.4660892676040298, -0.4419371805707073, -0.42107174921058554, -0.40311960637649813, -0.3877367815766182, -0.37460923590845985 ], [ -0.19663653953290128, -0.24390719515896464, -0.3018622513113245, -0.37126616793731393, -0.4526471523693165, -0.5462078950978799, -0.6517366570134226, -0.7685303269950321, -0.8953423210394974, -1.0303655937996838, -1.1712547074889765, -1.3151833254555683, -1.4589279889161333, -1.598967691677684, -1.73159201888025, -1.8530179471886508, -1.9595249018528933, -2.047624287716434, -2.1142757879362035, -2.157143407706604, -2.1748544737648903, -2.1672001260883857, -2.1352135935597176, -2.081089310346697, -2.0079514111958394, -1.919522790845162, -1.8197665643682435, -1.7125651394618504, -1.6014774287737525, -1.489586665116827, -1.3794304187030624, -1.272993942396253, -1.171745898713431, -1.0766982376304655, -0.9884764794435494, -0.907391117720253, -0.8335045120324708, -0.7666903127707319, -0.7066842571663112, -0.6531262937761215, -0.6055946280469067, -0.5636325947120282, -0.5267693727582741, -0.4945355483808378, -0.4664744556589373, -0.442150118536875, -0.42115250228192247, -0.4031006700626276, -0.38764433702277823, -0.374464223022398 ], [ -0.19848147783057724, -0.24657477357002233, -0.3055541113925744, -0.37621486442698426, -0.4591146567478628, -0.554480873149604, -0.6621177763218058, -0.7813254266276324, -0.9108441363257188, -1.0488355158162603, -1.1929043380120437, -1.3401572039173058, -1.4872880363692844, -1.6306790041549006, -1.7665090065401121, -1.8908699702070095, -1.9999022136369915, -2.0899684842676804, -2.1578827142156958, -2.2011875760409017, -2.2184398041863798, -2.209432632400154, -2.1752818923423813, -2.1183342507181733, -2.041909548898578, -1.9499377260708728, -1.8465720848774543, -1.7358501926314789, -1.6214439570258365, -1.5065088416334553, -1.393620183558147, -1.2847746174582575, -1.1814336517381427, -1.0845901821690775, -0.9948439050496457, -0.9124764274071966, -0.8375206829285015, -0.7698219680402896, -0.7090896842695582, -0.6549399453875562, -0.6069297956446302, -0.5645840570930258, -0.527415900905734, -0.49494220226243013, -0.4666946444429878, -0.4422274186809081, -0.42112224195141335, -0.40299129626944574, -0.38747858578942296, -0.3742601142153932 ], [ -0.20082690852287177, -0.2497126672700034, -0.3096671667882047, -0.3815135985562417, -0.4658362384998145, -0.5628850706485833, -0.6724792960826842, -0.7939224354841679, -0.925943551927547, -1.0666763904618426, -1.21368092479478, -1.364002928914116, -1.5142608177874939, -1.660747494365272, -1.799538697815701, -1.9266082128367015, -2.0379628662531797, -2.1298205305681503, -2.19885136649373, -2.242477797021889, -2.2591876342852184, -2.2487795410957583, -2.2124566306466456, -2.1527220152364084, -2.073092707194524, -1.9777029722029147, -1.8708894852328213, -1.7568353953870963, -1.6393150700855958, -1.5215462794508992, -1.4061338049139083, -1.2950793465311385, -1.1898329269561383, -1.0913657808782262, -1.0002505460013529, -0.9167397261355931, -0.840837319566099, -0.7723612153849269, -0.7109956908623836, -0.6563343621041384, -0.6079144780995538, -0.5652436787020783, -0.5278203822167014, -0.4951489095219195, -0.4667503410167375, -0.4421699719723444, -0.420982099586954, -0.4027927511916989, -0.38724085237500794, -0.37399823788567943 ], [ -0.20368103174123453, -0.2533271224929843, -0.31420434178090817, -0.3871601319755289, -0.4728021173308805, -0.5714002287893454, -0.6827870436619077, -0.8062694849239991, -0.9405671069930267, -1.0837894259533165, -1.233457021002883, -1.3865616941070764, -1.5396542286694381, -1.6889466990392414, -1.8304202165451542, -1.959938538519776, -2.073382114204341, -2.1668295487089155, -2.2368112572889443, -2.2806325010228052, -2.296715433541627, -2.2848682684857753, -2.2463857298436825, -2.1839299856005994, -2.1012140493656357, -2.002570663954757, -1.8925100656748128, -1.775349032152353, -1.654952310009813, -1.5345892988159204, -1.4168857630705334, -1.3038424141989684, -1.196893936237427, -1.0969878576852414, -1.0046690839406516, -0.9201613131770056, -0.8434405462891995, -0.7742985878730302, -0.7123961111077426, -0.657305820508461, -0.6085467339064701, -0.5656107956106804, -0.5279830481051155, -0.4951565095176784, -0.4666427785228582, -0.4419792474378992, -0.4207336651932141, -0.4025066635856449, -0.3869327467541912, -0.3736801462252617 ], [ -0.2070466665124051, -0.257418735339054, -0.31916275353112256, -0.39314641388340443, -0.47999688419856223, -0.5800008611910157, -0.6930022502427209, -0.8183109638963499, -0.9546386436800364, -1.1000743168428613, -1.2521049125804606, -1.4076756441643408, -1.5632782041436115, -1.7150530499767442, -1.8588961119054341, -1.9905703914678816, -2.1058386183407185, -2.2006477534658586, -2.2713948734326457, -2.3152735532716484, -2.330645412117609, -2.317333121972972, -2.2767266917484887, -2.2116478471757066, -2.1260012861367117, -2.024308897395043, -1.911241557551507, -1.7912354352382889, -1.6682322406639272, -1.5455418141892596, -1.425802517511906, -1.3110084431046896, -1.202575668577886, -1.1014265933007725, -1.0080783044729986, -0.9227265113534587, -0.8453205947097141, -0.7756279585056822, -0.7132874827010074, -0.6578527768874058, -0.6088263726808532, -0.5656861460599232, -0.5279052491877378, -0.4949667321425395, -0.4663738964103261, -0.44165727239652663, -0.4203789684588579, -0.4021350070893872, -0.38655614820405115, -0.37330760063483903 ], [ -0.21092084692816315, -0.26198199311694736, -0.324533209720282, -0.39945806006004925, -0.48739900622042054, -0.5886558527038179, -0.7030813355007415, -0.8299876001510981, -0.9680798036822689, -1.1154302698853895, -1.2694982716602854, -1.427190231471472, -1.5849478303626943, -1.7388497681460107, -1.8847170409117464, -2.0182222496134514, -2.1350206247964714, -2.230937286018964, -2.3022450705905144, -2.3460340922556266, -2.3606126473305515, -2.3458234941411327, -2.303154569505587, -2.2355850142316687, -2.1472032722390004, -2.0427073177952604, -1.9269126500051197, -1.8043585085493317, -1.6790490973532957, -1.554323267925936, -1.4328238812951057, -1.3165333470517342, -1.2068465347581452, -1.10465994917451, -1.0104633662599265, -0.9244258294106584, -0.8464718938797764, -0.7763465825501479, -0.7136690583265601, -0.6579758594703933, -0.6087549360847766, -0.5654718453524128, -0.5275894275976039, -0.49458216976124203, -0.4659463133454951, -0.4412066071200673, -0.4199204555624718, -0.4016800793227857, -0.38611318669080097, -0.372882555295857 ], [ -0.21529453880476934, -0.2670049523899465, -0.3302998583223722, -0.4060739973435692, -0.4949805069391664, -0.5973282392684083, -0.7129758748812747, -0.8412367225906376, -0.9808107035705449, -1.1297572086376757, -1.2855139949414538, -1.4449567752978014, -1.6044866927393198, -1.7601310524703226, -1.9076468344785023, -2.042627587306362, -2.16063281555417, -2.257377898983428, -2.329023479836217, -2.3725674754924038, -2.386274308887641, -2.3700130295308326, -2.3253706871118336, -2.2554785288092662, -2.1645968069671064, -2.0575826917919233, -1.9393773521163413, -1.8146050069900725, -1.6873171663290003, -1.560870303099621, -1.4379041626402898, -1.3203850866132698, -1.2096848500900033, -1.1066739618064678, -1.011815968008754, -0.9252550449140755, -0.8468930991107043, -0.7764550927911056, -0.7135427811377644, -0.6576778332629325, -0.6083356579269488, -0.5649713449477385, -0.5270390773354172, -0.4940062401035916, -0.4653632932961127, -0.44063031434994127, -0.4193609621110548, -0.4011444780872837, -0.38560622208869355, -0.37240713912853507 ], [ -0.2201524968081099, -0.272469079538608, -0.33644002200412193, -0.4129663129335961, -0.5027068671232957, -0.6059752167591397, -0.7226327948326929, -0.851992740300999, -0.9927508066772298, -1.142957149436429, -1.3000341892466598, -1.4608351523417613, -1.6217303563613064, -1.778706427125587, -1.9274677836647274, -2.063541163728346, -2.1824036339647424, -2.2796752897898545, -2.351419716336882, -2.394557104573421, -2.40731971956677, -2.389609455287558, -2.343111761028568, -2.2711010746253937, -2.1779933005698653, -2.0687841723061875, -1.9485189584277838, -1.821887399003065, -1.692972772935442, -1.565138094251237, -1.4410130214968477, -1.3225441949351637, -1.2110791360553297, -1.1074628965771756, -1.0121344076898429, -0.925215205095417, -0.8465870586549961, -0.7759574478968503, -0.7129132249508237, -0.6569635383732098, -0.6075734043801313, -0.5641893766637374, -0.5262586934785931, -0.4932431408348037, -0.4646287054101519, -0.43993192419830707, -0.4187036826556074, -0.4005310750368467, -0.38503782153957533, -0.371883636391138 ], [ -0.22547327641450443, -0.2783492726956198, -0.3429242412151612, -0.4201003379696153, -0.5105371799778569, -0.6145484143319231, -0.7319948281327522, -0.8621878599782948, -1.0038199947826052, -1.1549357258556596, -1.3129482488827984, -1.4746965263730587, -1.636529846904211, -1.7944050753720961, -1.9439859339294572, -2.0807453852794726, -2.200092795032827, -2.297569755030767, -2.3691610251626765, -2.4117267234501836, -2.4234808017745446, -2.4043645907498252, -2.3561589289068854, -2.2822686378931354, -2.187244899474874, -2.076197930187015, -1.9542533753381213, -1.8261461431317276, -1.6959757668642823, -1.5671012660523747, -1.442135999199967, -1.323004049982653, -1.211028228315862, -1.1070292552691594, -1.0114235319836573, -0.9243125457282256, -0.8455607193640251, -0.7748608354462723, -0.7117875007992098, -0.6558398034063149, -0.6064745957379805, -0.5631318832247267, -0.5252537113076194, -0.49229779669440954, -0.4637469784317336, -0.43911539504747, -0.4179521372888124, -0.39984298723413314, -0.3844107352917894, -0.37131446619713504 ], [ -0.23122940801300884, -0.2846140748210493, -0.3497165385613161, -0.4274349807555333, -0.5184245780058756, -0.6229944490681896, -0.7410012415267446, -0.8717530435411711, -1.0139398240160875, -1.165603821516575, -1.3241549534481754, -1.486426008497652, -1.6487549813695868, -1.8070799622656606, -1.9570361370814922, -2.0940564313222287, -2.213498600770555, -2.310844710470051, -2.3820218331885465, -2.423850592306425, -2.4345422663500065, -2.414083880610481, -2.3643460629960478, -2.288847269057282, -2.1922496293173266, -2.079750823574812, -1.9565315802358871, -1.8273512305370798, -1.6963104141398586, -1.5667543480899546, -1.4412746937249588, -1.321770880276857, -1.2095411864100898, -1.1053836370256411, -1.009694577872723, -0.9225583308375509, -0.8438249743256092, -0.7731755324723402, -0.7101751324019783, -0.6543153361285499, -0.6050471115686091, -0.5618059366997017, -0.524030436618919, -0.49117580024074536, -0.4627230504975943, -0.4381850711314592, -0.4171101358783347, -0.39908354703939874, -0.3837278713800967, -0.3707021612425079 ], [ -0.23738773247545697, -0.29122607723541094, -0.35677490360982, -0.434923308183776, -0.5263169285619567, -0.6312557557573726, -0.7495888236114763, -0.8806191841283079, -1.0230349285977438, -1.1748792546512306, -1.3335645029554284, -1.4959251314865596, -1.6582973910571934, -1.816611538576511, -1.9664865910082594, -2.1033297943493596, -2.2224646130398584, -2.319334515490738, -2.3898325330184473, -2.430762775061229, -2.4403507426890045, -2.418634674833568, -2.3675666764139285, -2.2907583808270986, -2.1929551330767243, -2.079412813788056, -1.9553410281433465, -1.825502884677361, -1.6939856374487556, -1.564111738209558, -1.4384465705710516, -1.318863503471049, -1.206637008932518, -1.1025444582711752, -1.0069649122078077, -0.9199686186922119, -0.8413944572696095, -0.7709147275823318, -0.7080879039135315, -0.6524005941553641, -0.603300181495457, -0.5602196466266887, -0.5225959686650581, -0.4898833473541204, -0.46156231523585256, -0.43714563753635294, -0.4161817405244521, -0.39825627080289316, -0.3829922695233645, -0.3700493460450094 ], [ -0.24390988931250512, -0.29814250211927074, -0.36405198329713584, -0.4425133563500405, -0.5341577740031827, -0.6392716617107741, -0.7576930958558559, -0.888718455072269, -1.0310345166406032, -1.1826884448753852, -1.3411004018146422, -1.5031140236444556, -1.6650730866664984, -1.8229108274115378, -1.9722426023323198, -2.1084648789643454, -2.2268852095042573, -2.3229309880063083, -2.3924867487394033, -2.432364694878408, -2.440821983947025, -2.4179524545538813, -2.365778754994684, -2.287982080354043, -2.1893606625093196, -2.0751979176900717, -1.9507058907771024, -1.820631364291465, -1.6890345866738374, -1.5592071750540537, -1.4336844184969364, -1.3143128099413401, -1.2023441664710033, -1.0985375426957313, -1.003257678736972, -0.9165639619289683, -0.8382872901063432, -0.7680943097517632, -0.7055396840048918, -0.6501076388659635, -0.6012442641321198, -0.5583820598139115, -0.5209581172904112, -0.48842716873460246, -0.46027056514213593, -0.4360020733895891, -0.41517122685140606, -0.3973648268437493, -0.3822070746234709, -0.3693587150004125 ], [ -0.2507529408332627, -0.3053159424103675, -0.3714959501772048, -0.4501491352563429, -0.5418874732073349, -0.6469796551667737, -0.7652496878783965, -0.8959857667973999, -1.0378738876134208, -1.188967985629381, -1.3467011056420635, -1.507933180172384, -1.669024437180346, -1.8259217237837257, -1.974249339497747, -2.1094083365479084, -2.226709578608236, -2.3215880242692215, -2.3899463648691537, -2.428630157963949, -2.435945355261988, -2.4120443129981552, -2.359006986227933, -2.2805581829948407, -2.1815171213869506, -2.0671636039788996, -1.94268610293218, -1.8127958803501312, -1.681513565628635, -1.5520927496870218, -1.4270354783364299, -1.3081610157717725, -1.1966999723682763, -1.0933955973636291, -0.9986013652424849, -0.9123690516673921, -0.8345247912425937, -0.7647326297042214, -0.7025462308449644, -0.647449976076284, -0.5988909169046215, -0.5563030539372329, -0.5191253159091269, -0.486814458677038, -0.45885393323452184, -0.434759604022221, -0.4140830447477013, -0.39641300319936756, -0.3813755102472336, -0.36863301055756326 ], [ -0.25787010921064235, -0.3126952291764855, -0.3790515102870964, -0.457771779847713, -0.5494444866757366, -0.6543167802549927, -0.7721958030139151, -0.9023602541605872, -1.0434958937951864, -1.1936660461244761, -1.350321355018731, -1.5103447514154813, -1.6701214675689648, -1.825622382750027, -1.9724934016188997, -2.1061558853948785, -2.2219438034088714, -2.3153238610531206, -2.382243759150117, -2.4196072436710248, -2.4257850433573283, -2.4009892487222633, -2.347342101584097, -2.268584775077508, -2.1695251397460678, -2.0554086777696554, -1.9313752881571866, -1.802082703018617, -1.6715003834646707, -1.5428375131375038, -1.4185602899690233, -1.3004607199580258, -1.1897498178200552, -1.0871575949781063, -0.9930293058704083, -0.9074123169704412, -0.8301311532336714, -0.760850240343246, -0.69912498288207, -0.6444423871966005, -0.5962526596049615, -0.5539932271122954, -0.5171065320002759, -0.4850528024156846, -0.4573188339880778, -0.4334236528816682, -0.4129217791615245, -0.395404675619335, -0.3805008524630986, -0.3678750018046728 ], [ -0.26521159854831167, -0.320226390655006, -0.3866610054354427, -0.4653207917584692, -0.556766739132663, -0.6612210835407515, -0.7784716937468217, -0.9077867132379718, -1.0478522692133017, -1.1967435344543498, -1.3519331369350511, -1.5103332949208434, -1.6683624209720032, -1.8220256282157563, -1.9670031056400066, -2.0987524730238225, -2.212650834231335, -2.304220725505693, -2.3694809523793423, -2.405416787056524, -2.4104777825843615, -2.384935177624131, -2.3309373583061594, -2.252214444719573, -2.1535313474414632, -2.040069830760647, -1.9168977242063578, -1.788602591268935, -1.6590922343878929, -1.5315257581401718, -1.408331315429917, -1.2912738083631086, -1.1815463023942856, -1.0798680850236158, -0.9865791353057968, -0.9017254919050506, -0.825133098832883, -0.7564696229715433, -0.6952948404589012, -0.6411007546549956, -0.593342834531297, -0.5514637856082085, -0.5149111767723371, -0.4831501033039005, -0.45567190452228257, -0.431999793946648, -0.41169211153391494, -0.39434377625715156, -0.379586404386425, -0.3670874637438941 ], [ -0.2727254712535534, -0.3278536641167029, -0.3942655617005477, -0.4727353135614789, -0.5637929919555886, -0.6676330372373573, -0.7840220689281343, -0.9122169118167478, -1.050904758569605, -1.1981749675658082, -1.3515262355385707, -1.507905968418329, -1.6637735739115431, -1.8151783753405093, -1.9578474817411966, -2.0872907647135515, -2.198948334956474, -2.288421876360834, -2.3518257240529543, -2.3862475734042485, -2.3902273017938436, -2.3640929474213075, -2.31000249763005, -2.2316485326130393, -2.1337231766778753, -2.02131713951093, -1.8994045743281711, -1.77248771733102, -1.6444032326353193, -1.518255066854319, -1.3964314038527326, -1.2806702512818267, -1.1721482934236964, -1.0715764577570668, -0.9792922120635223, -0.895343162723575, -0.8195595245770589, -0.7516149060131818, -0.691075943228884, -0.6374418852853996, -0.5901754659853558, -0.5487264317902425, -0.5125490155783117, -0.48111451103274017, -0.4539199469622681, -0.4304937053518234, -0.41039878241562566, -0.393234263482511, -0.37863547176195533, -0.3662731575104121 ], [ -0.28035854730937304, -0.33552052154463174, -0.4018062367532036, -0.47995537969868773, -0.5704641622819893, -0.6734968712275569, -0.7887973644264192, -0.9156107101904041, -1.0526259936274185, -1.1979490119075868, -1.3491083564345274, -1.503092170451219, -1.6564083338240856, -1.8051601180991228, -1.9451340538762454, -2.0719080719762113, -2.1810045763038217, -2.268126299478432, -2.3295050700089606, -2.3623487345011083, -2.365296065094901, -2.3387279594816976, -2.2847957625363167, -2.207129922962077, -2.110322627898162, -1.9993488550090608, -1.8790696438384555, -1.7538882758817882, -1.627561738737031, -1.5031342207774534, -1.3829521659176907, -1.2687268421813607, -1.1616199478019844, -1.0623361848044977, -0.9712130278358986, -0.8883023073345696, -0.8134411407144464, -0.7463115826597584, -0.6864894480901742, -0.6334833351686262, -0.5867651217244907, -0.5457932542374377, -0.5100300805477271, -0.47895435199938463, -0.45206987281975874, -0.4289111248692803, -0.40904655576477755, -0.39208009319767334, -0.3776513398803816, -0.365434811766743 ] ], "zauto": true, "zmax": 2.440821983947025, "zmin": -2.440821983947025 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.6982638747415277, 0.6961787842389232, 0.6941964170565242, 0.6923197587581811, 0.6905441849191982, 0.6888583923639499, 0.6872462151860812, 0.6856891961064835, 0.684169667256101, 0.6826740032772022, 0.6811956591480173, 0.6797376042522355, 0.6783138146968664, 0.6769495832115537, 0.6756805405309534, 0.6745504398018706, 0.6736079173972489, 0.6729025862950512, 0.6724809166107839, 0.672382389939079, 0.6726363682611728, 0.6732599992435735, 0.6742573108396362, 0.6756194654642739, 0.6773259867713451, 0.6793466704504042, 0.6816438574324526, 0.6841747773667878, 0.6868937418829429, 0.6897540550125388, 0.6927095891131743, 0.6957160339900699, 0.698731859788534, 0.7017190437875338, 0.7046436051202853, 0.7074759782821426, 0.7101912430550649, 0.7127692193918986, 0.7151944322797241, 0.7174559529752392, 0.7195471274898267, 0.7214652087496253, 0.7232109137457162, 0.7247879301116781, 0.7262023974596369, 0.7274623875439171, 0.7285774043267697, 0.7295579208844157, 0.730414965424563, 0.7311597640208403 ], [ 0.6951620602476102, 0.6928903381757864, 0.6907335267448401, 0.6886950969896308, 0.6867698067618815, 0.6849446915363971, 0.6832010787408755, 0.6815174851090685, 0.6798731200852357, 0.6782516107457699, 0.6766445031805457, 0.6750540919755632, 0.6734951851277554, 0.6719955211812292, 0.6705947080900613, 0.6693417340287828, 0.6682912883735419, 0.6674992997774876, 0.6670182174251776, 0.6668926035461351, 0.6671555542867063, 0.6678263264390868, 0.6689093465504441, 0.6703945609172336, 0.6722588982574055, 0.6744684986592036, 0.6769813280816678, 0.6797498386387429, 0.6827234250617249, 0.6858505346901816, 0.6890803840823465, 0.6923643028764233, 0.6956567602710084, 0.6989161364667573, 0.7021052906867011, 0.7051919596289044, 0.7081490036697374, 0.7109545074773383, 0.7135917381407182, 0.7160489662839927, 0.7183191615392766, 0.7203995806607825, 0.7222912724488402, 0.7239985272808135, 0.7255282999704534, 0.7268896330700523, 0.728093104147996, 0.7291503157401853, 0.7300734413054648, 0.7308748352198884 ], [ 0.691844410310033, 0.6893711819530334, 0.6870263980229558, 0.6848141403422192, 0.6827285288378, 0.680754766172363, 0.6788713649802733, 0.6770534060920207, 0.6752765163273521, 0.6735211277712153, 0.6717765082084316, 0.6700440461287716, 0.6683393349939478, 0.6666927241236417, 0.6651481761687092, 0.6637604775618243, 0.6625910662170597, 0.6617029399792042, 0.6611552538199271, 0.6609982688518283, 0.661269260413455, 0.6619898288925584, 0.6631648177077595, 0.6647827822642481, 0.666817731639278, 0.6692317271873846, 0.6719778873827615, 0.6750034040700436, 0.6782522884213854, 0.6816676948507622, 0.685193784026307, 0.6887771625012991, 0.6923679724149334, 0.6959207077865416, 0.6993948172302373, 0.7027551295670561, 0.7059721184880002, 0.7090220101552467, 0.7118867343018423, 0.7145537231205781, 0.7170155699142764, 0.719269568010575, 0.7213171574635183, 0.7231633112226172, 0.7248158933470641, 0.7262850197853554, 0.7275824479503984, 0.7287210156729389, 0.7297141439504309, 0.7305754119119551 ], [ 0.6883011597058355, 0.6856105356973291, 0.6830633605937882, 0.6806644822317297, 0.6784073760505335, 0.6762752346269, 0.6742434219529165, 0.6722831299130698, 0.6703658873973734, 0.6684684235563492, 0.6665773008661936, 0.6646927238846874, 0.6628309968858037, 0.6610252405199459, 0.6593241718574229, 0.6577889869742602, 0.6564886370536261, 0.6554940240863465, 0.6548718177374098, 0.6546786672246422, 0.6549565220744534, 0.6557295842935575, 0.6570031295304857, 0.6587641228265849, 0.6609832900033885, 0.6636181455111322, 0.6666164432558106, 0.6699195920171581, 0.6734657186449572, 0.6771922198172148, 0.6810377758434533, 0.6849438857487344, 0.688856018987398, 0.6927244766091242, 0.6965050303976329, 0.7001593784427694, 0.7036554310066094, 0.7069674267130374, 0.7100758763537744, 0.7129673371716152, 0.7156340303625591, 0.7180733249805692, 0.720287119717952, 0.7222811587290915, 0.7240643184511955, 0.7256478997373755, 0.7270449544763876, 0.7282696692827406, 0.7293368217726791, 0.7302613181682969 ], [ 0.6845227714682638, 0.6815977933670784, 0.6788328693683537, 0.6762338042584422, 0.6737934406554619, 0.6714927805746218, 0.6693036799694574, 0.6671929432857847, 0.6651274262895877, 0.6630795805795842, 0.661032771665097, 0.6589856886460725, 0.6569552373980402, 0.6549774614976154, 0.6531062525132698, 0.6514098770750086, 0.6499656382241416, 0.6488532657227515, 0.6481478434052836, 0.6479131765337249, 0.6481964392738492, 0.649024719130658, 0.6504037355585184, 0.6523186358929507, 0.6547364559906461, 0.6576096462159664, 0.6608800312781129, 0.6644826722831723, 0.668349276136874, 0.6724109881852711, 0.6766005594350304, 0.6808539751500445, 0.6851116664545462, 0.6893194162885538, 0.6934290371993701, 0.6973988604262066, 0.7011940463907614, 0.7047867114617528, 0.7081558642105931, 0.7112871523619565, 0.7141724342136653, 0.716809200968846, 0.7191998861132259, 0.7213511031829615, 0.7232728538281467, 0.7249777446977164, 0.7264802455139148, 0.7277960130246166, 0.7289412974374408, 0.729932440311045 ], [ 0.680500054846757, 0.6773226397000813, 0.6743236192605704, 0.671509988565175, 0.6688739928058676, 0.6663942631891089, 0.6640387634837607, 0.6617693647961073, 0.6595476102491791, 0.6573410262460265, 0.6551292174714773, 0.6529089644471744, 0.6506976235678807, 0.6485342983189116, 0.6464784922868958, 0.6446062537393439, 0.6430041544451315, 0.6417617717585995, 0.6409636028033632, 0.6406814641054576, 0.6409683665180343, 0.64185459537259, 0.6433463207713667, 0.6454266136432892, 0.648058365558861, 0.6511883924597227, 0.6547519747697735, 0.658677217996859, 0.6628888381967334, 0.6673112070942221, 0.671870673077082, 0.6764972794484498, 0.6811260328311841, 0.6856978538601468, 0.690160296564235, 0.694468075464477, 0.6985834049140676, 0.7024761388470528, 0.7061236991940608, 0.7095107923359082, 0.7126289287879846, 0.7154757765391228, 0.7180543896747227, 0.7203723595918314, 0.7224409362942124, 0.7242741629408522, 0.7258880594563797, 0.7272998820809943, 0.728527476515602, 0.7295887337536737 ], [ 0.6762242996735824, 0.6727751841455569, 0.6695246771051001, 0.6664812470882462, 0.6636366075089063, 0.6609668431374787, 0.6584356182316187, 0.6559992758007306, 0.6536133382663311, 0.6512396797324546, 0.6488535000560378, 0.6464492078187009, 0.6440444086048975, 0.6416813812523214, 0.6394256921477879, 0.6373619321276834, 0.6355869408278286, 0.6342012669368612, 0.6332999294119642, 0.6329637080144823, 0.633252130818853, 0.6341990247029647, 0.6358110114980782, 0.638068791846941, 0.6409306062496909, 0.6443370084552664, 0.6482160662717544, 0.6524882772005342, 0.657070760235441, 0.6618805629353939, 0.6668371336998811, 0.6718641236057643, 0.6768907075541997, 0.6818525798696092, 0.6866927191819749, 0.6913619592146111, 0.6958193621336525, 0.700032374136554, 0.7039767456424423, 0.7076362135331123, 0.7110019625998704, 0.714071901492377, 0.7168498012767613, 0.719344350757271, 0.7215681823176987, 0.7235369165571115, 0.7252682652044256, 0.7267812214372844, 0.7280953562433528, 0.729230229881858 ], [ 0.6716874286247044, 0.6679461135025823, 0.6644256325677877, 0.6611362696216472, 0.6580693098678978, 0.6551981261400371, 0.6524816551869527, 0.6498700675397421, 0.647312084492649, 0.6447631149267797, 0.6421932214896751, 0.6395938978745619, 0.6369827377774744, 0.6344052809120239, 0.6319336147892759, 0.6296616819919674, 0.62769767473916, 0.6261543485106341, 0.6251384725550118, 0.624740849059277, 0.6250282800883721, 0.6260385125446541, 0.6277786142271359, 0.630226582278546, 0.6333354417096405, 0.637038794514552, 0.6412567717530113, 0.6459015652948223, 0.650882056016011, 0.6561073893355172, 0.6614895927808087, 0.6669454528320412, 0.6723978838366761, 0.6777769691748528, 0.6830207768463038, 0.688075981056194, 0.6928982758009931, 0.6974525496028774, 0.7017127969019061, 0.7056617616758007, 0.7092903331484455, 0.7125967348468119, 0.7155855627304251, 0.7182667343813425, 0.7206544100138986, 0.7227659391407824, 0.7246208762719358, 0.7262400970436694, 0.7276450342901243, 0.7288570428942108 ], [ 0.6668821689127399, 0.6628268651048809, 0.6590167700940339, 0.6554643928321587, 0.6521607407259474, 0.6490763260821438, 0.6461649131088306, 0.6433698059646068, 0.6406320687869237, 0.6378997403989034, 0.6351369171270937, 0.6323315452857028, 0.6295008751910637, 0.6266937530114682, 0.623989245672812, 0.6214915016822719, 0.6193212384421719, 0.6176047730742859, 0.6164619846642009, 0.6159948757943677, 0.6162783642638875, 0.6173545341177438, 0.6192308854157791, 0.6218823347657121, 0.6252560641648568, 0.6292779681284342, 0.6338594588039337, 0.6389036794026931, 0.6443105978135087, 0.6499808531641621, 0.6558185084676607, 0.6617329911270037, 0.6676405038624189, 0.6734651129504418, 0.679139621402332, 0.6846062501724071, 0.6898170993987833, 0.6947343460155372, 0.6993301454595611, 0.703586231394712, 0.7074932370112444, 0.7110497864449699, 0.7142614209686241, 0.7171394308674536, 0.719699661537896, 0.7219613536656347, 0.7239460649364037, 0.7256767069292926, 0.7271767174244437, 0.7284693765130165 ], [ 0.661802244974029, 0.657409822498717, 0.65328926412114, 0.6494557926003, 0.645900345096177, 0.6425904499422286, 0.6394742417084706, 0.6364874159912105, 0.63356244573631, 0.6306389973943456, 0.6276742668857304, 0.6246519206945144, 0.621588452026835, 0.6185360072877152, 0.6155810812912718, 0.6128389223206017, 0.6104440343526941, 0.608537777711993, 0.6072546437594868, 0.6067091449726799, 0.6069852514817241, 0.6081298447434189, 0.6101508343488736, 0.6130196307122915, 0.616676876459005, 0.6210399324499617, 0.6260106499569618, 0.6314823355956275, 0.6373453372702163, 0.643491159198015, 0.6498153344332102, 0.6562194147032037, 0.6626124170565661, 0.6689119619948005, 0.6750452132684132, 0.6809496295530926, 0.6865734820620518, 0.691876079129885, 0.6968276568628053, 0.7014089286194205, 0.7056103218682491, 0.7094309598331952, 0.7128774630020721, 0.7159626515239619, 0.7187042256209413, 0.7211234903306792, 0.7232441762514491, 0.7250913921182974, 0.7266907299549773, 0.7280675304660912 ], [ 0.6564425936972513, 0.6516885356458654, 0.6472353999589366, 0.64310170231531, 0.6392785860659528, 0.6357305071197645, 0.6323995077699662, 0.629212887144265, 0.6260935136782769, 0.6229715769223179, 0.6197963254994325, 0.6165463029938013, 0.6132367366019782, 0.6099230011041085, 0.6066994454798943, 0.6036933433884402, 0.601054334576796, 0.5989404374631614, 0.5975024133522401, 0.596868739679678, 0.5971334815474918, 0.598348826524457, 0.6005230609978648, 0.6036236098207285, 0.6075838051238004, 0.6123115733954454, 0.6176983021157971, 0.6236266297662881, 0.6299765475683924, 0.6366297739256161, 0.6434727258140372, 0.6503985405104356, 0.6573085515123328, 0.6641134812793144, 0.6707344593385153, 0.6771038576109591, 0.6831658744856379, 0.6888767907162519, 0.6942048469391645, 0.6991297352450082, 0.7036417399873974, 0.7077405959789972, 0.7114341512556324, 0.7147369268283184, 0.717668659956996, 0.7202529041292952, 0.7225157417171152, 0.7244846471809108, 0.7261875218123057, 0.7276519066325663 ], [ 0.650799603670702, 0.6456579677323827, 0.6408488229074776, 0.6363946600147853, 0.6322871871940199, 0.6284877461117749, 0.6249318269171816, 0.6215375028720295, 0.6182169454778632, 0.6148896571253423, 0.6114957724110385, 0.6080077477497148, 0.6044389263613417, 0.6008477579199237, 0.5973368342650611, 0.5940464006597147, 0.5911426661289387, 0.5888020608953145, 0.5871934418123655, 0.5864608672999947, 0.5867096588144503, 0.5879978733881281, 0.5903341306685023, 0.5936813315554479, 0.5979646457532549, 0.6030815863691273, 0.6089121128651657, 0.6153273227288658, 0.6221960873487942, 0.6293896687890349, 0.6367847624017785, 0.6442655298934533, 0.6517250984612042, 0.6590668154812044, 0.6662053598731621, 0.6730676769087923, 0.6795936402376705, 0.6857363435058706, 0.6914619616836991, 0.6967491754610529, 0.7015882025978474, 0.7059795173069304, 0.7099323588273313, 0.7134631343575779, 0.7165938131066765, 0.7193503918655973, 0.7217614923822339, 0.7238571302374923, 0.725667676126231, 0.7272230147379769 ], [ 0.644871379777047, 0.639314770655462, 0.6341248183142624, 0.6293287875191801, 0.624919406773941, 0.620854921895091, 0.6170638241358963, 0.6134540961867023, 0.6099260431040108, 0.606387162279098, 0.6027671819746121, 0.5990313758930302, 0.5951904616117435, 0.5913057104158779, 0.5874882892963862, 0.5838923669769543, 0.5807022328470706, 0.5781146252556875, 0.5763185029766001, 0.575475299226881, 0.5757028863627611, 0.5770658162533058, 0.5795729869876071, 0.5831821726339027, 0.5878094416843856, 0.5933408333447073, 0.5996438541662105, 0.6065771498738649, 0.6139976865624288, 0.6217655829278035, 0.6297471890266354, 0.637817107183889, 0.6458597094376783, 0.653770465002779, 0.661457163750124, 0.6688409692681716, 0.6758571716878249, 0.6824555192412691, 0.688600059017381, 0.694268482991466, 0.6994510344651748, 0.7041490714446074, 0.7083734041433735, 0.7121425259389204, 0.7154808455471942, 0.7184170083139134, 0.7209823711332873, 0.7232096722196654, 0.7251319161440486, 0.7267814774778504 ], [ 0.6386580342091387, 0.6326575911668562, 0.6270606253516614, 0.6219001049490698, 0.6171703477022545, 0.6128265978183437, 0.6087899266353788, 0.6049573347319778, 0.6012160184082763, 0.5974600449911671, 0.5936073146782039, 0.5896146826447602, 0.5854893604641431, 0.5812950675722498, 0.5771517993344027, 0.5732285857853897, 0.5697293744845396, 0.5668732522099776, 0.5648714793823684, 0.5639048538795246, 0.5641052430485299, 0.5655443897612202, 0.5682314044471751, 0.5721182614880684, 0.5771108966366689, 0.5830827306902058, 0.5898877336099577, 0.5973711553914207, 0.6053772541488999, 0.613754305207942, 0.6223576727934667, 0.631051792744511, 0.6397117055024472, 0.6482244716919928, 0.6564905311654309, 0.6644248962654928, 0.6719580095181932, 0.679036118807181, 0.6856210914401832, 0.6916896683459947, 0.697232227864778, 0.7022511739789137, 0.7067590844132727, 0.7107767535227558, 0.7143312494601141, 0.7174540811914121, 0.7201795439064979, 0.7225432851808897, 0.7245811113276676, 0.7263280349443484 ], [ 0.632162004581187, 0.6256874094342153, 0.6196557872830516, 0.6141068841999059, 0.609037307044101, 0.6043994862796142, 0.6001066931622124, 0.5960440388976076, 0.5920843029477563, 0.5881065934588112, 0.5840154301855187, 0.5797578664905075, 0.5753365740561205, 0.5708172043999614, 0.5663287285387103, 0.5620559365706093, 0.558224062726958, 0.5550767245280649, 0.5528498889518606, 0.5517459241003857, 0.5519123045351366, 0.5534287415648863, 0.5563044812784921, 0.5604849501898412, 0.5658648215161461, 0.572303667690626, 0.5796407829939172, 0.5877070506980283, 0.5963332070789479, 0.6053549749762627, 0.6146160764906854, 0.6239701496403007, 0.6332822975412619, 0.6424306131361959, 0.6513077025459953, 0.6598220438161312, 0.6678989645125588, 0.6754810631841007, 0.6825279884083897, 0.6890155850281432, 0.6949344950282071, 0.7002883494305415, 0.7050917072215755, 0.7093678932326148, 0.713146866815147, 0.7164632245912852, 0.7193544095451938, 0.7218591694397161, 0.7240162824621487, 0.725863548227727 ], [ 0.6253883992194482, 0.618407911391026, 0.6119125408350511, 0.6059500450424291, 0.6005201696988091, 0.5955728329388766, 0.5910131844476856, 0.5867135371875907, 0.5825308902168463, 0.5783277660211302, 0.5739936231454836, 0.5694641778864709, 0.5647363606919207, 0.5598770723132437, 0.5550242693904439, 0.5503793303450758, 0.5461904329011769, 0.5427280431875176, 0.5402554551750606, 0.5389990493223492, 0.5391237087955624, 0.5407179845771072, 0.5437911728457698, 0.5482813237596804, 0.5540706150323123, 0.5610034551934131, 0.5689032734945726, 0.5775855962463925, 0.586866819871356, 0.5965694005663842, 0.6065247470799725, 0.6165750426951091, 0.6265748162409189, 0.6363926039951915, 0.6459126720524323, 0.6550365692002276, 0.6636842400166828, 0.6717944937118578, 0.6793247370592179, 0.686249993482675, 0.692561318014704, 0.6982637695651389, 0.7033741195288449, 0.707918467002202, 0.7119299052792125, 0.7154463505055914, 0.7185086080136219, 0.7211587193331059, 0.7234386056056256, 0.7253890020637804 ], [ 0.6183453688774982, 0.6108258956161743, 0.6038362469367762, 0.5974335974556181, 0.5916218507813733, 0.5863488496488884, 0.5815113800511568, 0.5769680636894438, 0.5725587142577049, 0.5681275557092046, 0.5635471829488516, 0.5587402872855894, 0.5536966770676117, 0.5484836272954162, 0.5432479169554612, 0.5382082320430452, 0.5336373488456683, 0.5298350231661775, 0.5270947197843967, 0.5256695319699145, 0.5257437657395885, 0.5274157917956648, 0.5306948649998064, 0.5355107460564955, 0.5417317770895793, 0.5491858031613636, 0.5576791561197142, 0.5670110053554986, 0.5769825931828084, 0.5874023940843801, 0.5980888176766249, 0.6088719081920031, 0.6195949498483315, 0.6301163023637782, 0.6403113636104791, 0.6500743484927652, 0.6593195531291659, 0.6679818698778602, 0.6760164596908661, 0.6833976214025244, 0.6901169948405752, 0.696181288074854, 0.7016097332972053, 0.7064314611727965, 0.7106829514572609, 0.7144056780540915, 0.7176440266722346, 0.7204435273552393, 0.7228494147111026, 0.7249055064003167 ], [ 0.6110445029627251, 0.6029517145315888, 0.5954358644360137, 0.5885651334968943, 0.5823487913761822, 0.5767332016208984, 0.5716066474079222, 0.5668132031559738, 0.562174069293098, 0.557513388061276, 0.5526849789353384, 0.547596672034, 0.5422295842571179, 0.5366502720398011, 0.5310139598151146, 0.5255572050476272, 0.5205789967125298, 0.5164109245951851, 0.5133796954946034, 0.5117680963201965, 0.5117821095181232, 0.5135310323132333, 0.5170239858835987, 0.522181440552714, 0.5288564530808932, 0.5368588251511249, 0.5459765254256564, 0.5559913680536462, 0.5666886394576638, 0.5778621204016116, 0.589316520829177, 0.6008690318749645, 0.6123509872321103, 0.6236099186008175, 0.6345118069089649, 0.6449431219270673, 0.6548122523227703, 0.664050062558537, 0.6726094861876499, 0.6804642188548198, 0.6876066805864696, 0.6940454705885346, 0.6998025469077921, 0.7049103413959188, 0.7094089809565538, 0.7133437400294229, 0.7167628043189176, 0.7197153864597765, 0.7222502027547201, 0.724414296760368 ], [ 0.6035012467996137, 0.5947997483255929, 0.5867244673386626, 0.579356371351932, 0.5727115120757872, 0.5667355544762666, 0.5613082693237409, 0.5562583898414609, 0.551387075733691, 0.546496556117586, 0.5414198729817646, 0.5360480217257966, 0.5303516656379255, 0.5243953071428316, 0.5183419813228829, 0.5124464710130661, 0.5070355012672786, 0.5024751138291489, 0.49912855449186216, 0.49731158640783457, 0.4972543906172581, 0.4990784458244584, 0.5027926534931332, 0.5083071032019947, 0.5154580062070302, 0.5240355668250711, 0.5338081036583104, 0.5445390921626999, 0.5559970828923616, 0.5679604575585417, 0.5802195101826291, 0.5925778321926758, 0.60485406307709, 0.6168842234257623, 0.6285243102408252, 0.6396526342477259, 0.6501714288153304, 0.6600074403496874, 0.6691114193647375, 0.6774566065350093, 0.6850364221025604, 0.6918616189066125, 0.6979571615022153, 0.7033590631692779, 0.7081113647610265, 0.7122633863709962, 0.7158673327065406, 0.718976290311184, 0.7216426212131113, 0.7239167332875047 ], [ 0.5957353343972212, 0.5863889080713899, 0.5777198044889337, 0.5698237530217833, 0.5627252280324941, 0.5563701866294501, 0.5506300363585047, 0.545317466736394, 0.540212198589264, 0.535092697206775, 0.5297691619265411, 0.5241136617339167, 0.5180844534537509, 0.5117423851890233, 0.5052573628520842, 0.4989024755756696, 0.4930335554185694, 0.48805374621636216, 0.48436634585743343, 0.48232369739552655, 0.4821830029854436, 0.4840793512953657, 0.48802135481891973, 0.4939075432733002, 0.5015556137455323, 0.5107345545283727, 0.5211917415020852, 0.5326713579426352, 0.5449244700895202, 0.5577133649093373, 0.5708131867384327, 0.5840131448739518, 0.5971184012401244, 0.6099527513610133, 0.622361626443689, 0.6342147666028035, 0.6454080186162008, 0.65586394633113, 0.6655311910038111, 0.6743827153242661, 0.6824131848500473, 0.6896357883124404, 0.6960787913611338, 0.7017820773310771, 0.7067938714088077, 0.7111677841912949, 0.7149602552603784, 0.7182284312839697, 0.7210284777447789, 0.7234142983694876 ], [ 0.5877712285308785, 0.577743161861443, 0.5684448982200435, 0.5599890951821633, 0.5524105279051517, 0.545656671695577, 0.5395909103262297, 0.5340093120678251, 0.5286688248461527, 0.5233223168107404, 0.5177550528782024, 0.5118179948613502, 0.5054548602667635, 0.4987209602086655, 0.4917917783529648, 0.4849584473793086, 0.4786070500997354, 0.47318045874069264, 0.46912573182503176, 0.46683573199594514, 0.46659783901975765, 0.4685623833749119, 0.4727376505669511, 0.479009346412329, 0.4871748817666807, 0.4969803586934514, 0.5081509304666925, 0.5204105815284525, 0.5334921867147053, 0.5471412542798484, 0.5611170248793518, 0.5751935039207737, 0.5891615513719937, 0.6028319947899258, 0.616039107525046, 0.6286436559967937, 0.6405348917810056, 0.651631162335345, 0.6618791061704742, 0.6712516152172975, 0.679744870361308, 0.6873747967907983, 0.6941732674339892, 0.7001843298512659, 0.7054606644856323, 0.7100604139998974, 0.714044462740077, 0.7174741960279349, 0.7204097319472065, 0.7229085927506864 ], [ 0.5796385565910043, 0.5688920742460689, 0.5589286751208447, 0.5498802898073224, 0.5417941167788287, 0.5346206340246739, 0.5282157642392666, 0.5223585396443281, 0.5167819065759046, 0.5112113653161404, 0.5054051750423241, 0.49919096135969776, 0.4924956111599147, 0.4853667235289618, 0.47798366682127835, 0.4706549339911794, 0.4637976870756185, 0.45789705604299274, 0.4534477284733138, 0.4508873698237696, 0.45053706211815414, 0.4525642474949714, 0.45697689720670004, 0.46364655224746615, 0.4723484710999047, 0.4828041653322204, 0.49471532056750395, 0.5077848810812673, 0.5217268741790985, 0.5362693581314002, 0.5511548920791197, 0.5661414129324597, 0.5810046128615209, 0.5955415830122036, 0.6095748428471461, 0.6229557977917195, 0.6355669250309868, 0.6473223575439156, 0.6581668732591655, 0.6680735316154289, 0.6770403227778623, 0.685086224991715, 0.6922470331585041, 0.698571255290799, 0.7041162949813303, 0.7089450618034864, 0.7131230856204701, 0.716716158443123, 0.7197884890828532, 0.7224013300612574 ], [ 0.5713725265108424, 0.5598713446653988, 0.5492066174027105, 0.5395320468330967, 0.5309096194732494, 0.5232945776286188, 0.5165362020556221, 0.5103962784800438, 0.5045826761231854, 0.498791873607321, 0.4927531321380915, 0.4862685178754515, 0.4792456722091346, 0.4717220155078258, 0.463878666204652, 0.45604029368747134, 0.44865555159794823, 0.4422541673674412, 0.43738243086878376, 0.4345274327258593, 0.4340478824850687, 0.4361304812823236, 0.440782975322813, 0.4478613365151247, 0.45711672533693604, 0.4682443470872195, 0.48092123530051, 0.4948285379802293, 0.5096608387964796, 0.5251280871738746, 0.5409553547360332, 0.5568835993215255, 0.5726724389879404, 0.5881044397258314, 0.6029897750198376, 0.6171701262269186, 0.6305210535552359, 0.642952518038171, 0.65440761711652, 0.6648598469544519, 0.6743093229430198, 0.6827784058191295, 0.690307131760276, 0.6969487633535266, 0.7027656881070832, 0.7078258068050656, 0.7121994830040188, 0.7159570699401453, 0.7191669916932386, 0.7218943297119373 ], [ 0.5630143021175754, 0.5507233247276798, 0.5393214171029228, 0.5289866650077265, 0.5197984351216132, 0.5117187841365503, 0.5045914580078532, 0.4981610346298637, 0.49210943824732173, 0.48610265287432947, 0.47983909951043696, 0.4730931360653307, 0.4657506704173233, 0.4578362010733492, 0.44952998888971957, 0.4411711167351749, 0.4332396149459437, 0.4263118444576946, 0.420989695474176, 0.4178146228678364, 0.4171873167030337, 0.41931620571147377, 0.4242090098310944, 0.4317046848470033, 0.4415282892378542, 0.45334702315458186, 0.46681217389286744, 0.4815824434188985, 0.4973324439323501, 0.5137533680035327, 0.5305519608303513, 0.5474512424456466, 0.5641938128916274, 0.5805469113744745, 0.5963077869369896, 0.6113080674594118, 0.6254162975415808, 0.6385383538031839, 0.650615872565974, 0.6616230856699866, 0.6715625685926004, 0.6804604026043083, 0.6883611843047496, 0.6953232180318213, 0.7014141242386362, 0.7067070044829558, 0.7112772279250585, 0.7151998468999462, 0.7185476090508948, 0.7213895081273535 ], [ 0.5546113114948208, 0.5414974869954547, 0.5293236072164579, 0.5182948086489754, 0.5085106258548989, 0.4999422682684242, 0.4924293693601609, 0.4856996335991373, 0.47940844092243784, 0.4731900621609661, 0.4667104692613738, 0.4597143214039606, 0.45206329988059807, 0.44376599542842404, 0.4349987153397648, 0.42611254377584096, 0.4176181287192734, 0.4101400611223538, 0.4043397434689135, 0.4008182022683563, 0.40002290493278725, 0.40218684412482225, 0.4073180633916451, 0.41523704190961824, 0.42564070296349577, 0.4381665947430342, 0.4524392883038198, 0.468094518330788, 0.4847864732938436, 0.5021869491044535, 0.5199834880922072, 0.5378801649739214, 0.5556015856242711, 0.5728988578137464, 0.5895557527376148, 0.6053935592456753, 0.6202737588072442, 0.6340982796519765, 0.6468075557125506, 0.6583768806068135, 0.6688116393099742, 0.678141974947877, 0.6864173578885799, 0.6937014089475991, 0.7000672137355656, 0.7055932648999103, 0.7103600889621838, 0.714447555291535, 0.7179328244337265, 0.7208888683176473 ], [ 0.5462174555689993, 0.532250809392448, 0.5192721335607654, 0.5075162567766001, 0.497105811118665, 0.48802376874820697, 0.4801074071808606, 0.47306823408682697, 0.46653482073105595, 0.46010884326612445, 0.45342254448005026, 0.44618915163825223, 0.4382437082218552, 0.42957572474204697, 0.4203539789036927, 0.4109384424976178, 0.40186886343972367, 0.39381906399582584, 0.387513637165623, 0.38361857214815254, 0.38263335109100693, 0.38481878053562496, 0.390183779085859, 0.39852891532546914, 0.4095209539116147, 0.422766239414671, 0.43786181929194995, 0.4544200915185808, 0.47207445061132614, 0.49047666090709213, 0.5092941440841339, 0.5282109749668434, 0.5469327651732839, 0.5651936958303909, 0.5827635449339448, 0.5994530311404787, 0.6151165828608204, 0.6296523666259854, 0.6429999105651135, 0.6551359191641039, 0.6660689450974561, 0.6758335314852477, 0.6844843235063642, 0.6920905146154593, 0.6987308654888517, 0.704489426174414, 0.7094520081394519, 0.7137033924562393, 0.7173252202448295, 0.7203944878176104 ], [ 0.5378931775099243, 0.5230480296481197, 0.5092348186708585, 0.49672057658170715, 0.48565402378691563, 0.476032737521066, 0.46769373590518615, 0.46033339190788963, 0.45355360918250054, 0.4469230155118439, 0.44003927898949136, 0.4325828317072713, 0.42435985588126895, 0.4153375051210673, 0.4056730116397855, 0.3957313975193422, 0.38607913406107985, 0.37743951112998675, 0.3706035677782118, 0.36630769750354913, 0.3651090405428694, 0.36729992013516094, 0.3728909418104682, 0.3816614084558648, 0.39324596331272876, 0.4072183434063408, 0.42314747183278145, 0.44062221704183674, 0.45925489745164966, 0.47867661252843785, 0.49853370208959735, 0.5184891442508036, 0.5382285440583157, 0.5574683852796609, 0.5759639895979868, 0.5935153390358656, 0.609969881863496, 0.6252222606660073, 0.6392114287909322, 0.6519158677453865, 0.6633476576697237, 0.6735460690501567, 0.6825712033123083, 0.6904980575037202, 0.6974112491675281, 0.7034005231389676, 0.7085570751687312, 0.7129706661218493, 0.7167274610424115, 0.7199085050538939 ], [ 0.5297053473231241, 0.5139617139074409, 0.49928865455681726, 0.48598765524545917, 0.4742364641375714, 0.46405026947138894, 0.45526825267445836, 0.44757313514455527, 0.4405407712543719, 0.43370681108657194, 0.42663405060339793, 0.41896925667950924, 0.410487838051365, 0.4011313215477401, 0.39104101871089314, 0.3805824632933717, 0.3703455454771653, 0.36110232123253083, 0.35371287662738554, 0.3489893065033927, 0.34755237631937214, 0.34973010420909556, 0.3555359194628451, 0.3647266492782869, 0.37690297874489836, 0.39160484549782004, 0.40837270499202183, 0.4267719071640866, 0.4463935067234094, 0.4668473043593448, 0.48775755404923127, 0.5087650068310469, 0.5295342519939871, 0.5497633470975002, 0.5691927614226405, 0.5876116480666325, 0.6048606143121492, 0.620831065761073, 0.6354617408288499, 0.6487332734575963, 0.6606616238989711, 0.671291097979998, 0.6806875072134092, 0.6889318509405357, 0.6961147512683685, 0.702331751312362, 0.707679498163186, 0.7122527707685624, 0.7161422745883208, 0.7194331042335452 ], [ 0.5217269112280498, 0.5050720738097927, 0.4895198455774809, 0.47540800309585324, 0.4629460626412723, 0.45216988763848953, 0.4429235302341421, 0.4348779861315316, 0.4275842250783337, 0.4205456132462107, 0.41329044191858477, 0.40543156487954274, 0.3967121539157881, 0.3870449865649024, 0.3765508482290225, 0.3655906274487004, 0.3547733840796596, 0.3449181434099277, 0.3369557145063815, 0.3317787759065975, 0.3300778583907706, 0.3322213182743811, 0.3382269343031967, 0.3478280736639023, 0.36058983579453635, 0.37601745871265346, 0.39362290472862205, 0.41294825133854896, 0.43356320460099235, 0.45505563193362464, 0.47702665917139203, 0.4990936594955321, 0.520899219369541, 0.5421223023306591, 0.5624882107722463, 0.5817752584342267, 0.5998174178807126, 0.6165031893933761, 0.6317714771430577, 0.6456054424809234, 0.6580252612354344, 0.6690805536223173, 0.6788430589782565, 0.6873999381031697, 0.6948479252179416, 0.7012884264225534, 0.7068235710338862, 0.71155316152963, 0.7155724310688291, 0.7189704988804134 ], [ 0.5140362535001114, 0.4964664587164913, 0.48002350773164765, 0.4650827183493853, 0.4518877330290005, 0.4404980649696521, 0.43076555153025775, 0.4223518311572279, 0.4147847599612528, 0.40753683242654176, 0.40010298100125735, 0.3920626479865206, 0.3831258990653613, 0.37317395590510744, 0.3623024252700128, 0.35086193466774185, 0.3394755801859919, 0.32900634859990446, 0.32045622792843276, 0.3148025940065295, 0.3128118113782004, 0.3148976158460228, 0.32108410122940484, 0.3310805095765485, 0.3444150414961506, 0.36055772657623925, 0.37899239974505644, 0.3992383847930936, 0.42084406825564513, 0.4433747527581841, 0.46640736454092635, 0.48953474567476396, 0.5123765371253496, 0.5345920217667014, 0.5558911156162047, 0.5760413696132529, 0.5948703927637001, 0.6122641489209704, 0.6281620991035978, 0.6425502951085512, 0.6554534353862385, 0.6669266944590959, 0.6770479123187431, 0.6859105235347178, 0.6936174359304748, 0.7002759398310661, 0.7059936378658395, 0.710875325871493, 0.7150207206865968, 0.7185229141790114 ], [ 0.5067162212443188, 0.48823844686968304, 0.47090291930864964, 0.4551229821443154, 0.4411781655635685, 0.4291543242578054, 0.41891408026948673, 0.41011249397791166, 0.4022567273097319, 0.3947906172563216, 0.38717776271085963, 0.3789655613480681, 0.3698308429006745, 0.3596209744076987, 0.3484019241780821, 0.33650823199680246, 0.32457117568498134, 0.3134934452541517, 0.30434715136729357, 0.29819727488054854, 0.29589164568895476, 0.29789466094275213, 0.30423915244919975, 0.3146099931566373, 0.3284976181118328, 0.3453368583274752, 0.36458427031494955, 0.3857372624581041, 0.4083230613128966, 0.4318837844378621, 0.4559710724699798, 0.48015210337952363, 0.504022699261335, 0.5272219769075795, 0.5494443526013185, 0.5704467797584, 0.5900508340903856, 0.6081403385814611, 0.6246556998279252, 0.6395861981246954, 0.6529613210514126, 0.6648419876561413, 0.6753122576939664, 0.6844718978486158, 0.6924299993836428, 0.6992997103257064, 0.7051940546539861, 0.7102227533592722, 0.7144899298669166, 0.7180925683173035 ], [ 0.49985277215833723, 0.4804864643959173, 0.4622682145086169, 0.445648937331107, 0.4309449818401761, 0.41827071721965914, 0.40750246240838045, 0.3982918157552179, 0.39012832557096266, 0.3824302476002276, 0.3746328282147806, 0.36625374418816137, 0.35693733186619025, 0.34649551971764475, 0.3349606632060736, 0.3226455189727226, 0.31018325803907426, 0.2985108418791902, 0.2887676900033763, 0.282107588466179, 0.279464519024643, 0.281358771425359, 0.2878347468993086, 0.29855322751296515, 0.312966627616391, 0.33047527222457995, 0.35050988831613494, 0.3725471858796585, 0.3960935440735338, 0.42066730017045173, 0.4457937290381263, 0.4710132590564291, 0.4958971159732799, 0.5200638850831029, 0.5431924835511681, 0.5650295189601484, 0.5853909135253846, 0.6041587580502058, 0.6212747762953996, 0.6367317759351179, 0.6505642470745611, 0.6628389832576959, 0.6736463208875056, 0.6830923565004225, 0.6912923179325824, 0.6983651328621304, 0.704429148861263, 0.7095989038718348, 0.7139828163630468, 0.7176816530496896 ], [ 0.49353322374336006, 0.473311877991758, 0.4542344221735756, 0.43678780321988625, 0.4213250554662207, 0.40799045021274905, 0.3966766061603858, 0.3870349873934963, 0.37854123961283387, 0.3705919969109202, 0.3625981258660362, 0.35405091524623816, 0.3445639305606016, 0.3339130027452152, 0.3220937205419608, 0.3093919232580657, 0.29643637296360376, 0.284191928932461, 0.2738606108550467, 0.26668398144492567, 0.2636852568320985, 0.26544532590456044, 0.2720232385974597, 0.28305657027016645, 0.29796027507275974, 0.31610175860560874, 0.3368881146210126, 0.35977702365868947, 0.3842545124263878, 0.40981458748039534, 0.4359551099622506, 0.46218875194909737, 0.4880614885577697, 0.5131711445859864, 0.537181256438697, 0.5598284173102089, 0.5809233120229672, 0.6003467049189868, 0.6180419751267291, 0.6340057026633613, 0.6482775279484141, 0.6609301786668929, 0.6720602547104191, 0.6817801137208588, 0.690211012234628, 0.6974775249424869, 0.7037031773369186, 0.7090071746843666, 0.7135020835833312, 0.7172923137281766 ], [ 0.48784411098517066, 0.4668165393443341, 0.44691878271367097, 0.4286711011750212, 0.4124618104856868, 0.3984654122115185, 0.38659285675731964, 0.3764988329022879, 0.3676493369800022, 0.35942418855538116, 0.351214815762754, 0.3424904573016206, 0.33283667714222454, 0.3219936725637771, 0.3099182904523372, 0.2968653756983642, 0.2834535089373158, 0.27066854376335403, 0.2597685379589678, 0.2520791108999632, 0.24871340420666396, 0.25031638652584, 0.2569647544160346, 0.2682744085629453, 0.28362446500482186, 0.30235215711829466, 0.3238440700755137, 0.34754106209068797, 0.37290951979809106, 0.39941863914961906, 0.4265378844261812, 0.4537512784984219, 0.4805790419866806, 0.5065981599112575, 0.5314570233622206, 0.5548826114955159, 0.5766808078097669, 0.5967314350289415, 0.6149798155636038, 0.6314264782471417, 0.6461162841989299, 0.6591278754639323, 0.6705640254705365, 0.6805432129053216, 0.6891925507974137, 0.6966420714168368, 0.7030202832009963, 0.7084508668834351, 0.7130503544955027, 0.7169266290724625 ], [ 0.48286869816989253, 0.4610998088278149, 0.4404373333121008, 0.42143092326914267, 0.4045013574621151, 0.38985239064136895, 0.3774144891467673, 0.36684872615001024, 0.357616087625086, 0.3490851214221836, 0.3406336252300915, 0.33171405252729713, 0.32188779187049144, 0.31086116059014646, 0.2985518206242113, 0.2851811242841693, 0.27135285598258446, 0.2580670209333596, 0.24662958493079376, 0.2384435168587355, 0.2347093368033687, 0.23613740164215127, 0.2428244171049796, 0.2543667567327008, 0.27011066483253543, 0.2893674309722478, 0.3115073930804244, 0.33595742545086504, 0.3621652427378203, 0.389574853125224, 0.41762644558659856, 0.4457746538378236, 0.47351361755072446, 0.5003995624857926, 0.5260660821916798, 0.5502309967538486, 0.5726958259513343, 0.5933397962270143, 0.6121103943380701, 0.6290121923745656, 0.6440952547285764, 0.6574440309967854, 0.6691672961108255, 0.6793894349341492, 0.6882431782850407, 0.6958637685761645, 0.7023844523574848, 0.707933151618038, 0.7126301454897865, 0.7165865909675179 ], [ 0.47868423685842526, 0.4562551515844768, 0.43490083660111284, 0.4151952759838671, 0.3975874311828407, 0.3823078557022178, 0.3693066159862237, 0.35825386966564254, 0.3486103907877145, 0.33973953165506815, 0.33101193615668084, 0.3218692970840478, 0.31185364912250974, 0.30064058830484086, 0.28810999268659754, 0.2744492932187571, 0.26024466480802344, 0.24650420745301532, 0.23457265976726685, 0.22592063812113478, 0.2218294767292686, 0.22307290653648967, 0.22976856044685035, 0.24149590664789838, 0.25757292558816125, 0.2772910248949336, 0.30000990723644133, 0.32514601927515613, 0.35212966546276614, 0.3803794321239463, 0.4093055087658763, 0.4383325977041292, 0.46692863614880614, 0.4946293385283942, 0.5210539531749403, 0.5459116343471226, 0.5689999581945193, 0.5901978427305878, 0.6094550782238612, 0.6267802808454541, 0.6422286047001324, 0.6558901075137974, 0.6678793081423472, 0.678326206045783, 0.6873688438149996, 0.6951473684706178, 0.7017994703414483, 0.7074570367183747, 0.7122438406010092, 0.7162740845894512 ], [ 0.4753591108932099, 0.45236647474627756, 0.43041023633560904, 0.4100826726423216, 0.3918552615079368, 0.37598137186408015, 0.3624294779001911, 0.3508808086419449, 0.3408006017793006, 0.33155332834515205, 0.3225093221959397, 0.3131060357148283, 0.3028718225787895, 0.2914561618064772, 0.27870462119749884, 0.26477274041279397, 0.25022863751974334, 0.2360840022720955, 0.22371301762470064, 0.21464162519293495, 0.21022085695458004, 0.21128126177889744, 0.2179598468360511, 0.22982199798317052, 0.24616394259212018, 0.2662654270161133, 0.28948265556780955, 0.3152259799638258, 0.342909884279067, 0.371927494637642, 0.4016584950027093, 0.4314973648961355, 0.4608859523386679, 0.4893398825684767, 0.5164646066342464, 0.5419611280336707, 0.5656234640208175, 0.5873304387765708, 0.6070341910427721, 0.6247472795824421, 0.6405297329562005, 0.6544769218738191, 0.6667087646676653, 0.6773605069933791, 0.6865751305470754, 0.6944973244296421, 0.7012688802322199, 0.7070253342305406, 0.7118936664998992, 0.7159908691663899 ], [ 0.4729500526254762, 0.4495044486646882, 0.427051940547376, 0.40619631693952757, 0.38742472938744554, 0.37100795529874625, 0.356930359960769, 0.344885320977304, 0.3343467875993204, 0.3246865319281127, 0.31528139485226225, 0.3055712506386009, 0.2950770657617251, 0.2834281962649555, 0.270441545238346, 0.2562454657168705, 0.2413923154946988, 0.2268950912098344, 0.21414884659208822, 0.20472067751616813, 0.20001554329728954, 0.20090867578040156, 0.20755134615326426, 0.21949748966021423, 0.23603013382626573, 0.2564279348109016, 0.2800523222645494, 0.30631266385544675, 0.3346095703559496, 0.36431093694954386, 0.3947657380573956, 0.4253382550701322, 0.45544462953394577, 0.4845810021714237, 0.5123396625727674, 0.5384139860919164, 0.5625947658231301, 0.5847608614861316, 0.6048667026855982, 0.6229285820034809, 0.6390110832674504, 0.6532144990491123, 0.6656637168970249, 0.6764987852770267, 0.685867187899969, 0.6939177387790201, 0.7007959423736578, 0.7066406294189104, 0.7115816686644226, 0.715738559680279 ], [ 0.4714996426082234, 0.4477231113541212, 0.4248933336991681, 0.4036183828735527, 0.3843933960813447, 0.3675000027599584, 0.35293473718614543, 0.3404032049109956, 0.32939161030462805, 0.3192846758678073, 0.3094720919095985, 0.2994025444584687, 0.2885962203973851, 0.2766695664832234, 0.2634185665954006, 0.248951745013472, 0.23381083398457309, 0.21901049636738082, 0.20595972853220712, 0.19625181858851848, 0.19132569121014487, 0.19208303930458673, 0.19867989136316655, 0.21066073467641186, 0.22730589424117106, 0.24790576330904876, 0.27183716262074087, 0.29851427853621976, 0.3273261773330725, 0.357616118777337, 0.3887025755292813, 0.41992005186896586, 0.4506596767787186, 0.48039890590584594, 0.5087175871062833, 0.5353019879775335, 0.5599399526485576, 0.5825104137819437, 0.602969928229991, 0.6213382057597903, 0.6376839638588516, 0.6521119327137449, 0.6647514565927841, 0.6757468722529825, 0.6852496677284616, 0.6934123137414625, 0.7003835966322863, 0.7063052517778867, 0.711309689132877, 0.7155186098076949 ], [ 0.47103430859549206, 0.4470570764772495, 0.4239789742921793, 0.40240500667983375, 0.3828301807968317, 0.3655396938886585, 0.3505376130360582, 0.3375409093110261, 0.32605068892388056, 0.31546937490500937, 0.30520493923357067, 0.29472057734855217, 0.283542262342431, 0.2712816747119594, 0.257723451296786, 0.2429659998993752, 0.22754814719321462, 0.2124892582916081, 0.19920758498623978, 0.18930795969138123, 0.1842401519716642, 0.1849083845831867, 0.19145937105592148, 0.20342918807904956, 0.2201074488119741, 0.24081082414516575, 0.26494268916692093, 0.2919283414896921, 0.3211480331714438, 0.3519214792817726, 0.38353740667096897, 0.4153014552740259, 0.4465807961349041, 0.47683521176980853, 0.5056329136582361, 0.5326535763960164, 0.557682307861416, 0.5805980586505202, 0.6013592454384065, 0.6199885749074288, 0.6365583796584795, 0.6511772561745658, 0.6639784168313019, 0.675109906874683, 0.6847266657517042, 0.6929843064712743, 0.700034427894346, 0.706021248570681, 0.7110793462214546, 0.7153322963828949 ], [ 0.47156301302664255, 0.4475196379368491, 0.42432791660152713, 0.4025826162761529, 0.3827705247505981, 0.36517291040762956, 0.34979625153930727, 0.33636728285523115, 0.32440369708885664, 0.31332920986350954, 0.30257425818526035, 0.2916212032333442, 0.2800079731878224, 0.2673501588896018, 0.2534319691672006, 0.23835318149170442, 0.22265941055096714, 0.20738000840502574, 0.1939401244181235, 0.18394265058852546, 0.17882338234647885, 0.1794609290778231, 0.18597495244980983, 0.19789314108021344, 0.21452702312095243, 0.2352347085357342, 0.2594574911916766, 0.2866382299757225, 0.3161515035313538, 0.34729521933937463, 0.37932981707820285, 0.4115335814109427, 0.443251195546897, 0.47392601638938847, 0.5031155183599944, 0.530493296190249, 0.5558418762336825, 0.5790400859716412, 0.6000478387568977, 0.6188903233947403, 0.6356428815366814, 0.6504173267475151, 0.6633500833431379, 0.6745922677167484, 0.6843016694413395, 0.6926364891097936, 0.6997506354535351, 0.7057903613751042, 0.7108920165603039, 0.7151807056445999 ], [ 0.4730767614599467, 0.4491019853334077, 0.4259324931962355, 0.4041461049938528, 0.3842137624584109, 0.36640563010034005, 0.35072548500149797, 0.33690779516243463, 0.3244876367296884, 0.3129123553409126, 0.30163762262137056, 0.2901683802257734, 0.27805999137591125, 0.2649407076762689, 0.25060592106304447, 0.23516921703494634, 0.21919374292588822, 0.20372548836890234, 0.19019594347464489, 0.1801940832255628, 0.17511685906989913, 0.17578750800814782, 0.18227936630548794, 0.19411111297875427, 0.21062826020213107, 0.23124455074982989, 0.25544965213205395, 0.28271013705744336, 0.31239844360201446, 0.3437932029447808, 0.3761288796865146, 0.40865860860560776, 0.4407065238814828, 0.4717010656570345, 0.5011899787369956, 0.5288413008016136, 0.5544350852772978, 0.5778498224987729, 0.5990464773920916, 0.6180521253054888, 0.634944436453158, 0.6498377264099092, 0.6628709184836206, 0.6741975147743914, 0.6839775134581391, 0.6923711146580128, 0.6995340068735246, 0.7056140060657091, 0.7107488197643204, 0.7150647214998428 ], [ 0.4755489849573896, 0.451773624397867, 0.4287587206174625, 0.4070591184476992, 0.38712312178424546, 0.3692034142735109, 0.3532964412592636, 0.33914229723328043, 0.32629353929809196, 0.314222307364992, 0.30241091284663796, 0.2903890509269412, 0.2777341397394422, 0.26409545585190736, 0.24929112000012144, 0.2334609400907564, 0.21719626090316801, 0.20156648901587895, 0.18800960315487172, 0.1780899645688916, 0.1731423697215564, 0.17390666797653948, 0.18039213713341126, 0.19210794495381486, 0.2084437856526719, 0.2288804392053885, 0.25296422501541377, 0.2801907466507281, 0.30993415396684487, 0.34145722889641245, 0.3739717390912646, 0.4067086455885829, 0.4389739818451467, 0.4701830646957883, 0.499875042363314, 0.5277129450977003, 0.5534744340767835, 0.5770373943715014, 0.598363334128595, 0.6174805566089174, 0.6344683219151485, 0.6494426811769165, 0.6625442996024207, 0.6739283423209822, 0.6837563435709303, 0.6921898893483904, 0.6993858968248781, 0.7054932565992929, 0.7106506060088972, 0.7149850160042558 ], [ 0.47893676043256633, 0.45548395725411106, 0.4327482793087329, 0.41125641752398856, 0.3914283588188124, 0.3734940860562919, 0.35743893712793107, 0.34300676839948663, 0.32976726580183124, 0.3172175837314888, 0.3048669616127039, 0.29227097884906594, 0.27903284634905695, 0.26483045110121, 0.24951536329466154, 0.23326499386213262, 0.21670827388337496, 0.2009435260170871, 0.18741462815389998, 0.1776512788980866, 0.17290581012574954, 0.17381192997857633, 0.18030196466161752, 0.19187611516439984, 0.20797546418806334, 0.22815482110426863, 0.2520220995534559, 0.27910587050552954, 0.30878601672152733, 0.3403138002050481, 0.37288257061300817, 0.4057048867586574, 0.43807165445395746, 0.46938715910229223, 0.4991832277843195, 0.5271184801373348, 0.5529682605233606, 0.5766095498231165, 0.5980038503001586, 0.6171799922609544, 0.6342180474912532, 0.649235001171874, 0.662372473232657, 0.6737865438529929, 0.6836395898066703, 0.6920939520628069, 0.6993072112972347, 0.7054288328984376, 0.7105979467278344, 0.7149420422192614 ], [ 0.4831827502628601, 0.46016484711947536, 0.4378218186434772, 0.416647983815905, 0.39703061603694867, 0.37917314509393196, 0.3630471064591014, 0.34839872493757335, 0.33481426457767505, 0.3218154829102957, 0.3089380951445088, 0.295763992914597, 0.2819251453336596, 0.2671345778309412, 0.25128654516573184, 0.2346054952300751, 0.21776495851003888, 0.2018950526045293, 0.18844279959125573, 0.17889315561521732, 0.17439991255053264, 0.17547608528193726, 0.18197157716670945, 0.1933799534162799, 0.20919726057392643, 0.22905394322761155, 0.2526203600272956, 0.27946015905957494, 0.3089629140548588, 0.34037347477001756, 0.37287197788927295, 0.4056571011300605, 0.43800809824631975, 0.4693206107506527, 0.49912057393288445, 0.5270628611684728, 0.5529205948330211, 0.5765695476087029, 0.5979706508094083, 0.617152541418704, 0.6341953053518176, 0.6492160428051774, 0.6623565261207575, 0.6737729898633332, 0.6836279493719184, 0.6920838611922419, 0.6992983974775135, 0.7054210930475303, 0.710591128592028, 0.714936029563802 ], [ 0.4882176801174141, 0.46573389611036425, 0.44388319281833366, 0.42312431996066835, 0.4038087873752786, 0.3861110477621948, 0.369987290021001, 0.3551853007961348, 0.3413073791070949, 0.32789916492746174, 0.31452206558765655, 0.30078439293494813, 0.28634924814975127, 0.2709701080933064, 0.2545911711461504, 0.23749070281875112, 0.22039062013627087, 0.2044520818227459, 0.19111932691157976, 0.1818221269215458, 0.177604869333644, 0.17885521598533363, 0.1853436980705894, 0.1965616294191258, 0.2120599524788116, 0.23154091905672566, 0.2547339576588353, 0.2812378379093355, 0.3104554378559649, 0.3416308241724584, 0.3739368569831142, 0.40656347820993893, 0.43878220080319597, 0.4699826808417013, 0.49968654700734016, 0.5275456751484715, 0.5533311037564188, 0.5769171142535794, 0.5982635113884744, 0.6173980223291108, 0.6343999509549695, 0.6493856938696162, 0.6624963736840833, 0.6738876188721785, 0.6837213796610955, 0.692159589171125, 0.6993594394669476, 0.7054700299299402, 0.7106301508650773, 0.7149669817326262 ], [ 0.49396314067817876, 0.4720981182124817, 0.4508241689950998, 0.4305623086031869, 0.4116265500151443, 0.3941613058060846, 0.37810696236025965, 0.36321265879703446, 0.34909633195520373, 0.33532674641044374, 0.32149023819001854, 0.30722165347076325, 0.29221718216321063, 0.2762747852070768, 0.25939359169963067, 0.24190937830623974, 0.22459252736269494, 0.20863038685501967, 0.19545505431795848, 0.18643057143058128, 0.18248686546360815, 0.18389152531372538, 0.19034663588468476, 0.20134740807410353, 0.21649653742031186, 0.23555969008818903, 0.2583182994310923, 0.2844042786930046, 0.31323680808216364, 0.34406496910664064, 0.37606071690004617, 0.40841082879984997, 0.4403833132179348, 0.47136472144588754, 0.500874105994345, 0.5285611887404232, 0.5541951262067633, 0.5776484706649675, 0.5988793785057654, 0.6179139771961437, 0.6348300141088984, 0.6497423817284647, 0.6627907660322419, 0.6741294418208124, 0.683919101433914, 0.6923205247509406, 0.6994898598877252, 0.7055752723463562, 0.71071472616735, 0.7150346772060133 ], [ 0.5003344964181959, 0.47915769379171136, 0.45852916626457496, 0.4388310299738937, 0.4203392800626847, 0.4031684268121653, 0.3872435322391295, 0.37231540918267303, 0.3580174509082302, 0.34394094009910114, 0.3296966347769528, 0.31494623726256304, 0.2994206705280047, 0.28296511566639576, 0.26563623254587493, 0.24782777387585522, 0.2303549056564085, 0.21442241264770762, 0.20143806606568074, 0.1926903476533838, 0.1889955239562533, 0.19051477268535782, 0.19689845074731338, 0.20765286754383433, 0.22242720067067215, 0.24103908203595972, 0.26331226276172215, 0.2889081285956966, 0.31726435123397, 0.347640611469887, 0.3792144122389842, 0.4111751150863067, 0.44279163995040693, 0.47345046569364624, 0.5026699204119072, 0.5300985125010246, 0.5555037974062997, 0.5787564261256216, 0.5998124405563386, 0.6186957260855134, 0.6354817397588379, 0.6502831041445705, 0.6632373112387392, 0.6744965596112623, 0.6842196120116038, 0.6925654829092492, 0.6996887273077841, 0.7057360905653418, 0.7108442846151849, 0.7151386723284239 ], [ 0.5072437081764305, 0.48680953723970516, 0.46687966321789603, 0.4477970648602739, 0.4298002538074279, 0.412974962356568, 0.3972321391730358, 0.3823250129797388, 0.3679024813213033, 0.3535779870412563, 0.33898656369635694, 0.32381735489151175, 0.3078373578902516, 0.29094041424812145, 0.27324096335172443, 0.2551881050246216, 0.23763472103494176, 0.22179120616333234, 0.20902730716726753, 0.2005479161096657, 0.19706168765133877, 0.19864273737402785, 0.20490938175633883, 0.21538639877102667, 0.22976310815168025, 0.24789634388236514, 0.2696411993402335, 0.2946837136784113, 0.32248136080031126, 0.3523094524945576, 0.3833572184040858, 0.4148222653531148, 0.44597885678959004, 0.4762164970862896, 0.5050547270670126, 0.5321418722335237, 0.5572442553296835, 0.5802305353521998, 0.60105424732359, 0.6197364577554617, 0.6363496570129201, 0.6510034817014064, 0.6638325151202664, 0.674986193264692, 0.6846207081172735, 0.6928927221274127, 0.6999546692937162, 0.7059514061706206, 0.711017981238629, 0.7152783068872055 ], [ 0.5146019172602827, 0.4949504789937374, 0.47575802367986275, 0.4573289779927849, 0.43986577240839714, 0.4234272378935215, 0.40791194264708897, 0.3930765706948448, 0.3785857749878327, 0.36407506608775736, 0.3492039527618725, 0.3336897986331825, 0.3173366402511558, 0.30008713451832025, 0.2821115574685085, 0.2639090064241804, 0.24636035461062977, 0.23066797779810097, 0.21815003518369647, 0.2099225530045499, 0.20659668486803362, 0.2081814112412577, 0.2142828636885197, 0.22445100645057253, 0.23840883129601417, 0.25603988462264676, 0.2772196468469224, 0.30165348542830384, 0.32881916836102654, 0.35801187591424033, 0.38843816581281704, 0.41930921603785587, 0.44990891766457347, 0.4796328709275514, 0.5080038071740276, 0.5346709745543872, 0.5593999204082907, 0.5820573122848436, 0.602593873253705, 0.6210273542623618, 0.6374266741714878, 0.6518978302251013, 0.6645718363879661, 0.6755947258858443, 0.6851195177775221, 0.6932999686182019, 0.7002858907903858, 0.7062198059879459, 0.7112347065211172, 0.7154527120783735 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.07173506449908018, 0.48555633518844843, 0.43276938144117594, 0.13594666216522455, 0.1580715337768197, 0.6632164781913161, 0.43822902721504764, 0.5032836965307719, 0.3605185554735036, 0.2784698053210525, 0.24332750066399203, 0.13817154272068607, 0.34021649879283955, 0.4014199282448173, 0.4623573341921234, 0.44118884597217817, 0.42022959052873393, 0.41708781234767667, 0.40125810545806145, 0.4078525712291232, 0.4188864726003662, 0.4063476296527273, 0.39920978552430186, 0.3971602386022429 ], "xaxis": "x", "y": [ 0.7096590753644705, 0.848789912648499, 0.5983624188229442, 0.6616736399009824, 0.9081467175856233, 0.9530803263187408, 0.8634369738451254, 0.8617745399492127, 0.8938795701814818, 0.855121111956768, 0.8481584478420583, 0.8172360429233081, 0.8801415957411487, 0.9078376382367699, 0.9443944181329188, 0.8694859528898895, 0.9420265060876317, 0.8926692847672513, 0.8807828217292244, 0.8805048995793955, 0.8518852341930643, 0.8350737451621212, 0.8300750319853952, 0.9078710743114302 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.07173506449908018, 0.48555633518844843, 0.43276938144117594, 0.13594666216522455, 0.1580715337768197, 0.6632164781913161, 0.43822902721504764, 0.5032836965307719, 0.3605185554735036, 0.2784698053210525, 0.24332750066399203, 0.13817154272068607, 0.34021649879283955, 0.4014199282448173, 0.4623573341921234, 0.44118884597217817, 0.42022959052873393, 0.41708781234767667, 0.40125810545806145, 0.4078525712291232, 0.4188864726003662, 0.4063476296527273, 0.39920978552430186, 0.3971602386022429 ], "xaxis": "x2", "y": [ 0.7096590753644705, 0.848789912648499, 0.5983624188229442, 0.6616736399009824, 0.9081467175856233, 0.9530803263187408, 0.8634369738451254, 0.8617745399492127, 0.8938795701814818, 0.855121111956768, 0.8481584478420583, 0.8172360429233081, 0.8801415957411487, 0.9078376382367699, 0.9443944181329188, 0.8694859528898895, 0.9420265060876317, 0.8926692847672513, 0.8807828217292244, 0.8805048995793955, 0.8518852341930643, 0.8350737451621212, 0.8300750319853952, 0.9078710743114302 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:33:58] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0219122674999717, 1.0217244042711093, 1.021908351238042, 1.0224678207969127, 1.0234050841711562, 1.0247209130186137, 1.0264145430410128, 1.0284836615770154, 1.0309244199467593, 1.0337314700266704, 1.0368980233199951, 1.0404159297846756, 1.0442757729758214, 1.0484669776913198, 1.0529779262588668, 1.057796079815631, 1.0629081013308004, 1.068299977627153, 1.0739571382006423, 1.0798645691636093, 1.0860069211133059, 1.0923686101346264, 1.0989339114788519, 1.1056870457218937, 1.1126122574039001, 1.1196938862969612, 1.1269164315495082, 1.1342646090240973, 1.1417234021875837, 1.1492781069360973, 1.1569143707466163, 1.164618226546479, 1.1723761216848574, 1.1801749423782064, 1.1880020339866313, 1.1958452174611929, 1.2036928022842244, 1.2115335962063116, 1.2193569120651506, 1.227152571953416, 1.234910908985118, 1.2426227668929022, 1.250279497672526, 1.2578729574752512, 1.2653955009342497, 1.2728399740972711, 1.2801997061249455, 1.2874684999017856, 1.2946406216957358, 1.3017107899914266 ], [ 1.0188398269567984, 1.0186492505696454, 1.018837393492265, 1.0194082216602336, 1.0203641929417118, 1.0217061904014293, 1.023433480173016, 1.025543696436801, 1.02803285448609, 1.0308953912454397, 1.0341242310905803, 1.0377108735945242, 1.0416454990055821, 1.0459170868875147, 1.0505135433832828, 1.055421832913655, 1.0606281106808229, 1.0661178530076276, 1.0718759832176197, 1.077886991388523, 1.084135046856443, 1.0906041027960962, 1.097277992554072, 1.1041405176769066, 1.1111755277673492, 1.1183669924346125, 1.1256990656914758, 1.1331561432038726, 1.1407229128266727, 1.1483843988698361, 1.1561260005372733, 1.1639335249710103, 1.171793215317825, 1.1796917742171469, 1.187616383088535, 1.1955547175757502, 1.203494959482904, 1.211425805516855, 1.2193364731291938, 1.2272167037311004, 1.235056763535141, 1.242847442259741, 1.2505800499147912, 1.2582464118704875, 1.2658388623961754, 1.2733502368416116, 1.2807738626196505, 1.2881035491368458, 1.2953335768068999, 1.3024586852710474 ], [ 1.0162156663700748, 1.0160235636387207, 1.0162167495737886, 1.0167994570622148, 1.0177743430026238, 1.0191424118818997, 1.0209029669046412, 1.0230535918394115, 1.0255901648436565, 1.0285069034801009, 1.0317964382377292, 1.035449910373248, 1.0394570889458574, 1.0438065015625306, 1.0484855735117302, 1.0534807705045888, 1.0587777410086703, 1.0643614550083937, 1.0702163368517048, 1.076326390576631, 1.0826753167222065, 1.0892466201089328, 1.0960237084346716, 1.1029899817900657, 1.1101289133739722, 1.1174241218027445, 1.1248594354744803, 1.1324189494835646, 1.140087075592426, 1.1478485857636753, 1.1556886497423706, 1.1635928671585019, 1.1715472945968193, 1.1795384680561931, 1.187553421195371, 1.195579699736426, 1.2036053723725846, 1.2116190385030037, 1.2196098330942267, 1.2275674289462026, 1.2354820366201988, 1.243344402266415, 1.251145803570999, 1.258878044025032, 1.266533445702164, 1.2741048407168074, 1.2815855615209968, 1.2889694301852959, 1.2962507467973738, 1.3034242771009175 ], [ 1.0140635288610338, 1.0138713039362015, 1.0140705401297825, 1.0146657497695362, 1.0156598008809712, 1.0170538295333353, 1.01884718305392, 1.0210373981373517, 1.02362021547254, 1.026589629899843, 1.0299379727161098, 1.033656020915529, 1.0377331270851902, 1.0421573633825256, 1.0469156733802794, 1.0519940263668452, 1.0573775697183643, 1.0630507760316044, 1.0689975826977411, 1.0752015224384965, 1.0816458439938164, 1.088313622651285, 1.0951878606638403, 1.1022515778426685, 1.109487892764098, 1.1168800951170614, 1.1244117097607738, 1.1320665530752385, 1.1398287821807462, 1.147682937584119, 1.1556139797840879, 1.1636073203392272, 1.1716488478713405, 1.1797249494465047, 1.1878225277459336, 1.1959290144097277, 1.2040323799089043, 1.2121211402748642, 1.2201843609906031, 1.228211658324761, 1.2361931983677799, 1.2441196940090495, 1.251982400074985, 1.2597731068303057, 1.267484132028443, 1.275108311681809, 1.282638989708728, 1.2900700066008235, 1.297395687242813, 1.3046108280056785 ], [ 1.0124065861861795, 1.012215887346437, 1.0124223638784988, 1.013030818350682, 1.0140443411582183, 1.0154642098962714, 1.0172898233127043, 1.0195186749826017, 1.0221463687913386, 1.0251666749693695, 1.0285716223920103, 1.0323516206283754, 1.0364956040406168, 1.0409911900768773, 1.045824844550791, 1.0509820478494916, 1.0564474573637281, 1.0622050627612842, 1.0682383318890976, 1.0745303460292728, 1.0810639239431388, 1.087821734640958, 1.0947863991512508, 1.101940581773649, 1.109267071417742, 1.11674885368681, 1.124369174380739, 1.132111595082438, 1.1399600414670994, 1.1478988449405791, 1.1559127781764287, 1.163987085083371, 1.1721075056976686, 1.1802602964589592, 1.1884322462939614, 1.1966106889002648, 1.2047835115922365, 1.212939161042798, 1.221066646228548, 1.2291555388611015, 1.2371959715648055, 1.2451786340397921, 1.2530947674297335, 1.2609361570955784, 1.2686951239798168, 1.2763645147304, 1.2839376907392521, 1.2914085162373303, 1.2987713455761845, 1.306021009815011 ], [ 1.0112671902121335, 1.011079938001336, 1.011295052208956, 1.0119176337135154, 1.0129510048659078, 1.0143965939718493, 1.0162538584722796, 1.0185202533990527, 1.0211912477843648, 1.0242603874006488, 1.027719398369529, 1.0315583234801449, 1.035765681797084, 1.0403286422193883, 1.0452332027142603, 1.050464368544181, 1.0560063245407487, 1.0618425980826618, 1.0679562107675105, 1.0743298177861673, 1.0809458347352663, 1.0877865520876804, 1.09483423784034, 1.102071229026044, 1.1094800128537878, 1.1170432982627827, 1.1247440786613134, 1.132565686588212, 1.1404918409915976, 1.1485066877727457, 1.156594834195749, 1.1647413777180315, 1.1729319297535803, 1.1811526348403494, 1.1893901856456757, 1.1976318342087358, 1.205865399786683, 1.2140792736413881, 1.2222624210758517, 1.2304043810039949, 1.2384952633137993, 1.2465257442619966, 1.2544870601184839, 1.2623709992600929, 1.2701698928963747, 1.2778766045944956, 1.28548451875603, 1.2929875281853689, 1.3003800208775138, 1.307656866142112 ], [ 1.0106665905686119, 1.0104850061489992, 1.0107103880775288, 1.0113481395150643, 1.0124018215907833, 1.013873020967187, 1.01576126061365, 1.018063962196099, 1.0207764635037189, 1.0238920887894125, 1.0274022650459358, 1.0312966740104323, 1.0355634284278934, 1.0401892615726844, 1.045159720651174, 1.0504593568538139, 1.0560719069913498, 1.0619804635346028, 1.0681676313563702, 1.0746156705421117, 1.0813066253513632, 1.0882224398540778, 1.0953450610124176, 1.102656530093586, 1.1101390633311146, 1.1177751227350514, 1.1255474779079704, 1.1334392596678693, 1.1414340062192612, 1.149515702554542, 1.1576688137115538, 1.1658783124609242, 1.1741297019486803, 1.1824090337753768, 1.1907029219526677, 1.198998553141082, 1.207283693538815, 1.2155466927600187, 1.2237764850124586, 1.2319625878578466, 1.2400950988139932, 1.248164690035539, 1.2561626012895772, 1.2640806314237296, 1.2719111285070344, 1.27964697880837, 1.2872815947626886, 1.2948089020624516, 1.302223325999569, 1.3095197771724523 ], [ 1.0106246170071478, 1.0104512488205963, 1.0106887863022382, 1.0113429330426267, 1.0124174915422306, 1.013914211854896, 1.015832688289251, 1.0181703148714125, 1.0209223039005313, 1.0240817647947513, 1.0276398343191422, 1.0315858454890967, 1.0359075213066251, 1.0405911805370531, 1.0456219450850675, 1.0509839413185535, 1.0566604903105914, 1.0626342841156267, 1.0688875467831975, 1.0754021798908147, 1.0821598930502259, 1.0891423202202046, 1.0963311228397534, 1.1037080808523652, 1.1112551726761548, 1.1189546451206593, 1.1267890741799382, 1.134741417555516, 1.1427950596883498, 1.1509338500094122, 1.1591421350547066, 1.1674047850328217, 1.1757072153809691, 1.1840354037981966, 1.1923759032017756, 1.2007158510138247, 1.2090429751497562, 1.2173455970477673, 1.2256126320489034, 1.2338335874100879, 1.241998558207669, 1.2500982213662917, 1.2581238280271034, 1.2660671944503807, 1.2739206916303114, 1.281677233783978, 1.289330265862222, 1.2968737502171122, 1.3043021525488752, 1.3116104272444906 ], [ 1.0111593271122832, 1.0109970728938273, 1.011248933923023, 1.0119209044769355, 1.0130170249426644, 1.0145392097849646, 1.016487128650251, 1.0188581541149684, 1.0216473814882037, 1.0248477169610826, 1.0284500227996942, 1.0324433039205814, 1.036814919368459, 1.0415508040749488, 1.0466356895147304, 1.0520533153689096, 1.057786627369865, 1.0638179588611774, 1.070129195250379, 1.0767019215790306, 1.0835175540371529, 1.090557456549256, 1.0978030436680322, 1.1052358710092995, 1.112837714400346, 1.1205906388259506, 1.128477058161027, 1.1364797865856004, 1.1445820824915163, 1.1527676856122009, 1.1610208480371322, 1.1693263597105363, 1.177669568958445, 1.1860363985385236, 1.1944133576624365, 1.202787550399942, 1.2111466808373235, 1.2194790553291999, 1.2277735821523923, 1.2360197688426835, 1.2442077174699668, 1.2523281180842034, 1.2603722405435893, 1.2683319249171656, 1.2761995706368077, 1.2839681245577603, 1.2916310680725929, 1.2991824034106125, 1.3066166392430325, 1.3139287757036657 ], [ 1.0122866237233639, 1.012138743645224, 1.0124073925106196, 1.0130988353728592, 1.014217338776333, 1.0157649768906585, 1.0177414959066131, 1.0201442534892695, 1.022968239911526, 1.026206175998752, 1.0298486737328763, 1.0338844405273115, 1.0383005079227254, 1.0430824683473472, 1.048214707819988, 1.0536806266724668, 1.0594628438181273, 1.0655433825980767, 1.0719038378828198, 1.0785255250872563, 1.085389612271699, 1.092477236717146, 1.0997696074011982, 1.107248094743756, 1.1148943088899668, 1.1226901676816579, 1.1306179553533393, 1.1386603728820575, 1.1468005808247625, 1.1550222353922053, 1.1633095184340412, 1.1716471619441837, 1.1800204676373558, 1.188415322095985, 1.1968182079401095, 1.2052162114310676, 1.2135970268818927, 1.2219489582128824, 1.2302609179596402, 1.2385224240124735, 1.2467235943402692, 1.2548551399285046, 1.2629083561399577, 1.2708751126872788, 1.2787478423893897, 1.2865195288678337, 1.2941836933251436, 1.301734380534441, 1.3091661441580327, 1.316474031502383 ], [ 1.014019852224762, 1.0138899676961262, 1.0141781699842365, 1.0148909626501075, 1.0160328161563335, 1.0176059520727203, 1.0196101904518498, 1.0220428807873674, 1.0248989244439985, 1.0281708822909772, 1.0318491502170275, 1.0359221800480851, 1.0403767239307473, 1.0451980843288409, 1.0503703570277894, 1.0558766593718474, 1.0616993397019674, 1.067820166538756, 1.0742204976587928, 1.0808814301068792, 1.0877839326100913, 1.094908961995928, 1.1022375651928769, 1.1097509682889355, 1.1174306539899825, 1.1252584286815963, 1.1332164801680011, 1.141287427044897, 1.1494543605603011, 1.1577008797278787, 1.1660111203791128, 1.1743697787720955, 1.182762130314199, 1.1911740439020595, 1.1995919923341885, 1.2080030592081978, 1.2163949426755463, 1.2247559563914077, 1.2330750279652758, 1.2413416951889251, 1.249546100292215, 1.2576789824534618, 1.2657316687698217, 1.2736960638737347, 1.2815646383642318, 1.2893304162062158, 1.2969869612368239, 1.3045283629054045, 1.3119492213622803, 1.3192446320013704 ], [ 1.016369395818115, 1.0162614677474118, 1.0165722782718047, 1.0173085232362877, 1.0184748423648724, 1.0200735830300163, 1.0221046315391713, 1.0245653359659468, 1.0274505295936402, 1.030752647183584, 1.0344619135649133, 1.0385665787745861, 1.04305317547684, 1.047906779669547, 1.0531112618306457, 1.058649520980004, 1.0645036980607334, 1.0706553676336228, 1.0770857084187788, 1.0837756540280588, 1.090706025576626, 1.097857647934516, 1.1052114513083662, 1.11274855970753, 1.1204503676928097, 1.1282986066526848, 1.1362754017118843, 1.144363320253085, 1.1525454129248187, 1.1608052479149253, 1.1691269391875672, 1.1774951693104252, 1.1858952074357827, 1.194312922943381, 1.202734795202933, 1.2111479198694046, 1.21954001208391, 1.2278994069166715, 1.2362150573558004, 1.2444765301160898, 1.2526739995154452, 1.2607982396426316, 1.2688406150185265, 1.2767930699337355, 1.2846481166281962, 1.2923988224628067, 1.3000387962193585, 1.3075621736525527, 1.314963602406883, 1.3222382264011758 ], [ 1.0193422958864837, 1.0192605768622376, 1.0195973045778397, 1.0203593066664944, 1.0215513441926094, 1.0231758584960438, 1.025232788934333, 1.0277194886519774, 1.0306307483624626, 1.0339589189618397, 1.0376941097737633, 1.0418244340311829, 1.0463362756087946, 1.0512145572785747, 1.0564429975617566, 1.062004348886937, 1.0678806137857957, 1.0740532384316246, 1.0805032843094633, 1.087211579554374, 1.0941588517861258, 1.1013258443018212, 1.108693417389393, 1.1162426363704985, 1.1239548478131207, 1.1318117451924392, 1.1397954251324953, 1.1478884352326073, 1.1560738143706244, 1.1643351262781663, 1.17265648709825, 1.1810225875616251, 1.1894187103525433, 1.1978307431766302, 1.2062451879915312, 1.2146491668146793, 1.223030424480803, 1.2313773286844847, 1.2396788676094854, 1.247924645416475, 1.2561048758338609, 1.2642103740722048, 1.2722325472611693, 1.2801633835886426, 1.2879954403044662, 1.2957218307358744, 1.303336210448086, 1.3108327626712903, 1.3182061831044742, 1.325451664196811 ], [ 1.0229419313881476, 1.0228908891204245, 1.0232570351468377, 1.0240472557640141, 1.0252663732093985, 1.0269168812144518, 1.0289987534371425, 1.0315093539212101, 1.0344434600784733, 1.037793388087982, 1.041549195875886, 1.0456989337895952, 1.0502289160751814, 1.0551239930759875, 1.060367811195794, 1.0659430534398096, 1.071831657397625, 1.0780150100919308, 1.0844741205747102, 1.091189771876824, 1.0981426541920478, 1.1053134811993302, 1.1126830913226393, 1.1202325355702156, 1.1279431534243052, 1.1357966380889504, 1.1437750922547643, 1.1518610754082323, 1.160037643598244, 1.1682883824720167, 1.1765974343047847, 1.184949519670173, 1.1933299543297973, 1.201724661859996, 1.2101201824794314, 1.2185036784931693, 1.2268629367257293, 1.235186368277111, 1.2434630059014782, 1.2516824992775117, 1.2598351084120882, 1.2679116953946676, 1.2759037146980619, 1.2838032022020625, 1.291602763099315, 1.2992955588276998, 1.306875293159987, 1.314336197569653, 1.3216730159811367, 1.3288809890034199 ], [ 1.0271677905564978, 1.027152005227707, 1.0275511747875314, 1.0283721623895978, 1.0296197824377396, 1.0312965321691663, 1.033402396301911, 1.0359347544232331, 1.0388884016778177, 1.042255672505807, 1.0460266424543347, 1.0501893781157094, 1.0547302082904304, 1.059633996271747, 1.0648844002335403, 1.0704641144387486, 1.076355088023836, 1.0825387206806116, 1.0889960360328457, 1.0957078342530149, 1.1026548257635893, 1.1098177479112865, 1.1171774664153737, 1.124715063245496, 1.1324119124216179, 1.1402497450687146, 1.1482107049111354, 1.156277395258813, 1.1644329184200382, 1.1726609083716513, 1.180945557426142, 1.1892716375541574, 1.1976245169494326, 1.2059901723596038, 1.2143551976499274, 1.2227068090168394, 1.23103284722366, 1.2393217771912097, 1.2475626852408885, 1.2557452742565898, 1.2638598570042012, 1.2718973478229083, 1.2798492528809016, 1.2877076591689265, 1.2954652223881975, 1.3031151538742503, 1.310651206685115, 1.318067660970535, 1.325359308728599, 1.3325214380470676 ], [ 1.0320153553353324, 1.032039399936511, 1.032475195515416, 1.0333294975084724, 1.03460704021301, 1.0363102724073427, 1.0384391641822281, 1.040991113650829, 1.0439609638010556, 1.0473411199988363, 1.0511217446030832, 1.0552910001418732, 1.0598353150238138, 1.0647396519811825, 1.0699877661286226, 1.0755624450603887, 1.0814457273933997, 1.0876190987550025, 1.0940636657521845, 1.10076030927686, 1.1076898188655446, 1.1148330099285946, 1.1221708256163336, 1.1296844249713114, 1.1373552588702975, 1.1451651351091703, 1.1530962738401098, 1.1611313544380786, 1.1692535547539096, 1.1774465836044177, 1.1856947072546902, 1.193982770563196, 1.2022962133853348, 1.210621082764606, 1.21894404138171, 1.227252372679778, 1.2355339830378869, 1.2437774013242577, 1.2519717761246842, 1.2601068709099459, 1.2681730573781493, 1.276161307183274, 1.2840631822395874, 1.2918708237726064, 1.2995769402704818, 1.3071747944750316, 1.3146581895386602, 1.3220214544620223, 1.3292594289172484, 1.3363674475526428 ], [ 1.0374760957631475, 1.0375444133470486, 1.0380203222299025, 1.0389103895182026, 1.040219200426954, 1.041949105335459, 1.044100034222668, 1.0466694049062153, 1.0496521348515464, 1.0530407485806081, 1.0568255598472915, 1.060994902634394, 1.0655353866240556, 1.0704321579930853, 1.0756691523567352, 1.0812293318599067, 1.087094902285036, 1.0932475086644806, 1.099668409513797, 1.106338630727599, 1.1132391006428684, 1.120350767952687, 1.1276547041662377, 1.1351321922349233, 1.1427648028456683, 1.150534459747541, 1.1584234953415375, 1.166414697632988, 1.1744913495255451, 1.1826372613257838, 1.190836797228881, 1.1990748964675948, 1.2073370897284659, 1.2156095113698189, 1.2238789079148324, 1.2321326432390542, 1.240358700824151, 1.2485456834080522, 1.2566828103249457, 1.2647599127965403, 1.2727674274078533, 1.2806963879761197, 1.2885384159999262, 1.2962857098566853, 1.303931032900144, 1.3114677005950952, 1.3188895668137737, 1.32619100940729, 1.3333669151556746, 1.3404126641914988 ], [ 1.0435375498832684, 1.0436543423908304, 1.0441736338834393, 1.0451017323753617, 1.046443014122289, 1.0481996877841118, 1.0503716205646896, 1.052956249760756, 1.0559485889055251, 1.059341322500044, 1.0631249719409612, 1.0672881100916565, 1.0718176024642756, 1.076698856906384, 1.0819160687039564, 1.087452452659265, 1.0932904573726918, 1.099411959575188, 1.1057984380825103, 1.1124311279953685, 1.1192911563563388, 1.126359660755819, 1.133617892470616, 1.1410473056980515, 1.1486296343657576, 1.1563469578840668, 1.1641817570831015, 1.1721169614509341, 1.1801359886693419, 1.1882227773319798, 1.1963618136285308, 1.2045381526869956, 1.2127374351851008, 1.220945899769868, 1.2291503917610105, 1.2373383685582187, 1.2454979021236803, 1.2536176788685975, 1.261686997235291, 1.2696957632340788, 1.2776344841658456, 1.2854942607365618, 1.2932667777486255, 1.3009442935350926, 1.3085196282866571, 1.3159861514069364, 1.3233377680192195, 1.3305689047369587, 1.3376744948007193, 1.34464996267596 ], [ 1.050183459024536, 1.0503525984187165, 1.0509182429804704, 1.051886384353266, 1.053261142612532, 1.0550445509220532, 1.0572363958174582, 1.059834133285727, 1.062832889214413, 1.066225540258521, 1.0700028613713803, 1.0741537211654841, 1.07866530579068, 1.083523354628783, 1.0887123950424575, 1.0942159673994671, 1.1000168349649826, 1.1060971758154654, 1.1124387557259483, 1.1190230821617975, 1.1258315402253263, 1.1328455118046081, 1.1400464793538252, 1.1474161157793241, 1.1549363618670072, 1.1625894926012963, 1.1703581736167796, 1.1782255089062394, 1.1861750807915439, 1.1941909830526338, 1.2022578480068926, 1.2103608682379272, 1.2184858135895178, 1.2266190439666018, 1.234747518420242, 1.2428588009367076, 1.2509410633011544, 1.2589830853632589, 1.2669742529945824, 1.2749045539948947, 1.2827645721763525, 1.2905454798299214, 1.298239028757091, 1.3058375400314222, 1.3133338926384133, 1.32072151112814, 1.327994352402983, 1.3351468917520657, 1.3421741082347585, 1.349071469507382 ], [ 1.0573939397138121, 1.0576189055967151, 1.0582335211792628, 1.059243418854013, 1.0606524287702892, 1.0624623851765558, 1.0646729817002276, 1.0672816925765694, 1.0702837677797206, 1.0736722999881723, 1.0774383530623926, 1.0815711368595753, 1.0860582119400626, 1.0908857091380655, 1.0960385518262776, 1.101500671948183, 1.107255213875579, 1.1132847225825397, 1.1195713144547494, 1.126096830335929, 1.132842971256893, 1.139791417805568, 1.1469239343735689, 1.154222459631008, 1.1616691845928695, 1.1692466195879048, 1.1769376513524605, 1.184725591365904, 1.1925942164333576, 1.2005278024126975, 1.2085111518805791, 1.216529616438566, 1.2245691142763881, 1.2326161435346414, 1.2406577919434707, 1.248681743156456, 1.2566762801487488, 1.2646302860052214, 1.2725332423866398, 1.2803752259293897, 1.288146902806012, 1.295839521649468, 1.3034449050229133, 1.310955439598503, 1.3183640651928485, 1.3256642627930373, 1.3328500416951565, 1.3399159258668023, 1.3468569396359882, 1.353668592800837 ], [ 1.0651456882114096, 1.0654295299847025, 1.066095353667917, 1.0671484026779798, 1.0685921955970088, 1.0704283537302084, 1.0726564710021649, 1.0752740403992647, 1.0782764443152884, 1.0816570083185117, 1.0854071110184165, 1.08951633819705, 1.0939726675488741, 1.0987626708069769, 1.1038717219047403, 1.1092842023228513, 1.1149836973112324, 1.1209531789162777, 1.1271751735452833, 1.1336319131479415, 1.1403054700393396, 1.1471778760059947, 1.1542312267041566, 1.1614477725473826, 1.168809997344797, 1.1763006859358782, 1.1839029820036673, 1.1916004371583515, 1.1993770522818241, 1.207217312020866, 1.215106213217551, 1.2230292879737612, 1.2309726219633692, 1.2389228685315004, 1.2468672590549172, 1.2547936099802341, 1.262690326906902, 1.2705464060386382, 1.278351433289599, 1.2860955812992314, 1.2937696045817946, 1.3013648330124505, 1.3088731638309155, 1.3162870523256702, 1.3235995013460835, 1.3308040497763218, 1.337894760093063, 1.3448662051189417, 1.351713454074571, 1.3584320580242433 ], [ 1.0734122194306024, 1.0737575374470483, 1.0744764160282536, 1.0755736906861204, 1.0770525563935416, 1.0789144148919532, 1.0811587580536948, 1.0837830991767035, 1.086782959044469, 1.090151907544399, 1.0938816560219167, 1.0979621914280182, 1.1023819411585567, 1.1071279571638468, 1.112186108946331, 1.1175412768778488, 1.1231775393510768, 1.1290783492810001, 1.1352266971950662, 1.1416052595176713, 1.148196531666419, 1.1549829462762786, 1.161946977313413, 1.1690712310938978, 1.1763385253385004, 1.1837319574174414, 1.1912349629027947, 1.1988313654754468, 1.2065054191456352, 1.2142418436521323, 1.222025853812428, 1.2298431835086026, 1.2376801049134383, 1.2455234434891687, 1.2533605892274127, 1.2611795045428096, 1.2689687291838594, 1.2767173824820905, 1.284415163223807, 1.292052347396882, 1.2996197840375565, 1.30710888937843, 1.3145116394783654, 1.321820561497232, 1.3290287237630538, 1.336129724765888, 1.3431176812011052, 1.3499872151747476, 1.356733440674809, 1.3633519494046136 ], [ 1.0821641392973516, 1.082573078563845, 1.0833464707512301, 1.084488732790277, 1.0860027309267888, 1.0878896458940746, 1.090148868248382, 1.0927779339049717, 1.0957725062961592, 1.0991264069617026, 1.1028316917776588, 1.1068787663020783, 1.111256531373444, 1.1159525492321316, 1.1209532208126816, 1.12624396607714, 1.131809400911779, 1.1376335058515892, 1.143699783500284, 1.1499914028555454, 1.156491329789884, 1.1631824436892482, 1.170047640755699, 1.177069924788733, 1.1842324864220097, 1.1915187718524698, 1.1989125420915878, 1.2063979237198206, 1.2139594520540509, 1.2215821075562445, 1.229251346227969, 1.2369531246547296, 1.2446739202889903, 1.2524007474924845, 1.2601211697975723, 1.2678233087934823, 1.2754958499961475, 1.2831280460192196, 1.2907097173280144, 1.2982312508272984, 1.3056835965068423, 1.3130582623455493, 1.3203473076548586, 1.3275433350246835, 1.3346394810201332, 1.3416294057641334, 1.3485072815297545, 1.355267780456065, 1.3619060614927596, 1.3684177566711035 ], [ 1.0913694456867824, 1.091843696609347, 1.0926726807582081, 1.0938603919040335, 1.0954093671177687, 1.0973205678961495, 1.0995932859526845, 1.1022250823101039, 1.1052117658344016, 1.108547413851309, 1.1122244336880835, 1.116233660606277, 1.1205644851636962, 1.1252050017970603, 1.130142170292315, 1.1353619825514716, 1.1408496283376026, 1.1465896551667238, 1.1525661189746113, 1.158762723467276, 1.1651629470966989, 1.1717501573774523, 1.178507712800316, 1.1854190529472113, 1.1924677776121946, 1.1996377158275493, 1.206912985715473, 1.2142780460609313, 1.2217177404490882, 1.2292173347442907, 1.2367625486160216, 1.2443395817458676, 1.2519351352816759, 1.2595364290425368, 1.2671312149215932, 1.2747077868832823, 1.2822549879069038, 1.2897622141893827, 1.2972194168858242, 1.3046171016366717, 1.3119463261043744, 1.3191986957199735, 1.3263663578204334, 1.3334419943406415, 1.3404188132091888, 1.347290538584293, 1.3540514000549926, 1.3606961209230446, 1.3672199056723577, 1.3736184267253098 ], [ 1.1009938527086, 1.1015346550930882, 1.1024199385621296, 1.1036532736919251, 1.1052368709866753, 1.1071714762291534, 1.1094562853790937, 1.1120888866064078, 1.1150652354383113, 1.1183796663618266, 1.1220249410533016, 1.1259923303213457, 1.1302717243910814, 1.1348517646514167, 1.139719989495192, 1.1448629872505098, 1.1502665501579694, 1.1559158246009602, 1.1617954541014208, 1.1678897127866876, 1.1741826280270018, 1.1806580917111658, 1.1872999601817957, 1.194092143223821, 1.2010186827289215, 1.20806382178145, 1.2152120649600289, 1.2224482306480209, 1.229757496114515, 1.2371254360783983, 1.2445380554105903, 1.251981816569667, 1.2594436623073606, 1.2669110341250966, 1.274371886911813, 1.2818147001472497, 1.2892284860137284, 1.2966027947229783, 1.303927717332352, 1.3111938862966037, 1.3183924739766202, 1.3255151893049637, 1.3325542727892226, 1.3395024900176882, 1.3463531238176145, 1.353099965203725, 1.3597373032437523, 1.3662599139581606, 1.3726630483627886, 1.3789424197557338 ], [ 1.1110011361509646, 1.1116092845073835, 1.1125512127636144, 1.11383007184994, 1.115447750372257, 1.1174047827203162, 1.1197002719871492, 1.122331834496179, 1.1252955718408866, 1.1285860743781548, 1.1321964574343453, 1.1361184286332953, 1.1403423822953103, 1.1448575151780584, 1.149651957077596, 1.1547129098956563, 1.1600267894806031, 1.1655793655943845, 1.171355896509074, 1.1773412558255192, 1.183520050038269, 1.1898767261086858, 1.1963956688556021, 1.2030612883539038, 1.2098580977786055, 1.2167707822777163, 1.2237842595296207, 1.2308837326630024, 1.2380547362068397, 1.2452831757072946, 1.2525553616066112, 1.2598580379322106, 1.2671784062961848, 1.27450414565851, 1.281823428263274, 1.2891249321165092, 1.296397850337265, 1.3036318976803754, 1.3108173144996669, 1.3179448683941621, 1.325005853756557, 1.3319920894227915, 1.3388959146036274, 1.345710183263269, 1.352428257096309, 1.3590439972420618, 1.3655517548647214, 1.3719463607183746, 1.3782231138076189, 1.3843777692471801 ], [ 1.1213535014009406, 1.1220293511906092, 1.1230279163664356, 1.124351934843812, 1.126002979552002, 1.12798137808756, 1.1302861428521231, 1.132914917850878, 1.1358639480203838, 1.1391280755268818, 1.142700765180476, 1.1465741584563873, 1.1507391531752051, 1.155185504109567, 1.159901938852826, 1.164876283166271, 1.1700955905191173, 1.1755462713990175, 1.1812142189729125, 1.187084928653577, 1.1931436099801564, 1.1993752899110386, 1.2057649071520486, 1.2122973975200202, 1.2189577705977672, 1.225731178098665, 1.2326029744517957, 1.2395587701622113, 1.2465844785108386, 1.2536663561466608, 1.2607910380983134, 1.2679455676995097, 1.2751174218860943, 1.282294532285394, 1.2894653024821072, 1.2966186218104256, 1.303743875990066, 1.310830954894453, 1.317870257712669, 1.3248526957428497, 1.3317696930332485, 1.3386131850681589, 1.3453756156789154, 1.3520499323452646, 1.3586295800391317, 1.3651084937511122, 1.3714810898297194, 1.3777422562542085, 1.3838873419537756, 1.389912145278636 ], [ 1.132011976141491, 1.132755451776, 1.1338103014126069, 1.1351788594554832, 1.1368623907586035, 1.138861020819813, 1.1411736725946735, 1.1437980155820768, 1.146730432997577, 1.1499660118569157, 1.153498558817704, 1.1573206421526885, 1.1614236578374468, 1.1657979158991827, 1.1704327421248144, 1.1753165899546625, 1.1804371577203203, 1.1857815070877655, 1.1913361794253405, 1.1970873076740767, 1.2030207220622315, 1.2091220486365597, 1.2153768000732141, 1.2217704585944775, 1.2282885510744037, 1.2349167165893347, 1.2416407667783524, 1.2484467394410719, 1.2553209458293266, 1.2622500120954212, 1.2692209153506393, 1.276221014768956, 1.2832380781467316, 1.2902603043018386, 1.2972763416677262, 1.3042753034100663, 1.3112467793669318, 1.318180845088455, 1.325068068228563, 1.3318995125201936, 1.3386667395459932, 1.3453618084991013, 1.3519772741128981, 1.3585061829246328, 1.364942068025331, 1.3712789424372152, 1.377511291250031, 1.3836340626387549, 1.3896426578773426, 1.3955329204561093 ], [ 1.142936827247838, 1.1437474332917648, 1.1448578805344594, 1.1462701121592298, 1.1479850939444507, 1.1500027541410724, 1.1523219266285478, 1.154940302515509, 1.1578543958822916, 1.1610595287236671, 1.1645498384612065, 1.1683183091078035, 1.1723568248628817, 1.1766562430803327, 1.1812064824342894, 1.1859966217215134, 1.1910150049306374, 1.196249348763436, 1.2016868495127497, 1.2073142869404017, 1.213118123469508, 1.219084597570093, 1.225199810666037, 1.2314498072340463, 1.237820648017164, 1.2442984764538656, 1.2508695785454176, 1.2575204364622745, 1.2642377762366122, 1.2710086099110558, 1.2778202725202594, 1.2846604542772364, 1.2915172283242045, 1.2983790743907817, 1.3052348986828435, 1.312074050304716, 1.3188863344963726, 1.325662022946907, 1.3323918614260737, 1.3390670749573055, 1.3456793707387125, 1.3522209390028788, 1.358684451992161, 1.3650630612132129, 1.3713503931229234, 1.377540543387448, 1.3836280698466261, 1.3896079843076705, 1.3954757432843932, 1.4012272377913972 ], [ 1.1540879954013699, 1.1549648325023276, 1.1561298691070443, 1.1575846721580831, 1.1593299188506596, 1.1613653454261152, 1.1636896964748344, 1.1663006794300403, 1.1691949297296222, 1.172367991773961, 1.1758143193884065, 1.1795272974247877, 1.1834992839662315, 1.1877216708118166, 1.1921849587722417, 1.196878843833184, 1.201792310309067, 1.2069137275247799, 1.2122309471463326, 1.2177313989011795, 1.2234021830053483, 1.229230158109948, 1.2352020239838333, 1.2413043984668661, 1.2475238884706785, 1.2538471549839396, 1.260260972169365, 1.2667522807308194, 1.2733082357897665, 1.2799162495483964, 1.2865640290376663, 1.2932396092570178, 1.2999313820118696, 1.3066281207483494, 1.3133190016736773, 1.3199936214371637, 1.3266420116317807, 1.3332546503607605, 1.3398224710981337, 1.3463368690569857, 1.3527897052648692, 1.3591733085322377, 1.3654804754872059, 1.3717044688384001, 1.377839014017004, 1.3838782943395136, 1.3898169448239235, 1.3956500447841083, 1.401373109319961, 1.4069820798142747 ], [ 1.1654255343916504, 1.1663673210191206, 1.167585634255507, 1.1690816822793466, 1.170855865768154, 1.1729077348847794, 1.1752359445951028, 1.1778382124965807, 1.1807112843004077, 1.183850911994097, 1.1872518485543735, 1.1909078612504156, 1.1948117635900082, 1.1989554642688642, 1.203330030343887, 1.2079257613087917, 1.2127322707016994, 1.2177385721539244, 1.2229331672392718, 1.2283041329856108, 1.2338392073928433, 1.2395258717273903, 1.2453514287210823, 1.2513030760925388, 1.2573679750389386, 1.2635333135243605, 1.2697863643264076, 1.276114537903762, 1.2825054302202998, 1.2889468657124064, 1.2954269356198838, 1.3019340319212607, 1.3084568771246796, 1.3149845501683632, 1.3215065086820794, 1.3280126078546217, 1.3344931161433389, 1.3409387280512246, 1.3473405741856932, 1.353690228801439, 1.3599797150181738, 1.3662015078927825, 1.3723485355146205, 1.3784141782826804, 1.384392266513783, 1.3902770765223953, 1.3960633253045, 1.4017461639507167, 1.4073211699069708, 1.412784338194912 ], [ 1.1769100375429744, 1.177915137842351, 1.1791851318470998, 1.1807208886248615, 1.1825225459783935, 1.1845894749157841, 1.1869202408436226, 1.1895125651430538, 1.1923632918328755, 1.1954683640902084, 1.1988228144974233, 1.2024207713247814, 1.2062554813951452, 1.2103193485210682, 1.2146039854011947, 1.2191002762718615, 1.2237984474565229, 1.2286881431061163, 1.2337585037442105, 1.2389982456190063, 1.2443957392545841, 1.2499390859514574, 1.2556161912972887, 1.2614148350098182, 1.267322736648866, 1.2733276169076193, 1.2794172543311964, 1.2855795374182182, 1.2918025121435062, 1.2980744250017044, 1.3043837617163856, 1.3107192817901412, 1.317070049091468, 1.3234254586859655, 1.329775260124676, 1.3361095774028429, 1.3424189257993218, 1.3486942258012824, 1.3549268143117568, 1.3611084533292712, 1.3672313362802284, 1.3732880921757196, 1.379271787755759, 1.3851759277753615, 1.3909944535788625, 1.396721740101105, 1.4023525914270687, 1.4078822350347548, 1.4133063148399247, 1.4186208831555793 ], [ 1.188503032832021, 1.1895694900495855, 1.1908893115449433, 1.19246304867194, 1.1942905914748074, 1.1963711399317933, 1.1987031708246272, 1.2012844033686951, 1.204111767793748, 1.2071813812679784, 1.210488534897048, 1.2140276942530155, 1.2177925143770265, 1.2217758688103781, 1.22596989116839, 1.2303660271517403, 1.2349550946463612, 1.2397273495941106, 1.244672555514772, 1.2497800548389806, 1.2550388405132513, 1.2604376266291468, 1.2659649170926743, 1.2716090715808983, 1.277358368230398, 1.2832010626679022, 1.289125443130573, 1.2951198815348834, 1.301172880442315, 1.307273115940026, 1.3134094765084663, 1.3195710979878899, 1.3257473947847702, 1.3319280874787742, 1.33810322700367, 1.3442632155823553, 1.3503988245989182, 1.3565012095898628, 1.3625619225337626, 1.3685729216139197, 1.3745265786228957, 1.380415684171457, 1.386233450857779, 1.3919735145459902, 1.3976299338964566, 1.4031971882837615, 1.408670174232058, 1.4140442004916602, 1.419314981875094, 1.4244786319655574 ], [ 1.2001673310934344, 1.201292905335716, 1.2026604730381678, 1.2042702904777394, 1.2061220163119504, 1.2082146888807874, 1.2105466984649935, 1.2131157571236473, 1.2159188697490502, 1.2189523102758437, 1.2222116065370239, 1.2256915362598615, 1.2293861354445192, 1.2332887191644706, 1.2373919138728369, 1.2416876996719988, 1.246167460688506, 1.2508220416219582, 1.2556418086233316, 1.2606167128356147, 1.2657363551469802, 1.2709900509330938, 1.276366893782571, 1.2818558173992771, 1.2874456550533644, 1.2931251961085826, 1.298883239286756, 1.304708642443057, 1.3105903687188196, 1.3165175290148223, 1.3224794207886643, 1.3284655632273719, 1.3344657288827042, 1.3404699718834996, 1.346468652858559, 1.3524524607164259, 1.3584124314364314, 1.3643399640293503, 1.3702268338271852, 1.3760652032604845, 1.3818476302789369, 1.3875670745671869, 1.393216901703351, 1.398790885402772, 1.404283207984391, 1.409688459191955, 1.415001633497105, 1.420218126006396, 1.425333727089384, 1.4303446158403097 ], [ 1.2118673169563008, 1.213049525643667, 1.2144625622592924, 1.2161064113512796, 1.2179805175050524, 1.2200837679895902, 1.2224144700251665, 1.2249703248161208, 1.2277484014350393, 1.230745114005217, 1.2339562053694146, 1.2373767396880853, 1.241001105412384, 1.2448230290647058, 1.2488355994056934, 1.2530313009545715, 1.2574020554647771, 1.2619392697981398, 1.2666338886312472, 1.2714764505133322, 1.2764571459346385, 1.2815658762287938, 1.286792312304361, 1.292125952367977, 1.2975561779585598, 1.303072307754705, 1.3086636487445957, 1.3143195444585518, 1.320029420059183, 1.3257828241638259, 1.3315694673397744, 1.3373792572660586, 1.3432023305979481, 1.3490290816032087, 1.354850187664033, 1.3606566317568978, 1.3664397220354079, 1.3721911086497136, 1.3779027979410614, 1.3835671641525171, 1.389176958797107, 1.3947253178235688, 1.4002057667175343, 1.4056122236730315, 1.4109390009656129, 1.4161808046546176, 1.4213327327380476, 1.4263902718795272, 1.4313492928227163, 1.436206044604506 ], [ 1.223569178072879, 1.2248053373436663, 1.2262614028290288, 1.2279371108956683, 1.2298317099408669, 1.2319439476821334, 1.2342720529795561, 1.2368137139027295, 1.239566054608243, 1.2425256139874983, 1.2456883289353384, 1.2490495245664603, 1.2526039129387052, 1.256345601014542, 1.260268107848709, 1.2643643904117854, 1.2686268770681766, 1.2730475075051781, 1.2776177778212965, 1.2823287894891195, 1.2871713009775454, 1.2921357809252896, 1.2972124618845307, 1.3023913937880325, 1.3076624964268455, 1.3130156103534487, 1.3184405457432122, 1.3239271288534977, 1.329465245813681, 1.335044883560404, 1.3406561678013733, 1.3462893979483093, 1.351935079006761, 1.357583950448222, 1.3632270121198364, 1.368855547269959, 1.3744611427851072, 1.380035706746401, 1.3855714834223511, 1.3910610658205094, 1.3964974059237754, 1.4018738227385548, 1.4071840082819178, 1.4124220316338771, 1.417582341179023, 1.4226597651593211, 1.4276495106571934, 1.4325471611248561, 1.4373486725728188, 1.4420503685270614 ], [ 1.2352410733951356, 1.2365283388494892, 1.2380248636042699, 1.2397301591277006, 1.241643295689233, 1.2437628936192087, 1.2460871091831422, 1.2486136164076622, 1.2513395869556054, 1.2542616705523941, 1.2573759784705796, 1.2606780722378246, 1.2641629591650527, 1.2678250956332944, 1.2716583984469958, 1.2756562640321234, 1.2798115948615651, 1.2841168322275953, 1.288563994333413, 1.2931447186186271, 1.2978503072426526, 1.3026717747050343, 1.30759989666623, 1.3126252591341332, 1.3177383072910551, 1.322929393346409, 1.3281888229070722, 1.3335068994569999, 1.3388739666281975, 1.3442804480256068, 1.3497168844385135, 1.3551739683308446, 1.3606425755531206, 1.3661137942602901, 1.371578951053519, 1.3770296343909414, 1.3824577153335436, 1.3878553657085821, 1.3932150737850972, 1.398529657564819, 1.4037922757978896, 1.4089964368367043, 1.4141360054433547, 1.419205207667031, 1.4241986339076393, 1.4291112402808481, 1.4339383483983987, 1.4386756436754669, 1.4433191722746919, 1.4478653367939074 ], [ 1.2468532450246796, 1.2481886504792281, 1.249722967287958, 1.2514555046438, 1.253385172551529, 1.2555104764259637, 1.2578295064982825, 1.2603399230525119, 1.2630389391832335, 1.265923303164588, 1.268989282606585, 1.2722326523758678, 1.2756486878543958, 1.2792321646006068, 1.282977364954993, 1.2868780916613185, 1.2909276881921672, 1.2951190651845996, 1.2994447322036997, 1.3038968339456467, 1.308467189951443, 1.3131473369119493, 1.3179285726906218, 1.3228020012601895, 1.3277585778342975, 1.3327891535669152, 1.3378845192858662, 1.3430354478173405, 1.3482327345433713, 1.3534672359119877, 1.3587299056890332, 1.3640118288013408, 1.3693042526731265, 1.3745986160016734, 1.3798865749550515, 1.3851600268049589, 1.3904111310320757, 1.3956323279607998, 1.4008163549954382, 1.4059562605415168, 1.4110454157046148, 1.4160775238653796, 1.4210466282337773, 1.4259471174883167, 1.4307737296076537, 1.4355215540023905, 1.4401860320548403, 1.444762956173542, 1.449248467468177, 1.453639052148784 ], [ 1.258378080416286, 1.2597585736928634, 1.2613279474903947, 1.2630853303749354, 1.2650294894286667, 1.2671588276088155, 1.2694713761763132, 1.2719647829589955, 1.2746362977979384, 1.2774827569074954, 1.2805005680189177, 1.2836856980854365, 1.2870336650544392, 1.290539534829599, 1.294197924122912, 1.2980030094887465, 1.3019485424761046, 1.306027870549592, 1.3102339632186275, 1.3145594426739715, 1.318996618151925, 1.3235375232181568, 1.3281739551744018, 1.3328975158316105, 1.3376996529534058, 1.3425717017462957, 1.3475049258517768, 1.3524905573754633, 1.3575198355661011, 1.3625840438305226, 1.3676745448374554, 1.372782813523215, 1.3779004678649223, 1.3830192973325524, 1.388131288969957, 1.3932286510875806, 1.3983038345766943, 1.403349551877017, 1.4083587936474837, 1.413324843204089, 1.4182412887998037, 1.4231020338301588, 1.4279013050543388, 1.4326336589264206, 1.437293986134409, 1.4418775144469267, 1.4463798099683514, 1.450796776903669, 1.4551246559339162, 1.4593600213023576 ], [ 1.2697901327029328, 1.2712126078353534, 1.2728142626726113, 1.2745940655961043, 1.2765506573298981, 1.2786823505440512, 1.2809871248269378, 1.28346261758625, 1.2861061119454693, 1.2889145230596886, 1.2918843844455645, 1.2950118359046134, 1.2982926144477382, 1.3017220493497201, 1.3052950621274266, 1.3090061718905475, 1.3128495061927208, 1.3168188172355735, 1.3209075030588378, 1.3251086331884694, 1.3294149781084403, 1.3338190418637588, 1.3383130970844719, 1.3428892217341428, 1.347539336923551, 1.3522552451837333, 1.3570286686557802, 1.36185128672291, 1.3667147726793658, 1.3716108290977678, 1.376531221619594, 1.3814678109513907, 1.3864125829013103, 1.3913576763365414, 1.396295408982045, 1.4012183010153254, 1.4061190964409218, 1.4109907822525132, 1.4158266054106536, 1.42062008768047, 1.4253650383869565, 1.4300555651559699, 1.4346860827173658, 1.43925131985306, 1.4437463245775715, 1.448166467642104, 1.4525074444555806, 1.4567652755175333, 1.4609363054584985, 1.4650172007836129 ], [ 1.281066106984014, 1.282527432553214, 1.2841585754336784, 1.2859583629067628, 1.2879253249419473, 1.2900576955933016, 1.2923534100809866, 1.2948100979576431, 1.297425073198188, 1.3001953223800031, 1.3031174923060793, 1.3061878784602123, 1.3094024155873007, 1.312756671495001, 1.3162458449134362, 1.3198647679639735, 1.3236079135061998, 1.32746940737643, 1.3314430453144268, 1.335522314204512, 1.3397004171332871, 1.343970301686362, 1.3483246908652853, 1.3527561159968473, 1.357256951023251, 1.3618194475967411, 1.3664357704500951, 1.3710980325701065, 1.3757983297604142, 1.3805287742398826, 1.3852815269807717, 1.3900488285453674, 1.3948230282300786, 1.3995966113710874, 1.4043622247057936, 1.4091126997193202, 1.413841073935593, 1.418540610138338, 1.4232048135291024, 1.4278274468476608, 1.4324025434951626, 1.436924418712825, 1.441387678878818, 1.4457872289941076, 1.4501182784342213, 1.45437634504875, 1.4585572576940842, 1.4626571572873894, 1.4666724964716744, 1.4706000379827184 ], [ 1.2921848199075836, 1.293681863481383, 1.2953397049883568, 1.297157048256585, 1.2991323270297603, 1.3012637077700653, 1.3035490884652754, 1.305986093717541, 1.3085720667700325, 1.3113040594255603, 1.314178820999927, 1.317192787522539, 1.32034207235507, 1.3236224592662125, 1.3270293988038135, 1.3305580085734965, 1.334203077790906, 1.3379590762436089, 1.34182016759316, 1.3457802267765901, 1.3498328611339017, 1.3539714347935556, 1.3581890957893628, 1.3624788053544206, 1.366833368835976, 1.3712454676933798, 1.3757076920743634, 1.3802125735080606, 1.3847526173022175, 1.3893203342838727, 1.393908271574689, 1.3985090421424227, 1.403115352917269, 1.4077200313054519, 1.4123160499717424, 1.416896549797771, 1.4214548609537525, 1.4259845220481098, 1.4304792973424951, 1.4349331920393789, 1.4393404656658837, 1.4436956435915, 1.4479935267286979, 1.4522291994749847, 1.4563980359625528, 1.4604957046877878, 1.4645181715977564, 1.4684617017144341, 1.4723228593801905, 1.476098507209889 ], [ 1.3031271390433985, 1.3046567878922528, 1.3063385597144548, 1.3081710510726667, 1.3101526128849479, 1.3122813543084884, 1.314555142940987, 1.3169716015248873, 1.3195281016663727, 1.3222217553483695, 1.325049405200497, 1.3280076145781474, 1.3310926584989884, 1.3343005164011241, 1.3376268675413798, 1.3410670896668573, 1.3446162613890815, 1.3482691684861772, 1.35202031416907, 1.3558639331826698, 1.3597940094780314, 1.3638042970889461, 1.3678883437755034, 1.372039516955125, 1.3762510314246938, 1.380515978381008, 1.384827355266171, 1.389178095995785, 1.3935611011664815, 1.39796926788283, 1.402395518888872, 1.4068328307346953, 1.4112742607522355, 1.4157129726554778, 1.4201422606182512, 1.4245555717171683, 1.428946526658137, 1.4333089387320506, 1.437636830969069, 1.4419244514816403, 1.4461662870040264, 1.4503570746512884, 1.4544918119333983, 1.4585657650708777, 1.462574475667222, 1.466513765800674, 1.4703797416038058, 1.4741687954040903, 1.4778776065022976, 1.4815031406682744 ], [ 1.3138759075753852, 1.3154350859618982, 1.3171380555485108, 1.318983320386292, 1.3209691608329264, 1.3230936382475715, 1.3253545963051558, 1.32774965904717, 1.3302762260672447, 1.3329314654678375, 1.335712305398303, 1.3386154250830984, 1.3416372462707222, 1.3447739259858082, 1.3480213513617947, 1.3513751371861618, 1.354830626621228, 1.3583828953871704, 1.3620267595233992, 1.365756786689903, 1.369567310838344, 1.3734524499772762, 1.3774061266774429, 1.381422090910892, 1.3854939447888093, 1.389615168754134, 1.3937791487924864, 1.397979204244888, 1.402208615834733, 1.406460653556343, 1.410728604110815, 1.4150057976144912, 1.419285633344789, 1.4235616043261634, 1.4278273205947833, 1.4320765310136432, 1.436303143540025, 1.4405012438743137, 1.4446651124433836, 1.4487892396928983, 1.452868339681518, 1.4568973619859709, 1.460871501939791, 1.4647862092402704, 1.4686371949680574, 1.4724204370722873, 1.4761321843808828, 1.4797689592014478, 1.4833275585826087, 1.4868050543092937 ], [ 1.3244158588669266, 1.3260015422745932, 1.327723024918722, 1.329578731716622, 1.331566883624941, 1.3336855029250747, 1.3359324154149783, 1.3383052495744399, 1.340801433013265, 1.3434181867222996, 1.3461525178084048, 1.3490012114958168, 1.3519608232142377, 1.3550276715720873, 1.3581978329401903, 1.361467138258838, 1.3648311725432298, 1.3682852774121124, 1.3718245568137963, 1.3754438859826, 1.379137923533512, 1.382901126498773, 1.386727768028187, 1.3906119574161913, 1.3945476620808925, 1.3985287311016412, 1.4025489199187735, 1.4066019158093, 1.4106813637719746, 1.4147808924820586, 1.4188941400074113, 1.4230147790114047, 1.4271365412029429, 1.4312532408283394, 1.4353587970329915, 1.4394472549520982, 1.4435128054187443, 1.4475498032042071, 1.451552783729337, 1.4555164782073038, 1.4594358271970234, 1.4633059925632255, 1.467122367853756, 1.4708805871172292, 1.4745765321949955, 1.4782063385306632, 1.4817663995480832, 1.4852533696553119, 1.4886641659373372, 1.491995968604691 ], [ 1.3347335245472831, 1.336342751236763, 1.3380801199112224, 1.3399439884361457, 1.3419325284733787, 1.3440437311791944, 1.3462754100785999, 1.348625201147211, 1.3510905603406598, 1.3536687589967877, 1.356356877683089, 1.35915179916139, 1.3620502011891453, 1.365048549873375, 1.3681430942446222, 1.3713298626329662, 1.3746046613171155, 1.3779630757913006, 1.3814004748638817, 1.3849120176747096, 1.3884926636024821, 1.3921371849330306, 1.3958401820777144, 1.3995961010685223, 1.4033992530127843, 1.407243835164051, 1.4111239532544282, 1.4150336447352119, 1.418966902584104, 1.422917699356611, 1.4268800111837627, 1.4308478414464325, 1.434815243886488, 1.4387763449456492, 1.4427253651530223, 1.446656639411502, 1.450564636060621, 1.4544439746190159, 1.4582894421331543, 1.462096008080235, 1.4658588377922932, 1.469573304385597, 1.473234999194529, 1.476839740722263, 1.480383582132212, 1.4838628173140211, 1.4872739855665262, 1.4906138749472413, 1.4938795243440925, 1.4970682243300062 ], [ 1.3448171389729635, 1.346447019245704, 1.34819771251053, 1.3500675204598898, 1.352054574581649, 1.3541568421277812, 1.3563721295112265, 1.3586980831369917, 1.36113218785325, 1.3636717633707987, 1.3663139591320255, 1.3690557482055983, 1.3718939208351746, 1.3748250782798532, 1.3778456275538398, 1.3809517776094349, 1.3841395374189422, 1.3874047163062944, 1.390742926766982, 1.3941495899026253, 1.3976199434912393, 1.40114905262007, 1.4047318227283263, 1.4083630148435498, 1.4120372627480946, 1.4157490917802975, 1.4194929389572661, 1.4232631741004653, 1.427054121649759, 1.4308600828639209, 1.4346753581239202, 1.4384942690778457, 1.4423111803915152, 1.4461205208953833, 1.4499168039453307, 1.453694646841517, 1.4574487891749888, 1.4611741099960822, 1.4648656437210827, 1.4685185947145298, 1.4721283505034615, 1.4756904935969704, 1.4792008118998556, 1.4826553077227205, 1.4860502054029001, 1.4893819575611167, 1.4926472500279129, 1.4958430054817378, 1.498966385847274, 1.5020147935081947 ], [ 1.354656542247808, 1.35630426576921, 1.3580657940475458, 1.3599393823763288, 1.3619231302800072, 1.3640149876412324, 1.3662127584899626, 1.3685141024430962, 1.37091653393818, 1.3734174195468591, 1.3760139737728512, 1.378703253827857, 1.3814821539326216, 1.3843473997079452, 1.3872955432040917, 1.3903229590709731, 1.3934258423017976, 1.3966002078967734, 1.3998418926982323, 1.4031465595505264, 1.4065097038436658, 1.409926662412865, 1.413392624690585, 1.416902645944974, 1.4204516623897543, 1.4240345079152315, 1.427645932167515, 1.4312806196917227, 1.4349332098533558, 1.438598317258394, 1.4422705524052668, 1.4459445423192197, 1.4496149509400507, 1.4532764990568738, 1.456923983607138, 1.4605522961809783, 1.4641564405954925, 1.4677315494260528, 1.4712728994032611, 1.4747759256041344, 1.4782362343846442, 1.4816496150176413, 1.4850120500156003, 1.4883197241313768, 1.4915690320425488, 1.494756584735834, 1.4978792146176156, 1.5009339793850656, 1.503918164699441, 1.5068292857093972 ], [ 1.3642430834378871, 1.3659059249345153, 1.3676758754215195, 1.3695511525617956, 1.3715298312942807, 1.3736098500323537, 1.37578901473971, 1.3780650008608124, 1.380435353216558, 1.3828974840997907, 1.3854486699113941, 1.388086046759329, 1.3908066054960002, 1.3936071866922075, 1.3964844760395634, 1.399435000640745, 1.4024551265927885, 1.4055410581985792, 1.4086888390614578, 1.411894355233382, 1.4151533405033245, 1.4184613838338624, 1.4218139388833677, 1.4252063354908666, 1.4286337929518542, 1.4320914348760092, 1.4355743053918928, 1.439077386448061, 1.4425956159535147, 1.4461239065017644, 1.4496571644303144, 1.45319030897994, 1.4567182913343208, 1.460236113339342, 1.4637388457216098, 1.4672216456468883, 1.470679773480188, 1.4741086086302064, 1.4775036643807362, 1.48086060163071, 1.4841752414824345, 1.4874435766340426, 1.4906617815473613, 1.4938262213762608, 1.4969334596529635, 1.4999802647409655, 1.5029636150731762, 1.5058807032025736, 1.5087289387003495, 1.5115059499430035 ], [ 1.3735695251804516, 1.3752448487844529, 1.3770208892184965, 1.378895834373189, 1.3808677412236015, 1.3829345420313348, 1.3850940486222432, 1.38734395470954, 1.3896818363472396, 1.3921051507069548, 1.394611233465131, 1.3971972951621694, 1.3998604169457807, 1.402597546136668, 1.4054054920554575, 1.4082809225277293, 1.4112203614424603, 1.414220187682644, 1.4172766356798943, 1.4203857977724554, 1.4235436284727032, 1.4267459506794582, 1.4299884638056848, 1.433266753735147, 1.4365763044739983, 1.4399125113254463, 1.4432706953876326, 1.4466461191561848, 1.4500340030026002, 1.4534295422966443, 1.4568279249443554, 1.460224349121408, 1.4636140409939107, 1.4669922722337339, 1.4703543771525684, 1.473695769297195, 1.4770119573671856, 1.4802985603352647, 1.4835513216689433, 1.4867661225699598, 1.4899389941649985, 1.4930661285970803, 1.4961438889818472, 1.4991688182065714, 1.502137646562146, 1.5050472982096175, 1.5078948964928724, 1.5106777681181327, 1.5133934462287644, 1.5160396724109566 ] ], "zauto": true, "zmax": 1.5160396724109566, "zmin": -1.5160396724109566 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.050953157833888506, 0.050100458666626956, 0.04940461223517639, 0.04887419152956057, 0.04851687448206261, 0.04833906060360056, 0.048345508078739406, 0.048539032397879635, 0.04892030322219473, 0.04948776432101637, 0.05023768444758888, 0.051164328905858564, 0.05226022653096541, 0.0535164978720805, 0.05492320848663988, 0.056469715400066116, 0.05814498270452669, 0.05993785147125665, 0.061837257644930615, 0.06383239821795089, 0.06591285038021132, 0.06806865069095763, 0.07029034208660945, 0.0725689962473954, 0.0748962179576416, 0.07726413695493513, 0.07966539159874932, 0.08209310762838885, 0.08454087438192616, 0.08700272012632017, 0.08947308759296828, 0.09194681039955961, 0.0944190907419743, 0.09688547853359895, 0.09934185203174575, 0.10178439990358752, 0.10420960463285008, 0.10661422714235388, 0.10899529249827736, 0.11135007656366509, 0.1136760934770774, 0.11597108384427893, 0.11823300354461869, 0.12046001306778194, 0.12265046731017808, 0.1248029057727646, 0.1269160431134079, 0.12898876001676002, 0.13102009435315162, 0.133009232605186 ], [ 0.04726770398514937, 0.046386832737384295, 0.04567185035717665, 0.04513247644578777, 0.04477739142930499, 0.044613745033602534, 0.04464669495814786, 0.044879035164060846, 0.045310965293738834, 0.04594003286982213, 0.046761252705773235, 0.04776738065611131, 0.0489492984695024, 0.050296457225870575, 0.05179732881322162, 0.05343982510384034, 0.05521165853187724, 0.05710063168006508, 0.059094854697568824, 0.06118289690188489, 0.06335388293663854, 0.06559754514547478, 0.06790424331675454, 0.07026496147676316, 0.07267128956275551, 0.07511539597046127, 0.07758999534510158, 0.08008831465010698, 0.08260405951013614, 0.08513138205355178, 0.08766485092836519, 0.09019942378723164, 0.09273042228860479, 0.09525350950718209, 0.09776466955932209, 0.10026018920710553, 0.1027366411925625, 0.10519086906024183, 0.10761997324393278, 0.11002129821677803, 0.11239242052963763, 0.11473113758824104, 0.11703545704400964, 0.11930358669566302, 0.12153392481855502, 0.12372505085593558, 0.1258757164211463, 0.1279848365722043, 0.13005148133059674, 0.13207486742455052 ], [ 0.04362462139208047, 0.04271435321414565, 0.041979727881159015, 0.04143185810432585, 0.04108063617442665, 0.04093409378574175, 0.040997807519684196, 0.04127443780712635, 0.04176347463537825, 0.042461229146810185, 0.043361065936222944, 0.044453829770658024, 0.045728394193323446, 0.04717225296695342, 0.04877208604972179, 0.05051425259484476, 0.052385186445396095, 0.05437168906101775, 0.05646112816308675, 0.05864155754601452, 0.06090177579679377, 0.0632313408110447, 0.06562055450632648, 0.06806042909449923, 0.07054264333469981, 0.07305949466525952, 0.07560385110934698, 0.07816910534739757, 0.08074913227686648, 0.08333825064778141, 0.0859311888866846, 0.08852305493057552, 0.09110930973004826, 0.09368574400473036, 0.09624845781370156, 0.09879384251719675, 0.10131856473893203, 0.10381955198095569, 0.10629397958879075, 0.1087392588098824, 0.1111530257307486, 0.11353313091661067, 0.11587762961113032, 0.11818477238319697, 0.1204529961326812, 0.12268091538802423, 0.1248673138459313, 0.12701113611765227, 0.12911147965780626, 0.1311675868608345 ], [ 0.04003877683859754, 0.03909765609151712, 0.03834274187461093, 0.037786859718050514, 0.037441383487591434, 0.03731538704955066, 0.03741486683168528, 0.03774216816846747, 0.038295720762451704, 0.03907012847130796, 0.04005658539738458, 0.041243529285565475, 0.04261741290145764, 0.04416347793722312, 0.0458664444137934, 0.04771106643065355, 0.049682539690067376, 0.05176677072878711, 0.05395053110060543, 0.05622152407324281, 0.05856838998454314, 0.060980672139238655, 0.06344876003047449, 0.06596382188444103, 0.0685177345579105, 0.07110301578364832, 0.07371276157595671, 0.07634059011973175, 0.07898059250339723, 0.08162729007103181, 0.0842755978441517, 0.08692079331082399, 0.0895584898358639, 0.09218461396730936, 0.0947953859718459, 0.09738730300657918, 0.09995712441460772, 0.10250185871021524, 0.1050187518922611, 0.10750527678961883, 0.10995912319961479, 0.11237818862947466, 0.11476056949229393, 0.11710455264370967, 0.11940860717408666, 0.12167137639437987, 0.12389166997271593, 0.12606845619373977, 0.1282008543245916, 0.1302881270804774 ], [ 0.036527038570002536, 0.03555335106803985, 0.03477734597765563, 0.03421398080399137, 0.03387646177115061, 0.033775097998933246, 0.033916269089259383, 0.0343017123646791, 0.034928282137133206, 0.03578822458691444, 0.03686988983579326, 0.03815871560867199, 0.0396382912232399, 0.04129134136565639, 0.04310052990904203, 0.0450490465506687, 0.04712098564668305, 0.049301552474309215, 0.05157714073163161, 0.05393532275409177, 0.05636478644597932, 0.05885524418049082, 0.06139733098492936, 0.06398250299999303, 0.06660294256897079, 0.06925147313588073, 0.07192148507910517, 0.07460687236366664, 0.07730197920406402, 0.08000155559819988, 0.08270072048542569, 0.08539493130569331, 0.08807995883200273, 0.09075186627655042, 0.09340699180912086, 0.09604193376094532, 0.09865353791141848, 0.10123888636549544, 0.10379528762539686, 0.10632026754184432, 0.10881156089858113, 0.11126710344073173, 0.1136850242042449, 0.11606363804155193, 0.11840143826909819, 0.12069708938669133, 0.12294941983772655, 0.12515741479417272, 0.12732020896150334, 0.12943707940717372 ], [ 0.033108792139786646, 0.03210056062073702, 0.03130250891907887, 0.030732281409029373, 0.0304053765791664, 0.03033356664229924, 0.0305235047334004, 0.030975848451450176, 0.03168511942772205, 0.03264031659229606, 0.03382609791515556, 0.03522423131900483, 0.03681502045270437, 0.038578500602660666, 0.04049531377156652, 0.04254726373357148, 0.04471760450485781, 0.04699113366359827, 0.049354158176134554, 0.05179438686618035, 0.05430078824912009, 0.056863439008196806, 0.05947337815773781, 0.06212247482256622, 0.06480331295443631, 0.06750909351959454, 0.07023355313987373, 0.0729708974108877, 0.0757157468455783, 0.07846309339436144, 0.08120826564339738, 0.08394690101002836, 0.08667492349190821, 0.08938852575774645, 0.09208415457948406, 0.09475849879265512, 0.09740847913231386, 0.10003123942751742, 0.10262413875020648, 0.10518474420715623, 0.10771082413939238, 0.11020034155456737, 0.11265144766678088, 0.11506247545717688, 0.11743193319917145, 0.11975849791589252, 0.12204100875555252, 0.12427846028413053, 0.12646999570473783, 0.12861490002015846 ], [ 0.029806666023326482, 0.02876170141853543, 0.027940541838189913, 0.027364258158440926, 0.027051246726823127, 0.027014999485537358, 0.02726219611151968, 0.027791656588593006, 0.02859446336711749, 0.029655178942931692, 0.030953754613915804, 0.03246760898248339, 0.03417345407291654, 0.03604864947612423, 0.03807205145593171, 0.04022443675172382, 0.042488620909487254, 0.044849385099819006, 0.04729330005923799, 0.049808507729079375, 0.05238449783165298, 0.055011899838328764, 0.057682299819578904, 0.060388085050150156, 0.06312231556700659, 0.06587862005893871, 0.06865111275389818, 0.07143432787651086, 0.07422316847422505, 0.0770128667787852, 0.07979895368047843, 0.08257723529256542, 0.08534377494717751, 0.08809487928164085, 0.09082708734449052, 0.09353716187614311, 0.09622208210519745, 0.09887903755298182, 0.10150542246156781, 0.10409883055873656, 0.10665704995168081, 0.10917805800297052, 0.11166001609077571, 0.11410126419282329, 0.11650031526238333, 0.118855849386268, 0.12116670773093724, 0.12343188629438347, 0.1256505294895166, 0.12782192358999386 ], [ 0.026647552764533084, 0.025563627303304932, 0.024718341661880014, 0.024137179434456736, 0.023842229131749063, 0.023848961747678442, 0.024163583683807003, 0.024781869028441674, 0.025689875554361877, 0.02686621260204437, 0.028285026014620858, 0.029918843101555993, 0.03174074751839537, 0.033725739846461544, 0.03585139496400668, 0.03809802324779674, 0.04044853489595164, 0.04288815730615068, 0.045404102398305356, 0.047985239128808185, 0.05062179849236478, 0.05330512142475723, 0.05602745071751895, 0.05878176345997016, 0.06156163864761592, 0.06436115418760624, 0.06717480785224392, 0.06999745736458045, 0.0728242755235831, 0.07565071697913082, 0.07847249389943035, 0.08128555831854545, 0.08408608940928676, 0.08687048430399942, 0.08963535139303958, 0.09237750527864241, 0.09509396276032651, 0.09778193938585242, 0.10043884622654148, 0.1030622866337177, 0.10565005280947878, 0.10820012208408591, 0.11071065283752993, 0.11317998003707933, 0.11560661038806566, 0.11798921711377673, 0.12032663439338342, 0.1226178514957061, 0.12486200665213497, 0.12705838071497932 ], [ 0.023664021060870673, 0.022539293378229876, 0.021669265875277035, 0.02108513199269811, 0.020813691215306063, 0.02087258201546974, 0.021266585580560913, 0.021986544778419548, 0.02301132142299257, 0.02431181237729803, 0.025855401313647868, 0.027609576168226114, 0.029544221794742875, 0.03163270454701073, 0.03385211488658089, 0.03618303176210185, 0.03860907254607884, 0.041116387699270576, 0.043693182576623975, 0.0463293014786837, 0.04901588320126229, 0.05174508475035087, 0.05450986470976598, 0.05730381637812338, 0.06012104120687541, 0.06295605420594656, 0.06580371430894003, 0.06865917396308106, 0.07151784333365861, 0.07437536546311158, 0.07722759950786158, 0.0800706098107897, 0.08290065907661867, 0.0857142043230918, 0.08850789460215285, 0.09127856973841426, 0.09402325953085602, 0.09673918301858792, 0.09942374753185369, 0.10207454734215683, 0.10468936179628875, 0.10726615287274127, 0.10980306213904097, 0.11229840711793894, 0.11475067709146873, 0.11715852838638062, 0.11952077919396878, 0.12183640398291498, 0.12410452756641374, 0.12632441888527066 ], [ 0.020896163216074414, 0.019730098366699887, 0.018835899478759924, 0.01825210178996539, 0.01801143943434988, 0.018133659033364412, 0.018620400241197575, 0.019454779741795155, 0.02060576682043418, 0.022034891402071332, 0.02370240102091082, 0.025571332250264527, 0.027609434989020996, 0.02978959253111333, 0.032089431022271034, 0.0344906049769938, 0.036978029839419564, 0.03953918560976754, 0.042163533827905844, 0.044842050980014925, 0.04756686545093656, 0.05033098055745666, 0.053128066564076204, 0.05595230677069919, 0.058798285359242836, 0.06166090712005407, 0.0645353412607305, 0.06741698320458468, 0.07030142965111529, 0.073184463250934, 0.07606204409678725, 0.07893030589729762, 0.08178555521969944, 0.08462427259281682, 0.08744311457665949, 0.09023891614924244, 0.09300869295004129, 0.0957496430645395, 0.09845914814514198, 0.10113477374763824, 0.10377426882524007, 0.10637556436859248, 0.10893677121372881, 0.11145617706349566, 0.11393224278391763, 0.11636359804692457, 0.1187490363964139, 0.12108750981669104, 0.12337812288198619, 0.1256201265634733 ], [ 0.01839367538892504, 0.017188859704141392, 0.016273826018024965, 0.01569627486107808, 0.015496092795148582, 0.01569445516000629, 0.016287007438004153, 0.017245448986622287, 0.01852617981722777, 0.02008059361501353, 0.021862622419050622, 0.0238324434264114, 0.02595735156594906, 0.02821115914005975, 0.03057307040939452, 0.03302651730711368, 0.035558148208429737, 0.03815701587181736, 0.04081395128816468, 0.04352109202370168, 0.046271532398802245, 0.049059067295971606, 0.051878006946741016, 0.05472304508756915, 0.05758916698723069, 0.060471587059324525, 0.06336570823643976, 0.06626709716079338, 0.06917147067880543, 0.07207469022253225, 0.074972761501203, 0.07786183757220777, 0.08073822385857028, 0.08359838406324031, 0.08643894622547314, 0.08925670839074676, 0.09204864353843745, 0.09481190354246018, 0.09754382203862601, 0.10024191614557655, 0.10290388703964459, 0.10552761942216395, 0.1081111799441549, 0.11065281467069826, 0.11315094567779391, 0.11560416687980513, 0.11801123918702382, 0.12037108509151824, 0.12268278277595956, 0.12494555983532026 ], [ 0.016217222534629955, 0.014982536746154759, 0.014055610575623293, 0.013494722885551395, 0.01334742430113217, 0.013634392857268992, 0.01434124128191892, 0.01542456578675485, 0.016826969762440823, 0.01849095329322236, 0.020366570025648716, 0.022413596936969368, 0.024600794765661654, 0.02690419242510882, 0.02930533703763272, 0.03178983308402382, 0.03434621829575503, 0.0369651302424177, 0.039638699449184876, 0.04236011191407008, 0.04512329632358321, 0.047922702637776336, 0.05075314758765711, 0.05360970916147416, 0.05648765687921541, 0.05938240806744876, 0.062289502833198486, 0.06520459226848635, 0.06812343578459099, 0.07104190450568984, 0.07395598843481518, 0.07686180570341894, 0.07975561267424582, 0.08263381401853476, 0.08549297215716278, 0.08832981565980194, 0.09114124635076609, 0.0939243449858938, 0.09667637545030777, 0.09939478748892294, 0.10207721802546413, 0.10472149115568113, 0.10732561691979572, 0.10988778897042362, 0.1124063812574511, 0.11487994385208652, 0.1173071980298527, 0.11968703072753319, 0.12201848848278947, 0.12430077095787938 ], [ 0.01443647935291141, 0.013191512073647028, 0.01227125578136077, 0.011744084368763535, 0.011663475246474772, 0.012045892509286294, 0.012863019172631152, 0.014055244109951447, 0.015553682264999273, 0.017295842826763504, 0.019231517375885226, 0.02132261942262621, 0.023540846582085086, 0.025865145403123135, 0.028279631008620278, 0.030772041061879037, 0.03333263079237233, 0.035953394358930434, 0.03862751865837973, 0.04134900125554963, 0.04411238461266123, 0.04691257335325521, 0.04974471121431375, 0.05260410105274835, 0.055486155864594634, 0.05838637197876905, 0.06130031787328216, 0.06422363372911209, 0.0671520380758762, 0.07008133881736434, 0.0730074466358372, 0.07592638931804677, 0.07883432596297227, 0.08172756035048147, 0.08460255299325828, 0.08745593157822724, 0.09028449964124065, 0.09308524342025143, 0.09585533690557979, 0.09859214515757338, 0.10129322599695746, 0.10395633019550427, 0.10657940030736136, 0.10916056828696032, 0.11169815203977455, 0.11419065104879646, 0.11663674121355255, 0.11903526903071032, 0.12138524523643993, 0.12368583802124487 ], [ 0.0131200176822175, 0.011898317778139947, 0.011015563314648799, 0.010545610426378665, 0.01054207565090663, 0.011012586517171685, 0.011914749679174374, 0.013177537196969204, 0.014727234016423018, 0.016501850196253266, 0.01845425149195446, 0.020550043443973303, 0.02276431779855737, 0.025078828458605682, 0.027479899938491908, 0.02995696409036897, 0.0325015542816, 0.03510661542092311, 0.037766029731575584, 0.0404742909974211, 0.043226282412199356, 0.04601712771526785, 0.048842094671594366, 0.05169653607449825, 0.05457585755073854, 0.05747550428349178, 0.06039096079259608, 0.06331775939618094, 0.06625149409079194, 0.06918783743358307, 0.0721225586596799, 0.07505154176748471, 0.07797080268889259, 0.08087650495518899, 0.08376497349232764, 0.08663270634654936, 0.08947638426488388, 0.0922928781446138, 0.09507925442884954, 0.09783277856817989, 0.10055091669560431, 0.10323133567759565, 0.1058719017110562, 0.10847067763652818, 0.1110259191341004, 0.1135360699613896, 0.11599975638382784, 0.11841578093709844, 0.12078311565045886, 0.12310089484838438 ], [ 0.012313089777658746, 0.011158429485364734, 0.010351262851330851, 0.009961527145110888, 0.010034139737814259, 0.010565767923299151, 0.011506522971201047, 0.012784328287065293, 0.014329105512076074, 0.01608408991731535, 0.01800704467118187, 0.02006749504080579, 0.02224345879656208, 0.024518804882876034, 0.026881360868443373, 0.029321611884340362, 0.03183181509757971, 0.03440539615107567, 0.0370365367939327, 0.03971989390983688, 0.04245041041058044, 0.04522319129982382, 0.04803342636997614, 0.05087634629807141, 0.053747202473912535, 0.0566412633869004, 0.05955382220376008, 0.062480211515544434, 0.06541582225651825, 0.06835612458610489, 0.07129668913523307, 0.07423320749028844, 0.07716151115092057, 0.08007758847497777, 0.08297759933268539, 0.08585788734730432, 0.08871498971235824, 0.09154564465558158, 0.09434679667443259, 0.09711559970329889, 0.09984941839335462, 0.10254582769584786, 0.1052026109416567, 0.10781775660626139, 0.11038945394175617, 0.11291608764736989, 0.11539623173825503, 0.11782864275972361, 0.12021225248122415, 0.12254616019155244 ], [ 0.012010027289462304, 0.010962025896144305, 0.010260249116023539, 0.009960762099567784, 0.010093557015981044, 0.010647158315682978, 0.011574026180341824, 0.012811113759479714, 0.0142983123993739, 0.015986782808779458, 0.017839738793370835, 0.019830221348263514, 0.02193845450388694, 0.024149668697002705, 0.02645251041284223, 0.02883792950633643, 0.03129841083242927, 0.03382744491189976, 0.036419164065925755, 0.039068094374835244, 0.04176898986409674, 0.0445167257024124, 0.04730623393065507, 0.05013246971898453, 0.05299039924008468, 0.05587500246444622, 0.058781285830863006, 0.06170430099996391, 0.06463916686889881, 0.06758109278096636, 0.0705254014524446, 0.0734675505948317, 0.07640315256104115, 0.07932799160992617, 0.08223803858220828, 0.08512946292661044, 0.08799864211919185, 0.09084216859102114, 0.09365685432681015, 0.0964397333261079, 0.09918806213378233, 0.10189931865151863, 0.10457119943991541, 0.10720161571348158, 0.10978868822034674, 0.11233074118583056, 0.11482629548521582, 0.1172740611968263, 0.11967292967224417, 0.12202196524656203 ], [ 0.0121430163370861, 0.011220954219893619, 0.01063199074673553, 0.010413974803812148, 0.01058229822995607, 0.011122395575700439, 0.011995417815809891, 0.013152082233528924, 0.014544830188062819, 0.01613379170633415, 0.017887822215812924, 0.01978326673625809, 0.02180218648664758, 0.023930766226669065, 0.026158078336112094, 0.028475178196587292, 0.030874457980221474, 0.0333491904990167, 0.03589321067886956, 0.03850069682332827, 0.04116602463560622, 0.04388367444745453, 0.046648177238678666, 0.049454088629675666, 0.05229598263567944, 0.05516845892344582, 0.058066158812089146, 0.060983786433109546, 0.06391613238846461, 0.06685809797259076, 0.06980471859328505, 0.07275118546744092, 0.07569286500520665, 0.07862531555063385, 0.08154430133506811, 0.08444580363567639, 0.08732602922693257, 0.09018141627717509, 0.09300863788293119, 0.09580460345662932, 0.09856645819333042, 0.10129158084273135, 0.10397758000688048, 0.10662228917381551, 0.10922376068434127, 0.11178025881453352, 0.11429025214119533, 0.11675240534197913, 0.11916557056666259, 0.12152877850141035 ], [ 0.012601840383120797, 0.011800673709070522, 0.011310440595060627, 0.011152806237571762, 0.011332842936211923, 0.01183643262588882, 0.012634544776869755, 0.013691348471320008, 0.014971435708875637, 0.016443832384358054, 0.018083155432088768, 0.01986919353112529, 0.021785924827571593, 0.02382049525414324, 0.02596235059995923, 0.028202558818455077, 0.030533302466461142, 0.03294750819285174, 0.03543858233980009, 0.03800022744409628, 0.04062631992430446, 0.04331083365073205, 0.04604779747868553, 0.04883127742834605, 0.051655376233955407, 0.054514244611644634, 0.05740209990638203, 0.060313248837525604, 0.0632421119142443, 0.0661832477705318, 0.06913137620356169, 0.07208139911310332, 0.07502841885539453, 0.07796775376105583, 0.08089495073934462, 0.08380579501400286, 0.08669631712030572, 0.08956279734781579, 0.09240176784626783, 0.09521001262847918, 0.09798456570906647, 0.10072270761417686, 0.10342196048836445, 0.10608008201187794, 0.10869505832666948, 0.11126509615326975, 0.11378861426418051, 0.11626423446310612, 0.11869077220354304, 0.12106722696520444 ], [ 0.013269381868479299, 0.012567957615859604, 0.012151655096878008, 0.012030607968344143, 0.012203879106022584, 0.012659160199977353, 0.013375602035185468, 0.014328213830356217, 0.015491811535610725, 0.01684344919813698, 0.01836336982437003, 0.020035004140947554, 0.0218445268157515, 0.023780289537873246, 0.02583228426534763, 0.027991692155681987, 0.030250527638582984, 0.032601369199757056, 0.03503716326573576, 0.03755108734736929, 0.04013645999243464, 0.042786686866696004, 0.0454952340163984, 0.048255620947772, 0.05106142756538155, 0.05390631023899542, 0.05678402332208038, 0.05968844333207644, 0.06261359373481559, 0.0655536688677652, 0.06850305600626429, 0.07145635494147869, 0.0744083947157326, 0.07735424736644118, 0.08028923867827112, 0.08320895604678555, 0.08610925362587635, 0.08898625497418305, 0.09183635343915872, 0.09465621052674594, 0.09744275250382119, 0.10019316547292065, 0.10290488914647292, 0.10557560953265872, 0.10820325072841776, 0.11078596599786819, 0.11332212829715786, 0.11581032039000502, 0.11824932468216971, 0.12063811288798842 ], [ 0.014047806079797722, 0.013419159814737494, 0.013050586810854569, 0.012944971001929997, 0.01309827246602575, 0.013500131437346172, 0.014135698710434649, 0.014987931682551475, 0.016039570853876528, 0.01727440221964486, 0.018677820507062976, 0.020236908472421124, 0.021940259306498112, 0.023777701510820638, 0.025740014825221133, 0.027818677775924325, 0.03000566104058559, 0.03229326814650078, 0.034674019512714906, 0.03714057374707314, 0.03968567957692904, 0.04230215200023081, 0.04498286681729287, 0.04772076845264336, 0.05050888678824178, 0.05334035953079387, 0.05620845737916478, 0.05910660991572581, 0.06202843070555436, 0.06496774054900435, 0.06791858820252306, 0.07087526816985479, 0.07383233538333975, 0.07678461675465408, 0.07972721968760792, 0.08265553772237001, 0.08556525352916215, 0.08845233949704887, 0.09131305617550323, 0.09414394882730263, 0.09694184234446773, 0.09970383476692132, 0.10242728962827115, 0.10510982733601533, 0.1077493157755238, 0.11034386030920514, 0.11289179332460418, 0.11539166346838194, 0.11784222468716232, 0.12024242518139042 ], [ 0.014867771459695842, 0.014285643430347822, 0.013941596731716363, 0.013834290542835975, 0.01395824955981846, 0.014304777646290163, 0.014863201229964382, 0.015622055399289082, 0.016569946202900608, 0.01769602171597935, 0.018990129148304995, 0.020442782404987182, 0.022045045084957245, 0.02378839390948915, 0.025664594151176657, 0.027665598653984772, 0.0297834725172009, 0.032010341763095744, 0.034338363055011124, 0.0367597111727333, 0.03926658089129627, 0.0418511999935552, 0.044505850350508684, 0.04722289431126355, 0.04999480402680265, 0.05281419174981004, 0.055673839570265775, 0.05856672743565583, 0.061486058647809046, 0.06442528231760927, 0.06737811249296397, 0.0703385438580079, 0.07330086403856682, 0.07625966264745485, 0.07920983727050049, 0.08214659663659254, 0.08506546123845456, 0.08796226167998777, 0.09083313502476535, 0.09367451941177211, 0.09648314719107148, 0.09925603681567617, 0.10199048370771094, 0.10468405029813942, 0.10733455542041526, 0.10994006322005545, 0.11249887172446507, 0.11500950120077405, 0.11747068241387106, 0.11988134488247384 ], [ 0.01568694244036913, 0.015128537687070938, 0.014789972303180512, 0.014667597640341921, 0.014755401379448602, 0.015046008047224715, 0.015531609353680465, 0.016204595705528936, 0.017057820987197325, 0.018084574646145872, 0.019278396868334557, 0.020632859471331793, 0.022141386827025974, 0.023797143652408894, 0.025592986315753435, 0.027521461774218173, 0.029574837026844287, 0.031745145604815866, 0.03402424210187971, 0.036403859340911185, 0.038875665131302924, 0.04143131693100981, 0.04406251344416836, 0.04676104255081084, 0.04951882516537858, 0.05232795475413688, 0.0551807323524006, 0.05806969702439672, 0.060987651802904524, 0.06392768522925527, 0.0668831886838193, 0.06984786975129492, 0.07281576190381749, 0.07578123080948815, 0.07873897758613002, 0.08168403932227704, 0.0846117871816097, 0.08751792239543572, 0.09039847043201152, 0.09324977361299752, 0.09606848242726987, 0.09885154577157065, 0.10159620032675237, 0.10429995925805748, 0.10696060040843043, 0.10957615413538618, 0.11214489092464952, 0.11466530889766538, 0.11713612131521393, 0.11955624416570329 ], [ 0.016484878609949943, 0.01593156163007077, 0.015583433491500624, 0.01543570120923128, 0.01548229243024122, 0.01571686915224608, 0.016133607063643293, 0.0167275706738698, 0.017494677593465995, 0.018431373872613607, 0.01953419098759216, 0.020799331202655216, 0.02222236773182715, 0.023798085181710386, 0.025520444162316098, 0.02738263528319669, 0.0293771860872161, 0.03149609159388272, 0.03373094862739719, 0.036073082478254054, 0.03851366047191847, 0.04104379076180332, 0.043654606687713496, 0.046337337954088634, 0.04908337016329993, 0.05188429420664586, 0.05473194685565183, 0.057618443706778905, 0.060536205457265124, 0.06347797834311403, 0.06643684945333024, 0.069406257542723, 0.07237999989293216, 0.0753522357128639, 0.0783174865208652, 0.08127063390915146, 0.08420691505392378, 0.08712191630110418, 0.09001156512689683, 0.09287212074387727, 0.0957001635968276, 0.09849258396785662, 0.1012465698874608, 0.1039595945268263, 0.10662940322705924, 0.10925400030279822, 0.1118316357410108, 0.11436079190042772, 0.11684017030305775, 0.1192686785964783 ], [ 0.017257774663861622, 0.016694946272977178, 0.01632573330271898, 0.016144893256825544, 0.016146548545314218, 0.01632519404236633, 0.01667641628334851, 0.01719716911982331, 0.0178856033870052, 0.018740575763426002, 0.019761021385824078, 0.020945362744722827, 0.02229106932316074, 0.02379441217015733, 0.025450401031955967, 0.027252859941073914, 0.029194588629136303, 0.03126756363914759, 0.0334631458582588, 0.03577227426574962, 0.038185636017394504, 0.040693809877173276, 0.04328738395233344, 0.045957050551505826, 0.04869368157186213, 0.05148838772547643, 0.054332564518169243, 0.057217927411938166, 0.060136538142691195, 0.06308082377126645, 0.06604358972764758, 0.06901802785926589, 0.07199772030291449, 0.07497663985333279, 0.07794914738915613, 0.08090998682986066, 0.08385427802866353, 0.0867775079512384, 0.08967552044497665, 0.0925445048656515, 0.09538098379611605, 0.09818180006371727, 0.10094410323851925, 0.10366533577266684, 0.10634321892170524, 0.10897573857115458, 0.1115611310758093, 0.11409786920495459, 0.11658464827368395, 0.119020372528817 ], [ 0.018014008492538085, 0.01743076878060997, 0.017032036373902756, 0.016812527827705266, 0.016766695924566193, 0.01688972918486128, 0.017178259531321703, 0.017630619014817033, 0.018246625076341578, 0.019027002911493143, 0.019972629600466744, 0.021083792885535642, 0.022359610373985952, 0.023797681243800186, 0.0253939722663966, 0.027142892657357455, 0.029037492902492117, 0.031069725295164184, 0.03323071829317672, 0.035511034077831044, 0.03790089356732406, 0.04039036364930009, 0.04296950769595111, 0.04562850353228645, 0.04835773408144752, 0.051147855822155204, 0.053989849578119184, 0.05687505737982374, 0.05979520838332083, 0.06274243617801822, 0.06570928928712852, 0.06868873625290908, 0.071674166385653, 0.07465938702045444, 0.07763861795017032, 0.08060648357172524, 0.08355800318407375, 0.08648857980083491, 0.08939398778226156, 0.09227035954520937, 0.09511417157275172, 0.09792222991459953, 0.1006916553439638, 0.10341986831470364, 0.10610457384371498, 0.10874374642692992, 0.11133561508262878, 0.11387864860264149, 0.1163715410802405, 0.11881319777295932 ], [ 0.018770464988291283, 0.01815927849022063, 0.017725368536092072, 0.01746364061069693, 0.01736894434723787, 0.01743706710643528, 0.017665453975687247, 0.01805348462035956, 0.018602261363884553, 0.01931399266610787, 0.020191148441832833, 0.021235593904767813, 0.022447876976184677, 0.023826772243923953, 0.025369103457778656, 0.027069803551665186, 0.028922138869422083, 0.03091802051610052, 0.033048340028469646, 0.03530328739215928, 0.03767262886766269, 0.04014593651018035, 0.04271277021576556, 0.04536281768129625, 0.04808599929300434, 0.05087254491679018, 0.05371304873411757, 0.05659850718112041, 0.05952034398482473, 0.06247042537005544, 0.06544106776716793, 0.0684250397749133, 0.07141555969873699, 0.07440628966291109, 0.07739132705872802, 0.0803651939180031, 0.08332282467442396, 0.08625955268181668, 0.08917109578858341, 0.09205354121480777, 0.09490332993771118, 0.09771724075908228, 0.10049237420240532, 0.10322613636607131, 0.1059162228412058, 0.1085606027871974, 0.11115750324470428, 0.11370539375411645, 0.11620297133695048, 0.1186491458882941 ], [ 0.0195493952276767, 0.01890579171178809, 0.018433602064768056, 0.018128034638898668, 0.017984356794690917, 0.017998884058802615, 0.018169721671676103, 0.018497077835498206, 0.01898307786108522, 0.019631137071361122, 0.020445055772487557, 0.02142805054112177, 0.02258192178999432, 0.0239064911708109, 0.025399354138743488, 0.027055915550318416, 0.028869629994178476, 0.030832356678813115, 0.032934751387857966, 0.035166641659382096, 0.03751735520709109, 0.039975990093678734, 0.04253162697846388, 0.04517348992545081, 0.04789106454572295, 0.05067418228605828, 0.053513078635063174, 0.056398431617239286, 0.059321385564984744, 0.06227356396465062, 0.0652470742117499, 0.06823450637084975, 0.0712289274825242, 0.0742238725541539, 0.07721333307725174, 0.08019174370238367, 0.08315396755052372, 0.08609528053009247, 0.08901135494932906, 0.09189824265529417, 0.09475235788729303, 0.09757045999943824, 0.10034963618138051, 0.1030872842858012, 0.10578109585451671, 0.10842903942109812, 0.11102934415598659, 0.11358048390967654, 0.11608116170041169, 0.11853029468464502 ], [ 0.020375641576067166, 0.019697914285292332, 0.019186698476187532, 0.01883754255521189, 0.01864611924889444, 0.018609209748377976, 0.01872546710256715, 0.01899576954029682, 0.01942307104139421, 0.020011781702503208, 0.02076682499471731, 0.021692587678162418, 0.022791981515001693, 0.024065778427387795, 0.025512289176366956, 0.02712736600373813, 0.02890464966219227, 0.03083595988406664, 0.032911737895596, 0.03512147504359601, 0.037454089521442656, 0.0398982357715857, 0.04244254599157727, 0.04507581111240959, 0.04778711168025441, 0.05056590924986853, 0.05340210767084953, 0.0562860919387762, 0.05920875058592376, 0.06216148611708318, 0.0651362168168644, 0.06812537235187864, 0.07112188492060344, 0.07411917721602894, 0.07711114811648666, 0.08009215677143368, 0.08305700557300047, 0.08600092237961629, 0.08891954226975037, 0.09180888904061797, 0.09466535662102421, 0.0974856905339203, 0.10026696951904339, 0.10300658740652971, 0.10570223531709051, 0.10835188425175528, 0.11095376812379582, 0.1135063672763979, 0.11600839252187946, 0.11845876973124643 ], [ 0.021274192416209384, 0.020563042956050832, 0.02001416057010366, 0.019623422483137528, 0.019386870991661507, 0.019301689345087577, 0.019366981557934034, 0.019584162435826728, 0.01995684833817808, 0.020490258505859157, 0.021190255756289023, 0.022062237666336623, 0.023110109469177107, 0.02433552398455689, 0.025737483377387207, 0.027312299144374552, 0.029053833887236754, 0.030953916543525844, 0.03300282740602551, 0.03518977507681768, 0.03750331871605553, 0.03993171544923236, 0.042463190806776, 0.04508613999966127, 0.047789271856920834, 0.050561707694796405, 0.053393046048191686, 0.05627340221633977, 0.05919342957736853, 0.062144327888532455, 0.0651178423932397, 0.0681062564892759, 0.07110237992400298, 0.07409953391202649, 0.07709153416499871, 0.08007267253752617, 0.08303769779316732, 0.0859817958552695, 0.08890056981016817, 0.09179001986237006, 0.09464652339335522, 0.09746681524150998, 0.100247968295778, 0.10298737447721457, 0.10568272616845839, 0.10833199814004232, 0.11093343001333549, 0.11348550929233646, 0.11598695498990898, 0.11843670186824909 ], [ 0.0222681392732472, 0.021526239905576998, 0.020942814531835077, 0.020514032840714524, 0.020236258347847473, 0.020107009896175854, 0.020125748521539765, 0.02029429667030272, 0.020616769504889273, 0.021099009037604064, 0.021747630346289012, 0.022568880159286837, 0.023567542762792895, 0.02474609575105614, 0.026104233355678255, 0.027638772591906068, 0.029343874124762324, 0.031211466983311627, 0.03323176409430868, 0.035393779735587716, 0.037685793166553495, 0.04009573256008866, 0.04261147452480985, 0.04522106666116078, 0.04791288585362384, 0.05067574593675973, 0.05349896707378219, 0.0563724170280848, 0.05928653225839342, 0.06223232478285864, 0.06520137915209602, 0.0681858426410241, 0.07117841085964773, 0.07417231032647915, 0.07716127908291022, 0.08013954610088384, 0.08310181000999906, 0.08604321751404138, 0.08895934175946255, 0.09184616084439386, 0.09470003660574013, 0.0975176937864159, 0.10029619965974801, 0.10303294417019239, 0.1057256206362525, 0.10837220705151356, 0.1109709480117671, 0.11352033728977338, 0.1160191010737269, 0.1184661818807029 ], [ 0.023377154743788073, 0.022608637010975336, 0.021995120935350266, 0.021533026469707738, 0.0212189891104305, 0.02105079824572021, 0.021028178999092813, 0.021153230514903275, 0.021430395918058, 0.021865939956845586, 0.022467023799628054, 0.023240560827342993, 0.024192083092513767, 0.02532482978327748, 0.026639194368058526, 0.028132566083667983, 0.029799511442752405, 0.031632188525460535, 0.03362087617897136, 0.03575452020803006, 0.03802123171931373, 0.04040870492780499, 0.04290454577076582, 0.04549651723144368, 0.04817271410649868, 0.05092168170202357, 0.053732491928499854, 0.05659478808627267, 0.05949880722253566, 0.062435386754197894, 0.06539596025496432, 0.06837254591540286, 0.0713577301510069, 0.07434464808478308, 0.07732696209959868, 0.08029883928360113, 0.0832549283345295, 0.08619033631177139, 0.08910060550413504, 0.09198169059894482, 0.09482993628203955, 0.09764205536002586, 0.10041510746989477, 0.10314647842289221, 0.1058338602166065, 0.10847523173984787, 0.11106884018778866, 0.1136131831992914, 0.11610699172373214, 0.11854921362076372 ], [ 0.024616580019641645, 0.023826494598723862, 0.023188181083320963, 0.02269827553100381, 0.022353645220435557, 0.02215229322889489, 0.022094121738173034, 0.022181377733381462, 0.02241865773677156, 0.022812437574568134, 0.023370197845987675, 0.02409930829456407, 0.02500588697993376, 0.026093844943297022, 0.02736426568877105, 0.028815174928206982, 0.030441664484021292, 0.03223627345714731, 0.034189509875552186, 0.036290409393462175, 0.03852705809450442, 0.04088703918302731, 0.04335778953450372, 0.045926868998642685, 0.048582154052552375, 0.0513119703440796, 0.0541051782609451, 0.05695122369540579, 0.05984016375031578, 0.06276267482701565, 0.06571004858912807, 0.06867417976202377, 0.07164754857126412, 0.07462319977777249, 0.07759471966282468, 0.08055621189046899, 0.08350227287933414, 0.08642796711224764, 0.089328802673044, 0.09220070720547423, 0.09504000442520182, 0.09784339127273638, 0.10060791576592176, 0.10333095559081829, 0.1060101974561942, 0.10864361722729836, 0.11122946084775892, 0.1137662260533185, 0.11625264487708363, 0.11868766694274509 ], [ 0.025997124170977052, 0.025190934299527203, 0.024533481659334104, 0.024021599528663784, 0.023652361482511763, 0.023423941053347372, 0.023336343043831816, 0.023391844609447772, 0.023595029114364115, 0.023952373337395947, 0.024471441998997392, 0.025159830001250476, 0.026024047835915172, 0.02706855109834091, 0.02829506823290247, 0.029702298460539622, 0.031285964177908646, 0.03303913712538913, 0.03495272916174185, 0.03701604355703977, 0.03921730806717989, 0.041544142221502794, 0.04398393834661637, 0.04652415472864096, 0.049152530003681076, 0.05185723233208506, 0.05462695747309149, 0.05745098841390967, 0.06031922697339575, 0.06322220550347889, 0.06615108478527608, 0.06909764257201721, 0.07205425596391188, 0.07501387985781827, 0.07797002303129225, 0.08091672293432499, 0.08384851992076309, 0.08676043141449354, 0.08964792634254508, 0.09250690005594984, 0.09533364988363012, 0.09812485141351422, 0.10087753556066985, 0.10358906645903135, 0.10625712019764648, 0.1088796644116553, 0.11145493873079909, 0.1139814360829953, 0.11645788484655997, 0.1188832318416595 ], [ 0.027525076275811338, 0.026708239958016928, 0.026037268321415702, 0.02550918909738902, 0.025121271961720603, 0.02487183308762433, 0.02476092259415369, 0.02479074987805395, 0.024965739779796443, 0.025292178690741733, 0.02577749068744437, 0.026429261207628157, 0.027254179277216888, 0.028257082189121298, 0.029440253567775552, 0.030803057858813824, 0.03234191518138959, 0.03405055565495551, 0.03592045747442528, 0.03794136946981534, 0.040101837207492344, 0.04238967910191545, 0.04479238535712837, 0.047297432538000894, 0.04989251902927866, 0.052565732787507286, 0.05530566461537612, 0.05810147952842909, 0.060942956980098835, 0.0638205085901092, 0.06672518002115105, 0.0696486419534587, 0.07258317375916365, 0.07552164245080628, 0.07845747871777993, 0.08138465131342554, 0.0842976406626084, 0.08719141228301121, 0.09006139042063196, 0.09290343216663882, 0.09571380223125496, 0.09848914848788574, 0.10122647835824282, 0.10392313608044532, 0.10657678088265911, 0.1091853660715937, 0.11174711903617239, 0.11426052216045278, 0.11672429463540507, 0.11913737515592195 ], [ 0.029202860975568894, 0.028380532254448965, 0.02770132975249109, 0.027162485253015206, 0.026761466187843412, 0.02649671708125636, 0.02636829403408436, 0.026378265171431298, 0.026530782053915368, 0.026831782659565297, 0.02728835512221888, 0.027907858443540098, 0.02869694549897351, 0.02966065064547668, 0.030801682968356905, 0.03212001299483013, 0.03361277313397917, 0.03527443149012462, 0.0370971606353129, 0.03907131190722399, 0.041185916337422496, 0.043429155261089196, 0.0457887675487227, 0.04825238028105347, 0.050807763331753464, 0.053443016032394965, 0.05614669732448276, 0.058907911184119435, 0.061716357964930475, 0.06456236054928517, 0.06743687235810814, 0.0703314726109702, 0.07323835285108633, 0.07615029766421506, 0.0790606616943899, 0.08196334444652642, 0.08485276391966427, 0.0877238297943549, 0.09057191667025859, 0.0933928376902069, 0.09618281877523847, 0.09893847361767437, 0.10165677952582096, 0.10433505417706328, 0.10697093331092608, 0.10956234937636365, 0.11210751113567442, 0.11460488421922685, 0.11705317261946185, 0.11945130110850655 ], [ 0.031029751759278988, 0.0302066023294471, 0.029523947119132275, 0.02897923805122221, 0.02857014845953948, 0.02829524633447665, 0.028154570115429454, 0.02814999778285165, 0.028285327061513408, 0.028566030741361027, 0.028998708118648343, 0.029590310026814, 0.03034725806340854, 0.03127459697386654, 0.032375306811785236, 0.03364986166592406, 0.03509606673569907, 0.03670915202505475, 0.03848206290058303, 0.04040587143437101, 0.0424702357122859, 0.044663849945813475, 0.04697484826732012, 0.049391143579808755, 0.05190069679292525, 0.05449172063502424, 0.0571528267868267, 0.059873126607583614, 0.06264229542364329, 0.06545060913374864, 0.06828896035065468, 0.07114885978259125, 0.0740224272228479, 0.07690237541618151, 0.07978198920421227, 0.08265510168968093, 0.08551606866461875, 0.08835974218361915, 0.09118144389953792, 0.09397693858931182, 0.09674240816246094, 0.09947442634921395, 0.10216993419775047, 0.10482621646286047, 0.107440878935208, 0.11001182673734514, 0.11253724359648998, 0.11501557209280087, 0.11744549487396498, 0.11982591682123951 ], [ 0.03300258865798598, 0.03218272963107838, 0.03150081077826441, 0.030954520898358304, 0.03054174858320205, 0.030261185250141615, 0.030112839884911372, 0.030098373093923436, 0.030221180819793154, 0.0304861960790637, 0.030899423760265405, 0.031467270098294614, 0.032195765100308874, 0.03308979403408222, 0.03415244799233692, 0.03538457485798721, 0.03678456896671752, 0.03834839276467216, 0.04006978839635814, 0.041940618052809304, 0.043951269339478724, 0.04609107144192854, 0.048348683307675736, 0.05071243109071594, 0.0531705854331278, 0.055711578535317864, 0.058324166543282555, 0.060997545384681405, 0.06372142879041968, 0.06648609668457184, 0.0692824210220839, 0.0721018748881641, 0.07493652946203594, 0.07777904239169071, 0.08062264025683209, 0.08346109710846736, 0.08628871054264348, 0.0891002763646833, 0.09189106260179929, 0.09465678340228892, 0.0973935731994384, 0.10009796140236174, 0.10276684779252632, 0.10539747874489114, 0.10798742434986723, 0.11053455648173195, 0.11303702783745594, 0.11549325195433971, 0.11790188420376474, 0.12026180375039716 ], [ 0.035116404078786655, 0.03430337831821876, 0.033625787634193785, 0.03308157062641071, 0.03266883775627738, 0.032386404940837714, 0.032234247804411705, 0.03221379948980708, 0.03232803397545872, 0.032581307855338325, 0.0329789713346327, 0.03352679701505306, 0.0342303054477145, 0.03509408266613983, 0.036121182847131846, 0.03731268922996698, 0.03866747382071756, 0.04018216003649735, 0.041851261373171286, 0.043667449549052474, 0.045621899040791614, 0.047704659211973956, 0.04990501602324245, 0.052211818236053364, 0.05461375490590974, 0.05709958016435985, 0.05965828742987061, 0.06227923864180856, 0.06495225556328378, 0.06766768034461845, 0.07041641194836556, 0.0731899241107227, 0.07598026950621156, 0.07878007383268296, 0.08158252270720028, 0.08438134357951699, 0.087170784323198, 0.08994558973817214, 0.09270097687219045, 0.09543260982218488, 0.09813657449240769, 0.10080935364974622, 0.10344780251611652, 0.10604912506406122, 0.10861085112789579, 0.11113081440344295, 0.11360713138078536, 0.11603818123364507, 0.11842258667380967, 0.1207591957678914 ], [ 0.0373649171262108, 0.036561733373969445, 0.03589150016136698, 0.03535241240426461, 0.03494280408088957, 0.03466161539807759, 0.034508789338603206, 0.0344855339694243, 0.034594402733686434, 0.0348391700712664, 0.03522451004738709, 0.035755516027110086, 0.036437124215435907, 0.03727351804494597, 0.03826759073512273, 0.0394205297511718, 0.04073156278315275, 0.04219787636314443, 0.04381469212215139, 0.045575467165132486, 0.047472176339813515, 0.049495634513936626, 0.05163582362247112, 0.053882198910453774, 0.05622395871447539, 0.058650270553624526, 0.06115045250508478, 0.06371411281352275, 0.06633125281088854, 0.06899233901691795, 0.071688350230522, 0.07441080488812826, 0.07715177322127968, 0.07990387795937144, 0.08266028658681569, 0.08541469752083498, 0.08816132203942414, 0.09089486335521506, 0.09361049388805567, 0.09630383152280884, 0.0989709154344619, 0.10160818190747133, 0.10421244045917813, 0.1067808504893591, 0.1093108986123941, 0.11180037677969659, 0.11424736126371403, 0.11665019254779235, 0.11900745614611462, 0.12131796436296755 ], [ 0.039740897855694894, 0.038950084269243394, 0.03828973080367557, 0.03775828792545107, 0.03735430914710751, 0.03707685636160171, 0.03692584296709714, 0.03690226274654777, 0.03700826555706879, 0.03724706110802028, 0.037622656286764075, 0.03813945565926644, 0.0388017747310584, 0.039613327566866106, 0.0405767520166425, 0.0416932267852443, 0.04296221708510758, 0.04438136379275246, 0.04594650981190832, 0.04765184088325207, 0.04949010865068394, 0.05145290151339572, 0.05353093212487433, 0.05571431705111135, 0.05799283185936656, 0.06035613215129031, 0.06279393688321819, 0.06529617445243414, 0.06785309459346674, 0.07045535044226346, 0.07309405555202482, 0.07576082050815824, 0.07844777334288121, 0.0811475673678938, 0.08385337943735394, 0.08655890108558506, 0.08925832448491908, 0.09194632474813352, 0.09461803975535557, 0.0972690484089175, 0.09989534800170281, 0.10249333121453627, 0.10505976312686761, 0.10759175852423751, 0.11008675970911451, 0.11254251496313464, 0.11495705776439445, 0.11732868682971781, 0.11965594702634987, 0.1219376111781398 ], [ 0.042236424893999924, 0.04146008737963609, 0.04081169041840488, 0.04028993239254831, 0.03989357717390575, 0.039621803181338705, 0.039474498202369965, 0.03945245770999145, 0.039557455147340805, 0.03979216884473718, 0.04015996940621267, 0.04066459053255748, 0.041309722193299814, 0.04209857506453739, 0.0430334674083122, 0.04411547975045372, 0.0453442101898988, 0.046717646759438625, 0.04823215645283216, 0.04988257652075248, 0.051662384465480736, 0.05356391940010773, 0.05557862836034248, 0.05769731528572302, 0.059910376074520856, 0.06220800898508898, 0.06458039479890808, 0.06701784514295364, 0.06951092011891437, 0.07205051804999851, 0.07462794097355785, 0.07723493973184836, 0.07986374236218513, 0.08250706912924165, 0.08515813709331006, 0.08781065664409766, 0.09045882199307273, 0.09309729723031755, 0.09572119922141226, 0.09832607834569851, 0.10090789785412829, 0.10346301244613045, 0.1059881465232477, 0.10848037246602958, 0.11093708919377454, 0.11335600119928603, 0.11573509819851033, 0.11807263549459411, 0.12036711512470494, 0.12261726783396562 ], [ 0.04484306646217756, 0.04408294382964577, 0.04344819389398388, 0.04293774963173712, 0.04255057196155548, 0.0422859485103199, 0.042143745566396405, 0.04212457906056931, 0.04222987917138938, 0.04246183605423299, 0.04282322933493578, 0.04331715909174404, 0.043946708724782284, 0.04471457834533183, 0.045622729768389776, 0.04667208055154515, 0.047862275659219716, 0.04919155314083006, 0.05065670715045706, 0.05225314007847223, 0.053974987222992946, 0.05581529303407398, 0.05776621729831204, 0.059819251817067286, 0.06196543201580996, 0.06419553241876737, 0.06650023921437938, 0.06887029673540693, 0.07129662738790273, 0.07377042639771209, 0.07628323383068092, 0.07882698685745775, 0.08139405534823098, 0.08397726374336316, 0.08656990186494914, 0.0891657269908661, 0.0917589591581244, 0.09434427132687302, 0.09691677573568476, 0.09947200751900781, 0.1020059064390367, 0.10451479740370477, 0.10699537029566983, 0.10944465951882339, 0.11186002357451652, 0.11423912490476172, 0.11657991018050495, 0.11888059116651206, 0.12113962625780551, 0.12335570275388177 ], [ 0.04755201213500401, 0.046809524726249656, 0.04618977943718636, 0.045691926344397366, 0.045315107243846006, 0.04505871013776302, 0.044922583693925315, 0.044907184172467085, 0.04501363440934591, 0.04524368468729475, 0.04559957724753087, 0.04608382805809626, 0.04669894950115083, 0.04744714436600916, 0.04833000394315192, 0.04934824083714998, 0.05050148090429217, 0.05178812975112272, 0.05320531921823406, 0.05474892995877118, 0.05641367896850992, 0.058193256469662835, 0.060080494956470235, 0.06206755400872939, 0.06414610691094723, 0.06630751837308252, 0.06854300605346403, 0.07084378166510734, 0.07320116994992545, 0.07560670565320476, 0.07805220986317553, 0.0805298477996059, 0.08303217046386434, 0.08555214261851775, 0.08808315944572101, 0.09061905401631465, 0.09315409743948591, 0.09568299329184397, 0.09820086766632086, 0.10070325594725182, 0.10318608721317621, 0.10564566699418397, 0.10807865896422703, 0.11048206602791405, 0.11285321116251361, 0.1151897182957086, 0.11748949343513987, 0.11975070621394843, 0.12197177197511266, 0.12415133448437271 ], [ 0.05035417600293442, 0.04963046717235397, 0.049026797627409406, 0.04854251440939852, 0.04817692240875086, 0.04792950032987409, 0.04780008272674342, 0.04778898601495055, 0.047897062083044915, 0.0481256712297828, 0.04847657552203967, 0.048951762985052744, 0.0495532209871931, 0.05028268264922665, 0.05114137235025123, 0.05212977519394376, 0.05324745098707967, 0.05449290673011747, 0.05586353402202149, 0.05735561039957584, 0.058964357522890753, 0.06068404494403629, 0.06250812615237583, 0.06442939347109199, 0.06644013971513882, 0.06853231674240676, 0.0706976836050712, 0.0729279395239896, 0.07521483910138856, 0.07755028892813258, 0.07992642600871683, 0.08233567926283178, 0.08477081584373974, 0.08722497422654824, 0.08969168604378418, 0.09216488854835304, 0.09463892941683516, 0.09710856540600742, 0.09956895616791932, 0.1020156543291559, 0.10444459275705445, 0.10685206977365302, 0.10923473293809045, 0.11158956189914218, 0.11391385071994038, 0.11620518999420856, 0.1184614490053429, 0.12068075812407279, 0.12286149159512662, 0.12500225082667038 ], [ 0.053240284739798145, 0.05253625588438046, 0.05194948642643794, 0.05147949895729586, 0.05112574312851993, 0.05088777842209362, 0.05076542838920964, 0.050758888632915146, 0.05086877539605292, 0.05109610801268122, 0.05144222583257543, 0.05190864754105125, 0.05249688708596339, 0.053208244857276765, 0.05404359478563366, 0.055003187447862485, 0.056086486307125996, 0.05729204945754996, 0.05861746352063319, 0.06005933056262188, 0.061613303872847414, 0.06327416471991694, 0.0650359300308553, 0.06689198026604187, 0.0688351973206843, 0.0708581036885407, 0.072952995980082, 0.0751120678557685, 0.07732751927076191, 0.07959165048351659, 0.0818969404961419, 0.0842361104693819, 0.08660217322781723, 0.08898847029725844, 0.09138869805611641, 0.09379692459046633, 0.09620759876450038, 0.09861555288950266, 0.10101600022144537, 0.10340452835755064, 0.10577708944725132, 0.10812998798945808, 0.11045986685943404, 0.11276369209586228, 0.11503873688174691, 0.11728256507039485, 0.11949301453848063, 0.12166818059045165, 0.12380639959067176, 0.12590623296019832 ], [ 0.05620095813937468, 0.055517298427066715, 0.05494804068634937, 0.05449286146820582, 0.054151337127523284, 0.05392309820371123, 0.053807959984482685, 0.05380601503884223, 0.053917677170897065, 0.054143671286337194, 0.05448496942828306, 0.05494267897878094, 0.055517893999178385, 0.05621152427244366, 0.05702411839370564, 0.057955697077307966, 0.05900561084336965, 0.06017243281071025, 0.06145389303716253, 0.06284685636714185, 0.06434734167391862, 0.06595057717361001, 0.06765108438461136, 0.06944278234315981, 0.07131910372440227, 0.07327311531353624, 0.07529763654074244, 0.07738535127238708, 0.07952890952814601, 0.08172101712538862, 0.08395451235838824, 0.08622242967337913, 0.08851805091020964, 0.09083494507805037, 0.09316699785662846, 0.09550843210740242, 0.09785382067869886, 0.10019809272673609, 0.10253653467537249, 0.10486478681971526, 0.10717883645516448, 0.10947500829255645, 0.11174995280693778, 0.11400063306484089, 0.11622431048399551, 0.11841852990007559, 0.12058110424688472, 0.12271009909830857, 0.12480381727131684, 0.12686078364809608 ], [ 0.059226785485915465, 0.05856399742271161, 0.05801267959712953, 0.05757264158007131, 0.05724356923546469, 0.05702515496237339, 0.05691720819034206, 0.05691973472533701, 0.057032976464709714, 0.057257406966490454, 0.05759368287806317, 0.058042555736681184, 0.05860475259505983, 0.05928083683043444, 0.060071062045667166, 0.06097523203901115, 0.061992578484673856, 0.06312166549833688, 0.06436032706679858, 0.06570563986958716, 0.06715393076319834, 0.06870081549544499, 0.07034126329067879, 0.07206968087016384, 0.07388000918854387, 0.07576582652899573, 0.07772045241192747, 0.07973704783758612, 0.08180870852937104, 0.08392854894242513, 0.08608977576712921, 0.08828575044676612, 0.0905100408321959, 0.09275646252524389, 0.09501911074013925, 0.09729238366784344, 0.0995709983904514, 0.10185000038832728, 0.10412476763332355, 0.10639101018459642, 0.10864476611246754, 0.11088239447953813, 0.11310056601333708, 0.11529625201506413, 0.11746671196668103, 0.11960948022487754, 0.12172235212529826, 0.12380336976389125, 0.12585080767336157, 0.1278631585710818 ], [ 0.06230839854481461, 0.061666820322460285, 0.06113371255024846, 0.0607089980994985, 0.06039245639127289, 0.06018383320544943, 0.06008293422161178, 0.0600896931356432, 0.06020420751814059, 0.06042673870115349, 0.06075767552415129, 0.06119746531293238, 0.061746518588864895, 0.062405096356551795, 0.06317319015137142, 0.06405040523938257, 0.06503585649576116, 0.06612808472608725, 0.0673249988227105, 0.06862384650445323, 0.07002121380699346, 0.07151305125443033, 0.07309472294115411, 0.07476107367543855, 0.07650650887315293, 0.0783250819585315, 0.08021058450104533, 0.08215663505008389, 0.08415676348823765, 0.08620448859944478, 0.08829338736055081, 0.09041715516567411, 0.09256965675950253, 0.09474496808592264, 0.096937409562695, 0.099141571489213, 0.1013523324032386, 0.10356487124459876, 0.10577467417741307, 0.1079775368830137, 0.1101695630758486, 0.11234715992349277, 0.11450703097647608, 0.11664616713856221, 0.11876183613653278, 0.12085157088216296, 0.12291315705902257, 0.1249446202131363, 0.12694421257939784, 0.12891039983458685 ], [ 0.0654365406229492, 0.06481636594898095, 0.06430160245876068, 0.06389226817784859, 0.06358822158498564, 0.06338925418127908, 0.06329516973886855, 0.06330584286600748, 0.06342125136874519, 0.06364147934339623, 0.06396669071537525, 0.06439707572776528, 0.06493277536210823, 0.06557379057640984, 0.06631988438295434, 0.0671704850749407, 0.06812459836857115, 0.06918073497861899, 0.07033685839117154, 0.07159035558055196, 0.07293803138700149, 0.07437612544471144, 0.07590034908548904, 0.07750593862993552, 0.07918772093286265, 0.08094018693187818, 0.08275756917678512, 0.08463391979275707, 0.08656318595099459, 0.08853928059735128, 0.09055614685246478, 0.09260781509775941, 0.09468845227250801, 0.09679240331648917, 0.09891422500200986, 0.10104871261683855, 0.10319092009958704, 0.10533617430592598, 0.107480084112357, 0.10961854505710214, 0.11174774018602834, 0.11386413772431346, 0.11596448613857038, 0.11804580709453259, 0.12010538675557099, 0.12214076580983009, 0.12414972856000847, 0.1261302913605827, 0.12808069064302674, 0.12999937073017992 ], [ 0.06860213064718976, 0.06800342654636195, 0.06750702510892855, 0.06711302312441896, 0.06682134516501168, 0.06663182164253195, 0.0665442560242579, 0.06655847527531643, 0.066674359056859, 0.06689184513966358, 0.06721091067740072, 0.06763153118047714, 0.06815362100176324, 0.0687769606857991, 0.0695011174977581, 0.07032536576640651, 0.07124861335476279, 0.07226933969531904, 0.07338554953432336, 0.07459474499718924, 0.07589391699872342, 0.07727955554446278, 0.07874767723249712, 0.08029386734981651, 0.08191333339354695, 0.08360096662065156, 0.08535140829175165, 0.0871591175579877, 0.08901843837017825, 0.09092366329721101, 0.09286909266667262, 0.09484908794108358, 0.0968581186882881, 0.09889080287863741, 0.10094194053940607, 0.10300654102061632, 0.10507984428371292, 0.10715733672497102, 0.10923476210008154, 0.11130812813525401, 0.11337370940286266, 0.11542804701397699, 0.1174679456425172, 0.1194904683513335, 0.12149292964290334, 0.12347288710937103, 0.12542813201014003, 0.12735667906139403, 0.12925675568142916, 0.1311267908989465 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.1454639071598649, 0.1452578166499734, 0.07187618501484394, 0.5090631926432252, 0.31458483450114727, 0.8452790696173906, 0.1006586495234564, 0.1588804308653677, 2.710505431213761e-17, 0.00011547329865921015, 0.0, 0.0, 0.005418258521989563, 2.957906783639042e-12, 3.301947629294326e-12, 3.3215763922836503e-13, 3.4216838143622994e-16, 0.0785508160568717, 0.04908849942365193, 0.06695577355143326, 0.14477238706618614, 0.12208622734303705, 0.07361797872103325, 0.12903130053077205 ], "xaxis": "x", "y": [ 0.22388708777725697, 0.28188073821365833, 0.8252799212932587, 0.6858136570081115, 0.11038063373416662, 0.7782178921625018, 0.2749786765395568, 0.249447581211545, 0.3089344785094871, 0.3670973684186971, 0.4657457104608541, 0.5635556079906251, 0.4478088698290576, 0.49862248702544343, 0.5463141286424281, 0.5328853663295189, 0.5345064196301386, 0.5419235512596348, 0.5884304211813007, 0.5851750768862208, 0.6249101818947641, 0.5887018452908952, 0.575419768663122, 0.5892123106611511 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.1454639071598649, 0.1452578166499734, 0.07187618501484394, 0.5090631926432252, 0.31458483450114727, 0.8452790696173906, 0.1006586495234564, 0.1588804308653677, 2.710505431213761e-17, 0.00011547329865921015, 0.0, 0.0, 0.005418258521989563, 2.957906783639042e-12, 3.301947629294326e-12, 3.3215763922836503e-13, 3.4216838143622994e-16, 0.0785508160568717, 0.04908849942365193, 0.06695577355143326, 0.14477238706618614, 0.12208622734303705, 0.07361797872103325, 0.12903130053077205 ], "xaxis": "x2", "y": [ 0.22388708777725697, 0.28188073821365833, 0.8252799212932587, 0.6858136570081115, 0.11038063373416662, 0.7782178921625018, 0.2749786765395568, 0.249447581211545, 0.3089344785094871, 0.3670973684186971, 0.4657457104608541, 0.5635556079906251, 0.4478088698290576, 0.49862248702544343, 0.5463141286424281, 0.5328853663295189, 0.5345064196301386, 0.5419235512596348, 0.5884304211813007, 0.5851750768862208, 0.6249101818947641, 0.5887018452908952, 0.575419768663122, 0.5892123106611511 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.10073835496145243, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -1.1027436654333302, -1.1027436654333302, -1.2628126566457458, -1.5124981999033373, -1.7121702356270936, -1.7121702356270936, -2.402305640118067, -2.8387163103685107, -2.8387163103685107, -2.8988401158220776, -2.8988401158220776, -2.9984346067254726, -3.0262933466351787, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.0755287489754486, -3.0755287489754486 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.07173506449908018
x2: 0.7096590753644705
x3: 0.1454639071598649
x4: 0.22388708777725697
x5: 0.8358255606144667
x6: 0.10475814528763294", "
Parameterization:
x1: 0.48555633518844843
x2: 0.848789912648499
x3: 0.1452578166499734
x4: 0.28188073821365833
x5: 0.2343400688841939
x6: 0.1755714165046811", "
Parameterization:
x1: 0.43276938144117594
x2: 0.5983624188229442
x3: 0.07187618501484394
x4: 0.8252799212932587
x5: 0.9974101297557354
x6: 0.8456849306821823", "
Parameterization:
x1: 0.13594666216522455
x2: 0.6616736399009824
x3: 0.5090631926432252
x4: 0.6858136570081115
x5: 0.9168174099177122
x6: 0.978117136284709", "
Parameterization:
x1: 0.1580715337768197
x2: 0.9081467175856233
x3: 0.31458483450114727
x4: 0.11038063373416662
x5: 0.8526917928829789
x6: 0.5804343847557902", "
Parameterization:
x1: 0.6632164781913161
x2: 0.9530803263187408
x3: 0.8452790696173906
x4: 0.7782178921625018
x5: 0.3974348120391369
x6: 0.9167442740872502", "
Parameterization:
x1: 0.43822902721504764
x2: 0.8634369738451254
x3: 0.1006586495234564
x4: 0.2749786765395568
x5: 0.12835364569302415
x6: 0.1382871528512103", "
Parameterization:
x1: 0.5032836965307719
x2: 0.8617745399492127
x3: 0.1588804308653677
x4: 0.249447581211545
x5: 0.015868121148190136
x6: 0.11334216499046168", "
Parameterization:
x1: 0.3605185554735036
x2: 0.8938795701814818
x3: 2.710505431213761e-17
x4: 0.3089344785094871
x5: 0.14631378271563755
x6: 0.14939553925986906", "
Parameterization:
x1: 0.2784698053210525
x2: 0.855121111956768
x3: 0.00011547329865921015
x4: 0.3670973684186971
x5: 0.14278020549796552
x6: 0.07042553897405943", "
Parameterization:
x1: 0.24332750066399203
x2: 0.8481584478420583
x3: 0.0
x4: 0.4657457104608541
x5: 0.1333958030865935
x6: 0.0", "
Parameterization:
x1: 0.13817154272068607
x2: 0.8172360429233081
x3: 0.0
x4: 0.5635556079906251
x5: 0.09803760749050446
x6: 6.735660793181328e-17", "
Parameterization:
x1: 0.34021649879283955
x2: 0.8801415957411487
x3: 0.005418258521989563
x4: 0.4478088698290576
x5: 0.13570423807803
x6: 1.3552465149506231e-15", "
Parameterization:
x1: 0.4014199282448173
x2: 0.9078376382367699
x3: 2.957906783639042e-12
x4: 0.49862248702544343
x5: 0.148175198907855
x6: 2.9657819919452394e-12", "
Parameterization:
x1: 0.4623573341921234
x2: 0.9443944181329188
x3: 3.301947629294326e-12
x4: 0.5463141286424281
x5: 0.17892139537705612
x6: 5.566107909707957e-12", "
Parameterization:
x1: 0.44118884597217817
x2: 0.8694859528898895
x3: 3.3215763922836503e-13
x4: 0.5328853663295189
x5: 0.08871944267363552
x6: 3.954107570954144e-12", "
Parameterization:
x1: 0.42022959052873393
x2: 0.9420265060876317
x3: 3.4216838143622994e-16
x4: 0.5345064196301386
x5: 0.022152913879751712
x6: 3.6222971576330677e-16", "
Parameterization:
x1: 0.41708781234767667
x2: 0.8926692847672513
x3: 0.0785508160568717
x4: 0.5419235512596348
x5: 0.08493102590607313
x6: 1.00608595376156e-15", "
Parameterization:
x1: 0.40125810545806145
x2: 0.8807828217292244
x3: 0.04908849942365193
x4: 0.5884304211813007
x5: 0.10376689542346436
x6: 0.0", "
Parameterization:
x1: 0.4078525712291232
x2: 0.8805048995793955
x3: 0.06695577355143326
x4: 0.5851750768862208
x5: 0.09115688722686188
x6: 0.0628972640609617", "
Parameterization:
x1: 0.4188864726003662
x2: 0.8518852341930643
x3: 0.14477238706618614
x4: 0.6249101818947641
x5: 0.021623012396877483
x6: 0.06271076114516895", "
Parameterization:
x1: 0.4063476296527273
x2: 0.8350737451621212
x3: 0.12208622734303705
x4: 0.5887018452908952
x5: 0.14998059538748781
x6: 0.0579445281707671", "
Parameterization:
x1: 0.39920978552430186
x2: 0.8300750319853952
x3: 0.07361797872103325
x4: 0.575419768663122
x5: 0.06141152553794274
x6: 0.05387349503804461", "
Parameterization:
x1: 0.3971602386022429
x2: 0.9078710743114302
x3: 0.12903130053077205
x4: 0.5892123106611511
x5: 0.11049169082431023
x6: 0.056961656211474004", "
Parameterization:
x1: 0.4957942944020033
x2: 0.6448016054928303
x3: 0.3466978454962373
x4: 0.6697968728840351
x5: 0.2731626396998763
x6: 0.01247310359030962" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.10073835496145243, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -1.1027436654333302, -1.1027436654333302, -1.2628126566457458, -1.5124981999033373, -1.7121702356270936, -1.7121702356270936, -2.402305640118067, -2.8387163103685107, -2.8387163103685107, -2.8988401158220776, -2.8988401158220776, -2.9984346067254726, -3.0262933466351787, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.0755287489754486, -3.0755287489754486 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.10073835496145243, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -0.9559789760078418, -1.1027436654333302, -1.1027436654333302, -1.2628126566457458, -1.5124981999033373, -1.7121702356270936, -1.7121702356270936, -2.402305640118067, -2.8387163103685107, -2.8387163103685107, -2.8988401158220776, -2.8988401158220776, -2.9984346067254726, -3.0262933466351787, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.070538131278556, -3.0755287489754486, -3.0755287489754486 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:34:00] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 11-04 18:34:00] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "ename": "ModuleNotFoundError", "evalue": "No module named 'psycopg2'", "output_type": "error", "traceback": [ "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mModuleNotFoundError\u001b[0m Traceback (most recent call last)", "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 4\u001b[0m \u001b[0mdb_settings\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mDBSettings\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;34m\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 5\u001b[0m \u001b[0;31m# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 6\u001b[0;31m \u001b[0mnew_ax\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mAxClient\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", "\u001b[0;32m~/build/facebook/Ax/ax/service/ax_client.py\u001b[0m in \u001b[0;36m__init__\u001b[0;34m(self, generation_strategy, db_settings, enforce_sequential_optimization, random_seed, verbose_logging, suppress_storage_errors)\u001b[0m\n\u001b[1;32m 128\u001b[0m \u001b[0msuppress_storage_errors\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mbool\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;32mFalse\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 129\u001b[0m ) -> None:\n\u001b[0;32m--> 130\u001b[0;31m \u001b[0msuper\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m__init__\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 131\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mverbose_logging\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 132\u001b[0m \u001b[0mlogger\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msetLevel\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlogging\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mWARNING\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;31m# pragma: no cover\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/service/utils/with_db_settings_base.py\u001b[0m in \u001b[0;36m__init__\u001b[0;34m(self, db_settings, logging_level)\u001b[0m\n\u001b[1;32m 67\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings_set\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 68\u001b[0m init_engine_and_session_factory(\n\u001b[0;32m---> 69\u001b[0;31m \u001b[0mcreator\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 70\u001b[0m )\n\u001b[1;32m 71\u001b[0m \u001b[0mlogger\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msetLevel\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlogging_level\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/storage/sqa_store/db.py\u001b[0m in \u001b[0;36minit_engine_and_session_factory\u001b[0;34m(url, creator, echo, force_init, **kwargs)\u001b[0m\n\u001b[1;32m 338\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0;31m# pragma: no cover\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 339\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0murl\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 340\u001b[0;31m \u001b[0mengine\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcreate_mysql_engine_from_url\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 341\u001b[0m \u001b[0;32melif\u001b[0m \u001b[0mcreator\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 342\u001b[0m \u001b[0mengine\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcreate_mysql_engine_from_creator\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/storage/sqa_store/db.py\u001b[0m in \u001b[0;36mcreate_mysql_engine_from_url\u001b[0;34m(url, echo, pool_recycle, **kwargs)\u001b[0m\n\u001b[1;32m 279\u001b[0m \"\"\"\n\u001b[1;32m 280\u001b[0m return create_engine(\n\u001b[0;32m--> 281\u001b[0;31m \u001b[0mname_or_url\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mpool_recycle\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mpool_recycle\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 282\u001b[0m )\n\u001b[1;32m 283\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/engine/__init__.py\u001b[0m in \u001b[0;36mcreate_engine\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m 498\u001b[0m \u001b[0mstrategy\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpop\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"strategy\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mdefault_strategy\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 499\u001b[0m \u001b[0mstrategy\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mstrategies\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mstrategies\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mstrategy\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 500\u001b[0;31m \u001b[0;32mreturn\u001b[0m \u001b[0mstrategy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcreate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 501\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 502\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/engine/strategies.py\u001b[0m in \u001b[0;36mcreate\u001b[0;34m(self, name_or_url, **kwargs)\u001b[0m\n\u001b[1;32m 85\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mk\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 86\u001b[0m \u001b[0mdbapi_args\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpop_kwarg\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 87\u001b[0;31m \u001b[0mdbapi\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mdialect_cls\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdbapi\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mdbapi_args\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 88\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 89\u001b[0m \u001b[0mdialect_args\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"dbapi\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mdbapi\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/dialects/postgresql/psycopg2.py\u001b[0m in \u001b[0;36mdbapi\u001b[0;34m(cls)\u001b[0m\n\u001b[1;32m 776\u001b[0m \u001b[0;34m@\u001b[0m\u001b[0mclassmethod\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 777\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mdbapi\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mcls\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 778\u001b[0;31m \u001b[0;32mimport\u001b[0m \u001b[0mpsycopg2\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 779\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 780\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0mpsycopg2\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;31mModuleNotFoundError\u001b[0m: No module named 'psycopg2'" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "collapsed": true }, "outputs": [], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "collapsed": true }, "outputs": [], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-16 10:14:20] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n", "[INFO 04-16 10:14:20] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 5, "metadata": { "bento_obj_id": "140609783487456" }, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" } }, "nbformat": 4, "nbformat_minor": 2 }