{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.86, 'x2': 0.3, 'x3': 0.87, 'x4': 0.47, 'x5': 0.55, 'x6': 0.27}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.04, 0.0), 'l2norm': (1.48, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.39, 'x2': 0.95, 'x3': 0.42, 'x4': 0.71, 'x5': 0.73, 'x6': 0.53}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.1, 0.0), 'l2norm': (1.59, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.62, 'x2': 0.61, 'x3': 0.34, 'x4': 0.21, 'x5': 0.31, 'x6': 0.21}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.31, 0.0), 'l2norm': (1.02, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.92, 'x2': 0.25, 'x3': 0.34, 'x4': 0.54, 'x5': 0.42, 'x6': 0.22}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.06, 0.0), 'l2norm': (1.24, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.17, 'x2': 0.34, 'x3': 0.12, 'x4': 0.93, 'x5': 0.75, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.26, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.86, 'x2': 0.62, 'x3': 0.62, 'x4': 0.07, 'x5': 0.07, 'x6': 0.14}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:29] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.01, 0.0), 'l2norm': (1.24, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:34] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.53, 'x2': 0.65, 'x3': 0.26, 'x4': 0.19, 'x5': 0.36, 'x6': 0.24}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:34] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.39, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:38] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.49, 'x2': 0.67, 'x3': 0.14, 'x4': 0.16, 'x5': 0.37, 'x6': 0.24}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:38] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.36, 0.0), 'l2norm': (0.96, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:42] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.45, 'x2': 0.67, 'x3': 0.32, 'x4': 0.2, 'x5': 0.4, 'x6': 0.26}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:42] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.49, 0.0), 'l2norm': (1.02, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:45] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.37, 'x2': 0.69, 'x3': 0.41, 'x4': 0.21, 'x5': 0.45, 'x6': 0.28}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:45] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.53, 0.0), 'l2norm': (1.05, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:49] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.34, 'x2': 0.7, 'x3': 0.37, 'x4': 0.27, 'x5': 0.38, 'x6': 0.34}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:49] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.68, 0.0), 'l2norm': (1.04, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:53] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.31, 'x2': 0.71, 'x3': 0.34, 'x4': 0.31, 'x5': 0.33, 'x6': 0.4}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:53] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.75, 0.0), 'l2norm': (1.04, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:56] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.23, 'x2': 0.65, 'x3': 0.36, 'x4': 0.3, 'x5': 0.28, 'x6': 0.46}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:26:56] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.01, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:00] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.17, 'x2': 0.59, 'x3': 0.39, 'x4': 0.31, 'x5': 0.25, 'x6': 0.5}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:00] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.28, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:05] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.1, 'x2': 0.52, 'x3': 0.44, 'x4': 0.31, 'x5': 0.21, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:05] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.56, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:09] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.02, 'x2': 0.45, 'x3': 0.47, 'x4': 0.3, 'x5': 0.16, 'x6': 0.62}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:09] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.52, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:12] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.13, 'x2': 0.5, 'x3': 0.5, 'x4': 0.35, 'x5': 0.23, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:12] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.82, 0.0), 'l2norm': (1.05, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:17] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.18, 'x2': 0.49, 'x3': 0.56, 'x4': 0.38, 'x5': 0.26, 'x6': 0.73}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:17] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.88, 0.0), 'l2norm': (1.15, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:22] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.11, 'x2': 0.52, 'x3': 0.63, 'x4': 0.41, 'x5': 0.24, 'x6': 0.69}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:22] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-1.51, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:26] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.23, 'x2': 0.46, 'x3': 0.47, 'x4': 0.35, 'x5': 0.25, 'x6': 0.74}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:26] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.07, 0.0), 'l2norm': (1.1, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:30] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.22, 'x2': 0.44, 'x3': 0.43, 'x4': 0.3, 'x5': 0.33, 'x6': 0.76}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:30] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.22, 0.0), 'l2norm': (1.1, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:34] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.24, 'x2': 0.49, 'x3': 0.46, 'x4': 0.23, 'x5': 0.34, 'x6': 0.8}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:34] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-1.87, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:39] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.18, 'x2': 0.4, 'x3': 0.38, 'x4': 0.33, 'x5': 0.39, 'x6': 0.77}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:39] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.05, 0.0), 'l2norm': (1.1, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:43] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.23, 'x2': 0.42, 'x3': 0.54, 'x4': 0.31, 'x5': 0.33, 'x6': 0.75}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:43] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-2.38, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:48] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.26, 'x2': 0.37, 'x3': 0.62, 'x4': 0.3, 'x5': 0.34, 'x6': 0.77}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:48] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.43, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:48] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.86, 'x2': 0.3, 'x3': 0.87, 'x...
10Sobol1COMPLETED{'1_0': {'x1': 0.39, 'x2': 0.95, 'x3': 0.42, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.62, 'x2': 0.61, 'x3': 0.34, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.92, 'x2': 0.25, 'x3': 0.34, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.17, 'x2': 0.34, 'x3': 0.12, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.86, 'x2': 0.62, 'x3': 0.62, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.53, 'x2': 0.65, 'x3': 0.26, '...
71GPEI7COMPLETED{'7_0': {'x1': 0.49, 'x2': 0.67, 'x3': 0.14, '...
81GPEI8COMPLETED{'8_0': {'x1': 0.45, 'x2': 0.67, 'x3': 0.32, '...
91GPEI9COMPLETED{'9_0': {'x1': 0.37, 'x2': 0.69, 'x3': 0.41, '...
101GPEI10COMPLETED{'10_0': {'x1': 0.34, 'x2': 0.7, 'x3': 0.37, '...
111GPEI11COMPLETED{'11_0': {'x1': 0.31, 'x2': 0.71, 'x3': 0.34, ...
121GPEI12COMPLETED{'12_0': {'x1': 0.23, 'x2': 0.65, 'x3': 0.36, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.17, 'x2': 0.59, 'x3': 0.39, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.1, 'x2': 0.52, 'x3': 0.44, '...
151GPEI15COMPLETED{'15_0': {'x1': 0.02, 'x2': 0.45, 'x3': 0.47, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.13, 'x2': 0.5, 'x3': 0.5, 'x...
171GPEI17COMPLETED{'17_0': {'x1': 0.18, 'x2': 0.49, 'x3': 0.56, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.11, 'x2': 0.52, 'x3': 0.63, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.23, 'x2': 0.46, 'x3': 0.47, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.22, 'x2': 0.44, 'x3': 0.43, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.24, 'x2': 0.49, 'x3': 0.46, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.18, 'x2': 0.4, 'x3': 0.38, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.23, 'x2': 0.42, 'x3': 0.54, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.26, 'x2': 0.37, 'x3': 0.62, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.86, 'x2': 0.3, 'x3': 0.87, 'x... \n", "1 {'1_0': {'x1': 0.39, 'x2': 0.95, 'x3': 0.42, '... \n", "2 {'2_0': {'x1': 0.62, 'x2': 0.61, 'x3': 0.34, '... \n", "3 {'3_0': {'x1': 0.92, 'x2': 0.25, 'x3': 0.34, '... \n", "4 {'4_0': {'x1': 0.17, 'x2': 0.34, 'x3': 0.12, '... \n", "5 {'5_0': {'x1': 0.86, 'x2': 0.62, 'x3': 0.62, '... \n", "6 {'6_0': {'x1': 0.53, 'x2': 0.65, 'x3': 0.26, '... \n", "7 {'7_0': {'x1': 0.49, 'x2': 0.67, 'x3': 0.14, '... \n", "8 {'8_0': {'x1': 0.45, 'x2': 0.67, 'x3': 0.32, '... \n", "9 {'9_0': {'x1': 0.37, 'x2': 0.69, 'x3': 0.41, '... \n", "10 {'10_0': {'x1': 0.34, 'x2': 0.7, 'x3': 0.37, '... \n", "11 {'11_0': {'x1': 0.31, 'x2': 0.71, 'x3': 0.34, ... \n", "12 {'12_0': {'x1': 0.23, 'x2': 0.65, 'x3': 0.36, ... \n", "13 {'13_0': {'x1': 0.17, 'x2': 0.59, 'x3': 0.39, ... \n", "14 {'14_0': {'x1': 0.1, 'x2': 0.52, 'x3': 0.44, '... \n", "15 {'15_0': {'x1': 0.02, 'x2': 0.45, 'x3': 0.47, ... \n", "16 {'16_0': {'x1': 0.13, 'x2': 0.5, 'x3': 0.5, 'x... \n", "17 {'17_0': {'x1': 0.18, 'x2': 0.49, 'x3': 0.56, ... \n", "18 {'18_0': {'x1': 0.11, 'x2': 0.52, 'x3': 0.63, ... \n", "19 {'19_0': {'x1': 0.23, 'x2': 0.46, 'x3': 0.47, ... \n", "20 {'20_0': {'x1': 0.22, 'x2': 0.44, 'x3': 0.43, ... \n", "21 {'21_0': {'x1': 0.24, 'x2': 0.49, 'x3': 0.46, ... \n", "22 {'22_0': {'x1': 0.18, 'x2': 0.4, 'x3': 0.38, '... \n", "23 {'23_0': {'x1': 0.23, 'x2': 0.42, 'x3': 0.54, ... \n", "24 {'24_0': {'x1': 0.26, 'x2': 0.37, 'x3': 0.62, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.2323591563636618,\n", " 'x2': 0.4199047081311001,\n", " 'x3': 0.541827007567024,\n", " 'x4': 0.30634757217791686,\n", " 'x5': 0.3288907817254116,\n", " 'x6': 0.7528167675616309}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.382583895327995, 'l2norm': 1.1369425853176165}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:48] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.9794038746341855, -0.9943833186763007, -1.0083565491111632, -1.0212284109356689, -1.0329076790933935, -1.0433082254221644, -1.0523501625447709, -1.0599609391244609, -1.0660763610725035, -1.070641514410352, -1.0736115675426567, -1.0749524336241882, -1.0746412773857137, -1.0726668550581644, -1.0690296807025377, -1.0637420170955405, -1.0568276941121957, -1.0483217620705318, -1.0382699915685742, -1.026728234794813, -1.0137616660197926, -0.9994439209172641, -0.9838561555056496, -0.9670860458767807, -0.9492267495580169, -0.930375848433575, -0.910634291745773, -0.8901053559295035, -0.8688936360245527, -0.8471040812725267, -0.8248410853363133, -0.8022076394611948, -0.7793045548902666, -0.7562297589968755, -0.7330776679307365, -0.7099386371050305, -0.6868984895803683, -0.664038121320035, -0.6414331813858579, -0.619153824397452, -0.5972645319708909, -0.5758239993668384, -0.5548850831956664, -0.5344948057327494, -0.514694411178427, -0.4955194690442817, -0.4770000197530164, -0.4591607574983171, -0.442021245420099, -0.42559615820720453 ], [ -1.0077492595754491, -1.0235910612072472, -1.0383795877367052, -1.052012602600195, -1.064392003196943, -1.0754251051693804, -1.0850259027915687, -1.0931162763656235, -1.0996271176851447, -1.104499345906788, -1.1076847885630563, -1.1091469058706183, -1.1088613407948906, -1.106816282323934, -1.1030126348413583, -1.0974639921028302, -1.0901964198421492, -1.0812480562031752, -1.0706685437878194, -1.0585183109492131, -1.044867722921195, -1.029796125399179, -1.0133908042717497, -0.9957458853987065, -0.976961197734536, -0.9571411218324343, -0.9363934439764421, -0.9148282340272677, -0.892556762674373, -0.8696904712930313, -0.8463400051209331, -0.8226143180827148, -0.7986198553678552, -0.7744598178507869, -0.7502335106556677, -0.726035776619298, -0.7019565140887665, -0.6780802773912085, -0.6544859574108084, -0.6312465389797846, -0.6084289312110802, -0.5860938664482082, -0.5642958631612386, -0.5430832478599774, -0.5224982309119145, -0.5025770310328518, -0.4833500431547896, -0.4648420443637369, -0.44707243263646335, -0.43005549318807546 ], [ -1.0359958881584044, -1.0527183993463025, -1.068340021993286, -1.0827511039146325, -1.0958463361005686, -1.1075261641933556, -1.1176981752126873, -1.1262784264473882, -1.133192683587988, -1.1383775366593896, -1.1417813651078874, -1.1433651274031345, -1.1431029555557588, -1.140982540781513, -1.1370053028689873, -1.131186342307764, -1.1235541805813705, -1.1141502999182624, -1.1030284989609556, -1.09025408505473, -1.0759029270406522, -1.060060394505663, -1.0428202104102537, -1.0242832439597445, -1.0045562696357362, -0.9837507166209998, -0.961981430611461, -0.9393654673928498, -0.9160209347355938, -0.8920658962782985, -0.8676173482504402, -0.8427902772227178, -0.8176968046351729, -0.7924454216783418, -0.7671403162095428, -0.7418807917741885, -0.7167607774576719, -0.6918684261936936, -0.6672857982723046, -0.643088626095071, -0.6193461556864085, -0.5961210600617501, -0.5734694192512562, -0.5514407615626995, -0.5300781605236545, -0.5094183818601252, -0.48949207483897517, -0.47032400232006877, -0.4519333039289407, -0.43433378687057766 ], [ -1.0639993299340333, -1.081616605591435, -1.098084999670188, -1.1132871288842205, -1.1271101680055857, -1.1394473987862084, -1.1501997331862408, -1.159277173333504, -1.1666001708029503, -1.1721008495390708, -1.175724060022999, -1.1774282369861615, -1.1771860388744628, -1.1749847540726026, -1.17082646624939, -1.1647279786928988, -1.1567205047781235, -1.146849138388466, -1.1351721238892756, -1.1217599498980357, -1.1066942944707707, -1.0900668513801774, -1.0719780679365476, -1.0525358244103584, -1.0318540837238181, -1.0100515378908776, -0.9872502749191181, -0.9635744867562732, -0.939149235564867, -0.9140992923077943, -0.8885480584589112, -0.8626165787139067, -0.8364226499318909, -0.8100800292209154, -0.7836977421005821, -0.7573794900212278, -0.7312231551688511, -0.7053203994051389, -0.6797563533467244, -0.6546093909399198, -0.6299509844016589, -0.6058456340427467, -0.582350867239419, -0.5595173006522315, -0.5373887596914599, -0.516002449184364, -0.49538916920468745, -0.4755735700748932, -0.45657444064523534, -0.43840502409073134 ], [ -1.0916027099493644, -1.110123744683738, -1.1274477120052735, -1.1434492084998653, -1.1580076102483758, -1.1710087697301155, -1.1823466859181504, -1.1919251049310045, -1.1996590087981684, -1.205475951942544, -1.2093172088466444, -1.2111387018938857, -1.2109116852909585, -1.2086231689148634, -1.2042760744548684, -1.1978891248664922, -1.1894964764566625, -1.1791471104522402, -1.1669040073159267, -1.1528431321100392, -1.1370522627255748, -1.1196296947603042, -1.1006828573173977, -1.080326873162776, -1.0586830947436137, -1.0358776447860993, -1.0120399868208618, -0.9873015472815883, -0.9617944070094004, -0.9356500762578462, -0.9089983637724961, -0.8819663473130473, -0.8546774501532913, -0.8272506256590254, -0.7997996500037284, -0.7724325214136971, -0.7452509630027547, -0.7183500252189613, -0.691817783136238, -0.6657351232387205, -0.6401756139243011, -0.6152054536611957, -0.5908834905387153, -0.567261306838162, -0.5443833621957271, -0.5222871889255044, -0.5010036331109804, -0.4805571351548107, -0.4609660435988102, -0.4422429561897798 ], [ -1.1186369555786726, -1.1380648760489, -1.15624755057241, -1.1730513020450606, -1.188347462270007, -1.2020142275442511, -1.2139384860118554, -1.22401756846432, -1.2321608745253592, -1.238291328599244, -1.2423466245373547, -1.2442802244850988, -1.2440620854733164, -1.2416790965652225, -1.2371352192345009, -1.230451333571101, -1.2216648023381955, -1.2108287733428207, -1.1980112476342544, -1.1832939464316121, -1.1667710132648819, -1.1485475895874953, -1.128738302200818, -1.1074656994361154, -1.0848586704469283, -1.061050878487491, -1.0361792350048822, -1.0103824370462358, -0.983799586128283, -0.9565689025349584, -0.9288265451458172, -0.9007055434471272, -0.872334845387159, -0.8438384822174729, -0.8153348493951865, -0.7869361009699423, -0.7587476535939945, -0.7308677953207876, -0.703387393641485, -0.6763896966997267, -0.6499502212766972, -0.6241367209138321, -0.5990092274083264, -0.5746201588545181, -0.5510144873959563, -0.5282299598886654, -0.5062973647505824, -0.48524083838378906, -0.46507820470585226, -0.44582134151604635 ], [ -1.1449212702310851, -1.1652524934867339, -1.1842905115944544, -1.201893165835257, -1.2179235458946505, -1.2322520148390463, -1.2447582039249223, -1.25533292255256, -1.2638799290543008, -1.2703175109606513, -1.2745798288356602, -1.2766179854552702, -1.276400791595712, -1.2739152104518985, -1.2691664740803765, -1.2621778765889136, -1.252990259429458, -1.2416612135248222, -1.2282640306257888, -1.2128864419613012, -1.1956291857840662, -1.1766044468631152, -1.1559342105107497, -1.1337485716388385, -1.11018403597047, -1.0853818462671836, -1.0594863616390193, -1.0326435130168394, -1.0049993529599646, -0.9766987133576119, -0.9478839804044599, -0.9186939925727118, -0.8892630641972157, -0.859720134729056, -0.8301880416596552, -0.8007829135174964, -0.77161367812919, -0.7427816804496636, -0.7143804036395544, -0.6864952866444445, -0.6592036312613458, -0.6325745915229599, -0.6066692381586537, -0.5815406908805718, -0.5572343112785474, -0.53378794918018, -0.5112322354387382, -0.48959091425137957, -0.4688812082857672, -0.44911421010724806 ], [ -1.1702638647153525, -1.191487236687295, -1.211369886199075, -1.2297610219489463, -1.2465153535772378, -1.2614952965482291, -1.2745731441453552, -1.2856331447748268, -1.2945734233628388, -1.3013076892524544, -1.305766679532709, -1.3078992958221667, -1.3076734036502147, -1.3050762760533403, -1.300114676063339, -1.2928145856183824, -1.283220600326556, -1.2713950198117625, -1.2574166715853863, -1.2413795122163072, -1.2233910529194187, -1.203570657642596, -1.182047760558033, -1.1589600469258627, -1.1344516370323403, -1.1086713077638857, -1.081770780789398, -1.0539031006570938, -1.025221120664836, -0.9958761093486265, -0.9660164859883336, -0.9357866897188989, -0.9053261836697623, -0.8747685930039296, -0.8442409737331068, -0.813863207672797, -0.783747517792775, -0.7539980974361833, -0.7247108463541325, -0.6959732061701526, -0.6678640876992248, -0.640453882458831, -0.6138045506944425, -0.5879697782779063, -0.5629951949112579, -0.5389186461736563, -0.5157705120836503, -0.493574065014154, -0.47234585999688206, -0.4520961506904173 ], [ -1.194462976947498, -1.216558909564709, -1.237267276124275, -1.2564285711359555, -1.2738890595882593, -1.2895031718224306, -1.3031358616394937, -1.3146648579052955, -1.3239827408569438, -1.330998778814735, -1.3356404688718009, -1.337854735914343, -1.3376087573449824, -1.3348903953074878, -1.3297082331238848, -1.322091227127107, -1.312087998248046, -1.2997657988797255, -1.285209199177063, -1.2685185427719847, -1.2498082248440532, -1.2292048457583677, -1.2068452914152101, -1.1828747875204881, -1.1574449697117222, -1.1307120053909376, -1.1028347967065903, -1.0739732877949686, -1.0442868934450085, -1.0139330609973438, -0.9830659726460094, -0.9518353914199744, -0.9203856509639068, -0.8888547867548033, -0.8573738045011068, -0.8260660800807504, -0.795046884390852, -0.7644230258173652, -0.7342926026114492, -0.7047448572162706, -0.6758601244724043, -0.6477098656024641, -0.620356779908348, -0.5938549861888338, -0.5682502659903862, -0.5435803609356558, -0.5198753165319114, -0.4971578650488553, -0.47544384027614406, -0.45474261723046905 ], [ -1.2173082099037364, -1.2402478400467212, -1.2617539745329776, -1.2816583948119746, -1.2997989444474134, -1.316022123358382, -1.330185639757767, -1.3421608412419666, -1.3518349479724336, -1.3591130165574798, -1.36391957279043, -1.3661998642167077, -1.365920698729988, -1.3630708520140589, -1.3576610435584215, -1.3497234971099492, -1.3393111158198374, -1.3264963142334436, -1.3113695581259357, -1.2940376687622046, -1.2746219504851155, -1.2532561998883902, -1.2300846516749169, -1.2052599112230753, -1.17894091751131, -1.1512909729915128, -1.1224758697865407, -1.0926621346431222, -1.0620154087044762, -1.0306989725679219, -0.9988724223487846, -0.9666904985900001, -0.934302066784094, -0.9018492459220852, -0.8694666797444333, -0.8372809441306936, -0.8054100832213059, -0.773963266322329, -0.7430405573229886, -0.7127327881924612, -0.6831215280676735, -0.6542791394621117, -0.6262689131925312, -0.5991452737208434, -0.5729540467347547, -0.5477327809408017, -0.5235111162190953, -0.500311190494504, -0.47814807791953373, -0.45703025124481556 ], [ -1.238582216309943, -1.262326614841748, -1.2845927508454908, -1.3052037907250238, -1.3239892830662845, -1.3407879605781519, -1.3554504919048664, -1.3678420950036232, -1.3778449261002115, -1.3853601654567766, -1.3903097328464085, -1.3926375809007805, -1.3923105322815488, -1.3893186456702689, -1.3836751145842963, -1.3754157207888604, -1.3645978795404619, -1.3512993262645776, -1.3356165030455711, -1.3176627083177925, -1.2975660745359743, -1.2754674367780539, -1.2515181507958306, -1.2258779126863248, -1.198712624837923, -1.1701923447854838, -1.1404893456555798, -1.1097763094298965, -1.0782246675905274, -1.0460030979927637, -1.0132761820856087, -0.9802032228311945, -0.9469372207702138, -0.913624003519642, -0.8804015024393655, -0.8473991691376558, -0.8147375237866935, -0.7825278267911768, -0.7508718651171031, -0.7198618444841071, -0.689580378609524, -0.6601005667356142, -0.631486150753594, -0.6037917433491211, -0.5770631187290193, -0.5513375576487634, -0.5266442386478499, -0.5030046676206427, -0.480433138108884, -0.45893721500380824 ], [ -1.2580627566846783, -1.2825622209265974, -1.3055400768640926, -1.326811085429572, -1.3461967458193829, -1.3635283120407047, -1.3786497484241886, -1.3914205250162344, -1.4017181573131894, -1.4094404040881117, -1.4145070513878932, -1.416861229013378, -1.4164702265250821, -1.413325797507666, -1.4074439619703805, -1.3988643360047566, -1.3876490340636778, -1.373881201690522, -1.3576632447996484, -1.3391148256473075, -1.3183706957296544, -1.2955784325711384, -1.2708961414730011, -1.2444901756106168, -1.2165329192184646, -1.1872006697079955, -1.1566716460097413, -1.1251241426326526, -1.092734842143206, -1.0596772930914053, -1.0261205558447213, -0.9922280152480697, -0.9581563563751048, -0.924054697719812, -0.8900638748444443, -0.8563158666101072, -0.822933355551169, -0.790029413618521, -0.7577073043372599, -0.7260603923494278, -0.6951721513063718, -0.6651162611160079, -0.6359567856248134, -0.607748421917257, -0.5805368125457855, -0.5543589121646055, -0.5292434002345618, -0.5052111316992883, -0.4822756178092632, -0.4604435295943555 ], [ -1.2755251552759126, -1.3007186232540513, -1.3243488290548242, -1.3462224641239835, -1.3661533589913417, -1.3839657194619972, -1.3994972868330307, -1.412602311181598, -1.4231542320858666, -1.4310479731710297, -1.4362017745688864, -1.4385585091905915, -1.438086452812931, -1.4347795024943248, -1.4286568610323873, -1.4197622255925397, -1.4081625351858809, -1.3939463436767687, -1.377221892204802, -1.3581149574633553, -1.336766550684565, -1.313330537194237, -1.2879712389263807, -1.260861073270772, -1.2321782719520948, -1.202104714051678, -1.1708238983477763, -1.1385190722391076, -1.1053715278200962, -1.0715590702366087, -1.037254659199195, -1.002625221327983, -0.9678306286754493, -0.9330228371393037, -0.8983451773694328, -0.8639317900456036, -0.8299071969408021, -0.7963859989017761, -0.763472691712409, -0.7312615907167748, -0.6998368550430245, -0.6692726022739011, -0.6396331044495478, -0.6109730563626671, -0.5833379072175311, -0.556764246875967, -0.5312802381095892, -0.5069060865217538, -0.4836545400981397, -0.4615314106935914 ], [ -1.2907451764446127, -1.3165598057137022, -1.340771498828666, -1.3631793547406759, -1.3835900666399423, -1.4018213804537702, -1.4177054572834078, -1.4310920158034526, -1.441851138442668, -1.4498756408123419, -1.455082925796538, -1.4574162698392619, -1.4568455168911085, -1.453367182928465, -1.4470039989682615, -1.4378039415695016, -1.4258388159597573, -1.4112024676901835, -1.394008704126233, -1.3743890075541054, -1.3524901179764217, -1.3284715567454732, -1.3025031530899964, -1.2747626253569224, -1.2454332583186307, -1.2147017079082718, -1.1827559557454204, -1.1497834280934076, -1.1159692875542417, -1.081494900818166, -1.0465364820063596, -1.011263908385867, -0.9758397032869088, -0.9404181797145134, -0.9051447372451172, -0.8701553041946968, -0.8355759166344854, -0.8015224255420333, -0.7681003231652169, -0.7354046795208508, -0.7035201798375876, -0.6725212536833911, -0.6424722864934072, -0.6134279042391853, -0.5854333220587993, -0.558524747803345, -0.5327298316508071, -0.5080681531946537, -0.4845517377322437, -0.4621855938557471 ], [ -1.3035023423184096, -1.329853299832023, -1.3545639391063944, -1.3774263984046853, -1.3982409297086367, -1.4168195792273526, -1.4329897453697271, -1.4465974759694313, -1.4575103777457157, -1.465620031356797, -1.470843832698466, -1.4731262123990567, -1.4724392176919359, -1.4687824712359632, -1.4621825478279138, -1.45269183086767, -1.4403869251816288, -1.4253667113078725, -1.407750129035644, -1.3876737756874917, -1.3652893983919812, -1.3407613505872147, -1.3142640723788235, -1.2859796431970785, -1.2560954443137573, -1.2248019588187793, -1.1922907280095123, -1.1587524759866004, -1.1243754085773068, -1.089343688393142, -1.0538360846702346, -1.0180247943037781, -0.9820744289407612, -0.946141161932812, -0.9103720282071127, -0.874904369565138, -0.8398654174838741, -0.8053720051248731, -0.7715303999306109, -0.738436247901866, -0.7061746204093591, -0.6748201542084731, -0.6444372752072937, -0.6150804964936147, -0.5867947811609571, -0.5596159605885338, -0.5335711990250888, -0.5086794955984466, -0.4849522152177952, -0.4623936402486506 ], [ -1.3135837108101598, -1.340374222820112, -1.3654896710854663, -1.3887160321607426, -1.4098479897854639, -1.428692833480964, -1.4450742004312982, -1.4588355069467895, -1.4698429315545305, -1.4779878382400573, -1.4831885623447294, -1.4853915191146916, -1.4845716319118896, -1.4807321102812376, -1.4739036350805552, -1.464143027494774, -1.451531490746128, -1.4361725182189318, -1.4181895605895272, -1.397723538712242, -1.3749302798683074, -1.3499779438879749, -1.3230444937995576, -1.294315254010744, -1.2639805882986745, -1.2322337205267977, -1.1992687132327657, -1.1652786130614408, -1.1304537673259536, -1.0949803125518585, -1.0590388334374206, -1.0228031889865814, -0.9864395014049774, -0.9501053025015407, -0.9139488316660748, -0.8781084789033582, -0.8427123658462401, -0.8078780571265907, -0.7737123939593318, -0.7403114413096789, -0.7077605395899165, -0.6761344514912986, -0.6454975943155438, -0.6159043480386903, -0.5873994293214927, -0.5600183217729525, -0.5337877529708003, -0.508726209036549, -0.4848444779429346, -0.46214621318792803 ], [ -1.320788130237828, -1.347909842267647, -1.3733247688694736, -1.3968137011297705, -1.4181668131376022, -1.4371877703597633, -1.4536976381185795, -1.4675384197086951, -1.4785760753842778, -1.4867029077061167, -1.4918392410026562, -1.4939343675534495, -1.4929667753737088, -1.4889437081228556, -1.4819001342475444, -1.4718972192152489, -1.4590204021676811, -1.4433771779911413, -1.4250946795691528, -1.4043171448211145, -1.3812033408248192, -1.3559240043369793, -1.3286593454652218, -1.2995966498517917, -1.2689280049323393, -1.2368481678024341, -1.2035525859316498, -1.169235577243496, -1.1340886726781754, -1.098299121986959, -1.062048561884212, -1.025511844547907, -0.9888560235993505, -0.9522394939511596, -0.915811281188339, -0.8797104753900755, -0.8440658035000058, -0.8089953335293187, -0.7746063030663346, -0.7409950638101126, -0.7082471331841494, -0.6764373435507003, -0.645630079157908, -0.6158795907200134, -0.5872303774550991, -0.5597176264767478, -0.5333676996422801, -0.5081986582844975, -0.48422081667924255, -0.4614373156104734 ], [ -1.3249309802045655, -1.3522646764690942, -1.3778633289494755, -1.4015037035436502, -1.4229727131967478, -1.4420717225077408, -1.458620599107875, -1.4724613233398947, -1.483460997042998, -1.4915141362479887, -1.4965441850072716, -1.4985042411314478, -1.4973770325796443, -1.493174220795579, -1.4859351319836454, -1.4757250291448418, -1.462633038419754, -1.446769835719493, -1.4282651868359701, -1.4072654189822837, -1.3839308861794422, -1.3584334765289787, -1.3309541970044574, -1.3016808612718764, -1.2708058981828927, -1.2385242927453262, -1.2050316672293233, -1.1705225072487682, -1.1351885358071703, -1.0992172370913227, -1.0627905309590353, -1.026083598381527, -0.9892638574101913, -0.9524900884450379, -0.9159117066466241, -0.8796681782593384, -0.8438885764394927, -0.8086912709665877, -0.7741837450277812, -0.7404625311696198, -0.7076132575618532, -0.6757107949554173, -0.6448194941622521, -0.6149935035451253, -0.5862771558732902, -0.5587054139577969, -0.5323043647053445, -0.5070917515959874, -0.4830775360720765, -0.4602644788992961 ], [ -1.3258493935083222, -1.3532661223950493, -1.378923511810214, -1.4025956489116491, -1.4240676222348339, -1.4431400028319177, -1.4596330078731667, -1.473390139079008, -1.4842811270206782, -1.4922040682896038, -1.497086707242749, -1.498886877766027, -1.497592174611, -1.4932189625037746, -1.4858108521422262, -1.4754367765049263, -1.4621887921280097, -1.446179712842002, -1.4275406625249019, -1.406418612458749, -1.3829739503433884, -1.35737811313897, -1.3298113049088143, -1.3004603133207961, -1.2695164337447555, -1.2371735072009447, -1.203626077089463, -1.1690676691108302, -1.133689198655819, -1.0976775098973157, -1.0612140506532464, -1.0244736866789317, -0.9876236583252614, -0.9508226814544012, -0.9142201931714147, -0.8779557413750799, -0.8421585154451008, -0.8069470136655873, -0.7724288413343663, -0.7387006320105104, -0.705848083074688, -0.6739460957625538, -0.6430590091002765, -0.6132409167230828, -0.5845360553751464, -0.5569792539435945, -0.5305964321361532, -0.5054051383339031, -0.48141511670233095, -0.4586288942929486 ], [ -1.323407923878909, -1.3507705706605757, -1.3763541070598868, -1.3999314698813146, -1.4212875388378747, -1.4402237674529876, -1.4565624208217987, -1.4701501924662366, -1.4808610224711771, -1.488598009408052, -1.4932943879032927, -1.4949136193086299, -1.4934487036373207, -1.4889208596526613, -1.4813777347632766, -1.470891299959904, -1.4575555634294544, -1.441484206965379, -1.422808218535176, -1.4016735672366805, -1.3782389460052134, -1.3526735934463945, -1.3251551982958407, -1.2958678867801978, -1.2650002929738802, -1.2327437137240727, -1.1992903518197051, -1.1648316531308096, -1.1295567450527586, -1.0936509845660105, -1.0572946245049724, -1.020661606233997, -0.983918485918252, -0.9472235000461982, -0.9107257739276735, -0.8745646746902024, -0.8388693079674675, -0.8037581551555522, -0.7693388459289697, -0.7357080587622201, -0.7029515405677614, -0.6711442352815988, -0.6403505103177166, -0.6106244692616487, -0.5820103389515673, -0.554542919160285, -0.5282480833946553, -0.5031433198208662, -0.479238301958577, -0.45653547952284357 ], [ -1.3175045710880893, -1.3446699097402615, -1.370041512383307, -1.393392863076051, -1.414510408145651, -1.4331983022122168, -1.4492826745731353, -1.4626151673679533, -1.4730755599722514, -1.480573381164644, -1.4850485071293185, -1.4864708327258016, -1.4848391713424056, -1.4801795762933827, -1.4725432825071285, -1.4620044462005106, -1.4486578217764245, -1.4326164701301236, -1.4140095502757888, -1.392980212859423, -1.3696835921969823, -1.3442848824400881, -1.3169574809733984, -1.2878811852038712, -1.2572404347600825, -1.2252225976964062, -1.1920163052689021, -1.1578098445373073, -1.1227896212215203, -1.0871387069371419, -1.0510354853191324, -1.0146524108272277, -0.9781548924306326, -0.9417003121049594, -0.9054371853452878, -0.8695044679010646, -0.8340310098568339, -0.7991351551855898, -0.7649244821338674, -0.7314956773722685, -0.6989345348393858, -0.667316068660369, -0.6367047284390476, -0.6071547045808887, -0.5787103110578096, -0.5514064331172437, -0.5252690278029744, -0.5003156657315072, -0.476556103297189, -0.4539928753123589 ], [ -1.3080769911173376, -1.3348982319423506, -1.3599169214945361, -1.382908934252525, -1.4036641877340725, -1.421991460644922, -1.4377226352652088, -1.4507160944230104, -1.4608590809513624, -1.4680689336243535, -1.4722932298642906, -1.473508970881457, -1.4717210208827933, -1.466960047411173, -1.4592802033856505, -1.448756750981833, -1.4354837672905432, -1.4195720074429627, -1.4011469455058867, -1.3803469744443553, -1.3573217256039902, -1.3322304629498343, -1.3052405129868765, -1.2765257028645736, -1.2462647925260066, -1.2146398991611158, -1.1818349222153013, -1.1480339843098422, -1.1134199077588414, -1.078172748312665, -1.0424684077944544, -1.0064773458749776, -0.9703634087407462, -0.9342827891779608, -0.8983831289000084, -0.8628027700337865, -0.8276701587675668, -0.793103400439844, -0.7592099619713465, -0.7260865146288458, -0.6938189077345656, -0.6624822621310078, -0.6321411709705738, -0.6028499946833861, -0.5746532367233464, -0.5475859868263517, -0.5216744189564737, -0.49693633178890295, -0.47338172041320414, -0.45101336887851384 ], [ -1.2951086023651643, -1.3214384280862739, -1.3459633831262856, -1.3684636840178168, -1.3887347088223234, -1.4065918361348244, -1.421874604823362, -1.4344499040684653, -1.4442139961207436, -1.4510933010497467, -1.455044011442992, -1.4560507291133646, -1.4541244014969734, -1.4492998677413351, -1.4416333019209153, -1.4311997751700192, -1.4180910705784986, -1.4024137970495993, -1.3842877785384182, -1.3638446519432454, -1.3412265904786247, -1.316585073800424, -1.2900796433644999, -1.2618766039098332, -1.232147654029897, -1.2010684473365263, -1.1688170994638472, -1.135572665110193, -1.1015136141371331, -1.0668163373176005, -1.031653711497135, -0.9961937514098315, -0.9605983717239492, -0.9250222785029153, -0.8896120044884659, -0.8545050977176311, -0.8198294682081537, -0.7857028929865456, -0.7522326757492235, -0.7195154540575753, -0.6876371442409253, -0.6566730121392661, -0.626687856438771, -0.5977362905815814, -0.5698631089876416, -0.5431037235174947, -0.517484656635531, -0.49302407851232544, -0.4697323762519454, -0.44761274447796573 ], [ -1.2786341578376608, -1.3043282044628914, -1.328222229417559, -1.3501027990273153, -1.369772766735208, -1.387056074374228, -1.4018017664763671, -1.4138869073144291, -1.423218198333423, -1.429732242202329, -1.433394563317465, -1.4341976408925476, -1.4321583086786822, -1.427314904208883, -1.4197245074382672, -1.4094605104648057, -1.3966106368673865, -1.3812754134315812, -1.3635670122583279, -1.3436083369632708, -1.3215322194947168, -1.2974806130761365, -1.2716036991988084, -1.2440588619198316, -1.215009514182005, -1.184623785262425, -1.153073095154354, -1.1205306515356845, -1.0871699094092049, -1.053163033985769, -1.018679405165576, -0.983884197999347, -0.9489370684556391, -0.9139909681615769, -0.8791911058735615, -0.8446740675502574, -0.8105671012745137, -0.7769875681001635, -0.7440425553408919, -0.7118286449836189, -0.6804318268592059, -0.6499275439488026, -0.620380855708901, -0.5918467044892848, -0.5643702698983027, -0.5379873962290448, -0.5127250786869832, -0.48860199504997504, -0.465629070454059, -0.443810064157497 ], [ -1.2587442121868317, -1.283664899750496, -1.3067982035843095, -1.327939035803784, -1.3468996915987876, -1.3635145488694913, -1.3776438729745628, -1.3891763979788356, -1.3980304774071466, -1.4041537676862523, -1.4075215983209728, -1.4081343558343478, -1.4060143228675157, -1.4012024396669538, -1.3937553865198637, -1.3837432456470595, -1.3712478334474731, -1.3563616450420701, -1.339187254013579, -1.3198369699399504, -1.2984325651174604, -1.2751049211852237, -1.2499934976318272, -1.2232455738365728, -1.1950152569475196, -1.1654622770599838, -1.1347506094515507, -1.103046973105219, -1.07051925778249, -1.0373349305920831, -1.0036594689457434, -0.9696548611226112, -0.9354782091159358, -0.9012804614927595, -0.8672052969906329, -0.8333881727603855, -0.7999555447548938, -0.7670242619448113, -0.7347011309632516, -0.7030826435475936, -0.6722548558107528, -0.642293405936047, -0.6132636552990163, -0.5852209371881376, -0.5582108971098474, -0.5322699089957992, -0.5074255523555224, -0.48369713641879586, -0.46109625848789304, -0.4396273849870378 ], [ -1.2355878122580877, -1.2596083653630086, -1.2818624901664972, -1.3021553480901988, -1.3203105082009077, -1.3361744789657886, -1.3496202414397633, -1.3605494391265611, -1.3688930122389165, -1.3746102544680228, -1.3776864905220298, -1.378129777924981, -1.3759671734128, -1.3712411285232189, -1.3640064784643668, -1.3543282946401751, -1.3422806479317377, -1.3279461428448316, -1.3114159722441499, -1.2927902139989051, -1.272178124239879, -1.249698247812322, -1.2254782395547623, -1.1996543542629579, -1.1723706116788868, -1.143777674859977, -1.1140314983399007, -1.0832918101477438, -1.0517204923856531, -1.019479921349735, -0.9867313219913632, -0.9536331840574456, -0.9203397792388466, -0.8869998105222657, -0.8537552169558176, -0.8207401494107616, -0.7880801258351351, -0.7558913681174628, -0.7242803171503864, -0.6933433181056277, -0.6631664643493115, -0.6338255858315236, -0.605386366114848, -0.5779045713611737, -0.5514263744458257, -0.5259887577720072, -0.5016199791775526, -0.478340086431536, -0.4561614671001558, -0.43508942192949895 ], [ -1.2093727307411704, -1.2323811563644682, -1.2536528273775873, -1.273004878089294, -1.2902737580549455, -1.3053195308173047, -1.3180290792398313, -1.3283178592824907, -1.3361299834736586, -1.3414366232243402, -1.3442329699398525, -1.3445342386340113, -1.3423713647776403, -1.337787070284302, -1.3308328349561551, -1.3215670481126427, -1.3100543235113564, -1.2963657319921005, -1.2805795907123345, -1.2627824423280178, -1.2430699253234623, -1.221547334796172, -1.19832976915504, -1.1735418355127873, -1.1473169402734171, -1.1197962236971315, -1.0911272129966814, -1.0614622729721848, -1.0309569306300264, -0.9997681437534367, -0.9680525749922277, -0.9359649238774156, -0.9036563598605006, -0.8712730903425747, -0.838955088878508, -0.8068350004621463, -0.7750372331679349, -0.7436772385925055, -0.7128609776413799, -0.6826845633388434, -0.6532340685475135, -0.6245854837545315, -0.596804808343784, -0.5699482579159603, -0.5440625700990271, -0.519185391758219, -0.49534573141588045, -0.47256446188901235, -0.4508548595280747, -0.43022316789812254 ], [ -1.1803626877020705, -1.20226541181193, -1.2224700167436597, -1.2408070685712214, -1.2571271912285558, -1.2713050712626024, -1.2832422874629068, -1.2928685973559868, -1.3001414543422731, -1.305043750824497, -1.3075800642392383, -1.3077719708674664, -1.305653197776993, -1.3012654126251983, -1.2946552648325527, -1.2858729466907612, -1.2749721704507742, -1.262011186123862, -1.2470543539706316, -1.2301738163297244, -1.2114509253900823, -1.1909772174182391, -1.168854842126393, -1.1451964430150854, -1.1201245399573314, -1.0937704950155724, -1.0662731540949828, -1.037777257245897, -1.0084317042346655, -0.9783877527059611, -0.947797215801715, -0.9168107154863739, -0.8855760374981076, -0.8542366239667758, -0.8229302303871842, -0.791787764888012, -0.7609323197055629, -0.7304783975938457, -0.7005313297116637, -0.6711868764241375, -0.6425309984874591, -0.6146397832366577, -0.5875795085936228, -0.5614068268361383, -0.536169049968256, -0.5119045190452534, -0.48864304077184595, -0.46640637596415147, -0.445208765918211, -0.42505748425980694 ], [ -1.148871279286199, -1.1695961038733536, -1.1886704671006652, -1.2059394894939393, -1.2212688786335657, -1.2345485849146516, -1.2456952170878104, -1.2546528445141423, -1.2613919530620596, -1.2659065523044952, -1.2682097418729015, -1.268328379709113, -1.2662977451797235, -1.2621571269787863, -1.2559470267968085, -1.2477082281702137, -1.2374825173041903, -1.2253145320597922, -1.2112541223147397, -1.1953586849026299, -1.1776950991531994, -1.1583410587929321, -1.13738573240934, -1.114929777092598, -1.0910847832810617, -1.065972253570817, -1.0397222244188355, -1.0124716351596148, -0.9843625389391232, -0.9555402383116061, -0.9261514160818994, -0.8963423202695553, -0.8662570510469048, -0.8360359871615701, -0.8058143796574551, -0.7757211316711772, -0.7458777747861776, -0.7163976450040843, -0.6873852549801468, -0.658935853875579, -0.6311351620582913, -0.6040592649238252, -0.5777746482361195, -0.5523383564794352, -0.5277982556121343, -0.5041933821498589, -0.4815543615124763, -0.4599038798923485, -0.4392571954099159, -0.41962267591037794 ], [ -1.1152527287018514, -1.1347507775182175, -1.1526548950200988, -1.1688254928910304, -1.1831438400139402, -1.1955153206374356, -1.20587140615293, -1.214169969146555, -1.2203937038953645, -1.2245466528850335, -1.2266491725481572, -1.2267320498040797, -1.2248307762349961, -1.2209810330592288, -1.21521614671793, -1.207566731816837, -1.1980621848357613, -1.1867333506081605, -1.1736156209961448, -1.158751862916651, -1.1421947875074072, -1.124008573570093, -1.104269707482721, -1.0830670947457592, -1.0605015467429706, -1.0366847646014619, -1.0117379423651187, -0.985790102647742, -0.9589762649279834, -0.9314355327274584, -0.9033091725156777, -0.8747387447921994, -0.8458643364086882, -0.8168229326510816, -0.7877469577663557, -0.7587630034496917, -0.7299907563683872, -0.7015421282180421, -0.6735205852317964, -0.6460206686157484, -0.6191276931278009, -0.5929176079491698, -0.5674570020465232, -0.5428032352643701, -0.5190046762625387, -0.4961010289480704, -0.47412373007170483, -0.4530964020078838, -0.43303534627804086, -0.4139500649999942 ], [ -1.079890020733178, -1.0981364109353282, -1.114853874768328, -1.129918441029366, -1.1432269685356717, -1.1546999645625922, -1.164283090717893, -1.1719469958568745, -1.1776852463189593, -1.1815103602324526, -1.1834483012147956, -1.1835321967226142, -1.1817963764924788, -1.178271879552654, -1.1729842362910083, -1.1659536988772001, -1.1571974633454154, -1.1467330671471316, -1.1345821202900557, -1.1207737221105991, -1.105347175461423, -1.0883538353942444, -1.0698580851513793, -1.0499375223369585, -1.0286824801398078, -1.0061950202549297, -0.9825875291977707, -0.9579810368901556, -0.9325033609515936, -0.9062871647761872, -0.8794680033373155, -0.8521824179575905, -0.8245661298113838, -0.7967523713955659, -0.7688703853901284, -0.7410441111536554, -0.7133910706090489, -0.6860214576064885, -0.6590374281631781, -0.6325325834084039, -0.6065916326854761, -0.5812902210847881, -0.556694903639436, -0.5328632473855243, -0.5098440423140469, -0.487677602744368, -0.4663961416548136, -0.44602420185220326, -0.4265791294098804, -0.4080715764400358 ], [ -1.0431813803154137, -1.0601744914079398, -1.075711468721445, -1.0896838717499373, -1.102003739878217, -1.1126059367643206, -1.1214491763741643, -1.1285153925494682, -1.1338072417924336, -1.13734376408735, -1.1391545792263136, -1.1392734173319092, -1.1377321252021495, -1.1345563404487387, -1.1297636490554073, -1.1233643514448617, -1.1153642873732252, -1.1057688066784668, -1.0945869792281016, -1.0818353732641692, -1.067541022276679, -1.0517434404909292, -1.0344957048034722, -1.0158647067246138, -0.9959307138956371, -0.9747863872179034, -0.9525353907643601, -0.92929071625209, -0.9051728268825641, -0.8803077092217441, -0.8548249073601883, -0.8288556008780341, -0.8025307767934138, -0.7759795352988734, -0.7493275594089561, -0.7226957695450416, -0.6961991756147515, -0.6699459314427892, -0.6440365896510507, -0.6185635494173979, -0.5936106850560292, -0.5692531400739984, -0.5455572692114983, -0.5225807098520742, -0.5003725639368091, -0.47897367195869345, -0.4584169615735709, -0.43872785467929554, -0.4199247183429544, -0.40201934658256966 ], [ -1.0055263115957853, -1.021285705870383, -1.0356685352876378, -1.0485814091444725, -1.0599507355264708, -1.0697245687480843, -1.0778731537029922, -1.0843878635531359, -1.0892783551182545, -1.092567998280055, -1.0942879802735739, -1.0944708932403309, -1.0931449389761596, -1.090329918079782, -1.086035780914227, -1.0802638195947325, -1.0730099057718543, -1.0642688251880303, -1.0540387826952757, -1.042325404792882, -1.0291448703128279, -1.014526044924497, -0.9985116518670768, -0.9811585932129414, -0.9625375679525829, -0.9427321365810578, -0.9218373709955178, -0.8999582119634209, -0.8772076388832171, -0.8537047402527858, -0.8295727589036207, -0.804937173551411, -0.7799238671232476, -0.754657422192629, -0.7292595743714402, -0.7038478455478493, -0.6785343704623858, -0.653424922427006, -0.6286181371967375, -0.604204928262392, -0.5802680822489226, -0.5568820197047113, -0.5341127043054879, -0.5120176822639393, -0.4906462333822401, -0.47003961553781004, -0.45023138527852, -0.43124777845919937, -0.413108136334307, -0.3958253641152272 ], [ -0.9673124593315899, -0.981875700577599, -0.9951473855297822, -1.0070483341109528, -1.017518166208778, -1.0265166460137365, -1.0340237609273195, -1.0400382773864014, -1.0445746461407013, -1.0476583554435548, -1.0493201545505249, -1.0495899394249417, -1.0484913722419742, -1.0460383100449124, -1.0422337376398059, -1.0370712454968922, -1.0305384648654463, -1.0226215396738674, -1.013309735398867, -1.0025995290149923, -0.9904978204198249, -0.9770241462096979, -0.9622119301182999, -0.9461088839923908, -0.9287767039179359, -0.9102902091317417, -0.8907360606065041, -0.8702111799648322, -0.84882097221306, -0.8266774398636478, -0.8038972620398875, -0.780599900016816, -0.7569057798994412, -0.7329345933028568, -0.7088037476527606, -0.6846269889390508, -0.6605132114691455, -0.6365654615315258, -0.6128801350822419, -0.5895463637784678, -0.5666455790167118, -0.5442512401268063, -0.5224287104898528, -0.5012352639894025, -0.48072020372804236, -0.46092507518044534, -0.4418839567385193, -0.42362381177389297, -0.4061648877555818, -0.3895211494989169 ], [ -0.9289043755937298, -0.9423231436227368, -0.9545391929668934, -0.96548641292903, -0.9751162123233346, -0.9833983760669301, -0.9903207177590101, -0.9958873248994292, -1.0001153255306694, -1.0030303200812325, -1.004660913718738, -1.0050330979691822, -1.0041654467663634, -1.002066062604675, -0.9987318575393388, -0.9941501804160464, -0.9883022517551512, -0.9811675664112698, -0.9727284304011979, -0.9629740114672493, -0.9519035540614055, -0.9395286356810109, -0.9258744889953942, -0.9109804927219793, -0.8948999663226485, -0.8776994087986361, -0.8594573132279113, -0.8402626741565511, -0.8202132890492778, -0.7994139399922773, -0.7779745285351503, -0.7560082249289014, -0.7336296826672559, -0.7109533597278842, -0.6880919789258353, -0.6651551512082596, -0.6422481775784128, -0.6194710377877629, -0.5969175671686717, -0.574674817171708, -0.5528225904409733, -0.5314331376558339, -0.510571000861384, -0.4902929865148785, -0.4706482508581401, -0.45167848032943936, -0.43341815038808085, -0.4158948471843624, -0.39912963782667177, -0.38313747645900287 ], [ -0.8906349201525847, -0.9029708845582443, -0.914195018430877, -0.9242529139714977, -0.9331061781414983, -0.9407328401809277, -0.947126640045186, -0.9522950523524685, -0.9562560314118113, -0.9590336605514299, -0.9606531390431485, -0.9611357888872583, -0.9604949139405784, -0.9587332868241337, -0.9558427303563207, -0.951805783763406, -0.9465989869658287, -0.9401970539801828, -0.9325771956096641, -0.9237230227560664, -0.9136276948878034, -0.902296181676996, -0.8897466441745209, -0.8760110195926039, -0.8611349288458516, -0.8451770351750169, -0.8282079771696383, -0.8103089878149119, -0.791570297333449, -0.7720894039982388, -0.7519692847534141, -0.7313166065191279, -0.7102399891912667, -0.6888483622048326, -0.6672494478386597, -0.6455483960903001, -0.6238465879889726, -0.60224061679005, -0.5808214497959694, -0.559673767751022, -0.5388754739861943, -0.5184973617999981, -0.49860292593683986, -0.47924830238859095, -0.46048231997669553, -0.44234664712400884, -0.4248760177411399, -0.40809852108071354, -0.3920359416177801, -0.37670413638011535 ], [ -0.8527995891058234, -0.8641204731721959, -0.874420659415378, -0.8836559435346547, -0.8917964799299758, -0.898826799509032, -0.9047448136904462, -0.9095597152453015, -0.9132888115981259, -0.9159535004737395, -0.9175748020122514, -0.9181690472291786, -0.917744415080694, -0.9162989364411099, -0.9138203220252119, -0.910287590185894, -0.9056741055351667, -0.8999514197853044, -0.8930932819092963, -0.8850793122261484, -0.8758980244177333, -0.8655490544695653, -0.8540445815025401, -0.8414100013306506, -0.8276839518104757, -0.8129178028578001, -0.7971747234328136, -0.7805284297123931, -0.7630617074944112, -0.7448647901644883, -0.7260336624895656, -0.7066683504005491, -0.6868712476553378, -0.666745521568516, -0.6463936316444326, -0.6259159868787139, -0.6054097597548191, -0.5849678677050253, -0.5646781262141027, -0.5446225719932287, -0.5248769498671765, -0.5055103532623074, -0.486585005450076, -0.4681561669266854, -0.45027215338495175, -0.4329744485241577, -0.4162978963009125, -0.4002709580051871, -0.38491602061904273, -0.3702497441677042 ], [ -0.8156536615833122, -0.8260298178711182, -0.8354749625102733, -0.8439535588499285, -0.8514427012676544, -0.8579318166869484, -0.8634214717769279, -0.8679212457528729, -0.8714467427794331, -0.8740159650650958, -0.8756454268981326, -0.8763465205357642, -0.8761226929697521, -0.8749679123956421, -0.8728666884790164, -0.8697956136271505, -0.8657261092164028, -0.860627883000164, -0.8544725719628861, -0.847237133588332, -0.8389066947150035, -0.8294767115400412, -0.8189544054401644, -0.8073595115006549, -0.794724417009931, -0.781093785253839, -0.7665237638749185, -0.7510808728962458, -0.7348406594011108, -0.7178861963792504, -0.7003064937368797, -0.6821948804231368, -0.6636474080851507, -0.6447613184889732, -0.6256336090048855, -0.6063597227183768, -0.587032382263877, -0.5677405794364883, -0.5485687261983719, -0.5295959670314533, -0.5108956478236123, -0.49253493267917103, -0.47457455722045105, -0.4570687050430273, -0.4400649929085343, -0.42360454988193974, -0.4077221758103514, -0.3924465651623429, -0.37780058317497234, -0.3638015823804054 ], [ -0.7794117595534675, -0.7889134352648919, -0.7975708771958, -0.8053557312033122, -0.8122505512888225, -0.8182482636806914, -0.8233508624412463, -0.8275673359026845, -0.8309109228763301, -0.8333959167017992, -0.8350343540486542, -0.8358330121590123, -0.8357911558689447, -0.8348993973577519, -0.8331398589304861, -0.8304876018918526, -0.8269130690406916, -0.82238514804656, -0.816874428410575, -0.810356282483349, -0.8028135091111401, -0.7942383933805723, -0.7846341308632458, -0.7740156313840005, -0.7624097581927569, -0.7498550797043227, -0.736401218890384, -0.7221078850306104, -0.7070436675811462, -0.6912846648595696, -0.674913012485615, -0.658015368704771, -0.640681406051344, -0.62300235126982, -0.6050696079697404, -0.5869734891553939, -0.5688020796418467, -0.5506402415961893, -0.5325687702055517, -0.5146637009374139, -0.49699576515024946, -0.4796299870053148, -0.46262541173740335, -0.4460349533236124, -0.42990534836382155, -0.41427720244540345, -0.39918511528462663, -0.38465787139326135, -0.37071868379267525, -0.357385479284259 ], [ -0.7442492625851034, -0.7529445978623974, -0.7608784061788729, -0.7680281488255032, -0.7743805419636234, -0.7799308593559886, -0.7846815910181739, -0.7886404855774731, -0.7918180877124193, -0.7942249750225128, -0.7958689840696926, -0.7967527695285213, -0.7968720390441204, -0.7962147347540056, -0.7947612958735005, -0.7924859647382956, -0.7893589366867877, -0.7853490452767677, -0.7804266406452003, -0.7745663539195351, -0.7677495177334182, -0.7599661015671468, -0.7512160993399011, -0.7415103661457303, -0.7308709406354418, -0.7193309126836636, -0.706933907016382, -0.693733256422076, -0.6797909362054955, -0.6651763269064629, -0.6499648663872841, -0.6342366459302862, -0.6180749983025251, -0.6015651189471587, -0.5847927545989955, -0.5678429867653351, -0.5507991307812388, -0.5337417647018085, -0.5167478963085298, -0.4998902711455119, -0.4832368198906014, -0.46685023958248273, -0.4507877002901166, -0.43510066669831404, -0.41983482272555217, -0.4050300865927666, -0.3907207036146304, -0.37693540427354033, -0.36369761575122805, -0.3510257159342698 ], [ -0.710304994032694, -0.7182586967090696, -0.7255286677246431, -0.7320969777074093, -0.7379534169251123, -0.7430947039099477, -0.7475231666101958, -0.7512449421469878, -0.7542678089551178, -0.7565988353636905, -0.7582420878944256, -0.7591966739177212, -0.7594553814158068, -0.7590041160598584, -0.7578222290589604, -0.7558836998561437, -0.7531590166809015, -0.7496175141994323, -0.7452298966770813, -0.7399706946394757, -0.7338204565147001, -0.7267675434603005, -0.7188094590934319, -0.7099536972801741, -0.7002181280444044, -0.6896309652956805, -0.6782303732137803, -0.6660637737362578, -0.6531869182417778, -0.6396627841425486, -0.6255603529898073, -0.6109533216260137, -0.595918792291743, -0.580535981618399, -0.5648849822341759, -0.5490456044002872, -0.5330963188218586, -0.5171133157119502, -0.5011696895036235, -0.485334753463755, -0.4696734839893969, -0.45424609064305643, -0.4391077050380483, -0.42430817950383515, -0.4098919849908583, -0.395898196834516, -0.3823605566919096, -0.36930759909014543, -0.3567628314805267, -0.3447449573862005 ], [ -0.6776846577835989, -0.6849572415434244, -0.691618444866936, -0.6976539220182203, -0.7030556606273002, -0.7078211512847242, -0.7119521342604878, -0.7154529792565874, -0.7183288073294756, -0.7205835157821348, -0.7222179065133056, -0.7232281344634943, -0.72360467601544, -0.723331964327514, -0.7223887557833784, -0.7207491946422733, -0.7183844526039054, -0.7152647557866438, -0.7113615845412018, -0.706649841048643, -0.7011098158770643, -0.694728833880557, -0.6875025099137708, -0.6794355881042733, -0.6705423716239591, -0.6608467728850285, -0.6503820283299564, -0.6391901295120479, -0.627321024927666, -0.6148316466540081, -0.6017848134131003, -0.5882480579688891, -0.57429242221825, -0.559991258226899, -0.5454190679712134, -0.5306504088376683, -0.5157588861703555, -0.5008162485204101, -0.48589159591484543, -0.4710507065838371, -0.4563554832904285, -0.44186351677852975, -0.42762776093227295, -0.41369631201847823, -0.4001122828243867, -0.38691376153877133, -0.3741338447730871, -0.3618007340893088, -0.349937885702039, -0.33856420356827066 ], [ -0.646464611246504, -0.6531120647501046, -0.6592147815971584, -0.6647611548816406, -0.6697446887926995, -0.6741631711976883, -0.6780175138318552, -0.6813103194633987, -0.6840442762173107, -0.6862205163054298, -0.6878371020623298, -0.6888878086940606, -0.6893613549772313, -0.6892411894200079, -0.6885058754665421, -0.6871300463994937, -0.6850858329833005, -0.6823446176621839, -0.678878945988435, -0.6746644293186517, -0.6696814968365183, -0.6639168906934108, -0.6573648368331306, -0.6500278596188471, -0.64191723736844, -0.6330531173710646, -0.6234643234351442, -0.6131878977367222, -0.6022684230831485, -0.5907571729172085, -0.5787111354234002, -0.5661919556412729, -0.553264835993794, -0.5399974314046975, -0.5264587704303355, -0.5127182287593937, -0.49884457622179723, -0.48490511327899577, -0.4709649080163639, -0.4570861400800297, -0.4433275539197744, -0.4297440202030208, -0.416386201397682, -0.4033003152903267, -0.39052798858344817, -0.37810619164940207, -0.3660672449385838, -0.35443888736715135, -0.3432443971639668, -0.3325027560596966 ], [ -0.6166956757277773, -0.6227694361971217, -0.6283593517727795, -0.6334558779490904, -0.6380535254007986, -0.6421500653477603, -0.6457454784958616, -0.6488407059983858, -0.6514362915283135, -0.6535310295568866, -0.6551207508204601, -0.6561973766738423, -0.6567483564533207, -0.6567565663569935, -0.6562006990695329, -0.6550561184217873, -0.6532961025665419, -0.6508933613257457, -0.6478216939551557, -0.6440576533613023, -0.6395820984091527, -0.6343815415987015, -0.6284492289782968, -0.6217859178268323, -0.6144003423341993, -0.606309376913206, -0.5975379208009157, -0.5881185368721488, -0.5780908829926408, -0.5675009766871366, -0.5564003341547357, -0.5448450233179887, -0.5328946680708914, -0.5206114375056762, -0.508059049891015, -0.4953018167530162, -0.4824037477688051, -0.4694277325058759, -0.4564348105015762, -0.4434835369284661, -0.4306294472560609, -0.41792462098632266, -0.40541734175989796, -0.3931518489187069, -0.38116817395225366, -0.36950205411036974, -0.3581849147768168, -0.34724391189926207, -0.3367020257907759, -0.3265781978865633 ], [ -0.5884067885014725, -0.593953912731105, -0.5990724536944205, -0.6037544012773565, -0.6079949042505817, -0.6117915277711471, -0.6151433166895712, -0.6180497194539011, -0.620509450004076, -0.6225193829070291, -0.6240735862661415, -0.6251625944159536, -0.6257730064212439, -0.6258874676732037, -0.6254850538682655, -0.6245420350849381, -0.623032959274312, -0.6209319653115164, -0.6182142196748603, -0.6148573686916763, -0.6108429081951576, -0.6061573906683777, -0.6007934122948715, -0.59475034511295, -0.5880348001027647, -0.5806608241182245, -0.5726498466667553, -0.5640304018267714, -0.554837656588585, -0.5451127802209792, -0.5349021904784355, -0.5242567120550875, -0.5132306810405689, -0.501881026539442, -0.49026635732319523, -0.4784460776058811, -0.466479551966848, -0.4544253352711204, -0.44234047932819753, -0.43027992413209337, -0.41829597796027274, -0.40643788746603926, -0.39475149623410766, -0.38327898810575056, -0.37205870991320333, -0.3611250670648266, -0.35050848464751716, -0.3402354263053987, -0.33032846305305785, -0.3208063843260661 ], [ -0.5616083825363345, -0.5666718323513766, -0.5713565705719785, -0.5756557189095209, -0.5795648087785561, -0.5830811019849478, -0.5862027671532652, -0.5889279615574161, -0.5912538844264698, -0.5931758797858966, -0.5946866718324538, -0.5957758117021528, -0.5964294004667141, -0.5966301301599377, -0.5963576552612333, -0.595589275436908, -0.5943008811351336, -0.5924680910408999, -0.5900674971828345, -0.5870779304588731, -0.5834816654553538, -0.57926549630799, -0.5744216321011679, -0.568948378208536, -0.5628505869526894, -0.5561398756888534, -0.5488346222859088, -0.5409597568986719, -0.532546375125072, -0.5236312014950002, -0.5142559341485812, -0.5044665019043936, -0.49431226401351036, -0.4838451810136908, -0.473118982472405, -0.46218835424558424, -0.4511081643728706, -0.4399327430579174, -0.4287152285069641, -0.41750698686300136, -0.40635711119450413, -0.39531200156612034, -0.38441502569300645, -0.37370625759096676, -0.3632222899849259, -0.3529961150108911, -0.34305706690710613, -0.33343081989350665, -0.3241394342333631, -0.315201443504187 ], [ -0.5362954388466488, -0.5409144211753601, -0.5451994912330891, -0.5491446024785872, -0.5527455004282124, -0.5559991113546502, -0.5589028260957521, -0.5614537229132102, -0.5636477850801795, -0.5654791767174396, -0.5669396425573171, -0.5680180925500365, -0.5687004202129109, -0.5689695852094006, -0.5688059678691633, -0.5681879791561704, -0.5670928872342997, -0.5654978042031493, -0.5633807657734955, -0.5607218333339862, -0.5575041514736756, -0.5537149030653626, -0.5493461165087639, -0.5443952937041212, -0.5388658411326908, -0.5327672989090251, -0.5261153731859545, -0.5189317855886596, -0.5112439594608972, -0.5030845668169238, -0.49449096226781397, -0.4855045311042391, -0.4761699784263551, -0.46653458494886035, -0.4566474530866387, -0.44655876433851394, -0.4363190660150631, -0.4259786021698523, -0.41558670034687806, -0.405191222585479, -0.3948380861417943, -0.3845708566802434, -0.37443041432123203, -0.3644546909371815, -0.3546784754795482, -0.34513328288593803, -0.33584728123441543, -0.3268452712458948, -0.3181487119430698, -0.30977578621011914 ], [ -0.5124501958108122, -0.5166605170906967, -0.5205770154573841, -0.5241942574238396, -0.5275080987850724, -0.5305151417424773, -0.5332121177073078, -0.5355952339730993, -0.5376595307266883, -0.5393982998246554, -0.54080261720549, -0.5418610359921536, -0.5425594772019449, -0.5428813402749858, -0.5428078379025332, -0.5423185409987917, -0.5413921024314409, -0.5400071143840763, -0.538143045418692, -0.5357812000367281, -0.5329056455372647, -0.5295040572898267, -0.5255684428351087, -0.521095716074636, -0.5160881039448126, -0.5105533784269645, -0.5045049158956951, -0.49796159333066714, -0.49094753672110136, -0.4834917411399552, -0.47562758460434273, -0.4673922591559415, -0.4588261427861131, -0.44997213508710576, -0.44087497801766595, -0.4315805811037051, -0.42213536791955486, -0.4125856579690783, -0.4029770952527172, -0.3933541319936499, -0.38375957331166033, -0.37423418616240534, -0.3648163736643849, -0.3555419140549041, -0.34644376196684923, -0.33755190849934036, -0.32889329565105807, -0.3204917800686983, -0.31236814070035346, -0.30454012479703185 ], [ -0.4900445240324831, -0.49387893381882086, -0.4974552824406502, -0.5007685938065639, -0.503814776787331, -0.5065901482448012, -0.5090909051445337, -0.5113125785075229, -0.5132495077073207, -0.5148943766039473, -0.5162378524370294, -0.5172683638460055, -0.517972045913969, -0.5183328683811267, -0.5183329493104197, -0.5179530420478606, -0.5171731699591681, -0.5159733726287256, -0.5143345200421908, -0.5122391482317432, -0.5096722708396452, -0.5066221254540432, -0.5030808204803788, -0.4990448567104244, -0.4945155066783117, -0.4894990435631672, -0.48400681924889544, -0.4780551978407589, -0.47166535630679074, -0.4648629679355768, -0.45767778704437656, -0.450143154948084, -0.4422954477505828, -0.43417348619761265, -0.4258179267885408, -0.4172706517367928, -0.40857417334407464, -0.3997710660540954, -0.39090343700884655, -0.382012443462842, -0.3731378630188916, -0.3643177204150664, -0.35558797257746577, -0.34698225189844345, -0.3385316662268768, -0.3302646528709192, -0.3222068830060193, -0.31438121223243454, -0.306807672610516, -0.2995035012877756 ], [ -0.46904198879287595, -0.47253049842192496, -0.47579276537808834, -0.47882416301842146, -0.481620628455245, -0.4841782471622561, -0.48649280434394526, -0.4885593308840861, -0.4903716756132174, -0.4919221372930669, -0.49320118859192386, -0.4941973201817348, -0.4948970260519876, -0.495284941731728, -0.49534413621999007, -0.4950565471692798, -0.4944035384413715, -0.493366550634186, -0.4919278093525752, -0.4900710532619177, -0.48778224430716266, -0.48505022552895116, -0.4818672970459619, -0.47822968726770454, -0.4741379035324267, -0.4695969535027412, -0.46461643531371044, -0.4592105003244661, -0.453397697185815, -0.44720070972586157, -0.44064600387831787, -0.43376340059427076, -0.42658559248171857, -0.41914762192270416, -0.4114863377502943, -0.4036398463567271, -0.39564697147961303, -0.387546735001323, -0.379377869016049, -0.37117836727724307, -0.36298508202856883, -0.3548333702213604, -0.3467567912904075, -0.33878685703962086, -0.33095283280476206, -0.3232815879221599, -0.3157974926373073, -0.3085223579230576, -0.30147541422364976, -0.2946733248733463 ] ], "zauto": true, "zmax": 1.498886877766027, "zmin": -1.498886877766027 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.452902901073372, 0.45154930204579996, 0.4503473781144297, 0.4492968649794112, 0.44839630617669307, 0.44764313124573046, 0.44703374532549756, 0.4465636264531425, 0.4462274272898359, 0.44601907865826634, 0.44593189306256475, 0.4459586671812711, 0.4460917830856153, 0.44632330855772817, 0.4466450973047455, 0.44704889004797876, 0.44752641740175947, 0.44806950516132676, 0.4486701821334115, 0.4493207900246511, 0.45001409421928046, 0.4507433935988935, 0.4515026269490354, 0.45228647301520813, 0.4530904409556482, 0.45391094781505426, 0.45474537972134704, 0.4555921337812493, 0.4564506381028151, 0.4573213479780675, 0.45820571698491314, 0.4591061425795862, 0.46002588661300553, 0.4609689720807434, 0.4619400582720058, 0.462944297284689, 0.46398717558951896, 0.46507434492690086, 0.4662114472785363, 0.46740393894890603, 0.4686569189013295, 0.46997496640805264, 0.47136199279055746, 0.47282111155149187, 0.47435453055014837, 0.4759634690765387, 0.4776481017713822, 0.47940753036480255, 0.48123978321372185, 0.48314184165649576 ], [ 0.4452006451797238, 0.44375197727650206, 0.44246979913262535, 0.4413537321268896, 0.4404020713414882, 0.4396118789914154, 0.43897909046217176, 0.43849862827115366, 0.4381645198368455, 0.4379700157837749, 0.43790770652444844, 0.43796963592335414, 0.4381474118441279, 0.4384323142042565, 0.4388154017314012, 0.4392876188827579, 0.4398399043401298, 0.44046330214962764, 0.4411490759870099, 0.4418888262709183, 0.4426746090026552, 0.44349905437151926, 0.4443554824113643, 0.4452380123955086, 0.4461416622632006, 0.4470624342106425, 0.44799738266172495, 0.44894466114895315, 0.44990354515990666, 0.450874428705326, 0.45185879320172767, 0.45285914819167516, 0.4538789444057236, 0.4549224606599843, 0.45599466704283304, 0.4571010677364298, 0.4582475276088013, 0.4594400873682546, 0.4606847725650332, 0.461987402030681, 0.4633534014445307, 0.4647876275974524, 0.46629420858311926, 0.46787640459503765, 0.4695364932635972, 0.47127568256327756, 0.4730940532981596, 0.4749905320844702, 0.47696289464715785, 0.47900779818935874 ], [ 0.4371631678846298, 0.43561472773579557, 0.4342487415575527, 0.4330647002793976, 0.43206061873476387, 0.43123314703553656, 0.4305776959999088, 0.43008857076594503, 0.4297591074268117, 0.4295818085868801, 0.4295484750279075, 0.42965033204007635, 0.4298781502619253, 0.43022236195050007, 0.4306731743632028, 0.4312206823111881, 0.4318549819215234, 0.4325662872470158, 0.43334505065281587, 0.43418208698048366, 0.43506870045237706, 0.43599681224427494, 0.436959085725375, 0.4379490456271152, 0.4389611869159078, 0.4399910689432695, 0.4410353905374256, 0.442092042068365, 0.44316013113141367, 0.44423997930892506, 0.44533308843571545, 0.4464420758593585, 0.44757057930059485, 0.4487231330338859, 0.4499050181791342, 0.4511220908820487, 0.45238059302519135, 0.4536869508202987, 0.45504756715469197, 0.45646861387467236, 0.4579558302672841, 0.45951433383735474, 0.46114844906833063, 0.4628615592141674, 0.4646559853195318, 0.4665328956439928, 0.4684922475212641, 0.47053276247433834, 0.47265193419364204, 0.47484606783043415 ], [ 0.42880221298933124, 0.42714900340696915, 0.42569542656897774, 0.42444083021590695, 0.4233829178837473, 0.42251788116210254, 0.42184054783859426, 0.4213445386133612, 0.421022425918261, 0.4208658896948439, 0.42086586660767716, 0.42101269090434223, 0.4212962267865608, 0.42170599355374344, 0.422231285783914, 0.422861291341841, 0.42358521002278077, 0.4243923751825858, 0.42527237985120936, 0.42621520769440213, 0.427211367915931, 0.42825203192187805, 0.42932916842913094, 0.4304356727970408, 0.4315654857672711, 0.4327136965499798, 0.43387662529977883, 0.4350518804595157, 0.43623838717040986, 0.43743638389693934, 0.4386473855313741, 0.4398741124627171, 0.44112038635778267, 0.44239099465293946, 0.4436915269440868, 0.4450281875452901, 0.4464075894234604, 0.44783653547186253, 0.4493217936277897, 0.45086987264326567, 0.4524868053628226, 0.45417794613901996, 0.4559477885254687, 0.4577998086432709, 0.459736338648766, 0.4617584735815403, 0.4638660135973057, 0.4660574422553202, 0.4683299402038633, 0.47067943235857235 ], [ 0.42013259071621734, 0.4183691977147033, 0.4168239003117605, 0.41549589703727524, 0.41438255251665224, 0.41347955372249007, 0.4127810845094968, 0.41228000935823605, 0.4119680582550827, 0.41183600624614053, 0.4118738432180774, 0.41207093163988084, 0.4124161521006523, 0.4128980382753354, 0.41350490426470154, 0.4142249679741022, 0.41504647427774927, 0.4159578211960113, 0.41694769129196885, 0.41800518911826695, 0.41911998399111344, 0.42028245581437074, 0.4214838402854785, 0.42271636871648777, 0.4239733969853897, 0.42524951783790343, 0.42654065088877624, 0.42784410519080884, 0.42915861009099326, 0.43048431120351616, 0.4318227296206815, 0.43317668387798475, 0.4345501756176078, 0.43594824129220033, 0.43737677356291493, 0.4388423172246238, 0.4403518454954069, 0.4419125233004183, 0.44353146473064126, 0.4452154921391688, 0.4469709043333763, 0.4488032610223797, 0.4507171900897313, 0.4527162234002354, 0.4548026657516128, 0.45697750029645295, 0.4592403323506184, 0.4615893720434761, 0.4640214548296822, 0.4665320975464125 ], [ 0.4111721228444755, 0.4092925483695913, 0.40765089105972974, 0.40624620565281916, 0.40507549763286677, 0.40413390660663245, 0.4034149111730328, 0.4029105440984433, 0.40261160775208105, 0.4025078816840763, 0.402588316697934, 0.40284121248255755, 0.4032543785169702, 0.4038152802561568, 0.40451117431697525, 0.4053292373568776, 0.4062566935170825, 0.407280944723604, 0.4083897069264457, 0.40957115369517566, 0.41081406669900494, 0.41210799070755233, 0.4134433890584273, 0.41481179421022357, 0.41620594713978765, 0.41761991899803785, 0.4190492086033741, 0.4204908099775906, 0.421943245138795, 0.4234065586658622, 0.42488227204206663, 0.4263732973785737, 0.4278838117279024, 0.4294190947513975, 0.4309853339426643, 0.4325894028803759, 0.43423861904618954, 0.43594048856058937, 0.43770244573084316, 0.439531595546977, 0.44143446718794355, 0.443416786205958, 0.4454832723508488, 0.44763746900252305, 0.44988160893956525, 0.45221651974300214, 0.45464157058759824, 0.4571546605889407, 0.45975224733659686, 0.4624294128317878 ], [ 0.4019415208751744, 0.39993896236537024, 0.3981955812663227, 0.39671031188207856, 0.39547979329115973, 0.3944985827589253, 0.39375939500874835, 0.39325335365833525, 0.3929702423694269, 0.3928987455164109, 0.39302667115882217, 0.3933411524415122, 0.3938288268561995, 0.3944759957123019, 0.3952687683805037, 0.39619319718484014, 0.39723540914288274, 0.3983817401269355, 0.39961887559093645, 0.40093400001050833, 0.40231495489598784, 0.40375040294568393, 0.4052299938642142, 0.4067445257769112, 0.4082860951520079, 0.4098482277489585, 0.41142598332826874, 0.4130160276178373, 0.4146166662311652, 0.4162278367553828, 0.41785105695132274, 0.41948932882204404, 0.4211470001125606, 0.4228295865211591, 0.4245435594658337, 0.42629610560552383, 0.4280948654225511, 0.42994765899519277, 0.43186220759980115, 0.4338458599594874, 0.43590533178923535, 0.4380464667752248, 0.44027402628337203, 0.442591513949882, 0.4450010399138473, 0.44750322787444874, 0.4500971664724863, 0.45278040479567744, 0.4555489901790842, 0.458397545000376 ], [ 0.39246420666738996, 0.39033077475711486, 0.38847930392347474, 0.38690865804365976, 0.3856151231629424, 0.38459265326264874, 0.38383314787819783, 0.3833267449430594, 0.3830621134966476, 0.3830267334611645, 0.3832071532249001, 0.3835892198293341, 0.3841582806616641, 0.3848993592346641, 0.3857973104954276, 0.3868369628664558, 0.3880032547604708, 0.38928137265797635, 0.3906568961733867, 0.3921159531513559, 0.39364538508124153, 0.39523292035393276, 0.39686735043123783, 0.3985387020977815, 0.40023839776915804, 0.4019593953920976, 0.4036962997628315, 0.4054454380154292, 0.4072048934598579, 0.4089744937305089, 0.410755751192139, 0.4125517556081165, 0.4143670210926347, 0.4162072912536811, 0.41807930811684024, 0.4199905518479028, 0.42194895942384225, 0.42396263120549316, 0.4260395348174606, 0.4281872158256873, 0.4304125244146144, 0.43272136661044047, 0.4351184875964371, 0.43760729336009263, 0.44018971535783397, 0.4428661211557833, 0.4456352721920796, 0.4484943280024666, 0.4514388945507113, 0.4544631127956823 ], [ 0.382766096177938, 0.3804924630153804, 0.3785251856087119, 0.3768631454529013, 0.37550231983469345, 0.37443606114373085, 0.37365541627664417, 0.3731494661485404, 0.37290566646282136, 0.372910173697902, 0.37314814436981103, 0.3736040005026804, 0.37426165928786437, 0.3751047295387751, 0.3761166812303261, 0.3772809967712614, 0.3785813135077079, 0.3800015663184993, 0.3815261372512424, 0.383140016323682, 0.38482897432037755, 0.38657974510295856, 0.3883802120225941, 0.3902195907756168, 0.3920885996549153, 0.39397960767571766, 0.39588675144485147, 0.3978060127712681, 0.3997352507115808, 0.4016741838211532, 0.40362432065951687, 0.4055888389208066, 0.40757241579648307, 0.4095810142289594, 0.41162163150713005, 0.41370201813514296, 0.41583037603638956, 0.41801504590915595, 0.4202641939112781, 0.42258550780987647, 0.424985912290816, 0.42747131229623514, 0.430046372078549, 0.4327143361752391, 0.43547689678801466, 0.43833411017632573, 0.44128436274406757, 0.44432438561003196, 0.4474493147048712, 0.4506527919169932 ], [ 0.3728753808474133, 0.37045035403372384, 0.3683577750202846, 0.3665966835426358, 0.3651628367327884, 0.36404902126025135, 0.36324541688110434, 0.36273998764845805, 0.36251887780481157, 0.36256679227730393, 0.3628673463316738, 0.3634033747054861, 0.36415719670228935, 0.36511083952033746, 0.3662462268212756, 0.36754534269682443, 0.3689903824894818, 0.3705639013643797, 0.3722489693669616, 0.3740293383845871, 0.37588962251675867, 0.3778154894181109, 0.3797938567079105, 0.38181308490538285, 0.3838631567593091, 0.38593583234483825, 0.38802476982320155, 0.3901256031327831, 0.3922359698857162, 0.39435548515292423, 0.3964856594172431, 0.39862976157509666, 0.400792630326325, 0.4029804395008799, 0.4052004247541584, 0.40746058056891443, 0.4097693375985274, 0.4121352310547367, 0.41456657107393446, 0.4170711257908959, 0.4196558272200331, 0.4223265090183759, 0.4250876838245257, 0.4279423661946275, 0.4308919452682154, 0.4339361092863923, 0.43707282205421466, 0.44029834949258184, 0.44360733266053815, 0.446992902131013 ], [ 0.3628223571259632, 0.36023237862672036, 0.35800271508157305, 0.3561327757887812, 0.35461824784135354, 0.3534514374206634, 0.3526216779339175, 0.3521157771834465, 0.3519184757673559, 0.35201289163707916, 0.3523809307952703, 0.35300365082369545, 0.3538615713880904, 0.35493493309164803, 0.35620391211988384, 0.3576488023214909, 0.359250178299695, 0.3609890527046518, 0.362847038518691, 0.3648065232723338, 0.36685085752117, 0.3689645552659454, 0.37113349992631095, 0.37334514642534805, 0.3755887081459394, 0.37785531702486597, 0.38013814574217647, 0.38243248262240476, 0.38473575221869966, 0.3870474773220277, 0.3893691810712639, 0.3917042307252116, 0.39405762733241656, 0.39643574788355435, 0.39884604847761, 0.4012967385304374, 0.40379643707742785, 0.4063538227613038, 0.4089772891537868, 0.41167461664965727, 0.41445267131958546, 0.41731713985451196, 0.42027230813617966, 0.42332088909949545, 0.4264639035021199, 0.42970061508625307, 0.43302851951406135, 0.4364433844868923, 0.4399393367149722, 0.4435089899669 ], [ 0.3526393711259331, 0.3498679470983774, 0.34748653735568463, 0.3454952247935293, 0.34388985962773155, 0.3426624217581867, 0.34180147083126405, 0.34129265201761605, 0.34111922418962715, 0.3412625792907753, 0.34170272693886194, 0.3424187259508025, 0.3433890534244482, 0.3445919109911405, 0.3460054756259139, 0.3476081079819341, 0.3493785340205245, 0.35129601563667157, 0.35334052338581184, 0.3554929199987139, 0.35773515800702543, 0.3600504893823969, 0.36242368037264194, 0.3648412212281652, 0.3672915185200197, 0.3697650572849732, 0.3722545211317772, 0.37475486042566475, 0.3772633014011231, 0.3797792922039639, 0.38230438513839765, 0.384842057555494, 0.3873974766896428, 0.3899772162085782, 0.3925889342151464, 0.3952410238847723, 0.3979422488256678, 0.40070137561129854, 0.4035268157725215, 0.40642628887908017, 0.40940651722917265, 0.4124729611589044, 0.415629602153484, 0.41887877887712177, 0.4222210790392448, 0.42565528778927303, 0.42917839119035434, 0.43278563136730824, 0.43647060824473877, 0.44022542145629984 ], [ 0.3423609598678539, 0.3393880365867283, 0.33683667693037106, 0.3347080601298957, 0.33299854216066427, 0.3317000247729054, 0.3308004400303915, 0.3302843144608254, 0.3301333733760934, 0.33032714671430496, 0.33084354278547595, 0.3316593647977645, 0.3327507556695073, 0.33409356773878046, 0.3356636639012174, 0.33743716407558294, 0.339390654889585, 0.3415013809120322, 0.3437474330522617, 0.3461079447726313, 0.34856330061185453, 0.35109535529376595, 0.3536876563129867, 0.35632565896779955, 0.3589969206471127, 0.3616912607749996, 0.3644008739546597, 0.3671203861835621, 0.3698468471326838, 0.37257965500848916, 0.37532041411337363, 0.37807272862699415, 0.3808419391589192, 0.38363481114860587, 0.3864591861401012, 0.3893236083029994, 0.39223693930308484, 0.3952079747613603, 0.3982450751109847, 0.40135582271511844, 0.4045467157067002, 0.4078229072305326, 0.4111879966997737, 0.4146438774260348, 0.41819064265595884, 0.4218265497607973, 0.42554804018798986, 0.4293498108920461, 0.43322493139449164, 0.43716499943397796 ], [ 0.3320242792800955, 0.32882559254080374, 0.32608182022011195, 0.3237958089936214, 0.3219649044419684, 0.320581303520674, 0.3196325589958722, 0.31910219691810543, 0.3189704012073807, 0.31921471785073957, 0.3198107353444914, 0.32073270711758656, 0.321954094131786, 0.32344801950069224, 0.3251876395545164, 0.32714644543353594, 0.32929851487181466, 0.33161873504257533, 0.3340830146798206, 0.33666849824267486, 0.33935378800078714, 0.3421191729246987, 0.34494685725340646, 0.34782117729907164, 0.35072879275260693, 0.353658838442229, 0.35660302388764015, 0.35955567066235106, 0.36251368105991505, 0.3654764354190773, 0.36844561933101405, 0.37142498554797854, 0.3744200585402274, 0.37743779218254264, 0.3804861929253398, 0.3835739219930974, 0.38670989066081685, 0.3899028625178904, 0.393161075888191, 0.39649189830353665, 0.39990152320906924, 0.4033947170125329, 0.40697462228556275, 0.41064262050229844, 0.4143982552791295, 0.4182392147749298, 0.4221613698276903, 0.42615886262727387, 0.4302242393180686, 0.43434861892661425 ], [ 0.3216699070712657, 0.3182163477985359, 0.31525270221670876, 0.3127842363411652, 0.3108099475884918, 0.30932286543641585, 0.3083105507890645, 0.3077557540058008, 0.3076371793895661, 0.30793029845546754, 0.3086081564539493, 0.3096421258368283, 0.3110025746722794, 0.31265943459413587, 0.3145826686868866, 0.3167426522321169, 0.3191104869106703, 0.3216582714377033, 0.32435934929770516, 0.3271885485501438, 0.3301224212232969, 0.3331394821887094, 0.3362204408794847, 0.33934841459177306, 0.3425091097236167, 0.34569095709095715, 0.34888518907214405, 0.35208584928031356, 0.3552897292252773, 0.3584962305256341, 0.3617071552760363, 0.3649264308706307, 0.3681597787303361, 0.3714143388542587, 0.3746982638495817, 0.37802029707065354, 0.3813893497329645, 0.38481409140629613, 0.3883025672030624, 0.3918618533539122, 0.39549776081233123, 0.3992145941765246, 0.40301497069178677, 0.40689970153298144, 0.4108677350918869, 0.4149161597222428, 0.41904026142100126, 0.42323363031797195, 0.4274883086509666, 0.43179497213534695 ], [ 0.3113430900376735, 0.3076001474221519, 0.3043834578039216, 0.30170167244809304, 0.29955632344332017, 0.2979420213175465, 0.2968469094894018, 0.2962533379955445, 0.2961386993624621, 0.2964763579312504, 0.29723660244167327, 0.2983875600409521, 0.29989602578355085, 0.30172818143645463, 0.3038501969829438, 0.3062287242615932, 0.3088313025990279, 0.31162670047387653, 0.3145852158457348, 0.3176789523222109, 0.3208820807177287, 0.32417108760721036, 0.32752500563885995, 0.33092561554610983, 0.3343576073463633, 0.3378086880423272, 0.34126962486099627, 0.34473421614101263, 0.3481991858537998, 0.35166400191845076, 0.35513062254198563, 0.3586031784869884, 0.36208760223352243, 0.3655912173345826, 0.369122302798054, 0.3726896480454385, 0.37630211392120455, 0.37996821441439893, 0.3836957322955414, 0.38749137988271337, 0.3913605137678705, 0.3953069097071132, 0.39933260115972136, 0.40343778229681587, 0.4076207738228622, 0.411878047770227, 0.4162043056190976, 0.42059260271197685, 0.42503451099306955, 0.4295203115996769 ], [ 0.3010954644575276, 0.2970228297966844, 0.29351359817755013, 0.29058101655514956, 0.2882303009752565, 0.2864586592599291, 0.28525563974294954, 0.28460377723165975, 0.2844794776530485, 0.2848540622088998, 0.285694884114091, 0.2869664366795567, 0.28863138802595334, 0.2906515004113463, 0.292988415830351, 0.2956043098178923, 0.2984624295146214, 0.3015275390842104, 0.3047662961240836, 0.3081475784219217, 0.31164277337432433, 0.3152260346364072, 0.3188745037276601, 0.32256848940026855, 0.32629159499897675, 0.33003078373589434, 0.3337763733802902, 0.33752195478383845, 0.34126423236887776, 0.3450027887056845, 0.3487397791958839, 0.35247956636444616, 0.3562283061320901, 0.359993500555861, 0.36378353281034054, 0.36760720061004454, 0.3714732638672345, 0.37539002120622583, 0.37936492812355804, 0.3834042672352888, 0.38751287835405274, 0.3916939532660822, 0.39594889720617465, 0.4002772563147629, 0.4046767079376189, 0.40914310859338054, 0.41367059284824814, 0.41825171522567933, 0.4228776266339561, 0.42753827658173416 ], [ 0.29098721032741165, 0.2865386497729701, 0.28269062388095506, 0.27946245205861675, 0.2768644961615317, 0.27489791073594966, 0.27355479629760543, 0.2728187458935724, 0.27266573243809006, 0.27306525072082827, 0.2739816099983233, 0.27537527269960455, 0.27720414951613137, 0.27942478551381106, 0.28199339950826324, 0.28486676425875357, 0.28800293438870195, 0.29136184073613536, 0.294905774280568, 0.2985997813551799, 0.3024119866567448, 0.30631385380596315, 0.3102803867167485, 0.3142902700272535, 0.3183259439056151, 0.32237360771380785, 0.3264231479866336, 0.33046798848321407, 0.33450486318628286, 0.3385335165980977, 0.3425563391283312, 0.3465779484880634, 0.3506047305668457, 0.3546443551116855, 0.358705282541275, 0.3627962783679409, 0.3669259509755895, 0.3711023269860774, 0.3753324762647971, 0.37962219593800717, 0.3839757598162547, 0.38839573654511433, 0.39288287683105344, 0.39743606738397214, 0.40205234690747227, 0.4067269776365453, 0.41145356460796306, 0.4162242140477111, 0.42102972193548027, 0.4258597838977477 ], [ 0.281089503611357, 0.2762131357519083, 0.2719731988015923, 0.2683968310179586, 0.2655013540454638, 0.26329362339994755, 0.26176985780206213, 0.2609159729601979, 0.2607083875683913, 0.2611152181381852, 0.26209774498621535, 0.26361201896180486, 0.2656104861115277, 0.2680435300189815, 0.270860861904372, 0.27401271997736437, 0.27745086684429027, 0.28112939386189384, 0.285005353149747, 0.2890392422197885, 0.29319536473614993, 0.297442086148274, 0.30175199705697753, 0.30610199182057923, 0.31047326602823827, 0.31485123438491, 0.319225370166822, 0.32358896839096957, 0.3279388367898771, 0.33227492118985047, 0.33659987459108787, 0.34091858182126933, 0.34523765380782495, 0.3495649070662475, 0.353908844770972, 0.35827815567084004, 0.3626812461217827, 0.3671258187042919, 0.37161850841441496, 0.37616458446164075, 0.38076772250421576, 0.38542984893640836, 0.3901510558274363, 0.3949295824726265, 0.3997618573758787, 0.4046425929036188, 0.40956492384548254, 0.41452058065221, 0.4195000881301585, 0.4244929807682751 ], [ 0.27148700862584224, 0.2661261514957174, 0.2614346963332615, 0.25744958611708596, 0.2541972886151419, 0.25169258908557224, 0.249937917902316, 0.2489232982743072, 0.24862692745980178, 0.24901633185787805, 0.2500499767900737, 0.2516791752452303, 0.25385012932102, 0.25650595093378553, 0.2595885383676246, 0.2630402244626691, 0.26680515265500626, 0.2708303719903234, 0.27506666748765535, 0.27946915665747457, 0.2839976879268416, 0.28861707497608124, 0.2932971956029031, 0.29801297722339826, 0.30274428515904755, 0.3074757253009239, 0.3121963698569136, 0.3168994135951608, 0.32158176803795413, 0.3262436020945762, 0.330887839275451, 0.3355196235225603, 0.34014576745752295, 0.34477419816611865, 0.34941341625351124, 0.354071983659832, 0.3587580545718982, 0.36347896176452094, 0.3682408680112623, 0.37304848904694593, 0.3779048912066156, 0.38281136357253753, 0.38776736146607627, 0.3927705156043964, 0.3978166993156914, 0.402900144915225, 0.4080135996710398, 0.41314851166853384, 0.4182952362221017, 0.4234432541702338 ], [ 0.26228001530447936, 0.2563747918928539, 0.25116679415085635, 0.24670491012548476, 0.2430272913399944, 0.2401594060205273, 0.2381126301693427, 0.23688355425372581, 0.23645410668470968, 0.23679249923284088, 0.23785490242999577, 0.23958767853728122, 0.24192994937217405, 0.24481626320942051, 0.24817914807100092, 0.25195138903156045, 0.2560679304688096, 0.2604673656924615, 0.26509302520388406, 0.26989370618486874, 0.274824100431212, 0.2798449798642932, 0.2849231928897454, 0.29003151545561373, 0.2951483906346535, 0.300257581637078, 0.30534775617482895, 0.31041201529653134, 0.3154473770952103, 0.32045422474441776, 0.3254357286947459, 0.33039725404234216, 0.33534576553263223, 0.34028924390101856, 0.34523612789031743, 0.35019479606947035, 0.3551731014098155, 0.36017796950287906, 0.3652150685020333, 0.3702885556007104, 0.37540090142450555, 0.3805527904102965, 0.3857430923259936, 0.39096889773327886, 0.39622560851506133, 0.40150707360180987, 0.40680575969181326, 0.4121129469762938, 0.41741894053009393, 0.42271328898265653 ], [ 0.25358569202210174, 0.24707559159651957, 0.2412826423627743, 0.23626980563926955, 0.23208970912656549, 0.22878177791454193, 0.2263697996958435, 0.2248602332802298, 0.22424151363147227, 0.22448449666791487, 0.225544038553477, 0.22736154638212988, 0.22986820681811782, 0.23298852854609178, 0.23664383758585658, 0.24075543209939732, 0.24524720760946112, 0.2500476722371793, 0.25509136026734386, 0.26031971018057537, 0.26568150111768074, 0.2711329468602865, 0.2766375375482098, 0.2821657037910738, 0.28769436056392683, 0.2932063722796, 0.2986899672453422, 0.30413811994467793, 0.30954791323749725, 0.3149198892413279, 0.3202573966891941, 0.32556594316985404, 0.33085256204290014, 0.33612520526296735, 0.34139217427623986, 0.3466616011992439, 0.3519409914976528, 0.3572368373918411, 0.3625543084250476, 0.3678970223418567, 0.3732668959849736, 0.3786640726594385, 0.38408691960961505, 0.3895320870935497, 0.39499461911358846, 0.4004681051732, 0.4059448624072032, 0.4114161379563823, 0.4168723223841852, 0.4223031661166993 ], [ 0.24553782230967183, 0.23836538327866608, 0.23191896355697098, 0.22627743945670425, 0.22151074413115696, 0.21767594050212924, 0.21481344389863435, 0.21294386665992335, 0.21206597631232899, 0.2121561686812104, 0.21316964971543176, 0.21504323429379318, 0.2176993886040059, 0.2210509543678096, 0.2250059507069994, 0.22947194473208835, 0.234359659141353, 0.23958567577823173, 0.24507424821577975, 0.25075833384344515, 0.2565800001394482, 0.26249036552508226, 0.2684492183162023, 0.2744244301871456, 0.2803912513013348, 0.2863315474794546, 0.2922330178105314, 0.2980884148252781, 0.30389477864297804, 0.30965269064718365, 0.315365550153074, 0.3210388779665541, 0.32667965250154374, 0.3322956861823267, 0.3378950514279645, 0.3434855661008085, 0.3490743476936321, 0.35466744377437204, 0.36026954354008056, 0.36588377210660383, 0.37151156577406386, 0.37715262333196103, 0.38280492579855374, 0.3884648150206188, 0.394127120374943, 0.39978532239536846, 0.4054317424056203, 0.41105774802667533, 0.4166539655860349, 0.4222104918261678 ], [ 0.23828436268021855, 0.23040003375933613, 0.2232362650555045, 0.21688901132660046, 0.21144799039253576, 0.2069916893986687, 0.2035819721174008, 0.20125891842010077, 0.20003671756794528, 0.19990144949888697, 0.2008113423683945, 0.2026996187912095, 0.20547949309472327, 0.20905046581281414, 0.21330492074701551, 0.21813416649275538, 0.22343336732952607, 0.2291051380052368, 0.23506183603884298, 0.24122674012020634, 0.24753436593642802, 0.25393017099799353, 0.2603698663794171, 0.26681850621021125, 0.2732494776806915, 0.2796434719345374, 0.2859874825305837, 0.2922738539316537, 0.29849938707104523, 0.30466450098185455, 0.31077244688594724, 0.3168285721089556, 0.3228396339787144, 0.32881316706851643, 0.3347569097524037, 0.34067829744322026, 0.3465840298532639, 0.35247971822571883, 0.3583696160259441, 0.3642564334738994, 0.37014123299690194, 0.3760233995998461, 0.38190067760951385, 0.3877692634512464, 0.39362394313682314, 0.3994582629502746, 0.4052647223018052, 0.41103497871935996, 0.4167600562864735, 0.4224305503457897 ], [ 0.23198225134281802, 0.22335025723628096, 0.21541617504658614, 0.20829304786750213, 0.20209193140235188, 0.19691605776136736, 0.19285373138251108, 0.18997065803330704, 0.18830290485320855, 0.18785196760522552, 0.18858323340947977, 0.1904284165984325, 0.19329155639118317, 0.1970573269658633, 0.2016000599059224, 0.2067920624136259, 0.21251032388910354, 0.21864126333821846, 0.22508359654138033, 0.23174964087987418, 0.2385654581183062, 0.24547021907740546, 0.2524151093878851, 0.259362015662963, 0.2662821550469696, 0.2731547471073681, 0.27996577859522176, 0.28670687852695675, 0.2933743013077234, 0.29996800632205833, 0.3064908204601117, 0.31294767256476314, 0.3193448933969975, 0.3256895796300727, 0.331989024395303, 0.3382502193514033, 0.34447943392659947, 0.35068187642767357, 0.3568614394969797, 0.3630205294239413, 0.3691599755995441, 0.3752790134000543, 0.3813753313459962, 0.38744517171340986, 0.3934834729490052, 0.3994840422161948, 0.40543974704907787, 0.4113427162434003, 0.41718454158072565, 0.42295647359002086 ], [ 0.22678917795939496, 0.21739384076772741, 0.2086548393116205, 0.20070071118730062, 0.19366377150453615, 0.18767398274317432, 0.18285040445373563, 0.17929076816132894, 0.17706065646912214, 0.17618456143609987, 0.1766412125408941, 0.1783646792188559, 0.18125113343896773, 0.18516958000192213, 0.1899740672642703, 0.1955150794023312, 0.2016486331374814, 0.20824253567734793, 0.21517995761451125, 0.2223608417383637, 0.22970177243866277, 0.23713487896633412, 0.24460622724923756, 0.25207402322287675, 0.2595068330337698, 0.26688193287096745, 0.27418383538148267, 0.28140299781578026, 0.2885346944104741, 0.29557802676730677, 0.3025350462678869, 0.3094099678541097, 0.3162084617607489, 0.3229370169004833, 0.3296023752767761, 0.33621104040570005, 0.34276886414527874, 0.34928071580847286, 0.35575023545122453, 0.3621796703631737, 0.36856979062827083, 0.3749198766671787, 0.38122776929248064, 0.3874899712180677, 0.3937017882358878, 0.39985749835521794, 0.40595053795600294, 0.41197369525632144, 0.41791930294113494, 0.4237794234665915 ], [ 0.22285255190224762, 0.2127040518060679, 0.20315153292497032, 0.19433559492040337, 0.18640746030401076, 0.17952342294610354, 0.1738356414130867, 0.1694793029451815, 0.16655756796486507, 0.1651272868002116, 0.1651893463324484, 0.16668677453175773, 0.16951140714577753, 0.1735171610955445, 0.17853625066436724, 0.1843946821424205, 0.190924598080901, 0.19797257101467142, 0.20540409359304582, 0.21310509069089167, 0.2209814112765139, 0.228957142299385, 0.23697237875237073, 0.2449808723121256, 0.25294780514543563, 0.2608478066848722, 0.2686632465644903, 0.27638278799461236, 0.28400016294904556, 0.2915131248310456, 0.2989225386861453, 0.30623157830233994, 0.31344501009496556, 0.3205685532641816, 0.3276083131058027, 0.3345702890673685, 0.3414599612151361, 0.34828195860814404, 0.3550398112569408, 0.36173578454561334, 0.36837079185658306, 0.374944378194434, 0.3814547652446766, 0.38789894674805364, 0.39427282238905503, 0.4005713585323636, 0.4067887649507819, 0.41291867798530524, 0.4189543421648061, 0.4248887840085128 ], [ 0.22029668229442026, 0.20943486078946577, 0.1990924489016856, 0.18941702991829468, 0.18057385543847418, 0.17274189553869954, 0.16610528541347336, 0.1608392915829813, 0.15709151206086372, 0.15496145764562727, 0.1544838292771844, 0.15562101061932523, 0.15826764047751637, 0.16226578638915184, 0.16742579623982773, 0.17354714876209965, 0.18043525344124153, 0.18791258891707913, 0.19582448520522794, 0.20404081028661486, 0.21245500716758567, 0.22098170454768004, 0.22955377194046092, 0.23811935813895563, 0.24663919646853988, 0.2550842878854994, 0.26343396985682926, 0.2716743262349149, 0.2797968737666128, 0.28779746098729597, 0.2956753255019479, 0.3034322697658395, 0.31107192960555763, 0.3185991217357393, 0.32601926544846477, 0.33333787925856034, 0.34056015584290383, 0.3476906186729239, 0.35473286201351656, 0.3616893731884849, 0.3685614328739874, 0.37534908623490865, 0.3820511753600672, 0.3886654219046417, 0.39518854817869536, 0.4016164250702038, 0.4079442360149476, 0.41416664753483035, 0.4202779784622819, 0.42627236167016486 ], [ 0.21921006243365082, 0.207704869776904, 0.19663121163809172, 0.1861376462122681, 0.17639650398350432, 0.16760237051145277, 0.1599657032020262, 0.1536996436399336, 0.14899936389753585, 0.14601614449955536, 0.14483209661577637, 0.14544371612842918, 0.14776073691138683, 0.151621009104535, 0.1568158565069598, 0.1631175818537981, 0.17030236662414452, 0.1781655110726105, 0.18652918831352788, 0.195244545220579, 0.2041902957232299, 0.21326956592664473, 0.2224061757458493, 0.23154103477840246, 0.24062896884265447, 0.24963607042300143, 0.25853754628909686, 0.26731598310415783, 0.27595993915099415, 0.2844627784374438, 0.29282168052631585, 0.301036778555583, 0.3091103953658133, 0.31704636169650513, 0.3248494104825759, 0.33252464748869653, 0.3400771013633352, 0.3475113563857108, 0.3548312695116271, 0.36203977058283876, 0.36913874144961645, 0.37612896682982355, 0.3830101473848328, 0.3897809639547043, 0.3964391812277673, 0.40298177926457346, 0.40940510211046605, 0.41570501402818083, 0.42187705546603493, 0.4279165925692674 ], [ 0.21963528259456686, 0.2075830885987698, 0.19586970129646514, 0.18463879520954848, 0.1740619703043434, 0.16433995764848364, 0.155699561307189, 0.14838360509677778, 0.14263156493860527, 0.13865091057092122, 0.13658380396636646, 0.13647889932141338, 0.13827937494260964, 0.14183289096158339, 0.14691948039851693, 0.1532864303154716, 0.16067926619636075, 0.1688629752386213, 0.17763294113213113, 0.18681804407200484, 0.19627902301441316, 0.20590460596929694, 0.21560701867458912, 0.22531772902974467, 0.2349837841710982, 0.24456481337226804, 0.25403063328186865, 0.2633593421925614, 0.27253578592491023, 0.28155029459609393, 0.2903976131782853, 0.2990759722357521, 0.30758626530786476, 0.3159313148999323, 0.32411521985587044, 0.3321427834584882, 0.34001902464019673, 0.3477487750089816, 0.3553363628442351, 0.36278538259144, 0.37009854537941644, 0.37727760325141924, 0.38432333752835757, 0.3912356002269278, 0.3980133968042863, 0.4046549986406258, 0.4111580744660464, 0.4175198312093904, 0.4237371563048107, 0.4298067551624516 ], [ 0.22156402070618542, 0.2090801747621489, 0.1968441785219656, 0.18499016470783736, 0.17368191613529077, 0.16311642804600163, 0.15352447390750296, 0.14516527309412242, 0.1383117242493821, 0.13322355297743158, 0.13010967765759074, 0.12908822145089052, 0.13015888086034424, 0.13320082841815442, 0.13799789089653566, 0.14427954288014413, 0.15176167886030573, 0.16017636435403373, 0.16928798403676043, 0.1788985562543281, 0.1888464668409503, 0.1990021418447893, 0.2092628711143501, 0.2195479084147215, 0.22979428559207826, 0.23995341331151834, 0.24998837948927946, 0.25987180569272933, 0.2695841237859356, 0.27911215830036196, 0.2884479285392985, 0.2975876110476596, 0.30653062497996264, 0.3152788193939795, 0.3238357528677046, 0.33220606277092696, 0.34039492485935025, 0.3484076044753979, 0.35624909938808236, 0.36392387196832565, 0.37143566565129393, 0.3787873980189275, 0.3859811207204751, 0.39301803505350713, 0.399898551425468, 0.4066223810639916, 0.4131886491205481, 0.4195960195504509, 0.4258428236742714, 0.431927185965014 ], [ 0.2249385270308448, 0.21214777509639596, 0.19952112230328095, 0.1871803199979752, 0.1752762624555892, 0.16399409332521542, 0.1535567857806321, 0.14422475255830844, 0.13628768501873492, 0.13004401740445076, 0.1257651728265498, 0.12364839159670861, 0.1237723195154061, 0.12607544198647302, 0.1303694627600254, 0.13638108024045006, 0.1438023529372451, 0.1523316898672592, 0.16169826926302558, 0.1716717765210726, 0.18206277132206977, 0.19271850134610552, 0.20351725640343488, 0.21436284099270544, 0.2251797885123316, 0.23590944615283851, 0.24650684649899118, 0.2569382148948524, 0.2671789611352368, 0.2772120289152966, 0.2870265073101414, 0.2966164371037354, 0.305979768097839, 0.31511744105718875, 0.32403258012809544, 0.33272978920691576, 0.3412145497318251, 0.34949271861973, 0.35757012441303726, 0.3654522579012639, 0.3731440511943668, 0.3806497369689337, 0.38797277775717004, 0.39511585392420556, 0.4020808984679323, 0.40886916695302433, 0.41548133165443846, 0.4219175901878069, 0.42817778038178744, 0.4342614947455198 ], [ 0.22965929482878206, 0.2166862820533453, 0.20380427701271536, 0.19112166630582533, 0.17877392093140426, 0.1669293622665078, 0.1557946466700957, 0.14561829910063886, 0.13668909290076442, 0.12932417773850463, 0.12384112881802471, 0.12051179017685937, 0.11950646494221012, 0.12085002417992184, 0.12441316564540833, 0.12994444901977756, 0.13712560567382043, 0.1456249934988144, 0.1551339755828608, 0.16538450057935986, 0.17615331544792617, 0.18725904360055706, 0.19855649379304294, 0.2099305576891863, 0.2212907108040855, 0.2325664140302808, 0.24370339064127822, 0.25466063888421353, 0.26540802126457425, 0.27592429079089476, 0.2861954447346362, 0.2962133262676129, 0.3059744193729615, 0.31547880165080716, 0.3247292333645883, 0.3337303700902526, 0.34248809155533316, 0.3510089415943129, 0.35929967444496713, 0.3673669016242271, 0.37521683199909445, 0.38285509592740957, 0.39028664286329945, 0.3975157008399707, 0.40454578586578055, 0.41137974949902817, 0.4180198536257312, 0.42446786262866965, 0.4307251445616906, 0.4367927744900745 ], [ 0.23559694275308904, 0.2225587263996175, 0.20955052965163973, 0.19666785833881406, 0.18403050622300907, 0.17178831257651622, 0.16012746326442912, 0.1492764069300155, 0.13950914525498326, 0.1311415121762422, 0.12451377033153421, 0.11995307479607312, 0.11771648608795907, 0.117930292589104, 0.1205539250616224, 0.12538951395581546, 0.1321314921632106, 0.14042938059462154, 0.1499386896769276, 0.1603504737342414, 0.171402635361827, 0.1828801142930992, 0.19460994345317306, 0.2064547682902367, 0.21830655928305814, 0.2300811626229197, 0.24171380720482902, 0.25315547173972436, 0.2643699536289114, 0.27533148447732286, 0.28602276354276424, 0.29643331116306904, 0.3065580717423477, 0.3163962178534206, 0.32595012326640094, 0.3352244839190644, 0.3442255729285284, 0.3529606196493038, 0.36143730438793265, 0.3696633604692431, 0.37764627457817196, 0.38539307520923893, 0.3929101980409106, 0.4002034163754576, 0.40727782458276585, 0.41413786279042586, 0.4207873718257392, 0.42722966854134997, 0.4334676330242191, 0.4395038006741537 ], [ 0.2426054804895888, 0.22960700336360074, 0.21658962017908204, 0.20363737131901186, 0.19085571758883252, 0.1783769269832848, 0.16636643428580306, 0.15502977125900885, 0.14461869949033782, 0.13543332477911307, 0.12781429335605796, 0.12211713438577709, 0.11866337404108969, 0.11767476594312476, 0.11921478197476156, 0.12316840878537966, 0.1292725523598782, 0.1371787394684758, 0.14651683419186412, 0.1569394847446194, 0.16814417161646933, 0.17987909739153776, 0.19194036251451913, 0.20416566160847802, 0.21642733661849764, 0.22862602537985932, 0.24068529226129698, 0.25254724259447087, 0.26416898186448634, 0.27551975244328636, 0.28657859741852865, 0.29733243125177733, 0.3077744272181245, 0.3179026569982389, 0.3277189373192224, 0.33722785257214555, 0.34643593177253335, 0.35535096407055794, 0.3639814401985873, 0.37233610859427235, 0.38042363515945943, 0.38825235527492064, 0.39583010621544124, 0.40316412779158767, 0.4102610190529641, 0.41712673928875116, 0.4237666423413604, 0.4301855343411793, 0.43638774627886767, 0.44237721425197 ], [ 0.2505343418493579, 0.23766675632694334, 0.2247425509637085, 0.21183617340635183, 0.19904096363362492, 0.18647405286082858, 0.1742823894890992, 0.16264978682412964, 0.15180421912486922, 0.1420231751377766, 0.13363249175485697, 0.12699129974359952, 0.12245512847224763, 0.1203158010112888, 0.12073298467137762, 0.12368824330343295, 0.12898801255368586, 0.13631345281089272, 0.14528894943723286, 0.1555401280881907, 0.16672889650500317, 0.17856779012859725, 0.1908212592343084, 0.20330067736108934, 0.2158572842060127, 0.22837515597108787, 0.24076502573344866, 0.2529591437353576, 0.2649071016016515, 0.27657246040130634, 0.2879300177978168, 0.2989635738683321, 0.30966408591036376, 0.32002813067431146, 0.33005661511359613, 0.3397536936811436, 0.3491258621362119, 0.3581812057428658, 0.3669287846197378, 0.3753781417162294, 0.38353892018571956, 0.3914205774025065, 0.3990321829859872, 0.4063822882783018, 0.41347885497413406, 0.4203292311242411, 0.4269401635479186, 0.43331783675774493, 0.43946792975273863, 0.44539568338943175 ], [ 0.25923752463692756, 0.24657857624823065, 0.23383537240108, 0.2210747610452603, 0.2083804674868647, 0.19585752531395775, 0.18363782961671812, 0.17188683525252446, 0.16081095115616317, 0.15066412927164688, 0.1417502379938691, 0.13441516933146594, 0.12902075989269277, 0.12589536778977914, 0.12526760099976264, 0.12720701080975455, 0.1316022766528837, 0.13818958661485437, 0.14661430892344474, 0.1564955314938286, 0.16747261736953573, 0.17922947849460116, 0.19150205433280743, 0.20407629775422786, 0.21678208718087866, 0.22948614319512547, 0.2420853736502116, 0.2545011481491154, 0.26667456523028155, 0.27856260284840106, 0.29013499675673, 0.30137169867250807, 0.3122607912804518, 0.3227967647255786, 0.3329790833507326, 0.34281099041752666, 0.3522985125499121, 0.3614496354240271, 0.3702736287092661, 0.3787805023121555, 0.38698057834198885, 0.3948841645260224, 0.40250131553629154, 0.40984166920249004, 0.4169143451102883, 0.42372789375478165, 0.43029028528691704, 0.4366089279502774, 0.44269070751261397, 0.44854204028774086 ], [ 0.2685793057986812, 0.25619480142259093, 0.24370734553150195, 0.23117808463749678, 0.2186835479237969, 0.20631967534194992, 0.19420687905884648, 0.1824961848969939, 0.17137613874388075, 0.16107935875218213, 0.15188613451371283, 0.14412031157563124, 0.13813073811095217, 0.13425243835920084, 0.1327491984352392, 0.13375343550000893, 0.13722999643005912, 0.14298336543266382, 0.15070382415403114, 0.16002857472721146, 0.17059403754606484, 0.18206870765120128, 0.19416783905269955, 0.20665602613118722, 0.21934348874558168, 0.23207992570506178, 0.24474801413538408, 0.2572574736890307, 0.26953999072999874, 0.2815450081011519, 0.2932362751673994, 0.3045890268492426, 0.3155876698045813, 0.326223874886423, 0.33649499697785634, 0.34640276225853767, 0.3559521778244771, 0.36515062954495286, 0.37400714173042526, 0.3825317773416441, 0.39073516079083603, 0.3986281074708422, 0.406221345480625, 0.41352531596060255, 0.42055003926337214, 0.42730503502289385, 0.433799285127912, 0.4400412296738531, 0.44603878714207557, 0.4517993912932816 ], [ 0.2784368694332744, 0.2663824243014769, 0.2542142041172853, 0.24198932434785933, 0.2297792196147802, 0.2176733246278374, 0.20578365331185028, 0.1942502896630979, 0.18324749870723597, 0.1729895231054341, 0.16373398864695318, 0.15577919853432082, 0.14945004405768617, 0.14506755941869753, 0.14290198727780495, 0.14311940810620477, 0.14574193203007044, 0.15064045982827987, 0.15756348844028678, 0.16618720870200487, 0.17616605494834076, 0.18716999192719103, 0.1989054003851881, 0.2111229330362213, 0.22361734459236504, 0.23622336101135497, 0.24881014318958053, 0.26127569031001086, 0.2735417719922864, 0.28554957264240866, 0.29725604091728663, 0.308630862854402, 0.3196539593075134, 0.3303134147133053, 0.3406037589019755, 0.3505245393426975, 0.3600791349365689, 0.36927377336906886, 0.37811672217137354, 0.3866176294415415, 0.3947869941713299, 0.4026357488229987, 0.4101749386426659, 0.4174154835322882, 0.42436800938795016, 0.4310427368193542, 0.4374494161932081, 0.4435972990336113, 0.44949513696693255, 0.4551512005927054 ], [ 0.2887006399863403, 0.27702320693569477, 0.26522802425906794, 0.25336953879704327, 0.2415157529091943, 0.22975158321538247, 0.2181829547053268, 0.2069415851978273, 0.19619014200855203, 0.1861269253400059, 0.17698835918748315, 0.16904639214568598, 0.1625968735739202, 0.1579352411805708, 0.1553191307266691, 0.15492441890179726, 0.15680863576645948, 0.1608969285013498, 0.1669969129022555, 0.17483521847652825, 0.18410065927684618, 0.19448091965103526, 0.2056868780436936, 0.21746498738575606, 0.22960101415912196, 0.24191867089146352, 0.25427578689709895, 0.2665596469570891, 0.27868236285231934, 0.2905766663144696, 0.30219225065204414, 0.3134926607483317, 0.32445267800957195, 0.3350561315539894, 0.3452940689519258, 0.3551632284457181, 0.3646647645965756, 0.37380318845086796, 0.3825854907971586, 0.39102042281535515, 0.39911791262797314, 0.40688859928470217, 0.4143434678844734, 0.42149357116001246, 0.428349824151893, 0.4349228597492257, 0.4412229339782112, 0.44725987103299336, 0.45304303918225103, 0.4585813498405456 ], [ 0.29927321029953496, 0.28801218805993906, 0.27663526089305185, 0.26519522188751393, 0.25375782057709, 0.242404795357203, 0.23123746369472362, 0.22038076275760754, 0.20998738668342648, 0.20024123660910295, 0.19135874938988431, 0.18358587765709605, 0.17718790603211618, 0.1724296657435888, 0.16954603730279175, 0.16870719117553107, 0.16998799993939948, 0.17335256472569188, 0.1786600415936147, 0.18568911518785328, 0.19417159583429042, 0.20382474343145646, 0.21437581631134614, 0.22557715486993266, 0.23721323094703464, 0.2491021658258518, 0.26109402626649847, 0.27306756479566435, 0.2849264361518155, 0.29659545353999406, 0.3080171514573695, 0.31914875267120363, 0.32995954955640155, 0.34042867020887124, 0.35054318554080377, 0.3602965119691141, 0.36968706816464214, 0.37871714991817834, 0.3873919927230558, 0.39571899644681413, 0.4037070902818827, 0.41136621910207716, 0.41870693458656805, 0.42574007620610227, 0.4324765285771801, 0.4389270429194117, 0.4451021114967141, 0.45101188504164846, 0.4566661242783612, 0.46207417777411375 ], [ 0.31006763144954314, 0.29925555472121934, 0.28833417572980874, 0.27735529815487203, 0.26638313300804994, 0.25549698450567787, 0.24479431455954345, 0.23439402670842518, 0.2244395942922212, 0.21510131792267104, 0.20657653513140195, 0.19908611199836493, 0.19286528724431756, 0.18814739170888894, 0.18514065684533768, 0.18400130223532613, 0.18480924828176165, 0.18755394527215494, 0.1921352560701598, 0.19837891959137638, 0.20606108751941077, 0.2149346193103127, 0.22475141876788252, 0.23527817778493684, 0.24630551908602144, 0.25765191676513927, 0.26916409919758993, 0.2807153951300308, 0.2922030667491168, 0.3035452893008781, 0.31467815254121917, 0.3255528736799347, 0.3361333007328462, 0.3463937242688203, 0.3563169850547399, 0.36589285199154187, 0.3751166408705586, 0.38398804509954926, 0.3925101520118237, 0.4006886213116272, 0.40853100498884265, 0.41604619042328783, 0.42324395036845885, 0.4301345851249057, 0.43672864358244584, 0.4430367110212402, 0.44906925268685455, 0.45483650324104435, 0.4603483932613572, 0.4656145050231237 ], [ 0.3210056163700239, 0.31066853890723245, 0.30023243734768806, 0.28974846927863174, 0.2792796195572907, 0.26890301849118514, 0.2587124711260728, 0.24882100487267583, 0.23936306215007136, 0.23049570903698166, 0.2223979220956684, 0.2152667412904541, 0.20930902726384054, 0.20472802208699495, 0.20170513886214256, 0.2003793307097564, 0.20082832338115225, 0.20305672342423403, 0.20699459563378947, 0.21250687386684475, 0.2194105923482593, 0.22749515577426285, 0.23654123463250076, 0.24633558637217418, 0.2566809803221431, 0.2674017006849714, 0.2783456785178982, 0.28938436405911716, 0.3004112582310841, 0.31133976347064857, 0.3221007828549052, 0.3326403229723743, 0.3429172387323923, 0.35290118489858513, 0.3625707961286012, 0.3719120938237453, 0.3809171064222995, 0.3895826848486865, 0.39790949352193167, 0.4059011577846337, 0.4135635498101777, 0.4209041964517229, 0.42793179387272123, 0.4346558150649523, 0.4410861975146736, 0.44723309934949723, 0.453106713322007, 0.4587171289868191, 0.4640742344192346, 0.4691876498071987 ], [ 0.3320159879263138, 0.3221737012097546, 0.31224527802463753, 0.302281306237076, 0.29234354560567294, 0.28250686766104427, 0.27286126182711273, 0.26351370137361946, 0.25458952007571445, 0.24623276902495825, 0.23860483252281248, 0.23188045566415705, 0.22624040205724252, 0.22186037887207094, 0.21889674418725322, 0.21747074725074053, 0.2176542139564443, 0.21946000753547176, 0.222839766799255, 0.2276894982477271, 0.23386142765107007, 0.24117911279729598, 0.24945266233711327, 0.2584917422419427, 0.26811524861157016, 0.27815754403717596, 0.2884717647130273, 0.29893093353436584, 0.3094275954086552, 0.31987255804678005, 0.3301931630102931, 0.3403313716934321, 0.3502418436317273, 0.3598901094061585, 0.36925089113130416, 0.37830659290024066, 0.3870459655125807, 0.3954629397912872, 0.4035556176652016, 0.4113254079137534, 0.4187762927668237, 0.42591421167230886, 0.4327465490639423, 0.4392817136619274, 0.4455287976154165, 0.4514973046073194, 0.45719693687564295, 0.4626374319582571, 0.46782844083642783, 0.47277944002931127 ], [ 0.34303351917718683, 0.33369973262213254, 0.32429430555084937, 0.314867133260458, 0.3054785398482354, 0.29620084529614155, 0.2871198833178309, 0.27833626731572136, 0.26996609549818384, 0.2621406660023524, 0.2550046678051362, 0.24871227863582984, 0.2434207178400992, 0.23928115388699434, 0.23642748449199252, 0.23496429536026217, 0.2349559929942815, 0.23641932838774282, 0.2393210203208054, 0.24358102412860433, 0.24908061884020682, 0.255673469701225, 0.2631975083977439, 0.2714858203228877, 0.280375429545183, 0.2897135889780327, 0.2993617080403056, 0.3091973315277953, 0.31911466825853063, 0.3290241334642488, 0.3388512814432249, 0.34853540745873574, 0.35802801169428605, 0.3672912505980863, 0.3762964520405371, 0.38502273719168384, 0.3934557700675653, 0.40158664187281984, 0.409410888906959, 0.4169276379701399, 0.4241388705795303, 0.4310487960255021, 0.43766332281527115, 0.443989618042928, 0.4500357444986909, 0.45581036577961326, 0.46132251022897947, 0.4665813851769387, 0.47159623365661546, 0.47637622650823286 ], [ 0.3539981845790633, 0.3451807546845539, 0.33630689696457333, 0.3274255622818948, 0.3185953104281042, 0.3098855262124674, 0.30137750224843063, 0.29316520216302794, 0.28535544362256804, 0.2780671674122823, 0.27142941121988184, 0.265577623363576, 0.26064808026044567, 0.25677045112036956, 0.25405898244470465, 0.25260327505456603, 0.252460032196896, 0.2536472645982306, 0.2561421125352359, 0.2598827295433333, 0.26477380466837896, 0.27069459671755186, 0.2775080388386349, 0.2850695743508242, 0.2932347676200151, 0.3018652020588618, 0.3108325789383352, 0.3200211961249697, 0.3293291148724009, 0.33866835065509127, 0.34796439276158797, 0.3571553006322681, 0.3661905640973717, 0.3750298606488152, 0.38364179961310324, 0.39200271069941683, 0.4000955112944406, 0.4079086710098446, 0.41543528143082714, 0.4226722321872618, 0.4296194901824482, 0.43627947621790064, 0.44265653176398323, 0.4487564678598486, 0.45458618783364196, 0.46015337555765784, 0.4654662411932825, 0.4705333167721391, 0.47536329445815556, 0.479964900906671 ], [ 0.36485476408511197, 0.35655601795889313, 0.3482160230026888, 0.33988246850618736, 0.3316117807364516, 0.32347002274947395, 0.3155336063613886, 0.30788965378706973, 0.3006357980469119, 0.2938791718501433, 0.28773432281469064, 0.2823198337311886, 0.27775354639997446, 0.2741465015024269, 0.27159600122062805, 0.27017851771243806, 0.2699434078531196, 0.27090843959676, 0.273057919110567, 0.27634375813716444, 0.2806892682796298, 0.28599499110234905, 0.29214560997712713, 0.2990169834000765, 0.30648253425902655, 0.31441851949857885, 0.3227079898799195, 0.3312434686778974, 0.3399285121990001, 0.3486783739072382, 0.35741999999133417, 0.36609156006789395, 0.3746416798067999, 0.38302850362765306, 0.39121868102777546, 0.39918634179268686, 0.40691210350251467, 0.41438213860475104, 0.4215873167708455, 0.42852243019930725, 0.4351855040383113, 0.44157719044291754, 0.4477002424097286, 0.45355906205438296, 0.4591593171424704, 0.4645076192659112, 0.4696112569475368, 0.47447797706885403, 0.4791158082875486, 0.4835329204957753 ], [ 0.3755527072295439, 0.3677698709483412, 0.3599603370969942, 0.35217020276807504, 0.3444534081082203, 0.3368723625831108, 0.3294983539943085, 0.3224116044485544, 0.31570080869126754, 0.3094619734539242, 0.30379638478653254, 0.298807579115913, 0.29459729614560537, 0.2912605508944877, 0.28888016216513646, 0.287521274481656, 0.28722654833768246, 0.28801270629558884, 0.2898689751899557, 0.29275767584130286, 0.2966168550846384, 0.3013645321743624, 0.306903928669187, 0.31312900414430644, 0.3199297103123969, 0.3271965483506174, 0.3348242068877646, 0.34271422516955424, 0.35077674479545473, 0.3589314815352177, 0.36710807531125406, 0.3752459747410502, 0.38329399501184064, 0.3912096635673513, 0.39895844303158196, 0.40651289815818725, 0.41385185468621843, 0.42095958299847136, 0.4278250280437507, 0.43444109850446594, 0.44080402204497177, 0.4469127691099909, 0.4527685447029886, 0.45837434551016476, 0.46373457838398907, 0.4688547353690353, 0.47374112000329893, 0.47840061945956264, 0.48284051712961773, 0.48706834044344627 ], [ 0.38604615858181385, 0.3787718768777608, 0.3714843834710155, 0.3642278768622979, 0.35705351213033276, 0.3500197995036204, 0.34319277591271197, 0.33664584005276116, 0.33045912662569343, 0.3247182927525727, 0.3195126076874135, 0.31493228468901735, 0.31106507686674, 0.307992274959997, 0.30578438009832865, 0.30449685054581976, 0.30416640071559187, 0.30480832794287316, 0.30641524011134186, 0.30895736779914107, 0.3123844111025899, 0.3166286527833977, 0.3216089185378673, 0.3272349093427984, 0.33341146598918864, 0.3400424244679632, 0.3470338464423401, 0.3542965299611386, 0.36174780205386126, 0.369312659614369, 0.37692435986929335, 0.3845245733228479, 0.3920632081352341, 0.3994980022644161, 0.4067939634503685, 0.4139227205167317, 0.4208618343210011, 0.4275941037977683, 0.4341068920780658, 0.44039148946025836, 0.44644252373451787, 0.4522574236689994, 0.4578359380206825, 0.4631797099556139, 0.4682919050245263, 0.47317688966300875, 0.4778399564346632, 0.48228709180754475, 0.48652478206986927, 0.4905598529893427 ], [ 0.3962940575499889, 0.38951697822586867, 0.38273881467454113, 0.3760016087448061, 0.3693535048650588, 0.3628489659139007, 0.35654876642828764, 0.35051967761877867, 0.34483375308213793, 0.3395671294050866, 0.3347982774256377, 0.3306056823472107, 0.3270649958321596, 0.3242457867821979, 0.3222081083888271, 0.32099917839040215, 0.3206505144490467, 0.3211758572022923, 0.3225701412055807, 0.3248096473162527, 0.3278533147412654, 0.3316450420173029, 0.3361166960796071, 0.3411914965938305, 0.34678745049107607, 0.35282056583739324, 0.35920765385681624, 0.365868612411345, 0.37272815830534317, 0.379717031449121, 0.3867727295116823, 0.39383984965125424, 0.4008701185483722, 0.4078221878311958, 0.4146612629485031, 0.42135862247090533, 0.42789107355356343, 0.4342403789427337, 0.44039268195296166, 0.44633794841732455, 0.45206943864848176, 0.4575832177727606, 0.4628777092097435, 0.4679532933668349, 0.4728119516253696, 0.477456954263273, 0.48189258996806833, 0.4861239339462721, 0.4901566512538667, 0.4939968317961797 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8576300200074911, 0.3430464207514382, 0.3069293367529619, 0.23123711043432674, 0.1731832736889785, 0.10276676402166102, 0.02272360489126676, 0.12822914338105254, 0.18264122633125843, 0.11021739438818898, 0.23200152971928015, 0.3945768438279629, 0.21771886090087916, 0.24268461401296557, 0.18007999032786176, 0.2323591563636618, 0.6178188910707831, 0.922042103484273, 0.17101835366338491, 0.8570100227370858, 0.534548249474776, 0.4907798030673444, 0.45258776486883523, 0.36587979703010326 ], "xaxis": "x", "y": [ 0.304885390214622, 0.6994141614918489, 0.71433956849282, 0.6450489400789448, 0.593244386847273, 0.5245964292924129, 0.45478208555364374, 0.50113973879535, 0.48679646734164944, 0.5219753765590699, 0.45670970601271255, 0.9470284963026643, 0.44325772469776215, 0.4888982273631153, 0.4020272304249925, 0.4199047081311001, 0.6060437019914389, 0.2518757041543722, 0.3430425301194191, 0.6166029404848814, 0.6454295322236044, 0.6693129221747312, 0.6689585957918127, 0.6905993536267468 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8576300200074911, 0.3430464207514382, 0.3069293367529619, 0.23123711043432674, 0.1731832736889785, 0.10276676402166102, 0.02272360489126676, 0.12822914338105254, 0.18264122633125843, 0.11021739438818898, 0.23200152971928015, 0.3945768438279629, 0.21771886090087916, 0.24268461401296557, 0.18007999032786176, 0.2323591563636618, 0.6178188910707831, 0.922042103484273, 0.17101835366338491, 0.8570100227370858, 0.534548249474776, 0.4907798030673444, 0.45258776486883523, 0.36587979703010326 ], "xaxis": "x2", "y": [ 0.304885390214622, 0.6994141614918489, 0.71433956849282, 0.6450489400789448, 0.593244386847273, 0.5245964292924129, 0.45478208555364374, 0.50113973879535, 0.48679646734164944, 0.5219753765590699, 0.45670970601271255, 0.9470284963026643, 0.44325772469776215, 0.4888982273631153, 0.4020272304249925, 0.4199047081311001, 0.6060437019914389, 0.2518757041543722, 0.3430425301194191, 0.6166029404848814, 0.6454295322236044, 0.6693129221747312, 0.6689585957918127, 0.6905993536267468 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:49] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9481951614693637, 0.9476010721190719, 0.9474185065226791, 0.9476557743589855, 0.9483197804636823, 0.9494160028042964, 0.9509484957454577, 0.9529199163915714, 0.9553315694843227, 0.95818346418514, 0.9614743744425909, 0.9652018938697559, 0.9693624763842237, 0.9739514553809343, 0.9789630368036675, 0.9843902648448513, 0.9902249626770823, 0.9964576540796602, 1.003077474582327, 1.0100720824448188, 1.017427580250643, 1.0251284571441182, 1.0331575599856464, 1.0414960992630913, 1.0501236928454523, 1.0590184479459688, 1.0681570792524004, 1.0775150592629652, 1.0870667955190063, 1.0967858286468448, 1.1066450448477365, 1.116616896608235, 1.1266736258338477, 1.1367874842326091, 1.1469309465035238, 1.1570769126495923, 1.1671988964876143, 1.1772711981358719, 1.1872690589081079, 1.197168797619278, 1.2069479278129303, 1.216585255852952, 1.2260609601872154, 1.2353566523914448, 1.2444554208435212, 1.2533418580662057, 1.2620020729153643, 1.2704236888862956, 1.2785958298681008, 1.2865090947003983 ], [ 0.9423006143065218, 0.9416232755817948, 0.941364609987239, 0.9415334512439979, 0.9421372082121102, 0.943181845161359, 0.944671890306942, 0.9466104701377678, 0.9489993642368135, 0.9518390726106352, 0.9551288854683481, 0.9588669443714458, 0.9630502840554114, 0.9676748461343418, 0.9727354592043556, 0.9782257841539372, 0.984138228159485, 0.9904638351945578, 0.997192164268337, 1.0043111685692725, 1.0118070890214, 1.0196643745389036, 1.0278656387983671, 1.036391660093409, 1.0452214272922133, 1.0543322315352095, 1.0636998004263087, 1.0732984692859295, 1.0831013826120661, 1.0930807181941522, 1.103207926229973, 1.1134539761622728, 1.123789604629321, 1.134185558780417, 1.144612830138151, 1.1550428751190622, 1.165447819204661, 1.1758006425585172, 1.1860753456000146, 1.1962470936690468, 1.206292340451205, 1.216188930285346, 1.2259161798511826, 1.235454940040219, 1.244787639055053, 1.2538983079661679, 1.262772590087352, 1.2713977356171342, 1.279762583039666, 1.2878575287901626 ], [ 0.9370936864700861, 0.936335704110838, 0.9360025204138167, 0.9361034802501103, 0.9366464928514273, 0.9376380152413744, 0.9390830670161119, 0.9409852737360389, 0.9433469327751931, 0.9461690921720943, 0.9494516304197625, 0.9531933238164827, 0.9573918884329482, 0.9620439861288173, 0.9671451882101689, 0.9726898957346024, 0.9786712213412797, 0.9850808428919894, 0.99190884331601, 0.9991435532677969, 1.0067714133033345, 1.0147768704059463, 1.023142320299538, 1.0318481027094868, 1.0408725522340987, 1.0501921033470312, 1.059781444666942, 1.0696137152123486, 1.0796607339359874, 1.0898932533001442, 1.1002812278312697, 1.1107940892713182, 1.1214010209284127, 1.1320712249589957, 1.1427741774681122, 1.1534798674161786, 1.1641590163259306, 1.1747832766731134, 1.1853254076163706, 1.1957594273809748, 1.206060742167408, 1.216206251919107, 1.226174433663695, 1.2359454034469504, 1.2455009581159509, 1.2548245983843564, 1.2639015347348095, 1.2727186777874706, 1.2812646147961648, 1.2895295739305452 ], [ 0.9326319136732322, 0.9317973275571595, 0.9313925586530594, 0.9314274428085749, 0.9319103804381363, 0.9328483241626814, 0.934246800871572, 0.9361099651823356, 0.9384406772173061, 0.9412405936195798, 0.9445102575218467, 0.9482491715197654, 0.9524558381943431, 0.9571277556483408, 0.9622613606834131, 0.9678519189841055, 0.9738933689589768, 0.9803781325293697, 0.9872969110699503, 0.9946384871516978, 1.0023895524637845, 1.010534579545746, 1.0190557503927662, 1.0279329494672962, 1.0371438230327668, 1.0466639017392076, 1.0564667795050355, 1.066524339152342, 1.0768070139315717, 1.0872840738241718, 1.0979239260681175, 1.108694420429354, 1.1195631510940227, 1.1304977484917318, 1.1414661557501435, 1.1524368857517575, 1.1633792558823446, 1.1742635985213914, 1.1850614461379136, 1.1957456905359827, 1.2062907163600862, 1.216672509435896, 1.2268687408992929, 1.2368588283654112, 1.246623975618135, 1.2561471924658802, 1.2654132965187153, 1.2744088987011788, 1.283122374331827, 1.2915438215807302 ], [ 0.9289696974851841, 0.9280640968691674, 0.9275921600215302, 0.9275641862837148, 0.9279890524253234, 0.9288742057301788, 0.9302256944085512, 0.9320482319809289, 0.9343452875488114, 0.9371191891297862, 0.9403712233705945, 0.9441017129095735, 0.9483100532190919, 0.9529946942923706, 0.9581530588430889, 0.9637813969412796, 0.9698745859129775, 0.976425892371281, 0.983426719046848, 0.9908663617217114, 0.9987318007638843, 1.007007547896506, 1.015675562812831, 1.0247152472203567, 1.0341035169930406, 1.0438149472167497, 1.053821980557916, 1.0640951867321629, 1.0746035597685997, 1.0853148399445478, 1.0961958483212935, 1.1072128233751608, 1.1183317509881725, 1.1295186808243864, 1.140740023741923, 1.1519628263150854, 1.1631550197514962, 1.1742856414990095, 1.18532502867182, 1.1962449831120332, 1.2070189084663714, 1.2176219201165814, 1.2280309291706326, 1.2382247020102841, 1.248183897107151, 1.2578910809710762, 1.267330725188318, 1.2764891865496122, 1.285354672266883, 1.2939171922394141 ], [ 0.9261572318501404, 0.9251878499880288, 0.9246547657285668, 0.9245687076557925, 0.9249390087104705, 0.9257736061136845, 0.9270790811661058, 0.9288607351611321, 0.9311226922473494, 0.9338680145871114, 0.9370988106243086, 0.9408163148406001, 0.9450209180159537, 0.9497121312100458, 0.9548884742353062, 0.9605472893215448, 0.9666844913759529, 0.9732942758369942, 0.980368811881424, 0.9878979515222208, 0.9958689836209867, 1.0042664565856774, 1.013072085746842, 1.0222647526204518, 1.0318205949153167, 1.0417131793046694, 1.0519137442303699, 1.062391497434963, 1.0731139522492692, 1.0840472874299052, 1.095156717020782, 1.1064068588404479, 1.1177620924205636, 1.129186899311534, 1.140646180510354, 1.1521055473150217, 1.1635315831817765, 1.174892075192754, 1.1861562145761377, 1.1972947663977584, 1.208280209093344, 1.2190868449560186, 1.2296908830488915, 1.2400704962875502, 1.2502058546392734, 1.2600791365215813, 1.2696745205588296, 1.2789781598794592, 1.2879781411155582, 1.296664430208794 ], [ 0.9242394393221343, 0.9232152207709996, 0.9226287103628098, 0.9224910261323875, 0.9228119324029, 0.923599847988585, 0.9248618962670696, 0.9266039928411203, 0.9288309604748286, 0.9315466547923197, 0.9347540790564776, 0.9384554635396136, 0.9426522857244121, 0.9473452124622072, 0.9525339540723066, 0.9582170320657686, 0.9643914748146173, 0.9710524667706948, 0.9781929846372461, 0.9858034567823916, 0.993871479790461, 1.002381619123864, 1.011315311015573, 1.0206508719026601, 1.0303636117697554, 1.0404260399899619, 1.0508081472289528, 1.0614777446801384, 1.0724008418518292, 1.0835420456551648, 1.0948649659622018, 1.1063326155542401, 1.1179077950675749, 1.1295534559415517, 1.1412330363898113, 1.1529107670476135, 1.1645519442432328, 1.1761231698641674, 1.1875925576018929, 1.1989299060121759, 1.2101068393572392, 1.2210969176238324, 1.231875717451122, 1.2424208859622368, 1.252712169679593, 1.2627314208223477, 1.2724625833413246, 1.2818916610501463, 1.2910066701692613, 1.2997975785210585 ], [ 0.9232549659960365, 0.9221866001201061, 0.921556153901705, 0.9213750914010606, 0.9216535801402832, 0.9224005088960261, 0.9236235485999258, 0.9253292514132242, 0.9275231764613869, 0.9302100239094625, 0.9333937533401411, 0.937077659272721, 0.9412643774839378, 0.9459558013392404, 0.9511528974698844, 0.9568554236074913, 0.9630615660269563, 0.969767527135293, 0.9769671026815094, 0.9846512910615938, 0.9928079737751676, 1.0014216972122798, 1.0104735736822565, 1.0199413064848433, 1.0297993321664223, 1.040019064433643, 1.0505692190941343, 1.0614161976212735, 1.072524507747378, 1.08385720194986, 1.095376317950031, 1.1070433087416143, 1.1188194527927873, 1.1306662377201686, 1.1425457128685423, 1.154420807892148, 1.1662556157100563, 1.1780156391935421, 1.189668001717353, 1.2011816223278873, 1.2125273567863621, 1.223678106154927, 1.2346088949186058, 1.2452969208814015, 1.2557215792448244, 1.2658644633769234, 1.2757093448161516, 1.285242135035712, 1.2944508314295196, 1.3033254498804527 ], [ 0.9232352837305482, 0.9221351983052766, 0.9214721065506065, 0.9212577738797347, 0.9215027409400686, 0.9222163519273924, 0.9234068263099425, 0.9250813682397, 0.9272463009348396, 0.9299072060619951, 0.9330690420231089, 0.9367362116926157, 0.9409125510609955, 0.9456012163492338, 0.9508044584128963, 0.9565232883953178, 0.9627570552178774, 0.9695029704878637, 0.9767556266327286, 0.9845065572614946, 0.992743884214512, 1.0014520846446615, 1.0106118964249824, 1.0202003644760058, 1.030191017144375, 1.0405541523335042, 1.0512572081751812, 1.0622651920852073, 1.0735411439525417, 1.0850466127482012, 1.0967421299760918, 1.108587667406607, 1.120543070034619, 1.1325684580369757, 1.144624593686897, 1.1566732108176274, 1.1686773056469515, 1.180601388699571, 1.192411698289829, 1.2040763766145, 1.2155656099891112, 1.2268517351570998, 1.2379093139144093, 1.2487151785246866, 1.2592484505541797, 1.269490535835662, 1.2794250982847393, 1.2890380152493774, 1.2983173169852014, 1.3072531127258658 ], [ 0.9242039403672756, 0.9230862495004353, 0.9224035867047236, 0.9221679752830351, 0.9223902985104969, 0.9230803387491946, 0.9242468591980537, 0.9258977216614687, 0.9280400264895511, 0.9306802533449322, 0.9338243751101587, 0.937477913759217, 0.9416459079826263, 0.946332768846437, 0.9515420118764666, 0.9572758705130273, 0.9635348143917796, 0.9703170129001482, 0.9776177962093097, 0.9854291695545256, 0.9937394308418966, 1.0025329280093527, 1.0117899743350636, 1.02148692130612, 1.0315963733742892, 1.0420875189727212, 1.0529265478103838, 1.064077124680883, 1.0755008932467158, 1.087157987954829, 1.0990075372299966, 1.1110081456457475, 1.123118346541112, 1.1352970194647791, 1.1475037689797654, 1.159699262916961, 1.1718455292985057, 1.1839062120062676, 1.1958467859485027, 1.2076347330384332, 1.219239680769709, 1.230633505563301, 1.2417904033671716, 1.2526869302120887, 1.2633020155648447, 1.2736169513794644, 1.2836153597367161, 1.2932831418940485, 1.3026084114546734, 1.3115814142179065 ], [ 0.9261759842554997, 0.9250563849506824, 0.9243689378416124, 0.9241258838365265, 0.9243384188987827, 0.925016743358338, 0.9261701519253408, 0.9278071568525735, 0.9299356294317684, 0.9325629375097206, 0.9356960503695317, 0.9393415788171429, 0.9435057192810963, 0.9481940773558692, 0.9534113587911367, 0.9591609334959272, 0.9654442982960966, 0.972260483252833, 0.9796054599359829, 0.9874716143114477, 0.9958473400940744, 1.0047167919379132, 1.0140598159856375, 1.023852053592892, 1.034065197037214, 1.0446673659267751, 1.0556235696663763, 1.0668962230493235, 1.0784456867227667, 1.0902308101027505, 1.102209460043434, 1.1143390235061272, 1.126576876375048, 1.1388808134552644, 1.151209436739603, 1.1635225004692273, 1.1757812125456781, 1.18794849263932, 1.1999891879821822, 1.2118702483828343, 1.2235608624738306, 1.2350325575956453, 1.2462592660271414, 1.25721736048578, 1.2678856619419285, 1.2782454228276015, 1.2882802886828792, 1.297976241187361, 1.3073215253841952, 1.31630656373414 ], [ 0.9291575721552473, 0.9280531840349614, 0.9273773137073159, 0.9271423835060296, 0.9273598727660023, 0.9280403757298135, 0.9291936970621344, 0.9308289765181735, 0.9329548272390091, 0.9355794648980758, 0.9387107988100223, 0.9423564527182369, 0.9465236838893863, 0.9512191756118629, 0.9564486907463081, 0.9622165920200499, 0.9685252562194782, 0.9753744305692796, 0.9827605953436285, 0.9906764021171603, 0.9991102492684752, 1.0080460367843729, 1.0174631165759374, 1.0273364295783884, 1.0376368024760285, 1.0483313671766472, 1.0593840642565184, 1.0707561950197482, 1.0824069929332911, 1.0942941920013711, 1.1063745759044008, 1.1186044968715343, 1.1309403571507453, 1.1433390487147017, 1.155758348744775, 1.16815726974175, 1.180496364052597, 1.1927379833424372, 1.204846494172736, 1.216788451407687, 1.2285327316620382, 1.2400506294115017, 1.2513159186967624, 1.2623048835567696, 1.2729963204287722, 1.2833715157619896, 1.2934142020247483, 1.3031104951591654, 1.3124488163704846, 1.321419800944963 ], [ 0.933145754622356, 0.9320748983556126, 0.9314283287015692, 0.9312186168483871, 0.9314574956919762, 0.9321559237862179, 0.9333241827349995, 0.9349719987880302, 0.9371086727255641, 0.9397431953526613, 0.942884320252264, 0.9465405622913048, 0.9507200911999077, 0.9554304956058645, 0.9606784049569593, 0.9664689746734894, 0.9728052620970723, 0.9796875437896669, 0.9871126428485286, 0.9950733417409429, 1.0035579475991736, 1.0125500541972856, 1.0220285149009287, 1.0319676128994966, 1.0423373956899908, 1.0531041319997099, 1.0642308492011372, 1.0756779144040514, 1.0874036297490712, 1.0993648199173958, 1.1115173964114926, 1.1238168883240547, 1.1362189330878323, 1.1486797233028703, 1.1611564074793763, 1.173607443720405, 1.1859929062440806, 1.1982747453700966, 1.2104170022472742, 1.2223859801962065, 1.2341503750672596, 1.245681367445128, 1.25695267984662, 1.2679406022522173, 1.2786239893902374, 1.2889842331709322, 1.299005213567591, 1.3086732310844356, 1.3179769237567678, 1.3269071714137624 ], [ 0.9381284245114653, 0.937110337224031, 0.9365118661503629, 0.9363457004058559, 0.9366237938739657, 0.9373574319116559, 0.9385573264431486, 0.9402337296014119, 0.9423965499682727, 0.9450554493708914, 0.9482198931393135, 0.9518991239410071, 0.9561020300708974, 0.960836884587346, 0.9661109428741423, 0.9719299034140262, 0.9782972588757254, 0.9852135889041689, 0.9926758662381906, 1.000676856209969, 1.00920468066013, 1.0182425918128408, 1.027768968132745, 1.037757513823132, 1.048177624025021, 1.0589948702987213, 1.0701715625818513, 1.0816673503513654, 1.093439833878909, 1.1054451642991445, 1.1176386177858864, 1.129975134170452, 1.1424098139266838, 1.154898369865718, 1.16739753147954, 1.1798654009724339, 1.1922617608715314, 1.2045483338584302, 1.216688996170051, 1.2286499465738294, 1.240399833497155, 1.2519098433488764, 1.2631537533902126, 1.2741079526905312, 1.2847514347525248, 1.295065765334396, 1.305035028860404, 1.3146457566215215, 1.323886839747286, 1.332749429695181 ], [ 0.9440844135325075, 0.9431389043084925, 0.9426080412090774, 0.9425045988924157, 0.9428407138330803, 0.9436279500858039, 0.9448773877623189, 0.9465997240020871, 0.9488053707951256, 0.9515045287147263, 0.9547072113022904, 0.958423192533447, 0.9626618505743497, 0.9674318860064286, 0.9727409028821216, 0.9785948570776292, 0.9849973981057791, 0.9919491551943251, 0.9994470399058778, 1.00748364718789, 1.0160468276335988, 1.0251194765785578, 1.034679549975852, 1.04470028545419, 1.0551505876884002, 1.0659955309619797, 1.0771969346721872, 1.0887139748737333, 1.1005038034516446, 1.1125221543583685, 1.124723922780623, 1.1370637079394876, 1.1494963136161285, 1.1619772027500757, 1.1744629039482284, 1.1869113688071615, 1.1992822798295442, 1.211537309534671, 1.223640332154589, 1.2355575900426488, 1.24725781755186, 1.2587123256245702, 1.2698950506530806, 1.2807825713260725, 1.2913540971897843, 1.3015914325564406, 1.3114789192187688, 1.321003361208276, 1.330153934590292, 1.3389220850377774 ], [ 0.9509837266989336, 0.9501307816885167, 0.9496873232490037, 0.9496661741491736, 0.9500796060169343, 0.9509394004259328, 0.9522569267151257, 0.9540432261856664, 0.9563090876420378, 0.9590650947877593, 0.9623216224634897, 0.9660887569570143, 0.970376116528713, 0.9751925528616965, 0.9805457233994854, 0.9864415393666924, 0.9928835147028374, 0.9998720649174635, 1.0074038260873703, 1.0154710740290949, 1.024061314849112, 1.033157091052415, 1.0427360118601967, 1.0527709852787028, 1.0632306108737017, 1.0740796866143616, 1.0852797864043, 1.09678987232887, 1.108566913994316, 1.1205664949386922, 1.132743392271991, 1.145052120313324, 1.1574474322002384, 1.1698847755794624, 1.182320699930961, 1.1947132141634522, 1.2070220940748717, 1.2192091401980867, 1.2312383874531532, 1.2430762688522303, 1.254691736189885, 1.26605634115618, 1.277144280618307, 1.2879324099416714, 1.2984002281951714, 1.3085298389473885, 1.3183058901499478, 1.327715496354147, 1.3367481462422595, 1.3453955981919672 ], [ 0.9587879108290749, 0.9580472640878185, 0.9577108288074406, 0.9577914301029288, 0.9583014156534042, 0.9592527086795196, 0.9606568716964495, 0.9625251707923819, 0.9648686262577342, 0.9676980317710062, 0.9710239216190091, 0.9748564642697952, 0.9792052617848185, 0.9840790389145416, 0.9894852142361547, 0.9954293592372796, 1.0019145698979446, 1.0089407970130189, 1.0165042007918514, 1.0245966040898438, 1.0332051103842117, 1.042311927699144, 1.0518944068480383, 1.0619252733385642, 1.0723730146013015, 1.0832023785154208, 1.094374941869443, 1.1058497141284946, 1.117583749646009, 1.12953274861865, 1.1416516329345745, 1.153895087443712, 1.1662180602373207, 1.17857621759146, 1.1909263506841747, 1.2032267323621486, 1.2154374233118395, 1.2275205280550037, 1.2394404022143757, 1.2511638134115333, 1.2626600588959107, 1.2739010435199543, 1.284861321965262, 1.2955181092136046, 1.3058512631875416, 1.3158432433066243, 1.3254790484607843, 1.3347461376281535, 1.3436343360848508, 1.3521357298846202 ], [ 0.9674505570580727, 0.9668412483858817, 0.9666307961294349, 0.9668319714088672, 0.9674571258387801, 0.9685182335382638, 0.9700269382845619, 0.9719945958941575, 0.9744322987148397, 0.9773508662855884, 0.9807607842524041, 0.984672073078027, 0.9890940695926655, 0.9940351087439995, 0.9995021008434242, 1.0055000118567863, 1.0120312707445285, 1.0190951465265863, 1.026687153895897, 1.0347985531701362, 1.0434160029560346, 1.0525214025470215, 1.0620919328055656, 1.0721002786463592, 1.0825149997292978, 1.0933010097051263, 1.104420125713635, 1.1158316552889016, 1.1274929946286194, 1.1393602186973886, 1.1513886490714509, 1.163533389562272, 1.1757498225928935, 1.1879940613518871, 1.2002233542744447, 1.2123964396969766, 1.2244738497708603, 1.2364181639433922, 1.2481942134687647, 1.259769239414054, 1.2711130074023977, 1.2821978828529705, 1.2929988707420272, 1.3034936239592114, 1.3136624242225639, 1.3234881392998148, 1.3329561600112412, 1.3420543201967468, 1.350772802541434, 1.3591040328827269 ], [ 0.9769179365598416, 0.9764578799964513, 0.97639124503757, 0.9767306811770586, 0.9774884591773291, 0.9786765000124751, 0.9803064039008738, 0.9823894700511403, 0.9849366952200208, 0.987958737081662, 0.9914658271403891, 0.9954676179533877, 0.9999729513041403, 1.004989538293411, 1.01052354971902, 1.0165791260015116, 1.023157829913201, 1.030258080577425, 1.037874619747505, 1.0459980662474078, 1.0546146080123135, 1.063705863891628, 1.0732489244106485, 1.0832165591179548, 1.093577563203133, 1.1042972092408687, 1.1153377697172249, 1.1266590798262637, 1.1382191155558739, 1.1499745677278381, 1.1618813975551547, 1.1738953631113307, 1.185972508924676, 1.1980696129781465, 1.2101445870318195, 1.2221568276472794, 1.2340675167130941, 1.2458398716550323, 1.2574393467921665, 1.2688337883764862, 1.2799935466596648, 1.2908915488418813, 1.30150333699426, 1.3118070750594113, 1.3217835288874604, 1.331416023019457, 1.3406903776373966, 1.349594828796883, 1.3581199347673403, 1.3662584710372963 ], [ 0.98712976363945, 0.9868353494546245, 0.986928813574479, 0.9874226059061597, 0.9883288209813819, 0.9896592125906032, 0.9914252042185427, 0.9936378866223673, 0.9963079919820117, 0.9994458326040689, 1.0030611915174148, 1.0071631528525544, 1.0117598620857868, 1.016858210518757, 1.0224634451590373, 1.028578714587492, 1.0352045728721744, 1.0423384753964564, 1.0499743096325862, 1.0581020069223623, 1.0667072758861162, 1.0757714846407478, 1.0852717010942619, 1.0951808831302392, 1.1054681974642417, 1.116099438945408, 1.127037520509835, 1.1382430061681532, 1.1496746635046773, 1.1612900167596207, 1.1730458857827848, 1.184898899601096, 1.1968059760156868, 1.2087247607330291, 1.2206140212972272, 1.232433992728285, 1.2441466733698463, 1.2557160709855864, 1.2671084005273658, 1.2782922361340372, 1.2892386207446747, 1.2999211372115922, 1.3103159450100852, 1.3204017866249864, 1.3301599675202325, 1.3395743133326454, 1.3486311076274928, 1.3573190132471462, 1.3656289799967076, 1.37355414115104 ], [ 0.9980200728809785, 0.997905822283198, 0.9981737493402751, 0.9988360185232023, 0.9999044456736299, 1.0013904979607726, 1.003305286235102, 1.0056595419781016, 1.008463569679816, 1.0117271645919976, 1.0154594856887604, 1.0196688746362765, 1.0243626139641413, 1.0295466217594529, 1.0352250862710635, 1.0414000517178768, 1.0480709756807083, 1.055234287276256, 1.0628829816962602, 1.0710062883406835, 1.0795894452722028, 1.0886136024844268, 1.0980558628409987, 1.107889455807818, 1.1180840281335063, 1.1286060289074566, 1.1394191639252016, 1.1504848950335282, 1.1617629628093349, 1.1732119143835065, 1.1847896216500755, 1.196453778094176, 1.208162364949948, 1.21987407948183, 1.2315487200518513, 1.2431475244275378, 1.2546334595369126, 1.2659714625362621, 1.277128634522391, 1.2880743893991946, 1.2987805612447716, 1.3092214740188326, 1.3193739776447195, 1.3292174544657394, 1.338733799887682, 1.3479073807469346, 1.3567249746389385, 1.3651756931403005, 1.3732508915792998, 1.380944067761646 ], [ 1.0095181894134597, 1.0095964757753517, 1.0100510221624814, 1.010893617348787, 1.012135693331541, 1.0137883110559514, 1.015862136060503, 1.018367397196047, 1.0213138206719794, 1.024710531267061, 1.0285659128404183, 1.0328874215351314, 1.0376813475183488, 1.042952524930711, 1.048703994966558, 1.0549366334486985, 1.061648761251681, 1.068835762323465, 1.0764897383434917, 1.0845992297653009, 1.0931490293111656, 1.1021201062550567, 1.111489649570622, 1.1212312274011653, 1.1313150513377437, 1.141708327892158, 1.1523756765814024, 1.1632795937081437, 1.1743809423734708, 1.185639451622489, 1.1970142102345727, 1.2084641431480527, 1.2199484607354263, 1.2314270731690824, 1.242860964043329, 1.2542125193145433, 1.2654458094787358, 1.2765268246463632, 1.2874236636914176, 1.2981066798542782, 1.308548586020542, 1.318724523388822, 1.3286120974300855, 1.3381913850033478, 1.3474449163057738, 1.3563576350679591, 1.3649168401097256, 1.3731121110821367, 1.3809352209564216, 1.3883800375868287 ], [ 1.0215497654238483, 1.0218306097373477, 1.0224815177611248, 1.0235138118686815, 1.024938436996481, 1.0267659332697554, 1.0290063969783017, 1.0316694240543276, 1.0347640296912797, 1.038298537692992, 1.042280433734994, 1.0467161781310204, 1.0516109760759187, 1.0569685067587493, 1.0627906171479078, 1.069076991366333, 1.0758248118325522, 1.0830284328824138, 1.090679090378834, 1.0987646709443994, 1.107269561459164, 1.1161745936230592, 1.1254570906834225, 1.1350910152908265, 1.1450472102510356, 1.1552937186341292, 1.1657961666272796, 1.1765181914837073, 1.1874218974136432, 1.198468323684724, 1.2096179110468492, 1.22083095455262, 1.2320680327783697, 1.2432904053569513, 1.2544603726479353, 1.265541593302394, 1.2764993573791996, 1.2873008144408609, 1.2979151575894423, 1.3083137656109227, 1.318470306241026, 1.3283608040601378, 1.3379636767224412, 1.3472597431990698, 1.356232207544089, 1.364866621442807, 1.3731508285249387, 1.3810748931539707, 1.3886310161563884, 1.395813439736893 ], [ 1.034037852777397, 1.0345287952936624, 1.0353832698963739, 1.0366120453533627, 1.0382254825850505, 1.0402334958460178, 1.042645501510741, 1.045470349610041, 1.0487162330550244, 1.0523905697016975, 1.0564998531833416, 1.0610494698862878, 1.0660434816467603, 1.0714843767075142, 1.07737279508084, 1.083707238443827, 1.0904837785789436, 1.0976957815414867, 1.1053336664992766, 1.1133847179814576, 1.1218329678446535, 1.1306591588253634, 1.1398407957527534, 1.1493522842762547, 1.1591651512559613, 1.1692483364730004, 1.179568542374849, 1.1900906271491332, 1.2007780262398813, 1.2115931881042856, 1.2224980112075152, 1.2334542707271694, 1.2444240250648138, 1.2553699939994496, 1.2662559021517008, 1.2770467833209658, 1.2877092431325856, 1.298211679179826, 1.3085244593563723, 1.3186200602681817, 1.328473168454735, 1.3380607476530382, 1.3473620755545255, 1.3563587535056851, 1.3650346924613108, 1.373376078278995, 1.381371319193537, 1.3890109780626814, 1.3962876917486893, 1.4031960798001557 ], [ 1.0469039811450171, 1.0476100263755823, 1.048672690436289, 1.0501021082884034, 1.0519079697614537, 1.0540994712812402, 1.056685255161368, 1.0596733325505436, 1.063070986142458, 1.066884649146329, 1.0711197578750375, 1.0757805767040003, 1.0808699961166581, 1.086389307044528, 1.092337957600629, 1.0987133013496724, 1.1055103490944453, 1.1127215383393085, 1.1203365356651855, 1.1283420868662999, 1.1367219277273195, 1.1454567649199414, 1.1545243321083747, 1.1638995215878678, 1.1735545872759605, 1.1834594111398768, 1.193581822461137, 1.2038879577610886, 1.2143426486099924, 1.2249098246995285, 1.2355529202529538, 1.2462352729096504, 1.2569205055485329, 1.267572883050389, 1.2781576376952277, 1.2886412586808846, 1.2989917430378473, 1.309178806889996, 1.3191740574653354, 1.328951127419083, 1.3384857738614349, 1.3477559449960823, 1.3567418175187795, 1.3654258079618657, 1.3737925610679875, 1.381828918093809, 1.3895238677284396, 1.3968684820928092, 1.403855840082658, 1.4104809401367375 ], [ 1.0600692129497142, 1.0609928417033474, 1.0622657616168347, 1.0638974034637576, 1.0658967114929283, 1.0682720878523528, 1.071031325100636, 1.0741815237618422, 1.077728992048077, 1.081679125363672, 1.0860362640742862, 1.0908035293084142, 1.095982638254947, 1.1015737024705403, 1.1075750149875219, 1.1139828343117852, 1.1207911754472442, 1.1279916195652349, 1.1355731545553798, 1.1435220582342067, 1.1518218343838955, 1.1604532091667754, 1.1693941921072608, 1.1786202021617542, 1.188104255840779, 1.1978172112689196, 1.207728059697971, 1.2178042544099057, 1.2280120661196896, 1.2383169538034497, 1.2486839402068912, 1.25907798202277, 1.269464325784176, 1.2798088418408968, 1.2900783303061225, 1.3002407944988157, 1.3102656790622214, 1.32012407150043, 1.3297888672432248, 1.3392348994536192, 1.348439035601607, 1.3573802433490196, 1.3660396285624583, 1.3744004483488483, 1.3824481019507766, 1.3901701022001836, 1.3975560300516572, 1.404597474530424, 1.4112879602524142, 1.4176228645126634 ], [ 1.073455150020634, 1.074596389938596, 1.0760791611710019, 1.0779121317537341, 1.0801034401906175, 1.0826606347292298, 1.085590601668771, 1.0888994804170469, 1.0925925632763276, 1.0966741784664662, 1.1011475557216426, 1.1060146749362982, 1.1112760997649358, 1.1169307997356472, 1.1229759662051224, 1.1294068291996655, 1.1362164836496054, 1.1433957345153611, 1.1509329706257823, 1.1588140765712205, 1.167022390684963, 1.1755387150975174, 1.1843413812608727, 1.1934063714904042, 1.2027074942560663, 1.2122166084304662, 1.2219038896510854, 1.231738130467531, 1.2416870650323173, 1.2517177087125806, 1.2617967030850263, 1.2718906572616115, 1.2819664773197572, 1.2919916767202169, 1.3019346619210561, 1.3117649888534404, 1.3214535874151756, 1.3309729525586225, 1.340297301809272, 1.349402700085178, 1.3582671534645234, 1.36687067407153, 1.3751953185491992, 1.3832252027060132, 1.390946494913544, 1.3983473907396609, 1.405418071166269, 1.4121506465889957, 1.4185390886460225, 1.4245791517833515 ], [ 1.0869848713402912, 1.0883414163055953, 1.0900312978799864, 1.0920623758500294, 1.094441937976869, 1.0971766361681328, 1.1002724129131223, 1.1037344163472396, 1.1075669026226294, 1.111773124786496, 1.116355208123166, 1.1213140128973995, 1.126648986615543, 1.132358009236202, 1.1384372361178625, 1.1448809447598767, 1.151681392427624, 1.15882869240099, 1.1663107167183138, 1.1741130328241003, 1.1822188804563076, 1.1906091934951881, 1.199262669479703, 1.2081558872680562, 1.2172634710794978, 1.2265582970911217, 1.2360117370168215, 1.2455939317520688, 1.2552740872617314, 1.2650207844149874, 1.2748022944055215, 1.284586891700669, 1.2943431570980908, 1.304040264382407, 1.3136482452033433, 1.323138228062184, 1.3324826486041805, 1.3416554296790748, 1.3506321307690103, 1.359390067334116, 1.3679084013605918, 1.3761682049119175, 1.3841524988020424, 1.3918462686650186, 1.399236460730391, 1.406311959567206, 1.4130635499656048, 1.4194838650089863, 1.4255673222679957, 1.4313100499296691 ], [ 1.10058378605578, 1.10215115464071, 1.1040432416742545, 1.106267066699191, 1.108829036975442, 1.111734882399134, 1.114989582086049, 1.118597281522646, 1.1225611995127107, 1.1268835246397195, 1.1315653016293687, 1.1366063088221308, 1.1420049289207699, 1.1477580162077106, 1.1538607644546122, 1.160306580674578, 1.167086970588955, 1.174191442091172, 1.181607433003805, 1.1893202689918443, 1.1973131566122444, 1.2055672151971402, 1.2140615496827818, 1.222773364738297, 1.231678118760561, 1.2407497146179411, 1.2499607225560583, 1.25928262949942, 1.2686861081372203, 1.2781412986859737, 1.287618096072724, 1.2970864354632157, 1.306516569540928, 1.3158793316834434, 1.325146380126144, 1.334290419279529, 1.343285395496656, 1.3521066656914746, 1.360731138217217, 1.3691373862741958, 1.3773057347992814, 1.38521832228879, 1.3928591393360072, 1.400214045850187, 1.4072707689984103, 1.4140188839076955, 1.4204497791108956, 1.4265566086387897, 1.4323342325675705, 1.4377791477353687 ], [ 1.1141803905395706, 1.1159521140577946, 1.1180395382316788, 1.1204488237496666, 1.123185482313639, 1.1262543119143016, 1.1296593252466212, 1.1334036706006978, 1.137489544878555, 1.1419180988299689, 1.146689335169003, 1.1518020009124983, 1.1572534760424344, 1.163039661389467, 1.1691548694040368, 1.1755917221513654, 1.182341061360667, 1.1893918756045145, 1.1967312496249343, 1.2043443404270922, 1.2122143840313953, 1.220322735747012, 1.2286489455729943, 1.2371708689384107, 1.2458648115612418, 1.2547057058356539, 1.263667314933595, 1.27272245979459, 1.2818432634216257, 1.2910014064256734, 1.3001683875752403, 1.3093157832045137, 1.3184154996949244, 1.3274400138370546, 1.3363625966555321, 1.3451575171797467, 1.3538002236010669, 1.3622675002060245, 1.3705375993549702, 1.3785903485417785, 1.3864072331948245, 1.393971456354038, 1.4012679766902516, 1.4082835265400129, 1.4150066117359617, 1.4214274950458394, 1.427538165015781, 1.433332291965046, 1.4388051728138065, 1.4439536663521113 ], [ 1.1277069224479137, 1.1296747539592535, 1.1319489028872123, 1.1345346652251995, 1.1374366557729916, 1.1406587451144548, 1.1442039912113415, 1.1480745652867714, 1.152271671961845, 1.156795463993972, 1.1616449524399324, 1.1668179136152375, 1.1723107948169738, 1.1781186213825383, 1.1842349082238128, 1.1906515794518169, 1.1973589000354357, 1.2043454235697861, 1.2115979601272628, 1.219101567808195, 1.22683957100181, 1.2347936075394177, 1.2429437059190793, 1.2512683926695325, 1.2597448287732897, 1.2683489729574822, 1.2770557686519382, 1.285839350561409, 1.2946732661434694, 1.3035307068521875, 1.3123847438134364, 1.3212085626413372, 1.3299756923739305, 1.3386602239742778, 1.3472370144725074, 1.355681873566399, 1.3639717302983978, 1.3720847782305752, 1.380000598296407, 1.3877002591808036, 1.3951663956424856, 1.4023832656354003, 1.4093367874105813, 1.4160145579988872, 1.4224058546063094, 1.4285016205165344, 1.434294437109607, 1.4397784835862266, 1.4449494859475491, 1.4498046567278875 ], [ 1.1410999083020144, 1.1432540448936075, 1.1457047925673567, 1.1484565885836109, 1.1515131619116759, 1.1548774729916287, 1.158551649534238, 1.1625369182892369, 1.1668335329683146, 1.1714406988343082, 1.176356494854847, 1.1815777947525092, 1.187100188741581, 1.1929179081938663, 1.1990237558864998, 1.2054090448138097, 1.21206354875409, 1.2189754678359703, 1.2261314122233207, 1.2335164067201725, 1.241113918592524, 1.2489059102323754, 1.2568729174864908, 1.2649941535846727, 1.273247637682676, 1.2816103461376427, 1.2900583838097373, 1.298567171976741, 1.3071116488939136, 1.3156664786544512, 1.3242062638211682, 1.3327057573107344, 1.3411400692102822, 1.3494848645727855, 1.357716548742419, 1.3658124373656049, 1.373750908903954, 1.3815115381376621, 1.3890752097917023, 1.396424211999963, 1.403542309822206, 1.410414799434266, 1.4170285439225532, 1.4233719918366652, 1.4294351798008982, 1.435209720571635, 1.44068877796707, 1.4458670301019563, 1.4507406223430064, 1.4553071113680627 ], [ 1.1543006040851647, 1.1566299157884907, 1.159245857485659, 1.1621520242629377, 1.1653512812621056, 1.168845707057057, 1.1726365343987977, 1.176724088447203, 1.1811077228262892, 1.1857857541065766, 1.1907553956258123, 1.196012691894784, 1.2015524551796624, 1.207368206182896, 1.2134521210340328, 1.2197949870212788, 1.2263861696167224, 1.233213593349206, 1.2402637389425533, 1.2475216588563218, 1.254971012945525, 1.2625941254106061, 1.2703720635650015, 1.2782847382389089, 1.2863110249031566, 1.2944289038769807, 1.3026156173169907, 1.3108478401069914, 1.3191018613085719, 1.3273537725127194, 1.3355796592666358, 1.3437557917422336, 1.3518588109585803, 1.359865907155553, 1.3677549873171364, 1.3755048293301728, 1.383095220803836, 1.3905070811316582, 1.3977225659191488, 1.4047251533992677, 1.4114997128958766, 1.4180325557612303, 1.4243114695042698, 1.4303257360456636, 1.4360661351908202, 1.4415249345140393, 1.446695866906167, 1.45157409706484, 1.4561561782090664, 1.4604400002848674 ], [ 1.1672553307525704, 1.1697475904647558, 1.172516276628627, 1.1755641679648876, 1.1788932971472708, 1.1825048983955386, 1.1863993536513213, 1.190576137587068, 1.1950337618782814, 1.1997697193818762, 1.204780429101492, 1.2100611830732986, 1.215606096558025, 1.221408063159227, 1.2274587166838564, 1.2337484016988347, 1.240266154797022, 1.2469996985521272, 1.2539354500038526, 1.2610585452683405, 1.2683528815184526, 1.2758011771358744, 1.2833850503210422, 1.291085115882633, 1.2988810993443733, 1.3067519669333274, 1.3146760694806483, 1.3226312978003496, 1.3305952467375055, 1.3385453848126696, 1.346459226246206, 1.3543145021295306, 1.3620893276171138, 1.3697623622333917, 1.3773129607049817, 1.3847213121182507, 1.3919685656387895, 1.399036941485793, 1.4059098263048881, 1.4125718525059217, 1.419008961511482, 1.4252084511871643, 1.4311590079915848, 1.436850724594008, 1.4422751038644528, 1.447425050252368, 1.4522948496430805, 1.4568801388237893, 1.4611778657095311, 1.4651862414797 ], [ 1.179915708468918, 1.1825578181801975, 1.1854659827827652, 1.1886421982786157, 1.1920877039988786, 1.1958029348123407, 1.1997874730020675, 1.2040400001470413, 1.2085582494887952, 1.2133389594265807, 1.2183778289628164, 1.2236694761040945, 1.2292074004007347, 1.2349839509662561, 1.2409903014429688, 1.2472164334565696, 1.253651130118131, 1.260281981075629, 1.2670954004826307, 1.2740766590370034, 1.2812099309513636, 1.288478356358353, 1.2958641192420626, 1.3033485405399086, 1.3109121855985038, 1.3185349847144758, 1.326196365069828, 1.333875392001832, 1.3415509172483286, 1.3492017315952838, 1.356806719234256, 1.3643450111179225, 1.3717961346803238, 1.3791401574580657, 1.3863578223964645, 1.39343067293374, 1.4003411663069052, 1.4070727738940172, 1.4136100677793078, 1.4199387930826013, 1.426045925919277, 1.4319197171422566, 1.4375497222587006, 1.4429268181103345, 1.4480432070598166, 1.4528924095404934, 1.4574692459087317, 1.4617698085918192, 1.4657914255555613, 1.4695326161282427 ], [ 1.1922387949103, 1.1950170043767911, 1.1980507841478925, 1.2013413875778896, 1.2048893059955679, 1.2086942257533706, 1.212754985895319, 1.2170695368317979, 1.2216349005180818, 1.2264471327540312, 1.231501288349667, 1.236791390028179, 1.2423104020558136, 1.2480502096874446, 1.2540016055871863, 1.2601542844153188, 1.2664968467574438, 1.2730168135022704, 1.2797006516470573, 1.2865338123239494, 1.293500781599449, 1.3005851443102145, 1.3077696608715543, 1.3150363566438628, 1.3223666230820308, 1.3297413295401896, 1.337140944275547, 1.3445456629064427, 1.3519355423451103, 1.3592906380563339, 1.3665911423972914, 1.3738175217753024, 1.3809506504184703, 1.3879719386844847, 1.3948634540260079, 1.4016080329747695, 1.4081893827858742, 1.4145921716833545, 1.4208021069521624, 1.4268060004170802, 1.4325918211243247, 1.4381487352888058, 1.4434671337845917, 1.4485386476360274, 1.4533561521129061, 1.4579137601473622, 1.4622068058760542, 1.466231819172278, 1.4699864920727896, 1.473469638026265 ], [ 1.2041871341727626, 1.2070872489128182, 1.2102323905665369, 1.2136231149640002, 1.2172592155145259, 1.22113968517573, 1.2252626798579498, 1.2296254836759717, 1.2342244765379184, 1.2390551046446312, 1.2441118545575396, 1.2493882315738079, 1.2548767432180346, 1.2605688887134858, 1.2664551553255525, 1.2725250224696518, 1.2787669744394075, 1.2851685225347058, 1.291716237251205, 1.298395791033255, 1.3051920118940639, 1.312088947975428, 1.3190699428623907, 1.3261177211951736, 1.3332144838429025, 1.3403420116326814, 1.3474817763757756, 1.3546150577114138, 1.3617230641085958, 1.3687870562358833, 1.3757884708346129, 1.3827090432157447, 1.3895309265445794, 1.3962368061778643, 1.402810007467865, 1.409234595639101, 1.4154954665647719, 1.4215784275099148, 1.4274702671554191, 1.4331588144605039, 1.438632986152424, 1.4438828228440832, 1.4488995139683276, 1.4536754118800148, 1.4582040356124615, 1.4624800648850416, 1.4664993250449658, 1.4702587636911957, 1.4737564197742843, 1.4769913859952708 ], [ 1.2157287237829557, 1.2187362999252715, 1.221978353157742, 1.2254547906660163, 1.2291647613991088, 1.2331066229184102, 1.2372779103692857, 1.2416753079904448, 1.246294623627174, 1.2511307667664173, 1.2561777306614, 1.2614285791571578, 1.2668754388617762, 1.2725094973269058, 1.2783210079005956, 1.2842993018920217, 1.2904328086376748, 1.2967090839802826, 1.3031148475641137, 1.3096360292144944, 1.3162578245075462, 1.3229647594526404, 1.3297407640102774, 1.3365692539589724, 1.3434332204138346, 1.3503153260954062, 1.357198007258348, 1.3640635800239578, 1.3708943497259245, 1.3776727217813638, 1.3843813125438174, 1.391003058584203, 1.3975213228801024, 1.4039199964713263, 1.410183594256178, 1.4162973437521111, 1.4222472658188536, 1.4280202465332263, 1.4336040996041055, 1.4389876189152424, 1.4441606209760038, 1.449113977239766, 1.453839636412779, 1.4583306370202083, 1.462581110619732, 1.4665862761564301, 1.4703424260366387, 1.473846904564135, 1.4770980794310478, 1.4800953069898497 ], [ 1.2268369080506791, 1.2299374321366947, 1.233261926726884, 1.2368097018003914, 1.240579317438098, 1.2445685554168024, 1.2487743934913376, 1.253192982767965, 1.257819628600175, 1.2626487754635847, 1.2676739962878636, 1.2728879867379885, 1.2782825649419058, 1.283848677154088, 1.2895764098221927, 1.2954550084845147, 1.301472903868065, 1.3076177454797433, 1.3138764428865177, 1.3202352147658545, 1.3266796456767875, 1.3331947503583381, 1.3397650452090417, 1.3463746264441032, 1.3530072542702252, 1.3596464422680974, 1.3662755510346676, 1.3728778850172243, 1.3794367913742958, 1.3859357596287232, 1.3923585208397207, 1.3986891450151053, 1.4049121355130003, 1.4110125192429224, 1.4169759315667685, 1.4227886949164463, 1.4284378902817945, 1.433911420873677, 1.4391980674267906, 1.4442875347685877, 1.4491704894393542, 1.453838588299401, 1.4582844981990195, 1.462501906912726, 1.4664855256501745, 1.47023108355117, 1.4737353146516077, 1.4769959378714501, 1.4800116306257427, 1.4827819966962672 ], [ 1.2374902065621216, 1.2406692589181396, 1.244061864754093, 1.2476667897532865, 1.2514820617431548, 1.255504946826896, 1.2597319286556345, 1.2641586912221663, 1.2687801055655323, 1.2735902207796839, 1.2785822597180334, 1.283748619777156, 1.2890808791259818, 1.294569808719886, 1.300205390401308, 1.3059768413387864, 1.3118726449943403, 1.3178805887351084, 1.3239878081194894, 1.3301808377921676, 1.3364456688179123, 1.342767812173155, 1.349132367999741, 1.3555241001099858, 1.3619275151194967, 1.3683269454777185, 1.3747066355695035, 1.3810508299776998, 1.3873438629304045, 1.39357024790987, 1.3997147663759018, 1.4057625545561252, 1.4116991872797877, 1.4175107578799344, 1.423183953259602, 1.4287061233082574, 1.434065343961658, 1.4392504733175975, 1.4442512003470376, 1.4490580858706394, 1.4536625956006308, 1.4580571251734122, 1.4622350172166794, 1.4661905706036282, 1.469919042144622, 1.4734166410524896, 1.4766805165911379, 1.4797087393782573, 1.4825002768619537, 1.485054963528548 ], [ 1.2476720869948246, 1.2509154877523603, 1.2543621570446204, 1.258010369677879, 1.2618576778898116, 1.2659008917569092, 1.2701360630925669, 1.2745584731875919, 1.2791626247369494, 1.2839422382832786, 1.2888902534883573, 1.2939988355178298, 1.29925938679134, 1.3046625643096588, 1.310198302722031, 1.315855843241216, 1.3216237684506489, 1.3274900429787466, 1.3334420599403427, 1.3394666929659214, 1.3455503535569622, 1.351679053421955, 1.3578384713640745, 1.3640140242100198, 1.370190941191832, 1.3763543411218389, 1.3824893116369998, 1.3885809897352246, 1.394614642784483, 1.4005757491578559, 1.406450077635513, 1.412223764719283, 1.4178833890274578, 1.4234160419768653, 1.428809394014996, 1.4340517557357984, 1.4391321332961997, 1.4440402776440768, 1.448766727168957, 1.4533028434913349, 1.4576408402119114, 1.4617738045455944, 1.4656957118643086, 1.4694014332655918, 1.4728867363690263, 1.47614827961884, 1.47918360043764, 1.4819910976330941, 1.4845700085061393, 1.4869203811462384 ], [ 1.2573706916390284, 1.2606646289033583, 1.2641517202447212, 1.2678298026789778, 1.271696008729909, 1.2757467508133349, 1.2799777093701687, 1.2843838250667343, 1.2889592953596585, 1.293697575695757, 1.2985913855843634, 1.3036327197407285, 1.3088128644544041, 1.3141224192865388, 1.3195513241452264, 1.3250888917291797, 1.330723845268116, 1.3364443614241799, 1.3422381181537746, 1.3480923472641864, 1.353993891335706, 1.359929264618306, 1.3658847174534041, 1.3718463037166666, 1.3777999507278587, 1.3837315310295522, 1.3896269353985713, 1.3954721464237179, 1.4012533119612836, 1.406956817767407, 1.412569358604264, 1.4180780071263037, 1.4234702798738397, 1.4287341997342895, 1.4338583542760448, 1.4388319494156472, 1.4436448579441055, 1.4482876625115406, 1.4527516927486077, 1.4570290562864523, 1.461112663521848, 1.4649962460589143, 1.4686743688410875, 1.4721424360655482, 1.475396691045364, 1.4784342102513697, 1.48125289182528, 1.483851438907279, 1.4862293381649334, 1.4883868339456585 ], [ 1.266578527029401, 1.2699096670798962, 1.2734240513716903, 1.2771191311679209, 1.280991673663052, 1.2850377500210943, 1.2892527273398313, 1.293631264823905, 1.2981673144184118, 1.3028541261172482, 1.3076842581174661, 1.312649591942759, 1.317741352606665, 1.3229501338301037, 1.328265928269574, 1.333678162652763, 1.339175737658924, 1.3447470723231576, 1.3503801526879409, 1.3560625843728091, 1.361781648684803, 1.367524361848678, 1.3732775368972998, 1.379027847729307, 1.3847618948129221, 1.3904662719920102, 1.3961276338328046, 1.4017327629376053, 1.407268636645283, 1.4127224925380333, 1.4180818921800282, 1.4233347825269538, 1.4284695544662092, 1.4334750979762598, 1.4383408534302187, 1.4430568586128012, 1.44761379107115, 1.452003005477202, 1.4562165657417303, 1.460247271685998, 1.4640886801450497, 1.4677351204452473, 1.4711817042664697, 1.4744243299648598, 1.4774596814940917, 1.480285222120747, 1.4828991831815976, 1.4853005481769537, 1.4874890325339714, 1.4894650594069412 ], [ 1.2752921259213437, 1.2786477056738188, 1.2821768542642844, 1.2858766875953325, 1.2897436598493168, 1.2937735548461753, 1.297961481433454, 1.3023018731556186, 1.3067884924106232, 1.311414439256695, 1.3161721649821483, 1.3210534904966367, 1.3260496295447912, 1.3311512166839938, 1.3363483399083704, 1.3416305777426303, 1.3469870405732522, 1.3524064159322833, 1.3578770174015296, 1.3633868367631876, 1.3689235989873705, 1.3744748196178966, 1.3800278640947985, 1.3855700085353067, 1.3910885014836296, 1.3965706261335056, 1.402003762525426, 1.4073754492223087, 1.4126734439729662, 1.4178857828817542, 1.4230008376157088, 1.428007370197172, 1.4328945849511112, 1.437652177202012, 1.4422703783459694, 1.4467399969591717, 1.4510524556445128, 1.4551998233630103, 1.4591748430456035, 1.4629709543328355, 1.4665823113440555, 1.47000379543298, 1.4732310229416752, 1.4762603480191594, 1.4790888606229529, 1.4817143798709007, 1.4841354429559248, 1.4863512898770261, 1.4883618442756181, 1.4901676906964447 ], [ 1.2835116904883328, 1.2868795927572487, 1.2904116484257515, 1.294104686300313, 1.297954897344518, 1.3019578290195715, 1.3061083837022196, 1.310400821392226, 1.3148287668766747, 1.319385221468071, 1.3240625793782739, 1.3288526487321475, 1.3337466771647064, 1.3387353818850782, 1.3438089840314213, 1.3489572470845037, 1.3541695190555596, 1.3594347781174865, 1.3647416813084599, 1.3700786159043226, 1.3754337530309195, 1.3807951030699432, 1.3861505724012528, 1.391488021020547, 1.3967953205727022, 1.4020604123471143, 1.4072713647910176, 1.4124164301092645, 1.4174840995336389, 1.4224631568612087, 1.4273427298792027, 1.4321123393136141, 1.4367619449603097, 1.4412819886813362, 1.4456634339755312, 1.4498978018619484, 1.4539772028470146, 1.4578943647818126, 1.4616426564542473, 1.4652161068016831, 1.4686094196724704, 1.47181798410883, 1.4748378801682223, 1.4776658803446154, 1.480299446694263, 1.4827367238119362, 1.4849765278421394, 1.4870183317452068, 1.4888622470696151, 1.4905090025089451 ], [ 1.2912407250799869, 1.2946095374439124, 1.298133369112418, 1.3018088075570606, 1.3056318274460086, 1.3095977876354459, 1.3137014322319116, 1.3179368959043711, 1.3222977135761664, 1.3267768345732336, 1.3313666412473106, 1.3360589720328602, 1.3408451488354691, 1.3457160085893762, 1.3506619387641643, 1.3556729165471755, 1.3607385513802195, 1.3658481304881354, 1.3709906670032683, 1.3761549502648227, 1.3813295978552471, 1.3865031089271491, 1.3916639183731236, 1.3968004513962717, 1.401901178050168, 1.4069546673321984, 1.4119496404324536, 1.4168750227606417, 1.421719994394787, 1.4264740386173793, 1.4311269882265247, 1.4356690693317204, 1.4400909423660124, 1.44438374006896, 1.448539102218401, 1.4525492069137729, 1.4564067982401956, 1.4601052101707712, 1.4636383865948055, 1.467000897391693, 1.4701879505039974, 1.473195399998141, 1.476019750136977, 1.4786581555243115, 1.4811084174169842, 1.4833689763343698, 1.4854389011277775, 1.4873178747023632, 1.4890061766114753, 1.4905046627672274 ], [ 1.2984856661835, 1.3018447244775615, 1.3053499667347008, 1.3089977820720549, 1.3127839726696995, 1.3167037530922812, 1.320751753631831, 1.3249220278195635, 1.3292080642034672, 1.3336028024328361, 1.3380986536322341, 1.3426875249869132, 1.3473608484013564, 1.35210961303394, 1.3569244014555335, 1.3617954291296988, 1.3667125868684933, 1.3716654858817896, 1.376643505010341, 1.381635839713943, 1.3866315523758939, 1.3916196234832792, 1.3965890032484682, 1.4015286632497008, 1.4064276476864137, 1.411275123866708, 1.4160604315687197, 1.4207731309434608, 1.4254030486527707, 1.4299403219618458, 1.4343754405305862, 1.4386992856717957, 1.4429031668669947, 1.4469788553524863, 1.4509186146098563, 1.4547152276165989, 1.4583620207345995, 1.4618528841370515, 1.4651822886983994, 1.468345299297133, 1.4713375845077976, 1.4741554226861333, 1.4767957044797333, 1.4792559318253589, 1.481534213522874, 1.4836292575039371, 1.4855403599406294, 1.4872673913646945, 1.4888107799912718, 1.4901714924617442 ], [ 1.3052555164013997, 1.308594934033056, 1.3120720127138716, 1.3156829832169956, 1.3194235157689556, 1.323288721396269, 1.327273157208057, 1.331370835734063, 1.3355752383854047, 1.3398793330492351, 1.3442755957699433, 1.3487560364099098, 1.3533122281240135, 1.3579353404257144, 1.3626161755702821, 1.3673452079342419, 1.3721126260305385, 1.3769083767674486, 1.381722211536482, 1.3865437337007382, 1.3913624470503312, 1.3961678047949246, 1.4009492586745376, 1.4056963077871554, 1.4103985467542626, 1.4150457128716, 1.4196277319209618, 1.4241347623483074, 1.4285572375428641, 1.4328859059802421, 1.4371118690194769, 1.4412266161688885, 1.4452220576587682, 1.44909055418038, 1.452824943670862, 1.4564185650428172, 1.459865278776253, 1.463159484309342, 1.4662961341838259, 1.4692707449208375, 1.4720794046237695, 1.4747187773265464, 1.4771861041279941, 1.4794792011760245, 1.4815964545883773, 1.483536812419566, 1.4852997738058873, 1.4868853754414628, 1.4882941755578722, 1.4895272355975193 ], [ 1.3115614883308244, 1.3148721727395911, 1.3183123179147502, 1.3218780332144437, 1.3255648940946654, 1.3293679451942146, 1.3332817072420136, 1.3373001878806285, 1.3414168964475903, 1.3456248627006753, 1.3499166594157102, 1.3542844287276918, 1.3587199120293982, 1.3632144831881696, 1.3677591847925674, 1.372344767097764, 1.37696172930293, 1.3816003627664908, 1.3862507957465169, 1.3909030392438977, 1.3955470335250306, 1.400172694908104, 1.4047699624117023, 1.409328843885201, 1.4138394612661123, 1.4182920946385156, 1.4226772247978015, 1.4269855740587079, 1.4312081450749652, 1.4353362574688975, 1.439361582097429, 1.443276172806707, 1.4470724955509517, 1.4507434547722695, 1.4542824169573068, 1.457683231304224, 1.4609402474500106, 1.464048330224116, 1.467002871410155, 1.4697997985134317, 1.472435580548516, 1.4749072308780724, 1.4772123071517733, 1.4793489084122025, 1.4813156694529888, 1.483111752532737, 1.4847368365663578, 1.486191103932601, 1.487475225052866, 1.4885903409110663 ], [ 1.31741666324351, 1.320690320901985, 1.3240855686950705, 1.3275984283695046, 1.331224414430349, 1.3349585386983012, 1.3387953185535426, 1.3427287889371302, 1.3467525181296296, 1.3508596272724471, 1.35504281354173, 1.3592943768291554, 1.3636062497302281, 1.3679700305903137, 1.3723770193131366, 1.3768182555972277, 1.3812845592339205, 1.385766572076728, 1.39025480127684, 1.3947396633731381, 1.3992115288272093, 1.4036607666038974, 1.4080777884149116, 1.4124530922658898, 1.4167773049746835, 1.4210412233592737, 1.425235853826067, 1.4293524501222663, 1.4333825490483507, 1.4373180039575315, 1.4411510158977636, 1.4448741622780614, 1.4484804229643096, 1.451963203730645, 1.4553163570109016, 1.4585341999111225, 1.4616115294590264, 1.464543635080175, 1.46732630830381, 1.469955849714315, 1.4724290731773628, 1.4747433073831568, 1.476896394762961, 1.4788866878492262, 1.4807130431640925, 1.4823748127354903, 1.483871833354479, 1.4852044137013793, 1.4863733194814053, 1.4873797567226605 ] ], "zauto": true, "zmax": 1.4905090025089451, "zmin": -1.4905090025089451 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.06988706323946568, 0.0686489051949981, 0.0675207195462655, 0.06649730192845772, 0.0655721853177899, 0.06473798888185268, 0.06398681054137992, 0.06331063537128025, 0.06270173152733367, 0.06215300830806167, 0.06165831663302653, 0.06121267960702287, 0.06081244871456882, 0.06045538835161969, 0.0601406968795401, 0.059868975575491, 0.05964215758684385, 0.059463407543837325, 0.05933699947716017, 0.05926817699262348, 0.059262996210071625, 0.05932814960905714, 0.05947076821307008, 0.05969820069824972, 0.06001777084208501, 0.06043651867667614, 0.06096093496057255, 0.061596702208729676, 0.06234845768117166, 0.06321959385401413, 0.06421210981036307, 0.06532652297008751, 0.06656184528849676, 0.0679156223807294, 0.06938402887050742, 0.07096200933286353, 0.07264345190082555, 0.07442138099097494, 0.07628815643927508, 0.078235668216391, 0.0802555183445891, 0.08233918424264006, 0.08447816015872357, 0.08666407541260054, 0.08888878976636222, 0.09114446737173391, 0.09342363144947585, 0.0957192022189748, 0.09802452069725177, 0.10033336090465145 ], [ 0.06659114807783796, 0.06527499126763414, 0.0640749557275054, 0.06298592328447197, 0.06200135303849657, 0.06111365536312856, 0.06031462017235938, 0.05959586674495663, 0.05894928123324804, 0.058367411197541956, 0.0578437933981181, 0.057373200332264784, 0.056951800998237934, 0.05657724048012501, 0.056248649842104294, 0.05596660165216538, 0.05573302697707267, 0.055551107259916715, 0.05542514997930826, 0.055360451599929424, 0.05536314636417941, 0.05544003610110693, 0.05559839523060651, 0.055845746789728964, 0.05618960930816997, 0.056637219904065866, 0.05719524489409797, 0.057869494221037085, 0.058664658948050556, 0.05958409120400718, 0.06062964312285579, 0.06180157596765027, 0.06309854374571208, 0.0645176484481643, 0.06605455778057917, 0.06770367176975502, 0.0694583223456929, 0.07131098984674994, 0.07325352196254717, 0.07527734331327951, 0.07737364704851869, 0.07953356301969687, 0.08174829988404053, 0.08400926074450542, 0.08630813356625958, 0.08863695867480381, 0.09098817622492616, 0.09335465674364278, 0.09572971780166724, 0.09810712964988949 ], [ 0.06353055602681554, 0.06212846430997408, 0.06084769388953751, 0.05968339225944337, 0.05862913906108719, 0.05767733850785587, 0.05681967772770542, 0.05604761356958622, 0.05535284811990674, 0.054727756421814745, 0.05416573796707886, 0.05366147484812934, 0.053211091930805254, 0.0528122258881832, 0.05246401860601519, 0.05216705514199786, 0.05192326670387598, 0.05173581544353327, 0.05160897140438727, 0.0515479843512804, 0.05155894625857153, 0.05164863553671961, 0.0518243327246981, 0.05209359971573634, 0.05246402016644163, 0.052942906402424265, 0.05353698623497466, 0.05425208985661534, 0.055092860842622327, 0.05606251530448201, 0.05716266931032711, 0.058393247567858506, 0.05975247748557924, 0.0612369637974056, 0.0628418314988584, 0.06456091992926989, 0.06638700880018356, 0.06831205755454851, 0.07032744197069318, 0.07242417556630759, 0.07459310733381865, 0.07682509106012886, 0.079111124591535, 0.08144245974878402, 0.08381068518226056, 0.08620778538116461, 0.08862617945314637, 0.09105874331710125, 0.09349881873100378, 0.09594021221285014 ], [ 0.060749960465408585, 0.05925400539262463, 0.05788318514077024, 0.056633104360402656, 0.05549768761064595, 0.0544695811953795, 0.05354063264531492, 0.05270240626751518, 0.05194668929437946, 0.05126594603989757, 0.05065368651610225, 0.05010472937442107, 0.049615354251974914, 0.049183352857532385, 0.048807998995950834, 0.0484899635328971, 0.048231200399984776, 0.04803482460497525, 0.04790499432204971, 0.047846798686907235, 0.04786614337322166, 0.04796961959709584, 0.04816434038269814, 0.04845773118651901, 0.04885726964901534, 0.04937017966327991, 0.050003095825109145, 0.05076172321575385, 0.05165052232646362, 0.05267244861223222, 0.053828770697362964, 0.05511898186091712, 0.056540808148743744, 0.05809030558076197, 0.059762030370935984, 0.06154926097742711, 0.06344424934979283, 0.06543848037173472, 0.06752292220837357, 0.06968825496394797, 0.07192506981467972, 0.07422403497128448, 0.07657602812072867, 0.07897223731818159, 0.08140423373059774, 0.08386402033896714, 0.08634406087607502, 0.08883729308702053, 0.09133712999600851, 0.09383745235469171 ], [ 0.05829226328654988, 0.05669514917304819, 0.055225148313672624, 0.053878502125325134, 0.0526497132040511, 0.05153194666605873, 0.05051751930337156, 0.04959843202875363, 0.04876689523612638, 0.04801579871239508, 0.0473390873168206, 0.04673201893239736, 0.046191299220020327, 0.045715105059674244, 0.045303022082079564, 0.04495592905423489, 0.04467586201065119, 0.04446588429961818, 0.04432997692098617, 0.04427294951633145, 0.04430035946008336, 0.04441841775796365, 0.044633857983022544, 0.04495374890418501, 0.04538524181628861, 0.045935257516188883, 0.04661013219823267, 0.04741525296158077, 0.04835471949122466, 0.04943106746944981, 0.05064508172947898, 0.05199571495662479, 0.05348011372253965, 0.05509374077270845, 0.05683057305397001, 0.0586833500726717, 0.06064384671065928, 0.0627031476077269, 0.06485190525881106, 0.06708056972622585, 0.06937958330213576, 0.07173953795607059, 0.07415129672003405, 0.07660608232116087, 0.07909553754328057, 0.0816117622189149, 0.08414733165536291, 0.08669530088187712, 0.08924919852296717, 0.09180301346405344 ], [ 0.056195705760272205, 0.05449152690641809, 0.052914214773128576, 0.05146078465963295, 0.050126526735269905, 0.048905398509150017, 0.04779051178910338, 0.04677466819115099, 0.045850889336652684, 0.045012888556299736, 0.04425544042741518, 0.043574621121280445, 0.04296791314972415, 0.0424341887053458, 0.04197360244239545, 0.041587434084360504, 0.04127792190801577, 0.04104811998265536, 0.04090179698274193, 0.04084337599653882, 0.04087789745629418, 0.04101097538153247, 0.041248713557090526, 0.04159755400517111, 0.042064043794589064, 0.04265452455426906, 0.04337476760755758, 0.04422959199144556, 0.04522250943024239, 0.04635543819112543, 0.04762851752696077, 0.049040038925027445, 0.050586493471009616, 0.052262719987423684, 0.05406212873833613, 0.055976971311035496, 0.05799862821624866, 0.06011789029005605, 0.0623252163563469, 0.06461095627197677, 0.06696553436870152, 0.06937959288695375, 0.07184409814251007, 0.0743504140187783, 0.07689034820170662, 0.07945617666585765, 0.08204065154387685, 0.08463699687798458, 0.08723889601343778, 0.08984047365088743 ], [ 0.0544905878822936, 0.05267561091469747, 0.050984787513908114, 0.049415972417405196, 0.04796539197828912, 0.04662802356694727, 0.045398071176555234, 0.044269491372597614, 0.043236513963775425, 0.042294100838922245, 0.041438295165895214, 0.04066643035935041, 0.03997719083384341, 0.03937054030489653, 0.038847553654432196, 0.038410201012693365, 0.038061134932780266, 0.03780352259625378, 0.03764094662703749, 0.037577374464654874, 0.03761717315339248, 0.037765129823617585, 0.03802643252695162, 0.038406572997942805, 0.03891115053734707, 0.03954557990819748, 0.04031472978728887, 0.0412225360135964, 0.04227164149348041, 0.04346311085664338, 0.04479625454092539, 0.04626857797655902, 0.047875851914193523, 0.04961228401872751, 0.051470762189167754, 0.05344313713532225, 0.055520514354819264, 0.057693531766973755, 0.05995260677159511, 0.06228814376815076, 0.0646906992000324, 0.06715110558162828, 0.06966055874743243, 0.07221067399242677, 0.07479351719681494, 0.07740161678195319, 0.0800279617076036, 0.0826659899021715, 0.08530957065938186, 0.08795298372455755 ], [ 0.05319609993990889, 0.05126941203400468, 0.04946169109434989, 0.047771610544355914, 0.04619639134852876, 0.04473216954641383, 0.04337445665014995, 0.04211864824429929, 0.04096052504860292, 0.03989668808378069, 0.03892487689039029, 0.03804413645172827, 0.037254822042449585, 0.03655845759606695, 0.035957487412040676, 0.035454978081229736, 0.03505433321383758, 0.03475907563871479, 0.03457273091315136, 0.03449881649212751, 0.03454091004788774, 0.034702746675114686, 0.034988284981415464, 0.035401689241565046, 0.03594719669669492, 0.03662886922851192, 0.03745025849067687, 0.03841403522916372, 0.0395216419623127, 0.0407730224979664, 0.042166464954691965, 0.04369857261355661, 0.04536435517736551, 0.04715741660614093, 0.049070206928791334, 0.05109430412942203, 0.05322069650954457, 0.055440043329954586, 0.05774289975325182, 0.060119899534589266, 0.0625618947044026, 0.06506005543164245, 0.0676059355211615, 0.07019150994170616, 0.07280919079784776, 0.07545182760358662, 0.07811269686352405, 0.08078548501468852, 0.08346426785333025, 0.08614348873731649 ], [ 0.05231795708919162, 0.050281813390402115, 0.048357253938045235, 0.046543674737700214, 0.044839254331606175, 0.04324131436799174, 0.04174676616802504, 0.04035260063784227, 0.03905636710774183, 0.03785658243134005, 0.03675301684262308, 0.03574681786849243, 0.034840456449761116, 0.0340375071440727, 0.03334230238545611, 0.03275952386223384, 0.032293806468796336, 0.031949427239398524, 0.0317301312656957, 0.031639111709193396, 0.03167911998070139, 0.03185264690248713, 0.03216209746396252, 0.03260988653248849, 0.03319840858177505, 0.033929872216056506, 0.03480602789940465, 0.03582784408684816, 0.03699519680441544, 0.03830663040910292, 0.03975922749147717, 0.04134860096613374, 0.043068998467250874, 0.044913493100255, 0.046874227170690466, 0.04894267581472024, 0.05110990304804139, 0.05336679084970851, 0.05570423021656017, 0.058113270214074336, 0.06058522627095689, 0.06311175226739751, 0.0656848826365586, 0.06829705115114919, 0.07094109271677183, 0.07361023368822947, 0.07629807522259395, 0.07899857315722253, 0.08170601695634686, 0.08441500945949716 ], [ 0.05184750836140714, 0.04970727353226424, 0.0476695877272614, 0.04573443604373745, 0.04390084950039208, 0.04216726302789559, 0.04053195127744919, 0.03899350250636251, 0.037551278997508444, 0.03620580677189471, 0.03495903972043127, 0.033814454504478834, 0.03277695220199103, 0.03185256909581983, 0.031048029397636, 0.030370202688788688, 0.029825552077509157, 0.029419667656998865, 0.02915696682814189, 0.029040606574923668, 0.02907259994973493, 0.02925407572504391, 0.02958558514523907, 0.030067355576304137, 0.030699417764254236, 0.03148157956419363, 0.032413266964175576, 0.03349328778066393, 0.03471958669772023, 0.03608905292053832, 0.037597420320819475, 0.03923927366458277, 0.04100815132366222, 0.04289671956456335, 0.044896987268829985, 0.047000531257501706, 0.04919870847478394, 0.05148283929705852, 0.05384435402566159, 0.056274900953341894, 0.05876641880880007, 0.06131117895431141, 0.06390180378588768, 0.0665312677968103, 0.06919288711851078, 0.07188030237237115, 0.07458745858411216, 0.07730858487740712, 0.08003817575761192, 0.08277097505512909 ], [ 0.0517626902787844, 0.04952638642699944, 0.04738266410885814, 0.045331978390443166, 0.04337409188904639, 0.041508430015029206, 0.03973450592945285, 0.038052379566599105, 0.03646310397900941, 0.034969105614671536, 0.03357444449414305, 0.03228490649085606, 0.031107893401514358, 0.030052097438608733, 0.029126975217523946, 0.028342071087049083, 0.027706276292555565, 0.027227139213821732, 0.02691034871962955, 0.026759485430888606, 0.02677607408659269, 0.02695989177819628, 0.027309421414333093, 0.02782231369870816, 0.02849574186512778, 0.029326587682230253, 0.03031145959644863, 0.03144659151498517, 0.03272769209554501, 0.03414981026287301, 0.03570726178967333, 0.03739363523995279, 0.039201872361338895, 0.04112440299592095, 0.043153308612159, 0.04528048982386251, 0.04749781886086643, 0.049797265139929714, 0.05217098887753822, 0.05461140301253045, 0.057111207225368915, 0.05966339968459001, 0.06226127268269459, 0.06489839796472906, 0.0675686066833156, 0.07026596782900607, 0.07298476788780314, 0.07571949349065026, 0.07846481800282258, 0.08121559237151182 ], [ 0.052030694951833364, 0.049708287105660595, 0.04746832523233075, 0.04531167332435229, 0.04323874322459417, 0.041249841446596026, 0.03934557761814606, 0.037527304031964276, 0.035797546214103734, 0.03416037773775762, 0.03262168952720483, 0.031189304957023337, 0.02987289756102648, 0.02868367950129158, 0.02763384913338486, 0.026735818933273137, 0.02600129200683163, 0.025440309237695326, 0.02506043022254314, 0.024866212223807374, 0.02485909434333593, 0.02503768925663638, 0.025398373297749795, 0.025935996873572984, 0.026644537412869266, 0.02751757566914429, 0.028548558006782406, 0.029730876591046965, 0.031057836606258316, 0.0325225838133585, 0.03411804772347508, 0.03583692919032968, 0.03767173711868481, 0.039614862883883106, 0.04165867396644058, 0.0437956083742747, 0.04601825575486809, 0.04831941700071467, 0.05069213973227311, 0.053129731299401725, 0.05562575357665717, 0.05817400498619395, 0.06076849522076087, 0.06340341746055278, 0.06607312183528616, 0.06877209274311984, 0.07149493157493347, 0.07423634550098128, 0.07699114229340304, 0.07975423067992263 ], [ 0.052611747127372786, 0.05021435750083862, 0.04788979010669332, 0.045639333244324794, 0.04346403610106866, 0.04136503846335977, 0.03934395318168188, 0.03740327631012484, 0.03554679235507033, 0.03377993632728325, 0.03211007029812124, 0.03054662940026349, 0.029101090372214956, 0.02778671614352389, 0.026618037274648922, 0.02561005389559598, 0.024777189449985547, 0.024132101230951934, 0.023684533967604723, 0.023440450826902933, 0.023401646938800716, 0.023565932271835333, 0.023927806597007283, 0.024479416690762066, 0.025211544004455185, 0.02611442365755363, 0.027178299078544712, 0.02839371641693497, 0.02975162480249334, 0.031243366614833984, 0.0328606287168474, 0.03459539882198478, 0.036439944793255415, 0.03838681602586713, 0.04042885673188022, 0.04255921913129895, 0.04477136727756136, 0.04705906674381282, 0.04941635974805924, 0.051837528494166736, 0.05431705126316554, 0.056849556259431014, 0.05942977775546256, 0.06205251807879228, 0.06471261777868129, 0.06740493513734547, 0.0701243351935174, 0.07286568768879607, 0.0756238728375248, 0.07839379353272281 ], [ 0.053463154012459324, 0.051002375153862724, 0.0486058171708333, 0.046275274119748064, 0.04401249021022948, 0.04181946428094513, 0.039698796963910106, 0.03765406028010969, 0.03569016406084513, 0.033813689292035175, 0.03203315464692193, 0.03035917787352437, 0.02880448715300283, 0.027383729542645816, 0.026113018819031233, 0.025009174329832427, 0.024088641458281417, 0.02336616409212001, 0.02285338966857256, 0.02255768321577571, 0.022481442172400112, 0.0226220969825499, 0.02297278273438069, 0.02352346943503686, 0.0242622393061797, 0.025176430042914703, 0.026253480064428167, 0.027481442309435774, 0.028849223733999823, 0.030346643302783752, 0.03196439485820905, 0.03369397476009808, 0.03552760550576806, 0.0374581651880108, 0.03947912100384419, 0.04158446136897071, 0.04376862239005196, 0.046026407600002775, 0.04835290298509072, 0.05074339141865642, 0.05319327140506445, 0.055697984717419075, 0.05825295646257899, 0.060853549722186845, 0.0634950355170674, 0.06617257763335628, 0.06888123093705656, 0.0716159512136119, 0.07437161427233217, 0.0771430419959986 ], [ 0.0545428729906398, 0.05203027425772847, 0.04957462985516817, 0.04717835770050714, 0.04484399721963723, 0.04257448316184768, 0.04037345110986443, 0.038245558044311886, 0.036196797681309734, 0.03423478730766303, 0.03236899963331979, 0.030610908232295744, 0.02897400684256556, 0.02747365100376536, 0.026126659172504146, 0.024950610367204872, 0.02396280411954039, 0.023178922493127557, 0.022611550645443634, 0.022268832167611073, 0.02215358633854004, 0.022263136035827382, 0.022589895780254204, 0.02312253982914365, 0.023847425317710287, 0.0247499430176304, 0.025815578490096892, 0.027030610556563812, 0.028382484713784756, 0.0298599509197708, 0.03145305788983709, 0.0331530731110544, 0.03495236964533865, 0.036844298775999845, 0.03882305488687237, 0.040883534180865926, 0.043021188840559346, 0.04523188010601577, 0.04751173554446813, 0.049857016577743815, 0.05226400194255788, 0.05472889144952279, 0.05724773260581209, 0.0598163707843341, 0.0624304219623209, 0.06508526578646986, 0.0677760559060995, 0.07049774412306704, 0.0732451148621578, 0.07601282667426906 ], [ 0.05581213250798383, 0.05325897172601463, 0.05075696438334306, 0.04830927281141038, 0.04591933737754284, 0.0435911169310797, 0.04132934957647797, 0.039139819401985514, 0.037029612226947624, 0.035007341249454274, 0.03308332082212214, 0.03126966205763325, 0.02958025615357643, 0.028030600131043876, 0.02663740857817418, 0.025417953457418072, 0.02438909761956799, 0.023566051455790618, 0.022960985586531216, 0.02258174338811207, 0.022430953764694343, 0.022505790182912433, 0.022798454193282604, 0.023297250688019962, 0.02398797038869534, 0.024855266792165653, 0.025883798020130612, 0.027059033407373752, 0.028367734636224357, 0.02979818063647825, 0.03134021782247325, 0.03298520236755183, 0.03472587852142227, 0.03655621805489681, 0.03847123460469343, 0.040466782062143276, 0.04253934549613465, 0.04468583381286984, 0.04690338371660127, 0.04918918380812198, 0.0515403258317626, 0.05395368754370729, 0.05642584892762352, 0.05895304096580209, 0.061531124174114625, 0.06415559275408034, 0.06682159949977862, 0.06952399642884123, 0.07225738635075442, 0.07501618110069948 ], [ 0.05723697183778199, 0.05465406848374877, 0.05211797342663581, 0.04963268854526249, 0.04720263428495892, 0.044832855577986906, 0.04252923677430405, 0.040298712301816815, 0.038149457735853445, 0.0360910441516271, 0.0341345364062518, 0.032292512395522686, 0.030578974582666608, 0.029009117657489304, 0.02759891033487311, 0.0263644525754077, 0.02532109302378608, 0.024482344455659076, 0.023858714171194523, 0.023456646043835808, 0.023277807563052096, 0.023318910945026704, 0.023572131839431857, 0.02402603031220872, 0.024666757908449334, 0.025479300957292766, 0.02644856221826658, 0.027560177752341132, 0.028801054334683336, 0.030159666901094194, 0.03162617355411626, 0.0331924004746464, 0.03485173548442529, 0.03659895668960493, 0.03843001525153463, 0.04034178845771632, 0.0423318188257252, 0.04439805489993231, 0.04653860840263379, 0.04875154006593758, 0.05103468303935806, 0.053385508809194085, 0.055801036697811786, 0.05827778472215173, 0.060811757164489236, 0.06339846272452279, 0.06603295650378811, 0.06870989915087809, 0.07142362706252738, 0.0741682283920639 ], [ 0.05878881338790208, 0.05618651936244986, 0.05362803979821108, 0.05111826928080256, 0.048662641366507615, 0.04626729924655902, 0.04393926439738365, 0.04168659018753341, 0.039518485595351455, 0.037445392613935514, 0.0354789992620275, 0.03363216802335678, 0.03191875699957535, 0.030353309117875003, 0.028950586263793623, 0.027724935242601483, 0.026689496821904458, 0.025855310294640936, 0.025230417425403117, 0.024819112533266807, 0.024621494512453292, 0.02463343467423345, 0.02484698709784488, 0.025251166259044434, 0.025832940599451806, 0.026578267886720967, 0.027473028348399323, 0.028503770709529117, 0.02965824493403213, 0.030925734998882883, 0.032297222206526865, 0.03376541125002902, 0.03532464663336118, 0.03697074252925367, 0.03870074719714351, 0.04051266328516212, 0.042405146102586895, 0.044377201751619806, 0.046427905034234586, 0.04855615328001261, 0.05076046722803788, 0.0530388446502523, 0.05538866730989807, 0.05780665768525437, 0.06028887895817005, 0.06283077011141242, 0.06542720744920587, 0.06807258419409933, 0.07076090073075425, 0.07348585929605876 ], [ 0.06044430815440732, 0.057832517839774576, 0.055262740649303095, 0.05274076965551816, 0.050273032343840736, 0.04786672524501283, 0.04552993603807209, 0.043271739928725295, 0.041102255481131326, 0.03903264388635487, 0.03707503495213501, 0.03524236310352742, 0.03354809798032277, 0.032005858040820394, 0.030628903903736366, 0.02942952320390485, 0.028418341534766405, 0.027603622180917282, 0.026990643202695605, 0.026581252346053005, 0.02637368764234809, 0.026362711909728463, 0.026540051929234622, 0.026895076059570266, 0.02741560638661907, 0.028088753643824543, 0.02890168246393618, 0.0298422482004405, 0.03089947974908046, 0.03206390614277437, 0.03332773661656586, 0.03468490804635845, 0.036131015060266704, 0.037663139981053, 0.039279602955421364, 0.04097965628579546, 0.04276314959785665, 0.04463019283351835, 0.04658084168171508, 0.048614825258294816, 0.050731329482492676, 0.052928842751248255, 0.05520506418273031, 0.05755686960553628, 0.05998032697166061, 0.06247075099930623, 0.06502278639234717, 0.06763050958918719, 0.07028754028313197, 0.07298715558383868 ], [ 0.06218472192802006, 0.05957288111571902, 0.057002261275390084, 0.05447951526829224, 0.05201199718364237, 0.04960786025606572, 0.04727613256079128, 0.04502675712569287, 0.042870581820661786, 0.04081928388431454, 0.03888521462557721, 0.037081152288732176, 0.03541995612044023, 0.03391412327460108, 0.0325752630176215, 0.03141351941877572, 0.0304369920462794, 0.02965121941931639, 0.029058795787242225, 0.028659182950878215, 0.028448754377001707, 0.02842107385410075, 0.02856737486007978, 0.0288771795189148, 0.029338983815810345, 0.029940939317324788, 0.030671476484961595, 0.03151983356637825, 0.03247647156740979, 0.03353336684860381, 0.034684179008629606, 0.0359242955484987, 0.03725075897070137, 0.03866208768136155, 0.04015800892216301, 0.041739128491542724, 0.043406566537855615, 0.04516159002185298, 0.047005270190973746, 0.048938188063673234, 0.05096020356686703, 0.05307029592809833, 0.05526647542962331, 0.057545760587946755, 0.05990421069936314, 0.06233700154461373, 0.06483853161722969, 0.06740254709862387, 0.07002227546992149, 0.07269055969378466 ], [ 0.06399509765247799, 0.061392190682415866, 0.05883053371991183, 0.05631756401618907, 0.05386145671981442, 0.051471185898311726, 0.049156554861898655, 0.04692818258776065, 0.04479743233892765, 0.04277626905425262, 0.040877034369111276, 0.03911213294903949, 0.037493631889288496, 0.03603278657592423, 0.03473952099503237, 0.03362190584807327, 0.032685690074711074, 0.03193394561601433, 0.031366877563330425, 0.03098183173336705, 0.030773503394808395, 0.030734322037122414, 0.030854965515227498, 0.031124947138757103, 0.031533221195285684, 0.03206876228826241, 0.03272108660791774, 0.03348069444268428, 0.034339420599694255, 0.03529068310369279, 0.03632962250633032, 0.0374531267495658, 0.038659741417406676, 0.039949472612353515, 0.041323498510529466, 0.04278381402288687, 0.04433283902127563, 0.04597302294269246, 0.04770647681636818, 0.04953465833023325, 0.05145812761945376, 0.053476382507750476, 0.05558777340962238, 0.057789491122338096, 0.06007761592591088, 0.06244721389572506, 0.06489246585149479, 0.0674068154196597, 0.06998312470211236, 0.0726138284976433 ], [ 0.06586337286117573, 0.06327788345609216, 0.06073431365940972, 0.058240782811829026, 0.05580615545002995, 0.053440066126588505, 0.05115290664949476, 0.04895576320124124, 0.046860290851858104, 0.04487851458981916, 0.04302254983767209, 0.041304242154742814, 0.039734735815025284, 0.03832399379443477, 0.037080305772959996, 0.036009832925258264, 0.035116244343744815, 0.03440049603606942, 0.03386078804051869, 0.03349271073536325, 0.033289564090623676, 0.0332428110433606, 0.0333426140136495, 0.03357840316965758, 0.03393943352285499, 0.034415300203101774, 0.03499639250468883, 0.03567427462788129, 0.036441984022509914, 0.03729423838291208, 0.0382275420925536, 0.03924018453491216, 0.04033212741995894, 0.04150478601635499, 0.042760718638734166, 0.04410324795979248, 0.045536044704746974, 0.047062707559993595, 0.04868637205861535, 0.05040937609516645, 0.05223300165007459, 0.05415730280248256, 0.05618102077673233, 0.058301578917357134, 0.06051514493438621, 0.06281674475842845, 0.06520041167123086, 0.06765935550286892, 0.07018613896334268, 0.07277285098942306 ], [ 0.06777957196103004, 0.06521942390663593, 0.0627023392671748, 0.06023700017646459, 0.05783281458730749, 0.055499906642007275, 0.0532490644333905, 0.051091633806964146, 0.04903934774997381, 0.0471040836154712, 0.04529754554924275, 0.04363087745806724, 0.042114222604710004, 0.04075625844478641, 0.039563747412954056, 0.038541152673467124, 0.03769036869968892, 0.037010607435349605, 0.036498462010044745, 0.036148145361204226, 0.035951877043746784, 0.035900374416054905, 0.03598339800380569, 0.036190304823998036, 0.03651057409385489, 0.036934282060443684, 0.03745251254617677, 0.038057695217045585, 0.03874386480389434, 0.03950683338410086, 0.04034426678420112, 0.04125565725576847, 0.042242188879140226, 0.04330649952135453, 0.04445235242145797, 0.04568423977022688, 0.04700694805878139, 0.048425118941885656, 0.049942839081877174, 0.05156328797627594, 0.05328846501131763, 0.05511900737323669, 0.05705410063387681, 0.0590914752723924, 0.06122747610449472, 0.06345718798440629, 0.06577460009967417, 0.06817279218832113, 0.07064412838420475, 0.07318044745319048 ], [ 0.06973514161799241, 0.0672076307765603, 0.06472465306865924, 0.06229532607780056, 0.0599294511807622, 0.057637472256341936, 0.0554303887050511, 0.053319613063184536, 0.051316765199328124, 0.04943339869485784, 0.0476806609868442, 0.04606889734178313, 0.04460721926394958, 0.04330306913556037, 0.04216182233309282, 0.04118647269295834, 0.04037744419724678, 0.03973255987463292, 0.03924717958657155, 0.0389144957885873, 0.038725956211578, 0.03867176968089986, 0.03874144826448015, 0.038924344510010665, 0.03921015308490414, 0.03958935735028089, 0.04005360994763819, 0.040596040911207165, 0.041211487585667304, 0.04189663943835412, 0.0426500898359094, 0.04347228779375513, 0.044365386549687295, 0.04533299248990071, 0.04637982648915217, 0.04751131854639115, 0.04873316395419845, 0.05005087362356581, 0.051469351657869866, 0.05299252966672407, 0.05462308025923816, 0.05636222291210641, 0.05820962554445837, 0.060163396171540574, 0.062220152105337684, 0.0643751499181541, 0.06662245780890456, 0.068955152688402, 0.0713655265578683, 0.0738452898727446 ], [ 0.07172245715549826, 0.06923418735703406, 0.06679211814279717, 0.06440567467297449, 0.062084905982619426, 0.05984041567517833, 0.05768324572953713, 0.05562470562885761, 0.053676141410810875, 0.051848643494925864, 0.05015269852434579, 0.04859779884490287, 0.04719203287943791, 0.04594168897931393, 0.04485091205715602, 0.043921453878979125, 0.043152552399016296, 0.042540962671543996, 0.042081143644773, 0.041765585494438255, 0.041585245777155055, 0.04153005324559879, 0.041589436969559544, 0.04175284410631083, 0.0420102191240065, 0.0423524269945599, 0.04277161022255583, 0.04326147348569343, 0.043817490547161345, 0.044437027372825864, 0.045119374787112324, 0.04586568500855915, 0.04667880983983754, 0.04756304415739763, 0.04852378591309415, 0.049567131853853426, 0.05069943509390588, 0.05192685515696087, 0.05325493217464882, 0.054688214241557, 0.05622996085489349, 0.05788193690781706, 0.05964430225823538, 0.06151559293077625, 0.06349278274874094, 0.06557140937649739, 0.0677457465697556, 0.07000900459266111, 0.0723535426720673, 0.07477108031640307 ], [ 0.07373449890331055, 0.07129133238244995, 0.06889612452274471, 0.06655848560740023, 0.06428857694879458, 0.062097017809659545, 0.05999474592377214, 0.05799282587298053, 0.056102202477028656, 0.054333400956703935, 0.052696182008780006, 0.051199167746255984, 0.049849462792825754, 0.04865230212429059, 0.04761076152029372, 0.046725565777804595, 0.04599502298596607, 0.04541510051180968, 0.04497964201407796, 0.04468070823815941, 0.04450901123251416, 0.04445440458555801, 0.04450639199286061, 0.0446546216231567, 0.044889341794358335, 0.04520180164893196, 0.045584586816239725, 0.046031883639640205, 0.046539666745817956, 0.04710580462957519, 0.047730077875434145, 0.04841410581319081, 0.0491611804952863, 0.049976011954924335, 0.05086439522391616, 0.05183281657454639, 0.05288802268572496, 0.054036580729437185, 0.055284458812597484, 0.056636654354449985, 0.05809689298699745, 0.05966741317142297, 0.06134884308804077, 0.06314016780540145, 0.06503877745863397, 0.06704058199000534, 0.06914017526010943, 0.0713310308937778, 0.07360571361094734, 0.07595609237652898 ], [ 0.07576467863044405, 0.07337170819837266, 0.07102845920888476, 0.06874461444221118, 0.06653032670410944, 0.06439610652316569, 0.06235266533155196, 0.06041071040405501, 0.05858069104018064, 0.05687250015169417, 0.05529514147132791, 0.053856379547392745, 0.052562396567648634, 0.05141748544267569, 0.05042381083678486, 0.04958126756978142, 0.048887458449603245, 0.04833780182509144, 0.04792576498334887, 0.047643205813517386, 0.04748079472839326, 0.04742848351300004, 0.04747598787036724, 0.047613254815042465, 0.047830892702963056, 0.04812054847345037, 0.04847522207574083, 0.04888951140897542, 0.049359782630227875, 0.0498842611761667, 0.05046303931838882, 0.051097997434998654, 0.0517926389860029, 0.05255184351925029, 0.05338154753717463, 0.05428836898399841, 0.05527919651441501, 0.056360768598033725, 0.05753926909096299, 0.05881996470827551, 0.06020690586984601, 0.06170270617253708, 0.063308408172874, 0.06502343536517796, 0.06684562329499731, 0.06877131748314828, 0.0707955226828136, 0.07291208696453634, 0.07511390489846684, 0.07739312615919702 ], [ 0.07780678583992204, 0.07546833202541142, 0.07318130170423306, 0.07095535032722036, 0.06880051849309936, 0.06672710499902292, 0.06474549832928961, 0.06286596472280429, 0.061098394291148474, 0.05945201118469599, 0.05793505931320425, 0.05655448106684444, 0.055315611922680995, 0.05422191753610254, 0.053274800636336696, 0.05247350184047446, 0.05181511119736835, 0.05129469671231632, 0.05090554407288453, 0.05063949058422162, 0.05048732803355342, 0.05043924511332719, 0.05048528025397749, 0.050615759303264306, 0.050821697880836056, 0.051095153835468476, 0.05142951986582065, 0.05181974951523133, 0.052262511533494704, 0.05275626857349308, 0.05330127709919219, 0.053899506899962375, 0.054554481166384935, 0.05527104177926873, 0.056055049043672985, 0.0569130300197986, 0.05785179413415558, 0.05887803812079564, 0.059997963870369646, 0.061216932028289296, 0.06253917111242271, 0.06396755684340115, 0.0655034699757182, 0.0671467340819655, 0.06889562840170646, 0.07074696578657892, 0.07269622242395667, 0.07473770452722175, 0.07686473735859008, 0.07906986341023797 ], [ 0.07985501991427979, 0.07757465269857265, 0.07534730386343046, 0.0731825161858629, 0.07109013245571492, 0.06908015824949497, 0.06716258683772472, 0.06534718599770332, 0.06364324979505386, 0.062059322606230906, 0.060602907494523545, 0.059280175956098705, 0.058095700178359924, 0.0570522312955252, 0.05615054674492602, 0.055389386150343535, 0.054765488265949645, 0.05427373226809921, 0.05390737660086588, 0.05365837945983654, 0.05351777839756491, 0.05347610333735963, 0.053523797499678144, 0.053651623621093554, 0.05385103719370208, 0.054114513068373206, 0.05443581575467067, 0.054810206694556836, 0.055234583731559685, 0.05570754931982468, 0.05622940524278397, 0.05680207323120735, 0.057428943210364694, 0.05811465405011034, 0.0588648154672867, 0.05968568374216847, 0.06058380761494307, 0.06156566352746264, 0.06263730073360146, 0.063804016354217, 0.06507007809769683, 0.06643850830826492, 0.06791093773171575, 0.0694875315909205, 0.07116698499233677, 0.07294658000411612, 0.07482229341364471, 0.07678894237801671, 0.07884035485640035, 0.08096955259396947 ], [ 0.08190407502460421, 0.07968465702020332, 0.07751971550547943, 0.07541861029348401, 0.07339091867944623, 0.07144629192169372, 0.06959427798783074, 0.0678441116914348, 0.06620447647200041, 0.06468324585856729, 0.06328721678342905, 0.06202185083498113, 0.06089104253266702, 0.059896934979049105, 0.059039802127207816, 0.05831801308344495, 0.05772808757008066, 0.057264843710550524, 0.05692163092229859, 0.05669063330093956, 0.05656322360319148, 0.056530345400905874, 0.05658290114772759, 0.05671212618311431, 0.05690993220073925, 0.057169207523476054, 0.057484064971821784, 0.057850030844313075, 0.05826417054256944, 0.05872514791332064, 0.05923321680556878, 0.05979014500169647, 0.06039907281423056, 0.06106431131247449, 0.06179108823674412, 0.06258525288801922, 0.0634529542467489, 0.06440030882878306, 0.06543307591726558, 0.06655635752384123, 0.06777433862661653, 0.06909008002977794, 0.07050537193665975, 0.07202065153727451, 0.07363498316798403, 0.07534609545164266, 0.07715046668205736, 0.0790434477929842, 0.08101941156051141, 0.08307191706949817 ], [ 0.08394924865955823, 0.0817929948313533, 0.07969252331262049, 0.07765695538350567, 0.07569555197898305, 0.07381756735656257, 0.07203207333777527, 0.07034775631294114, 0.06877269207670739, 0.06731410687644447, 0.06597813647908345, 0.06476959810466189, 0.0636917921350558, 0.06274635097911398, 0.06193315090898041, 0.06125029894215721, 0.06069420122300248, 0.06025971257751468, 0.059940359990818065, 0.059728626753853514, 0.059616279792951844, 0.05959472066382559, 0.05965534080718746, 0.05978986347251175, 0.05999065754631827, 0.060251011689363115, 0.06056536016797166, 0.060929454276358125, 0.061340475251717284, 0.06179708622889367, 0.0622994223061197, 0.06284901943819343, 0.06344868480617064, 0.0641023135830125, 0.06481465953993336, 0.06559106951465278, 0.06643719409971445, 0.06735868867793106, 0.06836091982612309, 0.06944869190276295, 0.07062600723970958, 0.07189587084791405, 0.0732601471634833, 0.07471947247744563, 0.07627322275215313, 0.07791953296131106, 0.07965536124676377, 0.0814765892752654, 0.08337814926125098, 0.0853541681169304 ], [ 0.08598655016873336, 0.08389509842870752, 0.0818605781012678, 0.07989183006595983, 0.0779977631218762, 0.07618720775823275, 0.07446874477776048, 0.07285051175066772, 0.07133999285484183, 0.06994380048846945, 0.06866745981180841, 0.06751520966044401, 0.06648983458931752, 0.06559254270798069, 0.06482290216327882, 0.06417884559696098, 0.06365674696624606, 0.06325156938709493, 0.06295707695357254, 0.06276609861694803, 0.06267082880172299, 0.0626631477965204, 0.06273494503149944, 0.06287842979387415, 0.06308641623322146, 0.06335257215286635, 0.06367162366650601, 0.06403951008664056, 0.06445348534645733, 0.06491216391901448, 0.06541551073978963, 0.0659647762214133, 0.06656237918716602, 0.06721174247681841, 0.06791708803579925, 0.06868320034137232, 0.06951516883924515, 0.07041812142402076, 0.07139696167423079, 0.07245612238148277, 0.07359934682215326, 0.07482950725614643, 0.07614846746868625, 0.07755699306649001, 0.0790547100259631, 0.08064010899925048, 0.08231059039537995, 0.08406254345875189, 0.0858914515460878, 0.08779201552897324 ], [ 0.0880127917519096, 0.0859872787986507, 0.08401969321817604, 0.08211856583346779, 0.0802924305166193, 0.07854968040486433, 0.07689840306717631, 0.07534619814007845, 0.07389998320739731, 0.07256579606297306, 0.07134860368355019, 0.07025212989400378, 0.06927871445042548, 0.06842921577802792, 0.06770296770840875, 0.06709779731597139, 0.06661010666175457, 0.06623501643879065, 0.0659665648189835, 0.06579795084897766, 0.06572180899551884, 0.06573050011598007, 0.06581640417744855, 0.06597220120417212, 0.06619112881685722, 0.0664672069467051, 0.06679542254580806, 0.06717186917936399, 0.06759383820724969, 0.06805985987717056, 0.06856969415070456, 0.06912427257019917, 0.06972559402372065, 0.07037657889878196, 0.07108088779087411, 0.0718427125471305, 0.07266654883132831, 0.07355696042606678, 0.07451834598301363, 0.07555471877386757, 0.07666950913095051, 0.07786539772805276, 0.07914418575714896, 0.0805067055964206, 0.08195277297802686, 0.08348117919845453, 0.08508971979045493, 0.08677525445486199, 0.08853379201757153, 0.09036059373730913 ], [ 0.09002565011086038, 0.08806678749617503, 0.08616670372084646, 0.08433360034857224, 0.08257562426009146, 0.0809007281120015, 0.07931651356072814, 0.0778300611005927, 0.07644775229910034, 0.07517509214674313, 0.07401654092355404, 0.07297536612792856, 0.07205352532644323, 0.0712515900447516, 0.07056871893989242, 0.0700026855645014, 0.06954996233544138, 0.0692058582884751, 0.06896470434355248, 0.06882007659609315, 0.06876504593314488, 0.06879244120466914, 0.0688951132166464, 0.06906618775300619, 0.06929929738890067, 0.06958878372927775, 0.06992986364608254, 0.07031875493294437, 0.07075275847787602, 0.07123029557745762, 0.07175090043036368, 0.07231516921661259, 0.07292466853854843, 0.07358180738242985, 0.0742896781246201, 0.0750518733813457, 0.07587228658273953, 0.07675490492332769, 0.07770360369203158, 0.07872195083267679, 0.07981302989479622, 0.08097928832631326, 0.08222241641763053, 0.08354326026725648, 0.08494177007456058, 0.08641698305896144, 0.0879670385255849, 0.08958922117637916, 0.09128002778207206, 0.09303525180664608 ], [ 0.09202369207181638, 0.09013183842386302, 0.08829948171868925, 0.08653448365591945, 0.08484460055595418, 0.08323734936780845, 0.08171985991382529, 0.0802987173791442, 0.07897980068076021, 0.07776812390112245, 0.0766676892317781, 0.07568136061011423, 0.07481076723196628, 0.0740562452379301, 0.0734168240684112, 0.07289026137166443, 0.07247312718186831, 0.07216093471823916, 0.07194831198967648, 0.07182920578416795, 0.07179710783510716, 0.07184529209949587, 0.07196705211928517, 0.0721559282128374, 0.0724059155387021, 0.07271164565825285, 0.073068535901691, 0.07347290247847976, 0.07392203480000932, 0.07441422988629474, 0.07494878703248958, 0.07552596414995263, 0.07614689839802488, 0.07681349489193964, 0.07752828838669343, 0.0782942838455355, 0.07911478263380298, 0.0799932016537753, 0.08093289297868203, 0.0819369713983182, 0.08300815673131805, 0.08414863680695141, 0.08535995573185508, 0.08664293053186539, 0.08799759761994519, 0.08942318892250112, 0.09091813602530058, 0.09248009948054241, 0.09410601951751199, 0.09579218385016972 ], [ 0.0940063616905677, 0.09218158810749415, 0.09041690767348394, 0.08871983840209666, 0.0870977489057699, 0.0855577308366561, 0.08410646066680325, 0.08275005484059629, 0.08149392367624933, 0.0803426306085673, 0.0792997642752403, 0.07836783137104009, 0.07754817797285335, 0.07684094608198502, 0.07624507044229711, 0.07575831838892269, 0.07537737278196747, 0.07509795527456362, 0.07491498456728359, 0.07482276218760706, 0.07481517689549252, 0.0748859181345493, 0.07502868899180876, 0.07523740977877363, 0.07550640443337338, 0.07583056328816125, 0.07620547719927175, 0.0766275394710069, 0.07709401337807598, 0.07760306435877445, 0.07815375713277098, 0.07874601910352719, 0.07938057245193879, 0.08005883831565119, 0.08078281736075917, 0.08155495185410827, 0.08237797498658536, 0.08325475362624528, 0.08418813084445838, 0.08518077442182205, 0.08623503708908646, 0.08735283350548054, 0.08853553796581352, 0.08978390562852875, 0.09109801875862059, 0.09247725818003702, 0.09392029892676103, 0.09542512805072861, 0.09698908174596471, 0.09860889841215541 ], [ 0.09597392964809315, 0.09421607635066287, 0.0925188006773034, 0.09088927824129737, 0.0893344973899956, 0.08786113861469713, 0.08647544603103538, 0.08518309488754859, 0.0839890601498338, 0.08289749213723642, 0.08191160581446404, 0.08103359052209565, 0.08026454655861831, 0.07960445405084354, 0.07905217799619228, 0.07860551134225323, 0.07826125567482976, 0.07801533675204671, 0.07786294999390657, 0.07779872932494719, 0.07781693161538056, 0.077911628430714, 0.07807689685459901, 0.07830700170187668, 0.07859656235752824, 0.078940698623176, 0.0793351512019707, 0.07977637371179087, 0.080261594327135, 0.08078884628459262, 0.08135696753981315, 0.08196557084074724, 0.08261498638821158, 0.08330618008907421, 0.08404065115685175, 0.0848203134550958, 0.08564736547788708, 0.08652415418285, 0.08745303800224592, 0.08843625423361245, 0.08947579564516477, 0.09057330053426658, 0.09172995968160087, 0.09294644269971533, 0.0942228452468463, 0.09555865753666967, 0.09695275359242785, 0.09840339983147324, 0.09990828087066202, 0.10146453994247827 ], [ 0.0979274082149035, 0.09623613151514449, 0.09460581293542537, 0.09304329061258784, 0.09155518312096561, 0.09014777611229711, 0.08882690340040304, 0.08759782630137353, 0.08646511590609933, 0.085432543651359, 0.0845029859534654, 0.08367834867033622, 0.08295951669048648, 0.08234633298773134, 0.08183761006869908, 0.08143117498238828, 0.08112394711718118, 0.08091204607229188, 0.08079092514920523, 0.0807555246253266, 0.08080043805325665, 0.08092008441520508, 0.0811088790296155, 0.08136139658285899, 0.08167252044051757, 0.08203757337062616, 0.08245242588601553, 0.08291357950711117, 0.08341822330826072, 0.08396426311139073, 0.0845503236193103, 0.08517572463553623, 0.08584043329851049, 0.08654499496253697, 0.08729044597611604, 0.08807821212415581, 0.08890999689187809, 0.0897876639515812, 0.09071311834738403, 0.0916881907435045, 0.09271452880481097, 0.09379349930416243, 0.0949261039232731, 0.09611291096931418, 0.09735400441498011, 0.09864895083748272, 0.09999678403406095, 0.10139600637531891, 0.10284460536035156, 0.10434008338411768 ], [ 0.09986843683466226, 0.09824324628775763, 0.09667929509884016, 0.09518309126058398, 0.09376089587844773, 0.09241861709323482, 0.09116170049019734, 0.089995019610007, 0.08892277084950648, 0.08794837753047852, 0.08707440813304139, 0.08630251356088593, 0.08563338778217604, 0.08506675526923624, 0.08460138738921377, 0.08423514837336436, 0.08396506984932567, 0.0837874513129807, 0.08369798249401549, 0.08369188245473282, 0.08376404953394202, 0.08390921593444346, 0.08412210083274965, 0.08439755630467774, 0.08473070102937427, 0.08511703757032874, 0.08555254995515549, 0.08603377922222602, 0.08655787552639757, 0.08712262627063776, 0.08772646054141324, 0.08836843086774024, 0.08904817399416334, 0.08976585295291219, 0.09052208323298247, 0.09131784626256607, 0.0921543937318934, 0.09303314647084601, 0.09395559164649393, 0.09492318195158797, 0.09593724021519279, 0.09699887248939958, 0.09810889216950133, 0.09926775711630742, 0.10047552110258899, 0.10173180023925026, 0.10303575438957724, 0.1043860829875096, 0.1057810341679261, 0.1072184257144457 ], [ 0.10179914458345043, 0.10023943082229785, 0.09874113991279027, 0.09731045846499639, 0.09595330328949295, 0.0946752225045767, 0.09348129486878759, 0.09237603072834445, 0.09136327847659496, 0.09044614075006153, 0.0896269046646572, 0.08890699017310943, 0.0882869200745252, 0.08776631433917505, 0.08734391027564005, 0.08701760874969514, 0.08678454527776551, 0.0866411834863028, 0.08658342726887298, 0.08660674707826027, 0.08670631521938134, 0.08687714477827195, 0.08711422691387781, 0.08741266160510913, 0.0877677775212515, 0.08817523739985879, 0.08863112610838536, 0.08913201938107418, 0.08967503202219088, 0.09025784512534432, 0.09087871256190379, 0.09153644763199734, 0.09223039134515593, 0.0929603643004699, 0.09372660456272476, 0.09452969427378474, 0.09537047798817219, 0.09624997586888358, 0.09716929491587065, 0.09812954132093883, 0.09913173684976102, 0.10017674185139633, 0.10126518710207306, 0.10239741622318832, 0.10357343989873995, 0.10479290258298307, 0.10605506186395748, 0.10735878015980287, 0.10870252799567084, 0.11008439775692092 ], [ 0.1037219965105879, 0.10222705071893277, 0.10079361202757048, 0.09942755511778874, 0.09813446587588823, 0.09691954948416356, 0.09578753820379705, 0.0947426019971493, 0.09378826550526076, 0.09292733509224367, 0.09216183964081315, 0.09149298849718278, 0.09092114940772453, 0.090445848482422, 0.09006579321046439, 0.0897789184174193, 0.08958245388539568, 0.08947301125668886, 0.08944668689854068, 0.08949917669219704, 0.0896258982653699, 0.08982211602436684, 0.09008306444299256, 0.09040406539063067, 0.09078063577973729, 0.09120858242758025, 0.09168408170632604, 0.0922037422559806, 0.09276464972328992, 0.09336439314409185, 0.09400107319287306, 0.09467329307356129, 0.09538013331511669, 0.09612111216063485, 0.09689613359528483, 0.09770542534132955, 0.09854946935184217, 0.09942892745263048, 0.10034456480980286, 0.10129717383619877, 0.10228750099528025, 0.10331617872201074, 0.10438366436755389, 0.1054901877034637, 0.1066357081101859, 0.10781988214515806, 0.10904204175929937, 0.1103011830278972, 0.11159596490094996, 0.11292471717314141 ], [ 0.10563963123879633, 0.10420865751482665, 0.10283917185847759, 0.10153674665181288, 0.10030664998360728, 0.09915376045778639, 0.09808248291825908, 0.09709666798927977, 0.09619953858287872, 0.0953936266158304, 0.09468072307153116, 0.09406184421558457, 0.09353721622712306, 0.0931062797642546, 0.09276771508849073, 0.09251948739602825, 0.0923589110212179, 0.09228273026881849, 0.09228721386720577, 0.09236825946731016, 0.09252150427161858, 0.09274243776953107, 0.09302651266346111, 0.09336925036156897, 0.09376633784570647, 0.09421371325191034, 0.0947076380833999, 0.09524475457668324, 0.09582212733249743, 0.09643726888535975, 0.09708814940592214, 0.09777319120138814, 0.09849124909629291, 0.09924157813567713, 0.10002379035185698, 0.10083780257126898, 0.1016837774054789, 0.10256205966698095, 0.1034731104734092, 0.10441744125267538, 0.10539554973831321, 0.10640785985404519, 0.10745466713777682, 0.1085360910592981, 0.10965203525710417, 0.11080215637366396, 0.11198584182153465, 0.11320219648079749, 0.11445003802549877, 0.11572790031467844 ], [ 0.10755469724260482, 0.1061868192620983, 0.1048803011416582, 0.10364042244331953, 0.10247214609193543, 0.10138003959740557, 0.10036819820346937, 0.09944017261490298, 0.09859890411201655, 0.09784666986981343, 0.09718504113414202, 0.0966148565575535, 0.09613621247005938, 0.09574847118035058, 0.09545028761513624, 0.09523965376544408, 0.09511395958330926, 0.09507006822353498, 0.09510440290742471, 0.09521304223790779, 0.09539182053886003, 0.09563642972732204, 0.09594251934045275, 0.09630579160190535, 0.09672208879016261, 0.09718747062754793, 0.09769827990877882, 0.09825119510268167, 0.09884326916706679, 0.09947195429817374, 0.10013511278141955, 0.10083101451242595, 0.1015583221121301, 0.10231606486432529, 0.1031036029557915, 0.10392058369604412, 0.10476689153334148, 0.10564259376410041, 0.10654788385309279, 0.10748302424203443, 0.10844829042649153, 0.10944391792970923, 0.1104700536036374, 0.11152671245094238, 0.11261374089776952, 0.11373078716744037, 0.11487727912256057, 0.11605240966928584, 0.11725512956391569, 0.11848414723779306 ], [ 0.10946969495794195, 0.1081639583881808, 0.10691933733825584, 0.10574082770868806, 0.10463309929991008, 0.10360042312708176, 0.10264660148231645, 0.10177490315503392, 0.10098800630077545, 0.10028795139376655, 0.09967610649298274, 0.09915314669218926, 0.09871904912284031, 0.09837310426156806, 0.09811394360122946, 0.09793958302536292, 0.09784748053334626, 0.09783460634769478, 0.09789752293755835, 0.09803247214233288, 0.09823546639018925, 0.09850238097688009, 0.09882904448633244, 0.09921132467266526, 0.09964520745477246, 0.10012686706939315, 0.10065272585864303, 0.1012195026092166, 0.10182424879390321, 0.10246437247770548, 0.10313765003119421, 0.10384222613664901, 0.1045766028741876, 0.10533961893308556, 0.10613042020598835, 0.1069484231893062, 0.10779327273038103, 0.10866479573016008, 0.10956295242869656, 0.11048778687059656, 0.11143937807047097, 0.11241779327818387, 0.11342304458538388, 0.11445504992533319, 0.11551359930553395, 0.11659832688618876, 0.11770868928665786, 0.11884395027615882, 0.12000317179271898, 0.12118521104332727 ], [ 0.11138683131497823, 0.11014220338109128, 0.10895832330111939, 0.10783991210137525, 0.10679135790948423, 0.10581664903607885, 0.1049193104575697, 0.1041023458791588, 0.10336818757502944, 0.10271865609987998, 0.1021549317339548, 0.10167753916478789, 0.10128634643749822, 0.10098057864797536, 0.10075884624570516, 0.10061918719725947, 0.10055912168097818, 0.10057571747777208, 0.10066566382407992, 0.10082535122166364, 0.10105095456362996, 0.10133851693361665, 0.10168403155223106, 0.10208351956142887, 0.10253310162957636, 0.10302906170277645, 0.10356790159863619, 0.10414638551732519, 0.10476157391580883, 0.105410846542982, 0.10609191475798421, 0.10680282354608855, 0.10754194390296216, 0.10830795647680007, 0.10909982753758835, 0.10991677848255836, 0.11075825018614165, 0.11162386356102563, 0.11251337771440295, 0.11342664706110016, 0.11436357869479473, 0.11532409122294524, 0.11630807614454361, 0.11731536269764482, 0.118345686932097, 0.11939866557899954, 0.12047377509946712, 0.12157033610857859, 0.12268750319280779, 0.12382425997679264 ], [ 0.11330789244482338, 0.11212325993077665, 0.11099887764682291, 0.10993920019565817, 0.10894834497190815, 0.1080300306883007, 0.10718751980889342, 0.10642356684880054, 0.10574037446920463, 0.10513955915909046, 0.10462212804781125, 0.10418846804147906, 0.10383834803737163, 0.10357093446925661, 0.10338481990474685, 0.10327806388917198, 0.10324824474429971, 0.10329252061587456, 0.10340769774540125, 0.10359030373358133, 0.10383666347013035, 0.10414297542267487, 0.10450538609391499, 0.10492006065371698, 0.10538324801115473, 0.10589133889029119, 0.10644091579376892, 0.10702879406385261, 0.10765205356858507, 0.10830806084157131, 0.10899448178090948, 0.10970928526164753, 0.11045073823413681, 0.11121739306626745, 0.11200806803987251, 0.11282182203003613, 0.11365792448040334, 0.11451582183783263, 0.11539510162630026, 0.11629545532376442, 0.11721664115842162, 0.11815844786483057, 0.11912066033909902, 0.1201030280098625, 0.12110523660296989, 0.12212688382807645, 0.12316745936036426, 0.12422632933612034, 0.12530272543227422, 0.12639573846212646 ], [ 0.11523413921633133, 0.11410830601325395, 0.11304209009379099, 0.11203968783871547, 0.11110495645166066, 0.11024135761466441, 0.10945190542636667, 0.10873912037579725, 0.10810499103711455, 0.10755094500960866, 0.10707783037344612, 0.10668590859379445, 0.10637485940078902, 0.10614379772384973, 0.10599130229431249, 0.10591545508025207, 0.10591389031052831, 0.10598385150601677, 0.10612225468269175, 0.10632575573386044, 0.10659081993938724, 0.1069137915827853, 0.10729096177132764, 0.10771863273465485, 0.10819317710669096, 0.10871109095700576, 0.1092690396154001, 0.10986389561417435, 0.1104927683456319, 0.11115302529000456, 0.11184230490567366, 0.11255852148575127, 0.1132998624706189, 0.1140647788637456, 0.11485196952738734, 0.11566036023538832, 0.11648907843225872, 0.11733742469121455, 0.11820484187948581, 0.11909088302785134, 0.11999517886448781, 0.12091740591283098, 0.12185725597193571, 0.12281440769898035, 0.12378850090095571, 0.12477911402035109, 0.12578574517228053, 0.12680779696243863, 0.12784456519082796, 0.1288952314293104 ], [ 0.1171662289603499, 0.11609791407328042, 0.11508844467863884, 0.11414176700203674, 0.11326148832644127, 0.11245082547079895, 0.11171255781205393, 0.11104898641103567, 0.11046190070797145, 0.10995255407753685, 0.10952164927992507, 0.1091693345236822, 0.10889521048458436, 0.1086983482241996, 0.10857731754664432, 0.10853022494761373, 0.10855475996942641, 0.10864824849869112, 0.10880771134268172, 0.10902992630325412, 0.10931149193323218, 0.10964889120380399, 0.11003855342224779, 0.11047691290404342, 0.11096046310759355, 0.11148580516913674, 0.11204969001694585, 0.11264905348662026, 0.11328104409442359, 0.1139430433467585, 0.11463267866649149, 0.11534782919808864, 0.116086624911701, 0.11684743956058471, 0.11762887815621959, 0.11842975971114256, 0.11924909606104839, 0.12008606761548868, 0.12093999690110369, 0.12181032075365562, 0.12269656198642687, 0.1235983013144877, 0.12451515024903424, 0.1254467255960534, 0.12639262610193744, 0.12735241168865388, 0.12832558561613522, 0.12931157980325872, 0.1303097434344985, 0.13131933488029499 ], [ 0.11910416530599596, 0.11809200201250097, 0.11713777231344881, 0.11624518032929235, 0.11541759353987327, 0.11465799578869074, 0.11396894499065173, 0.113352536925749, 0.11281037638748966, 0.11234355677148175, 0.11195264894186018, 0.11163769991216965, 0.11139824153890213, 0.11123330906956203, 0.11114146903432584, 0.11112085564215278, 0.11116921455748516, 0.11128395270737226, 0.11146219261073335, 0.11170082963571212, 0.1119965905764307, 0.11234609199093644, 0.11274589684838983, 0.11319256818393203, 0.11368271864185617, 0.11421305498964558, 0.11478041689625051, 0.11538180947856938, 0.11601442932323491, 0.11667568388117461, 0.11736320430635712, 0.1180748519653505, 0.11880871897949999, 0.11956312327606884, 0.12033659871846226, 0.12112788095874277, 0.12193588970839547, 0.12275970815612762, 0.12359856027503074, 0.12445178675648569, 0.12531882028586616, 0.12619916083674979, 0.1270923516077099, 0.1279979561608916, 0.12891553724679664, 0.12984463771762442, 0.13078476384487175, 0.1317353712684806, 0.13269585371736506, 0.1336655345572375 ], [ 0.12104727657565617, 0.12008981321056172, 0.11918923268077657, 0.11834900514091191, 0.11757226833097338, 0.11686178481712314, 0.11621990400853555, 0.11564853016928642, 0.11514909751853968, 0.11472255332709692, 0.11436934968026798, 0.11408944429723206, 0.113882310490476, 0.11374695603296847, 0.11368195039389536, 0.11368545952358762, 0.11375528713002575, 0.11388892120451002, 0.11408358442986673, 0.11433628704322123, 0.1146438807248331, 0.11500311213891876, 0.11541067485321072, 0.1158632585011558, 0.11635759421344512, 0.1168904955238657, 0.11745889413908633, 0.11805987014536469, 0.11869067640127186, 0.11934875702999623, 0.12003176007462922, 0.12073754451318446, 0.12146418194600442, 0.1222099533662309, 0.12297334150420908, 0.12375301929923647, 0.12454783509738346, 0.12535679520267784, 0.1261790444213754, 0.1270138452360804, 0.12786055622910084, 0.12871861034372933, 0.12958749352958407, 0.1304667242653197, 0.13135583439080334, 0.13225435161330745, 0.13316178398053855, 0.13407760653964965, 0.13500125032795296, 0.13593209376993481 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8741266010329127, 0.3721313694052165, 0.33682468553056094, 0.35811400962893175, 0.387256195869685, 0.4364826228680067, 0.4731251544112025, 0.5009919141937402, 0.5609014332658717, 0.633832506832756, 0.46710878231044195, 0.41764991730451584, 0.42976391479893244, 0.4645589116774908, 0.38068209813728127, 0.541827007567024, 0.3369416110217571, 0.33543329034000635, 0.11716809216886759, 0.6241536419838667, 0.26098429510401766, 0.13530073932340517, 0.3243612123105706, 0.41049855594107504 ], "xaxis": "x", "y": [ 0.47107124608010054, 0.26653510100196826, 0.306621720110712, 0.30467570819368706, 0.30940794014465045, 0.31278273165168097, 0.29669844001206613, 0.3471541026270753, 0.38430038634234137, 0.41280635414384353, 0.34808800281167385, 0.7094814367592335, 0.2971371268745914, 0.2266912187465196, 0.32915040582114197, 0.30634757217791686, 0.20878548454493284, 0.5392074631527066, 0.9321128027513623, 0.06684787943959236, 0.1926839965403504, 0.16063392226369352, 0.20362226848515758, 0.21203364561032936 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8741266010329127, 0.3721313694052165, 0.33682468553056094, 0.35811400962893175, 0.387256195869685, 0.4364826228680067, 0.4731251544112025, 0.5009919141937402, 0.5609014332658717, 0.633832506832756, 0.46710878231044195, 0.41764991730451584, 0.42976391479893244, 0.4645589116774908, 0.38068209813728127, 0.541827007567024, 0.3369416110217571, 0.33543329034000635, 0.11716809216886759, 0.6241536419838667, 0.26098429510401766, 0.13530073932340517, 0.3243612123105706, 0.41049855594107504 ], "xaxis": "x2", "y": [ 0.47107124608010054, 0.26653510100196826, 0.306621720110712, 0.30467570819368706, 0.30940794014465045, 0.31278273165168097, 0.29669844001206613, 0.3471541026270753, 0.38430038634234137, 0.41280635414384353, 0.34808800281167385, 0.7094814367592335, 0.2971371268745914, 0.2266912187465196, 0.32915040582114197, 0.30634757217791686, 0.20878548454493284, 0.5392074631527066, 0.9321128027513623, 0.06684787943959236, 0.1926839965403504, 0.16063392226369352, 0.20362226848515758, 0.21203364561032936 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.043363111853442673, -0.09933654975328225, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3938034163351052, -0.3938034163351052, -0.4937007214762411, -0.5259906274387349, -0.6761570695904271, -0.748038461065303, -1.012113342200196, -1.280377358046712, -1.561142914814164, -1.561142914814164, -1.8230961681851308, -1.8762412173596577, -1.8762412173596577, -2.0745337734960585, -2.2213739013133735, -2.2213739013133735, -2.2213739013133735, -2.3825849354627398, -2.4265158688429276 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.8576300200074911
x2: 0.304885390214622
x3: 0.8741266010329127
x4: 0.47107124608010054
x5: 0.5499769495800138
x6: 0.2717741122469306", "
Parameterization:
x1: 0.3945768438279629
x2: 0.9470284963026643
x3: 0.41764991730451584
x4: 0.7094814367592335
x5: 0.7316634766757488
x6: 0.526240604929626", "
Parameterization:
x1: 0.6178188910707831
x2: 0.6060437019914389
x3: 0.3369416110217571
x4: 0.20878548454493284
x5: 0.313774642534554
x6: 0.21360431145876646", "
Parameterization:
x1: 0.922042103484273
x2: 0.2518757041543722
x3: 0.33543329034000635
x4: 0.5392074631527066
x5: 0.4243688927963376
x6: 0.22053202707320452", "
Parameterization:
x1: 0.17101835366338491
x2: 0.3430425301194191
x3: 0.11716809216886759
x4: 0.9321128027513623
x5: 0.7526830276474357
x6: 0.06084885261952877", "
Parameterization:
x1: 0.8570100227370858
x2: 0.6166029404848814
x3: 0.6241536419838667
x4: 0.06684787943959236
x5: 0.07497220952063799
x6: 0.14403533469885588", "
Parameterization:
x1: 0.534548249474776
x2: 0.6454295322236044
x3: 0.26098429510401766
x4: 0.1926839965403504
x5: 0.3583006085267396
x6: 0.23621860613587223", "
Parameterization:
x1: 0.4907798030673444
x2: 0.6693129221747312
x3: 0.13530073932340517
x4: 0.16063392226369352
x5: 0.3720868180562604
x6: 0.24128125026380445", "
Parameterization:
x1: 0.45258776486883523
x2: 0.6689585957918127
x3: 0.3243612123105706
x4: 0.20362226848515758
x5: 0.40386956534943985
x6: 0.2617217823030513", "
Parameterization:
x1: 0.36587979703010326
x2: 0.6905993536267468
x3: 0.41049855594107504
x4: 0.21203364561032936
x5: 0.45085914082795997
x6: 0.28084253479207894", "
Parameterization:
x1: 0.3430464207514382
x2: 0.6994141614918489
x3: 0.3721313694052165
x4: 0.26653510100196826
x5: 0.3842839781870137
x6: 0.34210580512277344", "
Parameterization:
x1: 0.3069293367529619
x2: 0.71433956849282
x3: 0.33682468553056094
x4: 0.306621720110712
x5: 0.330724489385283
x6: 0.400242348414582", "
Parameterization:
x1: 0.23123711043432674
x2: 0.6450489400789448
x3: 0.35811400962893175
x4: 0.30467570819368706
x5: 0.2828683189136606
x6: 0.4552321428434623", "
Parameterization:
x1: 0.1731832736889785
x2: 0.593244386847273
x3: 0.387256195869685
x4: 0.30940794014465045
x5: 0.24931831574849236
x6: 0.5042444579129665", "
Parameterization:
x1: 0.10276676402166102
x2: 0.5245964292924129
x3: 0.4364826228680067
x4: 0.31278273165168097
x5: 0.20976144752261927
x6: 0.5718283260209248", "
Parameterization:
x1: 0.02272360489126676
x2: 0.45478208555364374
x3: 0.4731251544112025
x4: 0.29669844001206613
x5: 0.1629764468036589
x6: 0.6231264396369091", "
Parameterization:
x1: 0.12822914338105254
x2: 0.50113973879535
x3: 0.5009919141937402
x4: 0.3471541026270753
x5: 0.22569745035994693
x6: 0.6485131908512514", "
Parameterization:
x1: 0.18264122633125843
x2: 0.48679646734164944
x3: 0.5609014332658717
x4: 0.38430038634234137
x5: 0.25571875389806736
x6: 0.7251335170386098", "
Parameterization:
x1: 0.11021739438818898
x2: 0.5219753765590699
x3: 0.633832506832756
x4: 0.41280635414384353
x5: 0.24080799824877394
x6: 0.6868038086067043", "
Parameterization:
x1: 0.23200152971928015
x2: 0.45670970601271255
x3: 0.46710878231044195
x4: 0.34808800281167385
x5: 0.25294791533195954
x6: 0.7413137132027012", "
Parameterization:
x1: 0.21771886090087916
x2: 0.44325772469776215
x3: 0.42976391479893244
x4: 0.2971371268745914
x5: 0.3330905751647994
x6: 0.7643004814304811", "
Parameterization:
x1: 0.24268461401296557
x2: 0.4888982273631153
x3: 0.4645589116774908
x4: 0.2266912187465196
x5: 0.3359046338083378
x6: 0.795155864980252", "
Parameterization:
x1: 0.18007999032786176
x2: 0.4020272304249925
x3: 0.38068209813728127
x4: 0.32915040582114197
x5: 0.39271389983801674
x6: 0.7729942910219593", "
Parameterization:
x1: 0.2323591563636618
x2: 0.4199047081311001
x3: 0.541827007567024
x4: 0.30634757217791686
x5: 0.3288907817254116
x6: 0.7528167675616309", "
Parameterization:
x1: 0.2645811273977003
x2: 0.37002524627776356
x3: 0.6217047124569431
x4: 0.303332856959984
x5: 0.3398589157263807
x6: 0.7660006302413" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.043363111853442673, -0.09933654975328225, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3938034163351052, -0.3938034163351052, -0.4937007214762411, -0.5259906274387349, -0.6761570695904271, -0.748038461065303, -1.012113342200196, -1.280377358046712, -1.561142914814164, -1.561142914814164, -1.8230961681851308, -1.8762412173596577, -1.8762412173596577, -2.0745337734960585, -2.2213739013133735, -2.2213739013133735, -2.2213739013133735, -2.3825849354627398, -2.4265158688429276 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.043363111853442673, -0.09933654975328225, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3071238910075492, -0.3938034163351052, -0.3938034163351052, -0.4937007214762411, -0.5259906274387349, -0.6761570695904271, -0.748038461065303, -1.012113342200196, -1.280377358046712, -1.561142914814164, -1.561142914814164, -1.8230961681851308, -1.8762412173596577, -1.8762412173596577, -2.0745337734960585, -2.2213739013133735, -2.2213739013133735, -2.2213739013133735, -2.3825849354627398, -2.4265158688429276 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 6, 6 ], "y": [ -3.32237, -0.043363111853442673 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:51] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:52] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:52] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.23, 'x2': 0.41, 'x3': 0.67, 'x4': 0.31, 'x5': 0.34, 'x6': 0.81}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 02-24 16:27:57] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.10" } }, "nbformat": 4, "nbformat_minor": 2 }