{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.84, 'x2': 0.56, 'x3': 0.15, 'x4': 0.07, 'x5': 0.79, 'x6': 0.29}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.0, 0.0), 'l2norm': (1.32, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.53, 'x2': 0.26, 'x3': 0.27, 'x4': 0.25, 'x5': 0.62, 'x6': 0.37}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.24, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.19, 'x2': 0.96, 'x3': 0.93, 'x4': 0.88, 'x5': 0.92, 'x6': 0.32}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.17, 0.0), 'l2norm': (1.89, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.91, 'x2': 0.89, 'x3': 0.99, 'x4': 0.47, 'x5': 0.0, 'x6': 0.01}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.68, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.14, 'x2': 0.28, 'x3': 0.34, 'x4': 0.09, 'x5': 0.34, 'x6': 0.5}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:20] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-1.71, 0.0), 'l2norm': (0.77, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:21] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.46, 'x2': 0.53, 'x3': 0.13, 'x4': 0.75, 'x5': 0.51, 'x6': 0.1}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:21] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.75, 0.0), 'l2norm': (1.16, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:25] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.02, 'x2': 0.3, 'x3': 0.35, 'x4': 0.05, 'x5': 0.28, 'x6': 0.52}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:25] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-1.35, 0.0), 'l2norm': (0.75, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:29] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.2, 'x2': 0.21, 'x3': 0.37, 'x4': 0.15, 'x5': 0.28, 'x6': 0.55}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:29] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-2.45, 0.0), 'l2norm': (0.79, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:32] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.25, 'x2': 0.15, 'x3': 0.4, 'x4': 0.19, 'x5': 0.22, 'x6': 0.6}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:32] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-2.6, 0.0), 'l2norm': (0.83, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:35] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.22, 'x2': 0.2, 'x3': 0.49, 'x4': 0.23, 'x5': 0.24, 'x6': 0.6}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:36] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-2.91, 0.0), 'l2norm': (0.89, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:39] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.21, 'x2': 0.13, 'x3': 0.59, 'x4': 0.22, 'x5': 0.24, 'x6': 0.55}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:39] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-2.62, 0.0), 'l2norm': (0.9, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:42] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.2, 'x2': 0.25, 'x3': 0.48, 'x4': 0.33, 'x5': 0.22, 'x6': 0.59}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:42] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-2.63, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:45] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.25, 'x2': 0.25, 'x3': 0.54, 'x4': 0.19, 'x5': 0.26, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:45] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-2.86, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:48] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.27, 'x2': 0.26, 'x3': 0.52, 'x4': 0.19, 'x5': 0.22, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:48] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-2.39, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:52] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x4': 0.24, 'x5': 0.29, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:52] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-3.24, 0.0), 'l2norm': (0.96, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:55] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.21, 'x2': 0.15, 'x3': 0.49, 'x4': 0.27, 'x5': 0.35, 'x6': 0.7}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:55] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-3.21, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:58] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.16, 'x2': 0.16, 'x3': 0.5, 'x4': 0.23, 'x5': 0.32, 'x6': 0.73}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:35:58] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-3.1, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:02] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.2, 'x2': 0.15, 'x3': 0.52, 'x4': 0.29, 'x5': 0.3, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:02] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-3.28, 0.0), 'l2norm': (0.98, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:05] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.23, 'x2': 0.15, 'x3': 0.48, 'x4': 0.3, 'x5': 0.3, 'x6': 0.7}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:05] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-3.24, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:09] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x4': 0.31, 'x5': 0.32, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:09] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-3.25, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:12] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.19, 'x2': 0.14, 'x3': 0.48, 'x4': 0.29, 'x5': 0.31, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:12] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-3.31, 0.0), 'l2norm': (0.95, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:16] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.22, 'x2': 0.13, 'x3': 0.5, 'x4': 0.27, 'x5': 0.31, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:16] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.31, 0.0), 'l2norm': (0.95, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:19] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.2, 'x2': 0.13, 'x3': 0.49, 'x4': 0.28, 'x5': 0.31, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:19] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-3.31, 0.0), 'l2norm': (0.95, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.21, 'x2': 0.07, 'x3': 0.5, 'x4': 0.34, 'x5': 0.32, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.13, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.06, 'x2': 0.82, 'x3': 0.31, 'x4': 0.96, 'x5': 0.91, 'x6': 0.09}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-0.08, 0.0), 'l2norm': (1.59, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.84, 'x2': 0.56, 'x3': 0.15, '...
10Sobol1COMPLETED{'1_0': {'x1': 0.53, 'x2': 0.26, 'x3': 0.27, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.19, 'x2': 0.96, 'x3': 0.93, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.91, 'x2': 0.89, 'x3': 0.99, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.14, 'x2': 0.28, 'x3': 0.34, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.46, 'x2': 0.53, 'x3': 0.13, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.02, 'x2': 0.3, 'x3': 0.35, 'x...
71GPEI7COMPLETED{'7_0': {'x1': 0.2, 'x2': 0.21, 'x3': 0.37, 'x...
81GPEI8COMPLETED{'8_0': {'x1': 0.25, 'x2': 0.15, 'x3': 0.4, 'x...
91GPEI9COMPLETED{'9_0': {'x1': 0.22, 'x2': 0.2, 'x3': 0.49, 'x...
101GPEI10COMPLETED{'10_0': {'x1': 0.21, 'x2': 0.13, 'x3': 0.59, ...
111GPEI11COMPLETED{'11_0': {'x1': 0.2, 'x2': 0.25, 'x3': 0.48, '...
121GPEI12COMPLETED{'12_0': {'x1': 0.25, 'x2': 0.25, 'x3': 0.54, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.27, 'x2': 0.26, 'x3': 0.52, ...
141GPEI14COMPLETED{'14_0': {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x...
151GPEI15COMPLETED{'15_0': {'x1': 0.21, 'x2': 0.15, 'x3': 0.49, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.16, 'x2': 0.16, 'x3': 0.5, '...
171GPEI17COMPLETED{'17_0': {'x1': 0.2, 'x2': 0.15, 'x3': 0.52, '...
181GPEI18COMPLETED{'18_0': {'x1': 0.23, 'x2': 0.15, 'x3': 0.48, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x...
201GPEI20COMPLETED{'20_0': {'x1': 0.19, 'x2': 0.14, 'x3': 0.48, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.22, 'x2': 0.13, 'x3': 0.5, '...
221GPEI22COMPLETED{'22_0': {'x1': 0.2, 'x2': 0.13, 'x3': 0.49, '...
231GPEI23COMPLETED{'23_0': {'x1': 0.21, 'x2': 0.07, 'x3': 0.5, '...
241GPEI24COMPLETED{'24_0': {'x1': 0.06, 'x2': 0.82, 'x3': 0.31, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.84, 'x2': 0.56, 'x3': 0.15, '... \n", "1 {'1_0': {'x1': 0.53, 'x2': 0.26, 'x3': 0.27, '... \n", "2 {'2_0': {'x1': 0.19, 'x2': 0.96, 'x3': 0.93, '... \n", "3 {'3_0': {'x1': 0.91, 'x2': 0.89, 'x3': 0.99, '... \n", "4 {'4_0': {'x1': 0.14, 'x2': 0.28, 'x3': 0.34, '... \n", "5 {'5_0': {'x1': 0.46, 'x2': 0.53, 'x3': 0.13, '... \n", "6 {'6_0': {'x1': 0.02, 'x2': 0.3, 'x3': 0.35, 'x... \n", "7 {'7_0': {'x1': 0.2, 'x2': 0.21, 'x3': 0.37, 'x... \n", "8 {'8_0': {'x1': 0.25, 'x2': 0.15, 'x3': 0.4, 'x... \n", "9 {'9_0': {'x1': 0.22, 'x2': 0.2, 'x3': 0.49, 'x... \n", "10 {'10_0': {'x1': 0.21, 'x2': 0.13, 'x3': 0.59, ... \n", "11 {'11_0': {'x1': 0.2, 'x2': 0.25, 'x3': 0.48, '... \n", "12 {'12_0': {'x1': 0.25, 'x2': 0.25, 'x3': 0.54, ... \n", "13 {'13_0': {'x1': 0.27, 'x2': 0.26, 'x3': 0.52, ... \n", "14 {'14_0': {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x... \n", "15 {'15_0': {'x1': 0.21, 'x2': 0.15, 'x3': 0.49, ... \n", "16 {'16_0': {'x1': 0.16, 'x2': 0.16, 'x3': 0.5, '... \n", "17 {'17_0': {'x1': 0.2, 'x2': 0.15, 'x3': 0.52, '... \n", "18 {'18_0': {'x1': 0.23, 'x2': 0.15, 'x3': 0.48, ... \n", "19 {'19_0': {'x1': 0.2, 'x2': 0.18, 'x3': 0.5, 'x... \n", "20 {'20_0': {'x1': 0.19, 'x2': 0.14, 'x3': 0.48, ... \n", "21 {'21_0': {'x1': 0.22, 'x2': 0.13, 'x3': 0.5, '... \n", "22 {'22_0': {'x1': 0.2, 'x2': 0.13, 'x3': 0.49, '... \n", "23 {'23_0': {'x1': 0.21, 'x2': 0.07, 'x3': 0.5, '... \n", "24 {'24_0': {'x1': 0.06, 'x2': 0.82, 'x3': 0.31, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.20246233818118914,\n", " 'x2': 0.12826459792928196,\n", " 'x3': 0.492497987334334,\n", " 'x4': 0.27798558846201776,\n", " 'x5': 0.3077947302118925,\n", " 'x6': 0.6599058141494158}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.9526240523587834, 'hartmann6': -3.3130271447784687}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:21] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/home/travis/build/facebook/Ax/ax/modelbridge/torch.py:311: UserWarning:\n", "\n", "To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).\n", "\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -2.4902228568281086, -2.5445668910079347, -2.5948840304444034, -2.6405659140848114, -2.6810200255379546, -2.715686825700948, -2.744058212733826, -2.765696216383624, -2.780250511481471, -2.7874731871547125, -2.7872293351829627, -2.7795024432080613, -2.7643941982886506, -2.7421189477910604, -2.712993573597444, -2.6774238502842067, -2.6358884947822094, -2.5889221119482553, -2.5370981268810135, -2.4810125984699893, -2.4212695658146366, -2.358468330139494, -2.2931928529076475, -2.2260032752558607, -2.157429440045037, -2.0879662214637253, -2.018070429091619, -1.9481590432560505, -1.8786085469533096, -1.8097551389700048, -1.7418956375618098, -1.6752889103582436, -1.6101576917146452, -1.5466906722177831, -1.4850447658683361, -1.4253474784619349, -1.3676993159842614, -1.312176184675618, -1.2588317451115758, -1.207699691498766, -1.1587959346874486, -1.112120673409363, -1.0676603431764982, -1.0253894363056844, -0.985272189812064, -0.947264140564684, -0.9113135492187445, -0.8773626961133352, -0.845349053620136, -0.8152063404046939 ], [ -2.524542538368354, -2.580907518489524, -2.633190183587304, -2.680747321448408, -2.7229487475816003, -2.7591957031988663, -2.7889410652273865, -2.8117102118622563, -2.827120949043872, -2.8349006388474, -2.8348987314594245, -2.8270933547146626, -2.8115913686115372, -2.7886221252793977, -2.7585258612563655, -2.7217380729306897, -2.678771389608377, -2.630196415883396, -2.5766228241139086, -2.5186816951744424, -2.4570097881563346, -2.3922361176744205, -2.3249709651185713, -2.255797262578847, -2.1852641647844884, -2.1138825555672542, -2.042122207907313, -1.970410317569089, -1.8991311487862124, -1.82862655817654, -1.7591971943521842, -1.6911042019017866, -1.624571287472795, -1.5597870315523532, -1.4969073519062839, -1.4360580435679338, -1.3773373360702557, -1.3208184216766465, -1.266551919096336, -1.2145682459515283, -1.1648798804337435, -1.1174834984329485, -1.0723619771811022, -1.0294862603151766, -0.9888170823873912, -0.950306553357618, -0.9138996055946484, -0.8795353074711576, -0.8471480488295793, -0.8166686044787856 ], [ -2.5541599574910987, -2.61239708502948, -2.666510651576867, -2.7158246759496887, -2.7596730362267703, -2.7974190022984953, -2.8284771061905722, -2.852336163831931, -2.868581697160748, -2.8769155967134865, -2.877170820822361, -2.869319381488151, -2.853472757710527, -2.8298749406193386, -2.7988892306903046, -2.760980475338415, -2.7166946278541437, -2.666637404027413, -2.611453516558145, -2.5518075781765135, -2.4883673636501937, -2.421789766025854, -2.3527095042300683, -2.281730444972074, -2.2094192836561333, -2.1363012711186387, -2.0628576582799485, -1.989524543920155, -1.9166928396991167, -1.8447091026241251, -1.7738770227721052, -1.704459389832063, -1.6366803942034978, -1.5707281462870635, -1.50675732120097, -1.4448918557696602, -1.3852276407419495, -1.327835164328984, -1.2727620738107877, -1.2200356305914881, -1.1696650410672262, -1.121643651320598, -1.0759509982227273, -1.0325547132096895, -0.9914122779619778, -0.9524726335791607, -0.9156776467065861, -0.8809634375169735, -0.8482615755428418, -0.8175001501509378 ], [ -2.578633567446313, -2.6385559570540633, -2.694327507158846, -2.7452424048247637, -2.790601337401959, -2.8297319927000433, -2.862012433948934, -2.8868961688674006, -2.9039370397300805, -2.9128114888463643, -2.9133355688517377, -2.905474487232402, -2.8893434936190086, -2.865200241400925, -2.8334299487647496, -2.7945254301335636, -2.7490642926237747, -2.6976854043080625, -2.6410663146469924, -2.57990279645316, -2.5148911906740046, -2.4467138305263214, -2.376027522739342, -2.303454868014301, -2.2295780935553697, -2.154935026003354, -2.080016832391885, -2.005267182508779, -1.9310825253750694, -1.8578132166753842, -1.7857652774491597, -1.7152026041911284, -1.6463494853672196, -1.579393308915395, -1.514487369837803, -1.4517537070559652, -1.3912859149509385, -1.3331518880931847, -1.2773964681707015, -1.2240439705508614, -1.1731005746759064, -1.1245565679277694, -1.078388436966631, -1.0345608040549386, -0.9930282086834104, -0.9537367370417209, -0.916625503622001, -0.8816279905852284, -0.8486732515231259, -0.8176869869637173 ], [ -2.597563418978949, -2.6589464774851286, -2.7161646810139866, -2.7684861431164975, -2.815182131585098, -2.8555483489366518, -2.888929600257272, -2.9147467032162266, -2.9325236847868874, -2.941912568717859, -2.942712708069139, -2.9348819690581673, -2.9185381979545464, -2.89395099237013, -2.8615252978332193, -2.8217792984523227, -2.7753193288111166, -2.7228142514361133, -2.664971174388099, -2.60251374442709, -2.536163676376866, -2.466625728606296, -2.3945760196290324, -2.320653387181924, -2.2454533930863376, -2.1695245471592246, -2.09336633705705, -2.017428689145234, -1.9421125347590051, -1.86777120779606, -1.7947124483446233, -1.7232008304435864, -1.6534604691798334, -1.5856778932082287, -1.5200049939968645, -1.4565619834310946, -1.3954403076707083, -1.3367054781039438, -1.2803997905400017, -1.2265449119773593, -1.1751443208192904, -1.1261855916290486, -1.0796425196935842, -1.0354770840038785, -0.9936412499193465, -0.9540786148853484, -0.9167259022112835, -0.8815143091667907, -0.8483707165762742, -0.8172187677381606 ], [ -2.61060604783845, -2.6731898190048597, -2.7316068972785095, -2.7851038176591394, -2.8329271607717654, -2.87434542271214, -2.9086747236331996, -2.935307262641808, -2.9537405179285976, -2.9636042971768353, -2.964682227579245, -2.956924536848316, -2.94045017587269, -2.915538164563728, -2.8826098401530027, -2.8422048423167734, -2.794953971058536, -2.7415516827676303, -2.682730282767681, -2.6192371108508503, -2.5518153591800883, -2.4811886684636084, -2.408049319184849, -2.3330496439550226, -2.256796200361137, -2.1798462277783877, -2.1027059388884415, -2.0258302464785714, -1.9496235844684193, -1.874441540359284, -1.8005930696849437, -1.728343109454725, -1.657915446529013, -1.589495728768758, -1.5232345324919547, -1.4592504202331882, -1.3976329389932514, -1.3384455219387874, -1.2817282665876029, -1.2275005704793864, -1.1757636116459131, -1.1265026662171571, -1.0796892595030565, -1.0352831500807689, -0.9932341489507335, -0.9534837778193883, -0.9159667721143259, -0.8806124355104339, -0.8473458536016014, -0.816088974941086 ], [ -2.6174887074599535, -2.680982332006339, -2.7403183246164775, -2.794726748990177, -2.843435060632819, -2.885690383771997, -2.920785984311363, -2.9480909003300075, -2.967080711079352, -2.9773664116701957, -2.978717704973536, -2.971077193134917, -2.9545631856274137, -2.9294608512866374, -2.896203484567482, -2.855346998906095, -2.807541119273731, -2.7535003185395475, -2.6939767263776697, -2.6297363727349907, -2.5615393961733366, -2.49012431273344, -2.416196096538712, -2.3404176336430114, -2.263404033295788, -2.1857192771756444, -2.107874726428963, -2.0303290663939597, -1.9534893351895903, -1.877712746337682, -1.803309072881044, -1.7305434093727559, -1.6596391685445466, -1.590781202148515, -1.5241189614911834, -1.4597696336972752, -1.3978212058311072, -1.3383354215977596, -1.2813506052158883, -1.2268843348119678, -1.174935953810358, -1.1254889136483577, -1.078512945005016, -1.0339660578017595, -0.9917963726646297, -0.9519437884482402, -0.9143414918979331, -0.8789173166390505, -0.845594959486633, -0.8142950626118894 ], [ -2.618021791252032, -2.682109987654692, -2.7420592608207524, -2.7970887707952095, -2.846413051302504, -2.8892645242387784, -2.924920448231302, -2.952733303342319, -2.9721625922390884, -2.9828049526879834, -2.984418730454976, -2.976939260680574, -2.96048233598967, -2.935335438918876, -2.9019385111159144, -2.8608575182269815, -2.8127545031848475, -2.7583573857115455, -2.6984318889207173, -2.6337570315454837, -2.565104829524635, -2.4932242757923855, -2.418829304023243, -2.3425902490489245, -2.2651282447132948, -2.1870120052920248, -2.1087564852921297, -2.0308229806955813, -1.9536203074420602, -1.8775067615973835, -1.8027926261115685, -1.7297430399906604, -1.658581087316489, -1.5894909968487707, -1.5226213692204806, -1.4580883692908384, -1.3959788372238875, -1.3363532843130497, -1.2792487492795286, -1.2246814983729408, -1.1726495585837642, -1.1231350780077987, -1.0761065111578467, -1.0315206300000568, -0.989324363852554, -0.9494564731347963, -0.9118490633832625, -0.8764289470193534, -0.8431188611240257, -0.8118385499849072 ], [ -2.6121083188940517, -2.6764595232972344, -2.7366991375907688, -2.79204127705201, -2.8416941682524146, -2.884882740490825, -2.9208757550952043, -2.9490164935582213, -2.9687549953040855, -2.9796787342350397, -2.981537849540183, -2.9742611047085763, -2.9579599377166583, -2.9329200510573887, -2.899582223861038, -2.858515598109203, -2.8103872111944663, -2.7559311599284793, -2.6959199009549017, -2.631139212688967, -2.562367502811566, -2.4903595330594306, -2.4158342475968997, -2.3394661892482924, -2.261879915809523, -2.183646838416623, -2.1052839584900793, -2.027254053615028, -1.9499669400349717, -1.8737815115027845, -1.799008317049195, -1.7259124926704366, -1.6547169044568888, -1.5856053944758854, -1.5187260472198494, -1.4541944150412403, -1.3920966569667375, -1.3324925576570017, -1.2754184028936602, -1.2208896954828257, -1.1689037013627068, -1.1194418203622636, -1.0724717797538956, -1.0279496516776938, -0.9858216978363348, -0.946026046679034, -0.9084942096940472, -0.8731524444774414, -0.8399229729949467, -0.8087250639475743 ], [ -2.59974957292701, -2.6640251473815417, -2.7242244239715654, -2.7795624430975443, -2.829247894591478, -2.8725056261943935, -2.908603656214627, -2.936883708675708, -2.9567932835511144, -2.9679162109663837, -2.9699978964748386, -2.9629615136347316, -2.946912516875579, -2.922130826835611, -2.8890522040222057, -2.848241913044774, -2.800364385431729, -2.7461522950055253, -2.6863776326972024, -2.621826393267293, -2.5532776220152047, -2.4814869271701623, -2.4071741541339993, -2.3310147012973235, -2.2536338787891217, -2.175603720169577, -2.097441713113304, -2.0196109913653686, -1.9425216099414278, -1.866532599570279, -1.7919545606522707, -1.71905261045415, -1.648049540430185, -1.5791290747426192, -1.5124391477705883, -1.4480951391153414, -1.3861830206232817, -1.3267623823299044, -1.2698693138337889, -1.2155191251029551, -1.1637088965994917, -1.1144198532560845, -1.0676195605257437, -1.02326394365519, -0.9812991336506178, -0.9416631452219804, -0.9042873933915201, -0.8690980564986688, -0.8360172940805048, -0.8049643285978307 ], [ -2.5810463399562327, -2.6449101225938163, -2.7047405844888917, -2.7597595855535455, -2.8091829415827014, -2.8522426838328787, -2.8882136604429545, -2.9164434812748707, -2.9363838568803637, -2.9476204012417315, -2.9498973033629317, -2.943133334366141, -2.92742667831887, -2.9030478802477933, -2.8704222142783036, -2.8301043156054293, -2.7827485945768746, -2.7290787751350614, -2.6698591703149064, -2.6058693805407147, -2.537883240874199, -2.466652183902848, -2.3928927535359037, -2.317277770397505, -2.240430559030586, -2.162921648864244, -2.085267413583901, -2.0079301885191034, -1.9313194851669984, -1.8557939962757626, -1.7816641496097767, -1.7091950223812131, -1.6386094718550588, -1.5700913720976892, -1.5037888737701381, -1.439817624749447, -1.37826390550137, -1.3191876456085443, -1.2626252975451588, -1.208592551349988, -1.1570868797912277, -1.1080899083149534, -1.0615696078007673, -1.01748231111596, -0.9757745568110554, -0.936384765145263, -0.8992447530534793, -0.8642810957324074, -0.831416343285335, -0.8005701013683102 ], [ -2.556195665794559, -2.6193231231115117, -2.6784679782267893, -2.7328645442335464, -2.7817420664020847, -2.82434655960001, -2.8599667162613844, -2.887962866873034, -2.90779710375244, -2.919061810668099, -2.9215032790268376, -2.9150371751000574, -2.8997535359089905, -2.875910566151102, -2.8439183119772813, -2.804314732257547, -2.7577374023734627, -2.7048940297286697, -2.646534354994581, -2.5834251689629513, -2.516329349785779, -2.445989166732481, -2.3731136500266365, -2.298369572957724, -2.222375485590963, -2.1456982289632127, -2.0688514031606076, -1.9922953325489674, -1.9164381479574177, -1.8416376783169037, -1.7682039081819694, -1.6964018111410804, -1.6264544126244758, -1.55854597019896, -1.4928251865496773, -1.429408391429401, -1.3683826451922065, -1.3098087291924165, -1.2537239981820851, -1.20014507754804, -1.1490703942996905, -1.1004825355286847, -1.0543504318892265, -1.010631366697671, -0.9692728136708371, -0.9302141082267756, -0.893387958743308, -0.8587218052759338, -0.8261390340317147, -0.7955600564254739 ], [ -2.5254834854326633, -2.587569828282246, -2.6457322917208215, -2.699222842923735, -2.747289882576717, -2.789199484747306, -2.8242603544344096, -2.851851473018634, -2.8714506271081506, -2.8826612752572065, -2.885234755155369, -2.87908493999438, -2.8642932537289316, -2.841103329963769, -2.8099061747904326, -2.771218008141525, -2.7256536786148344, -2.673898595454083, -2.6166816490665115, -2.5547508544062474, -2.4888526877634534, -2.419715449737989, -2.3480365361036086, -2.2744732289698186, -2.1996364955248597, -2.1240872551487873, -2.0483346078216442, -1.9728355778811761, -1.8979959979266265, -1.8241722267606608, -1.751673457087673, -1.680764421150414, -1.6116683454951417, -1.5445700405106835, -1.4796190375792513, -1.4169327079463176, -1.3565993139870054, -1.2986809564541488, -1.2432163913792933, -1.1902236982201204, -1.1397027871087242, -1.0916377380319626, -1.0459989687464655, -1.0027452314033356, -0.9618254403822928, -0.9231803358264379, -0.8867439889135111, -0.8524451560664685, -0.8202084901515487, -0.7899556172834725 ], [ -2.4892738548197912, -2.5500406596891323, -2.6069506325107215, -2.6592780176893465, -2.7062953522313693, -2.7472939401123826, -2.781607640437896, -2.8086389431000054, -2.8278856351885775, -2.838965748369947, -2.841638129645591, -2.8358161014078114, -2.8215723694874684, -2.799134502790758, -2.7688716565214544, -2.731274375818623, -2.6869300117636317, -2.6364964097182533, -2.580676184027979, -2.5201932747297886, -2.455772799478983, -2.3881246159649554, -2.317930567248785, -2.2458351031886994, -2.172438828673325, -2.0982944849305527, -2.0239048869529186, -1.9497223894341242, -1.8761495159929913, -1.803540449982991, -1.732203143513065, -1.6624018517232682, -1.594359941286843, -1.5282628560995615, -1.4642611502141616, -1.4024735194625517, -1.342989780001044, -1.2858737551890504, -1.2311660425725346, -1.1788866409276963, -1.129037423820006, -1.0816044513218972, -1.0365601156883353, -0.993865120119483, -0.9534702923991927, -0.9153182373029694, -0.8793448333092759, -0.8454805803952763, -0.8136518066103127, -0.7837817417479906 ], [ -2.447995741343318, -2.507195828985685, -2.5626146970899217, -2.6135528063886726, -2.6593109596789546, -2.6992098607131645, -2.7326125612605097, -2.7589487917748854, -2.777739604668697, -2.7886202653315313, -2.791359069253038, -2.785869897933768, -2.7722169195678505, -2.7506108153289226, -2.7213970479888, -2.6850376997763643, -2.6420890523954963, -2.593177261929572, -2.5389742456161155, -2.480175397661054, -2.4174801615792525, -2.3515759433854195, -2.2831254280105164, -2.2127570800267153, -2.14105845343814, -2.0685718731752027, -1.9957920509175737, -1.923165233386973, -1.8510895332143464, -1.779916148680543, -1.7099512321022927, -1.6414582140260259, -1.5746604305708254, -1.509743934352016, -1.4468603961560165, -1.3861300258903066, -1.3276444582774038, -1.2714695621815613, -1.2176481430978767, -1.166202516800148, -1.1171369389100319, -1.0704398805800948, -1.0260861448525682, -0.9840388217715814, -0.9442510831455984, -0.906667820097562, -0.8712271282960253, -0.8378616471051878, -0.8064997598864847, -0.7770666633812382 ], [ -2.402128411544376, -2.45954893345084, -2.5132724717708332, -2.5626288970319284, -2.6069505112698534, -2.64559056806396, -2.6779442581106445, -2.703471195084841, -2.7217179677926326, -2.732338935817983, -2.7351132644340685, -2.7299563334579386, -2.716924159520639, -2.69621028014529, -2.668135493426428, -2.6331317075956004, -2.5917217368184113, -2.5444970866036396, -2.492095625981066, -2.4351806535497955, -2.3744223703786247, -2.3104822938121155, -2.2440007558420416, -2.1755873548729117, -2.105814064697988, -2.0352106269635786, -1.964261836823159, -1.8934063522698723, -1.8230366978505095, -1.7535001809710369, -1.6851004864335932, -1.618099758263793, -1.5527210156117923, -1.4891507812033, -1.4275418268607662, -1.3680159617204364, -1.310666805736695, -1.255562504656293, -1.2027483535312817, -1.1522493045776092, -1.104072342222784, -1.0582087138694276, -1.0146360095003366, -0.9733200869697645, -0.93421684282157, -0.8972738308687629, -0.8624317326558291, -0.8296256853819932, -0.7987864739541137, -0.7698415946164505 ], [ -2.3521864075187313, -2.407650249568706, -2.4595097846663294, -2.5071267236778763, -2.5498672153907735, -2.587119236064122, -2.6183120434701017, -2.642936784047493, -2.6605669607213907, -2.670877169086773, -2.6736583880821416, -2.6688282496040374, -2.656435139118069, -2.6366556466278968, -2.6097856669898563, -2.5762261710371637, -2.5364651805339298, -2.4910576949768832, -2.4406052404603993, -2.38573641643718, -2.3270894135254054, -2.2652970645656625, -2.200974639800891, -2.1347103364019664, -2.067058244816585, -1.998533485116048, -1.929609175038599, -1.8607148977735726, -1.7922363655001652, -1.7245160126771963, -1.6578542935669909, -1.5925114971060665, -1.52870992683156, -1.4666363233455504, -1.4064444317638511, -1.3482576371806818, -1.2921716079818637, -1.2382569004801753, -1.1865614894020562, -1.1371131977208526, -1.0899220066154693, -1.0449822322615234, -1.0022745609904102, -0.9617679382793933, -0.9234213102173405, -0.8871852186476299, -0.8530032532186134, -0.8208133651518337, -0.7905490487349653, -0.7621403974167893 ], [ -2.29870496459098, -2.352070685363958, -2.40193277580388, -2.4476864761658077, -2.488733296535381, -2.5244972175395195, -2.554442588418897, -2.5780928754552384, -2.5950491086862093, -2.6050066480063805, -2.6077688141394844, -2.6032560637284328, -2.5915097488356076, -2.5726900493615736, -2.5470683053527017, -2.5150145759379354, -2.476981692533114, -2.433487283392582, -2.385095218188258, -2.3323977063495684, -2.2759989628508777, -2.216501011019782, -2.1544918836708074, -2.0905362434421204, -2.0251682785175644, -1.958886633214666, -1.8921510892485773, -1.8253807066873415, -1.758953149659857, -1.6932049500807846, -1.628432495668987, -1.5648935617679056, -1.5028092373670199, -1.4423661230824603, -1.3837187023426547, -1.3269918067844664, -1.2722831132769343, -1.2196656235195376, -1.169190088275122, -1.1208873474159038, -1.0747705644435168, -1.0308373402872364, -0.9890716962256199, -0.9494459199053935, -0.91192227179692, -0.8764545521476501, -0.8429895306707109, -0.8114682429147178, -0.7818271585713303, -0.7539992279463914 ], [ -2.2422265330366336, -2.293387112898572, -2.3411520572329456, -2.384951134875891, -2.424221981423303, -2.4584250845662496, -2.487060140425493, -2.509683004607371, -2.5259222207736136, -2.535493941177988, -2.5382140121762404, -2.5340061240257485, -2.5229052283106843, -2.5050558753909393, -2.4807056444781637, -2.450194332601078, -2.4139399430717186, -2.372422709504018, -2.326168396681036, -2.275731967973744, -2.2216824603370697, -2.164589625923059, -2.1050126349261724, -2.0434909180285517, -1.9805370700852802, -1.9166316370059178, -1.8522195551878307, -1.787707994954273, -1.7234653645879126, -1.659821250276503, -1.5970670926971295, -1.535457428452224, -1.4752115513314987, -1.4165154729002274, -1.3595240835540825, -1.3043634338072523, -1.251133071357918, -1.1999083827068708, -1.1507428991362436, -1.103670536024749, -1.0587077420855657, -1.0158555414213735, -0.9751014565121443, -0.9364213045597802, -0.8997808631506403, -0.8651374040784219, -0.8324410964901354, -0.8016362823576972, -0.7726626287040741, -0.7454561620863578 ], [ -2.1832888615229717, -2.2321695559899926, -2.277769044997516, -2.3195520077320904, -2.356992319092776, -2.3895868214464633, -2.416870184311857, -2.4384301490957077, -2.4539222680241397, -2.4630831239663236, -2.465741000946353, -2.4618230920711506, -2.4513585869592345, -2.4344773478496053, -2.411404305934998, -2.382450113284807, -2.3479989000342893, -2.308494163466424, -2.264423842254141, -2.2163055263636173, -2.1646725638698565, -2.1100615992174943, -2.0530018551300104, -1.9940062801905476, -1.9335645390264764, -1.872137723324867, -1.810154603743868, -1.7480092162105194, -1.6860595718411524, -1.6246272897425027, -1.563997970012542, -1.5044221459351057, -1.4461166767563234, -1.3892664638204284, -1.334026392323715, -1.2805234181557612, -1.2288587341988675, -1.1791099631923359, -1.1313333350624704, -1.0855658157199095, -1.041827161972843, -1.000121883612429, -0.9604410990801102, -0.922764275581512, -0.887060848197537, -0.8532917155690596, -0.8214106121882485, -0.7913653592949423, -0.7630989979184131, -0.736550808782459 ], [ -2.1224149059599813, -2.1689704839918016, -2.212364690594924, -2.2520969640286186, -2.287676988720022, -2.318637278946791, -2.3445466100745658, -2.3650236675521215, -2.379750138828746, -2.3884823862511912, -2.3910608390394623, -2.3874163488837206, -2.377572967677817, -2.3616469055959186, -2.3398417698988925, -2.3124405138238275, -2.2797947866957182, -2.242312533180611, -2.2004447286069264, -2.154672071031472, -2.1054923095047022, -2.0534087087404, -1.998919966692406, -1.9425117375488021, -1.88464978152602, -1.8257746683142282, -1.7662979004173445, -1.706599289919739, -1.6470254103620852, -1.5878889478405736, -1.5294687867299483, -1.4720106814904745, -1.4157283840073704, -1.3608051139954336, -1.3073952771009516, -1.2556263508932373, -1.2056008727462266, -1.157398475660232, -1.1110779284716175, -1.0666791458019933, -1.0242251406811786, -0.9837238992072428, -0.945170162033359, -0.9085471020289082, -0.8738278912652129, -0.840977153624114, -0.8099523019047521, -0.7807047603855835, -0.7531810754495216, -0.7273239181594291 ], [ -2.0601046611490794, -2.1043162768728663, -2.145490636270602, -2.183161341164437, -2.2168730180413148, -2.2461927578594496, -2.270722203073361, -2.2901097225851297, -2.3040620045900364, -2.3123543369123785, -2.3148388555762263, -2.31145013787203, -2.3022076950795562, -2.2872151644956933, -2.2666562773403833, -2.240787946446191, -2.2099310344754626, -2.1744595001697933, -2.134788665159232, -2.0913633041769804, -2.044646158170301, -1.9951073301793305, -1.9432148743541633, -1.8894267494688135, -1.834184192220392, -1.7779064775534879, -1.720986972830422, -1.6637903562079452, -1.6066508520129235, -1.5498713320598032, -1.49372313717129, -1.4384464840252773, -1.3842513361796314, -1.3313186328784639, -1.2798017838379265, -1.2298283519526658, -1.1815018584007078, -1.1349036558191872, -1.0900948250742426, -1.0471180597273024, -1.0059995097129095, -0.9667505621084824, -0.9293695423092652, -0.8938433235301331, -0.8601488364367673, -0.828254473949114, -0.7981213889365366, -0.769704684706634, -0.7429544999395798, -0.7178169910938015 ], [ -1.996828881952684, -2.0387007862334876, -2.0776626701898477, -2.113281346893314, -2.1451351790913784, -2.172824433110234, -2.19598211580893, -2.214284801658777, -2.227462873314036, -2.2353095585450014, -2.2376881643101623, -2.2345369934180104, -2.2258715785107532, -2.211784067518516, -2.1924398188174026, -2.168071481337452, -2.138971013850481, -2.105480215637789, -2.0679803875147993, -2.026881721325108, -1.9826129419040337, -1.9356116182243448, -1.8863154403630857, -1.8351546428203576, -1.7825456537966269, -1.728885969920268, -1.6745501977302057, -1.6198871650908524, -1.5652179842207987, -1.5108349392557034, -1.4570010715602715, -1.4039503422470745, -1.3518882611278737, -1.3009928828476738, -1.2514160830204097, -1.203285039019207, -1.1567038512129064, -1.1117552506445632, -1.0685023483205789, -1.0269903894146126, -0.9872484828310577, -0.9492912827884963, -0.9131206044522109, -0.8787269602476016, -0.8460910074006334, -0.8151849005497378, -0.7859735460234851, -0.7584157566419667, -0.7324653077343786, -0.7080718965242343 ], [ -1.9330245670788089, -1.9725808205151687, -2.0093562606572624, -2.042949684614812, -2.0729717366578564, -2.0990542434918757, -2.1208599001513675, -2.138091874839078, -2.150502838381984, -2.1579028979991954, -2.1601659365947428, -2.1572339330844215, -2.149118963628921, -2.135902746345395, -2.1177337735102824, -2.094822251435703, -2.067433215661595, -2.035878290064315, -2.000506604300589, -1.961695376095389, -1.9198406129525822, -1.8753483064623322, -1.8286263970482677, -1.7800776912440885, -1.7300938271659554, -1.6790503123693534, -1.6273026037729177, -1.575183161224315, -1.5229993824535446, -1.4710323148078956, -1.4195360354239512, -1.3687375937921984, -1.3188374168902448, -1.270010085571375, -1.2224054005116993, -1.1761496659270831, -1.1313471289426928, -1.0880815216151571, -1.0464176609984979, -1.006403070235057, -0.9680695904281975, -0.9314349590373459, -0.8965043357709923, -0.8632717614926051, -0.8317215395546118, -0.8018295322944096, -0.7735643682195457, -0.746888557730901, -0.7217595171344842, -0.6981305022228552 ], [ -1.8690920189683258, -1.906373325220443, -1.9410038952735558, -1.972613081930386, -2.000842184957229, -2.0253528404600507, -2.0458356556364556, -2.062018712870299, -2.073675520699602, -2.0806319736193077, -2.0827719056141203, -2.0800408869519313, -2.072448017240703, -2.060065600587658, -2.0430267357924246, -2.021520997644676, -1.9957885068073034, -1.9661127716942501, -1.932812729000375, -1.89623441025685, -1.8567426264183577, -1.814713001481515, -1.7705246112193698, -1.7245534050108389, -1.6771665156967432, -1.6287174996712088, -1.5795424994977267, -1.5299572845293703, -1.4802551001819266, -1.4307052417624546, -1.3815522619483875, -1.3330157200822437, -1.2852903846036323, -1.2385468057313556, -1.1929321828250012, -1.148571458888797, -1.1055685828710164, -1.0640078883897557, -1.0239555450522766, -0.9854610455000976, -0.9485586976432641, -0.9132690972263962, -0.8796005609053121, -0.8475505044328031, -0.8171067543911044, -0.7882487852086477, -0.7609488760033511, -0.7351731841492315, -0.7108827344116564, -0.6880343240832711 ], [ -1.8053932621923947, -1.8404540029645302, -1.8729939315743778, -1.9026713912958748, -1.9291566054854892, -1.9521391960820997, -1.9713358650773074, -1.986497912810675, -1.9974182328824657, -2.0039374152114977, -2.005948611643761, -2.003400874352629, -1.996300763286862, -1.9847121274900565, -1.9687540845649847, -1.9485973390351414, -1.9244590803489883, -1.896596774141848, -1.8653012001922114, -1.8308890967254114, -1.7936957475356377, -1.7540678032555461, -1.7123565697787761, -1.668911933731594, -1.6240770338326729, -1.578183732704343, -1.531548898822939, -1.4844714736750841, -1.4372302744075185, -1.3900824661403042, -1.3432626291211056, -1.296982342438775, -1.2514302066186973, -1.2067722308402757, -1.1631525157433649, -1.1206941690586283, -1.0795003980416749, -1.0396557295180926, -1.0012273149875177, -0.9642662845195082, -0.9288091189996943, -0.894879015598135, -0.8624872261118415, -0.8316343520821015, -0.8023115843198332, -0.7745018777150623, -0.7481810549905008, -0.7233188354197952, -0.6998797865050239, -0.6778241982333122 ], [ -1.7422515937698404, -1.7751571156078474, -1.8056706706461165, -1.8334779448811602, -1.8582763010304872, -1.8797815009985936, -1.897734527763901, -1.9119082247981105, -1.9221134464223804, -1.9282044092399735, -1.9300829566737656, -1.9277014965942338, -1.921064443492006, -1.9102280855007545, -1.895298893777497, -1.876430386721633, -1.853818743949498, -1.8276974265981067, -1.7983310965674881, -1.7660091368153052, -1.731039060469277, -1.6937400635828714, -1.6544369313474072, -1.6134544570054377, -1.5711124821588096, -1.527721620751878, -1.4835796892880926, -1.438968833964589, -1.3941533214640867, -1.349377943486863, -1.3048669747010728, -1.2608236184497983, -1.2174298731130182, -1.1748467534352616, -1.1332148045151578, -1.0926548508062415, -1.0532689278567533, -1.015141350218267, -0.9783398746901419, -0.9429169236405877, -0.9089108384232405, -0.8763471378089012, -0.845239760828812, -0.8155922774583397, -0.7873990541556095, -0.7606463644188473, -0.7353134372582475, -0.7113734388182453, -0.688794384363177, -0.6675399794852885 ], [ -1.6799520455851824, -1.7107762241333115, -1.739335385944484, -1.7653408741885699, -1.7885153970493972, -1.8085990269722203, -1.8253552511189874, -1.8385768300653367, -1.8480912040768616, -1.8537651863556135, -1.8555087029999384, -1.8532773804238705, -1.8470738403553872, -1.8369476353653529, -1.8229938371582812, -1.8053503674764204, -1.784194229531996, -1.7597368499869968, -1.7322187737077273, -1.7019039647784013, -1.669073959215842, -1.6340220911773513, -1.5970479800108972, -1.5584524252770104, -1.5185328153610258, -1.4775791160014005, -1.4358704703515985, -1.3936724133556762, -1.3512346806467272, -1.3087895756283843, -1.2665508472254285, -1.224713024146125, -1.1834511484899444, -1.1429208513097224, -1.1032587145480488, -1.0645828669854387, -1.0269937659590582, -0.9905751212447045, -0.9553949223467706, -0.9215065352972749, -0.8889498397725553, -0.8577523817925201, -0.8279305214046737, -0.7994905585351169, -0.7724298235919413, -0.746737722430042, -0.7223967279373051, -0.6993833127964104, -0.6776688199349008, -0.6572202688241475 ], [ -1.6187425560862507, -1.6475656450934693, -1.6742480691935897, -1.6985251412086824, -1.720143144244882, -1.7388646772076095, -1.7544740156177063, -1.7667822787522898, -1.7756321816483718, -1.7809021526689595, -1.782509615872387, -1.7804132723564594, -1.7746142640840892, -1.7651561635045778, -1.7521237971073864, -1.7356409746448942, -1.7158672520608809, -1.692993900173271, -1.6672392796864182, -1.6388438350779784, -1.6080649162846705, -1.575171620469029, -1.5404398200240754, -1.504147511200506, -1.4665705838962548, -1.4279790801669305, -1.3886339790169955, -1.348784519313275, -1.3086660518053033, -1.2684983952683353, -1.228484660356419, -1.1888104972954376, -1.1496437193962632, -1.1111342528558288, -1.0734143638175004, -1.0365991156387324, -1.0007870123084506, -0.9660607876027425, -0.9324883035764202, -0.900123526140608, -0.8690075496090515, -0.8391696460902627, -0.8106283193765556, -0.7833923464807464, -0.7574617931640344, -0.7328289926685574, -0.7094794794126096, -0.687392871631439, -0.6665436988657785, -0.646902171832116 ], [ -1.5588356711959723, -1.5857424305221033, -1.6106296887042046, -1.6332550666282861, -1.6533866998777822, -1.6708079958231066, -1.6853223798574248, -1.6967578513161268, -1.7049711609726277, -1.7098514254183643, -1.7113230102729702, -1.7093475438467585, -1.703924963891621, -1.6950935492835852, -1.6829289416194704, -1.6675422139619553, -1.6490770906338996, -1.6277064591415364, -1.6036283404049938, -1.577061495471142, -1.548240846295079, -1.5174128767732258, -1.4848311605809574, -1.4507521374288619, -1.4154312319305864, -1.379119381793679, -1.3420600163546228, -1.3044865038160955, -1.2666200665782443, -1.2286681489937785, -1.1908232105864316, -1.153261909902418, -1.116144639244284, -1.079615368053865, -1.0438017521645655, -1.0088154670746707, -0.9747527254036716, -0.9416949414477274, -0.9097095089759495, -0.8788506618896297, -0.8491603909347638, -0.8206693931873588, -0.7933980344291085, -0.7673573077319935, -0.7425497745313552, -0.7189704771616117, -0.6966078142446765, -0.675444372456607, -0.6554577100590575, -0.6366210891811483 ], [ -1.5004106195309812, -1.525488707698583, -1.5486647891953411, -1.5697171783725141, -1.5884342067844515, -1.6046184524881748, -1.6180909399710153, -1.628695156754966, -1.6363007268876277, -1.640806585607535, -1.6421435142329592, -1.6402759194841907, -1.6352027755712224, -1.62695768794645, -1.6156080812997002, -1.6012535574189184, -1.5840235073068745, -1.5640740933658632, -1.5415847394361841, -1.516754278062861, -1.4897969057944427, -1.4609380897943822, -1.4304105544520747, -1.3984504572284735, -1.365293840879167, -1.3311734264442765, -1.296315789565249, -1.2609389429175542, -1.225250330529081, -1.1894452258015267, -1.1537055141864112, -1.118198833501053, -1.0830780394887256, -1.0484809610530166, -1.0145304082362427, -0.981334396088003, -0.9489865487410254, -0.9175666499789632, -0.8871413090945193, -0.8577647136891873, -0.8294794440936593, -0.8023173271608521, -0.7763003102029864, -0.7514413387372214, -0.7277452244198463, -0.7052094920514602, -0.6838251968061466, -0.6635777048660623, -0.6444474324294558, -0.6264105396111543 ], [ -1.4436156322386535, -1.4669542437514376, -1.4885042940062032, -1.508063238495903, -1.5254380263740934, -1.540448857713799, -1.5529328987864197, -1.5627478233818082, -1.5697750443834733, -1.573922504153374, -1.575126905264011, -1.5733552844180803, -1.5686058608109776, -1.560908123707584, -1.5503221600008565, -1.5369372580800111, -1.5208698566135908, -1.5022609334288224, -1.4812729488364313, -1.458086468670315, -1.4328965950273536, -1.4059093280129413, -1.3773379710853098, -1.3473996775161243, -1.3163122177781783, -1.2842910289363643, -1.2515465886935624, -1.2182821396411545, -1.1846917741594294, -1.1509588776775685, -1.1172549177567936, -1.0837385586372201, -1.050555075296845, -1.0178360374426563, -0.9856992318901574, -0.9542487911852904, -0.923575496795862, -0.8937572264888891, -0.8648595173903495, -0.8369362185037212, -0.8100302089846638, -0.7841741611043282, -0.7593913294818211, -0.735696350750199, -0.7130960402828117, -0.6915901749072066, -0.6711722526457493, -0.6518302224300787, -0.6335471784350775, -0.6163020151676082 ], [ -1.388570401541548, -1.4102591263913549, -1.4302683992043757, -1.4484133370947987, -1.4645180142586387, -1.4784187980430903, -1.4899676349463133, -1.4990351734416933, -1.5055136081689164, -1.5093191343742682, -1.5103939128275692, -1.5087074634616202, -1.5042574296706928, -1.4970696829536037, -1.4871977673319114, -1.4747217124295786, -1.4597462710362406, -1.4423986594755651, -1.4228258957748419, -1.401191840743201, -1.3776740505465037, -1.352460546745819, -1.3257466020263151, -1.2977316282379898, -1.2686162392482518, -1.2385995457558778, -1.2078767237551116, -1.1766368836521088, -1.145061253754829, -1.113321680373335, -1.0815794372620233, -1.0499843296287599, -1.0186740723276204, -0.9877739179649427, -0.9573965082628328, -0.9276419209023032, -0.8985978839762481, -0.8703401308996661, -0.8429328699527427, -0.8164293443981923, -0.7908724611700859, -0.7662954683547762, -0.7427226639754885, -0.7201701208725122, -0.6986464146798301, -0.6781533439915852, -0.6586866337572086, -0.6402366147217042, -0.6227888733268703, -0.6063248679068696 ], [ -1.3353685935544979, -1.355496475354196, -1.3740494739858997, -1.390858968151754, -1.4057647544870369, -1.4186180085249078, -1.4292841909114524, -1.437645801942515, -1.4436048861712696, -1.447085193011209, -1.4480339091217937, -1.4464228935982653, -1.4422493667635297, -1.4355360263849557, -1.4263305897822403, -1.4147047847569358, -1.4007528348032532, -1.3845895031280602, -1.366347774485075, -1.3461762630708531, -1.3242364386078078, -1.3006997615876208, -1.2757448131688214, -1.249554496356147, -1.2223133738800553, -1.1942051956739206, -1.1654106559373163, -1.1361054072396464, -1.1064583475324206, -1.0766301856869989, -1.0467722824740273, -1.0170257568274954, -0.9875208417588159, -0.9583764702973359, -0.9297000691782571, -0.901587536496981, -0.8741233790125242, -0.8473809850283354, -0.8214230096356705, -0.7963018504184636, -0.7720601933544968, -0.7487316104911137, -0.7263411929280246, -0.7049062046281045, -0.6844367445367836, -0.6649364063754182, -0.6464029272485448, -0.6288288178459165, -0.6122019685126896, -0.5965062267975534 ], [ -1.2840803497230255, -1.3027351191633072, -1.3199149028398731, -1.3354660241351275, -1.3492426908904518, -1.3611096228132968, -1.370944621988876, -1.3786410034145153, -1.3841098018687843, -1.3872816753421264, -1.388108433796472, -1.3865641349004854, -1.382645704918596, -1.3763730620793042, -1.3677887402165267, -1.356957030849907, -1.3439626807542748, -1.3289091982481542, -1.3119168339817766, -1.293120310372527, -1.2726663778564244, -1.250711276000214, -1.2274181737475203, -1.2029546563566151, -1.1774903177336453, -1.1511945066933336, -1.124234264948897, -1.0967724839929287, -1.068966297991166, -1.040965720738627, -1.0129125268511732, -0.984939370798344, -0.9571691321413631, -0.9297144713706458, -0.9026775779364067, -0.8761500903025898, -0.8502131669806885, -0.8249376873669627, -0.8003845616686187, -0.776605130127932, -0.7536416330169182, -0.7315277343733741, -0.7102890840917979, -0.6899439046945841, -0.6705035908289381, -0.6519733112152495, -0.6343526043764727, -0.6176359609789985, -0.6018133869960081, -0.5868709431536112 ], [ -1.2347547272438966, -1.2520221886414553, -1.2679098224111933, -1.282277664105757, -1.2949931122800766, -1.3059332596374174, -1.3149871669848485, -1.3220580087561538, -1.3270650187430477, -1.329945168278686, -1.3306545164924497, -1.3291691831446881, -1.3254859083904886, -1.3196221797778496, -1.311615923829586, -1.3015247765642748, -1.2894249631754073, -1.2754098308325292, -1.259588089437882, -1.2420818226909498, -1.2230243358056605, -1.2025579068014511, -1.1808315057990244, -1.1579985417166478, -1.1342146888046116, -1.109635837224655, -1.0844162029968556, -1.058706623646636, -1.0326530572349064, -1.0063952944833168, -0.9800658866430503, -0.9537892857312027, -0.9276811888238308, -0.901848074234739, -0.8763869145624301, -0.8513850496610906, -0.8269202014737982, -0.8030606122366435, -0.7798652877015937, -0.7573843276180041, -0.735659326651477, -0.7147238301088865, -0.694603830196378, -0.6753182899921888, -0.6568796838088882, -0.6392945441027931, -0.6225640065243501, -0.6066843460640681, -0.5916474985146842, -0.5774415626280438 ], [ -1.187422042190254, -1.2033855924502042, -1.2180597201892072, -1.231317024490845, -1.2430369627441018, -1.2531079188943026, -1.2614292155290496, -1.2679130086754564, -1.2724860043921546, -1.275090939511709, -1.2756877752438769, -1.2742545615620615, -1.2707879418999732, -1.2653032810121478, -1.2578344130775656, -1.248433021356965, -1.2371676740677247, -1.2241225528310504, -1.209395919453289, -1.1930983735208394, -1.1753509571400163, -1.1562831641893108, -1.1360309099122028, -1.1147345129515154, -1.0925367364877345, -1.069580928508381, -1.0460092939065913, -1.0219613235422178, -0.9975723979841931, -0.9729725766934798, -0.9482855771209444, -0.9236279427240701, -0.8991083943217273, -0.8748273555203605, -0.8508766401285937, -0.8273392874679601, -0.8042895302036346, -0.7817928786662041, -0.7599063055159947, -0.7386785149178474, -0.7181502810540621, -0.6983548417223953, -0.6793183338678537, -0.6610602591167307, -0.6435939686618573, -0.6269271581441329, -0.6110623644491584, -0.5959974575611531, -0.5817261217674887, -0.5682383215718498 ], [ -1.1420960900075159, -1.1568363511312385, -1.1703728734912562, -1.1825897530721017, -1.1933774596419024, -1.2026346718747944, -1.2102700582480745, -1.2162039512354594, -1.2203698627310773, -1.2227157915810898, -1.223205279567379, -1.2218181799849932, -1.21855111270125, -1.213417590737548, -1.2064478153166414, -1.1976881482545638, -1.187200281839228, -1.175060136293399, -1.1613565230579657, -1.1461896181054267, -1.12966929313608, -1.1119133538287544, -1.0930457334774575, -1.073194687630464, -1.0524910311233575, -1.0310664535689793, -1.0090519433412508, -0.9865763437475612, -0.9637650587563247, -0.9407389196027831, -0.9176132180417789, -0.8944969070912145, -0.8714919658971185, -0.8486929218831736, -0.8261865206179371, -0.80405153180454, -0.7823586784123218, -0.7611706751559952, -0.7405423622070957, -0.7205209201134779, -0.7011461523273619, -0.6824508224260835, -0.6644610339850061, -0.6471966420684165, -0.6306716863898083, -0.6148948373136351, -0.5998698469902564, -0.5855959990058297, -0.572068550967407, -0.5592791654144122 ], [ -1.0987762268565378, -1.1123707750271303, -1.124842616122214, -1.1360863555865366, -1.1460025106313432, -1.1544991387249406, -1.1614934144026967, -1.1669131093046066, -1.1706979308839844, -1.172800677856832, -1.1731881751605036, -1.1718419577956918, -1.1687586811242932, -1.163950244549194, -1.1574436254821376, -1.1492804305391766, -1.139516180421464, -1.1282193534272618, -1.115470219579671, -1.1013595026486076, -1.0859869107389835, -1.0694595775929787, -1.0518904564200782, -1.0333967061326232, -1.014098106605884, -0.9941155353187385, -0.973569532792464, -0.9525789789452344, -0.9312598970997117, -0.9097243971579538, -0.8880797645775445, -0.8664276973812686, -0.8448636895973549, -0.8234765563031559, -0.8023480928428062, -0.7815528587901854, -0.7611580757943628, -0.7412236275219997, -0.7218021494385998, -0.7029391960818521, -0.6846734737094888, -0.66703712668683, -0.6500560666558526, -0.6337503343439537, -0.6181344847786872, -0.6032179876333814, -0.5890056354036384, -0.5754979530774607, -0.562691603891176, -0.5505797866419304 ], [ -1.057449302256488, -1.0699724784194076, -1.0814494269758754, -1.0917843510992942, -1.100886927670866, -1.1086737526825814, -1.115069737876935, -1.1200094198444266, -1.1234381433996945, -1.125313083386595, -1.1256040730992052, -1.1242942131064941, -1.1213802411761395, -1.1168726518535421, -1.1107955626384443, -1.103186332153735, -1.09409494375917, -1.0835831753085032, -1.0717235818357078, -1.0585983226337266, -1.0442978673154557, -1.028919616988906, -1.0125664767038869, -0.9953454139881119, -0.9773660357974152, -0.9587392128091203, -0.9395757759521615, -0.9199853056522604, -0.9000750297119664, -0.8799488412494676, -0.8597064438540054, -0.8394426272065634, -0.8192466729501702, -0.7992018876270117, -0.7793852570510984, -0.7598672145519327, -0.7407115140823481, -0.7219751981957276, -0.7037086503156167, -0.6859557204923761, -0.668753913911182, -0.6521346317293075, -0.6361234543257632, -0.6207404576950319, -0.6060005544654068, -0.5919138518332174, -0.5784860195450072, -0.5657186619029737, -0.553609688593937, -0.5421536799311335 ], [ -1.018091438907965, -1.0296142275667786, -1.040162840062758, -1.0496502373703824, -1.0579944408278987, -1.0651198153448962, -1.0709583069633548, -1.0754506013914242, -1.0785471707525027, -1.0802091778499308, -1.0804092107138423, -1.0791318249506172, -1.07637387724539, -1.0721446399865944, -1.0664656940438342, -1.059370603864663, -1.0509043858899312, -1.0411227874800253, -1.030091398808696, -1.0178846243050366, -1.0045845430795388, -0.9902796893153336, -0.9750637838808531, -0.9590344475332733, -0.9422919241942014, -0.9249378400859862, -0.9070740212300483, -0.8888013881404979, -0.8702189426958244, -0.8514228583158532, -0.8325056808584097, -0.8135556441971812, -0.7946561013342728, -0.7758850691933445, -0.7573148829611382, -0.7390119540028954, -0.7210366239592803, -0.7034431066131872, -0.68627950845909, -0.6695879185734592, -0.6534045583272963, -0.6377599816550432, -0.6226793169531648, -0.6081825421841878, -0.5942847853692927, -0.580996643329879, -0.5683245122560112, -0.556270924411939, -0.5448348860149492, -0.5340122120273936 ], [ -0.9806696597213469, -0.9912596243476044, -1.0009431793180699, -1.009641271136205, -1.0172795182492438, -1.0237893505792544, -1.0291091065973499, -1.0331850591790313, -1.0359723420983509, -1.0374357508298941, -1.0375503943042959, -1.036302178302105, -1.033688106099707, -1.0297163875641, -1.0244063538528405, -1.0177881809089209, -1.0099024307461444, -1.0007994248190766, -0.9905384683253133, -0.9791869479166762, -0.9668193278859631, -0.9535160714015081, -0.9393625138036144, -0.9244477144309797, -0.9088633120335652, -0.8927024067032658, -0.8760584885847817, -0.8590244305897909, -0.8416915590942569, -0.8241488133029942, -0.8064820007469529, -0.7887731533432898, -0.771099985676253, -0.7535354547040993, -0.7361474179972336, -0.7189983858787408, -0.7021453614682052, -0.6856397616069898, -0.6695274109427729, -0.6538486010406068, -0.638638206231152, -0.6239258479653407, -0.6097360996809671, -0.5960887245633115, -0.5829989390648862, -0.5704776956075053, -0.5585319784956841, -0.5471651077001853, -0.5363770458046866, -0.5261647040308437 ], [ -0.9451433651688401, -0.9548646301604051, -0.9637431243314103, -0.9717070708447895, -0.9786890010986762, -0.9846267669830695, -0.9894645138512692, -0.9931535893986934, -0.9956533642401202, -0.9969319415669089, -0.9969667358219194, -0.9957449037664743, -0.9932636154865986, -0.9895301576050197, -0.9845618660034823, -0.9783858904721616, -0.9710387986431133, -0.9625660311031159, -0.9530212235213438, -0.9424654148157199, -0.930966162718404, -0.9185965895392092, -0.9054343814723242, -0.8915607645001362, -0.8770594789091648, -0.8620157727659981, -0.8465154325409907, -0.8306438665557756, -0.8144852542060192, -0.7981217711017818, -0.7816328974872968, -0.7650948146448373, -0.7485798915274413, -0.7321562616573896, -0.7158874884064221, -0.6998323151585419, -0.6840444955499916, -0.6685726979760283, -0.653460477832555, -0.6387463104982689, -0.6244636778310542, -0.6106412009195623, -0.5973028119650088, -0.5844679584379275, -0.572151833029416, -0.560365623369226, -0.5491167759883309, -0.5384092695402787, -0.5282438928446394, -0.5186185238623287 ], [ -0.9114656663226721, -0.9203789368295185, -0.9285091150719702, -0.9357910511522092, -0.9421635638789227, -0.9475703402683542, -0.951960798849889, -0.9552908953574697, -0.9575238499547265, -0.958630776535196, -0.9585911968352587, -0.9573934250243115, -0.9550348119759169, -0.9515218424192904, -0.9468700824379832, -0.9411039791217346, -0.9342565183875378, -0.926368750877824, -0.9174891992535232, -0.907673162998335, -0.8969819389490943, -0.8854819771209588, -0.8732439920024553, -0.8603420493907643, -0.8468526480894909, -0.8328538144922402, -0.8184242263330621, -0.8036423798145382, -0.78858581204087, -0.7733303882954301, -0.7579496613077115, -0.7425143073370082, -0.7270916417272384, -0.7117452146105312, -0.6965344856924187, -0.6815145755595025, -0.6667360897198922, -0.6522450106149487, -0.6380826521166985, -0.6242856705311295, -0.6108861258408362, -0.5979115868159235, -0.5853852736730685, -0.5733262321421024, -0.5617495330816484, -0.5506664921454931, -0.5400849044177081, -0.5300092893866806, -0.5204411420996222, -0.511379186815047 ], [ -0.8795845805068179, -0.8877471926786706, -0.8951826049443892, -0.9018316995974263, -0.9076390115223283, -0.91255352778675, -0.9165294540025819, -0.9195269289439483, -0.9215126694384101, -0.9224605287666958, -0.922351953694245, -0.9211763277537008, -0.9189311914038003, -0.9156223330793203, -0.9112637487676067, -0.9058774714366757, -0.8994932752330238, -0.892148262708095, -0.8838863462847941, -0.8747576376292272, -0.8648177604712399, -0.8541271036770621, -0.8427500320108199, -0.8307540720517699, -0.8182090902114425, -0.8051864787910403, -0.7917583646194759, -0.7779968531105526, -0.7639733186684936, -0.7497577503462312, -0.7354181596044069, -0.7210200550043879, -0.7066259867566389, -0.6922951622845559, -0.6780831323881527, -0.6640415462241371, -0.6502179721706707, -0.6366557807175877, -0.6233940848107375, -0.6104677325690511, -0.5979073469686647, -0.5857394069291373, -0.5739863642209624, -0.5626667907183891, -0.5517955507245544, -0.5413839933762368, -0.5314401604728518, -0.5219690054513486, -0.5129726196293467, -0.5044504622501325 ], [ -0.8494440975179445, -0.8569100928209228, -0.8637011722528736, -0.8697637064766652, -0.875047425110373, -0.8795061277743401, -0.8830983647189508, -0.885788071016171, -0.8875451387854589, -0.8883459129899309, -0.8881735979624328, -0.8870185639520898, -0.8848785455396917, -0.8817587266496079, -0.8776717099638176, -0.8726373716855902, -0.8666826056713774, -0.8598409638204507, -0.8521522021690273, -0.8436617442858849, -0.834420075242688, -0.8244820805944353, -0.8139063454421747, -0.802754428775525, -0.7910901279433848, -0.7789787473330374, -0.7664863842178926, -0.7536792433386665, -0.7406229901900905, -0.7273821512722372, -0.7140195678038181, -0.7005959076488315, -0.6871692385314372, -0.6737946640513397, -0.6605240225963751, -0.6474056480028454, -0.6344841897511995, -0.6218004896094784, -0.6093915109468795, -0.5972903164273711, -0.5855260894449763, -0.574124194463127, -0.5631062713518928, -0.5524903588606407, -0.5422910425002028, -0.5325196223200714, -0.5231842963347406, -0.5142903556633833, -0.5058403877844089, -0.4978344846587457 ], [ -0.8209851249804712, -0.8278053431900614, -0.8339995004966376, -0.839518959159306, -0.8443181681894352, -0.8483552959040925, -0.8515928347025761, -0.8539981641935752, -0.8555440592462049, -0.856209130468446, -0.8559781860139299, -0.8548425054397784, -0.852800018517307, -0.8498553843480952, -0.8460199687580201, -0.8413117206222505, -0.8357549504021784, -0.829380016645306, -0.8222229284148146, -0.814324873499013, -0.805731683743028, -0.7964932499099251, -0.7866628991019697, -0.7762967479631897, -0.7654530446679164, -0.7541915121190845, -0.7425727038888086, -0.7306573832926346, -0.7185059346633527, -0.7061778144440054, -0.6937310482142593, -0.6812217782549557, -0.6687038647903911, -0.6562285426668049, -0.6438441339592578, -0.6315958158704298, -0.6195254423076191, -0.6076714167056889, -0.5960686130039705, -0.5847483411796444, -0.5737383533796991, -0.563062886466116, -0.5527427366800455, -0.5427953621251629, -0.533235008851698, -0.5240728564755834, -0.5153171794761129, -0.5069735205667878, -0.49904487281479626, -0.49153186748362443 ], [ -0.7941463216863742, -0.8003685080028262, -0.806010237966166, -0.8110274120230407, -0.8153787654860081, -0.8190264314832414, -0.8219364785968986, -0.8240794111623679, -0.8254306206054196, -0.8259707770063032, -0.8256861512832749, -0.8245688599473389, -0.8226170262393768, -0.8198348535497542, -0.8162326092547809, -0.8118265193940117, -0.8066385768648325, -0.8006962679373608, -0.7940322238140496, -0.7866838056071577, -0.778692632433277, -0.7701040632940852, -0.7609666440119451, -0.7513315307213775, -0.7412519013013354, -0.7307823657010304, -0.7199783854065527, -0.7088957113654901, -0.6975898485859511, -0.6861155544080255, -0.6745263761618985, -0.6628742326253587, -0.6512090424163679, -0.6395784012396493, -0.6280273087784194, -0.6165979450046357, -0.6053294947884953, -0.5942580189280156, -0.5834163690954635, -0.5728341437063933, -0.5625376813534677, -0.552550088201615, -0.5428912956021654, -0.5335781441391072, -0.5246244903565491, -0.5160413325201756, -0.5078369519232415, -0.5000170664476793, -0.49258499332148475, -0.48554181826495646 ], [ -0.7688648278107204, -0.7745337502722116, -0.7796647469353706, -0.7842178429136912, -0.788155665464398, -0.7914439451976438, -0.7940519942614164, -0.7959531510629352, -0.7971251814529428, -0.7975506270078871, -0.7972170920821857, -0.7961174626389094, -0.7942500514563229, -0.7916186660907627, -0.7882325978845757, -0.7841065322667538, -0.7792603825264144, -0.7737190510726639, -0.7675121238607139, -0.76067350510776, -0.7532410005981183, -0.745255858757035, -0.7367622792407122, -0.7278068990473792, -0.7184382661130431, -0.7087063100409356, -0.6986618190587832, -0.6883559315427035, -0.6778396495344534, -0.6671633806544195, -0.6563765137202193, -0.6455270322610254, -0.6346611690075341, -0.6238231033689272, -0.6130547029069529, -0.6023953089037999, -0.5918815653090193, -0.5815472896503078, -0.5714233839074461, -0.5615377828779542, -0.5519154372031818, -0.5425783279677701, -0.5335455096254413, -0.5248331779291031, -0.516454759542865, -0.5084210200759909, -0.5007401873932393, -0.49341808721148706, -0.4864582881792845, -0.4798622538448505 ], [ -0.7450769007509899, -0.7502344747512659, -0.754893752410801, -0.7590185066152286, -0.7625748976737254, -0.7655319197435853, -0.7678618263418744, -0.7695405258742289, -0.7705479384399765, -0.7708683057905767, -0.7704904472133352, -0.7694079552585606, -0.7676193265882143, -0.765128024748406, -0.7619424733003641, -0.7580759794225604, -0.7535465897570963, -0.7483768818552856, -0.7425936960236466, -0.7362278136350311, -0.7293135890117459, -0.7218885427821822, -0.713992925145615, -0.7056692577489458, -0.6969618628933056, -0.6879163885659194, -0.6785793373599065, -0.6689976067333918, -0.6592180473056124, -0.6492870450281325, -0.639250132141455, -0.6291516308657492, -0.6190343328118268, -0.6089392161622265, -0.5989052017866137, -0.5889689486386509, -0.5791646880476278, -0.5695240958758792, -0.5600762009681168, -0.5508473278718404, -0.5418610714572765, -0.533138300806133, -0.5246971895640657, -0.5165532698543971, -0.5087195068208552, -0.5012063908960047, -0.4940220449695787, -0.4871723437484654, -0.48066104274833354, -0.4744899145283126 ] ], "zauto": true, "zmax": 2.984418730454976, "zmin": -2.984418730454976 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.3010142801809193, 0.2825480119060403, 0.26478479108749664, 0.24791526405300132, 0.23213276420944556, 0.21762979757610973, 0.2045963831009397, 0.19322151857091707, 0.18369799548908058, 0.17622840832185413, 0.17102704608289068, 0.16831049462847403, 0.16827228992240703, 0.1710451478124111, 0.17666412096859813, 0.18504713341258422, 0.19600130495815699, 0.20925030716417278, 0.22447008525330964, 0.2413213782934654, 0.2594733277077328, 0.27861771006755603, 0.2984758911590252, 0.3188010375539838, 0.3393776109978083, 0.360019485859635, 0.38056748041023564, 0.40088673068355146, 0.4208641219447334, 0.4404058754986866, 0.4594353278160277, 0.47789090918383653, 0.4957243154643023, 0.5128988609490447, 0.5293879984956552, 0.5451739930065074, 0.5602467348503548, 0.5746026805870936, 0.588243909158826, 0.6011772825004968, 0.6134137002945901, 0.6249674393528432, 0.6358555688607238, 0.6460974334676836, 0.6557141969441437, 0.6647284398460996, 0.6731638053200604, 0.681044687835105, 0.6883959602358918, 0.6952427350644663 ], [ 0.291165413276785, 0.2723180217687304, 0.2541822034232558, 0.23694854296438775, 0.2208079778896229, 0.2059476468788631, 0.19254937035737962, 0.18079285792049912, 0.17086460596588454, 0.16297024946156835, 0.15734318582158538, 0.1542382777036645, 0.15390143913892518, 0.15651763928645515, 0.16215655719307287, 0.17074228975205652, 0.18206121506307524, 0.1958000980617265, 0.2115941049909531, 0.2290677520967238, 0.24786206138565126, 0.2676489564990318, 0.2881368137553504, 0.3090709071873062, 0.33023133315528597, 0.35142992063051126, 0.37250690407526427, 0.39332771584145426, 0.41378003701939653, 0.43377114211675216, 0.45322552861635806, 0.4720828065990047, 0.4902958203729948, 0.5078289757476513, 0.5246567497390318, 0.5407623626709599, 0.5561365953505153, 0.5707767361807831, 0.5846856448042038, 0.5978709202634886, 0.6103441628301509, 0.6221203196643009, 0.6332171053878146, 0.6436544895081607, 0.6534542434377482, 0.6626395406176738, 0.6712346039734294, 0.6792643955988144, 0.686754344177431, 0.6937301062049165 ], [ 0.28244094089908933, 0.2632820543016012, 0.24484450346686806, 0.22731853148640807, 0.210892230498561, 0.19574650904792928, 0.18205337883541703, 0.16998061304915843, 0.15970477146513917, 0.15143066014794687, 0.1454083356316437, 0.14193180195468905, 0.1413039775812872, 0.14376797250780649, 0.14943093931628465, 0.15822064278458692, 0.16989671408305598, 0.18410341367885727, 0.2004325480889906, 0.21847309849328267, 0.23784080272976368, 0.2581914206066136, 0.27922398046374053, 0.3006790021903937, 0.3223347060560874, 0.34400273592907105, 0.36552406344275845, 0.3867653056917106, 0.4076154952563081, 0.42798326695308214, 0.44779440512904634, 0.4669896963617499, 0.48552304047085926, 0.5033597817285446, 0.5204752299188964, 0.5368533469534, 0.5524855792482009, 0.5673698193452853, 0.5815094826523035, 0.5949126869657986, 0.6075915238389092, 0.6195614120023704, 0.6308405240407847, 0.6414492784203215, 0.6514098897892951, 0.6607459712421286, 0.6694821829532251, 0.6776439222481481, 0.685257050781872, 0.6923476550345531 ], [ 0.2749053266159509, 0.2555053614730187, 0.2368373577988342, 0.21909125015570244, 0.20245249700362303, 0.18709605086296707, 0.17318417045593582, 0.16087209688038273, 0.15032477946303777, 0.14174337356890807, 0.1353913049673236, 0.13159930284833063, 0.13072659221464494, 0.13307425931352268, 0.13878469754528366, 0.1477842827950476, 0.15980063121226387, 0.1744332928224021, 0.19123255218279844, 0.20975649370979954, 0.22960118419322068, 0.25041149590578865, 0.2718814414499878, 0.2937500518714933, 0.315795982182642, 0.33783223600775913, 0.35970148837000393, 0.38127208646066657, 0.40243466184528326, 0.4230992513047184, 0.4431928290783199, 0.462657170993213, 0.48144698925401674, 0.4995282918101115, 0.5168769316293965, 0.5334773193930807, 0.5493212788432794, 0.5644070279697027, 0.5787382719758641, 0.5923233959338583, 0.6051747465095335, 0.617307993308099, 0.6287415613760158, 0.6394961272684876, 0.649594171891522, 0.659059584069932, 0.6679173094825486, 0.676193040242136, 0.6839129409762783, 0.6911034077839517 ], [ 0.2686143920955101, 0.2490436240414949, 0.2302157948380948, 0.21232083789962342, 0.19554244095403567, 0.18005109228436242, 0.16600128734372818, 0.15353775298699104, 0.14281500488756269, 0.134029768360491, 0.1274552035265134, 0.12345216730909084, 0.12242742074253371, 0.12473020329497485, 0.13052863363055892, 0.13974085807084938, 0.15206096380148112, 0.16704815362712644, 0.18421933644112085, 0.2031107582173004, 0.22330681114805828, 0.24444764757537657, 0.26622661539810744, 0.28838412293336446, 0.31070102499698665, 0.332992677567276, 0.35510392840411525, 0.37690497901307507, 0.39828796244677717, 0.4191640823007375, 0.43946118656746047, 0.4591216810613128, 0.4781007130394992, 0.49636457506187737, 0.5138892928871954, 0.5306593706289477, 0.5466666727275309, 0.561909426519957, 0.5763913320262797, 0.5901207675290119, 0.6031100809401386, 0.6153749580489362, 0.6269338596590852, 0.6378075204324827, 0.6480185030003959, 0.6575908015964106, 0.6665494901142025, 0.6749204100936248, 0.6827298946862114, 0.6900045251418881 ], [ 0.26361571198869044, 0.2439438123077076, 0.2250256825036245, 0.20705178544363956, 0.19020546679274844, 0.1746553547609083, 0.16055202832391385, 0.14803437080664347, 0.13725074346302105, 0.1283951624444994, 0.12174690421376119, 0.11768577755167507, 0.1166476000410784, 0.1190082152537629, 0.1249442071762895, 0.13435897585324297, 0.14691845598468306, 0.16215445289309935, 0.1795652142043197, 0.19867778439812833, 0.21907414140492162, 0.24039583303965095, 0.26233926665407753, 0.28464831098699944, 0.30710704145408724, 0.3295335248675858, 0.35177473991363606, 0.37370246727879214, 0.3952099379010874, 0.41620905534542163, 0.4366280514363849, 0.4564094733290144, 0.47550843031385476, 0.4938910501957135, 0.5115331098418924, 0.5284188143190391, 0.5445397054568709, 0.5598936848328637, 0.5744841388755967, 0.5883191555894051, 0.601410823674018, 0.6137746057815188, 0.6254287784575081, 0.6363939320313443, 0.6466925243892087, 0.6563484831975632, 0.6653868517438074, 0.673833474120618, 0.6817147159936218, 0.6890572176529194 ], [ 0.259948726976197, 0.24024464210337765, 0.22130463862592345, 0.2033203932206371, 0.1864767317401705, 0.1709438172779234, 0.156873512254269, 0.14440550775524705, 0.13368865272779493, 0.12491787475965241, 0.1183747651308949, 0.11444273370561019, 0.11355961172811506, 0.11609665987910418, 0.12221685565128672, 0.13180526842561058, 0.1445126866787096, 0.15986372943035979, 0.17735702076453302, 0.19652459453619556, 0.2169551931950887, 0.23829711549729174, 0.26025265048198687, 0.28257039647565174, 0.30503801269167136, 0.3274761331462419, 0.34973345466718103, 0.371682793905047, 0.3932178857867405, 0.41425073428478365, 0.4347093744554349, 0.45453594583336354, 0.473685008118728, 0.4921220517339492, 0.5098221703936524, 0.5267688723493739, 0.5429530130538792, 0.5583718358239637, 0.5730281094961941, 0.5869293536287229, 0.6000871428695106, 0.6125164829147174, 0.6242352511543178, 0.6352636957161848, 0.6456239872075661, 0.6553398180222415, 0.6644360446296945, 0.6729383687805899, 0.6808730540413316, 0.6882666745020043 ], [ 0.2576444672867084, 0.23797644316587127, 0.21908207534220234, 0.20115498821898753, 0.18438343597602247, 0.16894276927365304, 0.1549917771455376, 0.14267823415858308, 0.1321587575884099, 0.12363301095781437, 0.11738015321638369, 0.11376921719895547, 0.11320934678858062, 0.11603369516839465, 0.12237079149427753, 0.13208793766527235, 0.14483790918126485, 0.16016045758475636, 0.17757378134647964, 0.1966282623536522, 0.21692753171860418, 0.23813107692828592, 0.2599492038231066, 0.2821360344243555, 0.30448286356728643, 0.32681255459655495, 0.3489749961740648, 0.370843438594443, 0.392311503808849, 0.41329069691944914, 0.43370829054437354, 0.45350549125827194, 0.4726358258054044, 0.4910637047594942, 0.5087631346721155, 0.5257165583818385, 0.5419138085667466, 0.5573511629388642, 0.5720304914928248, 0.5859584874681621, 0.599145974510588, 0.6116072831356003, 0.6233596901288043, 0.6344229150227415, 0.6448186682941558, 0.6545702464303333, 0.6637021695105186, 0.6722398574255178, 0.6802093413037896, 0.6876370071155623 ], [ 0.25672492999397944, 0.23716049393090669, 0.21837844761134362, 0.20057500174197682, 0.18394356953392746, 0.16866793085736553, 0.15491875005268885, 0.14285808637011158, 0.13265609556867827, 0.12451918661758687, 0.11871785142935112, 0.11558904422914627, 0.11548628169704431, 0.1186782519015348, 0.12524531927748664, 0.13504048234019522, 0.14773363806758744, 0.1628976749126331, 0.18008551495596667, 0.1988764906945232, 0.21889571486009615, 0.2398175968962326, 0.26136236144111724, 0.28329045568387873, 0.3053969794238093, 0.32750684731712504, 0.34947078248449304, 0.37116202919677144, 0.39247362940921204, 0.4133161251983948, 0.4336155812773298, 0.45331185200130253, 0.47235704090385366, 0.49071411763802286, 0.5083556684939902, 0.5252627638916721, 0.541423930678056, 0.5568342196768922, 0.5714943604438133, 0.585409996053463, 0.5985909912947497, 0.6110508080626299, 0.6228059421130044, 0.6338754157382621, 0.6442803213389364, 0.6540434113061578, 0.6631887300759185, 0.6717412846531142, 0.6797267503156028, 0.6871712085845335 ], [ 0.2572022535208669, 0.2378080393689044, 0.2192040382407114, 0.20158942561063464, 0.1851639339697512, 0.17012195460657648, 0.15664923364530922, 0.14492577547738922, 0.13513787632887483, 0.12749773208267073, 0.12226005609438144, 0.1197159509088733, 0.12014655514737738, 0.12374310426790773, 0.13053343705568743, 0.140360176077863, 0.15291891890615486, 0.16782535805092968, 0.18467575426336527, 0.20308510243166167, 0.22270476131509997, 0.24322720922932226, 0.26438453812062207, 0.2859446414798809, 0.30770700009472535, 0.3294988089180604, 0.351171640056232, 0.3725986179934805, 0.3936720175209873, 0.41430119151858574, 0.43441075285120984, 0.4539389548036731, 0.4728362315373439, 0.49106387262512646, 0.5085928142206749, 0.5254025347765303, 0.5414800463846126, 0.5568189745446679, 0.5714187200472806, 0.585283697084518, 0.5984226419283178, 0.6108479866950718, 0.6225752929216748, 0.6336227399434785, 0.6440106633888565, 0.6537611394738448, 0.6628976111725361, 0.671444552733464, 0.6794271693902788, 0.6868711294629558 ], [ 0.2590778473741311, 0.23991923131231466, 0.22155764583568321, 0.20419520733811672, 0.18803828766646366, 0.1732925677002371, 0.1601597097859883, 0.14883807141461583, 0.13952905109666863, 0.13244704520262346, 0.12782468988374185, 0.12590016735880577, 0.12687794465180932, 0.13087226822736595, 0.13786175587293567, 0.1476815095229881, 0.16005430689936, 0.17463988210559034, 0.19107974007663686, 0.2090270510245107, 0.22816205126990685, 0.2481976366681154, 0.26887965441551476, 0.2899848583595673, 0.3113181159306444, 0.33270958667515815, 0.35401213584968316, 0.37509903826296137, 0.3958619477602917, 0.4162090870038641, 0.43606361497913104, 0.4553621394309721, 0.4740533513442302, 0.49209676632504296, 0.5094615629799127, 0.5261255115338606, 0.5420739875663213, 0.5572990664177634, 0.5717986939569922, 0.5855759292977106, 0.598638254901758, 0.6109969494124745, 0.6226665185704928, 0.6336641796846864, 0.6440093953479019, 0.6537234523754558, 0.6628290822750298, 0.6713501199032145, 0.6793111973037801, 0.6867374700394231 ], [ 0.26234158696509996, 0.24348214784470654, 0.22542539830872732, 0.20837589045450708, 0.19254600280523823, 0.1781517600349081, 0.16540915993554078, 0.154532280325192, 0.1457336703505429, 0.13922510735590216, 0.13521330680415355, 0.13388368435076545, 0.13537009933411268, 0.1397195588074673, 0.14686921066215833, 0.156648412522842, 0.16880390205154117, 0.18303487564769882, 0.19902484266448509, 0.21646394932954985, 0.2350616698133372, 0.2545525047781019, 0.2746975133885428, 0.29528371960122407, 0.31612260090448707, 0.3370482806492316, 0.3579157029926032, 0.37859889462934293, 0.39898933876226367, 0.4189944571347161, 0.43853618865987604, 0.4575496544859248, 0.47598190282997654, 0.49379073000990453, 0.5109435760438356, 0.527416494001951, 0.5431931922865315, 0.5582641485231689, 0.5726257930510165, 0.5862797593013517, 0.5992321977727554, 0.6114931499045068, 0.6230759779307896, 0.6339968467502938, 0.6442742539376586, 0.6539286042167891, 0.6629818249744484, 0.6714570196824599, 0.6793781563918154, 0.6867697887423191 ], [ 0.2669711304810032, 0.2484719577781834, 0.23077975919250973, 0.21410053789589653, 0.19865115733268998, 0.1846556232543517, 0.17234075225393525, 0.1619315685999822, 0.15364626815402682, 0.14768943884181324, 0.14424109005602856, 0.1434396113095093, 0.14536044998764097, 0.14999747988936843, 0.15725587270242417, 0.16696068845832807, 0.17887768846350427, 0.19273835594928587, 0.2082620656185002, 0.2251721069714174, 0.2432055231512975, 0.26211824979620696, 0.28168723050352384, 0.3017108035766957, 0.32200818924143704, 0.3424185473464179, 0.36279984826898426, 0.38302767311659675, 0.40299399581773887, 0.4226059711402781, 0.44178474145505603, 0.4604642713890341, 0.4785902184680441, 0.49611884725909644, 0.513015993623131, 0.5292560843743817, 0.5448212160576924, 0.5597002949030555, 0.5738882384705289, 0.5873852381753834, 0.6001960808420209, 0.612329526688473, 0.623797740671184, 0.634615773882442, 0.6448010916411714, 0.6543731450019802, 0.6633529825806992, 0.6717628998178582, 0.6796261230434458, 0.6869665259435843 ], [ 0.27293140266054666, 0.2548502745749852, 0.23757875606362563, 0.22132291246568928, 0.20630188602764402, 0.19274431836380584, 0.18088316704121193, 0.17094864269498994, 0.16315887051347755, 0.1577078321220069, 0.15475060078138977, 0.15438729563584525, 0.15664924346802994, 0.16149198503643358, 0.16879830481704292, 0.17839073241884948, 0.19004951831243141, 0.20353114151726245, 0.21858384637608635, 0.23495889117449117, 0.2524177904159474, 0.2707365130347113, 0.28970764072822813, 0.30914126344680565, 0.3288651260456155, 0.34872433449029355, 0.36858079620989737, 0.3883124919369088, 0.40781263570590515, 0.42698875979543166, 0.4457617520157099, 0.46406486798977314, 0.48184273795907684, 0.49905038486671016, 0.515652267616491, 0.5316213604706272, 0.546938276672331, 0.5615904417219343, 0.5755713194155319, 0.5888796918413801, 0.601518993037742, 0.613496694926493, 0.6248237434023874, 0.6355140420190664, 0.6455839805054056, 0.6550520053082142, 0.6639382294347282, 0.6722640790152776, 0.6800519741869735, 0.6873250420868288 ], [ 0.28017431957075917, 0.2625647897032568, 0.2457655328126186, 0.22998100884002942, 0.2154300307960169, 0.2023420705470669, 0.19095120150089467, 0.1814871069781524, 0.17416284131297657, 0.16915975222599375, 0.1666112575653767, 0.16658864554633723, 0.1690927417530296, 0.1740541633450835, 0.1813421213392068, 0.1907789254003189, 0.20215616773212833, 0.21524930389278474, 0.2298290074620562, 0.24566913144979255, 0.26255188463605267, 0.280271018762284, 0.2986337035412781, 0.3174615630645169, 0.33659116888567436, 0.35587416246984216, 0.3751771071541429, 0.39438113161520394, 0.4133814087438544, 0.43208650581388985, 0.45041763798835416, 0.46830785449798584, 0.48570118397070344, 0.5025517620522033, 0.5188229607383688, 0.53448653499419, 0.5495217985199032, 0.5639148371453335, 0.5776577654141938, 0.5907480295184988, 0.603187757860392, 0.6149831591166818, 0.6261439666982667, 0.6366829278596395, 0.6466153353478001, 0.6559585993151902, 0.6647318571962221, 0.672955619310706, 0.6806514480701173, 0.6878416687946418 ], [ 0.28863886238072384, 0.271549326097341, 0.25526840469992257, 0.23999715661689489, 0.225951351714099, 0.21335751303556177, 0.20244612438878434, 0.1934413854410357, 0.18654744747994867, 0.1819321938901923, 0.17971116266178425, 0.17993538770585232, 0.18258669163240546, 0.18758185852706796, 0.19478411835420342, 0.20401827385148244, 0.2150856514870905, 0.2277764252869464, 0.24187855160980012, 0.2571836995302401, 0.2734909941533319, 0.29060934981749775, 0.30835894832182226, 0.32657219381366, 0.3450943172637955, 0.36378371247718405, 0.38251204305963543, 0.40116414516526394, 0.41963774933737014, 0.4378430475354606, 0.4557021341549501, 0.47314835083301027, 0.49012556385512723, 0.5065874004213197, 0.5224964664746626, 0.5378235647868187, 0.5525469279705157, 0.5666514773486196, 0.5801281153330321, 0.5929730562371157, 0.6051871982730708, 0.6167755378348068, 0.627746625973035, 0.6381120661550324, 0.6478860518878364, 0.6570849424955524, 0.6657268752137375, 0.6738314117422151, 0.6814192174391629, 0.6885117714122355 ], [ 0.298251607388948, 0.28172444766301485, 0.26600158465295615, 0.25127890147651283, 0.23776656488079018, 0.22568477018279434, 0.2152564606074346, 0.20669651058347513, 0.20019758251964936, 0.19591411401489375, 0.1939473302129617, 0.19433497811293338, 0.19704876475076188, 0.20200017826218303, 0.20905262530375807, 0.21803620005574953, 0.22876160077432195, 0.24103114807049028, 0.254646441431509, 0.2694131999154693, 0.2851441668139924, 0.30166085992799985, 0.31879469570257457, 0.336387776390647, 0.3542934660990523, 0.37237679348861524, 0.3905146835351839, 0.40859601483599245, 0.4265215057335856, 0.4442034422628263, 0.4615652689525879, 0.47854106827666315, 0.49507495608850216, 0.5111204193925424, 0.5266396201567617, 0.5416026853257893, 0.5559869993474376, 0.569776511792358, 0.5829610692799484, 0.5955357780552037, 0.6075004012305136, 0.6188587928954432, 0.6296183699511968, 0.6397896215727412, 0.649385655563017, 0.6584217804657613, 0.6669151220805066, 0.6748842729194747, 0.6823489731174662, 0.6893298213190796 ], [ 0.3089277714537426, 0.2929986878122728, 0.2778666419750179, 0.26372072212161535, 0.25076327869609133, 0.23920543040728345, 0.22925958441952565, 0.2211286347966672, 0.21499227412796704, 0.2109920273181015, 0.2092178065067611, 0.20969926418094373, 0.21240435291109502, 0.21724539397016315, 0.22409064033496742, 0.23277803135244488, 0.24312806576498747, 0.2549539712255451, 0.26806873502962014, 0.28228947962299816, 0.297440001420786, 0.3133522264994235, 0.32986710826729515, 0.3468352603085909, 0.36411745005872487, 0.38158498370109395, 0.39911997205724353, 0.4166154593432935, 0.4339754041616445, 0.45111451407630904, 0.4679579459307954, 0.48444089151083125, 0.5005080719556784, 0.5161131650868732, 0.5312181884360209, 0.5457928580627195, 0.5598139399488761, 0.5732646073352717, 0.5861338141534039, 0.5984156918844441, 0.610108974826464, 0.6212164568799164, 0.6317444815334282, 0.6417024656877724, 0.6511024572256215, 0.6599587257491011, 0.6682873856028969, 0.6761060501235268, 0.6834335159617363, 0.6902894762814445 ], [ 0.32057275401859364, 0.3052703521551753, 0.2907546096182232, 0.27720645272990047, 0.26481866345046934, 0.25379125810988856, 0.24432408349303206, 0.23660647263715195, 0.2308045381634181, 0.22704768660291094, 0.22541684874474588, 0.22593716753678741, 0.228577045215308, 0.23325369352281747, 0.23984346711274143, 0.24819421362710162, 0.2581370131444009, 0.2694956556199167, 0.2820933521676219, 0.2957569992716821, 0.3103196729690773, 0.3256220325678376, 0.341513142845891, 0.35785102180461575, 0.37450306027582214, 0.39134635893698516, 0.40826797888156147, 0.42516508661434643, 0.44194497735609384, 0.4585249707006997, 0.47483218349010126, 0.4908031932293196, 0.5063836105656669, 0.5215275815327702, 0.5361972401038952, 0.5503621298904211, 0.5639986112479191, 0.5770892671442274, 0.5896223182671011, 0.6015910552293481, 0.6129932934826777, 0.6238308547162842, 0.6341090770794332, 0.6438363554859723, 0.6530237124756466, 0.6616843995612313, 0.6698335286242064, 0.6774877326844668, 0.6846648552198855, 0.6913836671171442 ], [ 0.3330840801293961, 0.31842975491638276, 0.3045485422759757, 0.2916121506409028, 0.27980254229449697, 0.26930731455256046, 0.26031259683409946, 0.25299345371548854, 0.24750243410298559, 0.2439577163075501, 0.2424329620916021, 0.2429510930314005, 0.24548347501247664, 0.24995460678709683, 0.2562509544749184, 0.26423171908731835, 0.27373935501317703, 0.284608358739917, 0.2966717488539103, 0.30976536945409505, 0.3237305166830926, 0.3384154577266562, 0.3536763098258911, 0.3693775898367867, 0.38539260312189066, 0.4016037414165186, 0.4179027033773323, 0.4341906279794296, 0.45037812711886704, 0.4663852095056409, 0.4821410965173769, 0.49758393848770593, 0.512660445408239, 0.5273254489718036, 0.5415414136456325, 0.5552779136316812, 0.5685110907457191, 0.5812231059287641, 0.593401594664553, 0.6050391342612088, 0.6161327289056953, 0.6266833166796864, 0.6366953013440048, 0.6461761106312147, 0.6551357819889252, 0.663586576139622, 0.6715426184163938, 0.6790195675525788, 0.6860343114092835, 0.6926046889878218 ], [ 0.3463535981311563, 0.33236169649934516, 0.3191262804327287, 0.30680911389616894, 0.2955805703721958, 0.2856151375797461, 0.2770847757927717, 0.2701502250169678, 0.26495090092179197, 0.26159464434844437, 0.2601490553540611, 0.26063616020318886, 0.2630315681812638, 0.26726821270983864, 0.2732436600284685, 0.28082927421365805, 0.2898794724461685, 0.30023977296631565, 0.3117530146497758, 0.3242637159324206, 0.3376208948099773, 0.35167979094534957, 0.3663028931875023, 0.381360568678313, 0.3967314756978601, 0.4123028526494202, 0.42797071807261594, 0.44363998686298445, 0.4592244973266513, 0.4746469440124411, 0.4898387162747497, 0.5047396484008015, 0.5192976919283067, 0.53346852377853, 0.5472151050474674, 0.5605072050826365, 0.5733209042743839, 0.5856380872299602, 0.5974459360143056, 0.6087364311741568, 0.6195058664631015, 0.6297543816337682, 0.6394855163857749, 0.6487057875456956, 0.6574242907787128, 0.6656523275514842, 0.6734030576408111, 0.6806911771740399, 0.6875326219614919, 0.6939442957116391 ], [ 0.3602697702518601, 0.34694798615294664, 0.33436319164434136, 0.3226667950078332, 0.31201723607745424, 0.3025757116092227, 0.294500091202028, 0.28793718329481083, 0.28301395008339486, 0.27982873890800597, 0.27844391781945654, 0.27888127914361993, 0.2811211124172932, 0.2851050531942566, 0.2907419767732168, 0.2979156473588509, 0.3064927248233253, 0.3163300209970502, 0.3272803832409876, 0.3391970506874056, 0.3519366488956729, 0.3653611352906385, 0.3793390206635887, 0.39374613171369643, 0.40846609689995217, 0.42339066337659753, 0.4384198989355521, 0.45346230046783653, 0.4684348148445245, 0.4832627733887914, 0.49787974216849223, 0.5122272936037637, 0.5262547082352651, 0.5399186179220447, 0.5531826029370602, 0.5660167555033466, 0.5783972215381196, 0.5903057310570854, 0.6017291261129116, 0.6126588935131728, 0.6230907080276917, 0.6330239904368399, 0.6424614836273389, 0.6514088490133791, 0.6598742848307473, 0.6678681672907997, 0.6754027151566885, 0.6824916779839554, 0.6891500480230017, 0.6953937955888108 ], [ 0.37471990896732704, 0.36206984564526135, 0.3501347145043257, 0.3390554357564102, 0.32897851766577146, 0.3200520701553853, 0.31242032075864523, 0.3062168238049645, 0.3015568987101877, 0.29853017823508826, 0.2971943644077727, 0.29757124924709105, 0.29964570478473024, 0.30336775989961096, 0.30865725603048033, 0.31541012961971865, 0.32350523553055216, 0.3328107879412465, 0.3431898296154102, 0.354504497642047, 0.36661912830611093, 0.37940239758154576, 0.39272874100449723, 0.4064792751057785, 0.4205423901749035, 0.4348141278279694, 0.44919841075424805, 0.4636071604596127, 0.4779603205453504, 0.4921857945385762, 0.5062193047941883, 0.5200041795226665, 0.5334910765489279, 0.5466376538318012, 0.5594081975650633, 0.5717732187328755, 0.5837090284112614, 0.5951973010841404, 0.6062246339764797, 0.6167821090665793, 0.6268648631468372, 0.6364716701348402, 0.6456045388325162, 0.6542683285000107, 0.6624703839430914, 0.6702201912871928, 0.67752905520191, 0.6844097980207875, 0.6908764809487954, 0.6969441473445342 ], [ 0.38959224479465343, 0.37761007810027863, 0.36631859583469173, 0.35584832808694006, 0.3463341189189592, 0.3379114673708065, 0.3307116453303944, 0.3248557911014635, 0.32044844345257695, 0.31757123199982373, 0.316277585619634, 0.316589276750575, 0.31849535469564255, 0.3219535907129705, 0.32689409300826455, 0.33322439996678505, 0.340835221202437, 0.3496060728964057, 0.35941027415137705, 0.3701190342203902, 0.38160458511123857, 0.39374246037148586, 0.4064130872616017, 0.4195028665049037, 0.4329048875068289, 0.44651938900080745, 0.4602540390815086, 0.4740240807247658, 0.48775237034264163, 0.5013693262339199, 0.51481279863093, 0.5280278711863682, 0.5409666034868816, 0.5535877244201182, 0.5658562863572826, 0.5777432898987113, 0.5892252883369835, 0.6002839801024842, 0.6109057963899843, 0.6210814900382652, 0.6308057306404122, 0.6400767098624673, 0.6488957600761844, 0.6572669886784945, 0.6651969298703352, 0.6726942151852254, 0.6797692636731935, 0.6864339923372216, 0.6927015471679093, 0.6985860549111884 ], [ 0.4047777497123563, 0.3934549349369584, 0.38279676932790135, 0.3729236693900974, 0.3639592718009197, 0.35602711721418934, 0.3492463445015511, 0.3437265872631986, 0.33956246700834525, 0.33682825910511, 0.3355734055921078, 0.3358195083094995, 0.3375592388780168, 0.34075728755455315, 0.3453531285392586, 0.35126510605411554, 0.35839521392722534, 0.3666339645830348, 0.3758648813021163, 0.38596833492391774, 0.39682462279973074, 0.40831631768582827, 0.42032998768358354, 0.43275741390157196, 0.44549642656637034, 0.45845145885311667, 0.4715338924492075, 0.484662246476518, 0.49776224451946044, 0.5107667832516227, 0.5236158194236273, 0.5362561883446487, 0.548641365187086, 0.5607311795302959, 0.5724914929441853, 0.5838938487860892, 0.5949151026269407, 0.6055370408310511, 0.6157459938384635, 0.6255324497053485, 0.634890672505649, 0.6438183293284707, 0.6523161288447752, 0.6603874737711619, 0.6680381290231562, 0.6752759069128782, 0.6821103703895823, 0.6885525550290537, 0.6946147102330762, 0.7003100598897096 ], [ 0.4201716760600983, 0.40949565414767364, 0.39945686635778005, 0.39016602182212917, 0.3817361314080004, 0.3742795318375866, 0.3679041143012062, 0.3627089339903771, 0.3587795301766357, 0.3561834178058177, 0.3549662776711042, 0.3551493373543362, 0.35672828934633494, 0.3596738629205929, 0.36393391097024075, 0.3694366607234394, 0.37609465920041607, 0.3838089359412045, 0.39247298647704787, 0.40197630890498626, 0.4122073600915121, 0.4230559075081661, 0.43441482468032294, 0.44618141393491756, 0.4582583485221833, 0.4705543181573258, 0.4829844468146419, 0.49547053540564323, 0.507941168053909, 0.5203317101681095, 0.5325842192709819, 0.5446472848645691, 0.556475810685086, 0.5680307508259215, 0.5792788098815217, 0.5901921161784068, 0.6007478761513507, 0.6109280169335909, 0.6207188232569092, 0.6301105738234588, 0.6390971814439665, 0.647675840458424, 0.6558466842773054, 0.6636124553053462, 0.6709781890292633, 0.6779509136534764, 0.6845393663391891, 0.690753726827107, 0.6966053689889519, 0.7021066306464152 ], [ 0.43567479915277585, 0.4256296719874798, 0.41619337658869654, 0.4074674079735863, 0.39955480577668845, 0.3925575039782948, 0.3865730437227376, 0.3816908064104474, 0.37798803972627154, 0.37552604441852183, 0.37434693457398366, 0.3744713555190652, 0.37589743574105944, 0.37860108089942224, 0.3825375283147874, 0.3876439159411864, 0.3938425176820368, 0.4010442718589851, 0.4091522725345695, 0.4180649789325606, 0.4276789970000695, 0.43789137573251646, 0.4486014263173009, 0.4597121116034812, 0.4711310707435176, 0.4827713458147372, 0.4945518705297821, 0.5063977709831515, 0.5182405180419922, 0.5300179621198658, 0.5416742741850543, 0.5531598118232319, 0.564430925601958, 0.5754497184328308, 0.5861837687283153, 0.5966058266418681, 0.606693491400134, 0.6164288765990811, 0.6257982693059769, 0.6347917878774162, 0.6434030425722959, 0.6516288023109164, 0.6594686703068705, 0.6669247707712983, 0.6740014484494488, 0.6807049823840395, 0.6870433149945566, 0.6930257973024497, 0.69866295090704, 0.7039662471159324 ], [ 0.4511943719227038, 0.44176152829764476, 0.43290849051686936, 0.42472808486858715, 0.41731406806674287, 0.4107587804058125, 0.40515029019567983, 0.40056916651187763, 0.39708510429869254, 0.3947536951171166, 0.3936136677134042, 0.3936848997555161, 0.39496742241245253, 0.39744151571722264, 0.4010688512956258, 0.4057945119467836, 0.41154963131340283, 0.41825436445220443, 0.425820918579902, 0.43415642769321805, 0.4431655254354016, 0.45275253988206415, 0.4628232903287724, 0.47328650501709507, 0.4840549006946372, 0.4950459735969393, 0.506182551358039, 0.5173931505073498, 0.5286121775170143, 0.5397800046167177, 0.5508429456731588, 0.561753152616784, 0.572468449131935, 0.5829521154121381, 0.5931726355011822, 0.6031034169070931, 0.6127224906563583, 0.6220121986634743, 0.6309588741755933, 0.6395525200865081, 0.6477864890824073, 0.6556571688727757, 0.6631636751622486, 0.6703075545207571, 0.6770924988956701, 0.6835240731659452, 0.68960945684968, 0.6953572008295378, 0.7007769997436912, 0.705879480494178 ], [ 0.46664481258031526, 0.4578034955408521, 0.44951266214239033, 0.4418570402556578, 0.4349217973164221, 0.42879047087311806, 0.4235424932986031, 0.41925042836169396, 0.4159771030064339, 0.413772868412543, 0.4126732459243271, 0.4126971955499015, 0.41384618567635356, 0.4161041512507254, 0.41943832187805624, 0.42380080301535716, 0.4291307218209091, 0.43535671500550116, 0.4423995395048049, 0.4501746195264294, 0.45859439263466195, 0.4675703702237364, 0.4770148744539729, 0.4868424493699763, 0.49697096732956225, 0.5073224645332836, 0.5178237440679727, 0.5284067843151804, 0.5390089872025781, 0.5495732962753427, 0.5600482099594521, 0.5703877111981527, 0.5805511310538172, 0.5905029608831707, 0.6002126252355672, 0.6096542255934325, 0.6188062633818571, 0.627651349252486, 0.6361759044456478, 0.6443698590200657, 0.6522263508859099, 0.659741428863938, 0.6669137624023377, 0.6737443600954978, 0.680236298747607, 0.6863944643915887, 0.6922253063947719, 0.6977366055431182, 0.7029372567844197, 0.7078370671189621 ], [ 0.48194815321877865, 0.4736759657735904, 0.46592493096642607, 0.4587722532298478, 0.4522951901108486, 0.4465692328963607, 0.44166596363541033, 0.4376506886120777, 0.43457999801542263, 0.43249943898032056, 0.4314415043822423, 0.43142412591572343, 0.4324498160559614, 0.43450553561672633, 0.43756328403979183, 0.4415813334719864, 0.4465059688878702, 0.4522735636398384, 0.4588128146231465, 0.46604697928960676, 0.4738959898133365, 0.48227835875805275, 0.49111282809222373, 0.5003197445316123, 0.5098221669366677, 0.5195467259823701, 0.529424263942884, 0.5393902850520174, 0.5493852462980868, 0.5593547161212471, 0.5692494253095741, 0.5790252310629334, 0.5886430120487155, 0.5980685094591451, 0.607272126633987, 0.6162286977190683, 0.6249172340525139, 0.633320655466665, 0.6414255124272319, 0.6492217038704636, 0.6567021947166819, 0.6638627363095728, 0.6707015924325378, 0.6772192730643098, 0.6834182776359295, 0.6893028492210234, 0.6948787408147872, 0.7001529946197582, 0.7051337350470246, 0.7098299759512626 ], [ 0.49703428018159834, 0.4893076303698829, 0.4820730408070267, 0.4754007576954178, 0.4693607810539455, 0.4640212685203426, 0.4594466811436227, 0.45569575563975057, 0.4528194253445835, 0.45085883993106657, 0.4498436448732363, 0.4497906709817658, 0.45070315151210666, 0.45257053361576277, 0.4553688907267146, 0.45906188345232096, 0.46360216863487624, 0.46893312627518036, 0.47499076425816206, 0.48170566921723995, 0.48900489332110275, 0.4968136950134484, 0.5050570810539003, 0.5136611234284816, 0.5225540455289215, 0.53166708679258, 0.5409351642350336, 0.5502973540732635, 0.5596972181679225, 0.5690829994364739, 0.5784077085982574, 0.5876291222416558, 0.596709709662485, 0.6056165034504061, 0.6143209265209442, 0.6227985862567813, 0.6310290446454803, 0.6389955717727704, 0.6466848887326949, 0.6540869049254306, 0.661194453806934, 0.6680030304074416, 0.6745105333246212, 0.6807170133989966, 0.6866244308727251, 0.6922364224981796, 0.6975580797830223, 0.7025957393189485, 0.7073567859303793, 0.7118494691884494 ], [ 0.5118409972765271, 0.5046354858708648, 0.49789338998936045, 0.49167854323506227, 0.4860543056988791, 0.48108216548198396, 0.4768201345006607, 0.4733210095756186, 0.4706305986312641, 0.46878603269134106, 0.46781429230621663, 0.4677310688754112, 0.4685400566773192, 0.47023273326864423, 0.47278864015078315, 0.47617612968509876, 0.4803535054063005, 0.4852704564340352, 0.49086967495738903, 0.4970885480451062, 0.5038608282593545, 0.5111182074925223, 0.518791740861392, 0.5268130889576548, 0.5351155650476664, 0.5436349879123865, 0.5523103508315479, 0.5610843232505554, 0.569903604705645, 0.5787191514487128, 0.5874862956396495, 0.5961647755406968, 0.6047186932756234, 0.6131164146900915, 0.621330423847051, 0.6293371428154645, 0.6371167257154426, 0.644652834489369, 0.6519324025788087, 0.6589453915913894, 0.6656845451240389, 0.67214514314901, 0.6783247597452318, 0.684223026447854, 0.6898414030721051, 0.6951829575243954, 0.7002521558266521, 0.7050546633347206, 0.7095971579165384, 0.7138871556619364 ], [ 0.5263139415941006, 0.5196046968551601, 0.5133308440970908, 0.5075503241163956, 0.5023204357925408, 0.4976966118736794, 0.4937310307503192, 0.4904711237371938, 0.4879580594885239, 0.48622530292500704, 0.4852973519179452, 0.4851887487126729, 0.48590344445696965, 0.4874345663253387, 0.4897646017280085, 0.4928659782615189, 0.4967019866739044, 0.5012279712790656, 0.5063927001141774, 0.5121398257101076, 0.5184093548888556, 0.5251390597087533, 0.5322657784729318, 0.5397265728883508, 0.5474597230345182, 0.5554055546247135, 0.5635071027025719, 0.5717106225276932, 0.5799659623931448, 0.5882268150433746, 0.5964508647830821, 0.604599846777389, 0.6126395338336234, 0.620539664417451, 0.6282738239960376, 0.6358192901536496, 0.6431568503744934, 0.650270599980353, 0.657147726468118, 0.6637782854190037, 0.6701549722403641, 0.6762728932388323, 0.6821293388924177, 0.6877235616698865, 0.6930565603186655, 0.6981308721892222, 0.7029503748678748, 0.7075200981370723, 0.7118460470609006, 0.7159350367951695 ], [ 0.5404063794823457, 0.5341683437939084, 0.5283384390679263, 0.5229692036115919, 0.5181124133017123, 0.5138180104119192, 0.5101329017223716, 0.5070996757384242, 0.5047553058769068, 0.503129918457898, 0.5022457087202585, 0.5021160832714996, 0.5027450932391181, 0.5041272003955158, 0.5062473916055863, 0.5090816288876889, 0.5125975970566338, 0.5167556914857769, 0.5215101768594579, 0.5268104442764376, 0.5326022977815242, 0.5388292105261747, 0.5454335031022913, 0.5523574100687618, 0.5595440136248399, 0.5669380346607013, 0.5744864804591193, 0.5821391550022444, 0.5898490423245827, 0.5975725759864314, 0.6052698089213718, 0.6129044980275872, 0.620444117266183, 0.6278598119761412, 0.6351263058242174, 0.642221770430115, 0.649127666345337, 0.6558285627838956, 0.662311942342095, 0.6685679959202331, 0.6745894121746, 0.6803711650772565, 0.6859103025314557, 0.6912057384667939, 0.6962580504033322, 0.7010692841115963, 0.7056427666901709, 0.7099829291213304, 0.7140951391368093, 0.7179855450218733 ], [ 0.554078907596084, 0.5482870808014711, 0.5428769991501371, 0.5378962575485097, 0.5333916066198152, 0.529408015616247, 0.5259876312256657, 0.523168673966579, 0.5209843270465253, 0.5194616817263114, 0.5186208065337327, 0.5184740039669576, 0.5190253075162717, 0.5202702549714325, 0.5221959531575592, 0.5247814271932747, 0.5279982269458746, 0.531811246995106, 0.5361797056896558, 0.5410582243365848, 0.5463979487768991, 0.5521476614200902, 0.5582548407065357, 0.5646666353641526, 0.5713307313608486, 0.5781960991161521, 0.5852136167037801, 0.5923365711812936, 0.5995210448199578, 0.606726196049774, 0.6139144466441843, 0.6210515873389053, 0.6281068139882967, 0.635052705754439, 0.6418651558966458, 0.648523264635482, 0.6550092024172222, 0.6613080507793327, 0.6674076269644961, 0.6732982974781899, 0.67897278494524, 0.6844259718952843, 0.6896547044892505, 0.6946575986778307, 0.6994348508450657, 0.7039880546215574, 0.7083200252390752, 0.7124346325293337, 0.7163366434344423, 0.7200315746868806 ], [ 0.5672990811595764, 0.5619287251930469, 0.5569146911706172, 0.5523000580194318, 0.548127009522057, 0.5444360145296248, 0.5412649243671566, 0.5386480223272472, 0.5366150703922425, 0.5351904053787429, 0.5343921392044728, 0.5342315151096624, 0.5347124633486343, 0.5358313868601267, 0.5375771912307487, 0.5399315558758939, 0.5428694268955283, 0.5463596983816954, 0.5503660393657857, 0.554847818682908, 0.5597610796680558, 0.565059520082359, 0.5706954389433763, 0.5766206198340017, 0.5827871287059284, 0.5891480123056001, 0.5956578905315184, 0.6022734419476089, 0.6089537862153678, 0.6156607704200697, 0.6223591683073005, 0.6290168025198731, 0.6356046002491222, 0.6420965924923975, 0.6484698665176032, 0.6547044803208627, 0.6607833469370454, 0.6666920955075168, 0.672418915082025, 0.6779543862684064, 0.6832913050646884, 0.6884245025212099, 0.6933506632847993, 0.698068145566573, 0.7025768046398982, 0.7068778216043791, 0.7109735388341789, 0.7148673032540753, 0.7185633183454794, 0.7220665055697755 ], [ 0.580040988822519, 0.5750677979030163, 0.570426533715394, 0.5661561554127815, 0.5622947007921703, 0.5588785690388797, 0.5559417377260748, 0.5535149432966938, 0.5516248622457736, 0.5502933356742018, 0.549536681796804, 0.5493651387527342, 0.549782473627409, 0.5507857835008189, 0.552365501677038, 0.5545056084853629, 0.5571840327542827, 0.5603732186796845, 0.5640408244013544, 0.5681505137293521, 0.572662801162467, 0.5775359122062572, 0.5827266253152991, 0.5881910676999271, 0.5938854439076573, 0.5997666827885705, 0.6057929946357167, 0.6119243356059694, 0.6181227808011536, 0.624352810595128, 0.6305815170009191, 0.6367787382151671, 0.6429171301146877, 0.6489721835751485, 0.6549221961859527, 0.6607482063791084, 0.6664338972796967, 0.6719654768039277, 0.6773315397379976, 0.6825229167683972, 0.687532514727409, 0.692355151680037, 0.6969873899147775, 0.7014273694087128, 0.7056746439115176, 0.7097300214250442, 0.7135954105363556, 0.7172736737838779, 0.7207684889909548, 0.7240842192822102 ], [ 0.5922847908479766, 0.5876850311462997, 0.5833938771912623, 0.5794465343802491, 0.5758772799664446, 0.5727188353903102, 0.570001686547706, 0.5677533764985516, 0.5659978013736727, 0.5647545444695506, 0.5640382849830605, 0.5638583160832886, 0.5642182020007531, 0.5651155959337046, 0.5665422306246959, 0.5684840825266779, 0.5709216997420575, 0.5738306744847289, 0.5771822335433853, 0.5809439156224426, 0.5850803026309451, 0.589553772761386, 0.5943252460756646, 0.5993548976797324, 0.6046028187738685, 0.6100296113228818, 0.6155969073234075, 0.6212678083178444, 0.6270072447174803, 0.6327822575723412, 0.6385622076743549, 0.6443189183787631, 0.6500267593866251, 0.6556626790736809, 0.6612061929016445, 0.6666393351202831, 0.6719465804589523, 0.6771147418930514, 0.6821328499142367, 0.686992018076676, 0.6916852989645207, 0.6962075341457317, 0.7005552011531762, 0.7047262600675868, 0.708720001866256, 0.7125369003411416, 0.7161784690740228, 0.7196471246778221, 0.722946057265945, 0.7260791088901629 ], [ 0.60401623490113, 0.5997668572407493, 0.5958038683197635, 0.5921590569974575, 0.5888632923275753, 0.5859459741624709, 0.5834344426691914, 0.581353367325927, 0.57972414087594, 0.578564307010619, 0.5778870516725673, 0.5777007864798113, 0.5780088488382409, 0.5788093371219866, 0.5800950914490345, 0.5818538218635464, 0.5840683770514666, 0.586717138914512, 0.5897745220990003, 0.5932115533649379, 0.5969965036515215, 0.6010955457494273, 0.6054734123209765, 0.6100940321779984, 0.6149211267442521, 0.619918753023831, 0.6250517837664636, 0.630286319558869, 0.6355900310756114, 0.6409324325871641, 0.6462850900198908, 0.6516217684247748, 0.6569185247091074, 0.6621537520090908, 0.6673081822291437, 0.6723648531396296, 0.6773090460936007, 0.6821281999661961, 0.6868118063950786, 0.6913512908500508, 0.6957398835159911, 0.6999724834557712, 0.7040455190409288, 0.707956807202923, 0.7117054136675636, 0.7152915159874437, 0.7187162708778797, 0.7219816870862285, 0.7250905047778585, 0.7280460822001822 ], [ 0.6152261614377468, 0.611304890259493, 0.6076489104105467, 0.6042869042171023, 0.6012466541406876, 0.5985545617810174, 0.59623513459528, 0.5943104576215702, 0.5927996713568509, 0.5917184795100204, 0.591078711206464, 0.5908879611097126, 0.5911493278211233, 0.591861266034025, 0.593017561690646, 0.5946074324189381, 0.5966157484896087, 0.5990233630910411, 0.6018075354230691, 0.604942426338851, 0.6083996441927578, 0.6121488181557879, 0.6161581773457051, 0.6203951163787489, 0.6248267310163853, 0.6294203110843906, 0.634143781448765, 0.6389660852753305, 0.6438575068839423, 0.6487899341167609, 0.6537370622216451, 0.6586745428081182, 0.6635800825036442, 0.6684334965847842, 0.6732167231550839, 0.6779138034653378, 0.6825108337936302, 0.6869958939854887, 0.6913589573511884, 0.6955917861693905, 0.6996878165850444, 0.703642036236808, 0.7074508575192172, 0.7111119889854453, 0.7146243070310896, 0.7179877296681668, 0.721203093899538, 0.7242720379344141, 0.7271968892422258, 0.7299805592218234 ], [ 0.6259100086333975, 0.6222954101505442, 0.6189261287669731, 0.6158280247512264, 0.6130260871660914, 0.6105440126603159, 0.6084037590365495, 0.60662508814587, 0.6052251157047172, 0.6042178876388155, 0.6036140032102295, 0.6034203042878912, 0.6036396476562236, 0.6042707733799934, 0.6053082772820068, 0.6067426899957469, 0.6085606593439175, 0.6107452274778591, 0.6132761897318099, 0.6161305188194496, 0.6192828359973813, 0.6227059101586981, 0.6263711663843381, 0.6302491870560536, 0.6343101909514574, 0.638524478510226, 0.6428628344106025, 0.6472968814963679, 0.6517993827710004, 0.6563444905094735, 0.6609079434647726, 0.6654672146471134, 0.6700016132447127, 0.6744923449757375, 0.6789225355652245, 0.6832772221876342, 0.6875433176640554, 0.6917095520069706, 0.6957663956118352, 0.6997059680420411, 0.703521935972181, 0.7072094034662292, 0.7107647973875737, 0.714185750376617, 0.717470983494228, 0.7206201903178641, 0.7236339239917563, 0.7265134884719133, 0.7292608349690191, 0.7318784643756391 ], [ 0.6360673249508523, 0.6327388571434389, 0.6296368487899825, 0.6267845987534963, 0.6242045697148354, 0.6219180192478326, 0.6199446113259652, 0.6183020205239459, 0.6170055435828292, 0.6160677345783468, 0.6154980804257492, 0.6153027327245888, 0.6154843099769685, 0.6160417811203118, 0.6169704373464117, 0.6182619546744358, 0.6199045451019098, 0.6218831897725307, 0.6241799438235481, 0.6267742996741061, 0.6296435936450934, 0.6327634400014275, 0.6361081767156246, 0.6396513083201524, 0.6433659329467836, 0.6472251428215868, 0.6512023898770277, 0.6552718105649009, 0.6594085062499956, 0.6635887776227145, 0.6677903133196171, 0.6719923343527363, 0.6761756970210355, 0.6803229577323182, 0.6844184036383989, 0.6884480532246571, 0.6923996310444835, 0.696262520694403, 0.700027699927642, 0.7036876615371015, 0.7072363233312822, 0.7106689302002265, 0.7139819509389339, 0.7171729721736959, 0.7202405914293002, 0.7231843110858069, 0.7260044347042164, 0.7287019669511061, 0.7312785181225642, 0.7337362140566617 ], [ 0.6457012958091992, 0.6426393426527175, 0.6397860927606618, 0.6371625221015746, 0.6347888099369308, 0.6326840156364284, 0.6308657404479484, 0.6293497845723902, 0.6281498117950783, 0.6272770351551303, 0.6267399375041861, 0.6265440402064664, 0.6266917316481544, 0.6271821647453409, 0.6280112294512077, 0.6291716026254791, 0.6306528738465096, 0.6324417421285614, 0.6345222753337628, 0.6368762215587019, 0.6394833600686723, 0.6423218784997409, 0.6453687630196583, 0.6486001888353053, 0.6519918997117515, 0.6555195668568824, 0.6591591194528944, 0.6628870411224559, 0.6666806285689156, 0.6705182104241695, 0.6743793259053704, 0.6782448641845719, 0.6820971664016751, 0.6859200930096947, 0.6896990596557242, 0.6934210451033999, 0.6970745748293036, 0.7006496839134707, 0.7041378627271957, 0.7075319887300149, 0.7108262474475705, 0.7140160454334741, 0.717097917736785, 0.7200694321137829, 0.7229290919459188, 0.7256762395603596, 0.7283109613980385, 0.7308339962382342, 0.7332466474687834, 0.7355507001872551 ], [ 0.6548182893851577, 0.6520041814761578, 0.6493820998897988, 0.6469709156982347, 0.644788745645252, 0.642852668995201, 0.6411784329465313, 0.639780155356818, 0.6386700350311802, 0.6378580807875855, 0.6373518707871391, 0.6371563531200584, 0.6372736973574099, 0.6377032047821136, 0.6384412824414448, 0.6394814832163604, 0.6408146110156658, 0.6424288872172556, 0.6443101718174978, 0.6464422305929923, 0.6488070380474837, 0.651385105065522, 0.6541558200144664, 0.6570977924637511, 0.6601891896205342, 0.6634080568854221, 0.6667326154750368, 0.6701415317093021, 0.6736141542071065, 0.6771307167830871, 0.6806725062251916, 0.6842219953164878, 0.6877629424266309, 0.6912804597379952, 0.6947610527017876, 0.698192633662582, 0.7015645127729345, 0.7048673693721319, 0.7080932069529559, 0.7112352947137237, 0.7142880985122024, 0.7172472038220986, 0.7201092330565714, 0.7228717593778919, 0.7255332188662863, 0.7280928226798532, 0.7305504706051248, 0.7329066671766469, 0.7351624413354497, 0.7373192704011915 ], [ 0.6634274253328933, 0.6608434488602809, 0.6584358730136405, 0.656221663009582, 0.65421707377397, 0.6524374018453054, 0.6508967287154525, 0.6496076630091422, 0.648581090095365, 0.6478259384750719, 0.6473489724899073, 0.6471546204806388, 0.6472448464825387, 0.6476190719296021, 0.6482741517579204, 0.6492044069044622, 0.650401712672467, 0.6518556399690589, 0.6535536441919289, 0.6554812946970449, 0.6576225364223819, 0.659959974427178, 0.6624751718363512, 0.6651489519152026, 0.6679616956659389, 0.6708936273382383, 0.6739250814747048, 0.6770367464632612, 0.6802098809473419, 0.6834265007717669, 0.6866695353571328, 0.6899229534578483, 0.6931718591457886, 0.6964025595663382, 0.6996026065412931, 0.7027608144581696, 0.7058672571073853, 0.7089132462299375, 0.7118912945416722, 0.7147950659275161, 0.7176193153699073, 0.7203598210067387, 0.7230133105192786, 0.7255773838407614, 0.7280504339599038, 0.7304315673768768, 0.732720525556531, 0.7349176085182331, 0.7370236015055645, 0.7390397054939778 ], [ 0.6715401691393617, 0.6691695649529921, 0.6669607542767703, 0.6649289780284433, 0.6630888115386908, 0.6614539471617014, 0.6600369706008279, 0.6588491372199056, 0.6579001555544959, 0.657197985823258, 0.6567486613825108, 0.6565561407161741, 0.6566221967018638, 0.6569463485810592, 0.6575258403702472, 0.6583556674990814, 0.6594286513925824, 0.660735559676534, 0.6622652678202665, 0.6640049564587964, 0.6659403374451739, 0.6680559009237751, 0.6703351753980403, 0.6727609928675724, 0.6753157515774013, 0.6779816696842585, 0.6807410241181721, 0.6835763700183057, 0.6864707372708908, 0.6894078018064702, 0.6923720303694068, 0.695348798416088, 0.6983244816051849, 0.7012865220028159, 0.7042234706373115, 0.7071250084102799, 0.7099819476165118, 0.712786216461619, 0.715530829011157, 0.718209842976345, 0.7208183076558047, 0.7233522042248581, 0.7258083804062597, 0.7281844813792221, 0.7304788785953288, 0.7326905979768603, 0.7348192487800601, 0.7368649542164937, 0.7388282847427622, 0.7407101947543928 ], [ 0.6791699539232096, 0.676996908269402, 0.6749720312618875, 0.6731090049777133, 0.6714208904927476, 0.669919937401385, 0.6686173888490576, 0.6675232873962218, 0.6666462877794644, 0.6659934830913349, 0.6655702509989924, 0.6653801263237573, 0.6654247056038615, 0.6657035881912899, 0.6662143570548698, 0.6669526008677602, 0.6679119772586084, 0.6690843154197469, 0.670459754705985, 0.6720269145214575, 0.6737730897539242, 0.6756844653213399, 0.677746343059547, 0.679943374190321, 0.6822597909287198, 0.6846796313645798, 0.6871869525209965, 0.689766027385416, 0.6924015226622491, 0.695078654951745, 0.6977833239712418, 0.7005022222657554, 0.7032229215811127, 0.705933936681259, 0.7086247678777838, 0.711285923907545, 0.7139089270520576, 0.7164863025522568, 0.7190115544480647, 0.7214791299783897, 0.7238843746274897, 0.7262234798108086, 0.7284934250685107, 0.730691916487562, 0.7328173229110859, 0.7348686113232625, 0.7368452826242218, 0.7387473088362172, 0.7405750726129611, 0.7423293097608161 ], [ 0.6863318307208781, 0.6843414590463681, 0.6824865742878202, 0.6807794503382353, 0.6792317839469342, 0.6778545278279213, 0.6766577206918974, 0.6756503187180445, 0.674840033572602, 0.6742331824348772, 0.6738345555558131, 0.6736473066195282, 0.673672870600121, 0.6739109129281396, 0.6743593126532126, 0.6750141809832321, 0.6758699151828462, 0.6769192864176586, 0.6781535588262767, 0.6795626359692114, 0.6811352299041926, 0.6828590475116629, 0.6847209883590714, 0.6867073483428531, 0.6888040235575773, 0.6909967092732946, 0.6932710895055457, 0.6956130133843788, 0.6980086553166559, 0.7004446567414825, 0.7029082480608752, 0.7053873500544521, 0.7078706547347003, 0.7103476861541159, 0.7128088421305879, 0.7152454182126972, 0.7176496154671937, 0.7200145338448486, 0.7223341529787416, 0.7246033023019599, 0.726817622351071, 0.7289735190583105, 0.7310681127389044, 0.7330991833589368, 0.7350651135309093, 0.7369648305348263, 0.7387977485072117, 0.74056371178318, 0.7422629402207859, 0.7438959771852228 ], [ 0.6930421476688904, 0.6912204727396941, 0.6895225049868358, 0.6879592471838555, 0.6865411676225259, 0.6852780539049883, 0.6841788647590016, 0.6832515837147951, 0.6825030789490051, 0.6819389738742428, 0.6815635330914517, 0.6813795681032335, 0.6813883667065055, 0.6815896492606012, 0.6819815541012276, 0.6825606532976797, 0.6833219987984457, 0.6842591978526514, 0.6853645155038776, 0.6866290009936726, 0.6880426341359523, 0.6895944871659994, 0.6912728972456396, 0.6930656447189132, 0.6949601323436342, 0.6969435610446665, 0.6990030982070359, 0.7011260351091377, 0.7032999307456308, 0.7055127399660824, 0.7077529245239288, 0.7100095462621162, 0.7122723422353938, 0.7145317820701627, 0.7167791082830329, 0.7190063606164895, 0.72120638570627, 0.7233728335755951, 0.7255001425636526, 0.7275835143484733, 0.7296188807266165, 0.7316028637727813, 0.7335327309301144, 0.735406346484012, 0.737222120755411, 0.7389789582196905, 0.7406762056192355, 0.7423136009956558, 0.7438912244250995, 0.7454094510999394 ], [ 0.6993182579713442, 0.6976521834103531, 0.6960988957756999, 0.6946682513185104, 0.6933696129255825, 0.6922117220523876, 0.6912025695284557, 0.6903492685007078, 0.6896579331489121, 0.6891335670169495, 0.6887799648228992, 0.6885996314216638, 0.6885937211937896, 0.6887620005377717, 0.6891028353808726, 0.6896132047397456, 0.6902887404102579, 0.6911237919048148, 0.6921115148429602, 0.6932439801897018, 0.6945123010689495, 0.6959067733868349, 0.6974170261979981, 0.6990321776392616, 0.7007409923290753, 0.7025320363664813, 0.7043938264318154, 0.7063149699596113, 0.7082842938881955, 0.7102909600568609, 0.7123245658906987, 0.7143752295598927, 0.7164336593051274, 0.7184912070694376, 0.7205399069609827, 0.7225724993866363, 0.7245824419431729, 0.7265639083339467, 0.7285117766996594, 0.7304216088183939, 0.7322896216498583, 0.7341126526789683, 0.735888120461668, 0.7376139816978392, 0.7392886860583298, 0.7409111298808954, 0.7424806097278789, 0.7439967766708647, 0.7454595920378128, 0.7468692852293767 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8382659908384085, 0.20868158038333934, 0.1987687368061373, 0.24599491403572823, 0.2735651131322229, 0.19812354407597796, 0.2092098449532774, 0.15535051105814224, 0.20092033184988664, 0.23278071006947793, 0.19874202152753742, 0.5306741623207927, 0.19413353295593247, 0.2192872743578544, 0.20246233818118914, 0.20984165673761018, 0.1861793575808406, 0.9138283375650644, 0.142005137167871, 0.4582363897934556, 0.02275182017174954, 0.20381124161101558, 0.25373370758056046, 0.22425682188164012 ], "xaxis": "x", "y": [ 0.5575602240860462, 0.13253601411120824, 0.25203556098842583, 0.2499748665379118, 0.26368353166503883, 0.17719333911041268, 0.14887959260411737, 0.1560726648561245, 0.154332592477152, 0.15421703497917041, 0.18460247194449386, 0.2625328293070197, 0.13625811786306796, 0.12720732065818385, 0.12826459792928196, 0.07203027273229609, 0.9618437867611647, 0.8896558601409197, 0.27868005726486444, 0.5284271622076631, 0.29585708086861406, 0.2115450550930907, 0.1514130550303062, 0.2028584529565092 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.8382659908384085, 0.20868158038333934, 0.1987687368061373, 0.24599491403572823, 0.2735651131322229, 0.19812354407597796, 0.2092098449532774, 0.15535051105814224, 0.20092033184988664, 0.23278071006947793, 0.19874202152753742, 0.5306741623207927, 0.19413353295593247, 0.2192872743578544, 0.20246233818118914, 0.20984165673761018, 0.1861793575808406, 0.9138283375650644, 0.142005137167871, 0.4582363897934556, 0.02275182017174954, 0.20381124161101558, 0.25373370758056046, 0.22425682188164012 ], "xaxis": "x2", "y": [ 0.5575602240860462, 0.13253601411120824, 0.25203556098842583, 0.2499748665379118, 0.26368353166503883, 0.17719333911041268, 0.14887959260411737, 0.1560726648561245, 0.154332592477152, 0.15421703497917041, 0.18460247194449386, 0.2625328293070197, 0.13625811786306796, 0.12720732065818385, 0.12826459792928196, 0.07203027273229609, 0.9618437867611647, 0.8896558601409197, 0.27868005726486444, 0.5284271622076631, 0.29585708086861406, 0.2115450550930907, 0.1514130550303062, 0.2028584529565092 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:23] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/home/travis/build/facebook/Ax/ax/modelbridge/torch.py:311: UserWarning:\n", "\n", "To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).\n", "\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.8175247543000637, 0.8113017692880699, 0.8057174363964387, 0.8008128444214497, 0.7966277916235236, 0.7932002561708283, 0.7905658109677463, 0.7887569840032899, 0.7878025676963684, 0.7877268840332672, 0.7885490169711228, 0.7902820301099497, 0.7929321965674391, 0.7964982797892551, 0.8009709187217281, 0.8063321872916773, 0.8125554132549753, 0.8196053487493107, 0.8274387750572328, 0.8360055892440285, 0.8452503610031268, 0.8551142756656838, 0.8655373092125093, 0.8764604256665118, 0.8878275589046168, 0.899587154762224, 0.9116931136277786, 0.924105077677179, 0.9367881204949533, 0.9497119857554894, 0.9628500646638887, 0.9761782978957071, 0.9896741505381483, 1.00331575641463, 1.017081276754205, 1.0309484771343433, 1.0448944997087677, 1.0588957941748764, 1.0729281675303395, 1.0869669155965667, 1.1009870052873496, 1.1149632834253445, 1.1288706942763846, 1.142684493317326, 1.1563804489478045, 1.1699350269967974, 1.1833255551417563, 1.1965303659459785, 1.2095289183015556, 1.2223018977802553 ], [ 0.817101797098907, 0.810924501502464, 0.8053908749350499, 0.8005422425314873, 0.7964186262927495, 0.7930582096609687, 0.7904967450985648, 0.7887669054743721, 0.7878975823118125, 0.7879131371694428, 0.7888326170067905, 0.7906689508785834, 0.7934281543496797, 0.7971085802695974, 0.8017002702814598, 0.8071844798965554, 0.8135334680559911, 0.8207106528586299, 0.8286712276210741, 0.8373632955187711, 0.8467295167497557, 0.8567091828399898, 0.8672405545965964, 0.878263234170073, 0.8897203016401244, 0.9015599552347068, 0.9137364676135272, 0.9262103967739954, 0.9389481288854538, 0.9519209354782356, 0.9651037723516401, 0.9784740342529182, 0.9920104283039186, 1.0056920643293266, 1.0194978000813326, 1.0334058341125991, 1.0473935116618627, 1.0614372972246748, 1.075512866878485, 1.0895952790933534, 1.1036591909204088, 1.1176790947386959, 1.1316295579712163, 1.1454854539523658, 1.1592221764711408, 1.1728158336456944, 1.1862434189658744, 1.1994829588157478, 1.2125136367560765, 1.2253158954593217 ], [ 0.8170748915733991, 0.810952927373571, 0.8054793168288297, 0.8006955501302283, 0.796641797237638, 0.7933563671399878, 0.7908751090169182, 0.7892307558429785, 0.7884522131435971, 0.7885637987218252, 0.7895844436415497, 0.791526871152462, 0.7943967793117653, 0.7981920656008048, 0.8029021484153626, 0.8085074605174363, 0.814979210531728, 0.8222795229812451, 0.8303620625513102, 0.8391732117445367, 0.8486538024837355, 0.8587413172164927, 0.8693723898872245, 0.8804853588349673, 0.8920225675006894, 0.9039321086412498, 0.9161687906429207, 0.9286942578752198, 0.9414763667841484, 0.9544880432395271, 0.9677058916895371, 0.981108800236088, 0.9946767177018399, 1.0083896997187274, 1.0222272518131381, 1.0361679486762894, 1.0501892819456393, 1.0642676799368591, 1.0783786456240403, 1.092496967891815, 1.106596971477198, 1.1206527806964952, 1.134638580014754, 1.1485288605783506, 1.1622986462147484, 1.1759236954453323, 1.1893806781024843, 1.2026473264732003, 1.215702561728858, 1.2285265969032886 ], [ 0.8174463408545999, 0.8113893419166973, 0.8059850331262935, 0.8012749955307807, 0.7972994679263008, 0.7940968013180653, 0.7917028544678504, 0.7901503308877716, 0.789468059738005, 0.7896802260979167, 0.7908055604226082, 0.79285650326926, 0.7958383703821755, 0.7997485559106392, 0.8045758287303187, 0.8102997985271656, 0.8168906519764758, 0.8243092773731865, 0.8325078942074329, 0.8414312675754603, 0.8510185155019946, 0.8612054285135804, 0.8719271300106979, 0.8831208136179688, 0.8947282161893819, 0.906697471518254, 0.9189840826726051, 0.93155093719723, 0.9443674969314355, 0.9574084391587454, 0.9706520681911002, 0.98407877235804, 0.9976697131829928, 1.0114058391632896, 1.0252672389176651, 1.0392327971237107, 1.0532800914977436, 1.067385463957885, 1.081524206016169, 1.0956708104515163, 1.1097992539060866, 1.1238832859643115, 1.1378967087922403, 1.1518136376236274, 1.165608736692709, 1.1792574280965773, 1.1927360729362106, 1.2060221252498255, 1.2190942599491217, 1.2319324763590984 ], [ 0.8182172466243814, 0.8122347783739317, 0.8069089717055653, 0.8022814217669088, 0.7983923541609463, 0.7952800750868492, 0.7929803620467177, 0.791525795384423, 0.790945032971014, 0.7912620332821154, 0.792495236338526, 0.7946567181078531, 0.7977513428382973, 0.8017759504802158, 0.8067186339152614, 0.8125581835194013, 0.8192638025199392, 0.826795217920897, 0.8351033128918286, 0.8441313705192572, 0.8538169453992795, 0.8640942895470405, 0.8748971644155896, 0.8861617625859024, 0.8978293585166003, 0.9098482757355041, 0.9221748606942404, 0.9347733787295507, 0.947615000082642, 0.9606762122662109, 0.9739370310724708, 0.9873793155532393, 1.0009853810765381, 1.014736994391607, 1.0286147491857345, 1.0425977679999172, 1.0566636541534655, 1.0707886169018428, 1.0849477044471618, 1.099115094766633, 1.1132644088592742, 1.1273690229467392, 1.1414023650379228, 1.1553381874695465, 1.1691508111789477, 1.1828153401319943, 1.1963078459849545, 1.209605524045755, 1.2226868221535918, 1.2355315443769674 ], [ 0.8193874916114519, 0.813488990039835, 0.8082507385701485, 0.8037142675645046, 0.7999197050165497, 0.7969052228267521, 0.794706423417836, 0.7933556669570804, 0.792881341475185, 0.7933070810479577, 0.7946509413367617, 0.7969245477673547, 0.8001322403303166, 0.8042702515514135, 0.8093259718626643, 0.8152773800946038, 0.8220927443749826, 0.8297307226713538, 0.8381409961328674, 0.8472655339362689, 0.8570405155114631, 0.8673988473926969, 0.8782731147465516, 0.8895986819650482, 0.9013165215160169, 0.9133752953250986, 0.925732324988262, 0.9383533563566268, 0.9512113285514313, 0.9642845509475231, 0.9775547168315166, 0.9910050874396407, 1.004619043600075, 1.018379076514515, 1.032266197261537, 1.0462596921978167, 1.060337133413463, 1.0744745584027051, 1.0886467492257055, 1.1028275600030177, 1.1169902579985185, 1.1311078562318784, 1.1451534245814652, 1.1591003723957307, 1.1729226995258526, 1.1865952151013879, 1.2000937248023147, 1.2133951881866374, 1.2264778480490452, 1.2393213339646358 ], [ 0.820955733164919, 0.815150444215417, 0.8100085924165417, 0.8055715628285859, 0.8018792996450339, 0.7989697490446953, 0.7968782424532578, 0.7956368205774649, 0.7952735006006082, 0.7958114917828514, 0.7972683687762061, 0.7996552178283587, 0.8029757795728851, 0.8072256244652134, 0.8123914144925671, 0.8184503284753425, 0.8253697566634125, 0.833107395945124, 0.841611883286782, 0.8508240733074465, 0.8606789963888031, 0.8711084488112566, 0.8820440671367257, 0.8934205949868159, 0.905178882218084, 0.9172680755887496, 0.9296465793304991, 0.9422816802062928, 0.9551480936375907, 0.96822590719154, 0.9814984075832386, 0.9949501498460981, 1.008565464433742, 1.0223274578829282, 1.0362174659035146, 1.050214867128197, 1.064297153015535, 1.0784401602980336, 1.0926183931567075, 1.1068053837839467, 1.1209740578366383, 1.1350970844260737, 1.1491471992630797, 1.1630974953766082, 1.1769216794150128, 1.1905942936721867, 1.2040909051871693, 1.2173882639002602, 1.2304644321381746, 1.2432988877897877 ], [ 0.8229194081531105, 0.8172163285516638, 0.8121794527435562, 0.8078499389144784, 0.8042674601989125, 0.8014696445591551, 0.7994914554380412, 0.7983645137394959, 0.7981163637492601, 0.7987696884767175, 0.8003414839432643, 0.8028422077249552, 0.8062749254164476, 0.8106344907900171, 0.8159068126753902, 0.8220682849828407, 0.8290854845921504, 0.8369152679324582, 0.8455054051690392, 0.8547958632127299, 0.8647207854474643, 0.8752111364693376, 0.8861978780323987, 0.8976153800205988, 0.90940457083961, 0.9215152242139346, 0.9339069030197218, 0.9465484430359794, 0.9594162810470116, 0.9724921777172285, 0.9857608769398943, 0.9992080807599784, 1.0128189298455088, 1.0265770266415444, 1.040463938693853, 1.0544590722467069, 1.06853979951341, 1.0826817398797715, 1.0968591204180387, 1.1110451650147315, 1.1252124802778944, 1.1393334197177853, 1.153380416460634, 1.1673262802248692, 1.1811444575527872, 1.1948092561504846, 1.208296035184982, 1.221581363866889, 1.2346431508278064, 1.247460746813467 ], [ 0.8252747491933166, 0.8196825697645448, 0.8147589214495643, 0.8105446535776601, 0.8070790806929224, 0.8043994199422692, 0.8025401698963216, 0.8015324316410297, 0.801403175095654, 0.802174456432612, 0.8038625965405888, 0.8064773362178113, 0.8100209920076145, 0.8144876484123678, 0.8198624389828988, 0.8261209914261041, 0.8332291392096619, 0.8411430275817657, 0.8498097511711303, 0.859168637681982, 0.869153237275806, 0.8796940033633247, 0.8907215441117364, 0.9021701449673195, 0.9139810373902781, 0.9261047580217536, 0.9385020671261098, 0.9511432977608372, 0.9640064846254666, 0.9770748922773101, 0.9903345344418505, 1.0037720789501214, 1.0173733191594776, 1.0311222293512456, 1.045000521014258, 1.0589875739638295, 1.0730606158287088, 1.0871950458651032, 1.1013648278601043, 1.1155429026764399, 1.1297015904670205, 1.1438129658709093, 1.1578491979584347, 1.1717828518022468, 1.185587151497323, 1.1992362060622617, 1.2127052004658638, 1.2259705543730233, 1.2390100512945226, 1.251802940777504 ], [ 0.8280168119729595, 0.8225438644220908, 0.8177413175412849, 0.8136496301259701, 0.8103076711983244, 0.8077521554440646, 0.8060170210392044, 0.8051327510750834, 0.8051256419940014, 0.8060170254509771, 0.8078224541455482, 0.8105508679199834, 0.81420376454218, 0.818774411113733, 0.8242471481681206, 0.8305968600291225, 0.8377887106579338, 0.8457782680879788, 0.8545121504179707, 0.8639293091830003, 0.8739630201429761, 0.8845435825032713, 0.8956016155212932, 0.9070716493055153, 0.9188954646782997, 0.9310244891439202, 0.9434206791224051, 0.9560557507698653, 0.968909144072113, 0.9819653964622486, 0.9952115580127806, 1.0086350531136814, 1.0222221587310476, 1.0359570978833255, 1.0498216471381796, 1.0637951190210053, 1.0778545857204098, 1.091975237590404, 1.1061308015616187, 1.1202939715906755, 1.1344368230076411, 1.148531195697526, 1.1625490391553353, 1.1764627172196194, 1.1902452729537973, 1.2038706555438972, 1.2173139117447227, 1.2305513446544432, 1.2435606426214048, 1.2563209809947637 ], [ 0.831139513185013, 0.8257937212329555, 0.8211197242691943, 0.8171575099490158, 0.8139454163705325, 0.8115195661838872, 0.8099132443495471, 0.8091562212055469, 0.809274024814507, 0.8102871696749421, 0.8122103531042986, 0.8150516363940553, 0.8188116358768116, 0.8234827602442352, 0.8290485458226069, 0.835483161595294, 0.8427511792799411, 0.8508077255441604, 0.8595991435476402, 0.8690642789723827, 0.879136467986859, 0.889746238451783, 0.9008246175766358, 0.9123067390193713, 0.92413519443464, 0.9362624198316831, 0.9486515282244841, 0.9612754469621847, 0.9741147665521395, 0.987155013114456, 1.00038400266304, 1.0137896875029255, 1.0273586545044455, 1.041075258066849, 1.0549212726395647, 1.0688759166692474, 1.082916110193098, 1.0970168588121676, 1.1111516901709435, 1.1252930966925636, 1.1394129580151526, 1.1534829293596136, 1.1674747898278712, 1.1813607491054658, 1.1951137134848093, 1.2087075133672616, 1.222117094958009, 1.2353186790455974, 1.2482898897369328, 1.2610098558984413 ], [ 0.834635678377745, 0.8294245140148987, 0.8248860477230185, 0.8210597172849748, 0.8179832469641976, 0.815692081016375, 0.8142187624172307, 0.8135922589907095, 0.8138372415551569, 0.814973321947978, 0.8170142631262768, 0.8199671793920558, 0.8238317527530865, 0.8285995022764252, 0.8342531578163959, 0.8407662080021389, 0.8481027135595594, 0.8562174965530581, 0.8650568261170981, 0.87455971312232, 0.8846598940183417, 0.8952885184352805, 0.9063774317417779, 0.9178627414882157, 0.9296881139155982, 0.9418070972572815, 0.9541838893715693, 0.966792412229323, 0.9796141059029415, 0.9926351634765557, 1.0058438729815005, 1.019228476704316, 1.0327756996223405, 1.046469919155266, 1.0602928528133309, 1.0742236112630277, 1.0882389778917094, 1.1023138082893236, 1.1164214771527508, 1.1305343277800377, 1.1446240987750462, 1.1586623150621445, 1.1726206378080373, 1.186471172114341, 1.2001867336399143, 1.2137410764553, 1.2271090849251358, 1.240266932552937, 1.2531922106795341, 1.2658640297938126 ], [ 0.8384970988199474, 0.8334275442995597, 0.8290310856750491, 0.8253465348167108, 0.8224109227001009, 0.8202589331746364, 0.8189222838281481, 0.8184290567199813, 0.8188029843201254, 0.82006269937098, 0.8222209618467688, 0.8252838820951559, 0.8292501671178926, 0.8341104274095323, 0.8398465954040852, 0.8464315234689028, 0.8538288482755804, 0.8619932256545404, 0.8708710494454486, 0.8804017617840699, 0.8905198323788714, 0.9011574170067433, 0.9122475784932839, 0.9237277553390941, 0.9355429361730104, 0.947647865873447, 0.9600077325383789, 0.9725972115565948, 0.9853982692295319, 0.9983974281626551, 1.0115831477355757, 1.0249437239054033, 1.038465855451291, 1.0521338449323852, 1.0659293092591988, 1.0798312480123715, 1.0938163323639942, 1.1078593099134835, 1.1219334544653135, 1.1360110169735367, 1.1500636529448574, 1.1640628137965223, 1.1779800969832934, 1.191787553863159, 1.205457956501988, 1.2189650257245677, 1.2322836231945689, 1.2453899104377661, 1.2582614776774252, 1.2708774452214373 ], [ 0.8427145963134647, 0.837793112344905, 0.8335446052586077, 0.8300071884745213, 0.8272171246243432, 0.8252082605661971, 0.8240114116909956, 0.8236536989354464, 0.8241578446132708, 0.8255414366916948, 0.82781617571138, 0.8309871245014865, 0.8350519885991166, 0.8400004653293508, 0.8458137122279431, 0.852464000813306, 0.85991463844651, 0.8681202561124832, 0.8770275681411763, 0.8865767037913959, 0.8967031800744358, 0.9073405148755695, 0.9184233512739983, 0.9298907758434568, 0.9416893112341691, 0.9537749577136618, 0.9661137865078288, 0.9786809837506019, 0.9914587241446514, 1.0044335318295985, 1.0175937485453095, 1.0309275001285885, 1.0444213068730475, 1.0580593091164054, 1.0718229880669699, 1.0856912354909933, 1.099640639611014, 1.113645885470175, 1.1276802003593958, 1.1417158011875426, 1.1557243192415398, 1.169677189758744, 1.1835460009699803, 1.19730280141465, 1.2109203665763828, 1.2243724270193155, 1.237633860705632, 1.2506808523290203, 1.2634910224725964, 1.2760435292855092 ], [ 0.847278094750866, 0.8425105951831466, 0.8384154279182662, 0.8350299396686688, 0.8323895549466572, 0.8305272134514531, 0.8294727592591727, 0.8292522859148336, 0.8298874443491242, 0.8313947241828402, 0.8337847236484517, 0.8370614293280443, 0.8412215345168588, 0.8462538346284701, 0.852138749887163, 0.8588480393974631, 0.8663447853881469, 0.8745837392913385, 0.8835121275065589, 0.8930710066893038, 0.9031972250511942, 0.9138259725903134, 0.9248937766604202, 0.936341626190235, 0.9481177360092812, 0.9601793894175868, 0.9724934304639157, 0.9850353331693592, 0.9977871946291892, 1.010735246119935, 1.023867452022438, 1.0371715668305976, 1.0506337957972571, 1.064238039578385, 1.0779656140783198, 1.0917953090164905, 1.105703659547766, 1.1196653331305624, 1.1336535639031402, 1.147640591776206, 1.1615980813954785, 1.1754975079018664, 1.1893105036521034, 1.2030091642798537, 1.2165663148136525, 1.229955737780396, 1.243152365788545, 1.2561324412903407, 1.2688736462333565, 1.2813552042263627 ], [ 0.852176697120994, 0.8475685302351095, 0.8436315199722404, 0.8404021830832034, 0.8379150422638586, 0.8362020671720234, 0.8352920700683498, 0.835210060893193, 0.8359765695322241, 0.8376069467690659, 0.8401106601583235, 0.8434906070035468, 0.8477424740491546, 0.8528541826364566, 0.858805469018501, 0.8655676619552404, 0.8731037324486378, 0.8813687009312433, 0.8903104906450038, 0.8998713046324847, 0.9099895665393327, 0.9206023894216637, 0.9316484149750883, 0.9430707114705189, 0.9548192805137208, 0.9668526826534819, 0.9791384283436807, 0.9916520916958608, 1.0043754574127866, 1.0172942216639638, 1.0303957550727556, 1.0436672704220662, 1.057094540279755, 1.0706611576270908, 1.0843482464356247, 1.0981344991927109, 1.1119964248737713, 1.1259087145096178, 1.139844658519983, 1.1537765731911591, 1.1676762108449141, 1.1815151398026844, 1.195265087529218, 1.2088982446933232, 1.2223875303674956, 1.2357068199280914, 1.248831137884265, 1.261736818144276, 1.2744016342949493, 1.2868049024254167 ], [ 0.8573987666104036, 0.8529547029721015, 0.8491800870864072, 0.8461105481354808, 0.8437796500669303, 0.8422183376155099, 0.8414543400660757, 0.8415115383000843, 0.842409303707566, 0.8441618213736664, 0.8467774147188731, 0.850257894662483, 0.8545979635763045, 0.8597847129367636, 0.8657972636354552, 0.8726066089258593, 0.880175730712642, 0.8884600676823584, 0.8974084138276022, 0.9069643105662599, 0.9170679545600144, 0.9276585665485325, 0.9386770525164007, 0.9500686559316334, 0.9617851952759124, 0.9737864710209866, 0.9860405620943425, 0.9985229973367278, 1.0112150750641777, 1.024101776284746, 1.0371697132389577, 1.0504054230993922, 1.0637941496536776, 1.0773191199288146, 1.0909612409762217, 1.1046991097418775, 1.1185092304512625, 1.13236635263674, 1.1462438663292671, 1.1601142120241663, 1.1739492792273647, 1.1877207786574737, 1.2014005805018486, 1.214961015645492, 1.2283751394600901, 1.2416169592440451, 1.254661627200162, 1.267485601215488, 1.2800667758476727, 1.292384585928808 ], [ 0.8629320104352266, 0.858656237104378, 0.8550476709732513, 0.8521410022407785, 0.849968786493773, 0.8485608972027535, 0.8479439393533541, 0.8481406304874223, 0.8491691585468314, 0.8510425297918367, 0.8537679248315065, 0.8573460865873985, 0.8617707709304707, 0.8670282988261259, 0.8730972579407754, 0.8799484112240664, 0.887544878595037, 0.895842662759702, 0.9047915865537388, 0.9143366897549364, 0.9244200891864973, 0.9349832304963092, 0.9459693564195452, 0.9573259063611385, 0.9690064885873549, 0.9809720803253407, 0.9931912420254289, 1.0056393544726445, 1.01829711629979, 1.03114867652741, 1.0441797782511675, 1.0573761879108754, 1.0707225477386388, 1.0842016711264044, 1.0977942248655808, 1.1114787082565305, 1.1252316356576668, 1.1390278425323288, 1.1528408544628381, 1.1666432772525224, 1.1804071812397798, 1.1941044638052531, 1.2077071813695077, 1.2211878468577209, 1.2345196914751646, 1.2476768913241165, 1.260634760338207, 1.2733699115039447, 1.285860388563954, 1.2980857704666733 ], [ 0.868763565064127, 0.8646596858181304, 0.8612202466938229, 0.8584789541150696, 0.856467313417741, 0.8552140893554415, 0.8547447313828633, 0.8550807707106768, 0.8562391992990053, 0.8582318448532611, 0.861064760603774, 0.8647376542746743, 0.8692433872279788, 0.874567582253436, 0.8806883865905893, 0.8875764447897867, 0.8951951424046882, 0.9035011833954484, 0.9124455568197696, 0.9219749253507632, 0.9320334224027418, 0.9425647727691195, 0.9535145604266653, 0.9648323793271892, 0.9764735559244421, 0.9884001632063736, 1.000581168167843, 1.012991738443662, 1.0256119131453534, 1.038424949493648, 1.0514156609528942, 1.0645689858042484, 1.077868915757297, 1.091297814566171, 1.104836088076787, 1.1184621326705586, 1.1321524813673511, 1.145882075331302, 1.1596246038576983, 1.1733528719177928, 1.1870391679340844, 1.2006556147470866, 1.2141744939520698, 1.2275685385787325, 1.240811192141037, 1.2538768339577555, 1.2667409717503062, 1.2793804031445992, 1.2917733480256746, 1.3038995538351283 ], [ 0.8748800815546117, 0.8709511226667721, 0.8676833190518644, 0.8651093554919295, 0.8632596531462524, 0.8621618396342808, 0.8618401877488181, 0.8623150304856975, 0.8636021632752972, 0.8657122481781576, 0.8686502394290265, 0.8724148551191833, 0.8769981259811827, 0.8823850590379607, 0.8885534609074462, 0.8954739719485787, 0.9031103665291431, 0.9114201736158054, 0.9203556612581247, 0.9298652028202145, 0.9398949970359453, 0.9503910475588427, 0.961301229724985, 0.9725772047889921, 0.9841759159318578, 0.9960604415956481, 1.00820009236081, 1.0205697879879507, 1.0331488907063766, 1.045919752579369, 1.0588662396777226, 1.0719724384692042, 1.0852216639668806, 1.0985958066852624, 1.112074994915437, 1.1256375151182596, 1.1392599222782966, 1.152917276100848, 1.166583450350639, 1.180231475894923, 1.1938338900290375, 1.2073630742197716, 1.2207915694003841, 1.2340923627908953, 1.247239143421273, 1.260206525583233, 1.272970240700912, 1.2855072988635534, 1.297796121688321, 1.3098166484018665 ], [ 0.8812678098193267, 0.8775162308409297, 0.8744220167174735, 0.8720167998150541, 0.8703298912311532, 0.86938776201553, 0.8692134970392005, 0.8698262298465094, 0.871240570019582, 0.8734660384010576, 0.8765065299955055, 0.8803598294956427, 0.885017210074145, 0.8904631521142818, 0.8966752244167705, 0.9036241751369188, 0.9112742815382298, 0.9195840038254702, 0.9285069749597646, 0.9379933310752454, 0.9479913428677291, 0.9584492487743876, 0.9693171261151399, 0.980548586641106, 0.9921020727028729, 1.0039415761226238, 1.016036699631189, 1.0283621031196917, 1.0408964853646843, 1.0536213143947926, 1.0665195244010253, 1.0795743543712588, 1.092768436841759, 1.106083177869038, 1.1194984169248192, 1.132992323521815, 1.1465414743040225, 1.1601210547208973, 1.1737051372715013, 1.187266998890951, 1.200779450387538, 1.2142151595195987, 1.227546955955627, 1.2407481111555831, 1.2537925895118869, 1.266655269282471, 1.2793121332602935, 1.2917404300064368, 1.3039188070046872, 1.3158274173988602 ], [ 0.8879126807582296, 0.8843403896878388, 0.8814211828957721, 0.879185616681389, 0.8776618741481104, 0.876875259076977, 0.8768476665781385, 0.8775970394453684, 0.8791368222943337, 0.8814754292792962, 0.8846157454568794, 0.8885546866486597, 0.8932828477999071, 0.8987842750282917, 0.9050364012045177, 0.9120101879494994, 0.9196705166381968, 0.9279768648119712, 0.9368842890551732, 0.9463447076812721, 0.9563084351360284, 0.9667258680706836, 0.9775491709013675, 0.9887337736118755, 1.0002394952490818, 1.0120311529208814, 1.0240786007979121, 1.0363562429500384, 1.0488421485417427, 1.0615169459767921, 1.0743626768270658, 1.0873617584004844, 1.1004961520007008, 1.1137467795376343, 1.1270931864907294, 1.1405134198840083, 1.1539840757918733, 1.1674804684902307, 1.1809768781897305, 1.1944468423803, 1.2078634644540853, 1.2211997209764789, 1.2344287551682132, 1.247524148816381, 1.2604601681637533, 1.2732119816252927, 1.2857558487190248, 1.2980692806016636, 1.310131173233069, 1.321921914581623 ], [ 0.8948003853316338, 0.8914087575164731, 0.8886654615519265, 0.8865999610407692, 0.8852393008718906, 0.8846076151756591, 0.8847256162408853, 0.8856100738348499, 0.8872732974500952, 0.8897226375700148, 0.8929600260672693, 0.8969815802306892, 0.9017772994533336, 0.9073308879259027, 0.9136197401004068, 0.9206151271310499, 0.9282826203110777, 0.9365827794551945, 0.9454721176359213, 0.9549043265659721, 0.9648317091954214, 0.9752067218787285, 0.9859834874953, 0.9971191174347502, 1.0085746880538609, 1.020315761373207, 1.0323124120380982, 1.044538803160759, 1.0569724203927615, 1.0695931110145378, 1.082382078606686, 1.0953209597624434, 1.108391069032555, 1.1215728544903476, 1.134845568649097, 1.1481871330533777, 1.1615741605089238, 1.1749820945450207, 1.1883854280457418, 1.2017579688578421, 1.21507312718678, 1.2283042062632479, 1.2414246834046394, 1.2544084730215204, 1.2672301664133792, 1.2798652455551198, 1.2922902697124474, 1.3044830348312424, 1.3164227063765164, 1.3280899267657795 ], [ 0.901916449800523, 0.8987063499018808, 0.8961393784093087, 0.894243896394094, 0.8930458076424996, 0.8925680820005253, 0.8928302638560667, 0.893847975629584, 0.8956324291188492, 0.8981899609243281, 0.9015216119047788, 0.9056227745434854, 0.9104829359906453, 0.9160855479549168, 0.9224080568451014, 0.9294221275432771, 0.9370940904142174, 0.9453856317364369, 0.9542547307516087, 0.9636568208198387, 0.9735461186670843, 0.9838770289000969, 0.9946054995284341, 1.0056901895423027, 1.017093321322823, 1.0287811311057742, 1.0407238917009831, 1.0528955471490942, 1.065273052121866, 1.0778355385392484, 1.0905634353459845, 1.1034376491103313, 1.1164388816481214, 1.1295471255916103, 1.1427413472650507, 1.1559993428353217, 1.1692977397407878, 1.1826121097748779, 1.1959171606177228, 1.2091869765850063, 1.2223952848573925, 1.23551572909333, 1.2485221373585864, 1.261388775429721, 1.2740905797183708, 1.2866033664301892, 1.2989040152729778, 1.3109706272191892, 1.3227826566434908, 1.3343210187012544 ], [ 0.9092463065175226, 0.9062181128818456, 0.903827416141985, 0.9021014714614675, 0.9010650454716792, 0.9007399561603917, 0.901144602004022, 0.9022934905465649, 0.904196779463435, 0.9068598463034007, 0.9102829064867259, 0.9144607025814829, 0.9193822910913854, 0.9250309555053633, 0.9313842754741345, 0.9384143806871168, 0.9460884130048884, 0.9543692101527821, 0.9632162074878797, 0.9725865306188747, 0.9824362225347616, 0.9927215188251819, 1.003400060991587, 1.014431929561842, 1.025780392371175, 1.03741229943397, 1.049298106919858, 1.0614115660828465, 1.0737291557339566, 1.086229360804941, 1.0988919028705355, 1.1116970145996545, 1.1246248253870157, 1.1376548969182294, 1.1507659210430892, 1.163935571835157, 1.1771404905306388, 1.1903563757184186, 1.2035581501454626, 1.2167201779180923, 1.2298165100314555, 1.2428211408104106, 1.255708262238891, 1.2684525069219217, 1.2810291734538988, 1.29341443029551, 1.305585495991321, 1.3175207948114889, 1.3292000877857195, 1.3406045797119472 ], [ 0.9167753598083688, 0.913928990615444, 0.9117140833785868, 0.9101567900069873, 0.9092807501709093, 0.9091066487109445, 0.9096517662674681, 0.9109295335619589, 0.9129491024266201, 0.9157149495777039, 0.9192265321442182, 0.9234780169000538, 0.9284581076878955, 0.9341499971931158, 0.940531469345094, 0.9475751762810549, 0.9552491078995154, 0.963517261422316, 0.97234050228683, 0.9816775862691941, 0.9914862878737489, 1.0017245558502141, 1.0123515993874312, 1.0233288047471276, 1.0346203962670053, 1.0461937872305425, 1.0580196087117653, 1.0700714480870297, 1.0823253636391903, 1.0947592613744392, 1.10735222345129, 1.1200838670808395, 1.1329337932406447, 1.1458811614404254, 1.1589044047348243, 1.1719810813438127, 1.1850878470465183, 1.1982005259157333, 1.2112942549501027, 1.2243436793363958, 1.2373231780698912, 1.2502071033997135, 1.2629700213259158, 1.275586943753222, 1.2880335457312766, 1.3002863634597648, 1.312322970461233, 1.324122130611693, 1.3356639276570619, 1.3469298715151008 ], [ 0.9244890466340866, 0.9218239872384246, 0.9197839773150911, 0.9183940736994016, 0.9176768048836609, 0.917651746728692, 0.9183350951882983, 0.919739246599574, 0.9218723985620885, 0.9247381870472, 0.9283353780093296, 0.9326576341953434, 0.9376933797420693, 0.9434257860457506, 0.9498329016520188, 0.9568879457560029, 0.9645597784357112, 0.9728135501691262, 0.9816115181377876, 0.9909139978454333, 1.0006803976664032, 1.0108702647730343, 1.0214442584616954, 1.032364966156009, 1.0435974911699955, 1.0551097686059547, 1.0668726012224552, 1.0788594428515006, 1.0910459854221775, 1.103409622089167, 1.1159288622517711, 1.1285827663159236, 1.1413504525947258, 1.1542107099466203, 1.1671417313110322, 1.1801209678479687, 1.193125092269232, 1.20613005336206, 1.21911120103226, 1.232043461411343, 1.244901543599533, 1.25766016253824, 1.270294265659412, 1.2827792539353289, 1.295091190541865, 1.3072069924817242, 1.3191046022035295, 1.3307631375502265, 1.3421630193447438, 1.3532860766376757 ], [ 0.9323728918636537, 0.9298882228020501, 0.9280218398946919, 0.9267977180555507, 0.9262372952735021, 0.9263590672036053, 0.9271781823326962, 0.9287060482872935, 0.930949962108175, 0.9339127796380815, 0.9375926414075315, 0.9419827743292475, 0.947071389801234, 0.9528416990278096, 0.9592720649305799, 0.9663363062752145, 0.9740041629048688, 0.9822419207405682, 0.9910131814288534, 1.0002797449682534, 1.0100025562731132, 1.020142651615445, 1.0306620321795315, 1.041524393191073, 1.052695650024602, 1.0641442260947245, 1.0758410968290688, 1.0877596134475445, 1.0998751538004001, 1.1121646614116436, 1.1246061371718805, 1.1371781422310527, 1.1498593583899162, 1.1626282369553524, 1.1754627515809957, 1.1883402572566473, 1.2012374475729364, 1.214130396003684, 1.22699466387086, 1.2398054571570023, 1.2525378155656313, 1.2651668194389682, 1.2776678027334702, 1.29001656283136, 1.3021895603032663, 1.314164103728881, 1.3259185163103098, 1.3374322822989786, 1.3486861722496133, 1.3596623468649731 ], [ 0.9404125581127654, 0.9381069833144077, 0.9364126076509942, 0.9353523416520283, 0.9349465576545047, 0.9352127036456575, 0.9361649209713545, 0.9378136763921843, 0.9401654209980395, 0.943222290512372, 0.9469818633684144, 0.9514369943935075, 0.9565757426804554, 0.9623814118500772, 0.9688327189268728, 0.9759041039219903, 0.9835661854577483, 0.991786358096652, 1.000529514630639, 1.0097588623352047, 1.0194367879060224, 1.0295257141478438, 1.0399888855669295, 1.050791022445, 1.0618987948044505, 1.0732810876358705, 1.084909053303455, 1.096755971363251, 1.1087969555932518, 1.12100855988465, 1.1333683379235204, 1.1458544072991317, 1.1584450589736046, 1.1711184405211812, 1.1838523285975007, 1.1966239945708388, 1.2094101582513919, 1.2221870185920571, 1.2349303469462947, 1.2476156274482757, 1.26021822968318, 1.272713600414257, 1.2850774632164603, 1.2972860170620568, 1.3093161269805431, 1.3211455017489948, 1.332752855112963, 1.3441180482936859, 1.3552222125318307, 1.3660478511883398 ], [ 0.9485938902139289, 0.9464657650168661, 0.9449414554241876, 0.9440428289012694, 0.9437892204529296, 0.9441970658889213, 0.945279541947961, 0.9470462235823138, 0.9495027705006203, 0.9526506567858604, 0.9564869588862219, 0.961004218295035, 0.9661903954995894, 0.9720289309254545, 0.9784989262213396, 0.9855754549027194, 0.993230004772907, 1.0014310455712676, 1.010144704278945, 1.019335518366463, 1.0289672256141593, 1.0390035401845277, 1.0494088607604342, 1.0601488596564015, 1.071190912443049, 1.082504344602407, 1.0940604921868418, 1.1058325936303102, 1.1177955462172027, 1.1299255708884135, 1.1421998322871894, 1.1545960579049883, 1.1670921925276745, 1.1796661139463382, 1.19229542503711, 1.2049573273782614, 1.2176285735534638, 1.2302854896168784, 1.242904055838168, 1.2554600324628296, 1.267929117329235, 1.2802871232716562, 1.2925101648711437, 1.3045748459550381, 1.3164584410661955, 1.3281390657875973, 1.3395958322537678, 1.3508089873884448, 1.361760032389311, 1.372431822759647 ], [ 0.9569029544748688, 0.954950313120525, 0.9535938342501882, 0.9528543667719755, 0.9527502394616002, 0.9532969136331566, 0.9545066453438898, 0.9563881671716488, 0.9589464011657605, 0.9621822159997822, 0.9660922424889233, 0.9706687622629779, 0.9758996842417342, 0.9817686223311309, 0.9882550851093749, 0.9953347838954265, 1.0029800592901408, 1.0111604180892337, 1.0198431627904694, 1.0289940856510875, 1.0385781898086301, 1.0485603931574217, 1.0589061682984338, 1.069582075277976, 1.0805561532768837, 1.0917981518301625, 1.1032795992395683, 1.1149737226413323, 1.1268552479295948, 1.1389001165125363, 1.1510851590031341, 1.1633877638742742, 1.1757855730869968, 1.1882562283422577, 1.2007771825003999, 1.2133255821608864, 1.2258782202773295, 1.2384115524325985, 1.2509017670720324, 1.2633248983718826, 1.2756569701443272, 1.2878741598483487, 1.2999529730148403, 1.3118704199084648, 1.3236041878210605, 1.3351328038842212, 1.3464357846251929, 1.3574937696376996, 1.3682886376950207, 1.3788036044090641 ], [ 0.9653260729571331, 0.9635466552995718, 0.962355503789183, 0.9617724758918008, 0.9618149273947462, 0.962497384292993, 0.9638312265579385, 0.965824393492915, 0.9684811217131258, 0.9718017279393916, 0.9757824496128596, 0.9804153566251524, 0.9856883469785225, 0.9915852376822624, 0.9980859593891185, 1.0051668589648188, 1.0128011082720336, 1.0209592100617744, 1.0296095834450003, 1.0387192027964167, 1.0482542563325532, 1.0581807854521716, 1.0684652646192867, 1.0790750850333597, 1.089978913657752, 1.1011469114174914, 1.112550808678228, 1.12416385015628, 1.1359606329949425, 1.1479168693371389, 1.160009107716051, 1.172214446258128, 1.1845102659871316, 1.1968740057038902, 1.2092829922873163, 1.221714332913636, 1.2341448693979622, 1.2465511900473008, 1.2589096911866875, 1.271196678757626, 1.2833884998276412, 1.2954616941753254, 1.3073931570189883, 1.319160305178111, 1.3307412402971004, 1.3421149040826883, 1.3532612217281965, 1.3641612307751827, 1.3747971935824406, 1.385152692336286 ], [ 0.973849853063056, 0.9722411302912429, 0.9712125597065089, 0.9707830365071295, 0.9709689782748715, 0.9717840157334805, 0.9732386974109901, 0.9753402175174474, 0.9780921774634577, 0.9814943923420231, 0.9855427542306887, 0.990229164168216, 0.9955415439132949, 1.0014639368899727, 1.007976704862644, 1.0150568227264505, 1.0226782683312652, 1.0308124976615756, 1.0394289884208054, 1.0484958278679415, 1.057980314647864, 1.0678495404986583, 1.0780709171597467, 1.0886126171876163, 1.0994439046848206, 1.110535342344376, 1.1218588732139105, 1.1333877873553926, 1.145096593378968, 1.1569608214174274, 1.168956786938064, 1.1810613440264606, 1.1932516531251316, 1.2055049826667041, 1.2177985576584562, 1.2301094619719932, 1.242414595547837, 1.254690683340558, 1.2669143297505612, 1.2790621104575008, 1.2911106928042368, 1.3030369759331801, 1.3148182424970032, 1.326432314728296, 1.3378577087780785, 1.3490737823908707, 1.360060872088402, 1.3708004170351578, 1.3812750676337624, 1.391468777641168 ], [ 0.9824612127606116, 0.9810204119874626, 0.9801514564457107, 0.9798723097916123, 0.9801984871883738, 0.9811427644622036, 0.9827149028634224, 0.9849213983057866, 0.9877652648659628, 0.991245862989803, 0.9953587831401524, 1.0000957953768905, 1.0054448744107927, 1.0113903078477555, 1.0179128924946064, 1.0249902196546905, 1.0325970453429933, 1.0407057355108351, 1.0492867701234672, 1.0583092839441026, 1.0677416169959626, 1.0775518448157269, 1.087708258567561, 1.0981797682991634, 1.1089362089959223, 1.1199485379288674, 1.131188921892819, 1.1426307228335326, 1.1542483986834815, 1.1660173419491715, 1.177913681243896, 1.1899140706193312, 1.2019954887392628, 1.2141350654418148, 1.2263099479051933, 1.2384972132362944, 1.250673829433964, 1.2628166627120194, 1.27490252626576, 1.2869082637227405, 1.2988108596099233, 1.3105875690099507, 1.3222160589627348, 1.3336745549061868, 1.3449419863801428, 1.355998127219634, 1.3668237264522114, 1.377400627034738, 1.3877118703897493, 1.3977417854162257 ], [ 0.9911474018008575, 0.989871529421898, 0.9891590258449192, 0.9890269549968805, 0.9894899659372056, 0.9905600198275518, 0.9922461339007977, 0.9945541508315627, 0.9974865426298974, 1.001042258638101, 1.0052166272877014, 1.010001320835601, 1.0153843912028955, 1.0213503831545376, 1.027880528285452, 1.0349530195891479, 1.0425433618581221, 1.0506247880299102, 1.0591687262525826, 1.068145297477182, 1.0775238194939574, 1.0872732912380874, 1.0973628314920394, 1.1077620491036988, 1.1184413273945688, 1.1293720129578544, 1.1405265075703828, 1.1518782702983807, 1.1634017439597362, 1.1750722250836863, 1.1868656989704782, 1.1987586614213919, 1.2107279465698122, 1.2227505766060829, 1.2348036447445763, 1.2468642381724229, 1.2589094034590649, 1.2709161533370783, 1.2828615110597714, 1.2947225867275272, 1.306476678976068, 1.3181013950976979, 1.329574782856728, 1.3408754678037955, 1.351982790649764, 1.3628769401171021, 1.373539077562652, 1.3839514505054107, 1.3940974929624304, 1.4039619111783048 ], [ 0.9998960192957801, 0.9987818830627063, 0.9982224920455152, 0.9982340429270784, 0.9988303550924225, 1.0000226147411382, 1.0018191371043788, 1.0042251546768584, 1.0072426399224643, 1.0108701711893853, 1.0151028504718451, 1.0199322810665046, 1.0253466119780077, 1.0313306540325384, 1.0378660699992766, 1.0449316376051503, 1.0525035802600808, 1.0605559558181108, 1.0690610891515298, 1.077990030207519, 1.0873130161249622, 1.09699991448382, 1.1070206252831378, 1.1173454219939112, 1.1279452168664368, 1.1387917420903828, 1.1498576456171041, 1.1611165075278351, 1.1725427888739295, 1.1841117292513583, 1.1957992116394576, 1.2075816132230872, 1.2194356593074287, 1.231338294502363, 1.243266581655317, 1.2551976350828242, 1.2671085909341033, 1.278976614325118, 1.290778940381784, 1.3024929445777123, 1.3140962367038986, 1.3255667723651559, 1.3368829759327268, 1.3480238692611142, 1.3589692010792824, 1.3696995726905423, 1.3801965563848368, 1.3904428037259944, 1.4004221415892226, 1.4101196544690509 ], [ 1.008695028025099, 1.0077392578150166, 1.0073294831283268, 1.0074810661974307, 1.008207032925817, 1.0095178334059134, 1.0114211213797728, 1.0139215600507214, 1.017020662049822, 1.0207166714831255, 1.025004495743333, 1.0298756940675988, 1.0353185285730135, 1.0413180816331145, 1.0478564409424713, 1.0549129504839065, 1.0624645219799358, 1.0704859974981233, 1.0789505500171397, 1.0878301053685846, 1.097095766520456, 1.106718220106682, 1.1166681057657502, 1.1269163313545227, 1.1374343213064577, 1.1481941908862197, 1.159168845211569, 1.170332007916935, 1.181658189503114, 1.1931226091951141, 1.204701086208425, 1.216369916665019, 1.2281057512085227, 1.2398854860124904, 1.2516861768055165, 1.2634849821947103, 1.2752591393356347, 1.2869859721499561, 1.2986429299985758, 1.310207653047455, 1.3216580594974523, 1.3329724493226949, 1.344129619072985, 1.3551089825368994, 1.3658906925296495, 1.3764557596741125, 1.3867861647124469, 1.3968649615665885, 1.4066763690204596, 1.4162058495022407 ], [ 1.0175327658326285, 1.0167318331226494, 1.0164680398910722, 1.0167559467080116, 1.0176078216598892, 1.0190334164891401, 1.021039762271556, 1.0236309915360844, 1.026808193993903, 1.0305693130347693, 1.0349090897928792, 1.0398190608025848, 1.0452876139911293, 1.0513001059440654, 1.057839041022183, 1.0648843100563337, 1.0724134831186924, 1.0804021474734642, 1.0888242785360356, 1.0976526288736659, 1.1068591183447725, 1.1164152077488871, 1.126292239089865, 1.1364617278168985, 1.14689559606229, 1.1575663405870638, 1.1684471343505063, 1.1795118657293304, 1.1907351238445403, 1.2020921417490391, 1.213558711122517, 1.2251110825619929, 1.2367258646914814, 1.2483799334300585, 1.260050360212882, 1.2717143651231881, 1.2833492980875962, 1.294932648760119, 1.3064420836313935, 1.3178555073242635, 1.3291511439794863, 1.3403076340526083, 1.3513041416590268, 1.3621204677316152, 1.3727371646073767, 1.3831356481559118, 1.3932983041398643, 1.403208586103069, 1.4128511026795134, 1.4222116927802606 ], [ 1.026397954456983, 1.0257481905365635, 1.025626622152151, 1.0260470407289952, 1.027020991436189, 1.028557564135659, 1.0306632042452704, 1.0333415499242, 1.036593302134925, 1.0404161340203006, 1.0448046455900357, 1.049750368878537, 1.055241827465835, 1.061264652519584, 1.067801755327656, 1.0748335537086706, 1.082338246831749, 1.0902921300373252, 1.0986699384799183, 1.1074452061111502, 1.116590624996199, 1.1260783894831798, 1.1358805105045393, 1.1459690873228774, 1.1563165272111984, 1.1668957075809425, 1.1776800795092455, 1.188643715977952, 1.199761311943976, 1.2110081462373752, 1.2223600170014564, 1.2337931628918388, 1.2452841816418463, 1.2568099560999006, 1.268347595740927, 1.279874399249615, 1.2913678413458924, 1.3028055847879156, 1.3141655165963047, 1.3254258060719484, 1.3365649811500957, 1.3475620190177775, 1.3583964466669785, 1.3690484470913877, 1.3794989670874362, 1.3897298230228743, 1.3997238014286952, 1.4094647518052827, 1.4189376695758158, 1.4281287676415024 ], [ 1.0352797061195673, 1.034777319090156, 1.0347941129333662, 1.0353431419565196, 1.0364352623604802, 1.0380789371717574, 1.0402800612722465, 1.0430418124506382, 1.0463645344481582, 1.0502456577680335, 1.05467966350987, 1.0596580946298786, 1.0651696177817795, 1.0712001372511488, 1.077732960477891, 1.0847490123358006, 1.0922270928190416, 1.1001441702455903, 1.1084756997453076, 1.1171959549050312, 1.1262783592453633, 1.135695803917759, 1.145420938768685, 1.155426425738594, 1.1656851463276714, 1.1761703583158198, 1.1868558007195165, 1.1977157496972464, 1.2087250313938784, 1.2198590002268166, 1.2310934926698684, 1.2424047671259184, 1.253769440065873, 1.2651644274215554, 1.276566898483321, 1.2879542475202492, 1.2993040862440937, 1.3105942582690757, 1.3218028750141864, 1.332908371133044, 1.3438895765665952, 1.3547258016857964, 1.3653969316855954, 1.3758835263537526, 1.386166921508368, 1.396229328717944, 1.4060539303342128, 1.4156249673381782, 1.4249278179876237, 1.4339490657352376 ], [ 1.0441675281670968, 1.0438086187910625, 1.043959820838517, 1.0446334828580293, 1.0458398049400104, 1.0475866568054815, 1.0498794160076461, 1.052720831704049, 1.0561109194240967, 1.0600468919849975, 1.0645231311565913, 1.0695312038062803, 1.075059925049464, 1.0810954693878734, 1.0876215289692768, 1.094619516014597, 1.1020688042425628, 1.1099470019306645, 1.1182302472721237, 1.1268935151290336, 1.1359109233454072, 1.1452560266349503, 1.1549020867962414, 1.16482230963354, 1.1749900413672496, 1.1853789202925027, 1.1959629826952918, 1.2067167252341497, 1.2176151288223176, 1.2286336512426317, 1.2397481971269364, 1.2509350744774637, 1.2621709466453055, 1.2734327877420966, 1.2846978480312616, 1.2959436341276236, 1.3071479070280583, 1.318288699265242, 1.3293443509470275, 1.3402935631916388, 1.3511154665298961, 1.361789701219058, 1.3722965060728938, 1.3826168123184444, 1.3927323390914434, 1.402625687431382, 1.4122804299860658, 1.421681194045282, 1.4308137359608617, 1.4396650054505282 ], [ 1.0530513260378, 1.0528319025060884, 1.053113480908463, 1.0539077345867396, 1.0552242391863824, 1.057070303085956, 1.0594508178099635, 1.0623681334381652, 1.0658219639242206, 1.0698093269131659, 1.0743245220664837, 1.0793591510410543, 1.0849021811130828, 1.0909400529992694, 1.0974568317408642, 1.104434397648991, 1.1118526723643474, 1.1196898731949472, 1.1279227872240405, 1.136527055397633, 1.1454774560711711, 1.1547481774468529, 1.1643130690369476, 1.174145863736502, 1.1842203641844, 1.1945105896565367, 1.2049908825261582, 1.2156359760755953, 1.226421027886333, 1.2373216249566283, 1.2483137679548033, 1.259373842556678, 1.270478585667851, 1.2816050535959107, 1.2927305980615602, 1.3038328544901292, 1.3148897454709312, 1.325879500755606, 1.3367806937997457, 1.347572293708052, 1.358233730560685, 1.3687449714849937, 1.3790866044770964, 1.3892399268401134, 1.3991870351526627, 1.408910913868821, 1.4183955199404608, 1.427625861208048, 1.4365880666961561, 1.445269447351488 ], [ 1.061921404790026, 1.0618373964829801, 1.062245254196487, 1.0631560057054064, 1.0645786326168003, 1.0665199123435072, 1.0689842798095408, 1.0719737134793603, 1.0754876501495283, 1.0795229325797924, 1.0840737934460956, 1.0891318782535788, 1.0946863087511758, 1.1007237870548885, 1.1072287391548112, 1.114183494814789, 1.1215684991678623, 1.1293625496828168, 1.1375430507650022, 1.146086277199258, 1.1549676370774793, 1.164161924876201, 1.173643556012745, 1.1833867754959546, 1.1933658351144298, 1.2035551358201775, 1.213929334368449, 1.22446341564113, 1.2351327341964486, 1.2459130302704435, 1.256780426585498, 1.2677114128460634, 1.2786828247394686, 1.2896718236875622, 1.3006558826298948, 1.3116127819001893, 1.3225206179232707, 1.3333578261343793, 1.344103218305271, 1.354736033422473, 1.3652360004401314, 1.3755834106384757, 1.3857591969500072, 1.3957450174473187, 1.4055233401885217, 1.415077526753041, 1.4243919120383264, 1.4334518781939798, 1.4422439209166076, 1.450755706692829 ], [ 1.0707684694028514, 1.0708157397192877, 1.0713457262727122, 1.0723688399229547, 1.0738934973485756, 1.075925973794338, 1.078470275197209, 1.0815280338876427, 1.0850984318674268, 1.0891781552780733, 1.0937613830765776, 1.0988398121178866, 1.1044027198097965, 1.1104370642750956, 1.116927620567712, 1.123857150006309, 1.1312065981943136, 1.1389553158930954, 1.1470812957212513, 1.1555614167849917, 1.1643716889087503, 1.1734874882079058, 1.1828837763635913, 1.1925352971024639, 1.2024167449789793, 1.212502903473613, 1.2227687514927192, 1.2331895393981795, 1.2437408375286307, 1.2543985616493183, 1.2651389807792839, 1.275938713346859, 1.2867747176253985, 1.297624281959904, 1.308465019504906, 1.3192748711689486, 1.330032119316375, 1.340715413621078, 1.3513038093865422, 1.361776817706273, 1.3721144660780598, 1.382297367521514, 1.3923067958794662, 1.4021247647949036, 1.4117341078222125, 1.421118557226358, 1.4302628192162585, 1.4391526436211715, 1.4477748863255244, 1.456117563107519 ], [ 1.0795836240286574, 1.0797579823577195, 1.0804059048326289, 1.0815372130123158, 1.0831597864466065, 1.0852794254588018, 1.0878997328706197, 1.091022018497307, 1.0946452300135618, 1.098765913387833, 1.103378205491813, 1.1084738607076534, 1.1140423123873526, 1.1200707688871796, 1.1265443426466224, 1.1334462094619302, 1.1407577937960347, 1.1484589747584237, 1.156528306378348, 1.1649432450810298, 1.1736803769422994, 1.1827156374037033, 1.192024516701209, 1.20158224527462, 1.21136395481746, 1.2213448122875432, 1.2315001259887741, 1.2418054246005101, 1.2522365116237133, 1.262769499006054, 1.2733808246141782, 1.2840472586953846, 1.294745904518221, 1.3054541980441075, 1.316149910837192, 1.3268111595576737, 1.3374164244039017, 1.3479445778620387, 1.358374924165764, 1.368687249021691, 1.3788618784573745, 1.3888797451162476, 1.3987224599623442, 1.4083723871556537, 1.417812719800125, 1.4270275543264885, 1.43600196142634, 1.4447220516781967, 1.453175034276668, 1.461349267573217 ], [ 1.0883583703499997, 1.0886555832573837, 1.089417216554279, 1.0906525290468205, 1.092368889651936, 1.0945716495113638, 1.097264032546014, 1.1004470479356936, 1.104119427759742, 1.1082775926233268, 1.1129156475167894, 1.1180254094087685, 1.1235964671716314, 1.1296162734010649, 1.13607026656209, 1.1429420207214733, 1.1502134189813387, 1.157864845686981, 1.1658753916267877, 1.1742230658539183, 1.1828850075062665, 1.1918376911284345, 1.201057119523749, 1.2105189990638443, 1.2201988936001444, 1.2300723545629269, 1.2401150263836562, 1.2503027279050642, 1.2606115118295258, 1.271017705390629, 1.2814979362425822, 1.2920291480063308, 1.3025886099901824, 1.313153925349119, 1.3237030414207251, 1.3342142652524693, 1.3446662864967602, 1.3550382089750714, 1.3653095913683826, 1.3754604967313822, 1.3854715498889882, 1.39532400127626, 1.4049997954325941, 1.414481642153989, 1.4237530882283531, 1.4327985877119076, 1.441603568826249, 1.4501544957466073, 1.458438923789499, 1.4664455467759923 ], [ 1.0970846051681435, 1.0975004068636849, 1.0983715033206123, 1.0997066160640252, 1.1015126285916361, 1.103794467153343, 1.1065549994177468, 1.1097949541946093, 1.1135128651167532, 1.1177050407742268, 1.122365563233937, 1.1274863161725082, 1.133057043011842, 1.139065434501121, 1.1454972441710227, 1.1523364290464322, 1.1595653120004377, 1.1671647612338223, 1.175114381639191, 1.1833927123241053, 1.1919774243770727, 1.2008455130997393, 1.2099734794072599, 1.2193374958959315, 1.2289135541417642, 1.2386775910465218, 1.24860559339141, 1.2586736810858614, 1.268858170804823, 1.2791356227054478, 1.289482873636289, 1.29987706066543, 1.31029563885438, 1.320716397016981, 1.331117474774431, 1.341477383611264, 1.351775033920398, 1.361989769265929, 1.3721014083489305, 1.3820902944819409, 1.3919373517969797, 1.4016241469500144, 1.4111329547509062, 1.420446825939473, 1.429549655237036, 1.4384262478135295, 1.4470623824050985, 1.455444869478819, 1.4635616030501448, 1.471401604999182 ], [ 1.1057546173269108, 1.1062847194758048, 1.1072610178994269, 1.108691721241523, 1.110583251546265, 1.1129401330761253, 1.1157648984255195, 1.1190580148082623, 1.1228178331222831, 1.1270405619891972, 1.131720268429085, 1.136848906167031, 1.1424163717929223, 1.1484105881339746, 1.154817613284433, 1.1616217728142977, 1.1688058118001308, 1.1763510625445162, 1.1842376232352736, 1.192444542395255, 1.200950003832154, 1.2097315069424999, 1.218766037658944, 1.2280302260363445, 1.237500487403868, 1.2471531451012183, 1.256964533983803, 1.2669110850350402, 1.2769693924759136, 1.287116265638307, 1.2973287685133075, 1.3075842502672044, 1.3178603701322844, 1.3281351199436875, 1.338386847246309, 1.3485942813877225, 1.3587365644012575, 1.3687932878247502, 1.378744535947158, 1.3885709353693922, 1.398253710239862, 1.407774742099312, 1.4171166329540308, 1.426262769992079, 1.4351973902571422, 1.4439056435889144, 1.452373652211543, 1.4605885654882407, 1.4685386085438876, 1.4762131236728997 ], [ 1.1143610840557336, 1.1150011849896289, 1.1160784191517903, 1.1176005056483589, 1.1195734278306342, 1.1220013295634497, 1.1248864281714674, 1.1282289466750546, 1.1320270676484856, 1.136276910636804, 1.140972534554991, 1.1461059658718984, 1.151667252666295, 1.157644543858584, 1.1640241920999157, 1.1707908779813543, 1.177927752455793, 1.185416593693495, 1.1932379740685206, 1.2013714326424925, 1.2097956484086225, 1.2184886097039884, 1.227427775591827, 1.2365902256414376, 1.2459527953492902, 1.2554921953958793, 1.265185113947787, 1.2750083022176326, 1.2849386444138438, 1.294953213982463, 1.3050293186179571, 1.3151445368711003, 1.325276749303735, 1.3354041670448917, 1.3455053603222433, 1.3555592891172707, 1.3655453375704996, 1.375443353193035, 1.3852336913671268, 1.3948972650800933, 1.40441559936174, 1.4137708895048413, 1.422946061853428, 1.4319248357451333, 1.44069178509052, 1.449232398053455, 1.4575331333514452, 1.4655814718105082, 1.4733659619697226, 1.4808762587248554 ], [ 1.122897066798192, 1.1236428601765034, 1.1248167668227764, 1.126426038618474, 1.1284762418273484, 1.1309711602654868, 1.1339127145145864, 1.1373008995469727, 1.141133742851668, 1.145407284767175, 1.1501155822401024, 1.1552507366496803, 1.1608029456803295, 1.1667605785127186, 1.1731102728655154, 1.179837051693744, 1.1869244566735637, 1.1943546950214516, 1.2021087957493586, 1.2101667711832216, 1.2185077794982275, 1.2271102841653465, 1.2359522065600645, 1.245011068537349, 1.2542641224928615, 1.263688467260051, 1.2732611490766477, 1.2829592477285077, 1.2927599487821984, 1.30264060349561, 1.3125787785079799, 1.3225522977324857, 1.3325392789985684, 1.3425181679283675, 1.35246777130498, 1.3623672918343352, 1.3721963657575313, 1.381935104277011, 1.3915641392578761, 1.401064673188119, 1.4104185329552663, 1.4196082266415704, 1.4286170022650384, 1.437428907205504, 1.446028846949463, 1.4544026417603486, 1.462537079921412, 1.4704199662957285, 1.4780401650893256, 1.4853876358776021 ] ], "zauto": true, "zmax": 1.4853876358776021, "zmin": -1.4853876358776021 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.08865474003933976, 0.08342839664331758, 0.07821294939931193, 0.07303002915227985, 0.06790384450566188, 0.06286152123998145, 0.05793352189838446, 0.05315415808239382, 0.048562191678919044, 0.04420147713670703, 0.04012149742952171, 0.03637744991052444, 0.033029207332010785, 0.03013805814262628, 0.027759928018158086, 0.025934559471564273, 0.024672695997687184, 0.023946906841912884, 0.0236926208227722, 0.023821043388575824, 0.024238253771585443, 0.024862084800976257, 0.025631845801932344, 0.02651079155537602, 0.027483747661560944, 0.028552476809346063, 0.029730586261434343, 0.031038934160655826, 0.03250187700450809, 0.03414433985347214, 0.03598954792571693, 0.03805727043967226, 0.04036251066291357, 0.042914649187523135, 0.0457170651208291, 0.04876722382557262, 0.05205716205355471, 0.05557425595733382, 0.0593021420175923, 0.06322167401444871, 0.06731182898070148, 0.0715505087933885, 0.07591521310862975, 0.08038358019458497, 0.08493380490786984, 0.08954494932767186, 0.09419716351255603, 0.09887183326946726, 0.10355167000215738, 0.1082207554418016 ], [ 0.08764538901809589, 0.08236715846489713, 0.07709585054885022, 0.07185243950151031, 0.06666033218182903, 0.06154568456848354, 0.05653780670372722, 0.0516696830350311, 0.04697863168418655, 0.042507103038146116, 0.03830354766432958, 0.03442311316937769, 0.03092757852306525, 0.02788334300542814, 0.025355624841083193, 0.023397128064081202, 0.022031941031686264, 0.021240866802132483, 0.020958317430979943, 0.021086038918793477, 0.021517225868533895, 0.022158573279906273, 0.022942553490945313, 0.02382988796210778, 0.024805921253413587, 0.025874549353584502, 0.027052014150626066, 0.028361647324288915, 0.02982983573244448, 0.031483044235473934, 0.033345592352294735, 0.03543794481086188, 0.0377754225180062, 0.0403673566584522, 0.043216736888431, 0.04632035574901593, 0.049669375360687065, 0.053250186170920095, 0.0570454113676528, 0.06103492937709547, 0.06519682376118316, 0.06950820885328002, 0.07394591119250715, 0.07848700823299364, 0.08310923786315567, 0.08779129746700552, 0.09251305214724591, 0.09725567029748705, 0.10200170227746191, 0.106735115283898 ], [ 0.08677881298266737, 0.08145958351549133, 0.07614422850438093, 0.07085314763273891, 0.06560902279863746, 0.060437098735368754, 0.05536555036154574, 0.05042597214764239, 0.045654031966705595, 0.04109032889415632, 0.03678145898737461, 0.03278117371834939, 0.029151209411211954, 0.025960718505904815, 0.023282188454070974, 0.021180904117141675, 0.019696578379810353, 0.01882243520879029, 0.018495465880073926, 0.01860918609057128, 0.019043316065242167, 0.019692535233390172, 0.020482143632416117, 0.021370501778652184, 0.022343800978996617, 0.023408259131183662, 0.02458267161804947, 0.025892507515157145, 0.027365694659089914, 0.02902971939999413, 0.030909545387428947, 0.033025999078214734, 0.03539450657114967, 0.03802423928943024, 0.04091776373811139, 0.04407122057219658, 0.04747495628548073, 0.05111446013193275, 0.05497144180050262, 0.05902491082177663, 0.06325216339155725, 0.06762962680503143, 0.07213354593666849, 0.07674051796346658, 0.08142789281666377, 0.0861740609369948, 0.09095864977376682, 0.09576264825134026, 0.10056847546071461, 0.10536000684212653 ], [ 0.086054125462572, 0.08070486802006571, 0.07535743890717206, 0.07003178215989865, 0.06474998504986179, 0.05953651721912123, 0.0544185475149209, 0.04942637618808279, 0.04459403396077206, 0.03996011134296756, 0.03556887687136638, 0.03147168078751492, 0.027728421431520732, 0.024408273354701405, 0.021587672060314398, 0.019341872176189667, 0.017726288261955655, 0.016750092106185215, 0.016357704777560114, 0.016437592708738614, 0.016856925853062768, 0.0174983735914685, 0.018280170110468046, 0.019158634382093347, 0.020121069019328936, 0.021175993641271366, 0.022344382653630125, 0.02365318982612325, 0.02513111091065277, 0.026805923774872276, 0.02870266061316298, 0.03084212827863646, 0.03323965491495853, 0.035904184861768156, 0.038837885586778864, 0.04203632637210466, 0.04548915064044402, 0.049181074585260255, 0.053093026673288114, 0.057203275883018705, 0.0614884499717445, 0.06592439540593112, 0.07048686737391846, 0.07515206036026956, 0.07989700027666877, 0.08469982218588888, 0.0895399565874653, 0.09439824432695713, 0.09925699676925151, 0.10410001461292026 ], [ 0.08546920925626987, 0.08010075245194062, 0.0747331044968076, 0.06938589543612483, 0.06408078403352614, 0.058841656782811926, 0.05369489185420477, 0.04866972352364803, 0.04379875906615799, 0.03911871976966857, 0.034671492835045996, 0.030505563836330945, 0.02667777026310212, 0.023254879029509193, 0.020313371991819346, 0.01793372725679331, 0.01618368808883348, 0.015089114107945754, 0.01460670731714495, 0.014625472936174074, 0.015003700832624409, 0.015613892648338751, 0.016368178059170815, 0.017221351615738723, 0.018161924025311322, 0.019200346824360337, 0.02035898062873485, 0.0216652063280698, 0.023147384963410275, 0.024832635296075278, 0.026745371722427018, 0.028905976212924112, 0.03132950683783321, 0.03402467113916352, 0.036993325920989015, 0.04023060879674089, 0.04372562108311849, 0.047462469843354935, 0.051421458293979046, 0.055580256578297356, 0.0599149482859807, 0.06440090486869787, 0.06901347966627494, 0.07372853574163661, 0.0785228315822974, 0.08337429084148121, 0.08826218040522434, 0.0931672175662459, 0.09807162327470556, 0.10295913494273262 ], [ 0.0850207944961701, 0.07964360640379643, 0.07426720471228604, 0.06891105322331148, 0.06359656167241137, 0.05834725101982611, 0.05318897041188443, 0.04815019674628914, 0.043262463691665115, 0.03856098819948215, 0.034085585366353095, 0.029881969477204638, 0.02600347202530585, 0.022512904579236916, 0.01948338869259007, 0.016994948280513657, 0.015120960971010317, 0.013900021079405002, 0.013303378747094322, 0.013227702606752942, 0.01352971908227972, 0.01407658807116899, 0.014776759479120922, 0.01558436813853551, 0.016489008525816636, 0.017502243221195975, 0.01864652343642803, 0.019948150446394298, 0.02143371591426877, 0.02312853419013369, 0.025055639569371787, 0.027234587869717688, 0.029680040383291258, 0.03240051727993855, 0.03539771008348394, 0.03866651188907707, 0.042195678254002805, 0.045968894538668266, 0.049966007878347214, 0.05416423639767534, 0.058539243082184285, 0.06306602571033047, 0.0677196170048666, 0.0724756123268124, 0.07731055163466141, 0.08220218377689861, 0.08712963859672994, 0.09207352830344419, 0.09701599541369471, 0.10194072086865937 ], [ 0.08470457631352937, 0.07932856587368053, 0.07395423560607074, 0.06860102000573082, 0.06329024910155234, 0.05804528858541249, 0.052891719823736014, 0.04785758517654522, 0.0429737375906847, 0.03827435185942167, 0.033797676059759287, 0.029587113118127714, 0.025692680924875207, 0.022172679489635416, 0.019094693324629736, 0.016533374087663776, 0.014559814506695672, 0.013217221819854772, 0.012488866121301491, 0.012284947905227375, 0.012470583473308998, 0.012915785153285616, 0.013529795245054816, 0.014267652412505325, 0.015119849738955304, 0.01609786254051634, 0.017222487300718854, 0.018517053641459134, 0.020004694724408693, 0.021707655322294846, 0.023646804327453825, 0.025840497155565505, 0.028302914581443427, 0.031042480531323014, 0.03406090103210921, 0.037353037756862065, 0.04090751473396656, 0.044707793763962576, 0.04873343982575182, 0.05296136604667589, 0.057366935444830416, 0.0619248686587719, 0.0666099533147681, 0.07139757486715423, 0.07626409793776048, 0.08118712793429779, 0.08614567955406024, 0.09112027430500266, 0.09609298472082718, 0.10104743905876591 ], [ 0.0845153663522192, 0.07914971569500194, 0.07378743090753621, 0.06844802852058489, 0.06315289711799381, 0.05792542008822782, 0.052791128356132117, 0.047777902872885684, 0.04291625683647892, 0.03823974083535215, 0.03378552772836004, 0.029595236856089772, 0.02571601337386484, 0.022201690576167044, 0.019113307175168848, 0.01651697015752415, 0.01447507664294367, 0.013026676896556623, 0.012160785856860843, 0.011802919703769258, 0.011835500054690364, 0.012141130178427216, 0.012636181166648122, 0.013279271817021966, 0.01406200555571124, 0.01499455808193565, 0.016094156335842828, 0.017379108185686373, 0.018867326105949, 0.02057672492434295, 0.022525261393084257, 0.02472975181173627, 0.027203832078029733, 0.029955927578300724, 0.032987939887538786, 0.036294913171885886, 0.03986555593963102, 0.043683306841665534, 0.04772762455131008, 0.05197526530582274, 0.05640141295372368, 0.06098060693576122, 0.06568746421866756, 0.07049721681127598, 0.07538609578781914, 0.08033159312225219, 0.08531262901419956, 0.09030964753697582, 0.09530465871161718, 0.10028124104314219 ], [ 0.08444727010970118, 0.07910030644001921, 0.07375902987214777, 0.06844311393628577, 0.06317409771962346, 0.057975496076550476, 0.0528729310040115, 0.047894298184444406, 0.04306998900243312, 0.03843319508447255, 0.034020325684213565, 0.029871556175773813, 0.026031466939327265, 0.022549551156638335, 0.019479919706384092, 0.016878630977845404, 0.014795916303008085, 0.013260924816427537, 0.012262349926379855, 0.01173897550760894, 0.01159476499086914, 0.011732461837072257, 0.012082070502613772, 0.012609429284396968, 0.013308301510827273, 0.01418686628349619, 0.015257159475909568, 0.01653062529256195, 0.018018380432233517, 0.01973290450704789, 0.021688588803678962, 0.023900398301346902, 0.026381340575386037, 0.029139904099238858, 0.03217833448382566, 0.03549205187944024, 0.03907005716264017, 0.04289596696269232, 0.04694931518560968, 0.051206857027119, 0.05564372598932296, 0.060234383676222504, 0.0649533572996147, 0.06977578734647234, 0.07467781766714077, 0.07963686053892034, 0.08463176536549027, 0.08964291454485782, 0.09465226508629752, 0.09964335032518348 ], [ 0.08449388058588364, 0.07917299287922051, 0.07386057410094553, 0.06857648767136722, 0.06334246094993572, 0.05818218383812194, 0.053121419543716575, 0.04818813534249645, 0.04341266328909819, 0.03882790067357102, 0.03446955247496527, 0.03037639095891228, 0.026590434193732006, 0.02315677379594461, 0.0201224360050278, 0.017533111089147513, 0.015426152783459966, 0.013819157986245617, 0.012697515150206564, 0.01201018003030984, 0.011682105595461895, 0.011639034111581481, 0.011828901071537778, 0.012228242622222949, 0.012834711295157201, 0.013654590532848994, 0.014693793977149615, 0.01595562382902579, 0.01744325959653522, 0.01916292191791386, 0.02112490961237129, 0.023342030753178297, 0.02582652374147447, 0.028586929432059937, 0.03162592775575101, 0.03493947418862619, 0.038517057924202784, 0.042342678520885434, 0.04639613958444312, 0.05065436807870974, 0.05509259373452173, 0.05968532043830228, 0.06440708150082146, 0.06923300070632518, 0.0741391919030668, 0.0791030305028887, 0.08410332634537353, 0.0891204221186114, 0.09413623642241181, 0.0991342661923039 ], [ 0.08464847812121844, 0.0793600801980798, 0.07408321419046211, 0.06883792380427754, 0.06364610802722045, 0.0585316054331324, 0.053520280430284, 0.048640112658441426, 0.04392128871931363, 0.03939628887712693, 0.03509994472260084, 0.031069406171307882, 0.027343878320444222, 0.023963843235333113, 0.02096925192861493, 0.018395927640313836, 0.01626949655350383, 0.01459729478808819, 0.013361439660573887, 0.012518955432846882, 0.01201298306799502, 0.011791144568479819, 0.011820392499843577, 0.012089987891482246, 0.012603101628420219, 0.013364780571854449, 0.014374641312459153, 0.015627283451630808, 0.01711736143487063, 0.018844347837868033, 0.020814052265090463, 0.023036808478755527, 0.02552386418761947, 0.02828370923659823, 0.031319475096531005, 0.034627768917586406, 0.0381987489435631, 0.04201700767938204, 0.04606283025605638, 0.050313511483410074, 0.05474454875916225, 0.05933063228189294, 0.06404641898638262, 0.06886710971626062, 0.0737688617216623, 0.07872907000188563, 0.08372654742370135, 0.08874162834912885, 0.09375621535383856, 0.09875378416441905 ], [ 0.08490422659511898, 0.07965376464349035, 0.07441800785081004, 0.06921713233649027, 0.0640731440031175, 0.05900994339701582, 0.05405338074602887, 0.04923129560110636, 0.044573529908537704, 0.040111891897204974, 0.03588002592408477, 0.031913102554060206, 0.02824717374480769, 0.024917935090287707, 0.021958524774721606, 0.019395975995834563, 0.017246288976417765, 0.015509149023734256, 0.014164997197901203, 0.01317805666676543, 0.012506751240088156, 0.012117726378977374, 0.011995672719925233, 0.012142803048190189, 0.012568644781230409, 0.013277708935606241, 0.014263638605571118, 0.015512384917894964, 0.017009995362705997, 0.018749009348480086, 0.020730463189897567, 0.02296188130891164, 0.025453217730359523, 0.028212712714128573, 0.031243886860236204, 0.034544063100926496, 0.03810422496091354, 0.04190976566599314, 0.04594167655084006, 0.050177837797651864, 0.05459421104337002, 0.059165842399468746, 0.0638676540603095, 0.06867503940032928, 0.07356429145346287, 0.07851289753081159, 0.08349972989130994, 0.08850515751790028, 0.09351109900479912, 0.09850103210245184 ], [ 0.08525435720822665, 0.08004635688122663, 0.0748561936399492, 0.06970409757592824, 0.06461207974415582, 0.05960397154876568, 0.05470544141245855, 0.04994397685735477, 0.04534881200671937, 0.040950766424776026, 0.036781937713963514, 0.03287515364728695, 0.029263038992935884, 0.025976498927996215, 0.023042408468216237, 0.020480429018204776, 0.018299311703582843, 0.016493885261644338, 0.01504484371326298, 0.013923435635404822, 0.01310111648163979, 0.012560589237121129, 0.01230202879340294, 0.012339576048266632, 0.012689049023639874, 0.0133548125905812, 0.014325030058890516, 0.015577439278160849, 0.017089757763976535, 0.018847635300811422, 0.02084714380177828, 0.02309265836057988, 0.025592475709723526, 0.02835430563154382, 0.03138191529909023, 0.03467334375777129, 0.0382205143305089, 0.04200980850535707, 0.04602314563379401, 0.050239218046600254, 0.0546346646928054, 0.05918507715340942, 0.06386580531166233, 0.06865257055992346, 0.07352191246112716, 0.07845149969531788, 0.08342033450925519, 0.08840887568270346, 0.09339910028390926, 0.09837452013402088 ], [ 0.08569233268154772, 0.08053047875099348, 0.07538942812174441, 0.07028936558539478, 0.06525218202282794, 0.06030148289955069, 0.05546256099172329, 0.050762316347942954, 0.0462290972323069, 0.041892421524010674, 0.037782517326584504, 0.03392959465791426, 0.03036273309360479, 0.027108262971934107, 0.02418757555484842, 0.021614496510101125, 0.019392772029192474, 0.0175148053453923, 0.015963202006273252, 0.014716271123341177, 0.013756867557011242, 0.013081269232326833, 0.012702810213744465, 0.012645993862202812, 0.012932244144463144, 0.013565812598071499, 0.014529859990302754, 0.01579453422207498, 0.017329721739229226, 0.019114390474622996, 0.021139545720567036, 0.02340609776708781, 0.02592029773501073, 0.028688986002466492, 0.03171595959611969, 0.034999899864049513, 0.03853372205948008, 0.042304938602021946, 0.04629659186396396, 0.05048840167396729, 0.05485789736338559, 0.05938141305152721, 0.06403490055261014, 0.06879455853030265, 0.07363729798002791, 0.07854107161081783, 0.08348509478800792, 0.08844998250653029, 0.09341782266609332, 0.0983722018209462 ], [ 0.08621198663153601, 0.08109922691960163, 0.07600997842493615, 0.07096427091030186, 0.06598374007478361, 0.061091601481151836, 0.05631257667843795, 0.05167275111688807, 0.04719933445373932, 0.0429202815572497, 0.03886371742670878, 0.035057094758965346, 0.031526008879462185, 0.02829262276929892, 0.025373752071886437, 0.022778871329774946, 0.020508643335244544, 0.018554948223967017, 0.016903513266405535, 0.015539698028270828, 0.014456511090468891, 0.013661816297136658, 0.013180019449021182, 0.013044299637340412, 0.01328069690041909, 0.013893151614876253, 0.01486026926641322, 0.016145350179378022, 0.01771111015110096, 0.01953018481900458, 0.02158851476453281, 0.023883291700663882, 0.02641834880142247, 0.02919929038136543, 0.03222966566209077, 0.03550864650689119, 0.039030113252018876, 0.04278278342880936, 0.046750965057897005, 0.05091558533471881, 0.05525525632128809, 0.05974724245469607, 0.06436827048842729, 0.06909516956590997, 0.07390535397873745, 0.0787771715506859, 0.08369014277208064, 0.08862511396967673, 0.09356434439751485, 0.09849154346176785 ], [ 0.08680763489189575, 0.08174629979450158, 0.07671086629022623, 0.07172109875436937, 0.06679824566573486, 0.06196497763867678, 0.05724526771037344, 0.05266419203539447, 0.048247621569071975, 0.04402176648972931, 0.0400125270077172, 0.0362446020485923, 0.032740321969140174, 0.029518221814511705, 0.02659148308465966, 0.023966564229052145, 0.021642595330333803, 0.019612327916109656, 0.01786539219070108, 0.016394052955322248, 0.015200413421262335, 0.01430225271427905, 0.013733169796395273, 0.01353332601951513, 0.01373225235982251, 0.014333294604132216, 0.015311007936606455, 0.016622744954103246, 0.018224888220421648, 0.020084247794006027, 0.022181830394386415, 0.024510950198092855, 0.027072701298047074, 0.02987108754868755, 0.03290909081802159, 0.03618614940748338, 0.039696996316187956, 0.04343154441539746, 0.04737543740388322, 0.05151093281311659, 0.055817876890290434, 0.06027462527724782, 0.06485883686956478, 0.06954811684085166, 0.07432051260085153, 0.07915487976584999, 0.08403113972733561, 0.08893045019317997, 0.093835307712899, 0.09872959813653324 ], [ 0.08747415745733082, 0.0824660866858192, 0.07748596332507322, 0.07255318379890291, 0.06768849063951501, 0.06291387576930135, 0.05825241896784782, 0.05372804013664252, 0.04936513861342344, 0.04518808810729808, 0.04122055471579157, 0.03748461373140043, 0.03399966848662328, 0.030781235492921027, 0.02783976904750025, 0.025179857929804105, 0.02280030515609655, 0.02069570800919322, 0.018860034284681616, 0.01729216143987517, 0.016002283834423276, 0.0150165608925449, 0.014375973839847782, 0.014125919412485803, 0.01429820618632215, 0.014895318327437871, 0.015888429997471948, 0.017230082546492883, 0.01887138796307762, 0.020774023454855284, 0.022914343125391725, 0.025281741043564912, 0.02787432655526738, 0.03069416617269066, 0.03374333501794359, 0.03702125620476681, 0.04052332278389615, 0.0442405457238903, 0.04815989162967351, 0.052265000367842075, 0.056537047522691675, 0.06095559900351323, 0.06549937385150421, 0.07014687976488347, 0.07487691570908907, 0.07966895190979809, 0.0845034043796352, 0.08936182270366329, 0.09422700867321439, 0.09908308107533476 ], [ 0.08820705138424702, 0.08325372040809013, 0.07833004009547981, 0.07345495066110118, 0.06864859077443898, 0.06393216945079656, 0.05932776931305884, 0.054858061912454806, 0.05054591300315131, 0.04641385513340538, 0.04248340985833864, 0.03877425773339806, 0.035303288969206814, 0.032083630475805404, 0.029123841968590584, 0.026427597755669486, 0.023994287331676627, 0.021821002822828388, 0.01990622164588643, 0.01825500636206052, 0.016884615643799724, 0.0158280559866371, 0.015131822835761526, 0.014844685315531764, 0.01499944152358826, 0.015597522501938483, 0.01660761676146845, 0.017978871711077413, 0.019658443927963207, 0.02160377247675693, 0.02378700074797003, 0.026193686825908905, 0.028818799874630444, 0.0316621799192452, 0.03472465916545315, 0.038005327835149864, 0.04149998218931131, 0.04520055509397182, 0.04909524173069365, 0.053169040882912764, 0.05740448825748788, 0.061782427501365596, 0.06628272656761544, 0.07088489371834415, 0.07556857823832974, 0.08031395890340896, 0.0851020322461928, 0.08991481603558392, 0.09473548358755997, 0.09954844315286494 ], [ 0.08900245631962977, 0.08410509620287945, 0.07923877378381296, 0.0744219035148729, 0.06967394765373276, 0.06501526183763309, 0.06046687148244284, 0.0560501629597633, 0.05178647326787673, 0.04769656503286841, 0.04379998323683596, 0.040114310622871706, 0.036654375943628525, 0.03343152815434805, 0.030453170556998786, 0.02772284016184907, 0.02524118706499738, 0.023008197773459742, 0.02102683015908358, 0.019307780587871425, 0.017874276340013352, 0.016764568848989036, 0.01602869823068762, 0.015716842422569748, 0.01586148006256504, 0.016462903141689016, 0.01748841325203516, 0.01888541602958951, 0.02059864620034213, 0.022582386391956435, 0.02480516886053993, 0.027248930606416037, 0.029905446255042222, 0.03277210602386954, 0.03584819000843243, 0.039132127495225384, 0.042619820386625214, 0.046303886413103526, 0.050173584864863854, 0.054215179635525246, 0.05841253292468041, 0.06274777850639593, 0.0672019773549918, 0.07175570169313417, 0.07638952404204842, 0.08108440709293485, 0.08582200096996742, 0.09058485949534759, 0.09535658861253558, 0.10012193973829507 ], [ 0.08985715531322784, 0.08501686102681544, 0.08020872045980122, 0.07545057378080083, 0.07076116148529722, 0.06615994983336206, 0.06166688954661483, 0.05730209570622803, 0.05308543883366101, 0.049036043133599244, 0.045171700499623255, 0.0415082315746751, 0.038058861467797356, 0.03483372952249334, 0.03183971663112102, 0.029080836953367814, 0.02655947548930024, 0.024278712109175156, 0.022245789212273357, 0.020476365194592856, 0.01899845194236241, 0.01785387024441851, 0.017094189782838817, 0.016769054837398323, 0.016909408914767485, 0.017514431977237368, 0.018551229771923645, 0.019967207022075602, 0.021706321995797646, 0.023720917033857064, 0.02597665370882477, 0.028452194827298796, 0.031136178264155483, 0.034023405439973176, 0.03711134658603278, 0.04039745946510495, 0.04387744094725839, 0.04754431997451408, 0.05138820408460974, 0.05539647073378821, 0.05955421762679713, 0.06384482858353542, 0.06825055653071282, 0.07275306394639755, 0.0773338901979963, 0.08197483487585745, 0.08665825820610762, 0.09136730606755054, 0.09608606993860237, 0.10079969270628858 ], [ 0.09076855421213434, 0.0859863779293351, 0.08123725865224336, 0.07653843524279197, 0.07190790779710542, 0.06736424961750569, 0.0629263573641996, 0.05861313160607476, 0.05444308386692152, 0.0504338742666887, 0.04660179809443085, 0.042961262464177495, 0.039524327389725986, 0.03630042882492208, 0.03329644944572549, 0.0305173433064119, 0.027967528952338883, 0.025653204068576612, 0.023585547971949738, 0.021784391027712194, 0.020281266890942843, 0.01911987353135073, 0.018351385721633896, 0.0180231817205065, 0.018163685872163198, 0.01877109165866409, 0.019813432185427284, 0.021239737350718928, 0.022994789908798562, 0.025030257130737706, 0.027309778280462316, 0.029809216516700238, 0.03251425276529542, 0.03541706301400438, 0.03851312503068533, 0.041798659266824724, 0.045268862143123124, 0.048916890153434, 0.05273345450296714, 0.05670685447892074, 0.06082328722677328, 0.0650673016449362, 0.06942230021169361, 0.0738710259969194, 0.07839599888333247, 0.08297988428916171, 0.0876057903100144, 0.0922574966860241, 0.09691962287821418, 0.10157774407480934 ], [ 0.0917346432777261, 0.08701167051412233, 0.08232251100609192, 0.07768379570509266, 0.07311279008205512, 0.06862719924110602, 0.06424491801217261, 0.059983722443770815, 0.055860904323258354, 0.051892859517156706, 0.0480946555657856, 0.04447962545111079, 0.041059063233806474, 0.03784213155661892, 0.034836125002460055, 0.03204725488275512, 0.029482109556932798, 0.02714986805635388, 0.02506515748883339, 0.023251086324644565, 0.021741411024387952, 0.020580098964741306, 0.019816260976212408, 0.019493665257602977, 0.01963756659664208, 0.020245363922248304, 0.021286926775246212, 0.022714233791643196, 0.024474288314777323, 0.02651929373498584, 0.028811772309959915, 0.031325372898767835, 0.03404312351960559, 0.03695465329023141, 0.04005335952788452, 0.04333402811753506, 0.04679110069188653, 0.050417593239441706, 0.05420457066026727, 0.058141041761436425, 0.06221413722630109, 0.06640945211059182, 0.07071146187040456, 0.07510394868801377, 0.07957039860394179, 0.08409434812370709, 0.08865967165827968, 0.09325080929054248, 0.09785293907374727, 0.10245210041362952 ], [ 0.09275394475581494, 0.0880913524261088, 0.08346325050620552, 0.07888567358654285, 0.074375179101049, 0.06994865167381314, 0.06562306047865235, 0.06141516988226864, 0.05734120966799969, 0.053416520720927695, 0.049655206161352695, 0.046069837103318106, 0.04267128597128763, 0.039468786005359774, 0.03647033714540148, 0.03368358481507182, 0.031117271374819053, 0.028783273472043056, 0.026699054904620476, 0.024890041295947574, 0.02339094824382633, 0.022244603325055234, 0.021496772880639788, 0.021186757646090067, 0.02133635154544194, 0.02194237775290115, 0.022977155082342337, 0.024396520982922543, 0.0261507723342129, 0.028193707203814446, 0.03048762788091541, 0.033004630835373645, 0.03572550722519713, 0.03863753488021573, 0.041732048104792724, 0.045002286214598536, 0.048441743098986516, 0.05204306352753387, 0.055797431931335836, 0.05969435283766191, 0.06372171072542145, 0.06786600646662705, 0.0721126869342783, 0.07644650639312536, 0.08085187856895144, 0.08531319478227511, 0.0898150957641486, 0.09434269314331671, 0.09888174186687017, 0.10341876780622661 ], [ 0.0938254500276016, 0.08922454651840345, 0.08465879717491029, 0.08014366684391634, 0.07569504792831357, 0.07132906920508164, 0.06706186630449743, 0.06290931742822228, 0.058886754264275074, 0.055008667450547236, 0.05128843882719478, 0.04773814903995143, 0.044368527633476845, 0.0411891305186685, 0.03820884062620158, 0.035436781660326204, 0.032883696830723376, 0.03056375241061109, 0.028496552096059356, 0.02670886844557466, 0.02523523076820265, 0.024116208167588915, 0.02339339064474568, 0.023101235542279632, 0.023258094645210316, 0.023860426140923652, 0.0248833092238782, 0.026286922059216428, 0.028025554596435794, 0.030055433396629562, 0.032339461763277164, 0.0348488732145203, 0.03756272130975033, 0.0404662325668666, 0.04354880013377897, 0.04680209711266657, 0.050218550640277616, 0.053790256678420065, 0.05750831784432637, 0.06136253566878634, 0.06534136975999148, 0.06943207759522116, 0.0736209608540205, 0.0778936607296104, 0.08223546127394386, 0.08663157425581283, 0.09106739035131212, 0.09552868971885398, 0.10000181055919743, 0.10447377770370803 ], [ 0.09494854972731977, 0.09041079791024312, 0.08590891041420047, 0.08145782046964885, 0.07707281011862212, 0.07276932767281422, 0.06856277553846477, 0.06446827463958812, 0.060500418007193746, 0.056673034837865975, 0.052998997544468775, 0.04949011750419279, 0.04615718876053525, 0.0430102495845574, 0.04005913388950139, 0.03731436919455968, 0.03478843241226085, 0.03249728239258548, 0.030461930854410277, 0.028709584452391287, 0.027273630332581896, 0.02619159596026505, 0.02550049268827676, 0.02522995449357291, 0.02539512865354932, 0.02599228824260628, 0.026999332609752243, 0.028380895217847642, 0.030095601578887767, 0.03210268325448608, 0.034366333936164735, 0.036857587137160024, 0.03955430037706142, 0.04244002726649128, 0.04550243288181796, 0.048731693473368476, 0.05211912819085123, 0.05565616843903614, 0.05933367807922815, 0.06314158473363782, 0.06706875803864809, 0.07110306530301493, 0.07523154094340781, 0.07944061749157623, 0.08371637893103678, 0.08804480924716947, 0.09241201919665276, 0.09680444207484933, 0.1012089948152335, 0.10561320445251811 ], [ 0.09612295988047534, 0.09164998461353302, 0.08721368135263707, 0.0828284976260292, 0.0785091667128497, 0.07427053673461732, 0.07012737841086103, 0.06609417966665901, 0.062184941255426666, 0.058412995305926085, 0.05479087799757382, 0.05133029757584494, 0.048042247823818385, 0.044937321666351226, 0.042026274658406325, 0.03932086620834256, 0.03683495750501129, 0.034585757650807486, 0.032594974657775826, 0.030889452765495238, 0.02950071248061601, 0.02846278493218227, 0.02780805364824174, 0.027561623679728586, 0.027735797816560905, 0.02832680318584988, 0.029315241711096268, 0.030670047308665693, 0.03235422846300152, 0.034330347747027326, 0.03656441449444719, 0.039027851622118484, 0.041697860146327294, 0.04455674344757197, 0.047590720133465235, 0.050788615397305996, 0.054140672491043616, 0.05763760597252225, 0.061269934187923696, 0.06502757598018949, 0.06889966874542212, 0.07287455449467746, 0.07693988126577853, 0.08108277411073381, 0.08529003936780004, 0.08954837567358391, 0.09384457386223236, 0.09816569495862978, 0.10249922080146669, 0.10683317559507464 ], [ 0.0973486467350439, 0.09294222883454399, 0.08857342873482929, 0.08425625833429089, 0.08000496625395319, 0.07583388037448367, 0.071757236565583, 0.06778900306736278, 0.06394271536356062, 0.060231342938426434, 0.05666721658950676, 0.05326205195336108, 0.0500271097088362, 0.04697353251976686, 0.04411288870451646, 0.04145792686830741, 0.03902349710640849, 0.03682751620267565, 0.03489174534450647, 0.03324202487738177, 0.03190752246792746, 0.03091859988146911, 0.030303215817592495, 0.030082396734486996, 0.0302660049657623, 0.030850320168554903, 0.03181842373696603, 0.03314322652225231, 0.034791953313411575, 0.03673060874560326, 0.03892737205387192, 0.04135453990793954, 0.04398915550428859, 0.04681270346124211, 0.04981027841161564, 0.05296955780293642, 0.05627980338617231, 0.05973101950669124, 0.06331332279232293, 0.06701652823109587, 0.07082992731080093, 0.07474221991773237, 0.07874155825277646, 0.08281566403225944, 0.08695198655235291, 0.09113787661316163, 0.0953607584542481, 0.09960828802520458, 0.10386849082863321, 0.10812987623340196 ], [ 0.09862575255857176, 0.0942878114873996, 0.0899886011043915, 0.08574174857967028, 0.08156108060553541, 0.0774604800859461, 0.07345373552927154, 0.06955439324699139, 0.06577562709413518, 0.062130145754194205, 0.05863016288648689, 0.05528745971259173, 0.05211357100675229, 0.04912012128297941, 0.04631932458663264, 0.04372463424117517, 0.04135148365114503, 0.03921799331081341, 0.037345436691877905, 0.03575817793112677, 0.03448276177764269, 0.03354592242280456, 0.032971550828869226, 0.03277710732879086, 0.03297040936631293, 0.03354785244849238, 0.03449472542878436, 0.03578750752917871, 0.037397337986521846, 0.03929360932062911, 0.04144686796183371, 0.043830650273692304, 0.046422271960093756, 0.04920280835531623, 0.05215656587441443, 0.055270313372126706, 0.05853247268618936, 0.06193239443413985, 0.06545978382772552, 0.06910429649867136, 0.0728552953855528, 0.07670174374421475, 0.08063220289203601, 0.08463490316825821, 0.08869786013947012, 0.09280901332579564, 0.0969563703352748, 0.10112814447731397, 0.10531287828808773, 0.10949954882084566 ], [ 0.09995452427952828, 0.09568709191448782, 0.09145968730761476, 0.08728560175303535, 0.08317829817336496, 0.07915128170396085, 0.07521796833589103, 0.07139156182262227, 0.06768495286636693, 0.06411065858856496, 0.06068082379878544, 0.057407307512156176, 0.054301876884112775, 0.05137652398279306, 0.048643905817009184, 0.046117881811901414, 0.04381408326164129, 0.04175039677489388, 0.03994718549042875, 0.038427026884604476, 0.03721374932166828, 0.036330646930617945, 0.03579797443067173, 0.03563013730195665, 0.035833266135956776, 0.036403907998744, 0.037329276850036924, 0.038588986601424236, 0.04015771884544443, 0.042008085917191934, 0.04411306846955628, 0.04644769249114798, 0.04898989375787617, 0.05172070336877354, 0.05462396478498688, 0.05768579216925837, 0.06089393960648023, 0.06423719860901447, 0.06770489262212145, 0.07128649864446197, 0.07497139901294674, 0.07874874974784743, 0.08260744345258976, 0.08653614225260169, 0.09052335751110747, 0.09455755637474941, 0.0986272793442226, 0.10272125722976444, 0.10682851957675255, 0.11093848972340817 ], [ 0.10133524647787671, 0.09714043431264066, 0.09298713670328483, 0.08888835353995592, 0.08485723513637004, 0.08090696567185181, 0.07705064885468471, 0.073301205683309, 0.06967129716177517, 0.06617328762222911, 0.0628192662517398, 0.05962114449978614, 0.05659084385335043, 0.053740580247242584, 0.05108323618487887, 0.048632787813649235, 0.046404721292593425, 0.04441633332407575, 0.04268677276849779, 0.0412366602404812, 0.040087145626988584, 0.039258356256901654, 0.038767359848804694, 0.038625980432499527, 0.03883897016289257, 0.0394030431952249, 0.04030706898806726, 0.04153337523310446, 0.04305979087408841, 0.04486191106477381, 0.046915118759234715, 0.049196076613448346, 0.051683602487287476, 0.054358990774798235, 0.05720591905801449, 0.06021009738473228, 0.06335879891772248, 0.06664037629040886, 0.07004383130183292, 0.07355847378434408, 0.07717368136942165, 0.08087875566981118, 0.08466286100221347, 0.08851502761237623, 0.0924242008215992, 0.09637931919125982, 0.10036940761176796, 0.10438367439728627, 0.10841160452099943, 0.11244304379181289 ], [ 0.10276817988606744, 0.09864814192228805, 0.09457128991045544, 0.09055037069280283, 0.0865982644945592, 0.08272787961658797, 0.07895205236907857, 0.0752834614819736, 0.07173456842331828, 0.0683175968046093, 0.06504456471999835, 0.06192738257106678, 0.058978024544268065, 0.05620877315751187, 0.05363252198323001, 0.05126310115271765, 0.049115564307084386, 0.04720634770409304, 0.04555318985840997, 0.04417469625833375, 0.043089465018671155, 0.04231476960141711, 0.0418649220662918, 0.04174958335004826, 0.04197238437915506, 0.042530208075707336, 0.04341333438927291, 0.044606417521617626, 0.046090046835157425, 0.047842529533844484, 0.049841550099685585, 0.05206547055560615, 0.05449417295892854, 0.057109460295987374, 0.059895102065561624, 0.0628366377201322, 0.06592104735872918, 0.06913637867608025, 0.07247139306986423, 0.07591526879117015, 0.07945737849798053, 0.08308714363980817, 0.08679395851561493, 0.09056717169486934, 0.09439611064043846, 0.0982701357330915, 0.1021787115548432, 0.10611148554974585, 0.11005836656918519, 0.11400959803072105 ], [ 0.10425350625291417, 0.10021039965328637, 0.09621232046247495, 0.09227179357868948, 0.08840146212838071, 0.08461399144689892, 0.08092198029466899, 0.07733788770908172, 0.07387398539023392, 0.07054234639666863, 0.06735488062336077, 0.06432342532125254, 0.0614598939508989, 0.05877647810332835, 0.05628588448451124, 0.0540015721395497, 0.05193793560426253, 0.05011036108165129, 0.04853507151483327, 0.0472286819093286, 0.04620741866456804, 0.0454860219531441, 0.04507644219252531, 0.04498653588685167, 0.04521902272868953, 0.04577094717760337, 0.04663378384555005, 0.047794169037294734, 0.04923509173785786, 0.05093729174147855, 0.0528806110715574, 0.05504510924185353, 0.057411845351744185, 0.05996331568695668, 0.06268359504933424, 0.06555825966301455, 0.06857417487493413, 0.07171922084215161, 0.07498201209101621, 0.0783516480807898, 0.08181751516946047, 0.08536914725818892, 0.08899614322832351, 0.09268813370543978, 0.0964347869754914, 0.10022584324396117, 0.10405116713798751, 0.10790080980870526, 0.11176507375491264, 0.11563457526406598 ], [ 0.1057912801498478, 0.1018272254946988, 0.09791018735759285, 0.0940524919751191, 0.09026656862085261, 0.08656486075898306, 0.0829597455669386, 0.07946346930410077, 0.07608810691531964, 0.07284555445846332, 0.06974756196106895, 0.06680581157800163, 0.06403204085374124, 0.061438203012873824, 0.05903664537321506, 0.05684027373554579, 0.05486265661311103, 0.053118011665376254, 0.05162101274374031, 0.05038636589388817, 0.04942813226796351, 0.04875882679634347, 0.04838838669226288, 0.048323165463488825, 0.048565140709869184, 0.04911150594220433, 0.04995474409311905, 0.051083174026943595, 0.05248185857050593, 0.05413369836777136, 0.05602052581259947, 0.05812404974934812, 0.06042656258119144, 0.06291138376110868, 0.06556306191771002, 0.06836738638390993, 0.0713112691921322, 0.07438255572147193, 0.07756981176019365, 0.08086212142329002, 0.08424891729562213, 0.08771985312376657, 0.09126472106587404, 0.09487340994720404, 0.09853589779016532, 0.1022422705597836, 0.10598275903569342, 0.10974778650330068, 0.1135280211617787, 0.11731442849474483 ], [ 0.10738138806038987, 0.10349843078339996, 0.09966459819764795, 0.0958920332760126, 0.09219296530131828, 0.08857962610344418, 0.08506417512695283, 0.08165863988485453, 0.07837487880074545, 0.07522457315052061, 0.07221925340708966, 0.06937036235535037, 0.06668935251212649, 0.06418780845628927, 0.06187757580205619, 0.05977086848855445, 0.05788031643774059, 0.0562189091513963, 0.05479979118215282, 0.053635876699471764, 0.05273927553358527, 0.052120561636409046, 0.05178796060016809, 0.0517465730898138, 0.051997769770059016, 0.05253887803900409, 0.053363230353556355, 0.054460571406005756, 0.05581774998159327, 0.05741957327009825, 0.05924968826038005, 0.06129137414618535, 0.06352816900293407, 0.06594429836423817, 0.06852491112044962, 0.07125615354922313, 0.07412512458685118, 0.07711975712055072, 0.08022866475311267, 0.08344098461924492, 0.08674623707531745, 0.09013421415279363, 0.09359490144912098, 0.09711843290863902, 0.10069507461373299, 0.10431523194984554, 0.10796947393960102, 0.1116485687826928, 0.11534352536466504, 0.11904563645828459 ], [ 0.10902351488761695, 0.10522358918295271, 0.10147498237798355, 0.09778966205800861, 0.09417966280548343, 0.09065700560025705, 0.08723362603345831, 0.0839213170384758, 0.08073169194202179, 0.07767617302116402, 0.07476600912862265, 0.07201232303892248, 0.06942618477459159, 0.06701870128473178, 0.06480110578628191, 0.06278482265031969, 0.06098147736181702, 0.0594028179137421, 0.058060516606082746, 0.05696583208676469, 0.05612913188797366, 0.0555593043754541, 0.05526312089769536, 0.05524463532026131, 0.05550471897861357, 0.0560408170708848, 0.056846977389848265, 0.05791415250461767, 0.05923072645328018, 0.06078318104633707, 0.06255680342648995, 0.06453634557100277, 0.06670657118094762, 0.06905265636417135, 0.07156043930272735, 0.07421653555468068, 0.07700834808336106, 0.07992400537352681, 0.08295225921625418, 0.08608236834289192, 0.08930398716009383, 0.09260707190270927, 0.09598181050287159, 0.09941857780164483, 0.10290791448136044, 0.10644052613217869, 0.11000729793918206, 0.1135993203095158, 0.11720792109463006, 0.120824700685483 ], [ 0.11071711783710582, 0.10700201404447401, 0.10334047362456747, 0.0997442898263788, 0.09622530038756012, 0.09279530845063141, 0.08946601197946556, 0.08624894664030262, 0.08315544697024432, 0.08019662984826736, 0.07738340259841506, 0.07472649531789925, 0.0722365131602468, 0.06992399942287265, 0.06779949477889734, 0.06587357261767329, 0.06415682641163184, 0.06265978388803425, 0.06139272629691508, 0.06036540066268754, 0.059586628981434214, 0.05906383941319785, 0.05880256678117569, 0.05880598724243532, 0.059074558452818435, 0.05960582754661571, 0.06039444486098157, 0.061432386917771344, 0.0627093568097646, 0.06421330317852397, 0.06593098651839378, 0.06784852461890956, 0.06995186404809166, 0.07222714577304926, 0.0746609544433339, 0.07724045833131835, 0.0799534584474838, 0.08278837083082301, 0.08573416655033962, 0.08878029112775761, 0.09191658046643669, 0.09513318521039513, 0.09842051062527951, 0.1017691750809679, 0.10516998721552363, 0.10861393985959376, 0.11209221766665266, 0.11559621494053197, 0.1191175601831721, 0.12264814422680743 ], [ 0.11246140748239696, 0.10883274367960113, 0.10525990105931537, 0.10175449369669658, 0.09832815424353589, 0.09499245505084494, 0.09175883733904423, 0.08863855277612359, 0.08564262152958677, 0.08278180996135906, 0.08006662948982046, 0.07750735565523274, 0.07511406310104925, 0.07289666819489123, 0.0708649667561671, 0.06902865050223858, 0.0673972833194062, 0.06598021845404402, 0.0647864413449239, 0.06382433086409481, 0.0631013441563973, 0.06262364573202006, 0.06239571714624595, 0.062419995514955806, 0.06269659316833354, 0.06322314425001183, 0.06399480714466843, 0.06500442766190442, 0.06624284270178764, 0.06769928385129996, 0.06936182942370746, 0.07121785320757523, 0.07325442696666791, 0.07545864794380787, 0.07781787825846123, 0.08031989690362795, 0.08295297513463602, 0.08570589183252537, 0.08856790733680563, 0.09152871323164645, 0.0945783727381022, 0.09770726270505678, 0.10090602445750005, 0.10416552744142553, 0.10747684695263891, 0.11083125532465714, 0.11422022473305503, 0.1176354391372351, 0.12106881268923572, 0.12451251205599002 ], [ 0.11425533569309013, 0.11071453396749864, 0.10723178790301212, 0.10381852275808044, 0.1004861531884797, 0.09724600363134234, 0.09410923627014917, 0.09108679047612375, 0.08818933724039618, 0.08542725119552261, 0.08281060127835421, 0.08034915886982466, 0.07805241941722792, 0.07592963029676587, 0.07398981437906102, 0.07224177598006146, 0.07069407434678537, 0.06935495035800128, 0.06823219544997186, 0.06733295831073151, 0.06666349439743473, 0.06622887471280269, 0.06603268148019152, 0.0660767266768804, 0.06636083214188118, 0.06688270545066853, 0.06763793401918415, 0.06862010311654416, 0.06982102535478418, 0.07123105391057297, 0.07283944241452413, 0.07463471246850109, 0.07660499446897713, 0.07873831671364602, 0.08102282896654218, 0.0834469573287626, 0.08599949574802343, 0.08866964504602905, 0.09144701295855183, 0.09432158887835342, 0.09728370549665064, 0.10032399709600201, 0.1034333614776298, 0.10660292985697768, 0.10982404680409444, 0.11308826056431567, 0.11638732288457664, 0.11971319673839914, 0.12305806999986477, 0.12641437306360792 ], [ 0.11609759000091077, 0.11264585763844764, 0.10925435688921677, 0.10593431089436264, 0.10269690015583205, 0.0995531815970259, 0.09651401481430588, 0.09358999907849182, 0.09079142422388223, 0.08812823766912901, 0.08561002838980775, 0.0832460267040525, 0.08104511632321987, 0.07901585245624829, 0.07716647716875412, 0.07550492114654292, 0.07403878005729833, 0.07277525442384994, 0.07172104478973161, 0.07088219916452639, 0.07026391700797094, 0.06987032247083659, 0.0697042277786492, 0.06976691365921643, 0.07005795577943093, 0.07057512312531919, 0.0713143661466763, 0.07226990065746705, 0.07343438036067376, 0.07479913924539976, 0.07635447730664535, 0.07808996027588601, 0.07999470621245498, 0.08205763769844789, 0.08426768624650749, 0.08661394360741877, 0.08908576159259066, 0.09167280702863984, 0.09436508132531879, 0.09715291507413462, 0.10002694755262244, 0.10297809951464032, 0.10599754568804744, 0.10907669136253825, 0.11220715559567046, 0.11538076204115896, 0.11858953726593802, 0.12182571566133422, 0.1250817496196467, 0.12835032347335218 ], [ 0.11798659389464285, 0.1146249095224603, 0.1113255414550239, 0.10809949489872774, 0.10495769813596698, 0.10191092000848936, 0.09896969433491118, 0.09614425459378102, 0.09344448177001637, 0.09087986741139632, 0.08845949263927128, 0.0861920221234994, 0.08408570996071532, 0.082148412174024, 0.08038759846726186, 0.07881035429212602, 0.07742336364999396, 0.07623286376722369, 0.07524456515991536, 0.07446353472001399, 0.07389404504503033, 0.07353939961735582, 0.07340174954399778, 0.07348192208624227, 0.07377928290218776, 0.07429165199352299, 0.0750152877584958, 0.07594494516757819, 0.07707400449515182, 0.07839465817481381, 0.07989813689453305, 0.08157495303974832, 0.08341514018558817, 0.08540847090300685, 0.08754464055226327, 0.08981341073806942, 0.09220471162209415, 0.09470870661740521, 0.09731582581178275, 0.10001677580502809, 0.10280253374588157, 0.10566433256994011, 0.1085936431367259, 0.11158215745740087, 0.11462177573132902, 0.11770459862215991, 0.12082292517968847, 0.12396925607262586, 0.12713630132074927, 0.13031699146155962 ], [ 0.11992051246978992, 0.11664961701904056, 0.11344300178986441, 0.11031143679684859, 0.10726557933211951, 0.10431588990229645, 0.10147255500295917, 0.09874541991847764, 0.09614393430356276, 0.0936771124980478, 0.09135350933136967, 0.08918121062185155, 0.08716783576548508, 0.08532054791225678, 0.0836460654910975, 0.0821506675732876, 0.08084018508990269, 0.07971997054548023, 0.0787948408004306, 0.07806899075059645, 0.07754588008020863, 0.07722810017862902, 0.07711723300194374, 0.07721371719016985, 0.07751673823728877, 0.07802415837360076, 0.07873249799306412, 0.07963697448626426, 0.08073159728799364, 0.08200931114772449, 0.08346217432811234, 0.08508155548086775, 0.08685833261519639, 0.08878307956832594, 0.09084622900975876, 0.09303820538704663, 0.09534952553207444, 0.09777086827891225, 0.10029311705635331, 0.10290738092310717, 0.10560500001896285, 0.10837754113145201, 0.11121678828592663, 0.11411473220546188, 0.11706356135760637, 0.12005565625226267, 0.12308358776517231, 0.12614011957377883, 0.12921821430940308, 0.13231104273174535 ], [ 0.12189726281193068, 0.11871765503136399, 0.11560414485620688, 0.11256724938448791, 0.10961733647319973, 0.10676453938870023, 0.10401867836031152, 0.10138919213999131, 0.09888508224584307, 0.09651487180290723, 0.09428657978674691, 0.09220771006503886, 0.09028525301659686, 0.08852569584341494, 0.08693503619301701, 0.0855187926284024, 0.08428200508351054, 0.08322921895112675, 0.0823644480060682, 0.08169111396272052, 0.08121196390377365, 0.08092897068654296, 0.08084322514233651, 0.08095483174229186, 0.08126282076313236, 0.08176508941034032, 0.08245838176274761, 0.08333831313327865, 0.0843994392147907, 0.08563536513390989, 0.08703888519244549, 0.08860214132448259, 0.09031678744726732, 0.092174147839988, 0.09416536002490171, 0.09628149575446934, 0.09851365701193511, 0.10085304690718394, 0.10329101766576529, 0.10581909942573337, 0.1084290142914194, 0.11111268016842525, 0.11386220849773147, 0.11666989930485619, 0.11952823614804695, 0.12242988271614555, 0.12536768207845828, 0.12833465897469915, 0.13132402507020752, 0.13432918678599887 ], [ 0.12391452846387387, 0.12082646461185016, 0.11780614754231294, 0.11486382408312502, 0.11200955537811559, 0.10925313068043711, 0.10660398826122469, 0.1040711464864798, 0.10166314769413007, 0.09938801676937514, 0.09725323527407574, 0.09526573068080012, 0.093431878789102, 0.09175751590482555, 0.09024795602998734, 0.08890800735427845, 0.08774198197152717, 0.08675369314112652, 0.08594643567274503, 0.0853229471121605, 0.08488535017821516, 0.08463508002176524, 0.08457280289186896, 0.08469833518095449, 0.08501057309070323, 0.08550744297462087, 0.08618588068363023, 0.0870418451812134, 0.088070367796792, 0.08926563441663853, 0.09062109436008087, 0.09212958720855546, 0.09378347774924022, 0.09557478947858025, 0.0974953285452206, 0.09953679219755507, 0.10169085828845742, 0.10394925477566881, 0.10630381014666392, 0.1087464871302345, 0.11126940289569227, 0.11386483923998242, 0.1165252461349026, 0.1192432415860404, 0.12201161017090384, 0.12482330198644986, 0.1276714331256273, 0.13054928827143744, 0.13345032557123898, 0.13636818364067 ], [ 0.12596977731387682, 0.12297327458463957, 0.12004598216306943, 0.11719786031578684, 0.11443864801027331, 0.11177777639285957, 0.10922428971272889, 0.10678677670991608, 0.10447331506316704, 0.10229143077908878, 0.1002480734082748, 0.0983496067461604, 0.09660181330844005, 0.09500990949654275, 0.09357856715440001, 0.09231193634652307, 0.09121366383453117, 0.09028690203317498, 0.08953430425709065, 0.08895800379834097, 0.08855957665819798, 0.08833999033279064, 0.08829954356344727, 0.0884378040047432, 0.08875355195831648, 0.08924473839966499, 0.08990846440088915, 0.09074098685758858, 0.09173775250341083, 0.09289345902239325, 0.09420213916593428, 0.09565726159030613, 0.09725184093001835, 0.09897854948410695, 0.10082982369455387, 0.10279796007871118, 0.10487519711541055, 0.10705378146396605, 0.10932601856381667, 0.11168430896019156, 0.11412117255952034, 0.11662926344803858, 0.1192013779714541, 0.12183045856505229, 0.12450959543997404, 0.1272320277624066, 0.1299911454792169, 0.13278049249737253, 0.13559377154572283, 0.13842485075049535 ], [ 0.12806028224525928, 0.12515512544129825, 0.12232044358814333, 0.11956589570273259, 0.11690088539120012, 0.11433447461315678, 0.11187530530719159, 0.10953153186020188, 0.1073107669737684, 0.10522004277625766, 0.10326578806548792, 0.1014538213963079, 0.09978935843956652, 0.09827703075895024, 0.0969209120297944, 0.09572454691876164, 0.09469097750237535, 0.09382276233699306, 0.09312198415209032, 0.0925902435914121, 0.09222863834684912, 0.09203772920220099, 0.09201749664019873, 0.09216729344642054, 0.09248579986915803, 0.09297098814798277, 0.09362010252386485, 0.09442965927135696, 0.09539546908764522, 0.09651268168617408, 0.09777585006776254, 0.09917901003256714, 0.10071576929710258, 0.10237940019002291, 0.10416293026974338, 0.10605922617168809, 0.1080610673233788, 0.11016120762037576, 0.11235242452692094, 0.1146275562031613, 0.11697952808488916, 0.11940137083416545, 0.12188623176867149, 0.12442738182344776, 0.12701821987179965, 0.12965227590315448, 0.13232321418540105, 0.1350248371743265, 0.1377510906052836, 0.14049606992997793 ], [ 0.13018314390449054, 0.1273688948474107, 0.12462617734413943, 0.12196433646999669, 0.11939242985794993, 0.11691914236640012, 0.11455270907197188, 0.11230084952340305, 0.11017071575064831, 0.1081688558215412, 0.10630119379700394, 0.10457302580999424, 0.10298903077060076, 0.10155329299772657, 0.1002693330327003, 0.09914014214252202, 0.09816821569517048, 0.0973555807761265, 0.09670381414851398, 0.09621404790441306, 0.09588696180117681, 0.09572276314187328, 0.09572115690740751, 0.09588131042073354, 0.09620181788064044, 0.09668067046684327, 0.09731523731505674, 0.09810226153890836, 0.09903787380529583, 0.10011762401148631, 0.10133652966770221, 0.10268913793951892, 0.10416959716187996, 0.10577173310704138, 0.10748912536806876, 0.10931517980830013, 0.11124319396609944, 0.11326641341108978, 0.11537807815415156, 0.11757145918731116, 0.11983988598776958, 0.12217676632834988, 0.12457560000022695, 0.12702998810688396, 0.129533639479907, 0.13208037555136054, 0.134664134743671, 0.1372789771475613, 0.1399190899822985, 0.14257879409006663 ], [ 0.13233531497395676, 0.12961132414735127, 0.1269597081077009, 0.12438948755219238, 0.12190936625019684, 0.1195276472114574, 0.11725215765778724, 0.11509018566978894, 0.11304843092259899, 0.11113297122136598, 0.10934924562330162, 0.10770205384541448, 0.1061955704915592, 0.10483337149999349, 0.10361846923782649, 0.10255335197584764, 0.10164002317288355, 0.10088003615542167, 0.10027452041840636, 0.09982419686023387, 0.09952938069937267, 0.09938997244601505, 0.099405438922696, 0.09957478773054065, 0.0998965395470684, 0.10036870307115554, 0.10098875723466227, 0.101753644506366, 0.10265977784534927, 0.10370306231287643, 0.10487893075715665, 0.10618239156976807, 0.1076080854553717, 0.10915034756254655, 0.1108032712141936, 0.11256076979595142, 0.11441663400198351, 0.11636458246384679, 0.11839830466618628, 0.12051149586943924, 0.1226978844358214, 0.12495125244766023, 0.1272654508072633, 0.12963441013076557, 0.13205214872670634, 0.1345127788224999, 0.13701051200838588, 0.13953966464356793, 0.1420946637414059, 0.14467005363970323 ], [ 0.13451362537510406, 0.1318790453104398, 0.12931746807735117, 0.12683758195340347, 0.12444773170055146, 0.1221558367838593, 0.11996931885663115, 0.1178950412983808, 0.11593926311748788, 0.1141076088245105, 0.11240505497422619, 0.11083593302277436, 0.10940394703496853, 0.10811220371029014, 0.10696325128859767, 0.10595912325786448, 0.10510138250767787, 0.10439116171178515, 0.10382919629369278, 0.10341584729314157, 0.10315111271785898, 0.10303462739887562, 0.10306565280268049, 0.10324305951260285, 0.10356530601399118, 0.10403041788156016, 0.10463597141454209, 0.10537908521158502, 0.10625642221233848, 0.10726420350475269, 0.10839823388768918, 0.10965393796860104, 0.11102640461711027, 0.11251043698523927, 0.11410060507825381, 0.11579129799141391, 0.1175767733447101, 0.11945120205153294, 0.1214087072426689, 0.12344339683989522, 0.12554938986168748, 0.12772083700216982, 0.12995193633459604, 0.13223694515579595, 0.13457018902656848, 0.1369460690025606, 0.13935906792097671, 0.14180375643964296, 0.14427479934090756, 0.14676696243324272 ], [ 0.1367148078753197, 0.13416860782196943, 0.13169582478241396, 0.12930480900604335, 0.12700354377719755, 0.12479956616918017, 0.12269989748749473, 0.12071098608285986, 0.1188386647237259, 0.11708812401068376, 0.11546390242467458, 0.11396989258579344, 0.11260936224222459, 0.1113849875071664, 0.11029889501994058, 0.10935270912305946, 0.10854759989741046, 0.10788432802905666, 0.10736328299879323, 0.10698451195048368, 0.10674773772393989, 0.10665236581401528, 0.10669748129721952, 0.10688183790268407, 0.1072038422605636, 0.10766153683771865, 0.108252585116032, 0.10897426219158897, 0.10982345323906674, 0.1107966613092068, 0.1118900248506906, 0.11309934431694958, 0.11442011636067094, 0.11584757352218196, 0.11737672702378191, 0.11900241028341314, 0.12071932101213823, 0.12252206018907238, 0.12440516673361794, 0.12636314724055658, 0.1283905006452707, 0.13048173810030514, 0.1326313986468721, 0.13483406145074803, 0.13708435545016998, 0.13937696725176765, 0.14170664803196584, 0.14406822007858613, 0.14645658346208437, 0.14886672317499247 ], [ 0.13893552362566985, 0.13647650508531334, 0.13409110795566082, 0.13178734123733837, 0.12957282679248144, 0.1274547230426416, 0.12543965871986928, 0.12353367922695868, 0.12174220765802476, 0.12007002182496146, 0.1185212477651149, 0.11709936922947711, 0.11580725164859915, 0.11464717813649195, 0.1136208943161171, 0.1127296582192415, 0.1119742912943996, 0.11135522668518537, 0.11087255141649915, 0.11052603990957627, 0.11031517726164619, 0.11023917186871976, 0.11029695811728725, 0.11048719089746094, 0.11080823448314114, 0.11125814879953404, 0.11183467621069915, 0.112535231712776, 0.11335689886178452, 0.114296432987296, 0.11535027235714686, 0.11651455708240166, 0.11778515479201287, 0.11915769154158, 0.12062758609313723, 0.12219008561785988, 0.12384030100335448, 0.1255732402414616, 0.1273838387687082, 0.12926698606738382, 0.13121754825583903, 0.13323038676138377, 0.13530037345235177, 0.137422402797489, 0.13959140172233395, 0.14180233785500682, 0.14405022681327573, 0.14633013909950018, 0.14863720705737138, 0.15096663221973708 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.15074859838932753, 0.5868790391839703, 0.48047551761196305, 0.5351218765112915, 0.5244595774889831, 0.5026592707569383, 0.49414723555038637, 0.4972144652582664, 0.5155004328138028, 0.47908746845474126, 0.5001615140598644, 0.26680566649883986, 0.4812825581827489, 0.49523370553816837, 0.492497987334334, 0.5021639722622611, 0.9347627703100443, 0.9877294125035405, 0.34432493802160025, 0.13039024267345667, 0.3522197931659842, 0.3733162814630585, 0.39568880574234894, 0.4921262496341817 ], "xaxis": "x", "y": [ 0.06943225674331188, 0.22260799329960182, 0.32712339024218967, 0.19139474175487972, 0.1922581459700871, 0.24130520882622833, 0.2748711787329677, 0.23387592640473642, 0.2906275825920357, 0.30019489090256934, 0.31488185995478835, 0.2547033838927746, 0.29436802778623283, 0.2741613139641317, 0.27798558846201776, 0.33600299724044075, 0.8819776782765985, 0.4653367968276143, 0.08658182062208652, 0.7465811837464571, 0.045713457138984434, 0.1451225559515453, 0.19074428399961335, 0.22695601918709835 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 0.15074859838932753, 0.5868790391839703, 0.48047551761196305, 0.5351218765112915, 0.5244595774889831, 0.5026592707569383, 0.49414723555038637, 0.4972144652582664, 0.5155004328138028, 0.47908746845474126, 0.5001615140598644, 0.26680566649883986, 0.4812825581827489, 0.49523370553816837, 0.492497987334334, 0.5021639722622611, 0.9347627703100443, 0.9877294125035405, 0.34432493802160025, 0.13039024267345667, 0.3522197931659842, 0.3733162814630585, 0.39568880574234894, 0.4921262496341817 ], "xaxis": "x2", "y": [ 0.06943225674331188, 0.22260799329960182, 0.32712339024218967, 0.19139474175487972, 0.1922581459700871, 0.24130520882622833, 0.2748711787329677, 0.23387592640473642, 0.2906275825920357, 0.30019489090256934, 0.31488185995478835, 0.2547033838927746, 0.29436802778623283, 0.2741613139641317, 0.27798558846201776, 0.33600299724044075, 0.8819776782765985, 0.4653367968276143, 0.08658182062208652, 0.7465811837464571, 0.045713457138984434, 0.1451225559515453, 0.19074428399961335, 0.22695601918709835 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.003725911166456971, -0.23955002823883667, -0.23955002823883667, -0.23955002823883667, -1.7084543498463953, -1.7084543498463953, -1.7084543498463953, -2.4463195772923925, -2.6004737813710017, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -3.239527696642378, -3.239527696642378, -3.239527696642378, -3.281629038038262, -3.281629038038262, -3.281629038038262, -3.307878047885971, -3.307878047885971, -3.3130258930330787, -3.3130258930330787, -3.3130258930330787 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.8382659908384085
x2: 0.5575602240860462
x3: 0.15074859838932753
x4: 0.06943225674331188
x5: 0.7893574675545096
x6: 0.2868263814598322", "
Parameterization:
x1: 0.5306741623207927
x2: 0.2625328293070197
x3: 0.26680566649883986
x4: 0.2547033838927746
x5: 0.6171511793509126
x6: 0.3734604576602578", "
Parameterization:
x1: 0.1861793575808406
x2: 0.9618437867611647
x3: 0.9347627703100443
x4: 0.8819776782765985
x5: 0.9238194189965725
x6: 0.31539186835289", "
Parameterization:
x1: 0.9138283375650644
x2: 0.8896558601409197
x3: 0.9877294125035405
x4: 0.4653367968276143
x5: 0.004562385380268097
x6: 0.006996076554059982", "
Parameterization:
x1: 0.142005137167871
x2: 0.27868005726486444
x3: 0.34432493802160025
x4: 0.08658182062208652
x5: 0.34427196625620127
x6: 0.4998997002840042", "
Parameterization:
x1: 0.4582363897934556
x2: 0.5284271622076631
x3: 0.13039024267345667
x4: 0.7465811837464571
x5: 0.5126907005906105
x6: 0.1032460369169712", "
Parameterization:
x1: 0.02275182017174954
x2: 0.29585708086861406
x3: 0.3522197931659842
x4: 0.045713457138984434
x5: 0.27554201632941533
x6: 0.5166407419552547", "
Parameterization:
x1: 0.20381124161101558
x2: 0.2115450550930907
x3: 0.3733162814630585
x4: 0.1451225559515453
x5: 0.27795693081365463
x6: 0.5546411600323868", "
Parameterization:
x1: 0.25373370758056046
x2: 0.1514130550303062
x3: 0.39568880574234894
x4: 0.19074428399961335
x5: 0.2199159715374527
x6: 0.6049869061997091", "
Parameterization:
x1: 0.22425682188164012
x2: 0.2028584529565092
x3: 0.4921262496341817
x4: 0.22695601918709835
x5: 0.24456704763462261
x6: 0.5955257643911344", "
Parameterization:
x1: 0.20868158038333934
x2: 0.13253601411120824
x3: 0.5868790391839703
x4: 0.22260799329960182
x5: 0.24227446214581672
x6: 0.5457439115509958", "
Parameterization:
x1: 0.1987687368061373
x2: 0.25203556098842583
x3: 0.48047551761196305
x4: 0.32712339024218967
x5: 0.2176353194247186
x6: 0.5884058225329708", "
Parameterization:
x1: 0.24599491403572823
x2: 0.2499748665379118
x3: 0.5351218765112915
x4: 0.19139474175487972
x5: 0.26303106231588486
x6: 0.6752078213139558", "
Parameterization:
x1: 0.2735651131322229
x2: 0.26368353166503883
x3: 0.5244595774889831
x4: 0.1922581459700871
x5: 0.2151024569181282
x6: 0.5735358009910448", "
Parameterization:
x1: 0.19812354407597796
x2: 0.17719333911041268
x3: 0.5026592707569383
x4: 0.24130520882622833
x5: 0.2873675930361708
x6: 0.6737556040361147", "
Parameterization:
x1: 0.2092098449532774
x2: 0.14887959260411737
x3: 0.49414723555038637
x4: 0.2748711787329677
x5: 0.3503614412494311
x6: 0.6972456858974628", "
Parameterization:
x1: 0.15535051105814224
x2: 0.1560726648561245
x3: 0.4972144652582664
x4: 0.23387592640473642
x5: 0.3201371674702668
x6: 0.7332687020027343", "
Parameterization:
x1: 0.20092033184988664
x2: 0.154332592477152
x3: 0.5155004328138028
x4: 0.2906275825920357
x5: 0.30099486508050594
x6: 0.6796298016230533", "
Parameterization:
x1: 0.23278071006947793
x2: 0.15421703497917041
x3: 0.47908746845474126
x4: 0.30019489090256934
x5: 0.297515435666832
x6: 0.7019430764456256", "
Parameterization:
x1: 0.19874202152753742
x2: 0.18460247194449386
x3: 0.5001615140598644
x4: 0.31488185995478835
x5: 0.3181090358686003
x6: 0.6731890370740631", "
Parameterization:
x1: 0.19413353295593247
x2: 0.13625811786306796
x3: 0.4812825581827489
x4: 0.29436802778623283
x5: 0.3087974472030642
x6: 0.656935870776127", "
Parameterization:
x1: 0.2192872743578544
x2: 0.12720732065818385
x3: 0.49523370553816837
x4: 0.2741613139641317
x5: 0.3122407343627245
x6: 0.6495447777479288", "
Parameterization:
x1: 0.20246233818118914
x2: 0.12826459792928196
x3: 0.492497987334334
x4: 0.27798558846201776
x5: 0.3077947302118925
x6: 0.6599058141494158", "
Parameterization:
x1: 0.20984165673761018
x2: 0.07203027273229609
x3: 0.5021639722622611
x4: 0.33600299724044075
x5: 0.32481353959410564
x6: 0.6534974471075735", "
Parameterization:
x1: 0.05804409645497799
x2: 0.8218465466052294
x3: 0.3136578192934394
x4: 0.9603449050337076
x5: 0.9110750975087285
x6: 0.0916060684248805" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.003725911166456971, -0.23955002823883667, -0.23955002823883667, -0.23955002823883667, -1.7084543498463953, -1.7084543498463953, -1.7084543498463953, -2.4463195772923925, -2.6004737813710017, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -3.239527696642378, -3.239527696642378, -3.239527696642378, -3.281629038038262, -3.281629038038262, -3.281629038038262, -3.307878047885971, -3.307878047885971, -3.3130258930330787, -3.3130258930330787, -3.3130258930330787 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.003725911166456971, -0.23955002823883667, -0.23955002823883667, -0.23955002823883667, -1.7084543498463953, -1.7084543498463953, -1.7084543498463953, -2.4463195772923925, -2.6004737813710017, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -2.9136851887112525, -3.239527696642378, -3.239527696642378, -3.239527696642378, -3.281629038038262, -3.281629038038262, -3.281629038038262, -3.307878047885971, -3.307878047885971, -3.3130258930330787, -3.3130258930330787, -3.3130258930330787 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:24] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 10-01 15:36:25] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "ename": "ModuleNotFoundError", "evalue": "No module named 'psycopg2'", "output_type": "error", "traceback": [ "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mModuleNotFoundError\u001b[0m Traceback (most recent call last)", "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 4\u001b[0m \u001b[0mdb_settings\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mDBSettings\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;34m\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 5\u001b[0m \u001b[0;31m# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 6\u001b[0;31m \u001b[0mnew_ax\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mAxClient\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", "\u001b[0;32m~/build/facebook/Ax/ax/service/ax_client.py\u001b[0m in \u001b[0;36m__init__\u001b[0;34m(self, generation_strategy, db_settings, enforce_sequential_optimization, random_seed, verbose_logging, suppress_storage_errors)\u001b[0m\n\u001b[1;32m 136\u001b[0m \u001b[0msuppress_storage_errors\u001b[0m\u001b[0;34m:\u001b[0m \u001b[0mbool\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0;32mFalse\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 137\u001b[0m ) -> None:\n\u001b[0;32m--> 138\u001b[0;31m \u001b[0msuper\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0m__init__\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 139\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0mverbose_logging\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 140\u001b[0m \u001b[0mlogger\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msetLevel\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlogging\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mWARNING\u001b[0m\u001b[0;34m)\u001b[0m \u001b[0;31m# pragma: no cover\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/service/utils/with_db_settings_base.py\u001b[0m in \u001b[0;36m__init__\u001b[0;34m(self, db_settings, logging_level)\u001b[0m\n\u001b[1;32m 67\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings_set\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 68\u001b[0m init_engine_and_session_factory(\n\u001b[0;32m---> 69\u001b[0;31m \u001b[0mcreator\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdb_settings\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 70\u001b[0m )\n\u001b[1;32m 71\u001b[0m \u001b[0mlogger\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0msetLevel\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mlogging_level\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/storage/sqa_store/db.py\u001b[0m in \u001b[0;36minit_engine_and_session_factory\u001b[0;34m(url, creator, echo, force_init, **kwargs)\u001b[0m\n\u001b[1;32m 336\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0;31m# pragma: no cover\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 337\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0murl\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 338\u001b[0;31m \u001b[0mengine\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcreate_mysql_engine_from_url\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 339\u001b[0m \u001b[0;32melif\u001b[0m \u001b[0mcreator\u001b[0m \u001b[0;32mis\u001b[0m \u001b[0;32mnot\u001b[0m \u001b[0;32mNone\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 340\u001b[0m \u001b[0mengine\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mcreate_mysql_engine_from_creator\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mcreator\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/build/facebook/Ax/ax/storage/sqa_store/db.py\u001b[0m in \u001b[0;36mcreate_mysql_engine_from_url\u001b[0;34m(url, echo, pool_recycle, **kwargs)\u001b[0m\n\u001b[1;32m 277\u001b[0m \"\"\"\n\u001b[1;32m 278\u001b[0m return create_engine(\n\u001b[0;32m--> 279\u001b[0;31m \u001b[0mname_or_url\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0murl\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mpool_recycle\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mpool_recycle\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mecho\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mecho\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 280\u001b[0m )\n\u001b[1;32m 281\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/engine/__init__.py\u001b[0m in \u001b[0;36mcreate_engine\u001b[0;34m(*args, **kwargs)\u001b[0m\n\u001b[1;32m 498\u001b[0m \u001b[0mstrategy\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mpop\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"strategy\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mdefault_strategy\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 499\u001b[0m \u001b[0mstrategy\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mstrategies\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mstrategies\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mstrategy\u001b[0m\u001b[0;34m]\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 500\u001b[0;31m \u001b[0;32mreturn\u001b[0m \u001b[0mstrategy\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mcreate\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m*\u001b[0m\u001b[0margs\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;34m**\u001b[0m\u001b[0mkwargs\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 501\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 502\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/engine/strategies.py\u001b[0m in \u001b[0;36mcreate\u001b[0;34m(self, name_or_url, **kwargs)\u001b[0m\n\u001b[1;32m 85\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mk\u001b[0m \u001b[0;32min\u001b[0m \u001b[0mkwargs\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 86\u001b[0m \u001b[0mdbapi_args\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mpop_kwarg\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mk\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m---> 87\u001b[0;31m \u001b[0mdbapi\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mdialect_cls\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mdbapi\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m**\u001b[0m\u001b[0mdbapi_args\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 88\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 89\u001b[0m \u001b[0mdialect_args\u001b[0m\u001b[0;34m[\u001b[0m\u001b[0;34m\"dbapi\"\u001b[0m\u001b[0;34m]\u001b[0m \u001b[0;34m=\u001b[0m \u001b[0mdbapi\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/sqlalchemy/dialects/postgresql/psycopg2.py\u001b[0m in \u001b[0;36mdbapi\u001b[0;34m(cls)\u001b[0m\n\u001b[1;32m 751\u001b[0m \u001b[0;34m@\u001b[0m\u001b[0mclassmethod\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 752\u001b[0m \u001b[0;32mdef\u001b[0m \u001b[0mdbapi\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0mcls\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 753\u001b[0;31m \u001b[0;32mimport\u001b[0m \u001b[0mpsycopg2\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 754\u001b[0m \u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 755\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0mpsycopg2\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;31mModuleNotFoundError\u001b[0m: No module named 'psycopg2'" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "collapsed": true }, "outputs": [], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": null, "metadata": { "collapsed": true }, "outputs": [], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 04-16 10:14:20] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n", "[INFO 04-16 10:14:20] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 5, "metadata": { "bento_obj_id": "140609783487456" }, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" } }, "nbformat": 4, "nbformat_minor": 2 }