{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:28] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.modelbridge.dispatch_utils: Using GPEI (Bayesian optimization) since there are more continuous parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.5, 'x2': 0.15, 'x3': 0.42, 'x4': 0.3, 'x5': 0.66, 'x6': 0.4}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.27, 0.0), 'l2norm': (1.06, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.13, 'x2': 0.98, 'x3': 0.75, 'x4': 0.3, 'x5': 0.6, 'x6': 0.91}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.05, 0.0), 'l2norm': (1.68, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.83, 'x2': 0.09, 'x3': 0.92, 'x4': 0.55, 'x5': 0.98, 'x6': 0.05}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.0, 0.0), 'l2norm': (1.68, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.22, 'x2': 0.52, 'x3': 0.84, 'x4': 0.96, 'x5': 0.35, 'x6': 0.6}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.08, 0.0), 'l2norm': (1.55, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.17, 'x2': 0.19, 'x3': 0.56, 'x4': 0.52, 'x5': 0.81, 'x6': 0.85}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.25, 0.0), 'l2norm': (1.42, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.18, 'x2': 0.47, 'x3': 0.86, 'x4': 0.12, 'x5': 0.89, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:29] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.15, 0.0), 'l2norm': (1.49, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:36] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.41, 'x2': 0.14, 'x3': 0.42, 'x4': 0.35, 'x5': 0.71, 'x6': 0.54}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:36] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.36, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:44] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.38, 'x2': 0.13, 'x3': 0.39, 'x4': 0.36, 'x5': 0.71, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:44] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.37, 0.0), 'l2norm': (1.16, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:51] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.34, 'x2': 0.19, 'x3': 0.36, 'x4': 0.38, 'x5': 0.77, 'x6': 0.59}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:51] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.26, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:59] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.41, 'x2': 0.08, 'x3': 0.44, 'x4': 0.35, 'x5': 0.67, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:19:59] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.47, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:07] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.43, 'x2': 0.02, 'x3': 0.49, 'x4': 0.34, 'x5': 0.64, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:07] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.56, 0.0), 'l2norm': (1.19, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:15] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.45, 'x2': 0.0, 'x3': 0.53, 'x4': 0.33, 'x5': 0.6, 'x6': 0.71}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:15] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.7, 0.0), 'l2norm': (1.21, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:22] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.46, 'x2': 0.01, 'x3': 0.57, 'x4': 0.29, 'x5': 0.54, 'x6': 0.74}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:22] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.01, 0.0), 'l2norm': (1.21, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:29] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.47, 'x2': 0.03, 'x3': 0.6, 'x4': 0.26, 'x5': 0.47, 'x6': 0.76}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:29] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-1.41, 0.0), 'l2norm': (1.21, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:36] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.48, 'x2': 0.04, 'x3': 0.63, 'x4': 0.22, 'x5': 0.38, 'x6': 0.79}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:36] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-1.75, 0.0), 'l2norm': (1.21, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:43] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.47, 'x2': 0.05, 'x3': 0.67, 'x4': 0.18, 'x5': 0.3, 'x6': 0.83}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:43] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-1.66, 0.0), 'l2norm': (1.22, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:50] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.57, 'x2': 0.06, 'x3': 0.59, 'x4': 0.17, 'x5': 0.36, 'x6': 0.77}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:50] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.53, 0.0), 'l2norm': (1.2, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:58] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.44, 'x2': 0.04, 'x3': 0.63, 'x4': 0.24, 'x5': 0.34, 'x6': 0.76}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:20:58] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.18, 0.0), 'l2norm': (1.16, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:05] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.38, 'x2': 0.05, 'x3': 0.62, 'x4': 0.28, 'x5': 0.28, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:05] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.65, 0.0), 'l2norm': (1.07, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:11] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.36, 'x2': 0.01, 'x3': 0.61, 'x4': 0.33, 'x5': 0.22, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:11] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.24, 0.0), 'l2norm': (1.04, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:18] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.31, 'x2': 0.12, 'x3': 0.61, 'x4': 0.25, 'x5': 0.29, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:18] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-2.94, 0.0), 'l2norm': (1.03, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:24] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.24, 'x2': 0.11, 'x3': 0.57, 'x4': 0.21, 'x5': 0.29, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:24] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.01, 0.0), 'l2norm': (0.96, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:29] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.24, 'x2': 0.12, 'x3': 0.69, 'x4': 0.2, 'x5': 0.31, 'x6': 0.61}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:29] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.62, 0.0), 'l2norm': (1.02, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:36] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.25, 'x2': 0.15, 'x3': 0.51, 'x4': 0.23, 'x5': 0.28, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:36] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.17, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:42] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.28, 'x2': 0.18, 'x3': 0.43, 'x4': 0.21, 'x5': 0.27, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:42] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.02, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(6, 6), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 6 for the first 6 trials and 3 for all subsequent trials.\" This is because the first 6 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:42] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration ModelTrial IndexTrial StatusArm Parameterizations
00Sobol0COMPLETED{'0_0': {'x1': 0.5, 'x2': 0.15, 'x3': 0.42, 'x...
10Sobol1COMPLETED{'1_0': {'x1': 0.13, 'x2': 0.98, 'x3': 0.75, '...
20Sobol2COMPLETED{'2_0': {'x1': 0.83, 'x2': 0.09, 'x3': 0.92, '...
30Sobol3COMPLETED{'3_0': {'x1': 0.22, 'x2': 0.52, 'x3': 0.84, '...
40Sobol4COMPLETED{'4_0': {'x1': 0.17, 'x2': 0.19, 'x3': 0.56, '...
50Sobol5COMPLETED{'5_0': {'x1': 0.18, 'x2': 0.47, 'x3': 0.86, '...
61GPEI6COMPLETED{'6_0': {'x1': 0.41, 'x2': 0.14, 'x3': 0.42, '...
71GPEI7COMPLETED{'7_0': {'x1': 0.38, 'x2': 0.13, 'x3': 0.39, '...
81GPEI8COMPLETED{'8_0': {'x1': 0.34, 'x2': 0.19, 'x3': 0.36, '...
91GPEI9COMPLETED{'9_0': {'x1': 0.41, 'x2': 0.08, 'x3': 0.44, '...
101GPEI10COMPLETED{'10_0': {'x1': 0.43, 'x2': 0.02, 'x3': 0.49, ...
111GPEI11COMPLETED{'11_0': {'x1': 0.45, 'x2': 0.0, 'x3': 0.53, '...
121GPEI12COMPLETED{'12_0': {'x1': 0.46, 'x2': 0.01, 'x3': 0.57, ...
131GPEI13COMPLETED{'13_0': {'x1': 0.47, 'x2': 0.03, 'x3': 0.6, '...
141GPEI14COMPLETED{'14_0': {'x1': 0.48, 'x2': 0.04, 'x3': 0.63, ...
151GPEI15COMPLETED{'15_0': {'x1': 0.47, 'x2': 0.05, 'x3': 0.67, ...
161GPEI16COMPLETED{'16_0': {'x1': 0.57, 'x2': 0.06, 'x3': 0.59, ...
171GPEI17COMPLETED{'17_0': {'x1': 0.44, 'x2': 0.04, 'x3': 0.63, ...
181GPEI18COMPLETED{'18_0': {'x1': 0.38, 'x2': 0.05, 'x3': 0.62, ...
191GPEI19COMPLETED{'19_0': {'x1': 0.36, 'x2': 0.01, 'x3': 0.61, ...
201GPEI20COMPLETED{'20_0': {'x1': 0.31, 'x2': 0.12, 'x3': 0.61, ...
211GPEI21COMPLETED{'21_0': {'x1': 0.24, 'x2': 0.11, 'x3': 0.57, ...
221GPEI22COMPLETED{'22_0': {'x1': 0.24, 'x2': 0.12, 'x3': 0.69, ...
231GPEI23COMPLETED{'23_0': {'x1': 0.25, 'x2': 0.15, 'x3': 0.51, ...
241GPEI24COMPLETED{'24_0': {'x1': 0.28, 'x2': 0.18, 'x3': 0.43, ...
\n", "
" ], "text/plain": [ " Generation Step Generation Model Trial Index Trial Status \\\n", "0 0 Sobol 0 COMPLETED \n", "1 0 Sobol 1 COMPLETED \n", "2 0 Sobol 2 COMPLETED \n", "3 0 Sobol 3 COMPLETED \n", "4 0 Sobol 4 COMPLETED \n", "5 0 Sobol 5 COMPLETED \n", "6 1 GPEI 6 COMPLETED \n", "7 1 GPEI 7 COMPLETED \n", "8 1 GPEI 8 COMPLETED \n", "9 1 GPEI 9 COMPLETED \n", "10 1 GPEI 10 COMPLETED \n", "11 1 GPEI 11 COMPLETED \n", "12 1 GPEI 12 COMPLETED \n", "13 1 GPEI 13 COMPLETED \n", "14 1 GPEI 14 COMPLETED \n", "15 1 GPEI 15 COMPLETED \n", "16 1 GPEI 16 COMPLETED \n", "17 1 GPEI 17 COMPLETED \n", "18 1 GPEI 18 COMPLETED \n", "19 1 GPEI 19 COMPLETED \n", "20 1 GPEI 20 COMPLETED \n", "21 1 GPEI 21 COMPLETED \n", "22 1 GPEI 22 COMPLETED \n", "23 1 GPEI 23 COMPLETED \n", "24 1 GPEI 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.5, 'x2': 0.15, 'x3': 0.42, 'x... \n", "1 {'1_0': {'x1': 0.13, 'x2': 0.98, 'x3': 0.75, '... \n", "2 {'2_0': {'x1': 0.83, 'x2': 0.09, 'x3': 0.92, '... \n", "3 {'3_0': {'x1': 0.22, 'x2': 0.52, 'x3': 0.84, '... \n", "4 {'4_0': {'x1': 0.17, 'x2': 0.19, 'x3': 0.56, '... \n", "5 {'5_0': {'x1': 0.18, 'x2': 0.47, 'x3': 0.86, '... \n", "6 {'6_0': {'x1': 0.41, 'x2': 0.14, 'x3': 0.42, '... \n", "7 {'7_0': {'x1': 0.38, 'x2': 0.13, 'x3': 0.39, '... \n", "8 {'8_0': {'x1': 0.34, 'x2': 0.19, 'x3': 0.36, '... \n", "9 {'9_0': {'x1': 0.41, 'x2': 0.08, 'x3': 0.44, '... \n", "10 {'10_0': {'x1': 0.43, 'x2': 0.02, 'x3': 0.49, ... \n", "11 {'11_0': {'x1': 0.45, 'x2': 0.0, 'x3': 0.53, '... \n", "12 {'12_0': {'x1': 0.46, 'x2': 0.01, 'x3': 0.57, ... \n", "13 {'13_0': {'x1': 0.47, 'x2': 0.03, 'x3': 0.6, '... \n", "14 {'14_0': {'x1': 0.48, 'x2': 0.04, 'x3': 0.63, ... \n", "15 {'15_0': {'x1': 0.47, 'x2': 0.05, 'x3': 0.67, ... \n", "16 {'16_0': {'x1': 0.57, 'x2': 0.06, 'x3': 0.59, ... \n", "17 {'17_0': {'x1': 0.44, 'x2': 0.04, 'x3': 0.63, ... \n", "18 {'18_0': {'x1': 0.38, 'x2': 0.05, 'x3': 0.62, ... \n", "19 {'19_0': {'x1': 0.36, 'x2': 0.01, 'x3': 0.61, ... \n", "20 {'20_0': {'x1': 0.31, 'x2': 0.12, 'x3': 0.61, ... \n", "21 {'21_0': {'x1': 0.24, 'x2': 0.11, 'x3': 0.57, ... \n", "22 {'22_0': {'x1': 0.24, 'x2': 0.12, 'x3': 0.69, ... \n", "23 {'23_0': {'x1': 0.25, 'x2': 0.15, 'x3': 0.51, ... \n", "24 {'24_0': {'x1': 0.28, 'x2': 0.18, 'x3': 0.43, ... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.2534931500682824,\n", " 'x2': 0.1536945586652028,\n", " 'x3': 0.5130402421432112,\n", " 'x4': 0.23083124075118483,\n", " 'x5': 0.2828253469672484,\n", " 'x6': 0.6698187221680083}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -3.1725837745434258, 'l2norm': 0.9659305889680001}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "metadata": { "collapsed": true }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:42] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.5092493496897812, -1.5341598372668466, -1.556553964841538, -1.5761442717762715, -1.592645506073771, -1.6057791916230255, -1.6152787919083014, -1.6208954443978958, -1.6224042114525306, -1.619610758255443, -1.612358324769419, -1.6005348057504518, -1.5840796892065696, -1.5629905289180441, -1.5373285421053446, -1.5072228341633827, -1.472872670444856, -1.4345471633114821, -1.3925817601020247, -1.3473710617688663, -1.2993578389955676, -1.2490186799528586, -1.1968474359939485, -1.1433382929878044, -1.08897053698479, -1.0341966819148931, -0.979434717854172, -0.9250642353175415, -0.8714254840199471, -0.8188202053204403, -0.7675132542719896, -0.7177343850201827, -0.6696799190472099, -0.6235142535765572, -0.5793712865075246, -0.5373558652478418, -0.49754534808790474, -0.4599913285020968, -0.42472153359024933, -0.39174187682229566, -0.3610386250653287, -0.3325806298566859, -0.3063215708645054, -0.28220216295746814, -0.26015228506194865, -0.2400929972774849, -0.22193842131967667, -0.20559746747413765, -0.1909753984278475, -0.1779752263939891 ], [ -1.529895040581632, -1.5556997376438086, -1.5789755294013563, -1.5994281266266974, -1.6167650322447593, -1.6307001875105847, -1.640959233386365, -1.6472853604784508, -1.6494456915304057, -1.647238104199623, -1.6404983576169239, -1.6291073328517174, -1.6129981337675083, -1.5921627203589477, -1.5666576627161992, -1.5366085150726723, -1.5022122274194851, -1.463736959439405, -1.4215186767524683, -1.3759540501088192, -1.3274895108731444, -1.2766068794387162, -1.223806714417817, -1.1695911987661876, -1.114448637998008, -1.0588412679450745, -1.0031971735303173, -0.9479061102347419, -0.8933183040420778, -0.8397450705437133, -0.7874602647208173, -0.7367019318185452, -0.6876738778203743, -0.6405471164425536, -0.5954612674083445, -0.5525260098557406, -0.5118226743932901, -0.4734060181948019, -0.4373061882654721, -0.4035308474691547, -0.37206741857981973, -0.3428853925982991, -0.3159386465307117, -0.2911677201763446, -0.26850200895210574, -0.24786183863973754, -0.22916039696162405, -0.21230550530234837, -0.19720122127294704, -0.18374926898355293 ], [ -1.5480009722357924, -1.5746208599605227, -1.598703747185163, -1.6199495298287876, -1.6380595480033457, -1.6527413023055517, -1.6637137998661402, -1.6707135016699828, -1.6735008121542887, -1.6718670147778791, -1.6656415122756663, -1.654699176702017, -1.638967551215099, -1.6184335725079884, -1.593149401097845, -1.5632368610780474, -1.5288899126781699, -1.490374532165567, -1.4480253920346677, -1.402238875374379, -1.3534622845603899, -1.3021796500211824, -1.2488952475630377, -1.194116575486204, -1.1383388034436943, -1.0820323666205776, -1.0256345367383128, -0.9695448265365904, -0.9141233726189328, -0.8596911885956398, -0.8065313262087137, -0.7548903201508177, -0.7049796279590805, -0.6569770094995622, -0.6110279073577813, -0.5672469194813002, -0.5257194367569735, -0.4865034809344567, -0.44963174084397683, -0.41511377594924903, -0.38293833837896785, -0.35307575676078684, -0.3254803251140901, -0.30009264517436063, -0.27684187857938947, -0.25564787462666383, -0.23642314862266578, -0.21907469444769023, -0.2035056224553986, -0.1896166200555205 ], [ -1.563416690886051, -1.5907642642437054, -1.615571092233249, -1.6375323246117985, -1.6563442820569834, -1.671709233108823, -1.6833408110021495, -1.6909700391114715, -1.6943519019715074, -1.6932723604052178, -1.6875556635839253, -1.6770717571966642, -1.6617435247315262, -1.641553528116845, -1.6165498361211093, -1.5868504488383397, -1.5526457554915871, -1.514198422241789, -1.471840132771659, -1.4259647483650644, -1.3770177714255292, -1.3254825123667233, -1.2718640117749034, -1.2166723610171786, -1.160407311862567, -1.1035457751332787, -1.0465330513307938, -0.9897777339533655, -0.93364954310177, -0.8784790780321129, -0.8245585826674962, -0.7721431156305145, -0.7214518253712324, -0.6726692524807196, -0.6259466965211771, -0.5814037179622791, -0.5391298317622606, -0.4991864162285966, -0.46160882689163085, -0.4264086789184255, -0.39357624566177885, -0.3630829145133063, -0.33488364212827315, -0.3089193568636691, -0.285119264763219, -0.2634030249799073, -0.24368277000579008, -0.22586495477371993, -0.20985202623214816, -0.19554391123040382 ], [ -1.5760105475959598, -1.6039908436978465, -1.6294308976458984, -1.6520222234106638, -1.6714573107248152, -1.687434452239466, -1.6996632160584277, -1.7078705287274776, -1.711807300698866, -1.7112554867474394, -1.7060354274778193, -1.6960132646413304, -1.6811081623143251, -1.6612989984572724, -1.636630118856962, -1.6072156730950744, -1.573241991150447, -1.5349674302994427, -1.4927191586724637, -1.4468864896799358, -1.3979106862961106, -1.3462716310852159, -1.292472344155587, -1.2370228547786297, -1.1804251554108023, -1.1231607256164504, -1.0656814593516717, -1.0084040272319992, -0.9517070729320349, -0.8959303638958624, -0.8413750731726497, -0.7883046122547535, -0.7369457052363243, -0.6874895979650747, -0.6400934078227069, -0.5948816573358395, -0.5519480274543164, -0.5113573398002988, -0.47314774835875373, -0.4373330985278776, -0.4039053979847945, -0.37283733898330884, -0.34408481357555787, -0.3175893695950617, -0.2932805640451073, -0.2710781802480815, -0.2508942846506155, -0.2326351078798643, -0.21620274215883306, -0.20149665338713962 ], [ -1.585671739058339, -1.6141835323892306, -1.6401597392285017, -1.663289376476082, -1.683262320489815, -1.6997741728039735, -1.7125317718954634, -1.7212593117082315, -1.725704993328924, -1.725648095651731, -1.7209063041031925, -1.711343083655027, -1.696874823771839, -1.677477419531471, -1.6531918872848697, -1.6241285503416383, -1.5904692812904393, -1.552467272241926, -1.5104438526895954, -1.4647820254761752, -1.4159166797687335, -1.3643218712568814, -1.310496073127578, -1.2549467505749319, -1.198175804373128, -1.140667234107425, -1.0828778259240617, -1.0252309827062058, -0.9681132486889059, -0.9118728004527128, -0.8568191837708028, -0.803223757692946, -0.7513205310051797, -0.7013072553698281, -0.6533467452483008, -0.6075684361624534, -0.5640701930446397, -0.522920361500906, -0.484160032141425, -0.4478054700044234, -0.4138506505549737, -0.3822698406918531, -0.35302016609058995, -0.3260441130826236, -0.30127192230735844, -0.2786238411483456, -0.25801221148069076, -0.23934337789487892, -0.2225194090004048, -0.2074396305379651 ], [ -1.592311986642852, -1.6212491177346662, -1.6476593885329118, -1.671230472711919, -1.6916508641724737, -1.7086147683198667, -1.7218276351477795, -1.7310122899170157, -1.7359155817701106, -1.7363154292635605, -1.7320280949087827, -1.7229154689861848, -1.7088920870118633, -1.6899315467749025, -1.6660719326938906, -1.6374198030606468, -1.6041522601771843, -1.5665166223066025, -1.524827275874421, -1.4794594377418402, -1.4308398257173973, -1.3794346178978283, -1.3257355209785784, -1.2702451436084943, -1.2134630324180384, -1.1558735746302777, -1.0979365290377898, -1.040080376742499, -0.9826981919286362, -0.92614546151922, -0.8707392472055822, -0.8167582046944852, -0.7644431485828884, -0.71399800164885, -0.6655910634783324, -0.6193565769212254, -0.5753965782236343, -0.533783005695267, -0.4945600258176239, -0.45774652249763925, -0.4233386878936388, -0.3913126521754622, -0.36162709356794587, -0.33422577742314796, -0.3090399822918206, -0.28599078074691675, -0.26499115214957547, -0.2459479130782496, -0.2287634584706575, -0.21333731255745714 ], [ -1.595866806095316, -1.6251196047702932, -1.6518582762997482, -1.675770307158605, -1.696544037835954, -1.7138735653118147, -1.7274642781971488, -1.737038975044471, -1.742344479979531, -1.7431586279493998, -1.7392974452708938, -1.730622300855202, -1.7170467508988225, -1.698542747004836, -1.6751458279451694, -1.6469588743870764, -1.6141539838427688, -1.5769720355957697, -1.5357195840953617, -1.490762868293119, -1.442518969824179, -1.3914444861588036, -1.3380224545422572, -1.2827485713926612, -1.2261178846160905, -1.1686130180344043, -1.110694637636879, -1.0527944076569282, -0.9953102689977007, -0.9386036182070077, -0.8829978970183476, -0.8287781695643804, -0.7761913887593861, -0.7254471725076459, -0.6767189935479152, -0.6301457298352682, -0.5858335354044011, -0.5438579880442356, -0.5042664608321212, -0.4670806564648009, -0.43229923950402527, -0.399900502717518, -0.36984500885756855, -0.3420781571701169, -0.31653263333761916, -0.29313071132887136, -0.27178638496360386, -0.2524073153987614, -0.2348965879458753, -0.21915427755073158 ], [ -1.5962963349701953, -1.6257530959004343, -1.6527124263399298, -1.6768627711742896, -1.69789353008777, -1.7154999556344515, -1.7293886700648438, -1.7392837459853734, -1.7449332589653155, -1.7461161782464854, -1.7426494158504373, -1.7343948061170045, -1.721265738966883, -1.7032331234831364, -1.680330317390243, -1.6526566283699873, -1.6203789838955318, -1.5837313907119834, -1.543011880437242, -1.4985767813769537, -1.4508323775721248, -1.400224302266369, -1.3472253197384365, -1.2923224000732412, -1.2360040996749648, -1.1787491717639462, -1.1210170603769714, -1.0632405649522578, -1.00582061816217, -0.9491228882678071, -0.8934758273793212, -0.8391698094846654, -0.7864570819600685, -0.7355523422190741, -0.686633818933156, -0.6398447770847218, -0.5952953827075351, -0.5530648656450079, -0.513203915433563, -0.47573724218909474, -0.4406662340011689, -0.407971645584568, -0.37761625933276777, -0.3495474684647424, -0.32369974157480996, -0.29999693766049185, -0.278354449935559, -0.25868116500088534, -0.2408812310199342, -0.2248556343604342 ], [ -1.5935857010894663, -1.6231341682817153, -1.650205840873554, -1.674491245184268, -1.6956820224551654, -1.7134758058879755, -1.7275816980335557, -1.7377262882474478, -1.743660112724898, -1.7451644180116617, -1.742058044280137, -1.7342041989557393, -1.7215168468210618, -1.7039664024140309, -1.681584378179159, -1.6544666228242855, -1.6227747865173106, -1.586735683732289, -1.546638303686278, -1.5028283541213399, -1.4557004203504949, -1.4056880644981782, -1.353252442065444, -1.2988702149829372, -1.2430216286033895, -1.1861795557758703, -1.1288001048505902, -1.0713151018515794, -1.0141264758523147, -0.9576023710968176, -0.9020747079150708, -0.8478379031149847, -0.7951485027548189, -0.7442255390950974, -0.6952514748487559, -0.6483736320357182, -0.603706020561994, -0.5613314884845308, -0.521304117699942, -0.4836517898968232, -0.44837885044866443, -0.4154688032828381, -0.3848869773949255, -0.35658311484910765, -0.33049383996143333, -0.3065449791476206, -0.28465371006444196, -0.26473052681894604, -0.2466810149766635, -0.2304074358178776 ], [ -1.5877449320827988, -1.6172737500141725, -1.6443503398803179, -1.6686683982177994, -1.6899229470023736, -1.7078151723054313, -1.7220578407947957, -1.732381228713904, -1.7385394609300178, -1.740317116838921, -1.7375359170531028, -1.7300612620984017, -1.7178083544675373, -1.7007476014657235, -1.6789089721495902, -1.652384972228912, -1.6213319126276136, -1.585969188845184, -1.5465763685462133, -1.5034880111178661, -1.4570863152331515, -1.407791895222222, -1.3560531933423652, -1.3023351976350153, -1.2471082076233633, -1.190837345077548, -1.13397335192578, -1.076944995468262, -1.0201531738849405, -0.9639666359439928, -0.9087191237609431, -0.8547077124491363, -0.8021921329098973, -0.7513948975719826, -0.7025020840224083, -0.6556646584134044, -0.6110002374464574, -0.568595197090928, -0.5285070416519717, -0.4907669514212881, -0.4553824327534223, -0.42234000168010966, -0.39160784097647583, -0.36313838038204027, -0.3368707597918875, -0.3127331450639007, -0.29064487517560345, -0.27051842751148936, -0.2522611949205764, -0.23577707382171464 ], [ -1.5788084223660035, -1.6082085147000114, -1.6351848777082967, -1.6594354216826677, -1.680659633386011, -1.69856335860875, -1.7128641364730046, -1.72329701550224, -1.7296207450054426, -1.7316241957913445, -1.7291328235603307, -1.72201494897129, -1.7101875932210167, -1.693621580243109, -1.6723456000026269, -1.6464489261641018, -1.616082500901078, -1.5814581459300525, -1.5428457380886667, -1.5005683036724382, -1.4549951359044395, -1.4065332116990263, -1.3556173523950512, -1.3026997043299646, -1.2482391754431696, -1.1926914339830479, -1.1364999598910774, -1.0800884686647942, -1.0238548451921985, -0.9681665711525481, -0.9133575266929668, -0.8597259971256627, -0.8075337056192107, -0.7570057056029089, -0.7083309869207394, -0.6616636687457915, -0.6171246666545622, -0.5748037314220082, -0.5347617648507714, -0.4970333251240282, -0.4616292419617325, -0.4285392707179574, -0.39773472437201207, -0.36917103271562357, -0.3427901883997502, -0.3185230493953738, -0.29629147647299403, -0.27601029227879303, -0.25758905536802845, -0.2409336481344324 ], [ -1.5668339888091485, -1.5959998305898326, -1.622774378759753, -1.6468607454636497, -1.6679639004028948, -1.6857953795835563, -1.7000785167230807, -1.7105541233430714, -1.7169865080787285, -1.7191696878872609, -1.7169336057313007, -1.7101501335458726, -1.6987386088331844, -1.6826706312753807, -1.6619738357207057, -1.636734363460783, -1.6070977789066423, -1.5732682278107823, -1.535505709689154, -1.4941214423286424, -1.4494714265028656, -1.4019484629692316, -1.351973011752641, -1.2999833901919355, -1.2464258569852043, -1.1917451105630517, -1.136375644775767, -1.0807342738312142, -1.02521399256728, -0.9701792071819884, -0.9159622744982547, -0.8628612297437583, -0.8111385576432253, -0.7610208582182845, -0.7126992662801015, -0.6663304946811737, -0.6220383822151537, -0.5799158366312144, -0.5400270719949525, -0.5024100483737662, -0.4670790311260401, -0.43402719710824544, -0.40322922571514397, -0.37464382346831016, -0.34821614143562696, -0.3238800547094336, -0.3015602821952488, -0.2811743328798395, -0.2626342714737898, -0.2458483018612121 ], [ -1.5519015590293601, -1.5807323145480519, -1.6072081494814694, -1.631038301295889, -1.6519341654560276, -1.6696139130434169, -1.6838075996108541, -1.6942626880574236, -1.700749874143959, -1.7030690674560889, -1.701055345350715, -1.6945846653454302, -1.683579095477876, -1.668011305442281, -1.6479080568691844, -1.6233524419679726, -1.59448464883809, -1.5615010817315973, -1.524651737162388, -1.484235831584239, -1.440595789074259, -1.3941098182702476, -1.34518342124004, -1.2942402640583677, -1.2417128820818626, -1.1880336821820876, -1.1336266414470917, -1.0789000012661538, -1.024240139050665, -0.9700066891046334, -0.9165288949881649, -0.8641031145000246, -0.8129913633878922, -0.7634207686923782, -0.7155837999092095, -0.6696391500143055, -0.6257131451860894, -0.5839015700653586, -0.5442718041054779, -0.5068651739708674, -0.47169943707711504, -0.4387713221227938, -0.4080590635715463, -0.3795248781360776, -0.35311734201187306, -0.3287736375757131, -0.3064216472564252, -0.28598188015255543, -0.26736922365492855, -0.25049451784330223 ], [ -1.5341115461175818, -1.5625120517710336, -1.5885979354073738, -1.612085410675457, -1.632693158417195, -1.6501468365794638, -1.664184048293393, -1.6745596884917273, -1.6810515569090485, -1.6834660918023905, -1.6816440464642726, -1.6754659022061977, -1.6648567898124813, -1.6497906793545296, -1.6302935983923117, -1.6064456533647193, -1.5783816603951824, -1.546290241252522, -1.5104113082103243, -1.4710319465584227, -1.4284808010718921, -1.3831211745129806, -1.3353431401428915, -1.285555042132302, -1.2341747949151693, -1.1816213875798232, -1.1283069533670333, -1.0746296868937182, -1.0209677982025986, -0.9676745994253568, -0.915074739415262, -0.8634615408213224, -0.8130953535589167, -0.7642028153853273, -0.7169768996838725, -0.6715776282413557, -0.628133329559223, -0.5867423290864062, -0.5474749656254653, -0.5103758374644808, -0.4754661921344463, -0.44274638471830885, -0.4121983409500085, -0.38378797254019636, -0.3574675028817741, -0.33317767122157893, -0.3108497923198038, -0.29040765642988786, -0.27176926107384736, -0.25484837158148943 ], [ -1.5135829703207317, -1.5414645492173629, -1.5670756992658514, -1.5901403819731084, -1.6103853337839285, -1.6275444527742153, -1.6413636094825819, -1.6516058007086207, -1.6580565344598603, -1.6605293032119248, -1.6588709734572555, -1.652966894694533, -1.6427455132296096, -1.6281822680009272, -1.6093025493911806, -1.5861835194726146, -1.5589546246181867, -1.5277966794270386, -1.4929394639480433, -1.4546578521479943, -1.413266574139684, -1.3691138008634163, -1.3225738182665783, -1.274039117981373, -1.2239122636981576, -1.1725978914283735, -1.1204951680947715, -1.0679909729364674, -1.0154539909411844, -0.9632298289883892, -0.911637193779327, -0.8609651122994372, -0.8114711327410051, -0.763380415583349, -0.7168856082699744, -0.6721473896274369, -0.629295569222449, -0.5884306303004898, -0.5496256114438266, -0.5129282307005191, -0.4783631659727249, -0.44593441633504105, -0.4156276801710742, -0.38741269711826287, -0.361245511419506, -0.3370706241028224, -0.3148230102456684, -0.2944299853139166, -0.2758129111586134, -0.25888873772781984 ], [ -1.4904513916514435, -1.5177324939959789, -1.542791199162078, -1.565359903980419, -1.5851740769854015, -1.6019765077129662, -1.6155219458051417, -1.6255820480835974, -1.6319505231588942, -1.6344483347143601, -1.6329287984693015, -1.6272823863826207, -1.6174410373645098, -1.603381768908971, -1.5851293905446968, -1.5627581391759406, -1.536392088928103, -1.5062042339165367, -1.472414200327756, -1.435284611956941, -1.3951162068585616, -1.3522418761874102, -1.3070198622386282, -1.2598264031652058, -1.2110481399215733, -1.1610746025657108, -1.1102910682384253, -1.0590720363977053, -1.0077755059584144, -0.9567381728743879, -0.9062716035257582, -0.8566593848000016, -0.8081552088808234, -0.7609818199161836, -0.7153307297407235, -0.6713625987665102, -0.629208174032263, -0.5889696774677271, -0.5507225422807478, -0.5145174029037647, -0.4803822532604892, -0.44832469850530476, -0.4183342362393806, -0.3903845140157983, -0.364435520310887, -0.340435675761522, -0.31832380014722494, -0.2980309382173325, -0.2794820339877929, -0.2625974485772349 ], [ -1.4648667177257602, -1.4914733877163373, -1.5159094448831996, -1.5379163212640345, -1.5572387977601752, -1.5736291034114454, -1.586851370451399, -1.5966863634874517, -1.602936374709053, -1.6054301512100502, -1.604027697334977, -1.5986247766437653, -1.5891569268541887, -1.5756027989568546, -1.5579866401548694, -1.536379760311836, -1.5109008534441637, -1.4817150889287032, -1.4490319400879816, -1.4131017781974085, -1.37421132407023, -1.33267811232775, -1.288844179413095, -1.243069229279079, -1.1957235552676921, -1.1471809998909175, -1.0978122159068342, -1.047978455326733, -0.998026063355381, -0.9482817985160552, -0.8990490448245172, -0.8506049319098237, -0.8031983375385934, -0.7570487152985188, -0.7123456680226604, -0.6692491738201017, -0.6278903648946, -0.5883727582196949, -0.5507738402664476, -0.5151469141964334, -0.48152312626630256, -0.44991359782385454, -0.420311599534837, -0.3926947148166916, -0.36702694944498937, -0.34326075362682507, -0.3213389312932565, -0.3011964188286317, -0.28276192188134175, -0.26595940429796194 ], [ -1.43699094867036, -1.462857124469947, -1.48660810600457, -1.5079948711300577, -1.5267719965721724, -1.5427015962535362, -1.5555575822204801, -1.5651301674918556, -1.5712305059034468, -1.5736953407694123, -1.5723915138062967, -1.56722017028904, -1.5581204878028707, -1.5450727559236608, -1.528100643945282, -1.5072725140099394, -1.4827016676250737, -1.4545454537629294, -1.423003214951821, -1.3883131015665062, -1.3507478406282343, -1.3106095997370852, -1.2682241346225982, -1.223934445519705, -1.1780941891944978, -1.1310610975622988, -1.0831906402460008, -1.0348301392425054, -0.9863135031517987, -0.9379567012999651, -0.890054049726679, -0.8428753357646737, -0.7966637688493544, -0.7516347138778159, -0.707975140295902, -0.6658437046816638, -0.6253713759710806, -0.586662509484569, -0.5497962773795467, -0.5148283679704336, -0.4817928735361223, -0.45070429492678676, -0.4215596007750415, -0.3943402888348747, -0.36901440646764505, -0.34553849623867416, -0.3238594407569527, -0.3039161881513198, -0.28564134587018297, -0.2689626358165491 ], [ -1.4069959161734285, -1.432063574271178, -1.4550749384124557, -1.475790953564836, -1.493976380072128, -1.5094035619026318, -1.521856485626339, -1.531135051142842, -1.5370594531093649, -1.539474551229533, -1.5382540897873245, -1.5333046138652637, -1.524568923298511, -1.5120289070265178, -1.4957076110899434, -1.475670413471085, -1.4520252080204603, -1.4249215368991528, -1.3945486546709225, -1.3611325551142732, -1.324932041079779, -1.286233964846413, -1.2453478076759268, -1.2025997989500068, -1.158326794343823, -1.1128701370722347, -1.0665697160940393, -1.0197584117733278, -0.9727570858707876, -0.9258702327961796, -0.8793823669384033, -0.8335551803046864, -0.7886254684693964, -0.7448037927260541, -0.7022738231307774, -0.6611922908076959, -0.6216894679036911, -0.583870089066998, -0.5478146282871434, -0.513580848365649, -0.4812055462441065, -0.4507064250581274, -0.42208403239451464, -0.39532371321679005, -0.3703975348291495, -0.3472661497280325, -0.32588057000640624, -0.30618383398110016, -0.2881125518353401, -0.2715983222909134 ], [ -1.3750610672362313, -1.3992802261043533, -1.4215052868881195, -1.441507495138432, -1.4590620897095512, -1.473951893625567, -1.4859711654950394, -1.494929634832129, -1.5006566246820345, -1.5030051464800613, -1.5018558366677643, -1.497120593862263, -1.4887457708225806, -1.4767147782835017, -1.4610499686907785, -1.441813687175591, -1.4191084043474365, -1.3930758796505502, -1.3638953435307009, -1.3317807293804989, -1.296977029601718, -1.259755891227641, -1.2204106023217038, -1.1792506478890878, -1.1365960309092142, -1.0927715588460514, -1.0481012883724385, -1.0029033021322946, -0.9574849634115019, -0.9121387606369873, -0.8671388170057606, -0.8227381043864552, -0.7791663674822525, -0.7366287358663172, -0.6953049788710939, -0.6553493417056346, -0.6168908903340274, -0.5800342869628732, -0.544860916652392, -0.5114302877039332, -0.47978163322044953, -0.44993564778686945, -0.4218963008751011, -0.3956526767605446, -0.3711807989779655, -0.34844540529260315, -0.3274016465677455, -0.3079966896120354, -0.2901712099997904, -0.27386076594599895 ], [ -1.3413713354974646, -1.3646999358778185, -1.3860997112970042, -1.405352456416309, -1.422244094749832, -1.4365680866539994, -1.4481290696719005, -1.4567466574724812, -1.4622593056739086, -1.464528136519469, -1.463440601094394, -1.4589138489563116, -1.450897671987145, -1.4393768929575896, -1.4243730803056263, -1.4059454890370315, -1.384191152979152, -1.3592440848436917, -1.3312735761721493, -1.3004816273206248, -1.2670995759267307, -1.231384028311203, -1.1936122294701759, -1.1540770313545294, -1.1130816341054168, -1.070934279645478, -1.02794307128524, -0.9844110775881738, -0.9406318553669355, -0.896885497745715, -0.8534352814133911, -0.8105249551366807, -0.7683766815521932, -0.7271896178949988, -0.6871390996977914, -0.648376375062072, -0.6110288258217825, -0.5752006053916686, -0.5409736206901764, -0.5084087865069383, -0.4775474842779712, -0.44841316270102105, -0.4210130243088239, -0.39533974945457406, -0.3713732166931142, -0.34908218590916795, -0.3284259174922812, -0.309355707213974, -0.2918163221243475, -0.2757473277072091 ], [ -1.3061151347033306, -1.32851881520373, -1.3490617734001664, -1.3675365207061299, -1.383739788009494, -1.3974757470319141, -1.4085594380547721, -1.416820333584473, -1.4221059514604253, -1.424285416542943, -1.4232528587153805, -1.4189305277395297, -1.4112715036145191, -1.4002618853298814, -1.3859223517080832, -1.3683090053753728, -1.3475134342685733, -1.3236619534967746, -1.29691402243031, -1.2674598658452683, -1.2355173618235786, -1.2013282907758245, -1.1651540673051375, -1.1272710977394558, -1.0879659194897162, -1.047530282997199, -1.006256332712475, -0.9644320309012372, -0.9223369484388005, -0.880238522031341, -0.8383888496812586, -0.7970220679003799, -0.7563523271317145, -0.7165723576192493, -0.6778525976158425, -0.6403408398946433, -0.6041623411416794, -0.5694203317258987, -0.5361968600970658, -0.5045539060430125, -0.474534699577414, -0.4461651866682239, -0.4194555887438821, -0.39440200939656866, -0.3709880484957382, -0.34918639068125423, -0.3289603416621385, -0.31026529172230344, -0.29305009121465775, -0.27725832755081536 ], [ -1.269482500473107, -1.2909342875458087, -1.310596010945478, -1.328270990609164, -1.3437668102696312, -1.356898350070563, -1.3674910019080746, -1.375384000765162, -1.3804337909687385, -1.3825173336858578, -1.3815352522040847, -1.377414705694105, -1.3701118811665294, -1.3596139978852602, -1.3459407289104026, -1.329144960625092, -1.3093128325343877, -1.2865630253815263, -1.2610452944266068, -1.2329382750158768, -1.2024466175929667, -1.1697975372438432, -1.1352368869458394, -1.0990248823129618, -1.0614316175391973, -1.022732516668243, -0.9832038610877799, -0.9431185237234248, -0.9027420238519246, -0.8623289952887685, -0.8221201367284182, -0.7823396880743585, -0.7431934523916703, -0.7048673610442464, -0.6675265606506801, -0.6313149853021441, -0.5963553662464174, -0.5627496238516331, -0.5305795827849046, -0.49990795048644054, -0.4707795006249955, -0.44322240670502056, -0.41724967580720873, -0.39286063808826654, -0.37004245372245503, -0.34877160509745064, -0.32901534802026766, -0.31073310125804254, -0.29387775880999256, -0.27839691381005716 ], [ -1.2316633983655483, -1.2521433293398259, -1.2709061159626576, -1.2877659083279656, -1.3025411180535684, -1.3150572615453613, -1.3251499647726805, -1.3326680667917088, -1.3374767464890123, -1.3394605859527193, -1.3385264755017159, -1.334606260655337, -1.3276590310038143, -1.317672955599325, -1.3046665793668901, -1.2886895100051605, -1.2698224444034039, -1.248176506881554, -1.2238918974034354, -1.1971358749289154, -1.1681001277287082, -1.1369976072109893, -1.1040589230896947, -1.0695284142249257, -1.0336600201470132, -0.9967130825028255, -0.9589482032872502, -0.9206232781113814, -0.8819898087623133, -0.8432895811661663, -0.8047517740550775, -0.7665905417142327, -0.7290030926099854, -0.6921682657182395, -0.656245588923357, -0.6213747895437607, -0.5876757161364875, -0.5552486232324392, -0.5241747663288421, -0.49451725293520965, -0.466322096265806, -0.4396194207939721, -0.4144247728414281, -0.390740494217793, -0.3685571222610792, -0.3478547851348035, -0.3286045666573997, -0.3107698200860989, -0.294307415020138, -0.27916890584684906 ], [ -1.1928462086931533, -1.2123409055114078, -1.2301933254020403, -1.2462284063254419, -1.2602752995698594, -1.2721700244138208, -1.2817582655294095, -1.2888982545333483, -1.2934636657348477, -1.295346446411001, -1.2944594947340322, -1.2907390945991692, -1.284147016737441, -1.2746722001040731, -1.2623319367855044, -1.2471724974161444, -1.229269151859282, -1.20872556089579, -1.1856725378328326, -1.1602662030565487, -1.1326855782627372, -1.1031296890415423, -1.0718142633699608, -1.0389681282503676, -1.0048294163532694, -0.9696416985499273, -0.9336501565284356, -0.8970979025697651, -0.8602225417102516, -0.8232530559489357, -0.7864070720989647, -0.7498885556389911, -0.713885953750279, -0.6785707927237072, -0.6440967189479425, -0.610598959329945, -0.5781941665611654, -0.5469806071881795, -0.5170386458340055, -0.48843147685765875, -0.46120605485289445, -0.4353941772476998, -0.41101367544374556, -0.38806967502593825, -0.3665558902164603, -0.34645592264142766, -0.32774453937689685, -0.31038890995736257, -0.29434978643073006, -0.2795826145410294 ], [ -1.1532163917723275, -1.1717186016016508, -1.1886550246209067, -1.2038612869155854, -1.2171771352821643, -1.2284489052316663, -1.2375321153800032, -1.2442941339351354, -1.248616852873607, -1.2503992968320035, -1.2495600874942683, -1.2460396810485133, -1.2398022967026545, -1.2308374586718454, -1.2191610826112596, -1.2048160500086327, -1.1878722301221647, -1.1684259279346454, -1.1465987573540213, -1.1225359604259864, -1.0964042144511055, -1.0683889884259081, -1.038691527036188, -1.0075255535561993, -0.975113791712444, -0.9416844104107778, -0.9074674940902531, -0.8726916355975471, -0.8375807384393628, -0.8023511019067197, -0.7672088468973077, -0.732347723393123, -0.6979473235582885, -0.6641717082667138, -0.6311684403270017, -0.5990680052961415, -0.5679835908864562, -0.5380111886798226, -0.5092299770958066, -0.48170294210395426, -0.4554776917200418, -0.430587421525508, -0.4070519909275694, -0.3848790732764763, -0.3640653469502618, -0.34459769882415514, -0.32645441593022506, -0.3096063454001228, -0.29401800683637347, -0.279648644982453 ], [ -1.1129553314661313, -1.130463448577168, -1.1464835578259294, -1.1608618227595624, -1.1734483928060349, -1.1840996875895426, -1.1926807936269397, -1.1990679234944315, -1.2031508785132652, -1.204835448402123, -1.2040456758673541, -1.2007259113807844, -1.1948425839385997, -1.186385617731816, -1.1753694324887023, -1.1618334766164418, -1.1458422567601865, -1.127484844363322, -1.10687385841229, -1.084143942804519, -1.05944977564359, -1.032963665196811, -1.0048728022751008, -0.9753762505815528, -0.9446817644929104, -0.9130025274083795, -0.880553903126975, -0.8475502878956087, -0.8142021422757963, -0.7807132705068344, -0.7472784014546001, -0.7140811104618591, -0.6812921063821005, -0.6490678936232156, -0.6175498058440835, -0.5868633965510374, -0.5571181625538519, -0.5284075692007262, -0.5008093414960515, -0.474385982464096, -0.44918547921649765, -0.4252421578174085, -0.4025776499008772, -0.3812019367668511, -0.3611144400732177, -0.3423051319936691, -0.3247556416080848, -0.30844033815880445, -0.29332737551028454, -0.27937968559589454 ], [ -1.072239350030983, -1.0887569313839944, -1.1038652344370774, -1.1174207650218202, -1.1292838405924386, -1.1393206946885361, -1.1474056820226686, -1.1534235386896632, -1.1572716438743595, -1.1588622226242078, -1.1581244243673843, -1.155006209458562, -1.1494759765756233, -1.1415238675593509, -1.1311626933660954, -1.1184284350439488, -1.1033802866690001, -1.0861002224050098, -1.0666920865215914, -1.045280222451081, -1.0220076738543553, -0.9970340062800996, -0.9705328114891074, -0.9426889671521592, -0.9136957318723524, -0.8837517590034722, -0.853058112451471, -0.8218153637184654, -0.7902208422720107, -0.7584661014822505, -0.7267346505889987, -0.695199990232388, -0.664023975798244, -0.6333555199231998, -0.6033296335930187, -0.5740667948226708, -0.5456726252410977, -0.5182378481728939, -0.4918384970290701, -0.4665363398897511, -0.44237948489892764, -0.41940313125521467, -0.39763043190596303, -0.37707343626306855, -0.35773408409887864, -0.33960522501610224, -0.32267164131615234, -0.30691105555061116, -0.29229510740171294, -0.27879028770421144 ], [ -1.031238883422785, -1.0467741683845493, -1.060979516398253, -1.0737215420295558, -1.0848704610247466, -1.0943020194670772, -1.101899513928133, -1.10755586151005, -1.1111756713244318, -1.1126772627716615, -1.1119945715268829, -1.10907888191799, -1.1039003248074581, -1.0964490834258973, -1.0867362559243534, -1.0747943325824116, -1.0606772572884924, -1.044460056569212, -1.0262380344063273, -1.0061255465603753, -0.9842543832909239, -0.9607718034065118, -0.9358382747419056, -0.9096249858121053, -0.8823112000565855, -0.8540815274795843, -0.8251231885373858, -0.795623341956845, -0.7657665421216155, -0.7357323832281466, -0.705693377204855, -0.6758131010804447, -0.6462446377637698, -0.6171293226940763, -0.5885957980850152, -0.5607593669479529, -0.5337216310375671, -0.5075703904795736, -0.4823797781596253, -0.4582105989137353, -0.4351108420251555, -0.41311633530758163, -0.39225150991674496, -0.3725302467482552, -0.353956777622051, -0.3365266172136444, -0.32022750468570127, -0.3050403370463294, -0.29094007928898324, -0.27789663925884145 ], [ -0.9901178033169538, -1.0046832459343182, -1.0179983686382013, -1.029939628560561, -1.0403868409838921, -1.049224938306628, -1.0563458123597975, -1.0616502033311523, -1.065049591833026, -1.066468044944771, -1.0658439628837626, -1.0631316707858067, -1.0583028002914636, -1.0513474084871202, -1.0422747873142164, -1.0311139247206595, -1.0179135892782074, -1.002742022249469, -0.9856862345419983, -0.9668509199277227, -0.9463570095877438, -0.924339905732845, -0.9009474430806106, -0.8763376357796704, -0.8506762735428521, -0.8241344340340602, -0.796885978880886, -0.7691050981692082, -0.740963963197639, -0.7126305400484136, -0.6842666076884564, -0.6560260144283725, -0.6280531962260745, -0.6004819700799802, -0.5734346060994588, -0.5470211731552411, -0.5213391455799464, -0.49647325237431184, -0.4724955458403759, -0.44946566347859584, -0.4274312552506533, -0.40642854777008564, -0.38648301745425384, -0.3676101459549067, -0.34981623308276066, -0.3330992447681289, -0.31744967618827136, -0.30285141289974826, -0.2892825755239742, -0.27671633615458546 ], [ -0.9490328700916534, -0.9626446904295178, -0.9750857530762351, -0.9862420642287717, -0.9960027164686683, -1.0042614830961838, -1.010918490004758, -1.015881932652112, -1.0190697994633662, -1.020411557633807, -1.0198497532678616, -1.0173414755496657, -1.0128596345620742, -1.0063940047003774, -0.9979519904481764, -0.9875590784991651, -0.9752589495434534, -0.9611132340535766, -0.9452009085397406, -0.9276173413505505, -0.9084730094956722, -0.8878919194986348, -0.8660097753504786, -0.8429719447276356, -0.8189312803897189, -0.7940458568641809, -0.7684766830936367, -0.7423854497635598, -0.7159323657823292, -0.6892741322108813, -0.6625620942823729, -0.6359406035100224, -0.6095456127624167, -0.583503518073789, -0.5579302522801981, -0.532930627681627, -0.5085979180836446, -0.4850136649348459, -0.46224768792118043, -0.4403582772995477, -0.419392543379111, -0.3993868977698364, -0.38036764116265387, -0.3623516333161948, -0.34534702243065885, -0.32935401302559064, -0.314365653655714, -0.3003686281663597, -0.2873440365981189, -0.27526815421111717 ], [ -0.9081332998429299, -0.9208110590986509, -0.9323972456618185, -0.9427870987135809, -0.9518786473444185, -0.9595741461544707, -0.9657815842544064, -0.9704162394470284, -0.9734022435271181, -0.9746741194792802, -0.9741782473456833, -0.9718742131229342, -0.9677359946022018, -0.9617529398429738, -0.9539304980658919, -0.9442906690885489, -0.9328721457596982, -0.9197301337695782, -0.904935844203997, -0.8885756656705557, -0.8707500341315593, -0.8515720291243309, -0.8311657342905507, -0.8096644076210526, -0.7872085122200632, -0.7639436615071252, -0.7400185335506804, -0.7155828077463265, -0.6907851735216353, -0.6657714554767877, -0.640682892741561, -0.6156546027733654, -0.5908142517794608, -0.5662809458420076, -0.5421643490356324, -0.5185640276684089, -0.4955690134873315, -0.4732575734270884, -0.45169716932741666, -0.4309445880102959, -0.41104622014638126, -0.3920384653586173, -0.37394824088639067, -0.35679357172575143, -0.3405842413230269, -0.3253224834869276, -0.31100369806435435, -0.2976171749784924, -0.2851468133528655, -0.27357182455859463 ], [ -0.8675604280702265, -0.8793266305298, -0.8900797558295463, -0.8997239416672189, -0.9081657985968625, -0.915315693043879, -0.9210891010850695, -0.9254080089100825, -0.9282023303060642, -0.9294113064427829, -0.9289848491401796, -0.9268847861229692, -0.9230859658929842, -0.9175771810497331, -0.9103618722806186, -0.9014585807696289, -0.8909011242094829, -0.8787384805705618, -0.8650343737880317, -0.8498665660150784, -0.8333258714713516, -0.8155149166304566, -0.7965466800385109, -0.7765428520276179, -0.7556320596862389, -0.7339480054975873, -0.7116275690089765, -0.6888089198213635, -0.6656296872687857, -0.642225227661236, -0.6187270242253718, -0.595261248268531, -0.5719475029971536, -0.548897764211138, -0.5262155251059625, -0.503995145926237, -0.4823214034470885, -0.46126923036418366, -0.44090363073400884, -0.42127975464658096, -0.40244311330481164, -0.3844299145585831, -0.3672674985986665, -0.35097485383856286, -0.33556319387615563, -0.3210365777063737, -0.3073925569325212, -0.29462283549000534, -0.2827139292584607, -0.27164781481866296 ], [ -0.8274474529187184, -0.8383271763396082, -0.8482713283481345, -0.857192595930119, -0.8650058054744235, -0.8716290595364906, -0.8769849430653345, -0.8810017790509905, -0.883614908142748, -0.8847679617120108, -0.8844140935502356, -0.8825171323678496, -0.8790526159030488, -0.8740086680561401, -0.8673866831770982, -0.8592017864169319, -0.8494830456979845, -0.8382734190046406, -0.8256294298723397, -0.8116205736215241, -0.7963284664913901, -0.779845758848259, -0.7622748416118603, -0.7437263815839783, -0.7243177262092402, -0.7041712212913848, -0.6834124862884555, -0.6621686910822616, -0.6405668757200467, -0.6187323507963742, -0.5967872111723667, -0.574848989944181, -0.5530294733086533, -0.5314336905575204, -0.5101590871583677, -0.48929488300357327, -0.4689216126275271, -0.44911083964994214, -0.4299250339842213, -0.4114175974869787, -0.39363302170394854, -0.3766071601378118, -0.36036759694602505, -0.34493409407510434, -0.3303190994454399, -0.31652829980931574, -0.30356120321014335, -0.2914117374760502, -0.28006885280148497, -0.2695171181328042 ], [ -0.7879192417251548, -0.7979397964252992, -0.8071010087636369, -0.8153237541001678, -0.8225307015188345, -0.8286473108125252, -0.8336028987926083, -0.8373317588181861, -0.8397743121124492, -0.8408782642503589, -0.840599735640756, -0.838904331381016, -0.8357681139759793, -0.8311784424158415, -0.8251346431685412, -0.8176484827467829, -0.8087444174614631, -0.7984596034214683, -0.7868436583220704, -0.7739581755575755, -0.7598760001642763, -0.7446802845459506, -0.7284633494209256, -0.711325381610938, -0.6933730049237682, -0.6747177633262252, -0.655474556827238, -0.6357600700538908, -0.6156912315496255, -0.5953837385637416, -0.5749506777924671, -0.5545012674612377, -0.5341397406008201, -0.5139643836536982, -0.4940667389146476, -0.47453097398655864, -0.4554334166015239, -0.4368422489507734, -0.418817352169357, -0.401410288870362, -0.3846644096164106, -0.3686150679167214, -0.35328992768450296, -0.33870934700235733, -0.3248868224329441, -0.31182947888511725, -0.2995385911105738, -0.28801012417655913, -0.27723528165929634, -0.26720105176344033 ], [ -0.749092186025364, -0.7582828018340722, -0.7666887554156261, -0.7742387404682995, -0.7808628906380718, -0.7864936433104661, -0.7910666735789771, -0.7945218861145659, -0.7968044473334992, -0.7978658348874206, -0.7976648765818553, -0.7961687469000323, -0.7933538868551082, -0.789206812287215, -0.7837247771619841, -0.7769162619182789, -0.7688012622654754, -0.7594113606952992, -0.7487895708873551, -0.7369899536327666, -0.7240770113532271, -0.7101248762703075, -0.6952163143697366, -0.679441573186314, -0.6628971058858478, -0.6456842070201836, -0.6279075966545389, -0.6096739893725632, -0.5910906830860222, -0.5722641998017032, -0.5532990067581688, -0.5342963418931739, -0.5153531627004044, -0.4965612324355795, -0.4780063525703061, -0.4597677455701167, -0.4419175876557506, -0.4245206873174284, -0.4076343020720419, -0.39130808332397116, -0.3755841372174963, -0.36049718802784947, -0.34607482988081506, -0.33233785235286417, -0.3193006257094346, -0.3069715321084623, -0.2953534299494692, -0.28444413960906156, -0.2742369400022808, -0.26472106668399087 ], [ -0.7110740920865084, -0.7194656313760532, -0.7271453832822757, -0.7340494827913753, -0.7401151470093741, -0.745281412448508, -0.7494899441626808, -0.752685908168715, -0.7548188931966839, -0.7558438621771387, -0.7557221085311707, -0.7544221878620339, -0.7519207925957647, -0.7482035359020275, -0.7432656120785429, -0.7371123035232656, -0.7297593092604591, -0.7212328763730749, -0.7115697231535706, -0.7008167507951235, -0.6890305484855952, -0.6762767043660879, -0.662628941580857, -0.6481681042759694, -0.6329810226999388, -0.6171592894164484, -0.6007979800410229, -0.5839943519206277, -0.5668465529115718, -0.5494523700495604, -0.5319080446531604, -0.5143071764853087, -0.49673973524858595, -0.4792911931351045, -0.46204178759788384, -0.445065919139928, -0.42843168487873995, -0.4122005450517322, -0.39642711655989715, -0.38115908514560115, -0.36643722587776295, -0.35229552025789956, -0.33876135742773694, -0.32585580660005586, -0.31359394788668027, -0.30198524909261215, -0.29103397671355014, -0.2807396302482379, -0.2710973899548126, -0.26209856928540454 ], [ -0.673964096364227, -0.6815887906383253, -0.688572527628702, -0.69485850126918, -0.7003906296612623, -0.7051141726492456, -0.7089764235684027, -0.7119274701877361, -0.7139210143533713, -0.7149152338822136, -0.7148736644339522, -0.7137660740421199, -0.7115692993151063, -0.7082680104981411, -0.7038553728860714, -0.6983335745284058, -0.691714194581389, -0.6840183926650676, -0.6752769066889962, -0.6655298542830034, -0.6548263406871241, -0.6432238832530067, -0.6307876692088923, -0.6175896687615566, -0.6037076297703243, -0.5892239830425665, -0.5742246887611351, -0.5587980547250821, -0.5430335560842451, -0.5270206842359809, -0.5108478497167255, -0.4946013604660202, -0.47836449297402006, -0.4622166697460386, -0.44623275241505, -0.43048245586785594, -0.41502988505796035, -0.39993319286278806, -0.38524435447808203, -0.37100905147136887, -0.3572666567551166, -0.34405031038044476, -0.3313870751665917, -0.31929816072726025, -0.30779920438061503, -0.29690059767644306, -0.28660784778183657, -0.27692196367649946, -0.2678398579645077, -0.25935475606049574 ], [ -0.6378525979833165, -0.6447438049602753, -0.6510626185276168, -0.6567589053638382, -0.6617829020142032, -0.66608571966921, -0.6696199259260682, -0.6723402019971152, -0.6742040681487389, -0.6751726638311286, -0.6752115626166658, -0.6742915964075722, -0.6723896590740942, -0.669489457273489, -0.66558217598224, -0.6606670282947884, -0.6547516631014609, -0.6478524099624927, -0.6399943473335815, -0.6312111877173804, -0.6215449807855001, -0.6110456425754325, -0.5997703251505756, -0.5877826463560939, -0.575151803346988, -0.5619515963355531, -0.5482593905083838, -0.5341550443655431, -0.5197198319517558, -0.5050353847317562, -0.49018267638229396, -0.4752410707164819, -0.4602874495090099, -0.44539543333298015, -0.4306347048166532, -0.4160704401273023, -0.40176285111141774, -0.38776683746177487, -0.37413174561095364, -0.3609012288104251, -0.34811320106266397, -0.3357998762284614, -0.32398788271233847, -0.3126984436021063, -0.3019476119607798, -0.29174655109096204, -0.2821018499614161, -0.2730158645509936, -0.26448707657670356, -0.25651046188486615 ], [ -0.6028212033104812, -0.6090131811165979, -0.6146988607076357, -0.6198343926665134, -0.6243759503826688, -0.6282801290886451, -0.631504425013945, -0.6340077964016185, -0.6357513022565815, -0.6366988079743242, -0.6368177401091388, -0.636079866258731, -0.634462071113966, -0.631947096739662, -0.6285242144566324, -0.6241897973401476, -0.6189477661215426, -0.6128098867573228, -0.6057959045733711, -0.5979335071254963, -0.589258115200235, -0.5798125082519798, -0.5696462966784197, -0.5588152584300214, -0.5473805613867864, -0.5354078956610524, -0.5229665415150931, -0.5101283989885663, -0.49696700472819866, -0.4835565600421169, -0.4699709920255183, -0.4562830668908011, -0.4425635715533567, -0.428880576234991, -0.4152987874995846, -0.40187899786075043, -0.3886776350094674, -0.3757464108879712, -0.36313206834881573, -0.3508762210259786, -0.33901528032848005, -0.32758046214721837, -0.3165978649289084, -0.30608861018981404, -0.2960690362811732, -0.286550936235742, -0.2775418307762152, -0.2690452680059764, -0.2610611418866504, -0.253586022294492 ], [ -0.5689426808124134, -0.5744703758078127, -0.5795552167475793, -0.5841592477644909, -0.5882441993468714, -0.5917717888475441, -0.5947041044133838, -0.5970040771775754, -0.5986360404667211, -0.5995663676426087, -0.5997641727537234, -0.5992020512651685, -0.5978568325920883, -0.5957103126346489, -0.5927499333787989, -0.5889693779469383, -0.5843690530228626, -0.5789564358848724, -0.5727462697863519, -0.5657605985234532, -0.558028638171222, -0.5495864906918235, -0.5404767100760334, -0.5307477366413748, -0.5204532189506458, -0.509651245493004, -0.49840350981378156, -0.4867744332669026, -0.4748302691085804, -0.46263821039009256, -0.45026552219078064, -0.43777871631549004, -0.42524278381673053, -0.41272049773675357, -0.400271795432268, -0.38795324686232346, -0.37581761238744094, -0.3639134910250812, -0.3522850577917258, -0.3409718867751017, -0.3300088549417466, -0.3194261203998877, -0.3092491678956507, -0.2994989137010825, -0.2901918617259972, -0.2813403026169057, -0.27295254775722566, -0.2650331904135055, -0.257583386744336, -0.25060114996473815 ], [ -0.5362809275219953, -0.5411797724252051, -0.5456963952190923, -0.5497983428360788, -0.553452525834531, -0.5566254277676355, -0.5592834012976783, -0.561393058782133, -0.5629217587495255, -0.5638381821418263, -0.5641129842103936, -0.5637195004410563, -0.5626344787524251, -0.5608388061754565, -0.5583181966922955, -0.5550638079517582, -0.5510727579338979, -0.5463485178218228, -0.5409011637474894, -0.5347474770825429, -0.5279108899779992, -0.5204212794560358, -0.51231461918722, -0.5036325029313375, -0.49442155736983573, -0.48473276468755444, -0.47462071680941664, -0.4641428237479409, -0.4533584981839649, -0.442328337318025, -0.4311133213354591, -0.41977404566771237, -0.40837000174629645, -0.3969589182659773, -0.38559617222104503, -0.37433427625855953, -0.36322244629537415, -0.35230625094350376, -0.3416273421356293, -0.3312232644763734, -0.32112733928631954, -0.3113686180611901, -0.30197189913186917, -0.292957800666128, -0.2843428827754937, -0.276139811351681, -0.2683575563229256, -0.26100161725745186, -0.25407426961477153, -0.24757482542284492 ], [ -0.5048909513866288, -0.5091966707461067, -0.5131778487862821, -0.5168071452967637, -0.5200562775050026, -0.5228961458680692, -0.5252970498188946, -0.5272290038342865, -0.528662157673815, -0.5295673167088297, -0.5299165497569406, -0.5296838637588306, -0.5288459179572874, -0.5273827457370497, -0.5252784503999345, -0.5225218419473844, -0.5191069851465023, -0.5150336342468329, -0.5103075360521053, -0.5049405899813069, -0.4989508606962575, -0.492362445366337, -0.48520520335709383, -0.4775143608670126, -0.4693300067009597, -0.4606964979488438, -0.4516617958824317, -0.44227675298159175, -0.43259437176829496, -0.42266905519141995, -0.41255586680191814, -0.4023098170204632, -0.3919851895567791, -0.38163491961198304, -0.3713100329911131, -0.3610591527686048, -0.3509280777654885, -0.340959434879349, -0.33119240530647254, -0.32166252294490627, -0.3124015417882695, -0.30343736792049836, -0.2947940507984318, -0.28649182784953975, -0.2785472159966388, -0.27097314352540647, -0.26377911570552803, -0.25697140773285354, -0.2505532788477257, -0.24452520187463433 ], [ -0.4748188763338045, -0.47856729700000566, -0.4820457902610221, -0.48523174098960675, -0.4881013043438277, -0.49062945570579963, -0.4927901335433088, -0.494556487927423, -0.4959012407320045, -0.4967971552609056, -0.497217604081708, -0.497137215256626, -0.49653256999650086, -0.4953829198487839, -0.49367088933479486, -0.4913831305392711, -0.48851089922969304, -0.4850505270938812, -0.4810037709590994, -0.47637802671921226, -0.4711864025566098, -0.4654476524403015, -0.45918597649161375, -0.4524306994452999, -0.44521584201675823, -0.43757960251639516, -0.4295637675879592, -0.42121307158361265, -0.41257452393992167, -0.4036967231118349, -0.39462917428411726, -0.38542162633699617, -0.37612344151409727, -0.36678300903580596, -0.35744721161887594, -0.3481609515901415, -0.3389667410915712, -0.32990435882527636, -0.3210105739262572, -0.3123189359098786, -0.30385962824072166, -0.2956593819176849, -0.2877414445665136, -0.28012559986533425, -0.2728282316858359, -0.26586242709129115, -0.25923811226897375, -0.25296221556254483, -0.24703885198357378, -0.24146952389450405 ], [ -0.44610197883720715, -0.4493288438837636, -0.4523372369258647, -0.45510888388020554, -0.4576240149687937, -0.4598613466552638, -0.4617981591216951, -0.4634104840792559, -0.46467341084193947, -0.4655615100175067, -0.4660493648104328, -0.4661121909099999, -0.4657265183557552, -0.4648709035033164, -0.46352663674830963, -0.46167841206848115, -0.4593149273990561, -0.456429389786566, -0.45301990547381676, -0.44908974185938366, -0.44464745504864234, -0.43970688300927563, -0.43428700985006385, -0.428411711281264, -0.4221093948194651, -0.4154125507817219, -0.40835723163848336, -0.40098247796111663, -0.39332970912367893, -0.385442096223079, -0.37736393348947417, -0.36914002288784287, -0.36081508477244506, -0.35243320544934487, -0.344037330418252, -0.3356688099823133, -0.3273670018993621, -0.3191689338545468, -0.3111090268041673, -0.3032188787039285, -0.29552710681093086, -0.28805924564663765, -0.2808376968284184, -0.2738817263127934, -0.2672075041318106, -0.26082818142716724, -0.2547539994747454, -0.2489924254224405, -0.24354830961364138, -0.23842405961459878 ], [ -0.41876876589263423, -0.4215095513628516, -0.4240800948200225, -0.42646608471061287, -0.4286514707328899, -0.43061838569145505, -0.43234716506589077, -0.4338164808149497, -0.43500359895897167, -0.43588476168323276, -0.4364356850411525, -0.43663215397436106, -0.436450688453662, -0.435869248986936, -0.43486794704652787, -0.4334297262032758, -0.4315409825880768, -0.4291920981380756, -0.4263778662062846, -0.4230977958140999, -0.4193562875007608, -0.41516267991349864, -0.4105311716823816, -0.4054806275678683, -0.40003428129852225, -0.3942193499519877, -0.3880665762454425, -0.38160971579444947, -0.374884986386849, -0.3679304957220052, -0.3607856630024563, -0.3534906483470168, -0.3460858023241299, -0.338611146075101, -0.3311058905910571, -0.32360800179676763, -0.31615381623861816, -0.3087777104228022, -0.30151182524084474, -0.2943858454811654, -0.28742683317562756, -0.280659112478034, -0.27410420291943616, -0.26778079722732606, -0.2617047794224968, -0.25588927860370436, -0.25034475367894615, -0.2450791042839061, -0.24009780322261043, -0.23540404595241426 ], [ -0.39283910445387116, -0.39512883929093845, -0.39729329493238186, -0.39932175136396364, -0.4012015310476844, -0.40291786860784773, -0.4044538798860623, -0.40579064826302436, -0.40690743910182947, -0.40778204422461295, -0.40839124846839936, -0.40871140076991563, -0.4087190640784273, -0.4083917126189318, -0.4077084421465642, -0.4066506589113722, -0.40520271575437916, -0.4033524684735934, -0.40109173160559886, -0.3984166193523596, -0.3953277639379963, -0.39183040975130934, -0.38793438691927407, -0.38365397230504106, -0.3790076492810416, -0.3740177800200093, -0.3687102055498108, -0.36311378953511186, -0.3572599217954795, -0.3511819970628757, -0.3449148835349477, -0.3384943945000073, -0.33195677479124663, -0.3253382121583146, -0.318674381899258, -0.31200003134064214, -0.30534860904314176, -0.29875194198898547, -0.2922399625111012, -0.2858404853777903, -0.27957903426804565, -0.27347871587083084, -0.26756013901912934, -0.2618413756229784, -0.25633795968668505, -0.251062920371942, -0.24602684488579463, -0.24123796691359212, -0.23670227636464247, -0.2324236463343401 ], [ -0.3683244114530019, -0.3701975019147671, -0.3719869922472181, -0.37368539266654677, -0.37528306230532116, -0.3767680345412675, -0.37812594277569345, -0.379340065574269, -0.3803915030308678, -0.3812594872196322, -0.38192181964380656, -0.3823554188745696, -0.38253695328533077, -0.3824435278640872, -0.38205339105609404, -0.3813466275178603, -0.38030580521533297, -0.3789165498661773, -0.3771680255814125, -0.3750533069953417, -0.37256963458235626, -0.36971855079508376, -0.36650591982868486, -0.36294183806715485, -0.35904044555437853, -0.35481965118482206, -0.3503007858042758, -0.34550819815299594, -0.3404688086858101, -0.3352116358805196, -0.3297673088065094, -0.3241675785700042, -0.3184448398723303, -0.31263167239255196, -0.3067604101066509, -0.30086274504155797, -0.2949693703844747, -0.2891096663666478, -0.283311430948617, -0.27760065607433426, -0.272001349150935, -0.26653539845850904, -0.2612224804028639, -0.2560800058919881, -0.2511231026371754, -0.24636462984223584, -0.24181522153666546, -0.23748335471631088, -0.23337543846277709, -0.2294959203047886 ], [ -0.34522791156512556, -0.34671797222934464, -0.3481628363616822, -0.34955789502065937, -0.35089622035891277, -0.35216835419730286, -0.35336219752024134, -0.3544630204590761, -0.3554536053281422, -0.35631452632385197, -0.35702455956534707, -0.3575612074393354, -0.3579013128894901, -0.35802173329524967, -0.3579000404431283, -0.3575152128767167, -0.35684828929186885, -0.35588295602264486, -0.35460604732613843, -0.3530079434194906, -0.3510828574570648, -0.34882900841676623, -0.34624868190525937, -0.343348185042741, -0.34013770480574124, -0.33663108152212107, -0.33284551070348467, -0.3288011871683165, -0.3245209055659135, -0.3200296310670039, -0.31535405324729715, -0.3105221351504993, -0.3055626682635256, -0.30050484274400246, -0.29537784077379947, -0.290210459427764, -0.28503076799017746, -0.2798658032606358, -0.2747413050952513, -0.2696814932508139, -0.2647088855535701, -0.25984415651003623, -0.2551060347179209, -0.2505112368197562, -0.2460744352650035, -0.24180825680000118, -0.23772330837812206, -0.23382822706287842, -0.23012975047076423, -0.22663280435444322 ] ], "zauto": true, "zmax": 1.7461161782464854, "zmin": -1.7461161782464854 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.5393928795334373, 0.5247295770218586, 0.5096542980554783, 0.4941542477481872, 0.4782115508677005, 0.46180364577359945, 0.4449042640061328, 0.4274851122481533, 0.40951837042538075, 0.3909801235071375, 0.37185486761960945, 0.3521412925131563, 0.3318596699099363, 0.3110614091715531, 0.28984172764667776, 0.268356974197856, 0.2468489439689385, 0.22567930249171397, 0.20537696999985122, 0.18669671832463222, 0.17067032939134066, 0.1585914767049621, 0.1518258132234932, 0.15138310703262461, 0.15745231605114166, 0.16931341004686962, 0.1857150590072462, 0.20534729477932145, 0.22710898305448374, 0.2501696974831147, 0.27393443695405884, 0.2979857760454089, 0.3220324346441051, 0.3458704708644502, 0.36935575902867007, 0.3923849645843435, 0.4148825619091794, 0.43679207204739606, 0.4580702315174454, 0.47868318822023626, 0.49860408646747956, 0.5178115874676413, 0.5362890019034671, 0.5540238054058033, 0.5710073768819359, 0.5872348507593363, 0.60270501183354, 0.6174201887691744, 0.6313861217871422, 0.6446117935403498 ], [ 0.5347582477634875, 0.5199445952147145, 0.5047328652152417, 0.489111935292734, 0.47306536082928496, 0.4565717279102554, 0.4396056129660356, 0.42213927141765606, 0.40414517230875374, 0.3855994965997119, 0.36648673659221986, 0.3468055931940371, 0.3265764959895808, 0.30585130940986593, 0.2847261898206257, 0.2633591782089748, 0.24199495573120067, 0.22100001203659037, 0.20091117580279766, 0.18249549376734636, 0.16680124920451966, 0.15513709628917666, 0.14886600001911093, 0.14895818390842194, 0.15553162103779258, 0.1678023774252594, 0.18449330047483073, 0.2043032313403569, 0.2261553792213872, 0.24924518207678326, 0.27299934484302524, 0.2970169743739769, 0.32101880049093484, 0.34480934141748515, 0.36825024387413813, 0.39124193102127014, 0.4137111291349718, 0.4356024914829602, 0.4568730645871158, 0.4774887165221993, 0.497421904819843, 0.5166503406563084, 0.5351562332281364, 0.5529258906531085, 0.5699495218866965, 0.5862211346088133, 0.6017384611814011, 0.6165028717127335, 0.6305192523435197, 0.643795839948554 ], [ 0.5305823330132066, 0.5156493723920713, 0.500335055018299, 0.4846306084476, 0.46852186965195164, 0.4519896291790552, 0.4350106094790114, 0.41755920748727493, 0.39961012495008974, 0.3811420085054688, 0.3621422387697349, 0.3426130645229317, 0.32257940437570964, 0.302098873989685, 0.2812749899222002, 0.2602750907269176, 0.23935526494932485, 0.21889514486207184, 0.19944452450482847, 0.1817776544492614, 0.16693170771527396, 0.15616558573233721, 0.15073915122036458, 0.15149029849347584, 0.15844616493760835, 0.17082337472335105, 0.1874125572729679, 0.20699343722504515, 0.22855250980414918, 0.25132625767142147, 0.27476563741912263, 0.2984833447663856, 0.3222073532734327, 0.3457457007169754, 0.36896133843309237, 0.39175464320184744, 0.4140514508580136, 0.4357949920550526, 0.45694056233376984, 0.477452091738306, 0.4973000152222843, 0.5164600129432005, 0.5349123111732965, 0.5526413243005318, 0.569635485289757, 0.5858871618431075, 0.6013925923235695, 0.6161518022148783, 0.6301684807651858, 0.6434498103346006 ], [ 0.5268892247734018, 0.5118685101176853, 0.4964857677155546, 0.4807352293486447, 0.4646058451681877, 0.4480816512936756, 0.4311428038011741, 0.41376741884060697, 0.395934351360326, 0.37762704188337953, 0.35883857549881004, 0.33957815012843107, 0.3198792700995492, 0.29981020015509907, 0.2794875667811063, 0.25909448067832225, 0.23890505886468938, 0.21931725491130877, 0.20089397157578284, 0.18440492497683106, 0.170842611442384, 0.16135402821837927, 0.15701750053022873, 0.15848373134436952, 0.16569395113591398, 0.17792065279365515, 0.19408831321830272, 0.21310698533775754, 0.23405441551736014, 0.2562203695322591, 0.27908328402731253, 0.3022682946124981, 0.3255077052437341, 0.3486097088821361, 0.37143534325062716, 0.3938820996977771, 0.41587252198007685, 0.4373464336950499, 0.45825576096509457, 0.4785611839554042, 0.4982300525672749, 0.517235152154874, 0.5355540181589484, 0.5531685841752875, 0.5700650129706389, 0.5862336089897788, 0.6016687473647234, 0.6163687809851728, 0.6303359059689838, 0.6435759786633766 ], [ 0.5237011561774556, 0.5086248600559026, 0.4932082668191461, 0.47744922845253435, 0.4613405983791059, 0.44487065160557493, 0.428024205697687, 0.41078459244479515, 0.3931366223085223, 0.37507067883867445, 0.35658809090578775, 0.3377079753116222, 0.3184758441506403, 0.2989744528725462, 0.27933763355481217, 0.25976816350272586, 0.24056084702694155, 0.2221313067059133, 0.205047966008751, 0.19005648830612765, 0.1780696925116886, 0.17007732048112253, 0.16693991908551734, 0.1691147884165874, 0.17647883159577854, 0.18839018411411132, 0.20393356494607642, 0.22217047658985864, 0.2422853382196183, 0.2636309224531643, 0.2857182044413789, 0.3081866408449357, 0.3307728799174368, 0.35328433434109424, 0.37557880703628965, 0.3975495111286773, 0.4191143917805488, 0.4402087120348891, 0.46078004475299067, 0.48078499709702255, 0.500187151152481, 0.5189558311729089, 0.5370654086706975, 0.5544949359071063, 0.5712279601832944, 0.5872524188411657, 0.6025605506412981, 0.6171487854190156, 0.6310175925656586, 0.6441712816159718 ], [ 0.5210379850490309, 0.5059390118160128, 0.4905236844400311, 0.47479403923089014, 0.4587475604196808, 0.4423776763605042, 0.4256749895888706, 0.4086293993853776, 0.39123326657438656, 0.37348576194218874, 0.355398542815878, 0.337002931732747, 0.31835884194550956, 0.29956581334772436, 0.2807766653843673, 0.2622143361821457, 0.2441921681496946, 0.22713654989798504, 0.2116071713658534, 0.19830260811263617, 0.18802795656130727, 0.1815956616844729, 0.1796526286052723, 0.1824896204692904, 0.1899441118001826, 0.2014659177454066, 0.21629550771866835, 0.23364387214540602, 0.25280559124420465, 0.27320237711743, 0.29438329020784443, 0.3160061410426624, 0.33781441295555925, 0.3596160555826467, 0.38126618385746386, 0.4026538252361392, 0.4236921790760988, 0.4443116934356558, 0.46445530152565445, 0.4840752575557062, 0.5031311184883056, 0.5215885165877775, 0.5394184524893951, 0.556596909080036, 0.5731046435657503, 0.5889270600633639, 0.6040540994848269, 0.6184801090490603, 0.6322036720827285, 0.6452273913646293 ], [ 0.5189165208258545, 0.5038285876254566, 0.4884502878817352, 0.47278834151618854, 0.4568455082048704, 0.44062117530266953, 0.4241127069961721, 0.40731771878338413, 0.39023742983087606, 0.3728812312822591, 0.355272599286036, 0.33745648678457446, 0.3195083532301988, 0.3015450252536689, 0.283737571264491, 0.26632617709881695, 0.24963631861075083, 0.23409377923556304, 0.22023251263431712, 0.20868379291805175, 0.20013000423181773, 0.19520993137491777, 0.19438563020707553, 0.19781984930365604, 0.20533082125530433, 0.21645236446389485, 0.23056052433626154, 0.24700026259618246, 0.265170587210824, 0.28456333520740135, 0.304769712458666, 0.3254702767515659, 0.346419014066729, 0.3674271284417223, 0.3883489322984779, 0.40907052711448455, 0.4295011914892147, 0.4495670953747659, 0.46920688286711754, 0.488368685848141, 0.5070081881693519, 0.5250874281836447, 0.5425740941063794, 0.5594411265021678, 0.5756664929936643, 0.5912330416301633, 0.6061283717395036, 0.6203446855269966, 0.6338786014160882, 0.6467309224219466 ], [ 0.5173497169331998, 0.502307363104908, 0.48700252615356465, 0.47144703136363725, 0.45564945584592065, 0.43961581427579877, 0.42335102320692114, 0.40686130831389583, 0.39015770266941663, 0.3732607602355623, 0.35620658167368413, 0.33905422267247093, 0.32189452357995146, 0.3048603373355543, 0.28813797073047526, 0.27197924473319585, 0.25671266687273697, 0.24275045582573218, 0.23058539970248662, 0.22076851738893247, 0.21385812795069065, 0.21033842846289721, 0.21052389515849174, 0.21448566547142786, 0.22203636613218705, 0.2327811448242967, 0.24620727381026372, 0.26177298480594524, 0.2789705087077421, 0.29735868545414434, 0.31657234551918007, 0.3363180879630647, 0.3563639432541489, 0.3765274870982993, 0.39666473902033067, 0.41666080979735104, 0.4364225226912008, 0.45587287545849287, 0.4749470620113028, 0.49358973383572863, 0.5117531966700671, 0.5293962778113496, 0.5464836477466143, 0.5629854279690066, 0.5788769603715906, 0.5941386505003831, 0.6087558266605697, 0.6227185797457203, 0.6360215655060881, 0.6486637627917994 ], [ 0.5163457691874158, 0.5013842598683643, 0.486189908188723, 0.47077997656598414, 0.4551692801283604, 0.4393709657389164, 0.4233980729620975, 0.40726603504421494, 0.39099625480039096, 0.3746208538168818, 0.3581886443995105, 0.3417723099616348, 0.3254766888883704, 0.30944790602927713, 0.2938828153786438, 0.2790376895937052, 0.26523416610985207, 0.25285905263568337, 0.24235297137742548, 0.23418207695958226, 0.22878943051139125, 0.2265302710100348, 0.22760712069277603, 0.23202856150055476, 0.23960983996381693, 0.2500145784066741, 0.26281867355035704, 0.2775729655905055, 0.29384960179091507, 0.3112683934935914, 0.32950672613108717, 0.34829880113022943, 0.3674292886471334, 0.3867248844885191, 0.4060458179110549, 0.4252783349518123, 0.4443285498298321, 0.4631177015182768, 0.48157867256851655, 0.49965355197189615, 0.5172920083011596, 0.5344502559175465, 0.551090428807452, 0.5671802134698363, 0.5826926282999967, 0.5976058689417576, 0.6119031657231379, 0.6255726202833557, 0.6386070042290595, 0.6510035138445219 ], [ 0.5159071798217297, 0.5010622798508186, 0.4860157950082277, 0.47079065495295214, 0.4554081952889033, 0.4398890145467207, 0.4242545994934901, 0.40852986348600057, 0.392746710632148, 0.37694868748950766, 0.36119671160717826, 0.34557576637107273, 0.3302023091512761, 0.3152319233474551, 0.30086640240052, 0.2873589204187806, 0.2750151865919402, 0.26418761137658836, 0.25525898416285575, 0.24861292608956354, 0.24459162408482799, 0.24344731772225844, 0.24530030585566057, 0.2501179273597696, 0.2577225860365195, 0.2678252459433102, 0.2800716432807086, 0.2940870457649173, 0.30951037777601775, 0.3260150095968013, 0.34331794718573605, 0.3611808837264861, 0.37940649906323703, 0.3978325820373045, 0.4163256536289359, 0.43477504599317984, 0.4530878902306007, 0.4711851490067685, 0.48899864776676016, 0.5064689660506803, 0.523544015482801, 0.5401781304581675, 0.556331515844766, 0.5719699228961672, 0.5870644535273477, 0.6015914203069139, 0.6155322129747453, 0.6288731412527121, 0.6416052381964003, 0.6537240187892885 ], [ 0.5160298607500181, 0.5013374692938297, 0.4864762108586858, 0.47147480091403876, 0.45636122684523484, 0.4411636575705524, 0.42591208930194807, 0.4106408521680026, 0.39539206076215994, 0.3802200259273527, 0.3651965510961296, 0.3504169071472202, 0.33600610188314045, 0.32212481290084616, 0.30897401140595127, 0.29679686192975063, 0.28587599772913097, 0.27652395124194423, 0.2690647947635127, 0.26380651004016226, 0.261006604215841, 0.26083738256196803, 0.26336001000491294, 0.26851553015816404, 0.27613574852695755, 0.28596995885353044, 0.29771892446910864, 0.3110673486324206, 0.32570914464888284, 0.34136361951516375, 0.35778342492255255, 0.374756378906963, 0.3921034139063433, 0.4096745152619375, 0.4273439720276254, 0.44500576680917286, 0.4625695501685729, 0.4799573809610785, 0.49710124662043054, 0.5139412823470462, 0.5304245635272846, 0.5465043340870223, 0.5621395417462084, 0.5772945698750931, 0.591939078437714, 0.6060478892631764, 0.6196008712773673, 0.6325827982621048, 0.6449831649093701, 0.6567959566232641 ], [ 0.5167023561863567, 0.5021980089006952, 0.4875587892382013, 0.47281919883905243, 0.45801384962921554, 0.44317839256383795, 0.42835113188411783, 0.4135754243560309, 0.3989029119233729, 0.38439755770671014, 0.37014034495891796, 0.3562343510171413, 0.34280971657327103, 0.3300277888095143, 0.3180834297968752, 0.3072041864663686, 0.2976448217720178, 0.2896758185772964, 0.2835651866332023, 0.279554467553117, 0.2778321076332026, 0.27850953855080857, 0.2816060177716622, 0.28704652037566564, 0.2946731386158801, 0.30426640252864207, 0.3155706971119032, 0.3283182156197521, 0.3422478483646211, 0.35711771602885123, 0.3727117815246233, 0.38884185452205067, 0.40534650971607206, 0.4220882638619175, 0.4389500321514, 0.4558315498934871, 0.47264616320066144, 0.4893181804778497, 0.5057808316076148, 0.5219747922496637, 0.5378471832340384, 0.5533509372009378, 0.5684444260249739, 0.5830912550526647, 0.5972601478680709, 0.6109248641798842, 0.6240641110320593, 0.6366614225771606, 0.6487049956252323, 0.6601874771182185 ], [ 0.5179052621930798, 0.5036235238289091, 0.48924196621030114, 0.47480075731744403, 0.4603409478652512, 0.4459053801512096, 0.43154021524294917, 0.4172971496139701, 0.40323633357688476, 0.3894299165070542, 0.3759660248881011, 0.3629528270347112, 0.35052215442563417, 0.33883194322289073, 0.32806655807896634, 0.3184339252012428, 0.3101584443828037, 0.3034690278090766, 0.29858247224675893, 0.29568370814603934, 0.29490596671824154, 0.2963148964217836, 0.2999004100932909, 0.30557830343560044, 0.3132010568820946, 0.32257489542943213, 0.3334791104004005, 0.34568402447295304, 0.358965267697631, 0.37311348543528605, 0.3879397129209622, 0.4032772678996643, 0.4189812085875639, 0.43492633469130254, 0.4510045144994159, 0.4671218947562633, 0.483196342835929, 0.49915530413293213, 0.5149341362319731, 0.5304749014502362, 0.545725553275795, 0.5606394316416555, 0.5751749789777387, 0.5892955968941583, 0.6029695769745391, 0.6161700547730569, 0.6288749512797032, 0.6410668794456521, 0.6527330042080813, 0.6638648526997888 ], [ 0.5196109090127374, 0.5055846927813503, 0.4914945154116401, 0.4773859750974258, 0.4633062257112632, 0.449304824464965, 0.43543511767594745, 0.42175620682732873, 0.4083354734036756, 0.3952515499387137, 0.38259750577450424, 0.3704838723813111, 0.3590409743503844, 0.3484198793112908, 0.33879117258563973, 0.33034076545775515, 0.32326214851581925, 0.31774499157434183, 0.3139607950626779, 0.3120472919783219, 0.31209416259938727, 0.3141329122659384, 0.31813315160080774, 0.3240060794004796, 0.3316142254237389, 0.3407851641712394, 0.35132642091504723, 0.3630391559066856, 0.3757290799076362, 0.3892140001379355, 0.4033281350131282, 0.41792377158342336, 0.4328710051193449, 0.4480562815049332, 0.4633803449362898, 0.47875603873546263, 0.4941062546620169, 0.5093621960587789, 0.5244620202632964, 0.5393498563030767, 0.5539751513157862, 0.5682922779538212, 0.5822603294291389, 0.5958430334858641, 0.6090087270323092, 0.6217303460747312, 0.633985398666755, 0.6457559004046899, 0.6570282618358004, 0.6677931247709271 ], [ 0.5217833525404508, 0.5080432113395164, 0.49427548919454206, 0.4805308724434462, 0.46686214999819525, 0.4533249596541526, 0.43997898383725775, 0.42688961003461445, 0.41413000595095134, 0.4017834702386123, 0.38994580880811236, 0.3787273619430614, 0.3682541844579908, 0.3586677871286877, 0.3501228240900227, 0.3427822123801625, 0.3368094519753738, 0.3323584051350742, 0.3295614478435994, 0.32851756883648436, 0.32928241094913957, 0.3318621728978826, 0.33621262015698505, 0.3422433589668319, 0.3498263922747672, 0.3588072024250646, 0.3690164015447494, 0.3802803019048596, 0.3924293568081448, 0.40530405757389143, 0.4187583764767304, 0.43266115746109457, 0.4468959904082188, 0.4613601090946352, 0.4759627802508905, 0.4906235437222022, 0.5052705506351479, 0.5198391448821662, 0.5342707515547416, 0.5485120766221135, 0.5625145838710758, 0.5762341945493367, 0.5896311481087961, 0.6026699647382068, 0.6153194583214219, 0.6275527591241641, 0.6393473167764887, 0.6506848646004981, 0.6615513352647178, 0.6719367248138522 ], [ 0.5243786966950872, 0.5109521343743257, 0.49753459305014547, 0.48418141577314827, 0.47095045106158845, 0.45790266192356294, 0.4451030923870491, 0.4326221839607451, 0.42053737132015645, 0.40893480418617034, 0.39791094585601056, 0.3875736991890791, 0.37804262694956325, 0.36944779327355104, 0.36192679265400113, 0.35561968976213887, 0.35066189177115936, 0.3471754017369027, 0.3452593832693796, 0.3449813636773808, 0.346370545412412, 0.3494144625595049, 0.3540596206469488, 0.36021596267290584, 0.3677642718619, 0.3765651776680043, 0.38646836572563303, 0.3973208441281793, 0.40897353929938235, 0.42128593255825164, 0.4341288011787178, 0.4473853548541058, 0.4609511651521561, 0.4747332996813842, 0.48864902737956445, 0.5026243855074852, 0.5165928140964205, 0.5304939838542163, 0.5442728768275681, 0.5578791287594381, 0.5712666081691835, 0.5843931878114332, 0.5972206564018966, 0.6097147191040023, 0.6218450412267229, 0.6335852983640522, 0.6449132058959559, 0.6558105100612907, 0.6662629309233353, 0.6762600541075582 ], [ 0.5273457422024698, 0.5142565903467345, 0.5012129816092779, 0.488274416717553, 0.47550315198710297, 0.4629646417564505, 0.45072824822013696, 0.43886819385256204, 0.4274646737348687, 0.4166049734547125, 0.40638435981473603, 0.396906439067797, 0.38828262995050217, 0.3806304012169095, 0.37407000237926674, 0.368719592237172, 0.36468894324648954, 0.36207223723408305, 0.36094079374097987, 0.3613367798521059, 0.3632689388616637, 0.36671110067250196, 0.3716037498032144, 0.3778583645081134, 0.3853637705592754, 0.39399350013627094, 0.40361314460161546, 0.4140868880621665, 0.42528270962651926, 0.4370760509888573, 0.44935199802181824, 0.4620061929810345, 0.4749447785133102, 0.4880836921561177, 0.5013476016242275, 0.5146687168499932, 0.5279856504354447, 0.5412424352129327, 0.5543877530518597, 0.5673743864284975, 0.5801588744725446, 0.5927013372783194, 0.6049654242155593, 0.6169183413410998, 0.6285309173521985, 0.6397776746886112, 0.6506368806848526, 0.6610905618807832, 0.6711244719458843, 0.6807280097532435 ], [ 0.5306269329443178, 0.5178948310683377, 0.5052444297808644, 0.492738846068254, 0.48044404986613565, 0.4684291187040493, 0.45676667589667846, 0.4455334765277412, 0.4348110552386226, 0.4246862911490385, 0.41525168606755525, 0.40660510524860133, 0.39884871248131215, 0.39208686263585346, 0.3864228117119572, 0.38195427334513626, 0.37876807841718463, 0.37693444127282255, 0.3765015380018462, 0.3774911867162385, 0.3798963340571171, 0.3836807927228669, 0.3887812990657007, 0.3951115691877939, 0.4025677317386201, 0.4110343734861145, 0.4203904596161709, 0.43051454470218015, 0.441288908569328, 0.4526024729790523, 0.46435253839224633, 0.4764455058761233, 0.48879681629885313, 0.5013303567557916, 0.5139775664367818, 0.5266764347598206, 0.5393705354193814, 0.5520081900246381, 0.5645418102900795, 0.5769274317092964, 0.5891244255703041, 0.6010953597583379, 0.6128059707249351, 0.6242252074484405, 0.6353253112174759, 0.6460819008359507, 0.6564740398896279, 0.666484269918807, 0.6760985999655021, 0.6853064485793035 ], [ 0.5341595514973663, 0.5217995576677864, 0.5095568063690901, 0.4974974736573416, 0.4856905407027255, 0.47420784797629567, 0.46312425879961117, 0.45251789179581126, 0.44247034063282137, 0.43306675444226184, 0.42439561144491905, 0.41654799312884766, 0.4096161706669532, 0.40369136251014714, 0.39886062047793047, 0.3952029483196446, 0.3927849324192857, 0.3916563322572987, 0.3918461902470318, 0.39336003175130957, 0.396178613887244, 0.40025846018131, 0.40553413806278893, 0.41192196848655616, 0.4193246664021346, 0.4276363335244999, 0.436747260497686, 0.4465481146154359, 0.4569332494193051, 0.46780303405189433, 0.4790652354482398, 0.4906355816672061, 0.5024376878929111, 0.5144025433023817, 0.5264677460671823, 0.5385766449553968, 0.5506775081430006, 0.5627228000222445, 0.5746686100974756, 0.5864742476239377, 0.5981019929152805, 0.6095169813339498, 0.6206871880769738, 0.6315834796389593, 0.642179699736864, 0.652452762028137, 0.6623827278621779, 0.6719528535748177, 0.6811495977637758, 0.6899625841369434 ], [ 0.5378771026619085, 0.5258994492769675, 0.5140737622323551, 0.5024687295922926, 0.4911556648085918, 0.4802083558256095, 0.4697029612389943, 0.4597179139581302, 0.4503337612457153, 0.441632838087889, 0.43369864587852075, 0.4266147998627188, 0.4204634267972669, 0.41532294680552845, 0.4112652624072818, 0.4083524953321252, 0.40663353818326625, 0.40614079337205256, 0.4068875229348929, 0.40886620488693437, 0.41204817902997104, 0.41638468694240904, 0.42180920735353117, 0.4282408069950335, 0.4355881074805129, 0.4437534295933904, 0.4526367134035253, 0.46213890464908675, 0.4721646164975252, 0.4826239948864072, 0.49343381638874717, 0.5045179201218746, 0.5158071174335559, 0.5272387379888718, 0.5387559643087763, 0.5503070856043866, 0.5618447724625631, 0.5733254421213358, 0.5847087539367214, 0.5959572489684777, 0.6070361278638503, 0.6179131477616218, 0.6285586113312748, 0.6389454183519284, 0.6490491512319746, 0.6588481693573927, 0.668323692042112, 0.677459855250885, 0.6862437325222333, 0.6946653152097436 ], [ 0.5417108182671089, 0.530120815825549, 0.5187165409781134, 0.5075686802279376, 0.49675025083747476, 0.48633624706615874, 0.47640328405294563, 0.467029205344248, 0.4582925977367971, 0.45027213674500566, 0.4430456736836261, 0.43668897821161906, 0.4312740748161426, 0.42686716182233037, 0.4235261751870918, 0.4212981470138921, 0.42021659310914844, 0.42029922290593613, 0.4215462779054696, 0.4239397594516793, 0.4274437059254023, 0.43200554196887325, 0.4375583777101146, 0.4440240153673475, 0.4513163472958012, 0.45934481278419076, 0.4680176157044108, 0.4772444763706703, 0.4869387796399231, 0.4970190698335308, 0.5074099186624078, 0.51804224787012, 0.5288532217030429, 0.5397858371903508, 0.5507883363960742, 0.5618135490898639, 0.5728182515315992, 0.5837626015981557, 0.5946096857340801, 0.6053251915900579, 0.6158772031188734, 0.6262361028351602, 0.6363745587285519, 0.6462675702973919, 0.6558925484363728, 0.6652294064882529, 0.6742606437395463, 0.682971407228313, 0.6913495223449388, 0.6993854869346643 ], [ 0.5455912177835953, 0.5343892993593016, 0.5234058257875132, 0.5127130214258662, 0.502385050526343, 0.4924974680141325, 0.48312663141557305, 0.47434904900248936, 0.466240625214767, 0.458875753556524, 0.4523262040423374, 0.4466597617443774, 0.44193859875125874, 0.43821740466328885, 0.4355413568191785, 0.4339440716648815, 0.4334457295405138, 0.43405159176768043, 0.4357511194495212, 0.43851785367753693, 0.44231013296382266, 0.4470726212327015, 0.4527385193502069, 0.4592322547542434, 0.46647240066973106, 0.4743745727936443, 0.4828540825357187, 0.4918281812717381, 0.5012177967781805, 0.5109487292666218, 0.5209523314095779, 0.5311657392805426, 0.5415317474160191, 0.5519984320366998, 0.5625186243266805, 0.5730493239318099, 0.5835511250934194, 0.5939877074197565, 0.6043254229876491, 0.6145329933050254, 0.6245813149280885, 0.6344433617856368, 0.6440941655087727, 0.6535108518722645, 0.662672711149718, 0.6715612819935709, 0.6801604316125854, 0.6884564188671561, 0.6964379309042599, 0.7040960877245225 ], [ 0.5494496658583342, 0.5386315575120096, 0.5280635485450692, 0.5178190084220015, 0.5079727780065952, 0.49860043567237256, 0.48977750023066086, 0.4815785572367424, 0.4740762882716407, 0.46734037916042764, 0.46143628590572755, 0.45642384925062085, 0.4523557717778193, 0.44927600436643816, 0.4472181274423066, 0.4462038492952332, 0.44624176930718135, 0.4473265591496216, 0.4494386941392364, 0.45254482005077157, 0.4565987744184952, 0.4615432075549006, 0.46731168104281046, 0.47383107242819544, 0.4810240916387083, 0.48881171868929835, 0.497115399569644, 0.5058588804188363, 0.5149696105454744, 0.524379694603054, 0.5340264172211939, 0.5438523958971417, 0.553805438476535, 0.5638381904230151, 0.5739076559003962, 0.5839746678268494, 0.5940033681519059, 0.6039607432156366, 0.6138162423889933, 0.6235414929711973, 0.6331101116686123, 0.6424976034801018, 0.6516813325712768, 0.6606405464782905, 0.6693564342508718, 0.6778122003196815, 0.6859931383340102, 0.69388669239615, 0.7014824965493663, 0.7087723867029398 ], [ 0.553219877952399, 0.542776875743432, 0.5326146039151983, 0.5228072621162716, 0.5134299924925302, 0.5045579735463523, 0.4962654374083539, 0.48862461006391905, 0.4817045727144824, 0.47557004383661594, 0.47028008741207455, 0.46588676454742445, 0.4624337634220422, 0.4599550645496743, 0.4584737210187463, 0.4580008513406878, 0.45853494990315813, 0.46006161205541796, 0.46255374564347734, 0.46597230036592857, 0.4702674964670856, 0.4753804833714392, 0.48124531564890044, 0.4877911051786183, 0.49494419828288283, 0.5026302349537177, 0.5107759709584174, 0.5193107774697969, 0.5281677711532946, 0.5372845650450646, 0.5466036629350647, 0.5560725446707933, 0.5656435056368728, 0.5752733207220466, 0.584922802389248, 0.5945563156608488, 0.6041413018565858, 0.613647849726572, 0.6230483389562173, 0.6323171682866054, 0.6414305696767255, 0.6503665015881527, 0.6591046087699751, 0.6676262327273439, 0.67591445602509, 0.6839541642444666, 0.6917321112763264, 0.6992369762237146, 0.7064594030935424, 0.7133920173604252 ], [ 0.5568393368927486, 0.546758669331071, 0.5369884284742829, 0.5276034124007549, 0.5186787873443193, 0.5102890218042004, 0.5025067401100354, 0.4954015087310151, 0.489038571410363, 0.4834775536055326, 0.4787711633800632, 0.4749639250340881, 0.47209099277989175, 0.470177103032212, 0.46923573277092756, 0.4692685347809364, 0.47026511546590855, 0.47220320565810586, 0.4750492496829142, 0.47875940543644724, 0.4832809128443641, 0.4885537551648223, 0.4945125122389411, 0.5010882906128613, 0.5082106140029192, 0.5158091682247852, 0.5238153150700742, 0.5321633162307773, 0.5407912374552155, 0.5496415311753033, 0.5586613200944318, 0.5678024228101801, 0.5770211745646645, 0.5862781016290184, 0.5955375072935272, 0.6047670220929544, 0.6139371621572477, 0.6230209289151268, 0.6319934721607949, 0.6408318278602385, 0.6495147328587246, 0.6580225113644956, 0.6663370229294995, 0.6744416585760975, 0.6823213704929916, 0.6899627209942591, 0.6973539378049978, 0.7044849648137446, 0.711347499866597, 0.7179350136862048 ], [ 0.5602505946679732, 0.5505158498896996, 0.5411204211933973, 0.5321395577219494, 0.5236482692566062, 0.5157201119213152, 0.5084258973113696, 0.5018323523526128, 0.4960007627946212, 0.49098563893015523, 0.4868334477122533, 0.4835814604511579, 0.4812567689186928, 0.4798755238443835, 0.4794424471611255, 0.4799506617861638, 0.4813818695683058, 0.4837068895426854, 0.4868865461302321, 0.4908728727058286, 0.49561057295506855, 0.5010386636164229, 0.5070922100014945, 0.5137040615594661, 0.5208064989742107, 0.5283327159935063, 0.5362180766495428, 0.5444011094810494, 0.5528242224083888, 0.561434142820266, 0.5701821053929899, 0.5790238239206434, 0.5879192923288299, 0.596832463994874, 0.6057308579178725, 0.6145851359604019, 0.6233686883387669, 0.6320572558744071, 0.6406286082948363, 0.6490622889993869, 0.6573394288796078, 0.665442625458407, 0.6733558789990622, 0.681064574340402, 0.6885554958834982, 0.6958168631290642, 0.7028383751314095, 0.7096112538744416, 0.7161282785927435, 0.7223838052071067 ], [ 0.5634024439366069, 0.5539940429730863, 0.5449531949536988, 0.5363555348858747, 0.5282758271951031, 0.5207866122918262, 0.5139567870346216, 0.5078501604019527, 0.5025240328871534, 0.4980278536704269, 0.49440201269901585, 0.49167682467501295, 0.4898717580262792, 0.4889949539232931, 0.48904306839992656, 0.4900014551930971, 0.49184468904447054, 0.49453741029003445, 0.498035453207044, 0.5022872044221082, 0.5072351251562235, 0.5128173632782499, 0.5189693786629774, 0.5256255082798584, 0.5327204053401369, 0.5401902988360009, 0.5479740347264227, 0.5560138764860709, 0.5642560593163635, 0.5726511076948152, 0.5811539389944484, 0.5897237858267917, 0.5983239760950971, 0.6069216124056921, 0.6154871917344193, 0.6239942026210554, 0.63241873139629, 0.640739101851914, 0.6489355651556519, 0.656990049407335, 0.6648859716036221, 0.6726081093144821, 0.6801425252824022, 0.687476535473731, 0.6945987097460585, 0.7014988940572152, 0.7081682437888124, 0.7145992590318411, 0.7207858143372888, 0.726723177255956 ], [ 0.5662509516637265, 0.5571466522577306, 0.5484376585754923, 0.5402000034987989, 0.5325082012613735, 0.525433761465403, 0.5190436527254106, 0.5133987711444837, 0.5085524766018192, 0.5045492640387725, 0.5014236364241943, 0.49919924014176775, 0.4978883121144588, 0.49749147178250386, 0.49799787153114067, 0.4993856982807178, 0.5016229988250475, 0.504668784040975, 0.5084743536908303, 0.5129847749429053, 0.5181404440574143, 0.5238786615564612, 0.5301351559595916, 0.5368454990492768, 0.5439463658543453, 0.5513766043568097, 0.55907809261724, 0.5669963738601221, 0.5750810723504424, 0.5832861039383062, 0.5915697043367577, 0.5998943050502966, 0.6082262910984214, 0.6165356762135337, 0.6247957301973817, 0.6329825899588399, 0.6410748809430361, 0.6490533697965274, 0.6569006628070178, 0.6646009584696102, 0.6721398569241729, 0.6795042243093833, 0.6866821064772751, 0.6936626840648882, 0.7004362595735104, 0.7069942667262115, 0.7133292927756076, 0.7194351054097395, 0.7253066772507856, 0.730940202475794 ], [ 0.5687603526676767, 0.5599357715954657, 0.5515339348552681, 0.5436313553892558, 0.536302367180179, 0.5296175102916609, 0.5236418854997824, 0.5184335475376564, 0.5140420134451656, 0.5105069644219172, 0.5078572146450868, 0.5061100083151465, 0.5052706874316362, 0.5053327493207371, 0.5062782874508419, 0.5080787846482191, 0.5106962072570614, 0.5140843340572172, 0.5181902457272111, 0.5229558990859674, 0.5283197142009939, 0.5342181102291764, 0.5405869360489569, 0.5473627530904992, 0.5544839393793422, 0.5618915951253894, 0.5695302408920253, 0.5773483092581285, 0.5852984397407227, 0.5933375943513428, 0.601427017265253, 0.6095320664591972, 0.6176219476607613, 0.6256693815086635, 0.6336502335474807, 0.641543133812965, 0.6493291086612946, 0.6569912425877716, 0.6645143825216551, 0.6718848919030959, 0.6790904571090414, 0.6861199447684925, 0.6929633053601287, 0.6996115162808767, 0.7060565562870891, 0.7122914027457847, 0.7183100433514572, 0.7241074947006776, 0.7296798212053731, 0.7350241491115954 ], [ 0.5709038035919239, 0.5623329489082205, 0.5542121225459157, 0.5466184612967817, 0.5396262532413774, 0.5333051942702175, 0.5277186375869088, 0.5229219190938634, 0.5189608479892164, 0.5158704506904203, 0.5136740461356024, 0.5123827116999471, 0.5119951730421789, 0.5124981211963315, 0.5138669300228849, 0.5160667206452731, 0.519053699839956, 0.5227766882419133, 0.5271787518000778, 0.5321988549274687, 0.5377734641456651, 0.5438380443870686, 0.5503284044240119, 0.5571818616426092, 0.5643382087144493, 0.5717404753222953, 0.5793354869982663, 0.5870742305174493, 0.5949120413422679, 0.6028086334412334, 0.6107279954241993, 0.6186381792972026, 0.6265110091836662, 0.6343217370669129, 0.6420486710403989, 0.6496727988591336, 0.6571774260066959, 0.6645478433281987, 0.6717710348600174, 0.6788354321338126, 0.6857307172269361, 0.6924476733915664, 0.6989780793623351, 0.7053146414797845, 0.7114509565667726, 0.7173814979914324, 0.7231016174376868, 0.7286075554539831, 0.7338964547275227, 0.7389663711054443 ], [ 0.572663998108469, 0.5643198057928264, 0.5564529095417371, 0.5491412656738837, 0.5424593041178868, 0.5364760538341589, 0.5312532874301271, 0.5268437820149867, 0.5232897980947628, 0.5206218732610891, 0.5188580116110127, 0.5180033240719718, 0.5180501418319787, 0.5189785891542658, 0.5207575679289724, 0.5233460789185977, 0.5266947869435895, 0.5307477304358199, 0.5354440790997357, 0.5407198546110056, 0.5465095453525546, 0.5527475641540185, 0.559369515453657, 0.5663132536787523, 0.5735197272245788, 0.5809336121480695, 0.5885037469272276, 0.5961833848734853, 0.6039302844983767, 0.611706660681329, 0.6194790210675257, 0.6272179128275954, 0.6348976047490457, 0.642495728603812, 0.6499929018787207, 0.6573723513540641, 0.6646195538201498, 0.6717219066342599, 0.6786684370722748, 0.6854495557548524, 0.6920568560400451, 0.698482958343098, 0.7047213959859133, 0.7107665374506331, 0.7166135388160325, 0.7222583196470291, 0.7276975556074646, 0.7329286814736441, 0.7379498989318531, 0.7427601844399706 ], [ 0.5740336423588056, 0.5658885142619596, 0.5582480413188617, 0.551191236338994, 0.5447929008623159, 0.5391216140927643, 0.534237769618004, 0.5301917716151987, 0.5270225047720547, 0.5247561826106723, 0.5234056567274477, 0.5229702363810936, 0.5234360278482711, 0.5247767615636445, 0.5269550381895317, 0.5299238973851622, 0.5336285981204323, 0.538008497387358, 0.5429989233419691, 0.5485329559994814, 0.5545430498062979, 0.5609624542486173, 0.567726408539815, 0.5747731028580265, 0.5820444110792521, 0.589486408697361, 0.5970496952786946, 0.6046895441337629, 0.6123659036043915, 0.6200432749959317, 0.6276904920727451, 0.6352804263584685, 0.6427896413070661, 0.6501980167508569, 0.6574883628986459, 0.6646460405909707, 0.6716586016037799, 0.6785154596513897, 0.6852075995283551, 0.6917273287119224, 0.6980680728770388, 0.7042242142834396, 0.7101909699708212, 0.715964305192363, 0.7215408765354829, 0.7269179986910866, 0.7320936287793075, 0.7370663624423793, 0.7418354364861703, 0.7464007336028305 ], [ 0.575015786196742, 0.5670421278027286, 0.5596006435548494, 0.5527716696474736, 0.5466306393406081, 0.5412459275609156, 0.536676773950957, 0.532971411481896, 0.5301655275506787, 0.5282811698045667, 0.5273261797727365, 0.5272941965492595, 0.5281652256255773, 0.5299067213848679, 0.5324750925772873, 0.5358175135189481, 0.5398739123394855, 0.5445790109235197, 0.5498643063893955, 0.5556599067579361, 0.5618961593664773, 0.5685050357380708, 0.5754212583802216, 0.5825831720246601, 0.5899333738993527, 0.5974191252723101, 0.6049925706362084, 0.6126107925097506, 0.6202357297973519, 0.6278339866411704, 0.6353765571565501, 0.6428384896036564, 0.6501985115145194, 0.6574386350866486, 0.6645437597657048, 0.6715012863732562, 0.6783007544233116, 0.6849335114783024, 0.6913924206141844, 0.6976716094026837, 0.7037662613835642, 0.7096724488845759, 0.7153870043204328, 0.7209074258038487, 0.7262318120387781, 0.7313588210173265, 0.7362876469624641, 0.7410180101876173, 0.7455501550111807, 0.7498848514968235 ], [ 0.5756240012347971, 0.5677947584682713, 0.560525391447056, 0.5538978445016935, 0.547988461110993, 0.5428656743384408, 0.5385878082210891, 0.5352011336475221, 0.5327383188777144, 0.5312173943920704, 0.5306413149245616, 0.5309981524253757, 0.532261899218873, 0.5343938090395606, 0.5373441626291235, 0.5410543194896865, 0.545458910143136, 0.5504880323517511, 0.5560693361599015, 0.562129911046818, 0.5685979187694826, 0.5754039435209707, 0.5824820542425931, 0.5897705912143689, 0.5972127004965966, 0.6047566462442847, 0.6123559335414481, 0.6199692744007849, 0.6275604279706518, 0.6350979435520872, 0.6425548322558396, 0.6499081903017329, 0.6571387941980887, 0.6642306853576199, 0.6711707590853769, 0.6779483702865676, 0.6845549656783458, 0.6909837497684074, 0.697229389428498, 0.7032877596043541, 0.709155730633106, 0.7148309958476329, 0.7203119366836661, 0.725597521398227, 0.7306872327634516, 0.7355810197023148, 0.7402792677480745, 0.7447827833894998, 0.7490927877530652, 0.7532109156123388 ], [ 0.5758823915978324, 0.5681715856602231, 0.5610485112339171, 0.5545970105897127, 0.5488946219974354, 0.5440101047562881, 0.5400011093426442, 0.5369121538530423, 0.5347730608985861, 0.5335979821792165, 0.5333850927233984, 0.5341169787919374, 0.5357616813425123, 0.5382743004756281, 0.5415990239282343, 0.5456714197279573, 0.5504208306952278, 0.555772723851633, 0.5616508756269203, 0.5679793077690425, 0.5746839232978251, 0.5816938224342592, 0.5889423027383615, 0.5963675649187243, 0.6039131563852473, 0.6115281897669068, 0.6191673747389556, 0.6267908999751362, 0.634364199001195, 0.6418576300131833, 0.6492460958791987, 0.6565086268644074, 0.6636279452286411, 0.6705900277570698, 0.6773836794571148, 0.6840001290354982, 0.6904326543160191, 0.6966762434522471, 0.7027272956353093, 0.7085833630201053, 0.714242933829278, 0.7197052550805207, 0.7249701921501991, 0.7300381214535536, 0.7349098518922558, 0.7395865703812978, 0.7440698066924218, 0.7483614130027146, 0.752463553869758, 0.7563787028208253 ], [ 0.5758254183169552, 0.5682086763127933, 0.5612075925255859, 0.5549081884663395, 0.5493894750763596, 0.5447208003950982, 0.540959377998291, 0.5381481764068594, 0.5363143385698959, 0.5354682664326047, 0.5356034511485716, 0.5366970619596143, 0.5387112366892329, 0.5415949554850599, 0.5452863361602235, 0.5497151692997704, 0.5548055143394681, 0.5604781999523775, 0.5666531065865559, 0.5732511485846152, 0.580195911701423, 0.5874149346727752, 0.5948406485590022, 0.6024110044906125, 0.6100698300220241, 0.6177669580543512, 0.6254581718966099, 0.6331050070346189, 0.6406744458031799, 0.6481385362946213, 0.6554739620464246, 0.6626615846336471, 0.6696859773641731, 0.6765349648367354, 0.683199180114576, 0.6896716486145085, 0.6959474054424029, 0.7020231507724526, 0.7078969459434433, 0.7135679512257125, 0.7190362047071365, 0.7243024404711718, 0.7293679432103367, 0.7342344356438738, 0.7389039945885204, 0.7433789912552143, 0.7476620512905947, 0.7517560302201446, 0.7556640002436578, 0.7593892447443867 ], [ 0.5754975142127161, 0.5679525911575212, 0.5610511841071504, 0.5548817523237183, 0.5495250373463498, 0.5450512214412568, 0.5415173037664555, 0.5389648949424849, 0.5374186151195656, 0.5368852386536437, 0.5373536640090125, 0.5387957097083353, 0.5411676587181683, 0.5444124075591754, 0.5484620326387593, 0.5532405695290036, 0.5586668100701073, 0.5646569515534725, 0.5711269736631962, 0.5779946640145021, 0.5851812552776324, 0.5926126716773256, 0.6002204082060608, 0.6079420822162694, 0.615721705432412, 0.6235097266921911, 0.6312628938042637, 0.6389439784808538, 0.646521402677142, 0.6539687987585497, 0.6612645302861074, 0.6683911951500683, 0.6753351283933907, 0.6820859183317826, 0.6886359464170465, 0.6949799586067101, 0.7011146737021963, 0.7070384321258774, 0.7127508868738172, 0.7182527368770087, 0.7235455017176323, 0.7286313355766797, 0.7335128774374939, 0.7381931339374638, 0.7426753908432427, 0.7469631489126048, 0.7510600798802417, 0.7549699984408969, 0.7586968463720246, 0.7622446853078586 ], [ 0.5749524637851349, 0.5674597485620928, 0.5606381418698837, 0.5545787615547481, 0.5493643040113342, 0.5450660026004982, 0.5417408417713121, 0.5394292495236329, 0.5381534703310505, 0.5379167700643661, 0.5387035490830713, 0.5404803508988273, 0.5431976666627176, 0.5467923649111364, 0.5511905321528201, 0.5563104971588981, 0.5620658277265346, 0.5683681257675154, 0.5751294951240604, 0.5822646072178316, 0.5896923353550937, 0.5973369650003976, 0.605129013076301, 0.6130057048668655, 0.6209111641184498, 0.6287963726335402, 0.6366189521888013, 0.6443428157893192, 0.6519377284632523, 0.6593788109303216, 0.6666460130967661, 0.6737235787090067, 0.6805995177159861, 0.6872650989058146, 0.6937143720960621, 0.6999437264494273, 0.7059514892437047, 0.7117375675523399, 0.7173031337185077, 0.7226503541836635, 0.7277821601317741, 0.7327020575168807, 0.7374139733455777, 0.7419221345810382, 0.7462309757137575, 0.7503450708948196, 0.7542690865343012, 0.7580077504100364, 0.761565833586443, 0.7649481417835436 ], [ 0.574252523006476, 0.5667955171485051, 0.5600366965842947, 0.5540700056828697, 0.5489802723083331, 0.5448399574854664, 0.5417061994884478, 0.5396183982466637, 0.5385965601479412, 0.5386405634638538, 0.5397304175910592, 0.5418274889328473, 0.5448765700784924, 0.5488085935307089, 0.553543747791952, 0.5589947455894829, 0.5650700172696232, 0.571676647573393, 0.5787229298241875, 0.5861204677224774, 0.5937858039980223, 0.6016415930625206, 0.6096173604787071, 0.6176499065655934, 0.6256834169813176, 0.6336693422007106, 0.6415661027972935, 0.6493386702730891, 0.6569580652603649, 0.6644008071702736, 0.6716483423146625, 0.6786864714205324, 0.6855047923406815, 0.6920961695735679, 0.698456238818298, 0.7045829520678748, 0.7104761665534476, 0.7161372790823642, 0.7215689058759704, 0.726774606846029, 0.7317586523083796, 0.7365258293911838, 0.7410812848350627, 0.7454304004908662, 0.7495786975866892, 0.7535317657467697, 0.7572952127865467, 0.7608746314630144, 0.7642755796078152, 0.7675035703908994 ], [ 0.57346725798911, 0.5660330121206291, 0.5593232125824497, 0.5534347302391301, 0.5484546395424996, 0.5444567539608942, 0.5414984948819135, 0.5396183641589789, 0.5388342590303503, 0.5391427984263267, 0.540519730338149, 0.542921377447654, 0.5462869728698895, 0.5505416580779224, 0.5555998725510473, 0.5613688619413864, 0.5677520626455111, 0.574652174230765, 0.5819737942854251, 0.5896255517234232, 0.5975217266957867, 0.6055833842616613, 0.6137390743184798, 0.6219251635961167, 0.6300858694450915, 0.6381730625648477, 0.6461458992878018, 0.6539703355761406, 0.6616185659312062, 0.6690684218678431, 0.6763027569665918, 0.6833088389911055, 0.6900777641630783, 0.6966039043295369, 0.7028843942931802, 0.7089186638479452, 0.714708016921029, 0.7202552585429127, 0.725564369047647, 0.7306402238712624, 0.7354883565125614, 0.7401147616106066, 0.7445257346515658, 0.7487277445263525, 0.7527273350053566, 0.75653105116436, 0.7601453868725939, 0.7635767496246402, 0.7668314392458483, 0.7699156373084911 ], [ 0.5726720901711971, 0.5652515790194186, 0.5585806172605019, 0.5527590200302278, 0.5478761488684517, 0.5440072318411867, 0.541210056034123, 0.5395223274164179, 0.5389599557499957, 0.5395164422245152, 0.5411634354046775, 0.5438523962273674, 0.547517198285301, 0.5520774058011217, 0.5574419305865912, 0.5635127723282429, 0.5701885858241378, 0.5773678808541439, 0.5849517306740063, 0.592845931617887, 0.6009626111592696, 0.6092213215885567, 0.6175496812559488, 0.6258836372920719, 0.6341674259862793, 0.6423533027618914, 0.65040110568103, 0.6582777067322346, 0.6659563952409464, 0.6734162284787434, 0.6806413763914274, 0.6876204804849106, 0.6943460412832159, 0.7008138442838077, 0.7070224308157608, 0.712972617480859, 0.7186670657645875, 0.7241099018044865, 0.7293063850860285, 0.7342626239156392, 0.7389853348340149, 0.7434816426357739, 0.7477589173224846, 0.7518246441128421, 0.755686322549301, 0.7593513907605298, 0.7628271710501595, 0.766120833170826, 0.7692393718941556, 0.7721895957873824 ], [ 0.5719465495363145, 0.5645349632444607, 0.5578964965696888, 0.5521338320221727, 0.5473385725502197, 0.5435873508335991, 0.5409383491273402, 0.5394285493881824, 0.539071990062564, 0.5398592154415548, 0.541757978513392, 0.5447151210719337, 0.548659431464564, 0.5535051929335921, 0.5591560963015961, 0.5655091999557431, 0.5724586676989015, 0.5798990854807567, 0.5877282352260789, 0.5958492751251436, 0.6041723329898542, 0.6126155595993642, 0.6211057129997923, 0.6295783552536587, 0.6379777437346084, 0.6462564932123276, 0.6543750755684674, 0.6623012131763834, 0.6700092112009989, 0.6774792641791972, 0.6846967636420709, 0.6916516263628409, 0.6983376570048992, 0.7047519543549045, 0.7108943667690499, 0.7167669997458554, 0.7223737764917392, 0.7277200508176793, 0.732812270576267, 0.7376576890254524, 0.7422641209186842, 0.7466397397204924, 0.7507929120957483, 0.7547320656939668, 0.7584655862278512, 0.7620017399125313, 0.7653486174752602, 0.7685140961521251, 0.7715058163461678, 0.7743311699176532 ], [ 0.5713722565250283, 0.5639691843255115, 0.5573608736566096, 0.5516526932043566, 0.5469383464816561, 0.543295781309349, 0.5407835466704654, 0.5394379404878625, 0.5392712424819643, 0.5402712254192693, 0.5424020004830643, 0.5456061034640394, 0.5498075968075532, 0.5549158721127717, 0.560829800809933, 0.5674418962641462, 0.5746422063589216, 0.5823217340709121, 0.590375267149666, 0.5987035733181285, 0.6072149766104948, 0.6158263710183808, 0.6244637507663704, 0.633062345607929, 0.6415664485155977, 0.6499290157744035, 0.6581111088000794, 0.6660812351817484, 0.6738146349131555, 0.6812925473379042, 0.6885014853638581, 0.695432536083417, 0.7020807009825921, 0.7084442842585528, 0.7145243341865324, 0.7203241397781427, 0.7258487829696442, 0.7311047451138026, 0.7360995654958236, 0.7408415488535245, 0.7453395183796699, 0.749602610365245, 0.7536401064664966, 0.7574612995171321, 0.7610753888389166, 0.7644914011128827, 0.7677181330460042, 0.7707641122927061, 0.7736375733558137, 0.7763464454867726 ], [ 0.5710306769496307, 0.5636401598769988, 0.5570637158707494, 0.5514091086805852, 0.5467719010831706, 0.5432311828230093, 0.5408457807020269, 0.5396513163094355, 0.5396584216052897, 0.5408523118265626, 0.5431937657680406, 0.5466214035400488, 0.5510550128904518, 0.556399582434483, 0.5625496659299973, 0.5693937234727329, 0.5768181490180574, 0.5847107794305961, 0.5929637695482262, 0.6014757965867557, 0.6101536179359166, 0.6189130469411458, 0.627679433448197, 0.6363877435407825, 0.6449823303835357, 0.6534164793508198, 0.6616517988019378, 0.6696575151644791, 0.6774097188088236, 0.6848905963081726, 0.6920876754078639, 0.6989931014200105, 0.7056029576968129, 0.7119166381210509, 0.7179362759628554, 0.7236662307717142, 0.7291126330087925, 0.7342829847140213, 0.7391858135130226, 0.7438303765974149, 0.7482264108797868, 0.7523839252731099, 0.7563130309308808, 0.7600238052777685, 0.7635261857382998, 0.7668298892160229, 0.7699443535741346, 0.7728786976093482, 0.7756416962836923, 0.778241768274524 ], [ 0.571000720580326, 0.5636311535022646, 0.5570922474669516, 0.551493759773096, 0.5469327701719937, 0.5434892531125401, 0.5412221641413257, 0.540166424969294, 0.5403311308977696, 0.5416991845432434, 0.544228399859301, 0.5478539510569662, 0.5524918959465402, 0.5580434089933122, 0.564399328025381, 0.5714446460763634, 0.5790626502816811, 0.5871385018877397, 0.5955621454699734, 0.6042305171125016, 0.6130490830976522, 0.6219327809878114, 0.6308064561933807, 0.6396048934779984, 0.6482725390165756, 0.6567629987218091, 0.665038385787751, 0.6730685769814398, 0.6808304245179487, 0.6883069591113439, 0.6954866102924651, 0.7023624623353033, 0.7089315579928814, 0.7151942574947537, 0.7211536566657483, 0.7268150653640632, 0.7321855455070071, 0.7372735065867578, 0.7420883556408258, 0.7466401980258388, 0.7509395849673458, 0.754997303661438, 0.7588242056412167, 0.7624310691595375, 0.7658284914551183, 0.7690268069440429, 0.7720360275992534, 0.7748658020356425, 0.7775253900983952, 0.7800236500488829 ], [ 0.5713562802040888, 0.5640201503952406, 0.5575281779727507, 0.5519916073591233, 0.5475085970751363, 0.5441596695087646, 0.5420037033492467, 0.5410748682503068, 0.5413808354732547, 0.5429024708206018, 0.54559504757543, 0.5493908403098242, 0.554202810912232, 0.5599290033587819, 0.5664572352730821, 0.5736697069433827, 0.5814472246245571, 0.5896728321458563, 0.5982347425060226, 0.6070285448038196, 0.615958724266795, 0.6249395731193303, 0.6338955903417705, 0.6427614736297366, 0.6514818019552523, 0.660010496308759, 0.6683101327036047, 0.6763511675645254, 0.6841111225439107, 0.6915737643104872, 0.6987283051901145, 0.7055686426918647, 0.7120926497598532, 0.7183015228219165, 0.7241991911146003, 0.7297917881183931, 0.735087184033972, 0.7400945768986303, 0.7448241390437672, 0.7492867150206373, 0.7534935667888534, 0.7574561618075131, 0.7611859996455106, 0.7646944728013642, 0.767992757568573, 0.7710917309815671, 0.7740019101156931, 0.7767334102813904, 0.7792959189387526, 0.7816986824563255 ], [ 0.5721638300132262, 0.5648772896520903, 0.5584449845189043, 0.5529790467131959, 0.5485781904985628, 0.5453230794098337, 0.5432722603351559, 0.542459074275683, 0.5428898834247305, 0.5445438208134562, 0.5473740939036298, 0.5513106916590872, 0.5562641925919632, 0.5621302767950277, 0.5687945192114832, 0.5761370780684638, 0.5840369727786938, 0.5923757463078285, 0.6010404070008193, 0.6099256296665285, 0.6189352583119467, 0.6279831924456731, 0.636993758418681, 0.6459016716882939, 0.6546516902111079, 0.6631980477096111, 0.6715037415713007, 0.679539735827257, 0.6872841263386994, 0.6947213036637966, 0.7018411393145775, 0.7086382132105402, 0.7151110939136209, 0.7212616784489133, 0.7270945949257762, 0.7326166685393753, 0.7378364496473832, 0.742763801308026, 0.7474095427942966, 0.7517851450549093, 0.755902473790475, 0.7597735756890972, 0.7634105033711144, 0.7668251746925634, 0.7700292622250626, 0.7730341089469904, 0.7758506664326777, 0.7784894521018658, 0.7809605223820939, 0.7832734589348319 ], [ 0.5734802159109303, 0.5662624984561624, 0.5599054049213316, 0.554521280714146, 0.5502088049381881, 0.5470483198768678, 0.5450977469121919, 0.5443895030640076, 0.5449287589588284, 0.5466932417628575, 0.5496346082688892, 0.5536812292923666, 0.558742074085325, 0.5647112902702187, 0.5714730514442156, 0.578906284056026, 0.5868889680045802, 0.5953018078566046, 0.6040311725104941, 0.6129712861709065, 0.6220257158410665, 0.6311082395672694, 0.6401431986462965, 0.6490654408937928, 0.657819955956582, 0.6663612918643095, 0.6746528278011202, 0.6826659636150516, 0.6903792731694037, 0.6977776569269346, 0.7048515193621567, 0.7115959888753158, 0.718010191650126, 0.7240965861133499, 0.729860361065112, 0.7353088979186025, 0.7404512956104259, 0.745297955445596, 0.7498602222841686, 0.7541500779489854, 0.7581798824502777, 0.761962158517575, 0.7655094149534877, 0.7688340044410197, 0.7719480116192349, 0.7748631674715077, 0.7775907863314648, 0.7801417220929329, 0.7825263405030689, 0.7847545047154875 ], [ 0.5753507719170328, 0.5682234758741311, 0.5619593018526634, 0.5566700827131784, 0.5524538255660963, 0.5493900520100152, 0.5475357388535883, 0.5469222718898781, 0.5475537496829415, 0.5494068354821368, 0.5524321766009332, 0.5565572273829194, 0.5616901612161681, 0.5677244660337267, 0.574543796364304, 0.582026695797586, 0.5900508871527659, 0.5984969299958653, 0.6072511455631832, 0.616207793496077, 0.6252705464724011, 0.6343533473223925, 0.6433807518399876, 0.6522878641919331, 0.6610199656347487, 0.6695319254613334, 0.6777874689241536, 0.6857583624733105, 0.6934235632872244, 0.7007683684033038, 0.7077835889908343, 0.714464767405024, 0.7208114484383186, 0.7268265114030599, 0.7325155660885334, 0.7378864130021443, 0.7429485664246062, 0.7477128375112252, 0.7521909738162499, 0.7563953510941797, 0.7603387129547983, 0.7640339538515282, 0.7674939409156831, 0.7707313702750536, 0.7737586536863574, 0.7765878315469539, 0.7792305086166512, 0.7816978090640752, 0.7840003477451516, 0.7861482149171001 ], [ 0.5778078839297757, 0.570794160138279, 0.5646420437235, 0.5594621048941961, 0.5553510214491755, 0.5523869792401461, 0.550625681319472, 0.5500973705422428, 0.5508051937359583, 0.5527250975428475, 0.5558072699297404, 0.5599789619770121, 0.5651483778359752, 0.5712092327447871, 0.5780455591052274, 0.5855363813040342, 0.5935599620564105, 0.6019974234738531, 0.6107356445112609, 0.6196694192001976, 0.6287029206897855, 0.6377505540749714, 0.6467372994827335, 0.6555986507161121, 0.6642802488428805, 0.6727372986514002, 0.6809338420289615, 0.6888419481687977, 0.69644086735199, 0.7037161835232902, 0.7106589912087873, 0.7172651144752413, 0.7235343794349481, 0.7294699470255872, 0.7350777091992835, 0.7403657490114719, 0.745343863207797, 0.750023144597473, 0.7544156206364325, 0.758533944113243, 0.762391131549112, 0.766000344824005, 0.7693747115735484, 0.772527180027981, 0.7754704041566299, 0.7782166552181266, 0.7807777560821404, 0.7831650349711213, 0.7853892955615085, 0.787460800676327 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.49872928857803345, 0.13194097392261028, 0.8315052930265665, 0.21781443897634745, 0.16873736307024956, 0.17625166848301888, 0.4144163417431746, 0.38097046748268004, 0.3379871796888515, 0.4098237031259022, 0.4335890115379974, 0.45015470465485763, 0.4645848639096352, 0.4728848127789459, 0.4825069897430853, 0.4732592414541781, 0.5731254707267917, 0.43966368135103484, 0.3750622273843812, 0.36480936275141973, 0.31317725025025467, 0.2397501380328812, 0.24074675141585142, 0.2534931500682824 ], "xaxis": "x", "y": [ 0.15240246057510376, 0.9810726530849934, 0.09178435429930687, 0.5230371272191405, 0.1923519130796194, 0.4650226552039385, 0.14348375860028056, 0.1296407806269, 0.1928284956116473, 0.08417571977898308, 0.02240009329121775, 4.515059793899048e-16, 0.006333033566768968, 0.025698324991664533, 0.044943069697356834, 0.053728659895273506, 0.063017484030048, 0.04183939206189174, 0.050494236159714656, 0.0058982881747641665, 0.1234118625132671, 0.11173662330548965, 0.11950141776975445, 0.1536945586652028 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.49872928857803345, 0.13194097392261028, 0.8315052930265665, 0.21781443897634745, 0.16873736307024956, 0.17625166848301888, 0.4144163417431746, 0.38097046748268004, 0.3379871796888515, 0.4098237031259022, 0.4335890115379974, 0.45015470465485763, 0.4645848639096352, 0.4728848127789459, 0.4825069897430853, 0.4732592414541781, 0.5731254707267917, 0.43966368135103484, 0.3750622273843812, 0.36480936275141973, 0.31317725025025467, 0.2397501380328812, 0.24074675141585142, 0.2534931500682824 ], "xaxis": "x2", "y": [ 0.15240246057510376, 0.9810726530849934, 0.09178435429930687, 0.5230371272191405, 0.1923519130796194, 0.4650226552039385, 0.14348375860028056, 0.1296407806269, 0.1928284956116473, 0.08417571977898308, 0.02240009329121775, 4.515059793899048e-16, 0.006333033566768968, 0.025698324991664533, 0.044943069697356834, 0.053728659895273506, 0.063017484030048, 0.04183939206189174, 0.050494236159714656, 0.0058982881747641665, 0.1234118625132671, 0.11173662330548965, 0.11950141776975445, 0.1536945586652028 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:43] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.044779220461837, 1.0391730440406939, 1.0339281563355431, 1.029072355728949, 1.024633567755245, 1.020639686495342, 1.0171183982204886, 1.0140969864615637, 1.011602117708308, 1.0096596070068466, 1.0082941628613493, 1.007529111117537, 1.0073860979950884, 1.007884773250462, 1.0090424557086062, 1.0108737852089236, 1.0133903674255391, 1.0166004210043327, 1.0205084398177844, 1.0251148864891362, 1.0304159360954661, 1.0364032903883602, 1.043064082200069, 1.0503808863136626, 1.058331846725599, 1.0668909212649997, 1.0760282340050624, 1.0857105154921918, 1.0959016025432107, 1.1065629650531004, 1.1176542279779527, 1.1291336622745844, 1.1409586276929722, 1.1530859606758037, 1.1654723098239959, 1.178074427647899, 1.1908494299172687, 1.203755033217368, 1.216749778422774, 1.2297932440570865, 1.2428462500455228, 1.255871049872229, 1.2688315078387062, 1.2816932578544558, 1.294423840672207, 1.3069928173753025, 1.3193718579590665, 1.331534804835302, 1.3434577119274527, 1.3551188606742062 ], [ 1.0421488398816456, 1.0364995142324105, 1.0312148694099457, 1.0263231186831747, 1.0218526216971902, 1.0178317254618114, 1.0142885875686256, 1.0112509807941101, 1.0087460782199633, 1.0068002179799507, 1.0054386467586276, 1.0046852412826253, 1.0045622073558458, 1.0050897566300006, 1.0062857624357078, 1.0081653977991338, 1.0107407613681807, 1.0140205003995824, 1.0180094440573684, 1.0227082646319643, 1.0281131882034273, 1.0342157787913593, 1.0410028200949177, 1.0484563156022155, 1.056553620656686, 1.065267709285897, 1.0745675654604618, 1.0844186751150988, 1.0947835844408726, 1.1056224842143831, 1.1168937808438215, 1.1285546223015306, 1.1405613592952901, 1.1528699357663053, 1.1654362147491315, 1.1782162533463532, 1.1911665431866316, 1.2042442309381705, 1.2174073289259173, 1.230614920560155, 1.2438273606332275, 1.2570064673935235, 1.270115701813066, 1.2831203293375046, 1.2959875601749191, 1.3086866653836773, 1.3211890673150073, 1.333468404141725, 1.3455005691616222, 1.357263726278774 ], [ 1.0399833078332643, 1.0343029693834844, 1.0289905985329861, 1.0240747776071735, 1.0195842503369699, 1.0155477623481226, 1.0119938839939453, 1.0089508147329327, 1.0064461681818009, 1.0045067368696985, 1.0031582356033024, 1.002425022281656, 1.0023297950750294, 1.0028932652632754, 1.0041338059317106, 1.006067078399185, 1.008705640942416, 1.0120585482191782, 1.0161309547008586, 1.0209237409864387, 1.0264331872600172, 1.0326507221576053, 1.0395627764873396, 1.0471507682493062, 1.0553912373963144, 1.0642561358982976, 1.0737132623416052, 1.08372681323833, 1.0942580090420773, 1.1052657451236851, 1.1167072189709373, 1.1285384946993278, 1.1407149820991966, 1.1531918255705502, 1.165924213770817, 1.1788676302988272, 1.1919780682174457, 1.2052122278516695, 1.2185277105870274, 1.2318832140073683, 1.2452387276226802, 1.2585557245785144, 1.2717973431299152, 1.2849285517822095, 1.2979162931579127, 1.310729603236298, 1.323339704211192, 1.335720070595637, 1.3478464692829712, 1.3596969750514716 ], [ 1.0382971184468373, 1.0325985553385844, 1.027271159165282, 1.0223438341894733, 1.0178456563802643, 1.0138057131616314, 1.0102529257317174, 1.007215853270058, 1.004722478252377, 1.0027999719174925, 1.0014744386836043, 1.0007706380320014, 1.0007116821629, 1.0013187077560133, 1.002610520705684, 1.0046032140954915, 1.0073097623071543, 1.0107395983210934, 1.0148981870166445, 1.0197866142473393, 1.0254012187085548, 1.031733299601834, 1.0387689359015464, 1.0464889507260975, 1.0548690455843028, 1.0638801140075804, 1.0734887238915585, 1.0836577361592827, 1.0943470088383591, 1.1055141251691418, 1.117115085280191, 1.1291049136168314, 1.1414381554540594, 1.1540692595767272, 1.1669528641787688, 1.1800440147047535, 1.1932983444887972, 1.206672243515041, 1.220123031049109, 1.2336091379435437, 1.247090296631212, 1.2605277322082522, 1.273884346370951, 1.287124886464794, 1.300216093562392, 1.3131268255323074, 1.3258281530046991, 1.3382934277468417, 1.3504983241711546, 1.362420855539046 ], [ 1.0371029031176757, 1.0313994718674449, 1.0260703358234222, 1.0211446732529421, 1.016651839277335, 1.0126212044863017, 1.0090819764284311, 1.006063003486331, 1.0035925605478648, 1.0016981156653144, 1.000406076530942, 0.9997415151036008, 0.9997278681742738, 1.0003866112364734, 1.0017369030420915, 1.0037951991294167, 1.006574834960789, 1.010085583628727, 1.01433319966051, 1.019318969020563, 1.025039294944173, 1.0314853578287255, 1.0386428924892204, 1.0464921249659924, 1.055007901759966, 1.06416002642855, 1.0739137936923262, 1.0842306837803257, 1.0950691557429473, 1.106385464363273, 1.1181344258211294, 1.1302700732263262, 1.1427461704662982, 1.1555165836379064, 1.1685355349577746, 1.1817577783652784, 1.195138737566349, 1.2086346388648912, 1.2222026579142669, 1.2358010864431415, 1.2493895152504422, 1.2629290243723144, 1.2763823697642593, 1.28971415684657, 1.3028909935336788, 1.3158816179442914, 1.3286569983156862, 1.3411904044949685, 1.3534574517247493, 1.3654361183482802 ], [ 1.0364112630132243, 1.030716790845563, 1.0253996846441444, 1.020489348344839, 1.0160153624401445, 1.0120073209258116, 1.0084946514602267, 1.0055064185105438, 1.0030711091989022, 1.001216401336754, 0.9999689126906016, 0.9993539298298137, 0.9993951140027624, 1.000114180527315, 1.001530547501487, 1.0036609498003, 1.00651901609033, 1.0101148108028106, 1.0144543502839918, 1.0195391126810156, 1.0253655734553624, 1.0319248103940812, 1.0392022301939619, 1.0471774693929778, 1.0558245127151895, 1.065112050914471, 1.0750040699879648, 1.0854606293531077, 1.0964387558912803, 1.1078933620541245, 1.1197780959421193, 1.132046050953608, 1.1446502973293602, 1.1575442374104374, 1.1706818190379527, 1.1840176590638056, 1.1975071296137263, 1.2111064476962652, 1.2247727910507524, 1.2384644463167278, 1.252140983606137, 1.2657634453722628, 1.2792945360952281, 1.2926988009519804, 1.3059427846294023, 1.3189951646131408, 1.3318268560315583, 1.3444110872460242, 1.356723446870847, 1.3687419038889006 ], [ 1.0362306202639797, 1.030559294267696, 1.0252683568929568, 1.0203873893057713, 1.015946143348557, 1.0119743761690962, 1.0085016683760795, 1.005557225825721, 1.0031696651619038, 1.00136678305426, 1.0001753086088756, 0.9996206375797602, 0.9997265457556472, 1.0005148773342263, 1.0020052025491144, 1.0042144379285507, 1.0071564233417551, 1.0108414536739456, 1.015275770703975, 1.0204610329691897, 1.0263937971099724, 1.0330650605303355, 1.0404599276397701, 1.0485574652639607, 1.057330802895029, 1.0667475089329443, 1.0767702374314991, 1.0873575975399494, 1.0984651592976555, 1.110046485198549, 1.1220540753805917, 1.1344401379814388, 1.1471571394256306, 1.1601581391680313, 1.1733969544464373, 1.1868282220274287, 1.2004074235206932, 1.2140909243654034, 1.227836053557176, 1.241601230046792, 1.2553461272358328, 1.269031859988971, 1.2826211774828644, 1.2960786476107995, 1.3093708224579386, 1.3224663781920012, 1.3353362259199866, 1.3479535924613026, 1.3602940716465675, 1.3723356478237259 ], [ 1.036567092189176, 1.0309333370836848, 1.0256829491356152, 1.0208456383608397, 1.0164512740113711, 1.0125297161605717, 1.0091106310493818, 1.0062232906760822, 1.0038963572546564, 1.002157653099768, 1.0010339160794814, 1.000550539855831, 1.0007312965834432, 1.0015980375538585, 1.0031703647125552, 1.005465263719104, 1.008496688505685, 1.0122750898633952, 1.0168068883189183, 1.022093905617798, 1.028132788834934, 1.0349144830806218, 1.0424238268734962, 1.0506393512348473, 1.0595333535660545, 1.069072288518368, 1.079217473722075, 1.089926056657913, 1.1011521416945866, 1.1128479459482619, 1.1249648494254014, 1.1374542326639363, 1.1502680475683729, 1.1633591285161973, 1.176681301636788, 1.1901893762373448, 1.2038391007627118, 1.2175871441227302, 1.2313911341010437, 1.245209758564411, 1.2590029179325275, 1.2727319094944105, 1.2863596233737042, 1.2998507331586089, 1.3131718688711982, 1.3262917644844965, 1.3391813758997366, 1.3518139680165588, 1.3641651713813414, 1.3762130100812962 ], [ 1.037424392537875, 1.031842739476527, 1.0266473854400238, 1.0218681209676828, 1.017534879012606, 1.0136775627343322, 1.0103258571559945, 1.007509025569292, 1.005255691882785, 1.0035936102215568, 1.0025494228177763, 1.0021484063498893, 1.0024142051493623, 1.003368546940335, 1.0050309331163465, 1.0074182916196153, 1.0105445776976216, 1.0144203084881132, 1.0190520243843657, 1.0244416857725678, 1.0305860380530645, 1.0374760069547684, 1.0450962118713365, 1.0534246969709855, 1.0624329697942183, 1.0720864025613677, 1.0823449975713306, 1.0931644559582385, 1.104497432723591, 1.1162948245928404, 1.128506932449226, 1.1410843717847592, 1.1539786664956584, 1.1671425351077613, 1.1805299402081053, 1.1940960033428882, 1.207796884999453, 1.2215897022804594, 1.235432521165344, 1.24928442900861, 1.2631056726908982, 1.2768578389968994, 1.2905040532909893, 1.3040091765868247, 1.3173399866463018, 1.3304653340122574, 1.3433562681185132, 1.3559861316998258, 1.3683306238026902, 1.3803678330159521 ], [ 1.0388037631131941, 1.0332887125415728, 1.028162836275581, 1.0234559569330708, 1.0191980176533992, 1.0154189053893763, 1.012148257997705, 1.0094152564064467, 1.0072484036566203, 1.0056752929737014, 1.0047223670078318, 1.0044146696808622, 1.0047755903136881, 1.0058265965176172, 1.0075869475834043, 1.0100733742391972, 1.0132997051682138, 1.0172764184755487, 1.02201010147889, 1.0275028188042326, 1.0337514182030605, 1.0407468416239278, 1.0484735450052987, 1.0569091492209515, 1.0660244344492629, 1.07578374803893, 1.0861458299893412, 1.0970649861058503, 1.1084924738479058, 1.1203779248213197, 1.1326706222767684, 1.14532048734692, 1.1582786983387938, 1.171497953255319, 1.1849324586810568, 1.1985377657175222, 1.212270570393089, 1.226088563612489, 1.2399503733081765, 1.2538156047977753, 1.2676449619702777, 1.2814004219500121, 1.295045435528641, 1.308545130403413, 1.3218665006417691, 1.3349785717999059, 1.347852535926412, 1.3604618541565325, 1.3727823269420258, 1.384792133443951 ], [ 1.0407039382967591, 1.035269820368511, 1.0302276777121064, 1.0256073161404595, 1.0214386354385105, 1.0177514475529998, 1.0145752783286885, 1.0119391544301597, 1.0098713778373096, 1.0083992909609891, 1.0075490357582597, 1.0073453098614238, 1.0078111211527887, 1.0089675388159454, 1.010833433200675, 1.0134251889495673, 1.016756367111344, 1.0208372857763495, 1.025674490675336, 1.0312701036193483, 1.0376210713922598, 1.0447183869533425, 1.0525464043444186, 1.061082397258027, 1.0702965008303342, 1.0801521232849953, 1.0906068322373788, 1.1016136327798265, 1.1131224820721264, 1.1250818422636377, 1.1374400691655344, 1.1501464729651645, 1.1631519648469963, 1.1764092996437712, 1.1898730081962685, 1.2034991570517501, 1.2172450700500592, 1.2310691094019937, 1.2449305652665157, 1.258789660934384, 1.2726076541099924, 1.2863470034503215, 1.299971569056997, 1.3134468208955807, 1.3267400362308293, 1.3398204738748878, 1.3526595184199723, 1.3652307915258404, 1.3775102299655648, 1.3894761318082496 ], [ 1.043121143928393, 1.037781980301715, 1.0328374931113364, 1.0283174216244881, 1.0242515683444908, 1.02066961166463, 1.0176009016415406, 1.01507424082951, 1.0131176531033572, 1.0117581443881676, 1.0110214599743514, 1.0109318432110597, 1.0115117991987932, 1.0127818637874642, 1.0147603718393383, 1.0174632089023086, 1.0209035181061838, 1.025091322818688, 1.030033022445968, 1.0357307332676489, 1.0421814858244043, 1.049376352853539, 1.05729964907019, 1.065928385870704, 1.0752321534419482, 1.085173535048973, 1.0957090555628919, 1.106790562948287, 1.1183668640178095, 1.130385395583406, 1.1427937122294236, 1.1555406144063014, 1.1685768224841133, 1.1818552057788896, 1.1953306676306699, 1.2089598377207984, 1.2227007210131875, 1.2365124126958758, 1.2503549349177832, 1.2641892045806007, 1.2779771116531249, 1.2916816745208994, 1.305267237962206, 1.3186996848472188, 1.3319466403081213, 1.3449776544393641, 1.3577643555052359, 1.3702805699637834, 1.3825024085677402, 1.3944083196969355 ], [ 1.0460491307784126, 1.040818501718746, 1.035985117815251, 1.0315786007497543, 1.027628601002981, 1.0241646047545172, 1.0212157233408738, 1.018810467443678, 1.0169765093923522, 1.0157404382941686, 1.0151275139344056, 1.0151614260928457, 1.0158640653691757, 1.017255308709506, 1.0193528162354946, 1.0221718245757434, 1.0257249059013693, 1.030021644644787, 1.0350681738004277, 1.0408665229392875, 1.0474137733369826, 1.0547010929553364, 1.062712813671426, 1.0714257727162435, 1.0808091299133853, 1.0908247850847, 1.1014283903525286, 1.1125708308880258, 1.1241999684605586, 1.1362624105483965, 1.148705076748616, 1.1614763807704007, 1.1745269294296794, 1.1878097459275057, 1.2012801217353404, 1.214895256627797, 1.2286138470755499, 1.2423957423252456, 1.2562017308726547, 1.2699934699662192, 1.28373353808432, 1.2973855755146144, 1.3109144763563556, 1.3242866005971796, 1.3374699828134173, 1.350434521788528, 1.3631521417280348, 1.3755969204944263, 1.3877451835638321, 1.399575564539185 ], [ 1.0494792415553125, 1.044370162117696, 1.0396607254794545, 1.0353803830285002, 1.0315585772778557, 1.0282245430376407, 1.0254070905156294, 1.023134372677557, 1.0214336406096585, 1.0203309922710864, 1.0198511217233293, 1.0200170772678696, 1.0208500371360003, 1.0223691091810363, 1.0245911546447506, 1.0275306236154313, 1.0311993704660452, 1.0356063940199205, 1.040757428621002, 1.0466543156512853, 1.0532941297658747, 1.0606681268531186, 1.068760696874953, 1.0775485870953778, 1.0870006520583502, 1.0970782753321988, 1.1077364454544287, 1.1189253277136544, 1.1305920962152012, 1.142682773818718, 1.15514384992525, 1.1679234974174295, 1.1809722912452982, 1.1942434342959607, 1.2076925936087994, 1.2212775083980403, 1.2349575354553148, 1.2486932582774002, 1.2624462291189738, 1.2761788611567801, 1.2898544529211782, 1.3034373103459238, 1.3168929286583568, 1.3301882010187631, 1.3432916285890903, 1.356173514646521, 1.368806132072431, 1.3811638586465065, 1.3932232781674267, 1.4049632478026608 ], [ 1.0534005091209946, 1.0484253177664624, 1.0438519528311394, 1.0397096408345385, 1.0360275589366392, 1.0328346306578227, 1.0301593029138427, 1.0280293067974338, 1.0264714061123261, 1.0255111395831136, 1.0251725647920875, 1.0254780138632598, 1.0264478719459977, 1.0281003882535287, 1.0304515236426584, 1.0335148258351343, 1.0373013014098866, 1.0418192241417097, 1.0470737914467612, 1.0530665350073067, 1.0597944350578448, 1.0672487948144223, 1.0754140764247118, 1.084267009023031, 1.0937762730830582, 1.103902926806813, 1.1146015407107055, 1.1258218457102402, 1.1375106284739436, 1.1496136105099444, 1.1620770865583283, 1.1748491545605861, 1.1878804462774872, 1.2011243633507453, 1.2145369165896425, 1.2280763252261315, 1.2417025408177325, 1.2553768252966355, 1.2690614577304573, 1.2827195923571484, 1.296315253977605, 1.30981343806477, 1.3231802781424928, 1.3363832465544145, 1.349391361965973, 1.3621753847600697, 1.3747079883414857, 1.386963899716547, 1.3989200065778291, 1.4105554307456685 ], [ 1.05779978244787, 1.0529700447823953, 1.0485440579331171, 1.0445507671738017, 1.0410190255130498, 1.0379773844741733, 1.0354538656820942, 1.0334757157536294, 1.0320691486848017, 1.0312590820617213, 1.031068875903532, 1.0315200854595372, 1.0326322410815556, 1.0344226679298076, 1.0369063533459484, 1.040095856956255, 1.0440012348437473, 1.0486299145622406, 1.053986421172532, 1.0600718388223398, 1.066882931928289, 1.0744109682943046, 1.082640458810043, 1.0915481654205446, 1.1011027269937605, 1.1112650877536085, 1.1219896769607955, 1.13322610949337, 1.1449211135406152, 1.1570204155045671, 1.1694703687998858, 1.1822191754150562, 1.1952176202561624, 1.2084193234342788, 1.2217806001553357, 1.2352600745345501, 1.2488182050387608, 1.2624168498555128, 1.2760189502618449, 1.2895883601503901, 1.3030898131105666, 1.316488998153514, 1.329752708502427, 1.3428490299152653, 1.3557475412610658, 1.3684195074293795, 1.380838051409439, 1.392978297836452, 1.4048174843636019, 1.4163350400528523 ], [ 1.0626618759509587, 1.0579883054173695, 1.0537201056924828, 1.0498858830024396, 1.0465141063589127, 1.043632894118247, 1.0412697810280576, 1.039451468313166, 1.0382035611359812, 1.0375503000526805, 1.0375142958288672, 1.0381162799080643, 1.039374885241519, 1.0413064726361654, 1.0439250137083673, 1.0472420292073714, 1.0512665568714499, 1.056005084921281, 1.061461343740722, 1.067635823700459, 1.0745249214486623, 1.0821197421251991, 1.0904047785561994, 1.099356849092839, 1.1089446787877804, 1.119129323032342, 1.1298653679515782, 1.1411026494460732, 1.1527881774968538, 1.1648679946032516, 1.1772887688818048, 1.1899989894032732, 1.2029496969170281, 1.2160947565801734, 1.2293907528277404, 1.242796638370291, 1.2562732830795353, 1.2697830456465475, 1.2832894471959433, 1.296756980092788, 1.3101510494484045, 1.323438023538878, 1.3365853608735072, 1.3495617819233707, 1.3623374584526253, 1.374884199962338, 1.3871756231580181, 1.3991872957475457, 1.41089685003165, 1.4222840647442585 ], [ 1.0679697372452326, 1.063462133633151, 1.0593611735196156, 1.055695065557112, 1.052491834590765, 1.0497791048867833, 1.047583863782984, 1.0459322083831357, 1.0448490797537302, 1.0443579914616583, 1.0444807621919026, 1.0452372653727933, 1.0466452115483376, 1.0487199802392975, 1.05147451461728, 1.0549192805041914, 1.0590622664334777, 1.0639089617244892, 1.069462201922405, 1.0757217404863488, 1.082683435388557, 1.090338066246459, 1.0986700018057656, 1.1076561115184442, 1.1172653223526097, 1.1274590270709792, 1.1381922713918504, 1.1494154491076785, 1.161076184511972, 1.1731211350174326, 1.1854975282936522, 1.198154318836246, 1.2110429098740063, 1.2241174491413254, 1.237334768934119, 1.2506540862461772, 1.264036593569554, 1.2774450543675548, 1.2908434809444338, 1.3041969318468198, 1.3174714324832053, 1.3306340011595914, 1.3436527527436377, 1.3564970506217224, 1.369137680997036, 1.3815470290769856, 1.3936992424965378, 1.4055703724659585, 1.4171384872545005, 1.4283837557029386 ], [ 1.0737046281585099, 1.0693718338281448, 1.0654465698117614, 1.0619565889130929, 1.0589294123492348, 1.0563921106701433, 1.0543710653305145, 1.0528917136352303, 1.0519782816423324, 1.051653512024633, 1.051938396848319, 1.052851928505347, 1.054410884991095, 1.0566296669389261, 1.0595202007129811, 1.0630919104194476, 1.0673517372507038, 1.0723041448501902, 1.0779510012325122, 1.0842911958288022, 1.0913198775072004, 1.0990273232932621, 1.1073976490322044, 1.116407746326643, 1.1260268397229243, 1.1362168681607878, 1.146933621040057, 1.1581283640274027, 1.1697496414469803, 1.1817449974692635, 1.1940624425739264, 1.2066515637902973, 1.2194642348911142, 1.2324549365032693, 1.2455807472927518, 1.2588011057237176, 1.2720774564116237, 1.285372883895144, 1.298651807761956, 1.3118797785610377, 1.3250233837615173, 1.338050252172003, 1.3509291342342256, 1.3636300323971882, 1.3761243575461939, 1.3883850917157856, 1.4003869423071122, 1.4121064777387877, 1.4235222384154862, 1.4346148199740598 ], [ 1.079846313971654, 1.0756961868190207, 1.0719540583100626, 1.06864716852985, 1.065802477545878, 1.0634464451324641, 1.0616047916880733, 1.060302243199138, 1.0595622649670846, 1.0594067912159528, 1.0598559606131228, 1.0609278709373464, 1.0626383689695431, 1.065000892772542, 1.0680263803450516, 1.0717232473631373, 1.0760974130175618, 1.0811523149699807, 1.0868888091788764, 1.093304821349242, 1.1003946439090022, 1.1081478887704947, 1.1165482922434071, 1.125572726864246, 1.1351907842666877, 1.145365121347986, 1.156052511662332, 1.1672053609011657, 1.1787733951649895, 1.1907052791012165, 1.2029500009298426, 1.2154579320696863, 1.2281815241875988, 1.2410756537385816, 1.2540976664472279, 1.26720720592183, 1.2803659239892196, 1.2935371633159678, 1.3066856806859881, 1.3197774509628692, 1.3327795654760353, 1.3456602191089682, 1.3583887689425616, 1.3709358427693563, 1.3832734760413892, 1.3953752587635493, 1.4072164778955976, 1.4187742449540401, 1.4300276021625062, 1.4409576034711016 ], [ 1.0863732563124504, 1.0824126578240503, 1.0788600822717407, 1.0757422027652037, 1.073085363923038, 1.0709153615678961, 1.0692572044523003, 1.0681348610262253, 1.0675709960938868, 1.0675867045379535, 1.0682012520683117, 1.0694318359232058, 1.071293380950128, 1.073798387157775, 1.0769568412802784, 1.0807761936812812, 1.0852613794092023, 1.0904148274712644, 1.096236362805503, 1.1027228827227658, 1.1098677179854703, 1.117659693778677, 1.1260820672247345, 1.1351116522150941, 1.1447184495629015, 1.1548659551881368, 1.1655121044865675, 1.1766106475230853, 1.188112696840533, 1.1999682253227988, 1.2121273613848773, 1.2245413949579587, 1.2371634601361337, 1.2499489028668973, 1.2628553777733453, 1.275842744418971, 1.2888728452678981, 1.3019092436027762, 1.3149169831098542, 1.3278624082283608, 1.340713062154724, 1.3534376618576538, 1.3660061381853907, 1.3783897237043314, 1.390561069858689, 1.4024943767406688, 1.414165521822612, 1.4255521774513165, 1.436633910158463, 1.4473922576151699 ], [ 1.0932628058109422, 1.089497602120232, 1.086139983646391, 1.0832160060112506, 1.0807513484855855, 1.078771094829997, 1.0772994972640302, 1.0763597267397893, 1.0759736144753724, 1.0761613919112378, 1.076941438807744, 1.0783300518122383, 1.0803412478062413, 1.0829866163843058, 1.0862752317547824, 1.0902136232715842, 1.094805783010949, 1.100053158504963, 1.105954546586688, 1.1125057893805252, 1.1196992029775112, 1.127522760451079, 1.1359591831070888, 1.1449852000127967, 1.1545712402296033, 1.1646817061605184, 1.1752758024756922, 1.1863087556511815, 1.1977332053325855, 1.2095005699853738, 1.2215622455803152, 1.2338705548559288, 1.2463794134169301, 1.259044717687745, 1.2718244905844533, 1.2846788427735845, 1.297569817961022, 1.3104611888141044, 1.3233182580994818, 1.3361077020137349, 1.3487974744205276, 1.3613567753997624, 1.3737560768660193, 1.3859671921078596, 1.397963374056264, 1.4097194276915412, 1.4212118241021043, 1.4324188064379115, 1.443320480778696, 1.453898887436103 ], [ 1.1004913914255467, 1.09692646510494, 1.0937682138405342, 1.0910420299414345, 1.0887728827771532, 1.0869851019033, 1.0857021446157633, 1.0849463512597686, 1.084738693309128, 1.0850985212639563, 1.0860433216734067, 1.087588494744535, 1.0897471653623727, 1.0925300396951871, 1.095945315027198, 1.0999986397680834, 1.1046931020631807, 1.1100292003146481, 1.116004724733398, 1.122614471623137, 1.129849741444807, 1.137697647557138, 1.1461403657075642, 1.155154533797459, 1.1647110131600849, 1.1747751339530366, 1.1853074123851366, 1.196264613444067, 1.2076009809576926, 1.219269465311345, 1.2312228210692786, 1.2434144961631615, 1.2557992780394809, 1.2683336973503465, 1.280976216967817, 1.2936872530408103, 1.3064290843208004, 1.3191657056967852, 1.3318626734039256, 1.3444869759530758, 1.3570069501483868, 1.3693922485562822, 1.3816138551014798, 1.3936441394902537, 1.4054569384505609, 1.4170276514902884, 1.4283333401186349, 1.439352821501073, 1.450066749786227, 1.4604576805132834 ], [ 1.108034704161911, 1.1046739745374188, 1.1017185339950273, 1.0991930710767464, 1.0971218066766035, 1.0955282805093793, 1.0944351234409724, 1.0938638191196097, 1.093834459912158, 1.0943655039642468, 1.0954735421114021, 1.097173085019285, 1.0994763816579103, 1.1023932789291977, 1.105931127455605, 1.1100947285875284, 1.114886301861724, 1.1203054324142838, 1.126348941099014, 1.133010618666075, 1.1402807929306744, 1.1481457586315698, 1.1565871769967337, 1.1655816088986655, 1.1751003451540696, 1.1851096318847774, 1.1955712876986324, 1.206443619369875, 1.2176824956082495, 1.2292424376081421, 1.2410776139271165, 1.2531426665934566, 1.2653933330035718, 1.2777868595237674, 1.2902822268700218, 1.3028402240201216, 1.3154234161630651, 1.3279960530751962, 1.3405239585803626, 1.3529744317412145, 1.3653161788655965, 1.3775192846252773, 1.3895552220454062, 1.4013968953882487, 1.4130187068817193, 1.4243966372979784, 1.4355083309108019, 1.4463331767431793, 1.4568523797800914, 1.4670490176364208 ], [ 1.115867873640344, 1.1127143236452173, 1.109964203824562, 1.1076414642648167, 1.1057695450914313, 1.1043711672183276, 1.103468110451357, 1.1030809824424386, 1.1032289834033548, 1.103929673052272, 1.1051987478008283, 1.1070498373375526, 1.1094943299114397, 1.1125412338525242, 1.1161970780457628, 1.1204658452054306, 1.1253489188732153, 1.1308450103949306, 1.1369500215885922, 1.1436568015062936, 1.15095478019379, 1.1588295094218453, 1.1672621964549594, 1.1762293562051873, 1.1857027054443114, 1.195649375088042, 1.206032442447098, 1.2168117161590062, 1.227944665884449, 1.2393873822030894, 1.251095470416068, 1.2630248117626957, 1.2751321566604303, 1.2873755417418145, 1.2997145437835458, 1.312110398489926, 1.3245260202890394, 1.336925961083213, 1.3492763422816854, 1.3615447871577038, 1.3737003716394243, 1.3857136028845418, 1.39755642766445, 1.4092022673045173, 1.4206260727480284, 1.4318043919331023, 1.442715441635018, 1.4533391767578439, 1.4636573513552404, 1.4736535671196065 ], [ 1.1239656365621133, 1.1210213444803583, 1.1184781588839112, 1.116359262603466, 1.1146872889846124, 1.1134841177058694, 1.112770659433494, 1.1125666328017745, 1.1128903384470972, 1.113758436123287, 1.1151857320923433, 1.1171849846760802, 1.1197667355373755, 1.122939172213692, 1.1267080228677036, 1.1310764766628145, 1.1360451130877016, 1.1416118132485393, 1.1477716203103818, 1.1545165212256459, 1.1618351426143378, 1.169712389087863, 1.1781290919715879, 1.1870617627453226, 1.196482543085103, 1.206359409131235, 1.2166566341000526, 1.227335461333252, 1.2383549062678763, 1.2496725964225572, 1.261245568973072, 1.2730309670590232, 1.2849866006627877, 1.2970713607166688, 1.309245493598494, 1.321470756406191, 1.333710481108453, 1.3459295781185394, 1.358094507849578, 1.3701732436768168, 1.3821352429731522, 1.3939514359110292, 1.405594235591861, 1.417037568367447, 1.4282569201282245, 1.4392293927185646, 1.4499337642002905, 1.4603505470730274, 1.470462039447247, 1.480252365290328 ], [ 1.1323024965539337, 1.129568671375052, 1.1272331766118442, 1.1253184048219433, 1.1238461626053957, 1.1228374721145982, 1.1223123628166969, 1.122289656924108, 1.1227867529654247, 1.123819413008359, 1.125401559876778, 1.1275450910175597, 1.1302597150331744, 1.1335528147735623, 1.13742933679925, 1.1418917008667473, 1.146939715566062, 1.152570479421037, 1.15877824418154, 1.1655542228548548, 1.1728863418521285, 1.180758962661733, 1.1891526259416982, 1.198043888176327, 1.2074053182715305, 1.2172056969012057, 1.2274104230973837, 1.2379820940325794, 1.2488811970332951, 1.2600668428251938, 1.2714974742093335, 1.283131499362291, 1.294927817905941, 1.3068462264824479, 1.3188477062797705, 1.33089460658799, 1.3429507456452416, 1.3549814529256534, 1.366953576255088, 1.3788354736883308, 1.390597005087896, 1.4022095329044937, 1.4136459366377372, 1.4248806413980704, 1.4358896581256149, 1.4466506313285064, 1.4571428895060954, 1.4673474934741402, 1.4772472783586224, 1.486826885851423 ], [ 1.1408528751393863, 1.1383298945945466, 1.1362020316996824, 1.1344908712319897, 1.1332173787310682, 1.1324017081593798, 1.132063001123367, 1.1322191809399007, 1.1328867457091958, 1.134080565355294, 1.1358136881410301, 1.1380971621949818, 1.1409398767664078, 1.1443484258946115, 1.148326993699124, 1.1528772556812612, 1.157998285059384, 1.1636864489451115, 1.1699352786370245, 1.1767353040619224, 1.1840738556046455, 1.1919348553277305, 1.2002986383013903, 1.209141855777641, 1.2184375091184458, 1.228155145724266, 1.2382612208405588, 1.2487196008344663, 1.2594921625105193, 1.2705394335764058, 1.2818212212695275, 1.2932971862074845, 1.3049273326541968, 1.316672401133225, 1.3284941623517876, 1.3403556214502967, 1.3522211481600217, 1.3640565515739596, 1.3758291183548566, 1.3875076310419256, 1.399062379536463, 1.4104651746932708, 1.421689368920563, 1.432709885275977, 1.4435032539875885, 1.4540476536755351, 1.4643229537141955, 1.4743107539928708, 1.4839944186176406, 1.4933591006722313 ], [ 1.1495912537228912, 1.147278704362756, 1.1453576413138509, 1.143848829197284, 1.1427723833487078, 1.1421475839363981, 1.1419926828174822, 1.1423247062418727, 1.1431592572222065, 1.144510321981317, 1.146390085210971, 1.1488087587172207, 1.151774427146631, 1.1552929126662395, 1.1593676576320116, 1.1639996206609495, 1.1691871778557559, 1.1749260185427897, 1.1812090255066334, 1.188026134875378, 1.195364180898804, 1.2032067441539351, 1.2115340342705834, 1.2203228451023092, 1.2295466175606284, 1.239175632539685, 1.2491773367842258, 1.2595167839055863, 1.2701571566115804, 1.2810603279334503, 1.2921874192431018, 1.3034993193733337, 1.3149571394396433, 1.3265225893820336, 1.338158272821221, 1.3498279053371922, 1.3614964671560306, 1.3731303043918688, 1.3846971937132604, 1.3961663841065923, 1.4075086269380237, 1.4186962024215006, 1.429702947445593, 1.4405042869075568, 1.451077268490799, 1.4614005992896413, 1.4714546818053036, 1.481221646508642, 1.4906853782555665, 1.4998315342135593 ], [ 1.1584923065154382, 1.1563890254037028, 1.1546732005581268, 1.1533647687703055, 1.1524829906955851, 1.1520462716062996, 1.1520719759227926, 1.1525762384284852, 1.1535737756362074, 1.1550777011979758, 1.1570993494102795, 1.1596481106025651, 1.1627312813461559, 1.1663539308702757, 1.1705187828474428, 1.1752261090888694, 1.1804736292989397, 1.1862564098551784, 1.192566755744566, 1.1993940941517465, 1.206724855720676, 1.214542368788213, 1.2228267901834686, 1.231555100267183, 1.2407011873866716, 1.2502360375705432, 1.2601280312265313, 1.2703433335583605, 1.2808463531769587, 1.2916002364563313, 1.3025673642329738, 1.313709821541234, 1.3249898184266593, 1.336370048560918, 1.347813980801169, 1.3592860859097942, 1.3707520057935352, 1.3821786756679983, 1.3935344106490988, 1.4047889677764336, 1.415913592857621, 1.4268810592842502, 1.4376657035551044, 1.4482434599950103, 1.4585918953004882, 1.468690242181964, 1.4785194305170575, 1.4880621140258319, 1.4973026904371518, 1.5062273133328652 ], [ 1.167531024322033, 1.1656351420558688, 1.1641223083714172, 1.1630116288193597, 1.1623215090766688, 1.1620694824092457, 1.1622720318193651, 1.162944409568218, 1.1641004572011184, 1.1657524294986958, 1.1679108258295101, 1.170584232074627, 1.1737791755319937, 1.1774999939468396, 1.1817487181323074, 1.1865249658118462, 1.1918258428327513, 1.1976458474616427, 1.2039767747968324, 1.2108076218531032, 1.2181244993753073, 1.2259105628163436, 1.2341459802973003, 1.2428079576646616, 1.2518708385099908, 1.2613062901044836, 1.2710835760329349, 1.2811699053344638, 1.291530838742561, 1.3021307270033646, 1.3129331549047827, 1.3239013671331106, 1.3349986572502417, 1.3461887075870058, 1.3574358744431008, 1.3687054187584615, 1.3799636868274079, 1.3911782484508963, 1.4023180012121392, 1.413353249549595, 1.4242557663288904, 1.4349988430544949, 1.445557333062978, 1.4559076902840273, 1.4660280046408058, 1.4758980339952423, 1.485499231760637, 1.494814768879607, 1.5038295487433286, 1.512530213734184 ], [ 1.1766828290825173, 1.1749918139229945, 1.1736790838799263, 1.1727629136890079, 1.1722608574777713, 1.172189582934862, 1.1725647009517517, 1.1734005932118927, 1.1747102405405567, 1.1765050550307554, 1.1787947189497874, 1.181587033130611, 1.1848877769070745, 1.1887005806646136, 1.1930268108478201, 1.197865466029178, 1.2032130817800093, 1.2090636420688572, 1.2154084961797065, 1.2222362828823492, 1.2295328675312105, 1.2372813020850773, 1.245461821451739, 1.2540518907217297, 1.2630263158644695, 1.2723574252877654, 1.282015322248412, 1.2919682000666697, 1.3021827051880404, 1.31262432867746, 1.3232578053106046, 1.3340475008745494, 1.344957771896468, 1.3559532868346524, 1.3669993028652994, 1.3780618970421208, 1.3891081543109975, 1.4001063173983945, 1.4110259049440008, 1.4218378045542581, 1.4325143469517627, 1.4430293663611091, 1.4533582509748515, 1.4634779860109488, 1.4733671906739036, 1.4830061493687396, 1.4923768368338282, 1.5014629364533532, 1.5102498508488753, 1.5187247038812093 ], [ 1.185923679036078, 1.1844343819547702, 1.183318273094711, 1.1825928002444805, 1.1822746727320768, 1.1823797022444322, 1.1829226398047885, 1.1839170111782504, 1.1853749532376892, 1.1873070539608945, 1.1897221986892477, 1.1926274250098825, 1.1960277881036299, 1.1999262376547994, 1.204323506546778, 1.2092180107616486, 1.2146057594402142, 1.220480274254367, 1.2268325183474575, 1.2336508371661998, 1.2409209162801718, 1.2486257641486669, 1.2567457298848508, 1.265258566517217, 1.2741395485064007, 1.28336164835758, 1.2928957717125502, 1.302711044394335, 1.312775139701017, 1.3230546307521214, 1.3335153513595615, 1.3441227496930086, 1.3548422215016502, 1.3656394131917107, 1.376480488961296, 1.3873323598819178, 1.3981628758818028, 1.4089409838072233, 1.4196368560600305, 1.4302219948067803, 1.4406693165860753, 1.4509532215066994, 1.461049650333846, 1.4709361317843304, 1.480591821434413, 1.4899975328774082, 1.4991357612001528, 1.507990698487554, 1.5165482408949078, 1.524795986815331 ], [ 1.195230164378516, 1.1939388648191929, 1.1930153457813044, 1.1924762350546063, 1.192337406876114, 1.1926138293085855, 1.1933194083780945, 1.1944668310527844, 1.1960674093505042, 1.1981309279613968, 1.2006654977234053, 1.203677417066628, 1.2071710431409564, 1.2111486737959938, 1.2156104409820208, 1.2205542156354672, 1.2259755238973213, 1.2318674747883203, 1.2382207003668102, 1.2450233109113777, 1.2522608695761859, 1.2599163928178045, 1.2679703841054453, 1.2764009084443095, 1.2851837137298647, 1.2942924019463922, 1.3036986491661144, 1.3133724689274562, 1.3232825096875043, 1.3333963743279913, 1.3436809485218995, 1.3541027251680051, 1.364628113812574, 1.3752237265599896, 1.3858566349369494, 1.396494595073889, 1.4071062410695485, 1.4176612483099698, 1.4281304697481085, 1.4384860487457876, 1.448701512137838, 1.4587518468414937, 1.468613562754455, 1.478264744002296, 1.4876850899233953, 1.4968559465961355, 1.5057603292643285, 1.5143829357180214, 1.5227101505315161, 1.5307300400271082 ], [ 1.2045795933067438, 1.2034820454384498, 1.2027465823257963, 1.2023890214592552, 1.202424414326864, 1.2028669002392978, 1.2037295574474078, 1.2050242534655742, 1.2067614966798883, 1.208950291394522, 1.211597998428233, 1.214710203200263, 1.2182905929472818, 1.2223408443263628, 1.226860522258074, 1.2318469905592495, 1.2372953348414721, 1.243198298430878, 1.2495462327654452, 1.2563270648042246, 1.2635262852570905, 1.2711269625946167, 1.2791097884350255, 1.287453159670902, 1.2961333013925542, 1.3051244323330966, 1.3143989715106503, 1.323927781475257, 1.333680440644045, 1.343625535104712, 1.3537309592710423, 1.3639642149382292, 1.3742926994543276, 1.3846839756017355, 1.395106018018239, 1.4055274332470087, 1.4159176525245343, 1.4262470980225117, 1.4364873243762635, 1.4466111379617101, 1.4565926965880187, 1.4664075921518014, 1.4760329184627772, 1.4854473260060734, 1.4946310649421874, 1.5035660172271328, 1.5122357184026993, 1.5206253693771257, 1.528721838389874, 1.5365136533172008 ], [ 1.2139500683949145, 1.2130415476074856, 1.2124891504708337, 1.2123078963259717, 1.2125120285914248, 1.2131148749105582, 1.2141287050703629, 1.2155645884566713, 1.2174322529480694, 1.2197399472129922, 1.2224943083459738, 1.2257002366535088, 1.229360779187655, 1.2334770233601684, 1.238048001709217, 1.2430706087157044, 1.2485395305644458, 1.2544471889907367, 1.2607837008710225, 1.267536855956531, 1.2746921159678706, 1.2822326389414238, 1.290139332982976, 1.2983909432130478, 1.3069641745638052, 1.3158338512565617, 1.3249731114701684, 1.3343536332497596, 1.3439458854911572, 1.3537193962072496, 1.3636430294531208, 1.373685262313581, 1.3838144541489725, 1.3939991016549587, 1.4042080749699808, 1.4144108318135782, 1.4245776082532007, 1.434679586033984, 1.4446890373910612, 1.4545794488854245, 1.4643256260973958, 1.4739037810431461, 1.4832916040284723, 1.4924683213993242, 1.5014147403589067, 1.5101132817473415, 1.5185480014562525, 1.5267046009922902, 1.5345704276142755, 1.5421344644399957 ], [ 1.2233205533161242, 1.222595902688557, 1.22222117187983, 1.2222105964036383, 1.2225776283518937, 1.2233348027330984, 1.2244936020175552, 1.2260643205247665, 1.2280559304061183, 1.2304759510330263, 1.2333303235873456, 1.2366232925658858, 1.2403572957661042, 1.2445328641431888, 1.2491485327639333, 1.2542007639861124, 1.2596838840200955, 1.2655900342232085, 1.2719091388410124, 1.2786288913940616, 1.2857347624046138, 1.2932100315072599, 1.3010358470165126, 1.309191315588634, 1.317653623648053, 1.3263981907950098, 1.3353988536273835, 1.3446280765381724, 1.3540571843612554, 1.3636566104727865, 1.3733961532716605, 1.3832452339125865, 1.3931731486965255, 1.4031493105034079, 1.413143474905624, 1.4231259479463538, 1.433067773846641, 1.4429409020045583, 1.4527183335026557, 1.4623742479273631, 1.4718841116438768, 1.4812247688056637, 1.4903745163645277, 1.4993131642423767, 1.5080220816796055, 1.5164842306263813, 1.5246841869180854, 1.5326081498875854, 1.5402439410187596, 1.5475809922333843 ], [ 1.2326709300051573, 1.2321246064660922, 1.2319217785928993, 1.2320759143070508, 1.2325996929223635, 1.2335048775391042, 1.2348021860441463, 1.2365011622395445, 1.2386100487262401, 1.2411356632249346, 1.2440832800173949, 1.247456518139493, 1.2512572378630793, 1.255485446889875, 1.2601392175781938, 1.2652146164712645, 1.270705647428741, 1.2766042098017079, 1.2829000733299005, 1.2895808717343016, 1.29663211724772, 1.3040372384605645, 1.311777643743472, 1.3198328120528555, 1.3281804120942198, 1.3367964496512008, 1.345655441500081, 1.3547306128905516, 1.3639941142742464, 1.3734172519736574, 1.3829707269218745, 1.392624875512129, 1.402349906945584, 1.412116132167535, 1.4218941804134115, 1.4316552004140333, 1.4413710443165026, 1.451014433271999, 1.4605591043694428, 1.4699799391333008, 1.4792530741620498, 1.4883559946880374, 1.4972676119279074, 1.50596832510435, 1.5144400689908588, 1.522666347788935, 1.5306322561093944, 1.5383244878064506, 1.5457313334068676, 1.5528426668848154 ], [ 1.2419820464442661, 1.241608166343016, 1.241571159549769, 1.241883744297419, 1.2425578472308996, 1.2436044817182454, 1.2450336251358398, 1.246854096551322, 1.2490734363222626, 1.2516977891840992, 1.25473179241414, 1.2581784706316839, 1.2620391387368866, 1.2663133144195207, 1.2709986416057761, 1.27609082618146, 1.2815835853545319, 1.2874686121073635, 1.2937355563290227, 1.3003720243740835, 1.307363598908018, 1.3146938808935678, 1.3223445553732833, 1.3302954822542852, 1.3385248125864215, 1.3470091298786355, 1.3557236149047869, 1.3646422313310598, 1.373737928487042, 1.3829828568231326, 1.3923485911331668, 1.401806356508414, 1.4113272522108797, 1.4208824691508568, 1.4304434973397786, 1.4399823204693858, 1.449471595553611, 1.4588848162916856, 1.4681964594242054, 1.4773821138389298, 1.4864185925410234, 1.4952840278497876, 1.5039579503453187, 1.5124213521901906, 1.5206567355166252, 1.5286481466163786, 1.5363811967092516, 1.5438430701025112, 1.551022520587674, 1.5579098569520082 ], [ 1.2512357553386275, 1.2510281391546543, 1.2511505974628467, 1.2516151181481965, 1.2524328966227065, 1.2536142199110478, 1.2551683500504645, 1.2571034081411852, 1.2594262604704576, 1.262142408189241, 1.2652558820427642, 1.2687691436479007, 1.2726829947780491, 1.2769964960724596, 1.281706896546895, 1.286809575261671, 1.2922979965133807, 1.2981636799599257, 1.3043961871532423, 1.310983126011897, 1.317910174773609, 1.3251611268742536, 1.3327179579560475, 1.3405609157805547, 1.3486686332062132, 1.357018263614966, 1.3655856373007766, 1.3743454364515728, 1.3832713855619, 1.39233645349227, 1.401513063005573, 1.4107733034879564, 1.420089142692852, 1.4294326336921868, 1.4387761137187502, 1.4480923921692337, 1.4573549256448681, 1.4665379784836867, 1.4756167677499366, 1.4845675920761363, 1.493367944099174, 1.5019966065039516, 1.5104337319013108, 1.5186609069371977, 1.526661201171083, 1.5344192013821234, 1.541921032066062, 1.549154362974761, 1.5561084046223945, 1.5627738927355608 ], [ 1.2604149440259533, 1.2603671599625723, 1.26064249642033, 1.2612522314943, 1.2622068519030758, 1.2635159427022773, 1.2651880766263686, 1.2672307043166071, 1.2696500467739524, 1.2724509914310225, 1.2756369932658533, 1.2792099823839864, 1.2831702794799922, 1.287516520562514, 1.2922455922992184, 1.2973525793182676, 1.3028307247974458, 1.3086714056792985, 1.3148641238597223, 1.3213965146867477, 1.3282543740448167, 1.3354217051536548, 1.3428807859482348, 1.3506122575088717, 1.3585952334789542, 1.3668074297666843, 1.3752253131237393, 1.3838242664912457, 1.3925787683701663, 1.4014625829719745, 1.4104489575805812, 1.4195108234293323, 1.4286209964630576, 1.4377523745876961, 1.4468781283674406, 1.4559718825633352, 1.4650078863714069, 1.4739611706751057, 1.4828076910498331, 1.4915244556340208, 1.5000896373087338, 1.5084826699120304, 1.5166843284630867, 1.5246767935934882, 1.5324437005838, 1.5399701735848725, 1.5472428457631733, 1.5542498662445141, 1.5609808948363744, 1.56742708558389 ], [ 1.2695035560326178, 1.2696089622647926, 1.2700304006806113, 1.2707784611524546, 1.2718629451365129, 1.2732927608626838, 1.2750758184415336, 1.2772189260750344, 1.2797276886331566, 1.2826064099124805, 1.2858579999252098, 1.2894838885783146, 1.2934839470970434, 1.297856418529873, 1.302597858649362, 1.3077030885408176, 1.313165160150368, 1.3189753360431502, 1.3251230845913409, 1.331596091754801, 1.338380290512192, 1.3454599088252568, 1.3528175367539306, 1.3604342129753337, 1.3682895304997102, 1.3763617608412662, 1.3846279953274827, 1.393064301662617, 1.401645893349538, 1.4103473091631487, 1.419142599590998, 1.428005517028339, 1.4369097065334189, 1.4458288940966997, 1.4547370696259527, 1.4636086621642919, 1.4724187052077498, 1.4811429903461213, 1.4897582077977463, 1.4982420727361987, 1.5065734366129426, 1.5147323829674288, 1.5227003074891523, 1.5304599823569458, 1.5379956051286854, 1.5452928326850854, 1.552338800937378, 1.5591221311829684, 1.565632924128872, 1.5718627426968257 ], [ 1.2784866047441588, 1.2787383901185025, 1.2792990051833786, 1.2801783739688126, 1.2813856367913516, 1.282929050763672, 1.2848158904853275, 1.2870523500357445, 1.2896434474605725, 1.2925929329945365, 1.2959032022974495, 1.2995752159952998, 1.3036084268184263, 1.3080007156160076, 1.312748337505129, 1.3178458793851768, 1.3232862300156505, 1.3290605638133162, 1.3351583394661906, 1.3415673143748168, 1.3482735758008713, 1.3552615894151863, 1.3625142656794942, 1.3700130441649863, 1.3777379955114661, 1.385667940280308, 1.3937805834797485, 1.4020526630759609, 1.4104601103837369, 1.4189782198882996, 1.4275818258087338, 1.4362454825849453, 1.444943646453766, 1.4536508553633607, 1.4623419046395674, 1.4709920160395946, 1.4795769980861433, 1.4880733958506633, 1.4964586286363057, 1.504711114294282, 1.5128103791906038, 1.5207371531255154, 1.5284734487960565, 1.5360026256812729, 1.543309438513674, 1.5503800707705362, 1.5572021538624632, 1.5637647729038515, 1.5700584601110503, 1.5760751769849979 ], [ 1.2873501797007445, 1.2877414027160705, 1.288434158349583, 1.2894377277988, 1.2907606148686885, 1.2924104516390815, 1.2943939045530275, 1.2967165819858375, 1.2993829444194283, 1.3023962183956264, 1.3057583154552748, 1.3094697572865934, 1.3135296083085513, 1.3179354169037947, 1.3226831664937948, 1.3277672376165186, 1.3331803821240902, 1.338913710560911, 1.3449566937061017, 1.3512971791588106, 1.3579214237018182, 1.3648141419880526, 1.3719585718502763, 1.3793365562348003, 1.3869286414126103, 1.394714190738291, 1.402671512830484, 1.4107780026613415, 1.4190102936928073, 1.427344418907895, 1.4357559783716833, 1.4442203108291183, 1.452712666803976, 1.461208380698243, 1.469683039490511, 1.478112645780884, 1.486473773113885, 1.4947437117199065, 1.5029006030428425, 1.5109235616654701, 1.5187927835052262, 1.5264896394325667, 1.5339967537607107, 1.5412980673648768, 1.5483788855003384, 1.5552259106893702, 1.5618272613213768, 1.5681724768443135, 1.5742525106077978, 1.580059711543867 ], [ 1.296081446058301, 1.296605071985808, 1.2974228577730722, 1.2985434652541576, 1.2999747866836997, 1.3017238553954003, 1.3037967570973068, 1.306198542805855, 1.3089331444800694, 1.3120032944631588, 1.3154104498699928, 1.3191547230753777, 1.3232348194603425, 1.3276479835623174, 1.3323899547511397, 1.3374549335161594, 1.3428355593993784, 1.348522901542699, 1.3545064627294727, 1.3607741976858814, 1.3673125462598614, 1.3741064819085287, 1.3811395756969054, 1.3883940757413298, 1.3958510017270145, 1.4034902538013923, 1.4112907348092973, 1.4192304845108443, 1.427286824127233, 1.4354365093097783, 1.4436558894361284, 1.4519210710102284, 1.4602080828805746, 1.4684930409885817, 1.4767523104081492, 1.4849626625289578, 1.4931014253615793, 1.501146625097142, 1.5090771172358577, 1.5168727058085743, 1.5245142494554713, 1.5319837533976497, 1.5392644466378376, 1.546340844048733, 1.553198793338807, 1.559825507209136, 1.5662095813122578, 1.5723409988792194, 1.5782111230800933, 1.5838126783205806 ], [ 1.3046686377742955, 1.3053175738061673, 1.3062532394229047, 1.3074837008667255, 1.3090162639793144, 1.3108573896803701, 1.3130126102755153, 1.3154864475404937, 1.3182823335828648, 1.3214025355243186, 1.3248480850755466, 1.3286187140904937, 1.3327127971879458, 1.3371273025159638, 1.341857751708463, 1.3468981900430652, 1.3522411677540058, 1.357877733380878, 1.3637974399404502, 1.3699883645904958, 1.3764371423075952, 1.3831290139225751, 1.3900478886459244, 1.397176420973979, 1.4044961015995294, 1.4119873616677117, 1.4196296894307694, 1.4274017580780274, 1.4352815632631784, 1.4432465686323022, 1.4512738574810886, 1.4593402885435511, 1.4674226538373054, 1.4754978364594415, 1.4835429662373576, 1.4915355711854694, 1.4994537227979217, 1.50727617331829, 1.5149824832711132, 1.5225531377207357, 1.5299696499436948, 1.5372146514631007, 1.5442719676941583, 1.5511266787799147, 1.5577651655409452, 1.5641751408026854, 1.5703456666789124, 1.5762671586605035, 1.5819313775709132, 1.5873314105966752 ], [ 1.313101045084994, 1.313868173428359, 1.3149145609792965, 1.316247702319813, 1.3178743420504575, 1.3198003949145538, 1.3220308669217917, 1.3245697783655273, 1.3274200896773136, 1.3305836311001182, 1.3340610371873458, 1.337851687147625, 1.3419536520546593, 1.346363649927348, 1.3510770096571656, 1.3560876447172059, 1.3613880375287135, 1.3669692352852032, 1.3728208579385406, 1.3789311189336508, 1.385286859136082, 1.3918735942287304, 1.3986755756599734, 1.4056758650086745, 1.412856421396091, 1.4201982013282897, 1.4276812701046102, 1.4352849236876974, 1.4429878197091615, 1.450768116090121, 1.458603615594171, 1.4664719145050102, 1.4743505535326191, 1.4822171689991974, 1.4900496423363099, 1.4978262459366505, 1.505525783446417, 1.5131277226602688, 1.5206123192938608, 1.5279607300650944, 1.5351551137183612, 1.542178718878597, 1.5490159579196243, 1.5556524663644686, 1.5620751476875046, 1.5682722037385939, 1.574233151335541, 1.5799488258527747, 1.585411372855838, 1.5906142289852387 ], [ 1.32136899683984, 1.3222472056987329, 1.3233971799200788, 1.3248258663888561, 1.326539473544491, 1.328543395973971, 1.330842140152768, 1.3334392521775007, 1.3363372483785623, 1.3395375497347681, 1.3430404210345543, 1.3468449157384885, 1.3509488274954031, 1.3553486492484568, 1.360039540837826, 1.3650153059624552, 1.3702683793034962, 1.3757898245355131, 1.3815693438566117, 1.3875952995541425, 1.3938547479868812, 1.4003334862079946, 1.407016111275872, 1.41388609210506, 1.420925853501063, 1.4281168718065445, 1.43543978136963, 1.442874490834982, 1.450400308062235, 1.4579960723007364, 1.465640292098077, 1.4733112872957335, 1.4809873333686943, 1.488646806296686, 1.4962683261124408, 1.5038308972573855, 1.511314043889694, 1.5186979383379142, 1.5259635209818554, 1.5330926099779751, 1.5400679994341906, 1.546873544881428, 1.553494235181684, 1.5599162503448842, 1.5661270050814435, 1.5721151782727887, 1.5778707288743565, 1.5833848990536317, 1.588650205593544, 1.593660420750416 ], [ 1.3294638382499793, 1.3304460506611557, 1.3316925269604214, 1.333209690215958, 1.335003237583019, 1.3370780691879398, 1.3394382182878266, 1.3420867835017134, 1.3450258639483392, 1.348256498155603, 1.3517786076259728, 1.355590945949837, 1.3596910543542262, 1.3640752245569712, 1.3687384697656195, 1.373674504615383, 1.3788757347807503, 1.384333256919639, 1.3900368695167677, 1.395975095083131, 1.4021352140408143, 1.4085033104771845, 1.4150643297911625, 1.4218021480788037, 1.4286996529199403, 1.4357388350364095, 1.4429008901009728, 1.4501663297898004, 1.4575151009959344, 1.4649267119602065, 1.4723803639333692, 1.4798550868603293, 1.4873298774748516, 1.4947838381121832, 1.5021963144876929, 1.5095470306546122, 1.516816219346861, 1.5239847459402385, 1.5310342243341255, 1.5379471231745778, 1.5447068610138222, 1.5512978892332772, 1.5577057618427321, 1.5639171915965087, 1.5699200922204186, 1.5757036068986694, 1.5812581235035994, 1.5865752773416602, 1.5916479424196994, 1.5964702123977468 ], [ 1.337377904593211, 1.3384571051022263, 1.3397930754285354, 1.3413917385196634, 1.3432583048239108, 1.3453972052869063, 1.3478120257327135, 1.3505054433788592, 1.3534791662698509, 1.356733876439601, 1.3602691776294908, 1.3640835483937899, 1.3681743014180492, 1.3725375498572674, 1.377168181469385, 1.3820598412747487, 1.387204923413322, 1.3925945727980868, 1.398218697074351, 1.4040659892909348, 1.4101239615698864, 1.4163789899276171, 1.4228163702532641, 1.429420385292051, 1.436174382315339, 1.443060860988696, 1.4500615707786109, 1.4571576170717067, 1.4643295750210386, 1.4715576099854166, 1.4788216032920762, 1.4861012819314972, 1.493376350687222, 1.5006266251137501, 1.5078321637042937, 1.5149733975403425, 1.5220312556921505, 1.5289872846506705, 1.535823760125313, 1.5425237896470043, 1.5490714045783978, 1.555451640354852, 1.561650604056813, 1.5676555287353653, 1.5734548142600857, 1.5790380548093905, 1.5843960534547692, 1.5895208245795405, 1.594405585103732, 1.599044735650111 ] ], "zauto": true, "zmax": 1.599044735650111, "zmin": -1.599044735650111 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.11142321836266517, 0.10803399337452722, 0.10465959109892693, 0.101310810592605, 0.09799873576425756, 0.09473460711316385, 0.091529672549466, 0.08839501917457625, 0.08534138977562505, 0.08237899002360727, 0.0795172948152311, 0.07676486459785947, 0.07412918447359422, 0.07161653989636417, 0.0692319423233969, 0.06697911580593799, 0.06486055097610856, 0.06287762635164612, 0.061030788954167914, 0.05931977801622672, 0.057743868514168205, 0.0563021070615376, 0.054993512885222265, 0.05381722229603039, 0.05277256651626226, 0.05185908887675545, 0.05107652546177373, 0.050424788731755016, 0.04990400094381217, 0.04951461842827575, 0.049257666978969265, 0.049135075518699646, 0.049150057516516195, 0.04930745812395736, 0.04961397002574363, 0.05007812899036993, 0.050710031374733955, 0.05152076440819155, 0.05252159521094769, 0.05372301328520141, 0.05513375177583605, 0.05675991754507827, 0.05860433824922001, 0.06066619268856146, 0.0629409404793268, 0.06542052136196361, 0.06809376272393254, 0.07094691993828323, 0.07396427611014683, 0.07712874058252936 ], [ 0.10881403531569345, 0.10531725902044756, 0.1018360091857016, 0.09838186219381294, 0.09496675635926653, 0.09160285485253133, 0.0883023819126673, 0.08507743319389538, 0.08193976324460546, 0.07890055588302111, 0.07597018650736276, 0.07315798889077921, 0.07047204229188288, 0.06791899709117506, 0.06550395784048851, 0.06323044080413404, 0.061100418234713044, 0.059114453709803026, 0.05727192248473108, 0.05557129934887843, 0.05401048586377932, 0.05258714136553736, 0.0512989799026452, 0.05014400002619311, 0.04912062677505512, 0.0482277645235874, 0.047464782696015104, 0.046831478382644065, 0.04632807342960747, 0.04595530149202608, 0.04571461886422602, 0.04560853374629354, 0.04564100115862506, 0.045817789080102596, 0.04614669988237779, 0.046637539127731394, 0.047301762318769744, 0.04815179140685558, 0.04920006215905238, 0.05045792320920847, 0.051934541875297675, 0.05363597133370553, 0.0555644993003161, 0.05771834095359605, 0.06009167555293929, 0.06267497371067428, 0.06545553097675418, 0.06841811520372999, 0.0715456451469627, 0.07481983789826466 ], [ 0.10626355677532595, 0.10265832003945392, 0.09906898350486265, 0.09550791709545868, 0.09198794705617541, 0.08852221332893662, 0.08512399394458099, 0.0818064957072256, 0.07858261275703796, 0.07546465783217567, 0.07246407520200412, 0.0695911490943871, 0.06685472647848506, 0.06426197743813525, 0.06181821892759525, 0.05952682716837479, 0.05738925925499397, 0.05540519523969496, 0.05357279860035305, 0.05188907724273221, 0.0503503116944158, 0.0489525050489375, 0.04769180353297952, 0.04656483964848669, 0.04556896291340966, 0.044702345865179315, 0.04396398236998624, 0.043353625440867585, 0.04287173376633167, 0.04251950006644963, 0.04229901334347564, 0.042213561767724055, 0.0422680238795594, 0.04246924124775144, 0.04282623538345395, 0.04335013913539327, 0.044053760149696974, 0.04495077089859191, 0.04605460619739341, 0.04737722090130033, 0.04892789663726182, 0.05071227641301482, 0.05273175400027964, 0.05498326887469252, 0.05745948113991421, 0.06014924454338898, 0.06303826909411395, 0.06610986610245358, 0.06934568847101541, 0.07272640681856413 ], [ 0.10378592814330304, 0.10007178518287892, 0.09637350769131996, 0.0927042563075878, 0.08907775950262684, 0.08550816993576435, 0.08200988146327177, 0.07859730391730219, 0.07528459502164478, 0.07208535233503074, 0.06901227307732247, 0.06607679603004313, 0.0632887469475211, 0.06065601607122574, 0.058184301839323334, 0.05587695675684237, 0.053734967714618484, 0.05175709261519275, 0.049940158203803264, 0.0482795025576152, 0.04676952343311785, 0.045404275122547647, 0.044178045903696894, 0.043085848768180786, 0.042123771540498005, 0.04128915859989079, 0.040580632532912046, 0.03999800386303127, 0.03954214994153699, 0.03921495695557468, 0.03901940092884457, 0.038959792617106664, 0.0390421387835709, 0.03927450170224928, 0.03966719670365739, 0.040232673631194794, 0.040984986082213765, 0.04193884830899134, 0.043108385924380314, 0.04450577026321779, 0.0461399605853252, 0.04801575283139049, 0.0501332590721528, 0.05248784545098209, 0.05507046978562448, 0.057868305309978926, 0.06086552054825822, 0.06404409942024437, 0.06738461636032411, 0.07086691531604138 ], [ 0.10139659629064535, 0.09757373876154414, 0.09376623277037267, 0.08998800335186864, 0.08625367021468226, 0.08257840878772207, 0.07897776603245246, 0.07546742541564427, 0.07206291729607749, 0.06877927445009117, 0.0656306379759896, 0.06262982659931145, 0.05978789220584595, 0.05711369525190596, 0.05461354356225169, 0.05229094403709345, 0.050146515689919485, 0.0481781016481559, 0.04638109667435822, 0.04474897774717364, 0.043273993486045194, 0.04194794047512954, 0.04076293716678337, 0.03971210331828939, 0.03879006665505478, 0.037993248344497084, 0.03731992234029008, 0.03677009446139425, 0.03634529346847077, 0.036048391784215435, 0.03588356180798198, 0.035856418735714296, 0.03597431376695534, 0.03624665142835419, 0.03668504760196605, 0.03730314836927224, 0.03811600021168836, 0.03913898032574391, 0.040386423462563416, 0.04187017490855529, 0.04359832553154814, 0.045574337015757145, 0.04779666480323555, 0.0502588719618725, 0.052950137001822835, 0.05585601319185913, 0.05895929564304213, 0.062240880659028615, 0.06568054155067415, 0.06925758255120934 ], [ 0.09911229438061749, 0.09518175960420378, 0.09126552968713894, 0.08737824078023965, 0.08353536207463785, 0.07975306809882206, 0.07604806109660014, 0.0724373347388931, 0.06893787146508742, 0.06556626863731846, 0.06233829421237556, 0.05926838148774499, 0.05636908490735708, 0.05365053420305652, 0.051119940088995466, 0.048781217368042654, 0.046634795439025954, 0.044677676833534956, 0.042903779127995145, 0.04130455659997172, 0.039869852704543, 0.03858889334740497, 0.037451303913013004, 0.03644802608266259, 0.0355720250649555, 0.03481871240942587, 0.03418606104710866, 0.033674451888675856, 0.03328635338378959, 0.0330259773418484, 0.032899053754928013, 0.03291281151828832, 0.033076150195141256, 0.03339987502247266, 0.03389679107914403, 0.03458145158628697, 0.03546943907664747, 0.03657620018176399, 0.03791560256786596, 0.03949847950656148, 0.04133143781953216, 0.043416129545765896, 0.045749062577696495, 0.048321901338581566, 0.05112212512191363, 0.05413388299641862, 0.05733890041272478, 0.0607173328325568, 0.06424850615985185, 0.06791152043494432 ], [ 0.09695096378589879, 0.09291487334638561, 0.0888914834246283, 0.08489605959446507, 0.0809448443235286, 0.07705494728478869, 0.07324418305095773, 0.06953084417084462, 0.06593339738376645, 0.06247009233802868, 0.05915847683503707, 0.05601482167121001, 0.053053472691086255, 0.050286167786733046, 0.04772138034036963, 0.045363773146150345, 0.04321386038863398, 0.041267970921589715, 0.03951857768830302, 0.037955006549346235, 0.036564473147500096, 0.03533333540370959, 0.03424840810107246, 0.03329817388998524, 0.032473742040306224, 0.03176944741399199, 0.031183042452649624, 0.030715509747767787, 0.030370601951920127, 0.0301542784237652, 0.030074225046523326, 0.03013959289427366, 0.030360977020598378, 0.030750518228904653, 0.03132191021762261, 0.032090085043724875, 0.03307044500799805, 0.034277672622546475, 0.03572431265838804, 0.037419412505835664, 0.03936749480077157, 0.041568034384018904, 0.044015471824772306, 0.04669967534509069, 0.049606696933856075, 0.05271966008159671, 0.056019647444376146, 0.05948650287596974, 0.06309950565536993, 0.06683790675085521 ], [ 0.09493159451732573, 0.09079341414434777, 0.08666578865023039, 0.08256450469419734, 0.07850646707998839, 0.07450961307768093, 0.07059277408709239, 0.0667754697335097, 0.06307761755728275, 0.05951914104756531, 0.05611946142018208, 0.0528968663415418, 0.04986776405959388, 0.04704585572862737, 0.04444129141001526, 0.04205991129667503, 0.039902702618542146, 0.03796560981785439, 0.03623980774963261, 0.03471248151304299, 0.03336806470738988, 0.032189796733935135, 0.031161397096615705, 0.030268635751420636, 0.02950060100045985, 0.028850517903311865, 0.02831604070198087, 0.02789902885947773, 0.027604912823776927, 0.027441843357288324, 0.02741986184103703, 0.027550293249333918, 0.027845442040788784, 0.028318505381704627, 0.02898348561638356, 0.029854856593227307, 0.030946836617218653, 0.032272297581510755, 0.03384150778433213, 0.03566098718001233, 0.03773272102387115, 0.04005386180505643, 0.0426169123737063, 0.04541028072358464, 0.048419053216549164, 0.051625841155673015, 0.05501159287703048, 0.05855630764073937, 0.0622396247210747, 0.06604128625632585 ], [ 0.09307396607168875, 0.08883877098639076, 0.08461151369616868, 0.08040837309493919, 0.07624677550561351, 0.07214533706705402, 0.06812375638473575, 0.0642026405007362, 0.060403243444492515, 0.05674709361618632, 0.05325548572480983, 0.0499488176751684, 0.04684576636303705, 0.04396232265703383, 0.04131074688764193, 0.03889855856913452, 0.036727725548748945, 0.034794246492148205, 0.03308830176890824, 0.03159506796210502, 0.030296163046292002, 0.029171552835216063, 0.028201652726989105, 0.027369329836684376, 0.026661543286305874, 0.02607042844705369, 0.025593713767660942, 0.025234454283218723, 0.025000178516748565, 0.02490166335751915, 0.024951634572693674, 0.025163686147056514, 0.025551593280997105, 0.026128997395712856, 0.026909261085178257, 0.027905224914528258, 0.029128680818511783, 0.03058955466645917, 0.03229495995669247, 0.034248361244394586, 0.03644904976324193, 0.03889202547605475, 0.041568262773809095, 0.0444652580517314, 0.04756773051014722, 0.05085836120777325, 0.05431848881790058, 0.0579287162300762, 0.06166941058541578, 0.06552109789475093 ], [ 0.09139827402539666, 0.08707299634167276, 0.08275270049000845, 0.07845381937968353, 0.07419414152316203, 0.06999278251972525, 0.06587011239214063, 0.06184762109682134, 0.05794769904350721, 0.05419330370509025, 0.050607478894992175, 0.047212693009673075, 0.04402997132463146, 0.04107782175682747, 0.03837099947419613, 0.03591922439728367, 0.03372604595118333, 0.03178811291548302, 0.030095111582590255, 0.02863054951501498, 0.027373390000168092, 0.026300340370266243, 0.025388447123472217, 0.024617604753525323, 0.023972634057303256, 0.02344467912319612, 0.023031770055080933, 0.022738499896051843, 0.02257489106584307, 0.022554682726273312, 0.02269341352318645, 0.023006725706903312, 0.02350921388883195, 0.024213901650913087, 0.025132165808140376, 0.02627378478984968, 0.027646831936069146, 0.029257312292267548, 0.03110862954204555, 0.03320106890545989, 0.03553146947426761, 0.03809317668984141, 0.04087627182259727, 0.04386801090462131, 0.04705338168017359, 0.050415694436491534, 0.053937145275240135, 0.057599315589414335, 0.06138359218801007, 0.06527150652187996 ], [ 0.08992463505840144, 0.08551826258869336, 0.08111377534437668, 0.07672772841125688, 0.07237811269332538, 0.06808435294612743, 0.06386726892722865, 0.05974898266183351, 0.05575274818784868, 0.05190267209136218, 0.048223284682892595, 0.04473891544426705, 0.04147282767900748, 0.03844608472660611, 0.03567616457453582, 0.03317541955644749, 0.030949588369520435, 0.028996678240884786, 0.027306586011765492, 0.025861753406832586, 0.02463893578190722, 0.02361187463091481, 0.022754432385426963, 0.022043671302048946, 0.021462428162809237, 0.021001065193509708, 0.020658192247798284, 0.020440257701938483, 0.020360047025715294, 0.02043433938072515, 0.02068120915450122, 0.02111759927679698, 0.021757708207563, 0.022612405764805252, 0.023689479623605503, 0.024994247330362523, 0.026530075371421498, 0.028298562636677262, 0.030299398990895697, 0.03253006477167914, 0.03498556111585669, 0.03765829852515862, 0.04053818522786396, 0.04361289048706126, 0.04686822504076198, 0.05028857604186826, 0.053857345173250484, 0.05755735535839698, 0.061371207138489245, 0.06528157761104411 ], [ 0.08867247499948298, 0.08419616580447223, 0.07971876171151633, 0.07525683287292267, 0.07082843510410194, 0.06645312873065257, 0.0621519679974706, 0.0579474457933488, 0.053863371394096644, 0.04992464951140884, 0.04615691746643677, 0.04258598560963283, 0.0392370189556239, 0.036133404843530066, 0.03329528710334137, 0.030737828487431677, 0.02846939678071545, 0.026490031589351305, 0.024790665285478904, 0.02335353861699622, 0.022154007051120472, 0.021163545333183417, 0.020353415007338782, 0.019698332348439592, 0.01917956526987704, 0.01878705705365116, 0.0185203023768776, 0.0183877979524079, 0.018405055954232214, 0.018591471664555107, 0.018966717316979426, 0.01954758683009467, 0.020346106681786033, 0.021369215786127816, 0.02261967105607773, 0.024097444570327458, 0.025800920250546228, 0.02772753285553657, 0.029873851673324778, 0.032235320323827074, 0.03480590106869603, 0.037577804120889124, 0.04054138612952941, 0.04368522426864986, 0.04699632824345803, 0.05046043775307902, 0.05406235652099558, 0.057786285715025545, 0.06161613267711745, 0.06553578199547912 ], [ 0.08765982065553071, 0.08312689726798154, 0.07859031228208897, 0.07406658569953331, 0.06957374600001033, 0.06513136231803411, 0.06076055330520625, 0.056483959563328606, 0.052325659683578885, 0.04831100015711616, 0.044466296403476616, 0.04081834674645362, 0.03739368699640369, 0.034217509287718925, 0.0313121916164557, 0.02869545766766632, 0.02637832972279279, 0.024363239868735797, 0.022642851106861598, 0.021200170052337784, 0.02001028658589339, 0.019043596607983063, 0.018269899002929562, 0.017662567756217416, 0.0172021089096271, 0.016878613863468058, 0.016692741925434594, 0.01665494719816263, 0.01678288369877035, 0.017097382188488323, 0.017617969097310386, 0.01835923345882675, 0.01932908505240523, 0.02052911699675772, 0.021956399382924964, 0.023605638863247163, 0.025470851403021823, 0.02754619954863177, 0.029826081271081224, 0.032304765774576666, 0.03497588139295386, 0.037831969566055355, 0.040864209497830865, 0.04406233333841048, 0.04741470257827501, 0.05090849704157036, 0.054529967590233985, 0.05826471264603971, 0.06209795028820508, 0.06601476841036757 ], [ 0.08690253495502767, 0.08232832864574713, 0.07774861257389666, 0.07317984424282696, 0.06863999401114396, 0.0641485833880034, 0.05972670385961071, 0.05539700487503916, 0.051183633216497305, 0.04711209645629201, 0.04320900981967811, 0.03950166865060762, 0.03601737039985107, 0.03278239849831378, 0.02982059244996475, 0.027151491214144636, 0.02478817976075518, 0.022735194248822168, 0.020987078921959633, 0.019528273151764385, 0.01833476842777275, 0.017377427839597313, 0.016626301971901108, 0.01605505191353003, 0.015644731242611638, 0.015386392080578825, 0.015282050487548644, 0.015343596404486636, 0.015589549867191013, 0.016040251607457864, 0.01671284759138088, 0.017617710440052135, 0.018757349382690327, 0.02012768729604756, 0.021720628964900887, 0.02352665324111742, 0.025536606946418128, 0.027742483592331613, 0.030137386684746168, 0.03271502928537593, 0.03546909077524392, 0.03839264534596932, 0.041477766650838396, 0.044715331295142484, 0.04809499620021955, 0.0516053048094723, 0.05523387483126458, 0.0589676271343623, 0.06279302556556683, 0.06669630742657676 ], [ 0.08641355302986409, 0.08181508292429596, 0.07721024578097296, 0.07261547717139467, 0.06804872252193932, 0.0635294761790028, 0.05907880237702698, 0.05471932757269929, 0.0504751874926862, 0.04637190296475832, 0.04243614525112009, 0.03869533398454224, 0.035176991047335786, 0.031907759287999694, 0.028912002873231975, 0.026209965576882772, 0.02381560849349381, 0.021734487769120608, 0.019962293232492226, 0.018484765467152393, 0.01727943976493112, 0.01631904957565946, 0.015575826292238458, 0.015025769623766037, 0.014652207869167341, 0.014448190112724581, 0.01441721410692413, 0.014571772826208808, 0.014929630914202316, 0.015508653743328691, 0.016321868105406565, 0.0173744938063125, 0.01866373159547448, 0.02018077358872225, 0.02191372768749021, 0.023850230419351085, 0.02597910006875027, 0.02829095811444134, 0.03077807840902777, 0.03343381382988596, 0.03625189827264063, 0.03922581947770811, 0.04234835957946197, 0.04561132770597778, 0.049005465561951844, 0.05252048713457256, 0.05614520959053082, 0.05986773704262744, 0.06367566707194025, 0.06755629858457467 ], [ 0.08620218977961512, 0.08159768311200656, 0.07698713944687066, 0.07238705259733677, 0.06781542494072547, 0.06329180391340418, 0.05883729952218241, 0.05447457205322217, 0.05022777292198087, 0.046122412152274174, 0.04218511239585403, 0.03844319160605215, 0.03492399690277588, 0.03165389906199525, 0.02865686900981185, 0.025952626086961583, 0.02355450767506418, 0.021467464091624165, 0.019686841164957045, 0.01819866383272943, 0.016981767231790557, 0.016011409709151502, 0.015263418482476756, 0.014717924844792259, 0.014362198803527038, 0.014192370975864168, 0.01421366512364965, 0.014438621297797818, 0.01488325104758599, 0.015562073003561947, 0.016483771853788957, 0.017649043042800665, 0.01905106499611245, 0.020677827178571532, 0.02251502507125301, 0.0245484787072981, 0.026765598214812846, 0.029155900848792552, 0.03171083429415298, 0.03442321746226864, 0.037286559677746786, 0.04029443243013156, 0.04343998489421031, 0.046715631898758075, 0.050112903768992634, 0.053622427712061556, 0.057234004315138115, 0.060936744758832866, 0.06471924028587875, 0.06856974252665532 ], [ 0.08627359260563577, 0.08168187729661817, 0.07708572700449637, 0.07250178852242198, 0.06794822044451763, 0.06344472424133082, 0.059012553217468705, 0.054674487071503304, 0.05045475296970774, 0.04637886394017597, 0.04247333129566754, 0.03876519014245633, 0.03528125942517044, 0.03204705067634382, 0.029085263958542353, 0.026413898357054457, 0.024044188504439238, 0.02197884418918747, 0.020211296958269735, 0.018726611570119428, 0.017504216778546515, 0.016521813790807312, 0.015759303856396373, 0.015201798710814436, 0.014841461291873342, 0.014678289140584869, 0.014719704984494469, 0.014978539646892176, 0.015469366355947683, 0.016204079040906903, 0.01718828019161577, 0.018419765101019236, 0.01988932791890492, 0.021583097482163756, 0.023485258318638534, 0.02558028407943757, 0.027854303909881157, 0.030295618425015505, 0.03289458445642736, 0.03564313478389411, 0.03853416050662828, 0.04156091421833114, 0.044716523352865745, 0.04799364899349543, 0.051384289436246774, 0.05487970778471844, 0.058470454705019964, 0.06214645693596186, 0.06589714575148287, 0.06971160485468836 ], [ 0.08662840334401571, 0.08206822667130377, 0.07750644260660852, 0.07295992932954179, 0.06844707914994574, 0.06398781958062591, 0.05960360647444604, 0.05531737433842907, 0.05115342129283748, 0.04713719529856754, 0.04329493406452422, 0.03965309501849739, 0.036237499427756295, 0.033072119162640655, 0.030177479068845103, 0.027568763037448294, 0.025253915282772203, 0.023232279536289514, 0.021494470745520456, 0.02002400110011779, 0.018800571936671538, 0.017804152897120448, 0.017018589683276988, 0.01643388584100165, 0.016047115730774723, 0.015862334935736466, 0.015889581688770162, 0.01614269975925806, 0.01663594817331352, 0.017380132817529086, 0.018379559969386134, 0.01963086765239752, 0.02112389299361901, 0.022843880638892942, 0.024774040546672333, 0.02689768911848716, 0.02919962457745244, 0.03166673006653987, 0.034287980834092305, 0.03705408275255663, 0.039956944729682455, 0.0429891328670451, 0.04614339669499408, 0.0494123103210585, 0.05278803781472529, 0.05626221181356809, 0.059825904350572896, 0.06346966602713884, 0.06718361104363366, 0.07095752910399457 ], [ 0.08726267109444488, 0.08275201237650984, 0.07824362480971117, 0.07375465164289652, 0.06930373953832232, 0.06491104198877033, 0.0605981858996937, 0.0563881830441087, 0.052305259809933766, 0.04837456776919316, 0.044621724883041905, 0.04107212577346297, 0.03774995718722879, 0.0346768763612434, 0.031870377541943926, 0.02934200674774124, 0.027095783724317164, 0.025127386725095072, 0.023424699670227537, 0.021970038640723524, 0.020743745857039423, 0.01972816619096135, 0.018910811988636117, 0.01828601577287618, 0.017855165884196188, 0.017626005036998085, 0.017611220934478554, 0.017826187812871055, 0.018285835434710938, 0.01900121478694281, 0.019976807338690578, 0.021209468814742928, 0.022689184630238297, 0.024401083711416076, 0.02632785614600788, 0.02845186930500461, 0.03075662371452012, 0.03322749959340055, 0.035851925088497646, 0.038619159469851824, 0.04151987446577294, 0.04454567495101978, 0.04768865173046007, 0.05094101686875753, 0.05429484048926077, 0.05774188736845566, 0.0612735401307492, 0.06488079093957001, 0.06855428296228927, 0.0722843846990926 ], [ 0.08816802651618363, 0.08372347326577491, 0.07928584241524687, 0.07487251307008763, 0.0705023296213009, 0.06619557743382858, 0.0619739101665639, 0.05786020710459442, 0.05387833077472792, 0.050052745720368365, 0.046407950605335535, 0.042967672525733344, 0.03975378357302917, 0.03678493933522427, 0.034075023147892035, 0.031631615444175906, 0.029454870988642454, 0.027537301438587375, 0.025864902067337846, 0.024419728332774303, 0.023183471612971268, 0.02214108525248607, 0.02128344629033518, 0.020608524006428288, 0.020121206687258253, 0.019832260806712854, 0.01975669846924797, 0.01991150953065691, 0.020312758368572412, 0.02097248051193981, 0.021896211311896098, 0.02308191023428652, 0.02452050450577633, 0.026197652266371628, 0.028096004137423407, 0.03019730511798025, 0.03248395334595757, 0.03493991354775817, 0.0375510665873349, 0.0403051543928589, 0.043191485520750764, 0.04620053701897608, 0.04932354792637508, 0.05255216198071557, 0.05587814735093786, 0.059293200494137874, 0.06278882848866385, 0.06635629757031597, 0.06998663321277342, 0.07367065734517259 ], [ 0.08933209495700216, 0.08496834040649216, 0.0806165905315235, 0.07629436442798827, 0.07202056964715192, 0.0678154401030166, 0.06370041310252807, 0.05969792183471203, 0.055831072995512106, 0.05212317316795349, 0.04859706510755953, 0.04527424169994235, 0.04217372954616225, 0.03931078614842088, 0.036695541558131824, 0.0343318304592619, 0.032216569733015975, 0.030340070983926645, 0.028687553909591622, 0.027241805533672135, 0.02598649363867381, 0.024909312698987437, 0.024004162769382664, 0.02327197794239999, 0.022720351730382986, 0.022362360987938243, 0.0222148551589998, 0.022296235547563405, 0.02262375657663393, 0.023210689051955512, 0.02406400376803412, 0.025183228030637425, 0.026560737981382834, 0.028183230645064006, 0.03003378975892945, 0.032093942483537516, 0.034345303319379676, 0.03677064880517488, 0.039354451126235396, 0.04208299270983129, 0.0449442071384824, 0.047927375223316644, 0.051022773109284957, 0.054221336072251776, 0.05751437377776541, 0.06089335216981218, 0.06434974349189322, 0.06787493791081087, 0.07146020630471205, 0.07509670262409185 ], [ 0.09073909785192194, 0.08646859653579357, 0.08221525416894965, 0.07799657747410675, 0.0738313416924955, 0.0697394836495155, 0.0657419228895812, 0.06186028743277917, 0.05811651671103787, 0.05453231279726339, 0.0511284155330052, 0.04792369266593008, 0.04493406883188599, 0.042171372167241455, 0.039642253344414555, 0.03734741427461848, 0.035281438616226526, 0.033433493314018965, 0.03178902417319554, 0.030332297536861813, 0.029049325267763968, 0.02793050920913439, 0.026972402729894613, 0.026178312997052776, 0.025557857617906965, 0.025125783110026147, 0.024900275379836762, 0.0249008286896248, 0.025145736387031395, 0.025649480535403155, 0.026420543698387488, 0.02746019584656111, 0.028762538734088162, 0.030315671738839707, 0.03210352415828997, 0.0341078196287993, 0.03630976428738922, 0.03869125579347742, 0.041235588253088915, 0.04392773465642247, 0.04675432861445761, 0.04970346455343938, 0.052764412669778264, 0.055927316815382065, 0.05918291784504758, 0.06252232481245124, 0.06593684214895576, 0.0694178518198147, 0.07295674426287359, 0.0765448895262125 ], [ 0.09237057469641352, 0.08820336777349021, 0.08405821189528422, 0.07995241233119181, 0.07590438337510554, 0.07193349459952221, 0.06805983786103961, 0.06430389436504846, 0.06068608041691968, 0.05722615379982968, 0.053942473087174675, 0.050851123325311255, 0.04796495661596544, 0.04529264548252647, 0.04283790427259622, 0.04059908283025381, 0.038569350130159885, 0.03673763217327058, 0.03509032892598399, 0.0336136249336722, 0.03229599379503724, 0.03113038232867708, 0.0301156306952884, 0.029256925969897412, 0.028565362562146132, 0.028056827919492613, 0.02775039776952614, 0.027666326766779815, 0.027823720767994425, 0.028238126403216168, 0.028919459478055673, 0.029870738563158306, 0.03108790751958053, 0.032560702703175626, 0.034274228422054756, 0.03621078408287197, 0.03835154791456142, 0.040677881422500124, 0.043172181419392844, 0.0458183196136317, 0.048601764525615036, 0.05150949170299974, 0.05452977519078582, 0.05765193090768111, 0.06086605977908815, 0.06416281923816916, 0.06753323723094953, 0.07096857291359222, 0.07446022199710112, 0.07799966124349814 ], [ 0.09420615364724484, 0.09014985287455679, 0.08611995506640277, 0.0821333617317288, 0.07820789436288049, 0.074362097493653, 0.07061496027094248, 0.06698554065220223, 0.06349247886669811, 0.06015339392170707, 0.05698417092719057, 0.053998169848025995, 0.051205418520583246, 0.04861189165774788, 0.04621901510815396, 0.04402355658590836, 0.04201805179735081, 0.04019185153325583, 0.03853275648160355, 0.03702905212484936, 0.035671615454232634, 0.034455704321037846, 0.03338210486023438, 0.03245748462895714, 0.03169398992568387, 0.03110823308078477, 0.030719809136281168, 0.030549430726742852, 0.030616778972369144, 0.030938276145097945, 0.03152512556435213, 0.03238201241771062, 0.03350673871270956, 0.03489081377422702, 0.0365207652396478, 0.03837979421145238, 0.04044940793201387, 0.04271077653324418, 0.04514570100004218, 0.047737192307265905, 0.0504697272583202, 0.0533292704750889, 0.05630314911407012, 0.05937985111441591, 0.0625487984916673, 0.0658001293860813, 0.06912450827668591, 0.07251297332266256, 0.07595682275176815, 0.07944753787353487 ], [ 0.09622430597485158, 0.09228420891376575, 0.08837412223763266, 0.08451034999701403, 0.08070991118954006, 0.07699030783527926, 0.07336921454136897, 0.06986407956685829, 0.0664916324181787, 0.06326730247486818, 0.06020456830921887, 0.057314278713160305, 0.054604012764334874, 0.05207757354011169, 0.049734730790607626, 0.04757133136864499, 0.045579871096085564, 0.04375056053414502, 0.04207282250729858, 0.04053704964975375, 0.039136360304339604, 0.03786806113173803, 0.036734578237262734, 0.03574373895752276, 0.03490841690052636, 0.034245631746350515, 0.033775204513564784, 0.03351804994354677, 0.03349420501244292, 0.033720774516490803, 0.034210081040252395, 0.034968353051319026, 0.035995207313197004, 0.03728399165334916, 0.03882283612002672, 0.04059611329522927, 0.042585980133769255, 0.04477374473924957, 0.04714091590104927, 0.0496698994120871, 0.0523443769102393, 0.05514943755224402, 0.058071539783794486, 0.06109837170920001, 0.06421866342493661, 0.06742198887563922, 0.0706985811048493, 0.07403917414287703, 0.07743487715886212, 0.08087708144216503 ], [ 0.09840303435093992, 0.09458233506471853, 0.09079438280747483, 0.08705471577363562, 0.08337938010763124, 0.07978467398379681, 0.07628682050402236, 0.07290156540364273, 0.06964370207823013, 0.06652653670495737, 0.06356132061360026, 0.06075669502467403, 0.05811821275347953, 0.055648018417972664, 0.053344777034509724, 0.051203933492945185, 0.04921835607069613, 0.047379363695384084, 0.045678064375960815, 0.04410685610843845, 0.04266088498539567, 0.04133924221598606, 0.04014572349757853, 0.03908905730933856, 0.038182597544243836, 0.037443533779071184, 0.036891688923650266, 0.03654797386268819, 0.036432591812155045, 0.036563150434538096, 0.03695292275575316, 0.037609540937610965, 0.03853435907092031, 0.03972257970290711, 0.04116405812643234, 0.042844555693286046, 0.0447471594384114, 0.04685362038595265, 0.049145449857471386, 0.0516047077155102, 0.05421448964610223, 0.0569591630347251, 0.05982441684011961, 0.06279718924192082, 0.06586552637092528, 0.06901841217661299, 0.07224559686702499, 0.0755374408847969, 0.07888478343874937, 0.08227883900129473 ], [ 0.10072046277300725, 0.09702052122088825, 0.09335513862519183, 0.08973895442207078, 0.08618691923124243, 0.08271402675370146, 0.07933498476999057, 0.07606382650985029, 0.07291347072310961, 0.06989524862712967, 0.06701842830956532, 0.0642897810463765, 0.06171324711892566, 0.05928976760534346, 0.057017348892589505, 0.05489141391822034, 0.052905465516865015, 0.0510520432138815, 0.049323900999963505, 0.047715281428006254, 0.04622312614898962, 0.04484805872941747, 0.0435950070690015, 0.04247338989926113, 0.04149685246902776, 0.04068257901519314, 0.040050228262206874, 0.03962054819553416, 0.03941375220180132, 0.03944779265141196, 0.039736734576878, 0.04028947158745058, 0.0411089989706655, 0.04219235556141425, 0.04353119944558688, 0.04511285087775298, 0.04692156673839, 0.048939817108217286, 0.05114939496824978, 0.053532269745377496, 0.05607116577290434, 0.058749893967088726, 0.06155348829488406, 0.06446820383615413, 0.0674814277663565, 0.070581544372778, 0.07375778411891806, 0.07700007681515955, 0.0802989209377274, 0.08364527516224449 ], [ 0.10315531297050302, 0.09957595043213406, 0.09603204052704145, 0.09253723056376262, 0.08910530156965371, 0.0857498990656624, 0.08248421468858565, 0.07932062407432043, 0.07627029325527816, 0.0733427744951991, 0.07054562241227041, 0.06788407117612281, 0.06536082148305493, 0.0629759892306426, 0.060727263385382674, 0.05861030601154671, 0.05661940185440745, 0.05474832987921986, 0.052991389758110734, 0.051344480743206036, 0.0498061085520921, 0.04837819578838999, 0.047066594657597625, 0.04588124004983056, 0.04483592266935397, 0.043947693183341116, 0.04323592646833585, 0.04272108952357306, 0.042423282705826466, 0.042360669423037886, 0.042547964096613496, 0.04299518446230756, 0.04370686166587559, 0.044681827879164034, 0.04591358486937471, 0.04739114002340024, 0.049100120474911045, 0.05102396054047706, 0.05314499410396978, 0.05544534668711557, 0.057907585971666724, 0.06051513841602356, 0.06325250844580343, 0.06610534811445513, 0.06906042471017673, 0.07210552699051015, 0.07522934157530854, 0.07842132195025463, 0.08167156471863603, 0.0849707015892464 ], [ 0.10568726598215153, 0.10222706075024153, 0.09880233585876155, 0.095425691834447, 0.09210971037904508, 0.08886669331641636, 0.08570836431762982, 0.08264554169575976, 0.07968779669325363, 0.07684311882845227, 0.07411761731549114, 0.07151529413145159, 0.06903792832572606, 0.06668511071856793, 0.06445446137975151, 0.06234204801458269, 0.060343001693763026, 0.05845229918672884, 0.05666565256631982, 0.05498042257806883, 0.05339645877768259, 0.051916771073927837, 0.050547954249109406, 0.04930031415642615, 0.04818767308552397, 0.04722685493287474, 0.046436867072761435, 0.04583781144073328, 0.045449581941277004, 0.045290443835141865, 0.045375636373032636, 0.045716173229320214, 0.04631801292780104, 0.047181720696354325, 0.04830265299267465, 0.049671595407316894, 0.051275708199123186, 0.05309960317617757, 0.05512639155457458, 0.0573385886094905, 0.05971881606747959, 0.062250290805273965, 0.06491712073682646, 0.06770444536306046, 0.07059846289042342, 0.07358638267054221, 0.07665633487699501, 0.0797972614900918, 0.08299880533287596, 0.0862512077850812 ], [ 0.10829721727465555, 0.1049537825001933, 0.10164507332137145, 0.09838262348940235, 0.0951778227920769, 0.0920416712471388, 0.0889845072540747, 0.08601571969891397, 0.08314345918326516, 0.08037436911376139, 0.07771336263275244, 0.07516347527521887, 0.0727258245451585, 0.07039970500986271, 0.0681828399512461, 0.06607179764797581, 0.06406256255481753, 0.06215123084360251, 0.06033477912272963, 0.05861183868501653, 0.05698339927109765, 0.05545336848508369, 0.05402892525234143, 0.05272062453154877, 0.05154223060411508, 0.05051027345797768, 0.04964333671155173, 0.04896110041313714, 0.0484831841622217, 0.04822786856587055, 0.048210811398398765, 0.0484439052700431, 0.048934428332432264, 0.04968460647880832, 0.050691637416867524, 0.05194814309240858, 0.053442944297510765, 0.05516201139924359, 0.05708944447621071, 0.059208366239411815, 0.06150165575221647, 0.06395249483400067, 0.06654473269454787, 0.06926309483901559, 0.07209327109049446, 0.07502191810413975, 0.0780366075008697, 0.08112574446394437, 0.084278475089235, 0.08748459491860204 ], [ 0.11096743941900163, 0.1077376720206961, 0.10454119487020862, 0.10138848381702978, 0.09828977301406377, 0.09525482917486978, 0.09229270964635947, 0.08941151502284937, 0.0866181511864499, 0.08391811977391314, 0.08131535950738315, 0.07881216277209266, 0.07640919137361131, 0.07410561172558398, 0.0718993622588055, 0.0697875545893054, 0.06776699567070732, 0.06583480237543259, 0.06398906505571984, 0.062229505366812564, 0.06055806842145647, 0.05897939144727224, 0.05750109995481418, 0.05613389557103104, 0.05489141387125348, 0.053789843356153805, 0.05284730827327843, 0.052083031238431284, 0.051516310781383065, 0.05116537623980029, 0.05104621473046816, 0.05117149255054927, 0.05154970278644187, 0.05218465129228384, 0.05307534353373035, 0.054216266840706705, 0.055597996683496693, 0.05720801109717106, 0.05903158418206506, 0.06105264525306942, 0.06325452366404263, 0.06562053751635556, 0.06813441744136156, 0.07078057959708577, 0.0735442744855197, 0.07641164224740028, 0.07936970359321004, 0.08240631108169325, 0.08551007995886764, 0.08867031239505722 ], [ 0.11368166869904478, 0.1105619639574412, 0.10747354324732304, 0.10442585589737594, 0.10142803746659015, 0.09848870685760587, 0.09561575551003679, 0.09281613939986331, 0.09009568776722404, 0.08745894537718749, 0.08490906715843717, 0.0824477846466619, 0.08007546216210681, 0.07779125657464435, 0.07559338763036293, 0.07347951633296998, 0.07144721752986832, 0.06949452094122718, 0.06762048411250418, 0.0658257530086934, 0.0641130626920154, 0.062487632357658945, 0.06095741536975398, 0.05953317418536656, 0.058228360130665804, 0.05705878755014934, 0.056042101194534295, 0.05519704698797096, 0.05454257246093373, 0.05409680577956239, 0.053875989433552804, 0.053893469467225605, 0.05415885346025838, 0.0546774409085581, 0.055449995050024646, 0.05647287189915271, 0.057738464745103205, 0.0592358770502525, 0.060951714749017574, 0.06287089233127113, 0.06497736947261532, 0.06725476613338727, 0.06968683455522913, 0.07225779049032013, 0.07495252121478144, 0.07775669509955539, 0.08065679878289672, 0.08364012558240198, 0.0866947345948235, 0.08980939527443065 ], [ 0.11642513205169908, 0.11341156270141811, 0.11042681009817708, 0.10747934480538146, 0.10457727439274932, 0.10172816453406965, 0.09893885881111468, 0.09621530744727695, 0.09356241754619549, 0.09098393930160657, 0.08848240365791667, 0.08605912658881369, 0.08371429311728307, 0.08144713015338233, 0.07925617114172534, 0.07713960768116004, 0.07509571437118025, 0.07312332416873867, 0.0712223237450454, 0.06939413294284148, 0.0676421303548701, 0.06597198855067281, 0.06439188707075864, 0.06291257784812995, 0.06154728491759881, 0.0603114273823019, 0.05922216199777171, 0.058297750996354335, 0.05755677404268483, 0.05701722177017106, 0.056695531002021446, 0.05660564381676323, 0.056758186477841206, 0.05715986203176568, 0.057813127859605046, 0.05871618924231628, 0.05986329167986835, 0.061245251371271604, 0.06285013599391505, 0.06466400150064314, 0.06667160270975918, 0.06885701887029255, 0.07120416195765013, 0.07369715885880881, 0.0763206155352752, 0.07905978111704215, 0.08190063379495162, 0.0848299101276247, 0.08783509671049088, 0.0909043994383292 ], [ 0.11918452932635099, 0.11627299074745874, 0.11338744502464594, 0.11053544264572006, 0.10772414140216377, 0.10496015133100617, 0.10224938344914332, 0.09959691169108359, 0.0970068591107802, 0.09448232053779677, 0.09202533417112728, 0.08963691373811304, 0.08731715058948834, 0.08506539132141466, 0.08288049128075689, 0.08076113793239861, 0.07870623111299548, 0.07671530044221998, 0.074788934492659, 0.07292919254665742, 0.07113996843371033, 0.06942727713833026, 0.06779943818266897, 0.06626713443385415, 0.06484333013934623, 0.06354303724269025, 0.06238292474562203, 0.06138077326530673, 0.06055478759329397, 0.0599227950771611, 0.05950137641323435, 0.05930499480920472, 0.05934520386909906, 0.0596300175195606, 0.0601635122725975, 0.060945703185594356, 0.061972695815395024, 0.06323707707371426, 0.06472847818643444, 0.06643422924521195, 0.06834002780362967, 0.07043055946016372, 0.0726900299388705, 0.07510258975893029, 0.07765265013060714, 0.08032510055113651, 0.08310544486165101, 0.0859798744389573, 0.08893529620392152, 0.091959330554977 ], [ 0.12194798371617775, 0.1191343084639018, 0.11634354131023875, 0.1135823777549587, 0.11085710697750657, 0.10817347958436338, 0.10553658287384958, 0.10295073205580102, 0.10041938695369758, 0.0979451042850925, 0.09552953542977825, 0.0931734784450892, 0.09087699083019178, 0.08863956614396731, 0.08646037316293541, 0.0843385511206688, 0.0822735491604159, 0.08026549304481087, 0.0783155580231726, 0.07642632409355747, 0.0746020890302797, 0.07284911547645455, 0.07117579079245948, 0.06959268165202986, 0.06811246905096083, 0.06674975321524065, 0.06552072219807106, 0.06444268366687024, 0.06353346775013126, 0.06281072078956737, 0.06229112524814905, 0.06198959783720337, 0.061918532135698076, 0.062087158428824805, 0.0625010877521347, 0.06316208769792724, 0.0640681073023074, 0.0652135341095916, 0.06658963670299363, 0.06818512737565378, 0.06998677501945363, 0.07198000620408593, 0.07414944832801634, 0.07647938736863305, 0.07895412984228391, 0.0815582716191401, 0.08427688449637, 0.08709563540799406, 0.09000085391837882, 0.09297956238344289 ], [ 0.1247049708568615, 0.12198501654989195, 0.11928470993007462, 0.11660995940400043, 0.11396626622269641, 0.11135861341338632, 0.10879136480468021, 0.10626818155524066, 0.10379196425673302, 0.10136482885219379, 0.09898812412615093, 0.09666249724900192, 0.0943880117240642, 0.09216431911145637, 0.08999088222488041, 0.08786724337434511, 0.08579332702880803, 0.08376976243405228, 0.08179820867933217, 0.07988166281142133, 0.07802473102515718, 0.07623384366780174, 0.07451739651383989, 0.07288580310013786, 0.07135144549787933, 0.06992851361596063, 0.06863272626392532, 0.06748093147650709, 0.06649059001258416, 0.06567915534350673, 0.06506337596004487, 0.06465856025146959, 0.06447785774674558, 0.06453161914256453, 0.06482689722907067, 0.06536713918974542, 0.06615209857789127, 0.0671779668385072, 0.06843769610408858, 0.06992146362920992, 0.07161721775170425, 0.07351124627840509, 0.07558871819291783, 0.07783416444753052, 0.08023187922493008, 0.08276623646508767, 0.08542192617015748, 0.0881841208252494, 0.09103858480485032, 0.09397173980278986 ], [ 0.12744623481979084, 0.12481594959930978, 0.12220195003575307, 0.11960942543861014, 0.11704316693750944, 0.11450747564695979, 0.11200608256629345, 0.10954208661645741, 0.10711791755709757, 0.10473533042853898, 0.10239543751069637, 0.10009878250486663, 0.09784545969925425, 0.0956352783236361, 0.09346796926693457, 0.0913434280434185, 0.0892619846376435, 0.08722468795690347, 0.08523359037726934, 0.08329201651094319, 0.081404799942398, 0.07957847221053574, 0.07782138953881057, 0.07614378444215884, 0.07455773111713225, 0.07307701538168342, 0.07171690210783747, 0.07049379615740102, 0.06942479759965478, 0.0685271592385817, 0.06781766452575477, 0.0673119561705134, 0.06702385831137866, 0.06696474494113511, 0.06714301086486373, 0.0675636960571822, 0.06822829921960602, 0.06913479383798775, 0.07027783480979068, 0.07164912142972543, 0.07323786785613573, 0.07503132729450465, 0.07701532034283072, 0.07917472847473592, 0.08149392694626237, 0.0839571443780982, 0.08654874685149465, 0.08925345171738476, 0.092056480529586, 0.09494366217466507 ], [ 0.13016369721473958, 0.12761916680656132, 0.1250875214107218, 0.12257329740134552, 0.12008064917231906, 0.11761327444315686, 0.11517435220749134, 0.11276649878128824, 0.1103917475211218, 0.10805155751223598, 0.10574685579723953, 0.10347811648631558, 0.10124547836168785, 0.09904890042339126, 0.09688835234337924, 0.09476403418201243, 0.09267661719815859, 0.09062749538730312, 0.08861903572163271, 0.08665481408513691, 0.08473982363677456, 0.08288064272053157, 0.08108555029721737, 0.07936457797643795, 0.07772948889532287, 0.07619367488151006, 0.07477196474118186, 0.07348033858615417, 0.07233554652935158, 0.07135463554516612, 0.0705543962557693, 0.06995075166891426, 0.06955812128783691, 0.06938880431057672, 0.06945243189361958, 0.06975553786140905, 0.07030128824233134, 0.07108939323315736, 0.07211620364624916, 0.07337497216475175, 0.07485624246898541, 0.0765483196715997, 0.07843777434604654, 0.0805099383787127, 0.08274936120690218, 0.0851402067646463, 0.08766658228306938, 0.09031279859154208, 0.09306356728562229, 0.09590414327975783 ], [ 0.13285036392879013, 0.13038784395222977, 0.1279348223578049, 0.12549524561352463, 0.12307269945721155, 0.12067034924708958, 0.11829089330353557, 0.11593653384325481, 0.11360897006306117, 0.11130941755966364, 0.10903865752808, 0.10679711804620853, 0.10458498824589908, 0.10240236435460139, 0.1002494245745956, 0.09812662769559888, 0.09603492838200647, 0.09397600040948531, 0.0919524578913202, 0.08996806382052722, 0.08802791506882761, 0.08613859325242741, 0.08430827145160097, 0.08254676748182935, 0.08086553511887072, 0.07927758534962616, 0.07779733050589774, 0.07644034540765905, 0.07522304195953314, 0.07416225765497436, 0.07327476466326055, 0.07257671469287734, 0.07208304499291641, 0.07180688110433045, 0.07175897993184273, 0.07194725972035093, 0.072376459530107, 0.07304795929017385, 0.07395977401858624, 0.07510671572058263, 0.07648069803173697, 0.07807114552867103, 0.07986546378484369, 0.08184952764254701, 0.08400815208064474, 0.08632551995382061, 0.08878555131306876, 0.09137220819572185, 0.0940697357508024, 0.09686284513314317 ], [ 0.13550023267069988, 0.13311616935347015, 0.13073827500167023, 0.12836996528114628, 0.12601431965501747, 0.12367403476959911, 0.12135139076908803, 0.11904823438382514, 0.11676598249012693, 0.11450564941974918, 0.11226790057764267, 0.1100531339051946, 0.10786158942987391, 0.10569348563140313, 0.10354917972136607, 0.10142934729465199, 0.09933517529663838, 0.09726856098331291, 0.09523230862977049, 0.09323031521651831, 0.09126773618277734, 0.08935112250870698, 0.08748852075133065, 0.08568952807107535, 0.08396529463597602, 0.0823284660549826, 0.08079305878963032, 0.07937426212410283, 0.07808816171343687, 0.0769513825644784, 0.07598065408125598, 0.075192306802356, 0.0746017194043031, 0.07422274440117425, 0.07406714988600223, 0.07414412025669609, 0.07445985888580219, 0.07501732882774238, 0.07581615427605323, 0.07685268780449493, 0.07812022997980185, 0.07960937246597388, 0.08130842603275051, 0.0832038920063395, 0.08528093897190052, 0.08752385405659945, 0.08991644757946843, 0.09244239922209205, 0.09508554179127812, 0.09783008448306586 ], [ 0.13810820343590974, 0.1357992453885609, 0.13349321895259622, 0.13119306376291065, 0.12890140965004068, 0.12662054119606683, 0.12435237486673646, 0.12209845190891126, 0.11985994999342107, 0.11763771614962058, 0.11543232286633749, 0.11324414833166303, 0.11107348068119333, 0.10892064487575795, 0.10678614951202249, 0.10467084957486945, 0.10257611996655903, 0.10050403368243555, 0.0984575378106568, 0.09644062013980582, 0.09445845904204599, 0.09251754939192139, 0.09062579747692888, 0.08879257803899471, 0.0870287466642746, 0.08534660069048462, 0.0837597817203857, 0.08228311296231051, 0.08093236536928344, 0.07972394844652882, 0.07867452519350171, 0.07780055633543795, 0.07711778678166599, 0.0766406964929587, 0.0763819472561579, 0.07635186420636461, 0.07655799404037854, 0.07700477895293414, 0.07769337586564712, 0.07862163566738131, 0.07978423965826405, 0.08117297369397558, 0.08277710786924229, 0.08458384292270663, 0.08657878419210538, 0.08874640874881942, 0.091070499318757, 0.09353452766531524, 0.09612197860158533, 0.09881661269681492 ], [ 0.14066999321445545, 0.13843299643571402, 0.13619581358119023, 0.13396095856840495, 0.1317306626953537, 0.12950684867628431, 0.12729111670708057, 0.12508474518963356, 0.12288870850308507, 0.12070371378523162, 0.11853025807619158, 0.11636870639072049, 0.11421939035537755, 0.1120827260202408, 0.10995934839474698, 0.10785025923551429, 0.10575698370312898, 0.1036817307669709, 0.10162755171274, 0.09959849080586694, 0.09759972205741725, 0.09563766606353453, 0.09372008095397724, 0.09185612149126471, 0.09005636023201963, 0.08833276437540481, 0.08669862155459211, 0.0851684075787861, 0.08375758935324538, 0.08248235736863661, 0.08135928479493404, 0.08040491479915331, 0.07963528441599713, 0.07906540181605155, 0.07870870313310759, 0.07857652342868779, 0.07867762175053679, 0.0790178005665855, 0.07959965395198396, 0.08042246704227905, 0.08148227331734682, 0.08277205930127012, 0.08428209157569365, 0.086000331194582, 0.08791289682640181, 0.09000453987219123, 0.0922591009175239, 0.09465992519425476, 0.0971902234041213, 0.09983337194886853 ], [ 0.14318205568587208, 0.1410140835360929, 0.13884294870963576, 0.1366707853355871, 0.13449947208448215, 0.1323306141818487, 0.1301655367850138, 0.12800529188103188, 0.12585068061024512, 0.12370229251931245, 0.12156056270163199, 0.11942584710645676, 0.1172985155189407, 0.11517906087287212, 0.11306822270668297, 0.1109671217670798, 0.1088774020565435, 0.10680137605387273, 0.10474216843479688, 0.10270385338083625, 0.10069158045778427, 0.09871168401136832, 0.09677177098729893, 0.09488078195182055, 0.09304901980034488, 0.09128814017608236, 0.08961109703730608, 0.08803203628057704, 0.08656613014800359, 0.08522934574597808, 0.08403814289026393, 0.08300910015786614, 0.08215847377495013, 0.08150170171087943, 0.08105287439246271, 0.08082420242306196, 0.08082551865183887, 0.08106385480633944, 0.08154313008713183, 0.0822639801894135, 0.08322374125689852, 0.08441658677056368, 0.08583379952386808, 0.08746414858487767, 0.08929433435827744, 0.09130946392720724, 0.09349352284379756, 0.09582981671894049, 0.09830136443654831, 0.10089123300205775 ], [ 0.1456415062375217, 0.14353982574219534, 0.14143216326333719, 0.13932031488948535, 0.13720584780449163, 0.13509008896466707, 0.1329741244093115, 0.13085881096958843, 0.12874480188954848, 0.12663258750471582, 0.12452255164295137, 0.12241504383495885, 0.12031046677280494, 0.11820937776893944, 0.11611260228562527, 0.11402135696798908, 0.11193737906163831, 0.10986305865648803, 0.10780156988440871, 0.10575699700056394, 0.10373445116455364, 0.10174017365327635, 0.09978162111314498, 0.09786752822198856, 0.09600794272320402, 0.09421422719791879, 0.09249902120388509, 0.09087615667598664, 0.08936051901328947, 0.08796784645354469, 0.08671446163425554, 0.08561693215438675, 0.08469166185928781, 0.08395442154350731, 0.08341983636237257, 0.08310085637650118, 0.08300824462139508, 0.08315012186567342, 0.08353160697613773, 0.08415458558955925, 0.08501762801368828, 0.08611606181906231, 0.08744218833442861, 0.08898561829925068, 0.09073369261819675, 0.09267195055943883, 0.09478460950025101, 0.0970550260753981, 0.0994661165010767, 0.10200072220295357 ], [ 0.14804605236657428, 0.14600812789768966, 0.14396157129326564, 0.14190787845026678, 0.13984834190803921, 0.13778404505432798, 0.13571586621266654, 0.13364449405160117, 0.131570455516674, 0.12949415715361456, 0.1274159402729025, 0.12533614991655265, 0.12325521704988263, 0.12117375284235939, 0.11909265335447491, 0.11701321244368669, 0.11493724026935018, 0.11286718443213893, 0.1108062505318698, 0.10875851875537997, 0.10672905298092425, 0.10472399875775376, 0.1027506663277764, 0.10081759453730858, 0.09893459099114543, 0.09711274311203627, 0.09536439392694918, 0.09370307553070437, 0.09214339250562549, 0.09070084744476943, 0.08939160157644947, 0.08823216580103548, 0.08723902164041251, 0.0864281778443564, 0.08581467644643878, 0.08541207107494546, 0.08523190883742701, 0.08528325320594429, 0.08557228712523027, 0.08610203174196328, 0.0868722065732494, 0.0878792428884202, 0.0891164460654475, 0.09057428771882972, 0.0922407971417361, 0.09410201565054435, 0.09614247698985108, 0.09834568109253423, 0.10069453554790357, 0.10317174734224596 ], [ 0.15039392934837623, 0.14841741447540746, 0.14642979473212622, 0.14443230009579713, 0.1424259814713442, 0.1404117094574869, 0.13839018224931168, 0.1363619438521508, 0.13432741355895914, 0.1322869273478684, 0.1302407914957693, 0.12818934829155393, 0.12613305328777305, 0.12407256307501982, 0.12200883212420234, 0.11994321684147359, 0.11787758463789182, 0.11581442554123542, 0.11375696366894827, 0.11170926572314753, 0.1096763435292343, 0.10766424747424344, 0.10568014745520389, 0.10373239756706426, 0.10183058020117625, 0.09998552447508455, 0.09820929300794101, 0.09651513010106062, 0.09491736358109598, 0.09343125222038577, 0.0920727711689376, 0.09085832967380922, 0.0898044189479673, 0.08892719362737997, 0.08824199771055556, 0.08776285457142714, 0.08750194933450002, 0.08746913886278603, 0.08767152794056897, 0.08811314842366487, 0.08879477062689378, 0.0897138637960566, 0.0908647072223283, 0.09223863821932833, 0.09382441058062659, 0.09560862924287886, 0.09757622441902268, 0.09971093091474012, 0.10199574431265808, 0.10441333348677702 ], [ 0.15268384094850096, 0.15076656904730235, 0.1488359022565167, 0.14689283566174308, 0.14493820815596425, 0.1429727049465779, 0.14099686848107656, 0.13901111875023506, 0.13701578372485962, 0.13501114042227585, 0.1329974667899164, 0.1309751042473504, 0.1289445303610866, 0.12690644075666685, 0.12486183901905545, 0.12281213301202425, 0.12075923577266881, 0.11870566891288112, 0.11665466628014685, 0.11461027547790782, 0.1125774546910476, 0.11056216206418794, 0.10857143459188336, 0.10661345305326059, 0.10469758892290743, 0.10283442840378414, 0.10103576778893829, 0.09931457336262729, 0.09768489817704176, 0.09616174756312916, 0.09476088552088321, 0.09349857561476682, 0.09239125308980346, 0.0914551299045398, 0.0907057412327189, 0.09015745023882221, 0.0898229365440017, 0.0897127012142294, 0.08983462551320277, 0.09019362046908967, 0.09079139866619615, 0.09162638893420315, 0.09269380038351867, 0.0939858270573486, 0.09549197109510636, 0.09719945293789678, 0.09909367287649541, 0.10115868903855657, 0.10337768165221506, 0.10573338052493192 ], [ 0.15491490490122814, 0.1530548789511815, 0.151179353669735, 0.1492891173601982, 0.14738482354654708, 0.14546699653426384, 0.14353604471190667, 0.14159228237766577, 0.13963596069314677, 0.13766730814027545, 0.13568658059413086, 0.13369412083498083, 0.13169042702011888, 0.12967622933448694, 0.12765257375299036, 0.1256209115886088, 0.1235831932764339, 0.12154196465519869, 0.11950046384669429, 0.11746271668174503, 0.11543362845113109, 0.11341906953454532, 0.11142595213878531, 0.10946229491750772, 0.10753727161870368, 0.10566123910487973, 0.10384573914524652, 0.10210346737561594, 0.10044820192086172, 0.09889468362395439, 0.09745843995845085, 0.09615554591359644, 0.09500231782952064, 0.09401494061795722, 0.093209035077787, 0.09259917974927996, 0.09219841007871447, 0.09201772521552416, 0.09206563785696543, 0.09234780359071051, 0.09286676214751581, 0.09362181387485537, 0.0946090417920907, 0.09582147498942666, 0.09724937550166185, 0.09888062043176127, 0.1007011454281048, 0.10269541489155913, 0.10484688774104348, 0.10713845380859917 ], [ 0.15708660285737688, 0.15528198473765162, 0.15345994928029674, 0.15162110350140606, 0.14976593958317588, 0.14789484291626118, 0.14600810725197647, 0.1441059576082383, 0.14218858141147905, 0.14025616816102282, 0.1383089576790585, 0.1363472967673919, 0.1343717038421095, 0.13238294087033037, 0.13038209169970041, 0.1283706456592429, 0.1263505851232295, 0.12432447556579662, 0.12229555648342864, 0.12026783140742026, 0.11824615504318882, 0.11623631532522243, 0.11424510782964077, 0.11228039950634316, 0.11035117805515733, 0.10846758247080457, 0.10664090934985396, 0.10488358856868919, 0.10320912105018856, 0.10163197076134513, 0.10016740312610055, 0.09883126305803637, 0.09763968818610484, 0.09660875685194745, 0.09575407618193443, 0.09509032271538839, 0.09463075597866363, 0.0943867328353933, 0.09436725588741827, 0.09457859111097401, 0.09502398718926128, 0.09570352141545801, 0.09661408545926385, 0.0977495105762162, 0.09910081839102416, 0.10065657249433627, 0.10240329934308212, 0.10432594490219124, 0.10640833565393179, 0.10863361786806892 ], [ 0.15919873450686908, 0.15744783401461654, 0.1556777838182642, 0.1538890328033886, 0.15208193353853727, 0.1502567523248791, 0.1484136857751458, 0.14655288445313133, 0.1446744839627979, 0.14277864370740972, 0.1408655933499537, 0.13893568680369237, 0.13698946337440804, 0.1350277154722791, 0.13305156211842828, 0.1310625272942075, 0.1290626220209166, 0.1270544289100231, 0.12504118777839074, 0.12302688076264155, 0.12101631516772858, 0.11901520201857983, 0.11703022791912358, 0.11506911733170948, 0.11314068175246103, 0.11125485147386809, 0.10942268472478293, 0.10765634803415998, 0.10596906081083723, 0.10437499656893687, 0.10288913322875808, 0.10152704581258064, 0.10030463697143757, 0.09923780439532252, 0.0983420493739578, 0.09763203738628537, 0.09712112899756403, 0.09682090649337254, 0.0967407272106322, 0.09688733700278288, 0.09726457558799155, 0.09787319928796893, 0.09871083645986486, 0.09977207829231102, 0.10104869471855295, 0.10252995417842015, 0.1042030184986104, 0.10605338102875517, 0.10806531718672327, 0.11022232080969498 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.418922483921051, 0.7489663353189826, 0.9175414154306054, 0.836055213585496, 0.5619917679578066, 0.8601006800308824, 0.42246860258480784, 0.3917907946478747, 0.3552636532547427, 0.44023316686813885, 0.4869581265629504, 0.5285282404345163, 0.5662384775757455, 0.6012200734178804, 0.6312552806711759, 0.6680394718407605, 0.5927728376599184, 0.6325301570101926, 0.6155384398304714, 0.6114363596688676, 0.6076726139121951, 0.5747567790881314, 0.6863992579002999, 0.5130402421432112 ], "xaxis": "x", "y": [ 0.30106499791145325, 0.30020284093916416, 0.5524859102442861, 0.956141204573214, 0.5208647614344954, 0.11638592090457678, 0.3537590786602953, 0.36016912296891335, 0.3779962030951745, 0.3528169487294001, 0.34427516258844604, 0.325474674849598, 0.2946908462092118, 0.25966889809465993, 0.21618524177617784, 0.1832921974853861, 0.17163701016642643, 0.24331884663575465, 0.2816034818229741, 0.32969717907023227, 0.25400511686048505, 0.2051239070473167, 0.20014073566423962, 0.23083124075118483 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.418922483921051, 0.7489663353189826, 0.9175414154306054, 0.836055213585496, 0.5619917679578066, 0.8601006800308824, 0.42246860258480784, 0.3917907946478747, 0.3552636532547427, 0.44023316686813885, 0.4869581265629504, 0.5285282404345163, 0.5662384775757455, 0.6012200734178804, 0.6312552806711759, 0.6680394718407605, 0.5927728376599184, 0.6325301570101926, 0.6155384398304714, 0.6114363596688676, 0.6076726139121951, 0.5747567790881314, 0.6863992579002999, 0.5130402421432112 ], "xaxis": "x2", "y": [ 0.30106499791145325, 0.30020284093916416, 0.5524859102442861, 0.956141204573214, 0.5208647614344954, 0.11638592090457678, 0.3537590786602953, 0.36016912296891335, 0.3779962030951745, 0.3528169487294001, 0.34427516258844604, 0.325474674849598, 0.2946908462092118, 0.25966889809465993, 0.21618524177617784, 0.1832921974853861, 0.17163701016642643, 0.24331884663575465, 0.2816034818229741, 0.32969717907023227, 0.25400511686048505, 0.2051239070473167, 0.20014073566423962, 0.23083124075118483 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": { "collapsed": true }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.3555929319219581, -0.368226970745379, -0.368226970745379, -0.47228101709396014, -0.5628944869318891, -0.701925631772709, -1.0055045632989008, -1.4148723810146537, -1.753080444415976, -1.753080444415976, -1.753080444415976, -2.1847721683636694, -2.6462794767130706, -2.6462794767130706, -2.9416145956615822, -3.0144325354400805, -3.0144325354400805, -3.172584342193771, -3.172584342193771 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.49872928857803345
x2: 0.15240246057510376
x3: 0.418922483921051
x4: 0.30106499791145325
x5: 0.6570462584495544
x6: 0.3972053527832031", "
Parameterization:
x1: 0.13194097392261028
x2: 0.9810726530849934
x3: 0.7489663353189826
x4: 0.30020284093916416
x5: 0.5970249082893133
x6: 0.9130386551842093", "
Parameterization:
x1: 0.8315052930265665
x2: 0.09178435429930687
x3: 0.9175414154306054
x4: 0.5524859102442861
x5: 0.9821475706994534
x6: 0.05153212137520313", "
Parameterization:
x1: 0.21781443897634745
x2: 0.5230371272191405
x3: 0.836055213585496
x4: 0.956141204573214
x5: 0.3507652347907424
x6: 0.5950704226270318", "
Parameterization:
x1: 0.16873736307024956
x2: 0.1923519130796194
x3: 0.5619917679578066
x4: 0.5208647614344954
x5: 0.8091549808159471
x6: 0.8482888713479042", "
Parameterization:
x1: 0.17625166848301888
x2: 0.4650226552039385
x3: 0.8601006800308824
x4: 0.11638592090457678
x5: 0.8879129178822041
x6: 0.6623590728268027", "
Parameterization:
x1: 0.4144163417431746
x2: 0.14348375860028056
x3: 0.42246860258480784
x4: 0.3537590786602953
x5: 0.7081720560531429
x6: 0.5441426650094909", "
Parameterization:
x1: 0.38097046748268004
x2: 0.1296407806269
x3: 0.3917907946478747
x4: 0.36016912296891335
x5: 0.7125524475247846
x6: 0.62707598798752", "
Parameterization:
x1: 0.3379871796888515
x2: 0.1928284956116473
x3: 0.3552636532547427
x4: 0.3779962030951745
x5: 0.7734122228704065
x6: 0.5852792149060819", "
Parameterization:
x1: 0.4098237031259022
x2: 0.08417571977898308
x3: 0.44023316686813885
x4: 0.3528169487294001
x5: 0.6746755707975396
x6: 0.6439618122354255", "
Parameterization:
x1: 0.4335890115379974
x2: 0.02240009329121775
x3: 0.4869581265629504
x4: 0.34427516258844604
x5: 0.6385219605148978
x6: 0.6834144051160477", "
Parameterization:
x1: 0.45015470465485763
x2: 4.515059793899048e-16
x3: 0.5285282404345163
x4: 0.325474674849598
x5: 0.5986613090137507
x6: 0.7132262333409654", "
Parameterization:
x1: 0.4645848639096352
x2: 0.006333033566768968
x3: 0.5662384775757455
x4: 0.2946908462092118
x5: 0.5395083554884755
x6: 0.7361599404069147", "
Parameterization:
x1: 0.4728848127789459
x2: 0.025698324991664533
x3: 0.6012200734178804
x4: 0.25966889809465993
x5: 0.46935413812621657
x6: 0.7633966871964928", "
Parameterization:
x1: 0.4825069897430853
x2: 0.044943069697356834
x3: 0.6312552806711759
x4: 0.21618524177617784
x5: 0.38026670826441966
x6: 0.7927736538954496", "
Parameterization:
x1: 0.4732592414541781
x2: 0.053728659895273506
x3: 0.6680394718407605
x4: 0.1832921974853861
x5: 0.3042731480452938
x6: 0.8340766854164782", "
Parameterization:
x1: 0.5731254707267917
x2: 0.063017484030048
x3: 0.5927728376599184
x4: 0.17163701016642643
x5: 0.3555037719492684
x6: 0.7745686987092428", "
Parameterization:
x1: 0.43966368135103484
x2: 0.04183939206189174
x3: 0.6325301570101926
x4: 0.24331884663575465
x5: 0.3380257365476385
x6: 0.7598033654010803", "
Parameterization:
x1: 0.3750622273843812
x2: 0.050494236159714656
x3: 0.6155384398304714
x4: 0.2816034818229741
x5: 0.2795348136924278
x6: 0.6833038694248315", "
Parameterization:
x1: 0.36480936275141973
x2: 0.0058982881747641665
x3: 0.6114363596688676
x4: 0.32969717907023227
x5: 0.216352300823613
x6: 0.6435299442656406", "
Parameterization:
x1: 0.31317725025025467
x2: 0.1234118625132671
x3: 0.6076726139121951
x4: 0.25400511686048505
x5: 0.28626340440861603
x6: 0.6540459059666863", "
Parameterization:
x1: 0.2397501380328812
x2: 0.11173662330548965
x3: 0.5747567790881314
x4: 0.2051239070473167
x5: 0.28948789027499905
x6: 0.6348924638004136", "
Parameterization:
x1: 0.24074675141585142
x2: 0.11950141776975445
x3: 0.6863992579002999
x4: 0.20014073566423962
x5: 0.30533216843309324
x6: 0.6067054082955071", "
Parameterization:
x1: 0.2534931500682824
x2: 0.1536945586652028
x3: 0.5130402421432112
x4: 0.23083124075118483
x5: 0.2828253469672484
x6: 0.6698187221680083", "
Parameterization:
x1: 0.27772858920443755
x2: 0.17917879853721402
x3: 0.4332387254221126
x4: 0.21239291256688209
x5: 0.270407785869818
x6: 0.6379211837500486" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.3555929319219581, -0.368226970745379, -0.368226970745379, -0.47228101709396014, -0.5628944869318891, -0.701925631772709, -1.0055045632989008, -1.4148723810146537, -1.753080444415976, -1.753080444415976, -1.753080444415976, -2.1847721683636694, -2.6462794767130706, -2.6462794767130706, -2.9416145956615822, -3.0144325354400805, -3.0144325354400805, -3.172584342193771, -3.172584342193771 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.2668232848275128, -0.3555929319219581, -0.368226970745379, -0.368226970745379, -0.47228101709396014, -0.5628944869318891, -0.701925631772709, -1.0055045632989008, -1.4148723810146537, -1.753080444415976, -1.753080444415976, -1.753080444415976, -2.1847721683636694, -2.6462794767130706, -2.6462794767130706, -2.9416145956615822, -3.0144325354400805, -3.0144325354400805, -3.172584342193771, -3.172584342193771 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] }, { "line": { "color": "rgba(141,211,199,1)", "dash": "dash" }, "mode": "lines", "name": "model change", "type": "scatter", "x": [ 6, 6 ], "y": [ -3.32237, -0.2668232848275128 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:44] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:45] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:45] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.19, 'x2': 0.15, 'x3': 0.49, 'x4': 0.26, 'x5': 0.29, 'x6': 0.69}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.modelbridge.dispatch_utils: Using GPEI (Bayesian optimization) since there are more continuous parameters than there are categories for the unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 06-30 21:21:52] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.10" } }, "nbformat": 4, "nbformat_minor": 2 }