{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ipy_plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.utils.dispatch: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 arms, GPEI for subsequent arms], generated 0 arm(s) so far). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.04, 'x2': 0.45, 'x3': 0.49, 'x4': 0.94, 'x5': 0.04, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.05, 0.0), 'l2norm': (1.32, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.29, 'x2': 0.6, 'x3': 0.17, 'x4': 0.49, 'x5': 0.48, 'x6': 0.11}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-1.16, 0.0), 'l2norm': (0.98, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.85, 'x2': 0.12, 'x3': 0.87, 'x4': 0.71, 'x5': 0.64, 'x6': 0.93}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.05, 0.0), 'l2norm': (1.81, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.89, 'x2': 0.73, 'x3': 0.27, 'x4': 0.08, 'x5': 0.29, 'x6': 0.8}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.14, 0.0), 'l2norm': (1.46, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.47, 'x2': 0.25, 'x3': 0.69, 'x4': 0.86, 'x5': 0.57, 'x6': 0.23}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.04, 0.0), 'l2norm': (1.37, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.21, 'x2': 0.83, 'x3': 0.89, 'x4': 0.31, 'x5': 0.88, 'x6': 0.52}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:38] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.06, 0.0), 'l2norm': (1.63, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:48] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.31, 'x2': 0.63, 'x3': 0.05, 'x4': 0.45, 'x5': 0.47, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:48] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-1.33, 0.0), 'l2norm': (0.96, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:58] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.23, 'x2': 0.72, 'x3': 0.02, 'x4': 0.45, 'x5': 0.46, 'x6': 0.01}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:46:58] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-1.2, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:07] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.29, 'x2': 0.53, 'x3': 0.02, 'x4': 0.37, 'x5': 0.5, 'x6': 0.02}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:07] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.6, 0.0), 'l2norm': (0.87, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:16] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.35, 'x2': 0.67, 'x3': 0.05, 'x4': 0.5, 'x5': 0.44, 'x6': 0.1}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:16] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-1.87, 0.0), 'l2norm': (1.01, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:26] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.4, 'x2': 0.73, 'x3': 0.02, 'x4': 0.55, 'x5': 0.41, 'x6': 0.12}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:26] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-2.32, 0.0), 'l2norm': (1.09, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:38] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.45, 'x2': 0.81, 'x3': 0.0, 'x4': 0.6, 'x5': 0.39, 'x6': 0.15}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:38] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-2.42, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:50] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.47, 'x2': 0.76, 'x3': 0.02, 'x4': 0.56, 'x5': 0.3, 'x6': 0.12}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:47:50] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-2.32, 0.0), 'l2norm': (1.11, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:04] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.43, 'x2': 0.8, 'x3': 0.0, 'x4': 0.53, 'x5': 0.39, 'x6': 0.2}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:04] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-2.0, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:18] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.44, 'x2': 0.78, 'x3': 0.0, 'x4': 0.64, 'x5': 0.4, 'x6': 0.09}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:18] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-2.5, 0.0), 'l2norm': (1.18, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:29] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.37, 'x2': 0.77, 'x3': 0.0, 'x4': 0.67, 'x5': 0.34, 'x6': 0.12}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:29] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-2.32, 0.0), 'l2norm': (1.14, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:41] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.46, 'x2': 0.84, 'x3': 0.0, 'x4': 0.6, 'x5': 0.41, 'x6': 0.08}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:41] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.77, 0.0), 'l2norm': (1.2, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:59] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.45, 'x2': 0.91, 'x3': 0.0, 'x4': 0.56, 'x5': 0.41, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:48:59] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.91, 0.0), 'l2norm': (1.23, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:16] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.44, 'x2': 0.93, 'x3': 0.08, 'x4': 0.56, 'x5': 0.39, 'x6': 0.06}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:16] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.94, 0.0), 'l2norm': (1.23, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:32] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.49, 'x2': 0.91, 'x3': 0.07, 'x4': 0.52, 'x5': 0.41, 'x6': 0.04}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:32] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.62, 0.0), 'l2norm': (1.23, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:35] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.66, 'x2': 0.04, 'x3': 0.47, 'x4': 0.21, 'x5': 0.9, 'x6': 0.35}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:35] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.28, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:49] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.41, 'x2': 0.94, 'x3': 0.04, 'x4': 0.59, 'x5': 0.37, 'x6': 0.07}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:49] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.96, 0.0), 'l2norm': (1.24, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:53] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.02, 'x2': 0.62, 'x3': 0.06, 'x4': 0.74, 'x5': 0.6, 'x6': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:53] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-0.03, 0.0), 'l2norm': (1.3, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:56] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.91, 'x2': 0.99, 'x3': 0.78, 'x4': 0.17, 'x5': 0.32, 'x6': 0.98}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:49:56] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-0.05, 0.0), 'l2norm': (1.87, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:05] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.42, 'x2': 0.92, 'x3': 0.06, 'x4': 0.57, 'x5': 0.41, 'x6': 0.08}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:05] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.96, 0.0), 'l2norm': (1.24, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To view all trials in a data frame at any point during optimization:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/travis/virtualenv/python3.6.7/lib/python3.6/site-packages/pandas/core/reshape/merge.py:617: UserWarning:\n", "\n", "merging between different levels can give an unintended result (2 levels on the left, 1 on the right)\n", "\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
arm_namehartmann6l2normtrial_indexx1x2x3x4x5x6
00_0-0.04842691.3185800.0411490.4494234.941352e-010.9350550.0409360.644046
31_0-1.159460.97646310.2857680.6002161.663477e-010.4891050.4831870.105788
152_0-0.0527961.8053220.8522160.1160158.710344e-010.7052580.6370390.926026
183_0-0.1394361.4598330.8920990.7307852.660937e-010.0843080.2887320.799951
194_0-0.04164811.3666540.4663430.2460966.893221e-010.8599990.5675880.229698
205_0-0.05561831.6340350.2060990.8346368.930215e-010.3056820.8770380.520411
216_0-1.328370.95685360.3067560.6267195.016168e-020.4481830.4705060.062703
227_0-1.200790.99063370.2250500.7188861.995630e-020.4459960.4631940.006988
238_0-0.5982850.86519680.2880640.5274121.693621e-020.3692130.5005010.017689
249_0-1.865371.0134490.3494520.6720304.723547e-020.4970910.4415500.095014
110_0-2.323421.08563100.4013230.7339012.049776e-020.5458370.4066740.123212
211_0-2.417511.17863110.4451160.8102740.000000e+000.6028130.3869210.146278
412_0-2.316141.10765120.4717920.7631031.697528e-020.5612360.3026240.122960
513_0-1.997981.14318130.4324370.8029384.435467e-030.5323400.3898080.199458
614_0-2.504251.17796140.4436280.7799111.869401e-160.6447950.3976120.093039
715_0-2.321731.14409150.3739970.7716761.026428e-160.6663680.3410200.115092
816_0-2.765071.20058160.4593690.8373570.000000e+000.5950890.4097530.084675
917_0-2.914441.22892170.4486180.9071578.626423e-040.5620550.4074620.064273
1018_0-2.940721.23394180.4416150.9258537.530165e-020.5581000.3868830.059623
1119_0-2.623451.23357190.4907220.9122906.540343e-020.5230370.4113000.040055
1220_0-0.02865951.27978200.6629440.0406984.689431e-010.2055430.9023620.346805
1321_0-2.961161.23918210.4064770.9386094.138984e-020.5861650.3736350.066750
1422_0-0.03180741.30305220.0201230.6221165.737688e-020.7384010.6004140.633616
1623_0-0.04517381.87454230.9122730.9893367.780936e-010.1745730.3226040.981276
1724_0-2.959391.23744240.4155690.9248136.458696e-020.5678840.4130130.077715
\n", "
" ], "text/plain": [ " arm_name hartmann6 l2norm trial_index x1 x2 \\\n", "0 0_0 -0.0484269 1.31858 0 0.041149 0.449423 \n", "3 1_0 -1.15946 0.976463 1 0.285768 0.600216 \n", "15 2_0 -0.052796 1.80532 2 0.852216 0.116015 \n", "18 3_0 -0.139436 1.45983 3 0.892099 0.730785 \n", "19 4_0 -0.0416481 1.36665 4 0.466343 0.246096 \n", "20 5_0 -0.0556183 1.63403 5 0.206099 0.834636 \n", "21 6_0 -1.32837 0.956853 6 0.306756 0.626719 \n", "22 7_0 -1.20079 0.990633 7 0.225050 0.718886 \n", "23 8_0 -0.598285 0.865196 8 0.288064 0.527412 \n", "24 9_0 -1.86537 1.01344 9 0.349452 0.672030 \n", "1 10_0 -2.32342 1.08563 10 0.401323 0.733901 \n", "2 11_0 -2.41751 1.17863 11 0.445116 0.810274 \n", "4 12_0 -2.31614 1.10765 12 0.471792 0.763103 \n", "5 13_0 -1.99798 1.14318 13 0.432437 0.802938 \n", "6 14_0 -2.50425 1.17796 14 0.443628 0.779911 \n", "7 15_0 -2.32173 1.14409 15 0.373997 0.771676 \n", "8 16_0 -2.76507 1.20058 16 0.459369 0.837357 \n", "9 17_0 -2.91444 1.22892 17 0.448618 0.907157 \n", "10 18_0 -2.94072 1.23394 18 0.441615 0.925853 \n", "11 19_0 -2.62345 1.23357 19 0.490722 0.912290 \n", "12 20_0 -0.0286595 1.27978 20 0.662944 0.040698 \n", "13 21_0 -2.96116 1.23918 21 0.406477 0.938609 \n", "14 22_0 -0.0318074 1.30305 22 0.020123 0.622116 \n", "16 23_0 -0.0451738 1.87454 23 0.912273 0.989336 \n", "17 24_0 -2.95939 1.23744 24 0.415569 0.924813 \n", "\n", " x3 x4 x5 x6 \n", "0 4.941352e-01 0.935055 0.040936 0.644046 \n", "3 1.663477e-01 0.489105 0.483187 0.105788 \n", "15 8.710344e-01 0.705258 0.637039 0.926026 \n", "18 2.660937e-01 0.084308 0.288732 0.799951 \n", "19 6.893221e-01 0.859999 0.567588 0.229698 \n", "20 8.930215e-01 0.305682 0.877038 0.520411 \n", "21 5.016168e-02 0.448183 0.470506 0.062703 \n", "22 1.995630e-02 0.445996 0.463194 0.006988 \n", "23 1.693621e-02 0.369213 0.500501 0.017689 \n", "24 4.723547e-02 0.497091 0.441550 0.095014 \n", "1 2.049776e-02 0.545837 0.406674 0.123212 \n", "2 0.000000e+00 0.602813 0.386921 0.146278 \n", "4 1.697528e-02 0.561236 0.302624 0.122960 \n", "5 4.435467e-03 0.532340 0.389808 0.199458 \n", "6 1.869401e-16 0.644795 0.397612 0.093039 \n", "7 1.026428e-16 0.666368 0.341020 0.115092 \n", "8 0.000000e+00 0.595089 0.409753 0.084675 \n", "9 8.626423e-04 0.562055 0.407462 0.064273 \n", "10 7.530165e-02 0.558100 0.386883 0.059623 \n", "11 6.540343e-02 0.523037 0.411300 0.040055 \n", "12 4.689431e-01 0.205543 0.902362 0.346805 \n", "13 4.138984e-02 0.586165 0.373635 0.066750 \n", "14 5.737688e-02 0.738401 0.600414 0.633616 \n", "16 7.780936e-01 0.174573 0.322604 0.981276 \n", "17 6.458696e-02 0.567884 0.413013 0.077715 " ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax.get_trials_data_frame().sort_values('trial_index')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.4064773338609024,\n", " 'x2': 0.938608765232727,\n", " 'x3': 0.04138983684782125,\n", " 'x4': 0.5861650473548686,\n", " 'x5': 0.3736346402677701,\n", " 'x6': 0.06674968638342735}" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.9611594090792632, 'l2norm': 1.239180918514228}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:05] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -0.13345356705041422, -0.12834832841962718, -0.12341157398535563, -0.11868489475953603, -0.114209410937133, -0.11002482105941858, -0.1061683859707605, -0.10267389025300044, -0.09957063501781382, -0.09688252459649882, -0.09462731389867551, -0.09281608123470875, -0.09145298192827522, -0.09053532071715886, -0.09005395664114246, -0.08999402513305377, -0.0903359318873842, -0.09105654603350843, -0.092130500376018, -0.09353149719626863, -0.09523352079354797, -0.09721187188372227, -0.09944396145566237, -0.10190982866744136, -0.10459237449461245, -0.10747732651302999, -0.11055296826958205, -0.1138096786831937, -0.11723933363718975, -0.12083462476719808, -0.12458835065349994, -0.12849273379441417, -0.1325388127680065, -0.1367159523889634, -0.14101150504122817, -0.14541064386237856, -0.14989637396575906, -0.15444971294574117, -0.15905001834607058, -0.16367542924758371, -0.16830338277233103, -0.1729111644805199, -0.17747645399057754, -0.18197783276103197, -0.18639522862691438, -0.1907102801520777, -0.19490661208955862, -0.19897002047281065, -0.20288857164662533, -0.20665262372639215 ], [ -0.1319968902176718, -0.12695190891032948, -0.12209733804571443, -0.11747647102911318, -0.11313188762672599, -0.10910440727772652, -0.10543196862567794, -0.10214848262895693, -0.099282719864765, -0.09685730326371189, -0.09488788325055642, -0.09338257091976265, -0.09234169475530396, -0.09175792686018625, -0.09161679652841936, -0.0918975748219244, -0.09257447773675698, -0.09361810268998028, -0.0949969886162132, -0.09667917803619197, -0.09863366206870983, -0.1008316058780665, -0.10324727931968414, -0.10585865065228384, -0.10864763470440053, -0.11160001619515891, -0.11470509114688965, -0.11795508368007024, -0.12134440282768821, -0.12486880609221096, -0.1285245350123998, -0.1323074840796803, -0.13621245821081973, -0.14023256538328588, -0.14435877969144717, -0.1485796961661343, -0.152881483100878, -0.15724802185534847, -0.16166120995829392, -0.16610139244859612, -0.17054787986732167, -0.17497950948800578, -0.1793752088467202, -0.18371452645056197, -0.18797810245935942, -0.19214806088933023, -0.19620831340301748, -0.20014477224870952, -0.20394547593963508, -0.20760063565225795 ], [ -0.13087468070148445, -0.1259223472162032, -0.12118458380235486, -0.11670637779692306, -0.1125317235841794, -0.10870247199536265, -0.10525709629407687, -0.1022294270720785, -0.09964742398726512, -0.09753206521038349, -0.09589644304683698, -0.09474515376639192, -0.09407405901995891, -0.09387047431845641, -0.09411380761353771, -0.09477663086568411, -0.09582612442514327, -0.09722579425715794, -0.09893733191058418, -0.10092247187367187, -0.10314470333129644, -0.1055707128483232, -0.10817146748338735, -0.11092288833299113, -0.11380610578813344, -0.11680732398082982, -0.11991734921619779, -0.12313085438454552, -0.1264454593626454, -0.12986070841380415, -0.13337702190482226, -0.1369946929516157, -0.14071299063990095, -0.14452942030324323, -0.14843917786112804, -0.15243481964935013, -0.1565061523694069, -0.16064033119087218, -0.16482213938857382, -0.16903441175832845, -0.17325855746688856, -0.17747513624642108, -0.18166444450034036, -0.18580707395343965, -0.18988441368280418, -0.19387907542248572, -0.1977752308504388, -0.201558857349309, -0.20521789501941923, -0.20874232234116508 ], [ -0.1301207855084383, -0.12529661293151118, -0.12071357577484543, -0.11641833541855795, -0.11245624027663248, -0.10887006281774325, -0.10569864242900029, -0.10297549168138986, -0.10072744182981808, -0.09897341901661849, -0.09772345252084236, -0.09697801722475541, -0.09672780145459048, -0.09695396696999325, -0.09762893064160272, -0.09871765032757773, -0.10017934621465607, -0.10196954082352816, -0.10404226385126147, -0.10635224862929116, -0.10885694889601649, -0.1115182275558404, -0.11430360887440849, -0.11718703494815763, -0.12014911796372374, -0.12317692430643157, -0.12626336004301786, -0.1294062478892788, -0.13260719446522984, -0.13587034612426785, -0.13920112499854165, -0.14260502658391516, -0.14608654758826312, -0.1496482983759886, -0.15329033826068628, -0.15700975440449905, -0.16080048697715021, -0.16465338584902622, -0.168556469046109, -0.17249534194062166, -0.1764537296346662, -0.18041407343995663, -0.184358145276468, -0.18826764018273723, -0.19212471565666034, -0.19591245592858453, -0.19961524840297673, -0.20321906759050612, -0.20671166841829902, -0.21008269567537496 ], [ -0.1297697250738601, -0.12511244914340502, -0.12072545974297344, -0.11665705982259866, -0.11295387400754264, -0.10965946437285656, -0.10681284018031256, -0.10444692461324667, -0.10258706281801588, -0.10124967432657495, -0.1004411655553783, -0.10015722059206, -0.1003825773503455, -0.10109136923165085, -0.10224806987912594, -0.10380902371537548, -0.10572448414575586, -0.10794102341466605, -0.11040413275239747, -0.11306080694147069, -0.11586190863676937, -0.11876413476005698, -0.12173145515635042, -0.1247359537655861, -0.12775806456707572, -0.13078624916819992, -0.1338162037528161, -0.13684970767018179, -0.13989323526767716, -0.1429564499744691, -0.14605068915652275, -0.14918753332407442, -0.15237753609117188, -0.15562917290270284, -0.15894804733572943, -0.16233637408050638, -0.1657927382199058, -0.1693121123252086, -0.17288609759148343, -0.1765033440413637, -0.18015009854773667, -0.18381082820015604, -0.18746886982467825, -0.19110706321006354, -0.19470833448759395, -0.19825620585171255, -0.2017352172850586, -0.20513125435976653, -0.20843178305170484, -0.21162599764421897 ], [ -0.12985645048995975, -0.12540811020771137, -0.12126198065096672, -0.11746796018529193, -0.11407385303180773, -0.11112385452780482, -0.10865691733053917, -0.10670506728709483, -0.10529176231002002, -0.10443040995926367, -0.10412317533711302, -0.10436021561521547, -0.1051194665933255, -0.10636707716086713, -0.10805853913006391, -0.11014049605348242, -0.11255314268862726, -0.11523305723372679, -0.11811625309575557, -0.12114120616193524, -0.12425161370854854, -0.12739867272977934, -0.1305427229582663, -0.13365417271104651, -0.1367137013058335, -0.13971179848656834, -0.14264775092289117, -0.1455282150218078, -0.14836552511015988, -0.1511758806341439, -0.15397754059557145, -0.15678913267843186, -0.15962816165025773, -0.16250977837658387, -0.16544584787559113, -0.16844433264115266, -0.17150898653763624, -0.17463933584976266, -0.17783090871724938, -0.18107566326485358, -0.18436255889956454, -0.18767821451420708, -0.1910076011093078, -0.19433472354608883, -0.19764325546192074, -0.20091710151355002, -0.2041408709582868, -0.20730025533613894, -0.2103823101995106, -0.21337564626648597 ], [ -0.13041606541726303, -0.12622206007349024, -0.12236515673203763, -0.11889678834917339, -0.11586582184085747, -0.11331690315561516, -0.11128866916623403, -0.10981190096536109, -0.10890772146009775, -0.10858596661428921, -0.1088438794823745, -0.10966528368945982, -0.11102038273315706, -0.11286629941128323, -0.11514841489453276, -0.11780249294297307, -0.12075748987822332, -0.12393886762768491, -0.1272721597861024, -0.1306865021770396, -0.13411783812035405, -0.13751154569337176, -0.1408243032102341, -0.1440250973164785, -0.14709537000032769, -0.15002838192815515, -0.15282792949951363, -0.15550658743966328, -0.15808365880221942, -0.16058300507018952, -0.16303090733120462, -0.1654540814798493, -0.16787794057206362, -0.17032516838319678, -0.17281464099904476, -0.1753607082955031, -0.17797282478138765, -0.1806555000920267, -0.18340852424731824, -0.1862274124027985, -0.18910400865841326, -0.19202718844177613, -0.19498360338488308, -0.19795842037084577, -0.20093601623506263, -0.20390060017660128, -0.20683674617895864, -0.20972982685966768, -0.21256634769020688, -0.21533418626417822 ], [ -0.1314835118514266, -0.12759262997642784, -0.1240769082749742, -0.12098923796952632, -0.11837941013428521, -0.1162923104844864, -0.11476596582991117, -0.11382952277725278, -0.11350127161509938, -0.11378685938446087, -0.11467786048946071, -0.11615088421546482, -0.11816738942918636, -0.12067434225711238, -0.1236057908529089, -0.1268853458691408, -0.13042945538690898, -0.13415126355116458, -0.13796476043069927, -0.1417888828323992, -0.14555122261041453, -0.14919104244620773, -0.15266138163901566, -0.1559301409144609, -0.1589801466119698, -0.1618082928199185, -0.16442393213252227, -0.1668467259899833, -0.16910417540276645, -0.17122903866962425, -0.17325681306095975, -0.17522342048145467, -0.1771631988998199, -0.17910726538509847, -0.18108228443513252, -0.18310964729119705, -0.1852050441343498, -0.18737839161832648, -0.18963406349242717, -0.19197136251894698, -0.19438516766929048, -0.19686669143473057, -0.19940428727899429, -0.20198425568462097, -0.20459160761648243, -0.2072107552831699, -0.20982611075213153, -0.21242258248621337, -0.21498596774867873, -0.2175032448831955 ], [ -0.13309321949156616, -0.12955763492242367, -0.1264386400746922, -0.12379049200238845, -0.12166374462445462, -0.1201032826828401, -0.11914619130243698, -0.11881954783934989, -0.11913825942281742, -0.1201031058189026, -0.12169917687886245, -0.1238949091601238, -0.12664191908223743, -0.1298757933488639, -0.13351792829780185, -0.13747841145666762, -0.14165982144146505, -0.1459617037776919, -0.15028538137486125, -0.15453869930933872, -0.1586402979100825, -0.16252305903881803, -0.1661364692523335, -0.16944777184104676, -0.17244191423827404, -0.17512041568926984, -0.17749936620993734, -0.17960681455825012, -0.18147981185666096, -0.18316135672251987, -0.18469744821627065, -0.186134405077655, -0.18751656149420248, -0.18888440571536957, -0.19027319013760624, -0.19171201029539708, -0.19322332509298712, -0.19482287120238606, -0.1965199106749922, -0.1983177424457725, -0.20021440542932467, -0.20220350289332623, -0.20427508394778782, -0.20641652720116244, -0.2086133826501242, -0.2108501394670328, -0.21311089849172782, -0.2153799381628949, -0.21764217087943227, -0.21988349317870592 ], [ -0.1352787191503484, -0.13215394912163325, -0.12949077738366443, -0.12734471794860158, -0.1257669026360697, -0.1248019431525258, -0.12448561197821983, -0.12484243492337588, -0.12588332960761917, -0.12760346603180728, -0.1299805611071181, -0.13297383956290232, -0.13652388912976732, -0.14055359950817525, -0.14497029776080472, -0.14966907998337153, -0.1545372020985729, -0.15945925172559772, -0.1643227038683095, -0.16902339048559667, -0.17347040522178347, -0.1775900242724464, -0.1813283425093708, -0.18465247833673448, -0.18755036272330106, -0.19002926994975766, -0.19211334984650041, -0.19384047479134892, -0.19525872167045333, -0.19642277962009946, -0.1973905225306385, -0.19821992434085645, -0.19896643517648172, -0.1996808833412247, -0.20040792440115185, -0.20118502412857064, -0.2020419358839407, -0.20300061400388003, -0.20407549211767684, -0.20527404850823494, -0.2065975792141268, -0.20804210293740977, -0.20959932911782797, -0.21125763066130632, -0.21300297455716044, -0.21481977581317224, -0.21669165178671834, -0.2186020643618105, -0.22053484607105878, -0.2224746130074544 ], [ -0.1380722214652783, -0.13541704141809352, -0.1332722561234534, -0.13169451125732556, -0.13073530748526596, -0.13043867904549122, -0.13083867384566217, -0.13195673416730114, -0.1337991234005529, -0.13635459236267033, -0.13959252132443867, -0.14346180068413905, -0.14789071240403384, -0.15278803475777059, -0.15804550793682215, -0.1635416692912166, -0.16914690720088, -0.17472941556680444, -0.18016158754755196, -0.18532629815070223, -0.190122512618494, -0.1944697276665226, -0.19831089387242407, -0.2016136528854835, -0.2043699176177256, -0.20659399334606388, -0.20831955814918723, -0.20959588155708464, -0.21048366372561755, -0.2110508369195887, -0.21136860413229264, -0.21150791308070271, -0.21153649022723853, -0.2115164962115763, -0.2115028137898871, -0.21154194166780504, -0.21167144067322408, -0.21191986055980028, -0.21230706478364958, -0.21284486576186312, -0.21353788359399561, -0.21438454622991654, -0.21537815768982171, -0.21650797211382522, -0.21776022398570616, -0.21911907772920358, -0.2205674720725208, -0.22208784541952853, -0.22366273752764365, -0.22527526989876678 ], [ -0.1415041631167957, -0.13938047279646382, -0.13781996923491535, -0.13688028848371103, -0.13661306687231045, -0.1370614238110519, -0.1382572286033954, -0.14021825665467147, -0.14294539193734468, -0.1464200874063668, -0.15060234533641936, -0.15542951375229563, -0.16081619917858103, -0.16665555596865866, -0.17282211915322265, -0.1791762013375171, -0.18556968840626475, -0.1918528713353731, -0.19788177946286312, -0.2035253720037722, -0.20867192716154648, -0.21323405069706447, -0.21715189461845985, -0.22039439895767932, -0.22295860247160437, -0.22486727001351103, -0.22616522528053662, -0.2269148448608993, -0.22719116732821965, -0.22707701628764254, -0.2266584508752636, -0.2260207621813004, -0.2252451449336057, -0.22440609926895938, -0.22356956034244413, -0.2227917127995267, -0.22211841991832904, -0.22158518047775155, -0.22121751766777487, -0.22103170192347665, -0.22103571225995577, -0.2212303475682602, -0.2216104094604281, -0.22216589059648362, -0.22288311590594567, -0.22374579769456426, -0.2247359784181724, -0.2258348462501174, -0.22702341806176962, -0.22828309191289242 ], [ -0.1456027238283628, -0.1440753592354147, -0.14316817234661294, -0.14293963319936065, -0.14344125701447386, -0.14471487814426687, -0.14678969065739644, -0.1496791673336364, -0.1533780255981423, -0.15785947089067998, -0.16307300677534475, -0.16894314388807907, -0.17536935011589327, -0.18222754505392724, -0.18937334013298934, -0.1966470600850092, -0.20388036609665905, -0.21090406813490148, -0.2175565082451545, -0.22369176473115826, -0.229186903924246, -0.23394760352867583, -0.23791167324794693, -0.2410502646053927, -0.24336683992474684, -0.24489420945392237, -0.2456901092112067, -0.24583186541417557, -0.24541068069906324, -0.24452600426735138, -0.24328034037535207, -0.2417747330483686, -0.240105058292869, -0.23835916848147853, -0.23661486967871892, -0.23493866937329733, -0.23338520521998607, -0.23199725068074972, -0.23080618746859338, -0.22983283508601327, -0.2290885329841028, -0.22857637986124502, -0.228292546421887, -0.2282275915581391, -0.22836772640265646, -0.22869598507343958, -0.22919327436645154, -0.22983928653288888, -0.23061326922359582, -0.23149465454140983 ], [ -0.15039331860779126, -0.14952980451068099, -0.14934785342205137, -0.14990659927496752, -0.15125715699199072, -0.15343967355885657, -0.15648012888126295, -0.16038700474458167, -0.16514800229800386, -0.1707270579311695, -0.1770619755393923, -0.18406304582283095, -0.19161304134419543, -0.19956893861996683, -0.2077656087425479, -0.2160215313279854, -0.22414633783111793, -0.23194971637066097, -0.23925096481677688, -0.24588831926875931, -0.2517271549283311, -0.2566662713012948, -0.26064171468061215, -0.2636279092052789, -0.2656361988687108, -0.2667111844578889, -0.266925427654507, -0.2663731724807197, -0.26516371134033023, -0.2634149268295529, -0.2612474060170573, -0.2587793825957694, -0.25612263640080535, -0.253379380524384, -0.25064009579245816, -0.247982227182179, -0.24546963104419994, -0.24315265002713016, -0.24106868992058694, -0.2392431762448204, -0.23769077646811287, -0.23641678503680175, -0.23541858202814847, -0.23468709129429577, -0.23420817955234585, -0.23396395311689133, -0.23393392310795624, -0.23409602242411842, -0.2344274681929175, -0.2349054716610086 ], [ -0.1558980709709783, -0.1557683090160551, -0.1563860726977362, -0.15781097798771082, -0.16009343978339263, -0.16327148496257093, -0.16736729930259497, -0.17238363340426055, -0.17830026018602796, -0.18507075368675396, -0.19261993707440705, -0.20084241155095617, -0.20960260540692022, -0.21873674848526248, -0.2280570598912759, -0.23735822750242974, -0.24642597143431155, -0.25504716234086877, -0.26302067345093394, -0.2701679527556755, -0.27634226340914214, -0.28143567644390055, -0.28538318782278616, -0.2881637119898468, -0.2897980972033214, -0.2903446381023105, -0.2898927755717513, -0.2885557542789885, -0.28646296809459715, -0.28375259877242587, -0.2805649870379432, -0.2770370058079361, -0.2732975584652091, -0.26946421299973156, -0.2656409064592693, -0.2619166080613389, -0.2583648056997032, -0.2550436721123821, -0.25199676813193017, -0.24925414762005582, -0.24683373978806022, -0.24474289837975438, -0.24298002277094466, -0.24153617262505644, -0.24039661453050543, -0.2395422552395381, -0.23895093103184206, -0.23859853580567503, -0.23845998142674985, -0.23850999251963279 ], [ -0.1621352742439206, -0.1628111622436561, -0.16430528102513087, -0.16667753743701197, -0.1699773287198223, -0.17424010107128174, -0.17948362751621083, -0.18570413748009806, -0.19287250311141468, -0.20093077242252266, -0.20978942811250811, -0.2193258271322729, -0.2293843149273036, -0.2397784795902116, -0.25029588687307647, -0.26070540365997563, -0.2707668889536714, -0.28024265567671947, -0.2889097601549875, -0.29657194487095495, -0.30307001201382766, -0.3082895666556602, -0.3121654121991748, -0.31468233400037415, -0.31587247252180184, -0.3158098725137799, -0.31460303689020064, -0.3123863931212387, -0.30931151625137043, -0.30553879221940616, -0.3012300016638243, -0.29654210351166865, -0.2916223287685271, -0.28660457030813413, -0.28160697330625317, -0.2767305852440698, -0.27205890396323174, -0.26765815804656734, -0.2635781592514641, -0.2598535777364568, -0.25650550512107295, -0.2535431867778726, -0.2509658223897422, -0.24876435202520786, -0.246923163075202, -0.2454216706366117, -0.24423573967573753, -0.24333893106266835, -0.2427035650338074, -0.24230160471285767 ], [ -0.16911884943193445, -0.17067382821104982, -0.17312262664776967, -0.17652524495263378, -0.1809297305702675, -0.1863684642501502, -0.1928541526228682, -0.20037566759883108, -0.20889395059974603, -0.21833829250848313, -0.22860340010894076, -0.2395477495690146, -0.2509937796074566, -0.2627304556605403, -0.2745186063413101, -0.28609917475034363, -0.29720415174822534, -0.3075695202138071, -0.3169491295003568, -0.32512814242647115, -0.33193463771748943, -0.3372481423214406, -0.34100427834282443, -0.3431952488848684, -0.3438664365466606, -0.3431098351906092, -0.34105530572816045, -0.3378607196411625, -0.3337019587467833, -0.32876353571210504, -0.32323035313225335, -0.3172808835478824, -0.31108186123153425, -0.3047844404567157, -0.29852169066062917, -0.2924072551305372, -0.28653498373647635, -0.28097935098570415, -0.2757964807759288, -0.27102561421497917, -0.2666908744383727, -0.26280320135734936, -0.2593623490438417, -0.2563588584204042, -0.25377593743566584, -0.25159119930676144, -0.24977822609404288, -0.24830793937618334, -0.24714977183879783, -0.24627264309791452 ], [ -0.1768578095310751, -0.17936633479427977, -0.1828492624315039, -0.18736648550341517, -0.19296435914246635, -0.19967169438831633, -0.2074954478372082, -0.2164162562742138, -0.22638404797835432, -0.23731406299080948, -0.2490837259012113, -0.26153091911255544, -0.274454271745161, -0.287616067681955, -0.3007482419392038, -0.31356164932909136, -0.3257583620866267, -0.33704624412319717, -0.34715456637143616, -0.35584909749529814, -0.36294503163378744, -0.3683163424115574, -0.37190064169804393, -0.37369926267991405, -0.37377293338898276, -0.37223392236223907, -0.369235835480223, -0.36496230287570675, -0.3596156583027492, -0.3534064566529913, -0.34654437925429327, -0.3392308040076839, -0.33165310346748256, -0.3239805881762612, -0.3163619273025049, -0.3089238385983817, -0.3017708290871637, -0.29498577417398186, -0.2886311378019111, -0.2827506552384107, -0.2773713208675721, -0.272505545013322, -0.2681533658015378, -0.26430462388865816, -0.2609410289563372, -0.25803806656337347, -0.25556671167608136, -0.25349493052442473, -0.2517889651022589, -0.2504144045919472 ], [ -0.1853557414798681, -0.18889267956108546, -0.19348966755648833, -0.1992062914980952, -0.20608686608642612, -0.21415611464629825, -0.22341453656551957, -0.23383362149498765, -0.24535115670716134, -0.257866982105472, -0.2712396701210553, -0.285284727603095, -0.2997750009259721, -0.31444396594377655, -0.32899244754233914, -0.3430990009842727, -0.3564337030465776, -0.36867451175781585, -0.3795247858911541, -0.38873016321055776, -0.3960929087026328, -0.40148211452457905, -0.40483871603736055, -0.40617504843148655, -0.4055694267404819, -0.40315682311329226, -0.3991170375234887, -0.3936617955465256, -0.38702201717611273, -0.3794361810385807, -0.37114035685304314, -0.3623601675306345, -0.353304707322025, -0.34416228970076945, -0.33509781517488535, -0.3262515149066527, -0.3177388219685091, -0.30965113422405155, -0.3020572525256542, -0.2950053006745257, -0.2885249574636153, -0.28262985538562835, -0.27732002484772167, -0.27258428655049904, -0.2684025174857865, -0.2647477371493705, -0.2615879794707725, -0.25888793220412554, -0.25661033887420825, -0.2547171688084393 ], [ -0.1946103181429386, -0.1992502662210791, -0.2050409995892284, -0.2120416017223241, -0.22029399843038489, -0.2298183002809766, -0.24060782665523694, -0.2526239824421057, -0.2657912498962922, -0.27999267348338086, -0.2950663496780872, -0.31080356960680944, -0.3269493650629116, -0.3432062232752535, -0.3592415982949706, -0.37469950636394644, -0.3892159464434277, -0.40243720790151105, -0.4140394632141635, -0.42374757986327727, -0.43135098060857513, -0.4367147027667122, -0.43978449986659274, -0.44058572820787534, -0.4392166468578804, -0.43583743269394115, -0.43065655491991084, -0.42391615648034486, -0.4158778328921473, -0.4068098054133289, -0.3969760728832117, -0.3866277757849135, -0.3759967528217272, -0.365291114407287, -0.35469257893923634, -0.34435529111124596, -0.33440584482610936, -0.3249442513267422, -0.3160456172993582, -0.3077623238757974, -0.3001265241820359, -0.29315280389285503, -0.28684087587538487, -0.2811782059911794, -0.27614249185298423, -0.2717039391150018, -0.2678273001102969, -0.2644736569115058, -0.2616019449798248, -0.2591702244994376 ], [ -0.20461285370544857, -0.21042938712909054, -0.2174924945784038, -0.22586056936323784, -0.23557280514044265, -0.24664417512963244, -0.2590600895520143, -0.2727709160122771, -0.2876866433642178, -0.3036720918018412, -0.32054321723036017, -0.33806521026151115, -0.3559532126256246, -0.3738765052800659, -0.39146688631350735, -0.4083315878764118, -0.4240704681623464, -0.438296435120876, -0.45065728510660386, -0.46085659416089597, -0.4686711752616869, -0.4739629965966575, -0.47668427789605683, -0.4768755425761738, -0.47465743444763375, -0.47021786833209644, -0.46379644005482223, -0.45566797447368446, -0.4461267497107213, -0.4354724566006718, -0.4239984741584153, -0.41198265307976767, -0.3996805321572636, -0.38732075820154055, -0.37510241000152633, -0.36319390972361165, -0.3517332161955611, -0.3408290180455782, -0.3305626725696462, -0.32099066522734443, -0.3121473939205186, -0.3040481115179223, -0.29669188920576506, -0.2900644916313755, -0.2841410817169512, -0.2788886976714209, -0.2742684664680044, -0.270237536455318, -0.2667507266603424, -0.263761901789078 ], [ -0.2153479165547867, -0.2224127682913608, -0.23082493423546313, -0.24064194099140068, -0.2518999175152994, -0.2646081835522449, -0.27874351509581596, -0.2942442876543887, -0.3110047982783024, -0.328870196176706, -0.34763260791707173, -0.36702921188091286, -0.3867431597797617, -0.40640829296280856, -0.42561846819935734, -0.4439419100394284, -0.4609403217217617, -0.47619159677226974, -0.4893140772589941, -0.49998966641598763, -0.5079829576152072, -0.5131539943744842, -0.5154632490864813, -0.5149686555857924, -0.511815724902123, -0.5062226255434998, -0.4984624682788428, -0.4888449197069178, -0.4776988263440962, -0.4653569548284502, -0.4521434072556997, -0.43836384752044877, -0.42429839976857786, -0.4101969330551314, -0.39627638827687317, -0.38271979711724335, -0.3696766612805473, -0.3572643883262747, -0.3455705110601035, -0.33465544858805574, -0.32455559858645944, -0.3152865821346682, -0.30684649427379007, -0.2992190445451566, -0.29237650116665126, -0.28628237929108025, -0.2808938372325205, -0.2761637642107124, -0.2720425589194444, -0.26847961020362576 ], [ -0.22679301404626795, -0.23517519391999042, -0.24501020023102238, -0.25635452983008955, -0.2692409303068135, -0.28367256846351485, -0.29961687640058154, -0.31699929472655386, -0.33569723718332933, -0.3555347364498773, -0.3762783975799122, -0.39763547037283353, -0.4192550161622852, -0.4407332140817344, -0.4616237233038749, -0.48145359101085616, -0.49974443405059665, -0.5160376117387852, -0.5299210748541354, -0.541054833675015, -0.549191819063267, -0.5541914466128754, -0.5560243424422031, -0.5547681510932587, -0.5505957221360607, -0.5437579168005098, -0.534563621777871, -0.5233593496107073, -0.51051024028641, -0.4963835951391581, -0.48133545919795684, -0.4657003171399825, -0.4497836937594337, -0.4338573164611097, -0.4181564545315217, -0.40287905494150267, -0.38818631940068915, -0.3742043983528687, -0.36102690962509154, -0.34871802186943524, -0.3373158762603976, -0.3268361542757652, -0.31727563421690563, -0.308615613312093, -0.3008251045210901, -0.29386374638515633, -0.2876843896262844, -0.28223534525802285, -0.2774622956519126, -0.27330988252238764 ], [ -0.2389183634068235, -0.24868322764444084, -0.26001093601058023, -0.272956807452162, -0.2875499118577911, -0.3037867882482015, -0.32162484236284494, -0.3409756647889721, -0.3616986206766668, -0.38359520431821603, -0.4064048288644493, -0.4298029220435309, -0.4534023838155067, -0.47675955152912763, -0.499385694677397, -0.5207646046519, -0.5403760018554756, -0.5577233416077816, -0.5723634183747114, -0.5839343106029442, -0.5921780152978056, -0.5969547549056432, -0.5982472906484473, -0.5961552829052864, -0.5908813156142371, -0.582711236662117, -0.5719917784192894, -0.5591080953799292, -0.5444631476779537, -0.5284600602499308, -0.5114879078294761, -0.4939109070004124, -0.47606073276233696, -0.458231563811781, -0.4406774356790042, -0.4236114965761797, -0.4072067901391132, -0.39159822092880026, -0.37688539030749757, -0.36313602312683346, -0.3503897406581453, -0.3386619723653186, -0.32794783741211786, -0.3182258645789162, -0.30946145485082077, -0.3016100229436114, -0.2946197815389118, -0.2884341545818405, -0.28299382365373904, -0.2782384244896132 ], [ -0.25168676234697474, -0.2628950469104363, -0.27578033615734454, -0.29039663800224114, -0.30676907200489634, -0.3248871065068881, -0.34469747741745027, -0.3660970544682747, -0.3889260365672289, -0.4129620073505704, -0.43791556930860187, -0.46342849069554826, -0.4890755046722193, -0.5143710092757003, -0.5387817979947432, -0.561746462652807, -0.5827011815755164, -0.601110325616939, -0.6164989707340608, -0.6284834229592046, -0.636795643880613, -0.6412982117479947, -0.6419880384069352, -0.6389890453725139, -0.6325357958596284, -0.6229511971001501, -0.6106216384536072, -0.5959724525879123, -0.579445714591102, -0.5614814751456729, -0.5425027883564651, -0.5229044213766806, -0.5030448910625964, -0.4832413858844661, -0.46376712497506756, -0.4448507305010674, -0.4266772200350084, -0.4093902551742432, -0.3930953122889642, -0.3778634737017499, -0.36373557424656644, -0.3507264785702926, -0.33882930691280433, -0.32801946908971, -0.3182584058052249, -0.3094969715700009, -0.3016784233790255, -0.2947410035288702, -0.2886201236285706, -0.2832501704376258 ], [ -0.2650535716660718, -0.2777604057829479, -0.2922620820678965, -0.308611177948674, -0.3268286157307221, -0.3468963883522549, -0.36874996871648613, -0.3922706961469864, -0.4172785563082162, -0.4435259284641708, -0.4706930717786866, -0.4983863529511515, -0.5261404416868586, -0.5534258275685181, -0.5796628960080771, -0.6042432791788218, -0.626558179016146, -0.6460319314018348, -0.6621575635401951, -0.6745299786504065, -0.682872160806067, -0.6870506719196182, -0.6870785650010284, -0.6831061310340881, -0.6754019213654179, -0.6643276726833706, -0.6503109169253702, -0.6338183941151443, -0.6153323307707551, -0.595330609607007, -0.574271079384664, -0.5525797929298061, -0.53064275339295, -0.5088006928546883, -0.4873464187362313, -0.4665242924205155, -0.44653143179209076, -0.427520253528203, -0.40960199663399677, -0.39285090015065083, -0.3773087465340961, -0.36298952655631145, -0.34988402883564196, -0.33796420401470617, -0.327187197378882, -0.3174989823752332, -0.3088375599680422, -0.30113571473425704, -0.2943233383107742, -0.28832934487306083 ], [ -0.2789668202120392, -0.2932207392561452, -0.309390440449975, -0.3275269620554673, -0.3476468083092985, -0.3697241349970595, -0.39368261943292904, -0.41938733905087977, -0.44663711391730043, -0.47515793525000183, -0.5045983110407549, -0.534527604850853, -0.5644386854227911, -0.5937563471068233, -0.6218528449929038, -0.648071329734746, -0.6717568537052113, -0.69229303761211, -0.7091407868077165, -0.7218741857595319, -0.7302084371986696, -0.7340157451602667, -0.7333271968859107, -0.728321335737565, -0.7193023818900978, -0.7066722864464032, -0.6909008208362681, -0.6724970155961518, -0.6519840101717392, -0.6298782297297922, -0.6066730081563763, -0.5828263484574505, -0.5587523495145904, -0.5348158056852474, -0.5113295110990616, -0.4885538281344972, -0.4666980982418325, -0.44592348833779727, -0.42634688599885173, -0.4080454869183059, -0.3910617592271539, -0.3754085185551188, -0.36107390082928226, -0.34802607245766803, -0.3362175662775493, -0.3255891742060839, -0.31607336280090825, -0.30759720572166094, -0.3000848478176641, -0.29345953006913095 ], [ -0.2933674399934316, -0.30920941923576084, -0.3270905378419966, -0.34706019261484466, -0.3691302737750577, -0.3932667843269484, -0.41938114290147643, -0.4473215276311907, -0.47686475953126783, -0.5077094013768041, -0.5394709692397378, -0.5716804130131021, -0.6037872793087052, -0.6351691241843295, -0.6651486222768813, -0.6930192182994569, -0.7180789544247961, -0.7396703642938236, -0.7572224341360315, -0.770289222114608, -0.7785794496878453, -0.7819725895417834, -0.7805194734304299, -0.7744284573813995, -0.7640406882381469, -0.7497992529001762, -0.7322168172242282, -0.7118452128837671, -0.6892489744032698, -0.6649835936697635, -0.6395784709527185, -0.6135241687056173, -0.5872634677543785, -0.56118573553357, -0.5356241485442267, -0.5108553295386018, -0.4871009637307244, -0.46453096070761035, -0.44326774179170014, -0.423391261946817, -0.40494442010172693, -0.38793856724769293, -0.37235888180706556, -0.3581694410402412, -0.34531787154154414, -0.3337395086689847, -0.3233610329771037, -0.3141035813582651, -0.30588535231983216, -0.2986237396848632 ], [ -0.308189636076563, -0.3256521686281899, -0.34527882000043, -0.36711724396664214, -0.3911745428618576, -0.41740829883456865, -0.44571728545264777, -0.4759322528983274, -0.5078073323288479, -0.5410127949527362, -0.5751301359750666, -0.6096507269223677, -0.643979550342417, -0.6774456923355571, -0.7093211369691945, -0.7388487586576767, -0.7652790924500886, -0.7879135546683755, -0.8061497003962885, -0.8195225431536421, -0.827735677540349, -0.830677362343991, -0.8284196050951416, -0.8212017105397953, -0.8094024960393986, -0.7935065745897834, -0.774069681704126, -0.7516865782426623, -0.7269634061318099, -0.7004950810287526, -0.6728475613555771, -0.6445445382639979, -0.6160580463612982, -0.5878025321527368, -0.5601319465209236, -0.533339426798831, -0.5076591161930473, -0.483269654750766, -0.46029888160691, -0.4388293176295641, -0.4189040475626593, -0.40053268402025655, -0.38369716413129695, -0.368357196436794, -0.35445523604283813, -0.34192091736097696, -0.3306749150555164, -0.32063223529906226, -0.3117049620762875, -0.3038044983957622 ], [ -0.32336139221939275, -0.34246763553816595, -0.363863699696906, -0.3875953880337404, -0.4136648591565477, -0.44202105369442224, -0.472549795951022, -0.5050640012676116, -0.5392945852595723, -0.5748828753199415, -0.6113755742458539, -0.6482236135244378, -0.684786515572008, -0.7203440482525396, -0.7541168064790296, -0.7852966540315626, -0.8130865343939291, -0.8367470841534873, -0.8556451979849522, -0.869297980996679, -0.8774052436890958, -0.8798653483932583, -0.876772527110394, -0.8683976453417567, -0.8551573410879797, -0.8375775637851338, -0.8162567978907077, -0.7918324884297723, -0.7649523508183719, -0.7362509404779004, -0.7063311969891888, -0.6757504812373961, -0.6450106421670783, -0.6145517032791068, -0.5847487715737374, -0.5559117406781651, -0.5282873138925742, -0.5020628408887851, -0.4773714600723794, -0.4542980696860299, -0.4328857079215016, -0.4131419951364046, -0.3950453693788176, -0.3785509216526093, -0.3635957043830742, -0.3501034426313776, -0.3379886220049555, -0.3271599604819222, -0.3175232948184701, -0.30898392746766623 ], [ -0.3388051091271944, -0.3595681246002811, -0.3827463903972239, -0.40838373923363647, -0.43647724331932536, -0.46696702711015425, -0.49972574741850817, -0.5345482106604922, -0.5711417768457515, -0.6091184201134123, -0.6479895813406255, -0.6871652504838324, -0.7259590071245206, -0.763600909248456, -0.7992599476982852, -0.8320770218325337, -0.8612078554268321, -0.8858730274630435, -0.9054098092070076, -0.9193186366046769, -0.9272967847640609, -0.9292537348004347, -0.9253065039673719, -0.915757516662789, -0.9010607286094161, -0.8817826336973787, -0.8585636588693576, -0.8320833456066555, -0.8030307385663885, -0.772080137621139, -0.7398718352934199, -0.7069973796575892, -0.6739889778151523, -0.6413127087731123, -0.6093651938786082, -0.5784733001317561, -0.5488963715959712, -0.5208304323197778, -0.49441379648443873, -0.469733556601029, -0.4468324873816488, -0.4257159872617222, -0.4063587686785508, -0.3887110926891575, -0.37270441757443984, -0.3582563920644335, -0.345275171304241, -0.33366306863407735, -0.32331958038272823, -0.3141438361360398 ], [ -0.3544383679361325, -0.376860477167952, -0.4018219167333965, -0.42936440902547357, -0.4594798052570819, -0.4920992828674472, -0.5270822012931625, -0.5642051257291244, -0.6031517240023928, -0.6435044792867303, -0.6847394445213549, -0.7262255809284974, -0.7672305205821642, -0.806934747037359, -0.8444559845909257, -0.8788847585261782, -0.909330437166042, -0.934974653853165, -0.9551263281993222, -0.9692705010174743, -0.9771029699920443, -0.9785449393259705, -0.9737361847885819, -0.9630100033469018, -0.9468564828559229, -0.9258812782310719, -0.9007655060920755, -0.8722299239884772, -0.8410044953598834, -0.8078032860461619, -0.7733042715595941, -0.7381336748131297, -0.7028545718443145, -0.6679595357577236, -0.6338670169237294, -0.6009210315082268, -0.5693936116594405, -0.5394893991157828, -0.511351752684466, -0.4850697821844575, -0.4606858005367387, -0.43820278354978925, -0.41759152837308133, -0.3987972960109212, -0.38174580467680097, -0.366348506690199, -0.3525071320899529, -0.3401175186204708, -0.3290727723838873, -0.3192658185664725 ], [ -0.3701748072453579, -0.3942470867246466, -0.420980285977113, -0.450413851973548, -0.4825342836830733, -0.517263722028995, -0.5544481887994835, -0.5938460243373924, -0.6351172858270545, -0.6778151239927513, -0.7213804572456196, -0.7651415927925832, -0.8083207460513675, -0.8500495514505845, -0.8893954172703321, -0.9253996777149318, -0.9571267278550083, -0.983720749915626, -1.0044637725665586, -1.0188266681352443, -1.0265045181301182, -1.0274303352786702, -1.0217659550223686, -1.0098741345961213, -0.9922792337165807, -0.9696241416173654, -0.9426290333259624, -0.91205477448638, -0.8786717166075256, -0.8432336500921571, -0.8064565183423769, -0.769001656892519, -0.7314634600378984, -0.6943613639589628, -0.6581358929946618, -0.6231483267925214, -0.5896833860049215, -0.5579542444975735, -0.5281091644664434, -0.5002391035044326, -0.47438573682475416, -0.4505494511250163, -0.42869698140254164, -0.4087684669096987, -0.39068379128739483, -0.3743481426963713, -0.3596567830548114, -0.3464990533048413, -0.33476166659378226, -0.3243313560691585 ], [ -0.3859250979497004, -0.4116270307641614, -0.4401077982754369, -0.47140437708240057, -0.5054977822633793, -0.5423010678539886, -0.5816469678318972, -0.6232757674699779, -0.6668242237644727, -0.7118166284078666, -0.7576594260718525, -0.8036411441368171, -0.8489396933634501, -0.8926392238978957, -0.933758438467955, -0.9712912907434774, -1.0042591149685152, -1.0317704994030186, -1.0530821743896683, -1.0676519330454788, -1.0751744985904064, -1.0755941619723204, -1.069093388228859, -1.056062252814811, -1.037056902685012, -1.0127550762975852, -0.9839140883976235, -0.9513336492937745, -0.9158238871749976, -0.8781782185934002, -0.8391507743756521, -0.7994383552042725, -0.7596670212328902, -0.7203833334719334, -0.6820500347863003, -0.6450456990279078, -0.6096676750340884, -0.5761375475301924, -0.5446083293031396, -0.5151726658683705, -0.4878714457997536, -0.46270234025688584, -0.43962792432849174, -0.4185831484489646, -0.39948202443234204, -0.3822234661271553, -0.3666962805667475, -0.35278334440709536, -0.34036502553938, -0.32932192412241057 ], [ -0.40159799649806116, -0.42889729581167924, -0.45908846762643907, -0.49220579083978844, -0.528224662291408, -0.5670490363347281, -0.6084984990595038, -0.6522956064034938, -0.6980543609037048, -0.7452709950123647, -0.7933185654162684, -0.8414472172482892, -0.8887922788455908, -0.9343924515765228, -0.9772200307213059, -1.0162240441438355, -1.0503852045585922, -1.0787786946984914, -1.1006376084261453, -1.1154075236058052, -1.1227826650619426, -1.1227173831324777, -1.115412588138236, -1.101282841717312, -1.080913061180043, -1.0550131056820544, -1.0243753272639549, -0.9898369300941456, -0.9522471512660349, -0.9124388642272684, -0.8712045024266776, -0.8292765488726098, -0.7873129254473253, -0.7458874296343693, -0.7054850344076857, -0.6665015330376586, -0.629246768960923, -0.5939505756466378, -0.5607705522554246, -0.5298008856240963, -0.5010815612587695, -0.47460745479924504, -0.4503369393035773, -0.4281997701626368, -0.4081041129938263, -0.38994265972040765, -0.37359783621110165, -0.3589461446286213, -0.3458617086684823, -0.33421910362992313 ], [ -0.41710145422325984, -0.4459540685044687, -0.4778055208330211, -0.5126871324110597, -0.550568544255659, -0.5913446351879839, -0.6348220729688415, -0.680706166047916, -0.7285889448096678, -0.7779397116353889, -0.8280996510463645, -0.8782824540472934, -0.9275832073830631, -0.9749978773754076, -1.0194553408969167, -1.0598627930284128, -1.0951632703758611, -1.1244010296051552, -1.1467871988946419, -1.161755706868024, -1.1689995754180196, -1.1684812732729621, -1.1604172401857236, -1.1452430864741885, -1.1235690771402456, -1.0961342516665495, -1.0637638144346884, -1.0273310765917492, -0.9877236609718771, -0.9458136212253608, -0.9024316473789207, -0.8583459248776488, -0.8142462256455322, -0.7707335008183341, -0.7283148007510053, -0.6874029384985597, -0.6483200356332225, -0.611303968922018, -0.5765167505207512, -0.5440539802955686, -0.513954663182012, -0.48621085256654406, -0.4607767395540341, -0.4375769450861322, -0.41651388233062536, -0.3974741406571076, -0.3803339026619996, -0.36496344608547626, -0.35123080725085853, -0.33900469569710867 ], [ -0.4323437582275811, -0.46269406295005533, -0.4961429382899951, -0.5327184571863002, -0.5723843653524503, -0.6150265275072477, -0.6604390113420388, -0.7083105132907068, -0.7582121061368029, -0.8095876142386954, -0.8617482868050451, -0.9138738073678582, -0.9650219649677638, -1.0141493629992757, -1.060145114751187, -1.1018782822012705, -1.1382576384365493, -1.1682992388847442, -1.1911938772703934, -1.2063640588136388, -1.2135003131584512, -1.2125705850396546, -1.2038032715993607, -1.1876511136939234, -1.1647460420133329, -1.1358532531944685, -1.1018286174022665, -1.063580152199864, -1.0220330600517797, -0.9780981317290769, -0.9326440356429851, -0.8864744147466428, -0.8403106154507753, -0.7947804239318335, -0.7504126241629371, -0.7076367100085899, -0.6667867765045011, -0.6281084958118823, -0.5917681151550616, -0.5578625439525784, -0.5264297751193245, -0.4974590732503964, -0.4709005360914136, -0.4466737830269344, -0.4246756412246344, -0.404786787588715, -0.38687736647237414, -0.37081164384506615, -0.3564517829945555, -0.3436608390674474 ], [ -0.447234678083822, -0.47901585308945294, -0.5139869986443317, -0.5521726226742939, -0.5935304373240408, -0.6379373930792994, -0.6851753628867714, -0.7349172148175894, -0.7867143004299623, -0.8399867243370135, -0.8940181342505973, -0.9479571390165659, -1.000827735831865, -1.0515511464433271, -1.0989809855240305, -1.1419524295240466, -1.1793438111546042, -1.2101459078788472, -1.233530742971992, -1.2489092860775184, -1.2559677423163564, -1.2546762763248192, -1.2452711449178813, -1.2282179756969036, -1.2041665704730662, -1.173905281775973, -1.1383185011076509, -1.0983475229540078, -1.054954183262365, -1.0090873234152309, -0.9616530016255237, -0.9134897410798222, -0.8653498723918207, -0.8178874285395646, -0.7716523732015328, -0.7270903948581626, -0.6845471689421625, -0.6442758771285757, -0.6064468260884412, -0.5711581637729035, -0.5384468931186351, -0.5082995902757173, -0.4806624224344117, -0.4554502172590935, -0.4325544587300585, -0.41185017488156506, -0.39320174604593827, -0.3764677031128205, -0.3615046091673608, -0.3481701292155108 ], [ -0.4616865923836332, -0.49482117858847685, -0.5312277892153111, -0.5709270306808025, -0.6138704491140546, -0.6599262207591752, -0.7088645135742195, -0.7603432904291803, -0.8138956231449224, -0.8689199342092773, -0.924674961569544, -0.9802816057273488, -1.034734073626547, -1.0869227177198653, -1.1356704438085508, -1.1797832536724113, -1.218113201422467, -1.2496288643012625, -1.2734849918801754, -1.289080623788518, -1.296095378926588, -1.29449793196483, -1.2845279579464952, -1.2666595724794716, -1.2415566677744199, -1.210027834099254, -1.1729838767494591, -1.1313978530457507, -1.0862670636817087, -1.038577383196075, -0.9892712833732075, -0.939221198646164, -0.8892094988957426, -0.8399155833251281, -0.791909821825471, -0.7456534637440579, -0.7015032885694472, -0.6597196714363821, -0.6204768137289244, -0.5838740715608198, -0.5499475406035494, -0.518681281704775, -0.4900177731390404, -0.46386734108063954, -0.44011644793753346, -0.4186348115906833, -0.3992813927319254, -0.3819093283719339, -0.36636991282964715, -0.35251573795461555 ], [ -0.4756155699295208, -0.510016193847747, -0.5477606455406179, -0.5888652817458913, -0.6332753616239268, -0.6808504691059627, -0.7313496374106544, -0.7844169748480808, -0.839568897269101, -0.8961844254856731, -0.9535003845152907, -1.0106136955950307, -1.0664931840447374, -1.1200032729668536, -1.1699413627932145, -1.2150893487580725, -1.2542774239817398, -1.2864551605430512, -1.3107614940782426, -1.3265829677044616, -1.3335901064340054, -1.3317461576662946, -1.321289651398074, -1.3026988079176747, -1.2766479328622538, -1.2439630262278052, -1.205579179938971, -1.1624995241568175, -1.1157553337514865, -1.066368079649235, -1.0153152154631997, -0.963501681008763, -0.9117385608772142, -0.8607294381280766, -0.8110640967966583, -0.7632185728576121, -0.7175602000340969, -0.6743562109716542, -0.6337845573512509, -0.5959458216485616, -0.5608753418523484, -0.5285549139842777, -0.4989236509546905, -0.4718877499409898, -0.44732905311931137, -0.4251123822677576, -0.4050916926790773, -0.38711513255182295, -0.3710291166147939, -0.3566815322900576 ], [ -0.4889423820592904, -0.5245126319657032, -0.5634874863825928, -0.6058787017327123, -0.6516251470097199, -0.7005780392395692, -0.7524859221778317, -0.8069802124131206, -0.8635624475443239, -0.921594725233536, -0.980295195324238, -1.0387408061895242, -1.0958797110757528, -1.1505556487502107, -1.2015460022268705, -1.2476138657163598, -1.287572157430051, -1.3203547293648812, -1.3450861841839823, -1.3611399852362114, -1.3681750474999532, -1.3661452993085537, -1.3552836829521995, -1.3360683108952693, -1.3091803758952298, -1.2754605050595245, -1.2358658314201119, -1.1914275773655534, -1.143209075720128, -1.0922654584432108, -1.0396072222412676, -0.9861699427478796, -0.9327917069204692, -0.8801988015560219, -0.8289992248969577, -0.7796828980657934, -0.7326270988185856, -0.6881055729009977, -0.6462999072959364, -0.6073119842728169, -0.5711766050160061, -0.5378736310723817, -0.5073392165002345, -0.47947588416737763, -0.45416133622319044, -0.4312559863411116, -0.410609266814729, -0.392064804101097, -0.375464578345746, -0.3606521911396592 ], [ -0.5015934250957552, -0.5382288587431386, -0.5783180147504837, -0.6218677059227633, -0.6688103320010278, -0.7189890129100784, -0.7721425161763869, -0.8278908235572539, -0.8857224933489536, -0.9449853257947606, -1.004882202156721, -1.0644742867570551, -1.1226939546298051, -1.178369677413719, -1.23026445536491, -1.277128000606402, -1.31776062639909, -1.3510838240027647, -1.3762094437549843, -1.3924974506518106, -1.399592887699965, -1.3974368054159383, -1.3862524740355628, -1.3665139863112294, -1.3389060555933932, -1.304281118293968, -1.2636158633598233, -1.2179672139879327, -1.1684281242802417, -1.1160848918855328, -1.0619785803887107, -1.0070730610199452, -0.9522313311260864, -0.8982006193262756, -0.8456057486282201, -0.7949495139258715, -0.7466184809220567, -0.70089256655423, -0.6579569149966177, -0.6179148413558759, -0.580800904058122, -0.5465934403638728, -0.5152261335484047, -0.4865983667376813, -0.46058425826212235, -0.4370403725004335, -0.4158121660933871, -0.3967392696798042, -0.3796597266588879, -0.364413318457796 ], [ -0.5135015350737242, -0.5510907958658848, -0.5921707606696893, -0.6367429725655926, -0.6847333130813387, -0.73597711929323, -0.7902041551295881, -0.8470242981298822, -0.9059151118838361, -0.9662128178602261, -1.027108528403938, -1.0876518966678392, -1.1467644785894322, -1.20326493470442, -1.2559075286274421, -1.3034340049464108, -1.3446367508404427, -1.3784283257837335, -1.403909595200457, -1.4204269541091943, -1.4276098174209861, -1.4253833961588178, -1.4139577687571048, -1.3937994953957298, -1.3655935889077517, -1.3302013508419892, -1.288616183253289, -1.2419178027245716, -1.1912257549305485, -1.1376544111118663, -1.0822723806289516, -1.0260690314942975, -0.9699298219425052, -0.9146209036353771, -0.8607823685115729, -0.8089287828196112, -0.7594553119977911, -0.712647713585286, -0.6686946522701968, -0.6277010698088963, -0.5897016477275875, -0.554673685937725, -0.5225489623771931, -0.49322433010280453, -0.4665709508325485, -0.44244216429689986, -0.42068005900159644, -0.40112085007379816, -0.3835991907270706, -0.36795155124285306 ], [ -0.5246066805292845, -0.5630326969991342, -0.6049739472260698, -0.6504264051079146, -0.6993094204450511, -0.7514509052460414, -0.8065724421143912, -0.8642751871161795, -0.9240277427371021, -0.9851575085278357, -1.0468473457324576, -1.1081396577956275, -1.1679500925446984, -1.2250928700181396, -1.2783190521836716, -1.326367723549346, -1.368027972412231, -1.4022069284922605, -1.4279965080652102, -1.4447299682333086, -1.4520200506515082, -1.4497739677729438, -1.43818580371329, -1.4177115378513152, -1.3890333864997757, -1.3530183709021655, -1.310673317201713, -1.2630972409871306, -1.2114326176716084, -1.1568181957027661, -1.1003465800042904, -1.0430294066744064, -0.9857718204679549, -0.9293566508466349, -0.8744375611762496, -0.8215397133981047, -0.7710661633827631, -0.7233081951987164, -0.6784579993957585, -0.6366223961824072, -0.5978366228003436, -0.5620774990598517, -0.5292755332474373, -0.49932572579244416, -0.4720969728130947, -0.44744007304752853, -0.4251944082246939, -0.4051934068804084, -0.3872689221385244, -0.3712546608856342 ], [ -0.534856523051565, -0.5739977654185673, -0.6166661674986583, -0.6628518698515075, -0.7124677168753202, -0.7653345949546925, -0.8211667667816016, -0.8795580800264616, -0.9399702228869607, -1.0017245159475778, -1.0639990355550262, -1.12583309860312, -1.1861412070540378, -1.243738318502166, -1.2973776150247176, -1.34580063962204, -1.3877977125588499, -1.4222741151469402, -1.4483151807545682, -1.4652420733670557, -1.472650659496902, -1.4704289199980696, -1.4587529452762862, -1.438065584709393, -1.4090432753206417, -1.3725553733165734, -1.32961835423205, -1.2813464290717411, -1.2289007113646293, -1.1734400503151479, -1.1160770049967548, -1.0578418634825175, -0.9996563975756091, -0.9423176754414039, -0.8864911163126226, -0.8327112435637317, -0.7813882799095503, -0.732818738960638, -0.6871983804911854, -0.6446362058598211, -0.6051684984449204, -0.5687722156491964, -0.535377291939511, -0.5048776104722793, -0.47714054726647803, -0.45201509412564345, -0.42933863338630673, -0.4089424775262116, -0.39065630700289566, -0.37431164633142466 ], [ -0.5442068393066968, -0.5839386067481268, -0.6271968660575349, -0.6739657031693043, -0.7241515265815675, -0.777568635489888, -0.8339248625078212, -0.8928081693929943, -0.9536753569221073, -1.0158443488731932, -1.0784917902762292, -1.1406579025754835, -1.2012605727255332, -1.2591203966150915, -1.3129977076107777, -1.3616413780000736, -1.4038473638471602, -1.4385227609885802, -1.4647490480085328, -1.4818370010683453, -1.489366299961426, -1.4872054203974978, -1.4755112799541845, -1.4547115544230995, -1.4254740360440363, -1.3886668005520464, -1.3453117316496195, -1.2965335564523621, -1.243507152574652, -1.1874066699033476, -1.129360147454323, -1.0704125753765221, -1.0114990520862785, -0.95342828396186, -0.8968755331866389, -0.8423834019702708, -0.7903685438209227, -0.7411324175308813, -0.6948744247252379, -0.6517060901230697, -0.6116652787428817, -0.5747297506002678, -0.5408296094575221, -0.5098584022786932, -0.48168277370486856, -0.45615068283609805, -0.43309825686930803, -0.41235539625893436, -0.3937502664225625, -0.3771128175833476 ], [ -0.5526218021747695, -0.5928175151551351, -0.6365266244775444, -0.6837269893197241, -0.7343186972110468, -0.788109934313944, -0.8448030110168954, -0.9039814159571852, -0.9650990403467434, -1.0274729928830277, -1.090281678503704, -1.152569984470787, -1.21326342030314, -1.2711927833149326, -1.325130246803197, -1.3738365976468243, -1.4161176834757763, -1.4508861510461597, -1.477222708440907, -1.4944300929215448, -1.5020733401809157, -1.5000020570604753, -1.4883535855949972, -1.4675388732440466, -1.4382143395507219, -1.4012429871278922, -1.3576474760836044, -1.3085578824552324, -1.2551574824628469, -1.198630489827861, -1.1401155933620828, -1.080668264404128, -1.0212334334707762, -0.9626287144322807, -0.905537219293422, -0.8505083038133416, -0.797964300707328, -0.7482113330260842, -0.7014525330503032, -0.6578023153613298, -0.6173006911583316, -0.5799269194680661, -0.5456120484986391, -0.514250101645725, -0.4857078111869596, -0.4598329063178146, -0.4364610299198759, -0.41542139890801844, -0.39654134358804183, -0.3796498681701628 ], [ -0.560074122344815, -0.6006065957909839, -0.6446272555897533, -0.6921076160945223, -0.7429416054339193, -0.796931802978244, -0.8537759131583819, -0.9130543380756349, -0.974219964275228, -1.0365915354863253, -1.099352208220047, -1.1615550261867589, -1.222137024921196, -1.2799433919679546, -1.3337624574979017, -1.3823712019227186, -1.424589455329171, -1.4593392022341203, -1.485703777223205, -1.5029807959943076, -1.5107229413666474, -1.5087623820404803, -1.497217167457665, -1.476480415812602, -1.4471946156277362, -1.4102138146923435, -1.3665565489913225, -1.3173527214900451, -1.2637882781361196, -1.2070519358282898, -1.1482879397069994, -1.0885578208950004, -1.0288127024182216, -0.9698762745727766, -0.9124374398943508, -0.8570509415080718, -0.8041440171417793, -0.7540271636328661, -0.7069073323891871, -0.6629022004280003, -0.6220545000876619, -0.5843456990520091, -0.549708580080107, -0.5180384714530204, -0.48920302818995476, -0.46305056828402513, -0.43941703652180597, -0.418131709430559, -0.3990217759294652, -0.381915935336991 ], [ -0.5665450550707443, -0.6072877302213041, -0.6514817158060083, -0.6990921208503071, -0.7500069225324749, -0.8040236279698397, -0.8608362518549664, -0.9200234566479377, -0.9810389378221733, -1.0432053702846955, -1.1057134295548692, -1.1676275112543388, -1.2278997246973993, -1.2853934457779974, -1.338917095764386, -1.3872678116212767, -1.4292833145130655, -1.463898724590614, -1.4902036363915925, -1.5074939094601798, -1.5153127589548296, -1.5134769819116582, -1.5020861829625112, -1.4815149560734968, -1.452389507133475, -1.415551066705598, -1.3720090282699624, -1.3228874087486504, -1.2693688861075054, -1.2126409283480246, -1.1538480849270176, -1.094053401521415, -1.0342104600792748, -0.9751461253406848, -0.9175529771679154, -0.861989738385757, -0.8088877453702741, -0.7585615533792917, -0.7112220024494587, -0.6669903906024962, -0.6259127364786982, -0.5879734198270603, -0.5531077447917386, -0.5212131721445131, -0.4921591158282661, -0.46579530389339296, -0.4419587728999965, -0.4204796065462981, -0.4011855509784039, -0.38390564688998974 ], [ -0.5720242797148359, -0.6128523949683934, -0.6570838487104671, -0.7046773438176654, -0.755515161233737, -0.8093902948866852, -0.8659939787773627, -0.9249044326325669, -0.9855778703713172, -1.047343026318837, -1.1094006249936839, -1.1708293039242808, -1.2305994326987892, -1.2875959824021057, -1.3406510184983924, -1.3885854780187352, -1.430258678402476, -1.4646226301702898, -1.4907769574718788, -1.5080194285434871, -1.515887088822528, -1.5141838864560502, -1.5029922592476082, -1.4826679326392513, -1.453818720871367, -1.4172693078286196, -1.3740149700792588, -1.3251681122109011, -1.271902165753375, -1.2153975496403095, -1.1567938193939298, -1.0971509473221732, -1.0374211999379082, -0.9784316736411878, -0.920876470628313, -0.8653168431901149, -0.8121873776251796, -0.7618063313668743, -0.7143884643824825, -0.6700590196521362, -0.6288678367983394, -0.5908028849007484, -0.555802754453339, -0.5237678484651072, -0.4945701617517738, -0.46806164262750316, -0.44408120095904624, -0.4224604691096401, -0.4030284448600563, -0.38561515383187994 ] ], "zauto": true, "zmax": 1.515887088822528, "zmin": -1.515887088822528 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.6579302983853205, 0.6554581561364291, 0.6528368051048332, 0.650075604824553, 0.6471872082103519, 0.6441874274410867, 0.6410949170319954, 0.6379306879583804, 0.6347174934094671, 0.631479152935392, 0.6282399017460619, 0.6250238597000316, 0.6218547052315712, 0.6187556111829262, 0.6157494546614947, 0.6128592588496918, 0.6101087722041753, 0.6075230521340571, 0.6051289065221901, 0.6029550625396446, 0.6010319758669825, 0.5993912549694126, 0.5980647396330601, 0.5970833248019405, 0.5964756480632555, 0.5962667579306972, 0.5964768555447145, 0.5971201669740794, 0.5982039720080512, 0.5997278001145859, 0.6016828093896703, 0.60405138491622, 0.6068070169809788, 0.6099145328659522, 0.6133307477066874, 0.6170055670797908, 0.6208835221348553, 0.6249056593211416, 0.6290116553477475, 0.633141995764801, 0.6372400485890548, 0.6412538822466012, 0.6451377139200749, 0.6488529214275788, 0.6523686000455536, 0.6556616879952007, 0.6587167161683112, 0.6615252574095081, 0.6640851588861667, 0.6663996397896084 ], [ 0.6559283350675722, 0.6532410963406261, 0.6503933995801183, 0.6473966424680334, 0.6442661116905637, 0.6410208271264505, 0.6376831560951768, 0.634278208316268, 0.6308330553518845, 0.62737585219985, 0.6239349664223619, 0.6205382339420072, 0.6172124536904272, 0.6139832023205147, 0.6108749972422174, 0.6079117695913555, 0.6051175418966592, 0.6025171539614239, 0.6001368586220486, 0.5980046240630852, 0.5961500295153038, 0.5946037151983489, 0.5933964272812782, 0.5925577647636017, 0.5921147722125454, 0.5920905241113997, 0.5925028181418559, 0.5933630501078536, 0.5946753002892413, 0.5964356348015684, 0.5986316227101339, 0.6012420864596352, 0.6042371275362739, 0.607578485962058, 0.6112202890808862, 0.6151102176686876, 0.6191910702833394, 0.6234026515231733, 0.6276838606089742, 0.6319748253738781, 0.6362189197317879, 0.6403645198351698, 0.6443663898700681, 0.6481866342668801, 0.6517952002206168, 0.6551699556977151, 0.6582963991362195, 0.6611670761691961, 0.6637807864898638, 0.6661416624257093 ], [ 0.6538018541985223, 0.650883720603215, 0.6477928443344501, 0.6445428870892935, 0.6411520897855028, 0.6376430991743016, 0.6340425087953556, 0.6303801195394031, 0.6266879657051906, 0.6229991957713804, 0.6193469347018645, 0.6157632764825897, 0.612278552586064, 0.608920988852275, 0.6057168011753495, 0.6026906987558726, 0.599866678978501, 0.5972689301841368, 0.5949226257878021, 0.5928544058378882, 0.5910923992490118, 0.5896657285584541, 0.5886035373333064, 0.5879336639046113, 0.5876811343381348, 0.5878666537189424, 0.5885052425376732, 0.5896051101166475, 0.5911668007372192, 0.5931826090048459, 0.595636248528269, 0.5985027699278883, 0.6017487484626836, 0.6053327819178618, 0.609206342115955, 0.613315002475497, 0.6176000228113582, 0.6220002218441105, 0.6264540214729521, 0.6309015167427167, 0.6352864182748865, 0.6395577299730778, 0.6436710589183104, 0.6475894984034907, 0.6512840704844727, 0.6547337542976869, 0.657925156360912, 0.6608518974798039, 0.6635137982543253, 0.6659159434442985 ], [ 0.6515492360984796, 0.6483837196649621, 0.645032002275692, 0.6415102355946644, 0.6378399462978274, 0.634047851987368, 0.6301653262251717, 0.6262275096920532, 0.6222721137646325, 0.6183380175704825, 0.6144638096867632, 0.610686458426752, 0.607040297781304, 0.6035564814677779, 0.6002629852320506, 0.5971851379689119, 0.5943465553702459, 0.5917702609232697, 0.5894797317021422, 0.5874996149675549, 0.5858559262629586, 0.5845756453802814, 0.5836857468153545, 0.5832118060145316, 0.5831763870703701, 0.5835974296158378, 0.5844868166154974, 0.5858492385293453, 0.5876813978054637, 0.5899715435458287, 0.592699302314382, 0.5958357769394657, 0.5993439088986777, 0.6031791241236983, 0.6072902913994368, 0.6116210091459144, 0.6161112021592948, 0.620698964662121, 0.6253225431106497, 0.6299223235743452, 0.6344426811102164, 0.6388335631274675, 0.6430517106837418, 0.647061463331447, 0.6508351363783429, 0.6543529975174353, 0.6576028984565734, 0.6605796347708959, 0.6632841141626795, 0.6657224114703152 ], [ 0.6491698863167334, 0.6457398840986809, 0.6421088968931006, 0.6382957865709576, 0.6343257024907386, 0.6302298970519251, 0.6260451148034476, 0.6218125401371936, 0.6175763477356832, 0.6133819684122735, 0.6092742487587135, 0.6052957301929354, 0.6014852851741642, 0.597877313665085, 0.5945016193873242, 0.5913839643885669, 0.5885471661483266, 0.5860124857665432, 0.5838009892963864, 0.5819345666093961, 0.5804363650317365, 0.5793305207632742, 0.5786412176614463, 0.578391233207443, 0.5786002143777479, 0.5792829459744014, 0.5804478342596338, 0.5820957498700216, 0.5842192851466296, 0.5868024096673334, 0.5898204705646689, 0.5932404827821764, 0.5970216771232356, 0.60111630229427, 0.6054706938245463, 0.6100266179368935, 0.6147228723363038, 0.6194970870971745, 0.6242876300836092, 0.6290354944787591, 0.6336860383112923, 0.6381904586417019, 0.6425069123755623, 0.6466012344729769, 0.6504472449251077, 0.6540266718280944, 0.6573287450504643, 0.6603495316738659, 0.6630910909396223, 0.6655605245500057 ], [ 0.6466644086775865, 0.642952306011365, 0.6390229442486044, 0.6348981030526726, 0.6306068895937953, 0.6261855683159321, 0.6216768776716549, 0.6171288021592372, 0.6125928381390731, 0.6081218765958677, 0.6037679112282016, 0.5995798462086801, 0.595601703064632, 0.5918714934007887, 0.5884209285298166, 0.5852759905020694, 0.5824582208136623, 0.5799864334637785, 0.5778784677260327, 0.5761525893546977, 0.574828230783089, 0.5739259104806709, 0.5734663498340203, 0.5734689669853109, 0.5739500325004802, 0.5749208013344553, 0.5763858922375531, 0.5783420927385555, 0.5807776593562817, 0.583672091646814, 0.5869963061225976, 0.5907131260191514, 0.5947780240355838, 0.5991400878115851, 0.6037432026283004, 0.6085274505682565, 0.6134307083930975, 0.6183903949358467, 0.623345284824686, 0.6282372805509935, 0.633013026874537, 0.637625262253871, 0.6420338282285369, 0.6462062931428566, 0.6501181841389659, 0.6537528548511213, 0.6571010416820515, 0.6601601772198639, 0.6629335354904128, 0.6654292818701494 ], [ 0.6440347857189929, 0.6400225924521822, 0.6357752020968895, 0.6313174989575298, 0.6266828725258914, 0.6219130810982375, 0.6170575043158618, 0.6121717303860063, 0.6073155059027726, 0.6025501798255856, 0.5979358822466447, 0.5935287687616075, 0.5893787043850534, 0.5855277331597848, 0.5820095711859565, 0.5788501838957802, 0.5760692983016759, 0.5736825084931835, 0.5717035093467414, 0.5701459744223143, 0.5690246859405625, 0.568355702903833, 0.5681555697716396, 0.5684397663117229, 0.5692207318074146, 0.5705058383396522, 0.5722956407861526, 0.574582622212737, 0.5773505225479852, 0.5805742249997288, 0.5842201045707176, 0.5882467229937083, 0.5926057735060197, 0.5972432160142171, 0.6021005766558459, 0.6071164009974872, 0.6122278432188415, 0.6173723503099329, 0.6224893716613968, 0.6275220019495468, 0.6324184568586785, 0.6371332895731127, 0.6416282787865651, 0.6458729506998372, 0.6498447315809048, 0.6535287582173116, 0.6569173971268986, 0.6600095379654718, 0.6628097322712324, 0.6653272468684919 ], [ 0.6412845629155176, 0.6369540868214641, 0.6323686325456371, 0.6275563460003083, 0.622555202384591, 0.6174129291897515, 0.6121862085505931, 0.6069390749277933, 0.6017405190398271, 0.596661434402591, 0.5917711808660936, 0.5871341606084965, 0.5828068697926599, 0.5788358704784888, 0.5752570059850399, 0.5720959701421211, 0.5693700791179378, 0.5670908480599116, 0.5652668104717271, 0.5639059827851689, 0.563017480141927, 0.5626120021611353, 0.5627011700281179, 0.5632959391301544, 0.5644044763665592, 0.5660299469634122, 0.5681686043138842, 0.5708084491324383, 0.573928568041887, 0.5774991229249231, 0.5814818724741472, 0.585831076031944, 0.5904946464294297, 0.595415460421916, 0.6005327782040304, 0.6057837500913835, 0.6111049925323789, 0.6164342011650517, 0.6217117458282745, 0.6268821725396714, 0.6318955287719447, 0.6367084342752999, 0.6412848387984524, 0.6455964357115063, 0.649622730884756, 0.6533507939244524, 0.6567747403080356, 0.6598950063272265, 0.6627174839820443, 0.6652525812255131 ], [ 0.6384190320037785, 0.6337520932491613, 0.6288083730751496, 0.6236193960460903, 0.6182279931808702, 0.6126883165803254, 0.6070650127060467, 0.601431431891638, 0.5958668596871364, 0.5904529057173692, 0.5852693584830984, 0.5803899745595348, 0.5758787714660242, 0.571787389971655, 0.5681539577228578, 0.5650036311490594, 0.5623506672396402, 0.5602015624100436, 0.5585585791112482, 0.5574229239035986, 0.5567969581510881, 0.5566850776048959, 0.5570932159226184, 0.5580272237236512, 0.5594905778727, 0.5614819476534942, 0.5639930878997751, 0.567007380663689, 0.5704991618136114, 0.5744338015420113, 0.5787683957374851, 0.5834528812874475, 0.5884314022273731, 0.5936438006791603, 0.5990271595799209, 0.6045173630342614, 0.6100506559645379, 0.6155651797992046, 0.6210024444121325, 0.6263086794354747, 0.6314359991010445, 0.6363433180901678, 0.6409969710495342, 0.6453710117456485, 0.6494471941673856, 0.6532146624000417, 0.6566693952744784, 0.6598134638515015, 0.6626541645259918, 0.6652030888695019 ], [ 0.6354454075708855, 0.6304240974322658, 0.6251020089023673, 0.6195141116623545, 0.613708315748364, 0.6077456174033504, 0.601699272819624, 0.5956528288093723, 0.5896969602088349, 0.5839252411611924, 0.5784291912231038, 0.5732931458292165, 0.5685896452503102, 0.5643760558859658, 0.5606929929565788, 0.5575648094418414, 0.5550020125739468, 0.5530050695335382, 0.5515687811635432, 0.5506863181324964, 0.550352148529963, 0.5505633933629441, 0.551319533835205, 0.5526207551593179, 0.5544654593497835, 0.5568475694183773, 0.5597541835934209, 0.5631639645339694, 0.5670464299966462, 0.5713621117936203, 0.5760634133945224, 0.5810959390466772, 0.5864000783282299, 0.5919126827871056, 0.5975687353817888, 0.603302965339166, 0.6090513893616368, 0.6147527652253402, 0.6203499339070359, 0.6257910122710355, 0.6310303891294872, 0.6360294781489083, 0.640757192174062, 0.6451901223246589, 0.6493124273390405, 0.6531154597337666, 0.6565971721185552, 0.6597613576515702, 0.6626167827796262, 0.6651762688059315 ], [ 0.6323729898688675, 0.6269799758319615, 0.6212598376317824, 0.6152509950909646, 0.6090065987140096, 0.6025948541821393, 0.5960982357478307, 0.5896113573887776, 0.5832374028512535, 0.5770832224220225, 0.57125346584818, 0.5658443892082676, 0.5609381752908301, 0.556598660878079, 0.552869211846792, 0.5497731256782916, 0.5473164416168562, 0.5454925322153354, 0.5442874834875757, 0.5436851519573567, 0.5436709431896826, 0.544233729174308, 0.5453657933414684, 0.5470611296896694, 0.5493127216598016, 0.5521095353963522, 0.5554338878799366, 0.5592596465026806, 0.563551459723177, 0.5682649827346451, 0.5733478989181017, 0.578741466072817, 0.5843823249785944, 0.5902043671466093, 0.5961405346448246, 0.6021244906815597, 0.6080921410335257, 0.6139830019543667, 0.6197414071459585, 0.6253175353595896, 0.63066823074579, 0.6357575860205742, 0.640557265439198, 0.6450465586918, 0.6492121745882737, 0.6530478009297818, 0.6565534711980101, 0.6597347878305365, 0.6626020553829701, 0.6651693753117073 ], [ 0.6292133056451426, 0.6234321835016502, 0.6172951149514558, 0.6108439030392546, 0.6041370229090058, 0.5972501802727517, 0.5902756143147616, 0.5833198407243237, 0.5764996718767302, 0.5699365884847664, 0.5637498532141565, 0.5580490977565742, 0.5529273901803178, 0.5484558918138193, 0.5446810582126773, 0.5416249120396405, 0.5392882993568381, 0.53765640086386, 0.5367052978680789, 0.5364082309548467, 0.5367403738774428, 0.5376813998475977, 0.5392156916929506, 0.541330576416954, 0.5440133223434115, 0.5472477649489601, 0.5510113381526492, 0.555273047087828, 0.5599926170517987, 0.5651207774489517, 0.570600447768565, 0.5763685063665456, 0.582357829756289, 0.5884993572013306, 0.5947240245260932, 0.6009644915757251, 0.6071566427302938, 0.6132408660999471, 0.6191631209049762, 0.6248757946309522, 0.6303383418538471, 0.6355176918373102, 0.6403884147039711, 0.6449326453738795, 0.6491397777590042, 0.6530059555648251, 0.6565333976446825, 0.6597296033927725, 0.662606486500055, 0.6651794838249634 ], [ 0.6259802177180246, 0.6197959092473184, 0.6132242679143084, 0.6063103316885926, 0.5991178917099055, 0.591730347571895, 0.5842501608834294, 0.576796515596422, 0.569500940027778, 0.5625009132693333, 0.5559318558597133, 0.5499183324151203, 0.5445656625970963, 0.5399533066169583, 0.5361312432468367, 0.5331200578210429, 0.5309146993225059, 0.529491059578296, 0.5288139241230639, 0.5288446298568066, 0.5295469864030857, 0.5308905756868274, 0.5328512443832716, 0.5354092409420631, 0.5385458718737324, 0.542239696993077, 0.5464631718264535, 0.5511803595040204, 0.5563459818537546, 0.5619057591996865, 0.5677977665573866, 0.5739544337099622, 0.5803048234918903, 0.5867768991548918, 0.593299595219599, 0.5998046022325939, 0.6062278447162742, 0.612510668518915, 0.6186007644800882, 0.6244528504010561, 0.6300291232936128, 0.6352994863142155, 0.6402415532543448, 0.6448404381005023, 0.6490883459791341, 0.6529839919369497, 0.6565318828892254, 0.659741503936251, 0.6626264523264292, 0.6652035607177431 ], [ 0.6226899931883044, 0.6160891854486117, 0.6090670602516993, 0.601671653309567, 0.5939719556946248, 0.5860591352314007, 0.5780462131536721, 0.5700657027394469, 0.5622648624748793, 0.5547985125064887, 0.5478198066936334, 0.5414698823547036, 0.5358677950973979, 0.5311024072707494, 0.5272277698339263, 0.524262955454291, 0.5221963709741779, 0.5209935656039498, 0.5206067836855268, 0.5209842325740565, 0.5220773072669219, 0.5238447004295224, 0.5262531800326178, 0.5292755804576054, 0.532887047357989, 0.5370607344511426, 0.5417640071265394, 0.5469558664515185, 0.5525858955535267, 0.5585946618370696, 0.5649152560537446, 0.5714755366626757, 0.5782006570538999, 0.5850155414014451, 0.5918470943296888, 0.5986260417921133, 0.6052883834235815, 0.6117764840188512, 0.6180398490100034, 0.6240356266162431, 0.6297288688533567, 0.6350925732040253, 0.6401075209949837, 0.6447619284534833, 0.6490509307402956, 0.6529759256517587, 0.6565438098122163, 0.6597661443155682, 0.6626582880322516, 0.6652385350641973 ], [ 0.6193613196968839, 0.6123329388665149, 0.6048466924134476, 0.5969532831062703, 0.5887266659478806, 0.5802657095557574, 0.5716941787748605, 0.5631584291063317, 0.5548223411046457, 0.5468593430703916, 0.5394418837459337, 0.5327293637382604, 0.5268561628479704, 0.521921782739931, 0.5179850337731272, 0.5150635252983509, 0.513138584493404, 0.5121644639094048, 0.5120797272664876, 0.5128183479417038, 0.5143183908023529, 0.5165269971452987, 0.5194014320878763, 0.5229068643042009, 0.5270121185448874, 0.5316848047928583, 0.5368870399904243, 0.542572569167199, 0.5486856138216839, 0.5551613551736179, 0.5619276774634494, 0.5689076744004173, 0.5760224366698672, 0.5831937409745193, 0.5903463979811547, 0.5974101454864055, 0.6043210697718703, 0.6110225954443261, 0.6174661072176661, 0.6236112671891887, 0.6294260799705337, 0.6348867447610815, 0.6399773235163588, 0.6446892496535451, 0.6490207016535127, 0.6529758686089971, 0.6565641381395139, 0.6597992394660582, 0.6626983748251423, 0.6652813705091557 ], [ 0.6160152591654382, 0.6085509683398636, 0.6005898178897335, 0.5921847527294014, 0.5834143267539315, 0.5743848798872523, 0.5652309179345414, 0.5561129565607463, 0.547212210357462, 0.5387218446607283, 0.5308350915225544, 0.5237313097237478, 0.5175618694556017, 0.5124382816824671, 0.5084249653710856, 0.5055382859340877, 0.5037521227017885, 0.5030086495241712, 0.5032317922231287, 0.5043403799110373, 0.5062584286663825, 0.5089210468315434, 0.5122757145377245, 0.5162797690203516, 0.5208955762692746, 0.5260850271826408, 0.5318047473728295, 0.5380029183749072, 0.5446180529867262, 0.5515795932018053, 0.5588098891002993, 0.5662269900019942, 0.5737477041656113, 0.5812905034685708, 0.588778005462985, 0.5961389110999237, 0.6033093862656411, 0.6102339416231418, 0.6168658934996806, 0.6231674903402464, 0.6291097770220957, 0.6346722530771762, 0.6398423668149513, 0.6446148781151735, 0.6489911182925611, 0.6529781745044634, 0.6565880268205899, 0.6598366666735458, 0.6627432248889826, 0.6653291353961508 ], [ 0.612675129150618, 0.6047698356604038, 0.5963264571710312, 0.5873996657314932, 0.5780721158138106, 0.568457210739869, 0.5586999761330339, 0.5489751617633603, 0.539481783417481, 0.5304336589033496, 0.5220461429265798, 0.514520187101062, 0.508025854712418, 0.5026881584139499, 0.49857816000341193, 0.495711423711089, 0.49405425883235843, 0.49353624115325656, 0.4940659777829991, 0.4955465247684599, 0.49788739834819457, 0.5010114199454785, 0.504856164763647, 0.5093710530973562, 0.514511849830708, 0.5202344732895099, 0.5264896840041083, 0.5332196338203612, 0.5403566163403459, 0.547823830858509, 0.5555376388582385, 0.5634106665443883, 0.5713551477007861, 0.5792860424772692, 0.5871236441204722, 0.5947955482655306, 0.6022379813351761, 0.6093965586240312, 0.6162265748218634, 0.622692932401461, 0.6287697996304181, 0.6344400706375258, 0.6396946818778925, 0.6445318257767876, 0.6489560938557495, 0.6529775772271673, 0.6566109503449705, 0.6598745627484354, 0.6627895620932348, 0.6653790694227403 ], [ 0.6093663034521642, 0.6010186573523653, 0.5920897917995747, 0.5826355105961186, 0.5727419392026374, 0.5625289475890654, 0.552151613889103, 0.5417987033807306, 0.5316871854771726, 0.5220521455915803, 0.5131321577781848, 0.505151255545838, 0.4982998734989119, 0.4927181171029466, 0.48848492983303976, 0.48561580154849393, 0.48406968797677735, 0.4837634213665349, 0.4845900003270878, 0.48643646374436106, 0.4891977243244256, 0.4927843387654276, 0.49712403463828014, 0.5021582947520471, 0.5078360979045211, 0.5141070068970194, 0.5209153577520901, 0.5281965972680406, 0.535876084883588, 0.5438700936751111, 0.5520883968474123, 0.5604377106693654, 0.5688253282286709, 0.5771624445585951, 0.585366871443943, 0.5933650185771384, 0.6010931499751576, 0.6084980044532949, 0.6155369035926906, 0.6221774732509489, 0.6283970890882022, 0.6341821340687145, 0.639527133901579, 0.6444338187012774, 0.648910146794702, 0.6529693188833056, 0.6566288062433359, 0.6599094138011412, 0.6628343965599797, 0.6654286452450964 ], [ 0.6061159260603259, 0.5973287877809348, 0.587915823713239, 0.5779333094028929, 0.5674700898320334, 0.5566517136342124, 0.5456425775018753, 0.5346449067278446, 0.5238933907687988, 0.5136446016389722, 0.5041610762612045, 0.49569116545323855, 0.48844724443438176, 0.4825861596515759, 0.4781961919445576, 0.4752938335775547, 0.47383135042623037, 0.4737131926034683, 0.4748169877804734, 0.47701401830184254, 0.48018492568684945, 0.4842283492695392, 0.4890624118974333, 0.4946206767727981, 0.5008450580133721, 0.5076781875362519, 0.5150571685239241, 0.5229098034189217, 0.5311535565536195, 0.539696884170649, 0.5484422121981715, 0.5572897481135632, 0.5661414069553199, 0.5749043260027206, 0.5834936617632578, 0.5918345551167741, 0.5998632904629673, 0.6075277581104181, 0.6147873645016455, 0.6216125363481257, 0.6279839467689402, 0.6338915657551799, 0.6393336115485339, 0.6443154580014752, 0.648848537042728, 0.6529492645904357, 0.6566380113651353, 0.659938135601684, 0.6628750914097563, 0.6654756236433051 ], [ 0.6029525359685196, 0.5937333881236934, 0.5838428897750793, 0.5733370852075707, 0.5623066830282732, 0.5508819387428867, 0.5392355568880958, 0.5275822946727117, 0.5161738745482545, 0.5052880780214417, 0.49521167079686335, 0.48621817215067625, 0.47854324733192005, 0.4723621240973802, 0.46777409248434554, 0.4647981408307646, 0.4633810784729407, 0.46341599594303645, 0.4647660733012763, 0.4672877388154362, 0.4708482286688223, 0.47533498613172037, 0.48065695844444, 0.4867398065053353, 0.4935179428220043, 0.5009262257998134, 0.5088933973485579, 0.5173383543122893, 0.5261694186403001, 0.5352861092498143, 0.5445825783269032, 0.5539518159849173, 0.5632898594402705, 0.5724994681591283, 0.5814929655579826, 0.5901941507005091, 0.598539327724173, 0.6064775847548851, 0.6139704881558753, 0.6209913571718073, 0.6275242631824935, 0.633562868737573, 0.639109192315828, 0.6441723597404792, 0.6487673839956556, 0.6529140016326151, 0.656635584903739, 0.6599581428234879, 0.6629094202696036, 0.6655181010734923 ], [ 0.5999056047846898, 0.5902668812966243, 0.5799110281832717, 0.5688931392060146, 0.5573048517066663, 0.5452799908758581, 0.532998284756057, 0.5206856996160046, 0.508609793435757, 0.4970686872649329, 0.4863730318447688, 0.47682183186274457, 0.4686750336802688, 0.4621277858249061, 0.45729225475084334, 0.4541918962624587, 0.4527699967011759, 0.4529101429693487, 0.45446285553990434, 0.4572714066346379, 0.46119113260557587, 0.46609942432255547, 0.47189666124220453, 0.4785005667887472, 0.48583737786676806, 0.49383298295752154, 0.5024062359751811, 0.5114654853970185, 0.5209083398904327, 0.530624014069059, 0.5404972917937795, 0.5504131372167569, 0.5602611625677606, 0.5699394186821576, 0.5793572300501035, 0.5884370048685978, 0.5971150946885482, 0.6053418595478054, 0.6130811251719347, 0.6203092146750051, 0.627013713114727, 0.633192091036761, 0.6388502807581425, 0.6440012710588378, 0.6486637639296303, 0.6528609210291557, 0.6566192165355837, 0.659967405805506, 0.662935614405622, 0.6655545486632728 ], [ 0.5970049943032533, 0.5869642998050743, 0.5761612023163319, 0.5646491398348701, 0.5525196969601628, 0.5399089955404456, 0.5270022476737178, 0.5140349072590832, 0.5012886211464699, 0.48908030351141557, 0.4777434072274276, 0.467602043577932, 0.4589409094377078, 0.4519763880070105, 0.4468355354375851, 0.44354876809761784, 0.4420586119182316, 0.44224202213619396, 0.44393970733433924, 0.44698444586791736, 0.45122193435210456, 0.4565211262768753, 0.4627746052058426, 0.4698920053509932, 0.4777903848733944, 0.4863850149495087, 0.4955828528887304, 0.505279615425707, 0.5153602715107919, 0.525702109639104, 0.5361792910885486, 0.5466678634853672, 0.5570504412991238, 0.5672200466792221, 0.5770828703803628, 0.5865599203175903, 0.5955876636953596, 0.604117843480425, 0.612116675143571, 0.6195636211303465, 0.6264499130272924, 0.6327769562453939, 0.6385547169554767, 0.6438001603682291, 0.6485357850645488, 0.6527882800295013, 0.6565873184372126, 0.6599644938056396, 0.6629523986276994, 0.6655838419446051 ], [ 0.5942803469648654, 0.5838605413572518, 0.5726343981401107, 0.5606530398580829, 0.5480070076131378, 0.5348333505942227, 0.5213210050504639, 0.5077128108866705, 0.4943021952370207, 0.4814225838533537, 0.469428296935101, 0.45866731774557307, 0.44944886110124255, 0.4420114764957013, 0.43649918226463463, 0.43295238251331186, 0.43131654524510266, 0.43146606153616474, 0.43323593792843124, 0.4364522652983221, 0.44095423942765566, 0.44660451481401, 0.4532887960336483, 0.46090828570633896, 0.4693694273250536, 0.47857467047147656, 0.4884164987210424, 0.49877541726401803, 0.5095214495613988, 0.5205180835248103, 0.5316274629947579, 0.5427157737326372, 0.5536580627413125, 0.5643420402846341, 0.5746706812056607, 0.5845636400454665, 0.5939576206273385, 0.6028059051630729, 0.6110772655932787, 0.6187544664332706, 0.6258325375746521, 0.6323169578813608, 0.6382218532264368, 0.6435682800116235, 0.6483826389861737, 0.6526952444930865, 0.6565390603330259, 0.6599486040525838, 0.6629590153975404, 0.6656052808558922 ], [ 0.5917604280073514, 0.5809895553719253, 0.569370622883443, 0.5569518533842593, 0.5438217835971878, 0.5301169713943786, 0.516028146587377, 0.5018030959133745, 0.4877441764193605, 0.4741982876323185, 0.46153775192009133, 0.4501321946686966, 0.44031423176034196, 0.43234494457773043, 0.42638731329440904, 0.4224952534674716, 0.4206218874329893, 0.42064446067645334, 0.42239784569236116, 0.42570658232180786, 0.4304075176685314, 0.43635972842503246, 0.4434430836322827, 0.4515497413598942, 0.4605735497764094, 0.470401264020415, 0.4809076619563679, 0.4919549119868088, 0.5033953945205366, 0.5150766849219099, 0.5268474052459052, 0.5385629160291224, 0.5500901654515615, 0.5613113355166014, 0.5721261789229594, 0.5824531169165367, 0.5922292749605202, 0.6014096831158378, 0.6099658766233975, 0.6178841135567279, 0.6251633927199679, 0.6318134156023687, 0.6378525976594576, 0.6433062003179771, 0.6482046276185551, 0.6525819105392395, 0.6564743871002036, 0.6599195762261613, 0.6629552368466689, 0.665618599777527 ], [ 0.589472443548872, 0.5783834914555797, 0.5664078442101393, 0.5535903412482329, 0.5400166211403783, 0.5258213328833705, 0.5111949604191343, 0.4963875270464955, 0.4817069849748046, 0.46750994126394746, 0.45418289976565873, 0.44211380802953804, 0.43165652002341204, 0.42309425052160793, 0.41661068762410286, 0.4122771712531794, 0.41006019935485405, 0.40984674354478345, 0.41147873701845084, 0.4147858176889654, 0.4196077951108463, 0.42580354556537536, 0.4332482622903056, 0.4418240958260656, 0.4514096583452832, 0.4618723562693709, 0.4730652935047103, 0.4848285932859981, 0.49699390629429807, 0.5093905764990115, 0.5218521345299532, 0.5342221805202576, 0.546359111835478, 0.5581394652830469, 0.569459864861876, 0.5802377076266768, 0.5904107993104428, 0.5999361835863338, 0.6087884075261484, 0.6169574424252283, 0.624446443511285, 0.6312694919465586, 0.6374494235710806, 0.643015814477119, 0.6480031653905587, 0.6524493052559461, 0.6563940188122155, 0.6598778923039281, 0.6629413646744906, 0.6656239675880008 ], [ 0.587441363219362, 0.5760718475839351, 0.5637809192068906, 0.5506096683167726, 0.5366400400401027, 0.5220034072173626, 0.5068879287158383, 0.4915429699083531, 0.4762783543449715, 0.46145598646069247, 0.44747182078492836, 0.434727692836274, 0.4235953735553974, 0.4143788581482762, 0.40728381009714654, 0.40240310113127653, 0.39972322978872504, 0.39914922952509624, 0.4005390277950478, 0.403735687701494, 0.4085886084207718, 0.41496059510014827, 0.4227234494283962, 0.4317479313357463, 0.4418940047943877, 0.4530051841108972, 0.4649081244798916, 0.47741659183455587, 0.4903380535159704, 0.5034811448579944, 0.5166627279402981, 0.5297137902433807, 0.542483850762542, 0.5548438169675141, 0.5666873996473408, 0.5779312831568043, 0.5885142923516501, 0.5983958093474118, 0.6075536821200441, 0.6159818400239456, 0.6236877951360685, 0.6306901688068991, 0.637016344513904, 0.6427003141347539, 0.6477807566697882, 0.6522993666387676, 0.6562994334379718, 0.6598246620025462, 0.6629182181453527, 0.6656219779384346 ], [ 0.5856892786446598, 0.5740806601199427, 0.5615205696535238, 0.5480461077392348, 0.5337348513069593, 0.5187136231315275, 0.5031662083644628, 0.4873383369875446, 0.47153772029795615, 0.45612664912427625, 0.44150501539002796, 0.4280830643214572, 0.41624597471887004, 0.40631606333305953, 0.39852150460710845, 0.3929807131937641, 0.389707474376656, 0.388634558913529, 0.3896465780469951, 0.39261015174032043, 0.3973923771004154, 0.40386499588610886, 0.41189786633109826, 0.42134850545856045, 0.4320539473769761, 0.44382828826890036, 0.4564661029178024, 0.46974988786357297, 0.4834591531513615, 0.4973792582489544, 0.5113088830394409, 0.5250656942873705, 0.5384901759105991, 0.551447786063184, 0.5638296785013635, 0.5755522477679605, 0.5865557592287072, 0.5968023153443326, 0.6062733900953489, 0.6149671351167557, 0.6228956264348475, 0.6300821833891961, 0.6365588549629098, 0.6423641360690922, 0.6475409489505625, 0.6521349032958731, 0.6561928327312784, 0.6597615943159317, 0.6628871106366828, 0.665613630140279 ], [ 0.5842348295626955, 0.5724317790652421, 0.5596524628196142, 0.5459298726621433, 0.5313366735999563, 0.5159939908539488, 0.5000792833669486, 0.48383169300230233, 0.46755273035785794, 0.4515998568471894, 0.43637081797001315, 0.4222779257355502, 0.40971415128646166, 0.3990164928468399, 0.39043518874449545, 0.3841177320275504, 0.38011273999206024, 0.3783914324617599, 0.37887742509327754, 0.38147288617434516, 0.38607236236409054, 0.39256258176538, 0.40081315514109384, 0.4106660214963891, 0.4219300631747246, 0.43438338326063985, 0.4477819687347024, 0.4618715721825423, 0.4763997283478054, 0.49112595308659956, 0.5058293761004146, 0.5203138437339371, 0.5344108627170405, 0.5479808118110672, 0.5609127965714342, 0.5731234584826665, 0.5845550038352304, 0.5951726875331524, 0.6049619622298705, 0.6139254765604597, 0.6220800756579206, 0.6294539239703335, 0.6360838373255975, 0.6420128807717791, 0.6472882626877307, 0.6519595348066647, 0.6560770921471671, 0.659690955909226, 0.6628498154074173, 0.6656003012430204 ], [ 0.5830927272841652, 0.5711422694859345, 0.5581964543964486, 0.5442841536449545, 0.5294727060298305, 0.5138765389220917, 0.4976649846636263, 0.4810677748852936, 0.4643761949716138, 0.44793759183998094, 0.4321411962499858, 0.41739446843260736, 0.4040916611648536, 0.3925796706215939, 0.3831291655886725, 0.37591934137558947, 0.3710408903286811, 0.3685147122947607, 0.3683170591474163, 0.3703994354515555, 0.37469536661685177, 0.38111385756303157, 0.38952635674041647, 0.39975644686060596, 0.4115786716521081, 0.42472749664491294, 0.4389129673111479, 0.45383813793381433, 0.4692144170453238, 0.4847730186622135, 0.5002723892434213, 0.515502324868864, 0.5302856631627183, 0.5444782788361948, 0.5579678925716345, 0.570672036941211, 0.5825354277227778, 0.5935269418685754, 0.6036363780466497, 0.6128711549219487, 0.6212530789296486, 0.6288152863908625, 0.6355994364666341, 0.6416532042285087, 0.647028099072618, 0.6517776139643884, 0.655955695910306, 0.6596155173691802, 0.6628085214570715, 0.6655837100454723 ], [ 0.5822734005565742, 0.5702239737236683, 0.5571660417412259, 0.5431244291054625, 0.5281608513694384, 0.5123821934562337, 0.4959480563595619, 0.4790761667563139, 0.46204379360192505, 0.44518307056167994, 0.4288683982896847, 0.41349527188561763, 0.3994521599680577, 0.3870901072379471, 0.37669728958820464, 0.36848588390946374, 0.3625949133069499, 0.3591059667437551, 0.35806230888909885, 0.3594801187094587, 0.36334526618796714, 0.36959778103009805, 0.3781136297494143, 0.388694931352574, 0.40107478724651474, 0.4149353638591911, 0.42993266497402866, 0.44572075389729854, 0.4619707791184524, 0.47838343135204164, 0.4946956648767132, 0.5106833164059379, 0.5261611332020563, 0.5409812666418543, 0.5550308583496852, 0.568229065718731, 0.5805237310657535, 0.5918878412707312, 0.6023159054047451, 0.6118203679838858, 0.6204281626785362, 0.6281774929078356, 0.6351149035267757, 0.6412926846885099, 0.6467666274570999, 0.651594132470738, 0.6558326586377015, 0.6595384885381934, 0.6627657805308819, 0.6655658739351228 ], [ 0.5817827819360044, 0.5696832591775609, 0.5565680618442458, 0.5424580970777496, 0.5274092578304936, 0.5115201961489296, 0.49493940342873166, 0.47787031665688273, 0.4605727876525594, 0.44335907729188073, 0.42658285020580433, 0.4106207653404954, 0.39584833120964324, 0.3826143500048217, 0.37122033834598833, 0.361911043005794, 0.3548783567821428, 0.3502744110993242, 0.34822375623764107, 0.34882362505333786, 0.3521273403886174, 0.3581163535641532, 0.36667469204878517, 0.3775797873441771, 0.39051543647209414, 0.40510199180781364, 0.42093276823428216, 0.4376064219627849, 0.454749914547211, 0.47203156555625475, 0.48916643058717957, 0.505916828591395, 0.5220902631103743, 0.5375361270356812, 0.5521419018416858, 0.5658291619199931, 0.5785495122438193, 0.5902805296528847, 0.601021772724291, 0.6107909318130053, 0.6196201922284807, 0.6275528758176111, 0.6346404114586361, 0.6409396667323526, 0.6465106545492935, 0.6514146119838319, 0.6557124351834416, 0.6594634443706313, 0.662724446494848, 0.6655490595843395 ], [ 0.5816222441222058, 0.5695209640302741, 0.5564026506705305, 0.5422844513183195, 0.527216312049849, 0.5112881080489312, 0.4946360893842702, 0.47744749444813483, 0.45996188227885204, 0.4424676484177178, 0.42529256378930436, 0.4087882678350082, 0.39331052644127174, 0.37919931777536997, 0.36676431987228586, 0.35628057931044704, 0.3479950284517106, 0.3421380001199773, 0.3389283708498983, 0.33856099452014327, 0.3411731373487464, 0.34679980212628025, 0.3553377876634618, 0.3665368351046268, 0.38002313664723497, 0.3953451890042625, 0.4120247582205299, 0.42959885526288316, 0.447646760088027, 0.4658030801267766, 0.48376102107374297, 0.5012701734907726, 0.5181318774567424, 0.5341938689185594, 0.5493449517869368, 0.5635099224850082, 0.5766447644285912, 0.5887320838568518, 0.5997767761218161, 0.6098019404031758, 0.6188450798467309, 0.6269546291423157, 0.6341868454006006, 0.6406030854935311, 0.6462674779278166, 0.6512449827479122, 0.6555998206253196, 0.6593942429445123, 0.6626876084548385, 0.6655357286488541 ], [ 0.5817886862266299, 0.569732539622639, 0.5566634608288575, 0.5425949964918808, 0.527571075525202, 0.5116723891777202, 0.495022073218174, 0.4777896829892311, 0.4601922386597772, 0.4424911286687392, 0.4249841070878518, 0.40799269996966353, 0.39184704289249617, 0.3768720485271801, 0.36337977803418703, 0.35167153860128836, 0.342048673579281, 0.3348241889936364, 0.33032175574705724, 0.32884934722259807, 0.33064527980367636, 0.3358118177384031, 0.34426469593631437, 0.3557236672238219, 0.3697491254735694, 0.38580769689653654, 0.40334103249053815, 0.4218188327029959, 0.44076988143268725, 0.4597943502017864, 0.4785641091280746, 0.49681710988037286, 0.5143497704532416, 0.5310093314229709, 0.5466868952023494, 0.5613112385276672, 0.5748432702946328, 0.5872709867341219, 0.5986048257250661, 0.6088733785129112, 0.6181194568098294, 0.6263965326524533, 0.6337655717567323, 0.6402922744528224, 0.6460447268437938, 0.651091452347979, 0.655499842547382, 0.6593349374358665, 0.662658519123808, 0.6655284797111704 ], [ 0.5822747606040017, 0.5703083748016489, 0.5573381153109843, 0.5433740696046344, 0.5284541173455636, 0.5126494881541555, 0.4960695967083219, 0.47886528732074246, 0.4612294948891724, 0.4433944363885085, 0.42562496711423947, 0.40820880791042585, 0.39144590681352043, 0.3756407512530451, 0.3611019661206946, 0.348151690705944, 0.3371421803353942, 0.3284696509304365, 0.3225690686063904, 0.3198743100616352, 0.3207411587598237, 0.32535386553617784, 0.3336548883545158, 0.34533303477644206, 0.35987565157846013, 0.37665835233254014, 0.3950351088182159, 0.4144037013670506, 0.434240531488203, 0.4541112924279101, 0.4736674500974852, 0.4926366062701765, 0.5108115461229759, 0.5280401313499832, 0.5442166436393638, 0.5592744805507066, 0.5731798997883262, 0.5859265276969622, 0.5975304378626848, 0.608025694182941, 0.6174603154593007, 0.6258926535493194, 0.6333881906246566, 0.6400167607888174, 0.6458501936878448, 0.6509603674255697, 0.6554176479818057, 0.6592896840121953, 0.6626405200472693, 0.6655299877871202 ], [ 0.5830692226457506, 0.5712342759796851, 0.5584088586814849, 0.5445997117305494, 0.5298386634557873, 0.5141873302684415, 0.49774106963104986, 0.4806314594904131, 0.463026536801832, 0.4451282229201886, 0.42716694478781025, 0.40939451998661813, 0.392077797918267, 0.3754968393131917, 0.35995159543113636, 0.34577885798679503, 0.3333757863945119, 0.32321810873304047, 0.3158534202125244, 0.31184967318977014, 0.3116939364028353, 0.31566702274982833, 0.3237474191865068, 0.3355941261199553, 0.3506163134301126, 0.3680914951605271, 0.38728031747120617, 0.40750563280987545, 0.4281907192084255, 0.4488674271243537, 0.46916805029501973, 0.4888111755437244, 0.5075871432325633, 0.5253453803652449, 0.5419840322222164, 0.5574415627683947, 0.5716898208502129, 0.5847281408334103, 0.5965781826387699, 0.6072793394910643, 0.616884628724416, 0.6254570322124006, 0.6330662769816837, 0.6397860528078381, 0.645691659874413, 0.6508580714497133, 0.6553583875486899, 0.659262647719121, 0.6626369653752782, 0.6655429427650407 ], [ 0.5841573795954512, 0.57249206805652, 0.5598533554435756, 0.5462447182593412, 0.5316919612807832, 0.516247063578039, 0.49999126172283614, 0.4830367851679217, 0.4655266921878472, 0.44763252308239465, 0.4295501109249382, 0.4114949227550358, 0.3936996049494322, 0.37641749048522793, 0.3599357862379908, 0.3445997977035774, 0.3308438413483629, 0.31921551396868214, 0.3103705018962626, 0.3050125499669216, 0.3037688283852815, 0.3070292551021627, 0.3148186116668255, 0.3267700889617502, 0.34221314970337424, 0.3603236756003597, 0.38026634085998573, 0.40128822729623603, 0.4227600491476686, 0.44418104678132014, 0.4651656964779704, 0.48542475815403574, 0.5047470439976827, 0.5229841822136934, 0.5400385666264653, 0.5558539030183431, 0.5704076389961625, 0.5837046950065331, 0.5957720994848988, 0.6066542902763005, 0.6164089561083133, 0.6251033594663282, 0.6328111167555681, 0.6396094244581949, 0.6455767202143642, 0.6507907618433012, 0.6553270994622359, 0.6592579085131746, 0.6626511459145714, 0.6655699881709832 ], [ 0.585521610504576, 0.5740602764947105, 0.5616455794038755, 0.548277788886597, 0.5339767504642702, 0.5187849136595336, 0.502769600765385, 0.4860240685320377, 0.4686670119572889, 0.4508404826084495, 0.4327068374761575, 0.41444632270056, 0.3962580772647942, 0.37836826432842646, 0.3610488818023335, 0.3446484390754296, 0.32962995665314765, 0.3166021878053641, 0.3063185449066422, 0.2996124802511095, 0.2972525557512084, 0.2997457908555491, 0.3071733186877593, 0.31914994217997045, 0.33492909684694405, 0.3535867260073937, 0.3741930251549395, 0.39592114468563144, 0.4180911730261774, 0.4401714281689959, 0.46175983620145117, 0.4825601699111525, 0.5023601937922935, 0.5210139402302206, 0.5384280471893145, 0.5545513044975485, 0.5693664883952118, 0.582883754975025, 0.5951350964259245, 0.6061695576874535, 0.6160490465529798, 0.6248446537581845, 0.6326334445131478, 0.6394957023177805, 0.6455126100816216, 0.6507643499014792, 0.655328596144364, 0.6592793696259714, 0.6626862152022992, 0.665613661647102 ], [ 0.5871419280637533, 0.5759148498625737, 0.563756737817701, 0.5506647003284758, 0.5366527353888502, 0.521754007668676, 0.5060223939085217, 0.48953298048081634, 0.47238134423041966, 0.4546818064965786, 0.4365654911064817, 0.41817994328208064, 0.3996931265657752, 0.38130540601149965, 0.36327292315924303, 0.3459435207801263, 0.32980082303565084, 0.31550224459495374, 0.303883612269155, 0.2958938150367425, 0.29243457637526127, 0.29413075525247834, 0.3011279103406755, 0.31303336229135054, 0.329034767140069, 0.3481165823167944, 0.3692611655889572, 0.3915726602277487, 0.4143238575221766, 0.43695414089687584, 0.4590458784661274, 0.4802961842635686, 0.5004916951475824, 0.5194885293996326, 0.5371971152168726, 0.5535707960282205, 0.5685971039602802, 0.5822908370667698, 0.5946883517107144, 0.6058427062812813, 0.6158194497795909, 0.6246929473645699, 0.6325431899338309, 0.6394530606875006, 0.6455060398024237, 0.6507843269866911, 0.6553673561901825, 0.6593306704233214, 0.6627451193085335, 0.6656763384913242 ], [ 0.5889965540530891, 0.5780298846938197, 0.5661561791707399, 0.5533694338798971, 0.5396779705450633, 0.5251060530576794, 0.5096948272457278, 0.49350239090257003, 0.47660298541841795, 0.4590856760999469, 0.4410535062189765, 0.42262495872876565, 0.4039404976043792, 0.3851776374968289, 0.3665777764725848, 0.3484859575278346, 0.33139948503220557, 0.3160115295139794, 0.3032216245249058, 0.29407250014051334, 0.28958059081057735, 0.2904799704498271, 0.2969846330239296, 0.3087080601668389, 0.324789479277842, 0.3441379817335918, 0.3656604995303285, 0.3884004085344341, 0.4115879142608706, 0.4346356617896252, 0.4571110840732445, 0.4787043824000971, 0.49920037941088063, 0.5184564124979383, 0.5363857824594933, 0.5529454775320598, 0.5681269101842137, 0.581948686774542, 0.5944507387924032, 0.6056893947805656, 0.6157331484914099, 0.6246589911694719, 0.6325492404308347, 0.6394888304843314, 0.6455630406798629, 0.6508556404278595, 0.6554474243535605, 0.6594151058409832, 0.6628305319949469, 0.6657601795328276 ], [ 0.5910624831246211, 0.5803783197829937, 0.5688122422886189, 0.5563552041470872, 0.5430100919027542, 0.528792789543865, 0.5137326471221799, 0.49787227402541323, 0.4812667849761966, 0.4639830030790234, 0.4460997029990537, 0.4277107383756252, 0.40893371278137686, 0.38992742342317455, 0.3709210887520162, 0.35225648657879316, 0.33443925661778856, 0.3181861191516716, 0.30444004675824776, 0.2943107190636016, 0.28890174678270186, 0.28903788049890494, 0.2949997391565131, 0.30642168591092406, 0.3224181168999312, 0.3418462965836164, 0.3635558821564658, 0.3865410451578964, 0.40999552444005943, 0.4333076782099112, 0.45603031986625286, 0.477845967509163, 0.49853639727082066, 0.5179588025022887, 0.536028018213486, 0.5527034253364207, 0.5679791670502231, 0.5818766082238125, 0.5944382970183659, 0.6057229562664286, 0.6158012240787435, 0.6247519875759167, 0.6326592271835072, 0.639609327471118, 0.6456888268899588, 0.6509825823759201, 0.6555723220578834, 0.6595355543327657, 0.662944796729824, 0.6658670845090808 ], [ 0.5933160139693089, 0.5829325740462445, 0.5716930154266595, 0.5595853519399404, 0.5466073520668416, 0.5327671683591687, 0.5180834761849675, 0.5025851429583728, 0.48631066831386016, 0.4693079988608578, 0.4516358489621429, 0.4333683261932546, 0.4146053535829784, 0.39549184545378224, 0.3762483598040294, 0.35721421764965533, 0.3388995612569284, 0.3220337743192159, 0.30758312342515143, 0.2966947963962409, 0.2905259060457886, 0.28996502810554997, 0.29535110513773505, 0.30635288871811284, 0.32208731032868865, 0.3413890158455556, 0.363073387273408, 0.38610000893011853, 0.40963375336595803, 0.43304161428615967, 0.45586203720444896, 0.4777687885541476, 0.4985389970324304, 0.5180279888535821, 0.5361504768435398, 0.5528667162326466, 0.5681722153583566, 0.5820898762105146, 0.5946637704633817, 0.6059540343160165, 0.6160325680563274, 0.6249793606636996, 0.6328793414061941, 0.639819704961063, 0.6458876771349843, 0.651168694567413, 0.6557449706836264, 0.6596944160554414, 0.663089876885075, 0.6659986519670626 ], [ 0.5957332319894952, 0.585665109804836, 0.5747669854799126, 0.5630240809658813, 0.5504294405350842, 0.5369842451657063, 0.52269776036634, 0.5075870253399696, 0.49167661198532947, 0.47499912183091125, 0.45759755830605237, 0.4395312832712726, 0.4208878411041347, 0.4018032919390723, 0.3824934251579123, 0.3632965934473812, 0.3447246948077914, 0.32751032627801613, 0.3126242606498794, 0.3012220319764301, 0.29447850305189094, 0.29331445567501974, 0.29811323917935223, 0.3085880420062408, 0.3238857868246534, 0.3428502395116448, 0.3642885742140796, 0.38714284579172553, 0.41055820061137654, 0.4338839939999479, 0.4566448766257122, 0.478504839764942, 0.49923466920451537, 0.5186859489205314, 0.536771449246616, 0.553450628466584, 0.5687188624515087, 0.5825992599767117, 0.5951362358599952, 0.606390290267015, 0.6164336503171447, 0.6253465717422615, 0.6332141868832487, 0.640123835484598, 0.6461628394125192, 0.6514166915225639, 0.6559676295426373, 0.6598935627410196, 0.6632673152217987, 0.666156146536275 ], [ 0.5982904328038213, 0.5885489109009155, 0.5780035681533803, 0.5666370327454048, 0.554438090222082, 0.541401798853863, 0.527529375456086, 0.5128280312546645, 0.4973111506950007, 0.4809995144920848, 0.4639246749872167, 0.4461360687876841, 0.4277139109039076, 0.40879016457850453, 0.3895795522977092, 0.37042099492116665, 0.35182590639099137, 0.33452187052275795, 0.3194674679675036, 0.3078000610323211, 0.3006785394608882, 0.2990239591835435, 0.30324677645432807, 0.3131097774843458, 0.32781357169046077, 0.3462414609541889, 0.36721909791006174, 0.3896895050624849, 0.4127886925878893, 0.43585322500942913, 0.4583952775070974, 0.48006848418043885, 0.5006358221017392, 0.519943355214476, 0.537900113342823, 0.5544630712488312, 0.5696259441754172, 0.5834106838753457, 0.5958608374507729, 0.607036194355226, 0.6170083533929479, 0.6258569869755676, 0.6336666736550348, 0.640524225015688, 0.6465164615651178, 0.6517284041635182, 0.6562418500268042, 0.6601343003768366, 0.6634782035125198, 0.6663404742185816 ], [ 0.6009644807811859, 0.5915578717667704, 0.5813735189478916, 0.5703917059211366, 0.558597486197483, 0.5459807062639883, 0.5325359423279346, 0.5182625864801028, 0.5031655172212774, 0.4872570613917657, 0.4705612973920435, 0.45312213495882325, 0.4350169557261918, 0.41637773976710013, 0.3974212001748909, 0.37848788600702954, 0.36008647597984, 0.3429322406866422, 0.3279573161384636, 0.3162586258449561, 0.30895057831855804, 0.3069262711973104, 0.31060538831033124, 0.31980040240841157, 0.3337827017882394, 0.35150067098861876, 0.3718231031571987, 0.3937125875999718, 0.4163076699467975, 0.43893823453727676, 0.46110637778218655, 0.48245559030650065, 0.5027401145832943, 0.5217990630857195, 0.5395361409676621, 0.5559042819628497, 0.5708940900586412, 0.5845250436752817, 0.596838641904481, 0.6078929100130412, 0.6177578793378247, 0.6265118018277428, 0.6342379562874212, 0.6410219622552608, 0.6469495494396384, 0.6521047452003484, 0.6565684469299512, 0.6604173454381106, 0.6637231628584173, 0.6665521661158088 ], [ 0.6037331010108824, 0.5946670990404963, 0.5848492316961508, 0.5742577344236376, 0.5628745020412622, 0.5506851128551892, 0.5376789092431243, 0.5238494111110357, 0.5091955186090307, 0.4937241932484381, 0.477455586056183, 0.4604318796212552, 0.44273135541112996, 0.42448923181608134, 0.405926333898632, 0.38738509654276293, 0.3693688847882207, 0.35257408875238144, 0.3378947388329206, 0.32637011263148163, 0.31904860701403764, 0.3167734122756216, 0.3199574305952373, 0.32845876893005654, 0.34162895613013317, 0.35849980324894737, 0.37800362731039716, 0.39913980794976084, 0.42106150083666893, 0.4430991386469647, 0.46474833774053087, 0.48564367763610466, 0.5055305129776623, 0.524240125322953, 0.5416696931202668, 0.5577668130253719, 0.5725177068090043, 0.585938188916192, 0.5980666205031971, 0.6089582763430365, 0.6186807327420966, 0.6273100247963472, 0.6349274184696411, 0.6416167042129243, 0.6474619535441647, 0.6525456969238067, 0.6569474874056136, 0.6607428150101362, 0.6640023349489631, 0.6667913707779691 ], [ 0.606575106497344, 0.5978531314003759, 0.5884049360587473, 0.5782070439281299, 0.5672387938936004, 0.5554824427470726, 0.5429234603615464, 0.529551319747974, 0.5153612413281784, 0.5003575428218159, 0.48455946428473323, 0.468010554275976, 0.4507928503489618, 0.43304702044441473, 0.4149990700830298, 0.39699267090392015, 0.37952289453413357, 0.3632613909947899, 0.3490550512749159, 0.33787348667943023, 0.33068489104536825, 0.32826777002904994, 0.3310156161922213, 0.3388254980603073, 0.3511312654282886, 0.3670585739766537, 0.3856179706217089, 0.4058601503258464, 0.426964474890526, 0.4482698364629254, 0.46927004392647387, 0.48959305577899054, 0.5089760687846905, 0.5272423344995619, 0.5442818054777265, 0.5600358101869075, 0.5744851814565592, 0.587641072179804, 0.5995377591001547, 0.6102268890087169, 0.6197727799516277, 0.6282485204082076, 0.6357327038609691, 0.6423066979825977, 0.6480523840915897, 0.6530503212979508, 0.6573782974634893, 0.6611102307150271, 0.6643153841915124, 0.6670578551116765 ], [ 0.6094705648797184, 0.6010940860198126, 0.5920168080716655, 0.5822139081989666, 0.5716627831820497, 0.5603432901604062, 0.5482383045305796, 0.5353349091243784, 0.5216266608462169, 0.5071175323482522, 0.4918282862479076, 0.47580618040429395, 0.45913896154924866, 0.4419739481111444, 0.424542378949454, 0.4071876904272088, 0.3903934019574369, 0.37480137519556794, 0.361204903489603, 0.35049672152194833, 0.34355729222773623, 0.34109236117473446, 0.3434672541874836, 0.3506102470489499, 0.362034139971074, 0.37696162183984555, 0.3944901271843113, 0.4137325964330902, 0.43390483358098714, 0.4543621619128527, 0.4746019823843033, 0.49424883433616884, 0.5130333437699978, 0.5307712479034951, 0.5473451354483398, 0.5626895633808628, 0.5767792913255506, 0.5896200563383339, 0.6012412894683468, 0.6116902749031208, 0.6210273810688339, 0.6293221089219335, 0.6366497912611209, 0.6430888372520494, 0.6487184533167006, 0.6536167915004876, 0.6578594853502233, 0.6615185359394321, 0.6646615103226801, 0.6673510135492254 ], [ 0.6124009106729715, 0.6043697415942508, 0.5956630088928074, 0.5862549269560978, 0.5761215572984268, 0.5652412298953919, 0.5535953902810193, 0.5411701860457153, 0.5279592122585037, 0.513967947256404, 0.49922051609381735, 0.4837694919274538, 0.4677094267914699, 0.45119457223492615, 0.43446058676547894, 0.4178485833183363, 0.4018272219903832, 0.38700448512644436, 0.3741160350124684, 0.3639746374030457, 0.35737091681347016, 0.35493524490212136, 0.3569996263303181, 0.3635159001685266, 0.37406887858684795, 0.38797580659517716, 0.40442413123802273, 0.42259603768143694, 0.4417519672513876, 0.46127105515540595, 0.4806599487852413, 0.4995435961820009, 0.5176483511791071, 0.5347836103464593, 0.5508250149598, 0.5657002925768627, 0.5793777950653834, 0.5918573617662786, 0.6031630292434139, 0.6133371513779758, 0.6224355880174833, 0.6305237177920815, 0.6376731104339926, 0.6439587508030677, 0.6494567430044922, 0.6542424433529784, 0.6583889806329551, 0.6619661254640352, 0.6650394708152856, 0.6676698849534057 ], [ 0.6153490100191615, 0.6076615684929236, 0.5993236667449144, 0.5903089455028147, 0.5805927142374615, 0.5701525786513413, 0.5589695838377362, 0.5470301755315893, 0.5343293615512065, 0.5208755301466019, 0.5066974387908533, 0.4918539003724392, 0.4764466100325829, 0.4606362691172283, 0.4446614874981096, 0.42885861005289977, 0.4136783337900077, 0.3996917381668795, 0.38757499291225234, 0.3780610826301837, 0.37185269740256516, 0.3695062064309809, 0.37131807740622635, 0.3772569141186004, 0.3869708287657856, 0.3998653161564126, 0.4152164998841416, 0.43227906646812064, 0.4503638864835402, 0.4688801603122183, 0.48734920569253726, 0.505400478557242, 0.5227588444768019, 0.5392290624749222, 0.5546807330852827, 0.5690351166407036, 0.5822541686012098, 0.5943316280517095, 0.605285812291918, 0.6151537569228757, 0.6239863991167433, 0.6318445778717815, 0.6387956933838168, 0.6449109191261587, 0.6502628943250963, 0.654923844454072, 0.6589640873325596, 0.66245088624093, 0.6654476121269112, 0.6680131765304356 ], [ 0.6182991853590851, 0.6109527164833137, 0.602980816090687, 0.5943569341240854, 0.5850561732441448, 0.5750561328283984, 0.5643383382314013, 0.5528905376594639, 0.5407102033415483, 0.5278096140199434, 0.5142229094255087, 0.5000154706697284, 0.48529584596297426, 0.47023011901987166, 0.4550579590416486, 0.44010839670755864, 0.42581147558347915, 0.41269944773720135, 0.4013889674215371, 0.39253585624144754, 0.3867594749720082, 0.38454617954345327, 0.38615685580516873, 0.39157125565655615, 0.4004916543295948, 0.41240334024000336, 0.42666659028993814, 0.44260866433178847, 0.4595942182170534, 0.4770673066290387, 0.4945687055154352, 0.5117363980019921, 0.5282967718649177, 0.5440520092446353, 0.5588669615610296, 0.5726571443820065, 0.5853784430546997, 0.597018559578025, 0.6075899874534074, 0.61712423727677, 0.6256670584354485, 0.6332744557031729, 0.6400093546628904, 0.6459388143574034, 0.6511317163810538, 0.6556568783086606, 0.6595815490601804, 0.6629702477669808, 0.6658839086099125, 0.6683792938513422 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.041148629039525986, 0.2857678532600403, 0.8522157073020935, 0.8920990228652954, 0.4663430452346802, 0.20609870553016663, 0.30675558555234717, 0.2250502329177462, 0.28806440484970325, 0.3494522977329207, 0.40132300897942824, 0.445116106351731, 0.471791866888048, 0.4324373836464875, 0.4436284360891264, 0.3739973899742409, 0.45936881616360536, 0.44861793528239574, 0.4416146699444828, 0.49072243904581697, 0.6629438269883394, 0.4064773338609024, 0.02012301329523325, 0.9122729804366827 ], "xaxis": "x", "y": [ 0.4494225084781647, 0.600216269493103, 0.11601513624191284, 0.7307854890823364, 0.2460964322090149, 0.8346359729766846, 0.6267194874247792, 0.7188857905091293, 0.5274124193294614, 0.6720304627522604, 0.7339013019194774, 0.8102739296888797, 0.7631026767583268, 0.8029384163526634, 0.7799105194147483, 0.7716763982631036, 0.8373565525852932, 0.9071568460475623, 0.9258527883134839, 0.9122897350911305, 0.040698133409023285, 0.938608765232727, 0.6221157927066088, 0.9893355583772063 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.041148629039525986, 0.2857678532600403, 0.8522157073020935, 0.8920990228652954, 0.4663430452346802, 0.20609870553016663, 0.30675558555234717, 0.2250502329177462, 0.28806440484970325, 0.3494522977329207, 0.40132300897942824, 0.445116106351731, 0.471791866888048, 0.4324373836464875, 0.4436284360891264, 0.3739973899742409, 0.45936881616360536, 0.44861793528239574, 0.4416146699444828, 0.49072243904581697, 0.6629438269883394, 0.4064773338609024, 0.02012301329523325, 0.9122729804366827 ], "xaxis": "x2", "y": [ 0.4494225084781647, 0.600216269493103, 0.11601513624191284, 0.7307854890823364, 0.2460964322090149, 0.8346359729766846, 0.6267194874247792, 0.7188857905091293, 0.5274124193294614, 0.6720304627522604, 0.7339013019194774, 0.8102739296888797, 0.7631026767583268, 0.8029384163526634, 0.7799105194147483, 0.7716763982631036, 0.8373565525852932, 0.9071568460475623, 0.9258527883134839, 0.9122897350911305, 0.040698133409023285, 0.938608765232727, 0.6221157927066088, 0.9893355583772063 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:08] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 1.0071817517138761, 1.0095297755543775, 1.012546344709097, 1.0162309299900494, 1.0205807902109258, 1.0255910606765746, 1.0312548209615104, 1.0375631363172366, 1.0445050712173012, 1.0520676776875015, 1.0602359646061719, 1.068992856671735, 1.0783191530011356, 1.088193495340669, 1.0985923548181415, 1.1094900443390547, 1.1208587614722687, 1.1326686643074495, 1.144887980560645, 1.1574831483366146, 1.1704189855212765, 1.1836588837978348, 1.1971650227240997, 1.2108985991104702, 1.2248200670189788, 1.2388893839804622, 1.2530662594268311, 1.2673104017956345, 1.2815817612390428, 1.2958407653245272, 1.310048545529885, 1.324167152699532, 1.3381597599387642, 1.3519908516806574, 1.3656263978723586, 1.3790340124017912, 1.3921830950324667, 1.405044956242135, 1.4175929244804026, 1.4298024354789174, 1.4416511033724764, 1.45311877352521, 1.4641875571055702, 1.4748418476182217, 1.4850683197778813, 1.4948559112964817, 1.5041957883447847, 1.5130812956363675, 1.521507892257963, 1.5294730745284442 ], [ 1.004570493827481, 1.0068894094862144, 1.009880821740254, 1.0135443179677102, 1.0178773336588045, 1.022875248447919, 1.0285314542321904, 1.0348373893482, 1.0417825378761536, 1.049354398104689, 1.0575384283174276, 1.0663179808518668, 1.0756742366041008, 1.0855861518552987, 1.0960304277466058, 1.1069815103272336, 1.118411626282888, 1.1302908566125711, 1.1425872479641832, 1.155266959254289, 1.1682944396694679, 1.1816326331739777, 1.1952432041704169, 1.2090867788826078, 1.2231231972492287, 1.2373117705320757, 1.2516115403690002, 1.2659815355696786, 1.2803810235131692, 1.2947697535263218, 1.3091081900828905, 1.323357734056336, 1.3374809305846358, 1.351441662368435, 1.3652053274336187, 1.3787390005560465, 1.3920115776820805, 1.404993902794357, 1.4176588767792022, 1.429981547959009, 1.4419391840676965, 1.4535113255755838, 1.4646798204143825, 1.4754288403150557, 1.4857448791484538, 1.495616733847491, 1.505035468683856, 1.513994363864648, 1.5224888495968285, 1.5305164269317626 ], [ 1.0023950064091012, 1.0046808152846567, 1.0076420747115054, 1.011278507038794, 1.0155877596228644, 1.020565508494825, 1.026205525589083, 1.0324997031864842, 1.0394380354459463, 1.0470085628360988, 1.0551972900699769, 1.0639880912028477, 1.073362616649161, 1.0833002161323446, 1.0937778893898982, 1.104770273346073, 1.1162496709858303, 1.128186123788527, 1.140547526649021, 1.1532997819224424, 1.166406987639458, 1.1798316540153586, 1.1935349420202839, 1.2074769178605094, 1.2216168176107742, 1.2359133168155523, 1.2503248005452685, 1.2648096300781142, 1.279326403028516, 1.2938342043280144, 1.308292845967881, 1.3226630938308808, 1.3369068802759152, 1.3509875014030253, 1.3648697981291062, 1.3785203203603777, 1.39190747366924, 1.4050016479843275, 1.4177753278946488, 1.4302031842625138, 1.442262146943359, 1.4539314585299155, 1.4651927091770944, 1.4760298527225433, 1.486429204495221, 1.4963794213954738, 1.5058714650287017, 1.514898548872837, 1.5234560706488112, 1.531541531234002 ], [ 1.0006722928684237, 1.0029208582538174, 1.005846774955639, 1.009449922133373, 1.0137281991021974, 1.0186776365925714, 1.024292461537168, 1.030565108800296, 1.0374861808365972, 1.0450443633475923, 1.053226310533479, 1.0620165168332703, 1.0713971929012691, 1.081348162216319, 1.0918467917117294, 1.102867965843973, 1.1143841092704192, 1.126365259338402, 1.1387791862737864, 1.1515915564839785, 1.1647661327846666, 1.1782650045393561, 1.1920488405182117, 1.2060771575702522, 1.220308598797618, 1.2347012156843242, 1.2492127494561167, 1.2638009077556198, 1.278423633457839, 1.2930393630981032, 1.3076072729262227, 1.32208751103821, 1.3364414143788368, 1.3506317096674254, 1.364622697490827, 1.3783804189480933, 1.3918728043357562, 1.4050698034461526, 1.4179434971267697, 1.430468189827364, 1.4426204829525058, 1.4543793289471125, 1.465726066174436, 1.476644434801741, 1.4871205740854991, 1.497143001641411, 1.506702575487567, 1.5157924398529403, 1.5244079559389372, 1.532546618998999 ], [ 0.9994182239120177, 1.001625272726892, 1.0045104692708924, 1.008073875342646, 1.0123136876746732, 1.0172263565687047, 1.0228066463234766, 1.0290476307457432, 1.0359406262298272, 1.043475073307073, 1.0516383839049186, 1.0604157750350571, 1.0697901100911442, 1.0797417667706566, 1.0902485466027125, 1.101285636063119, 1.1128256241299979, 1.1248385765237012, 1.1372921631826978, 1.1501518329137468, 1.1633810275949847, 1.1769414276587566, 1.1907932206322882, 1.2048953850541126, 1.219205982918087, 1.2336824547679413, 1.2482819125565467, 1.2629614263177251, 1.2776783015282513, 1.2923903447413756, 1.3070561156469562, 1.3216351641633581, 1.3360882515072532, 1.3503775544362218, 1.364466852034616, 1.3783216945343568, 1.3919095537465118, 1.405199954742961, 1.418164588484585, 1.4307774051547084, 1.4430146880340688, 1.4548551078529202, 1.4662797576809288, 1.477272168567338, 1.48781830632001, 1.4979065500075002, 1.507527652975534, 1.516674687379206, 1.5253429734340362, 1.5335299947732848 ], [ 0.9986473615396292, 1.0008084874277319, 1.003647408207078, 1.007164398751747, 1.0113580044764012, 1.016225166917839, 1.0217612774781104, 1.0279601526527156, 1.03481393519955, 1.0423129356682763, 1.0504454359208113, 1.0591974798504995, 1.0685526763754962, 1.0784920365510935, 1.0889938613472931, 1.1000336904206494, 1.111584316090743, 1.1236158614461709, 1.136095917460054, 1.1489897313053852, 1.1622604366253004, 1.1758693161083666, 1.1897760870699174, 1.203939201582686, 1.2183161538057041, 1.2328637883573843, 1.247538604743905, 1.262297053913384, 1.2770958239191106, 1.2918921124282794, 1.3066438844096813, 1.321310113788332, 1.3358510081878778, 1.3502282161137757, 1.364405016085034, 1.3783464873201767, 1.3920196616441647, 1.4053936563243927, 1.4184397875806625, 1.4311316645591718, 1.443445263623601, 1.4553589829048839, 1.4668536771688148, 1.477912673208559, 1.4885217661443484, 1.4986691972103579, 1.5083456138201976, 1.5175440129181466, 1.5262596688318772, 1.5344900470331373 ], [ 0.998372785028973, 1.0004834532633156, 1.0032703773801352, 1.0067340810528964, 1.010873515842782, 1.0156861930394356, 1.0211682279528218, 1.0273142902179282, 1.0341174671067868, 1.0415690585873427, 1.0496583310028131, 1.0583722597913403, 1.0676952906874329, 1.0776091442509788, 1.0880926817311274, 1.0991218426403797, 1.1106696572023833, 1.1227063308617389, 1.1351993936977194, 1.1481139049044118, 1.1614127012870867, 1.175056678654595, 1.1890050957095326, 1.2032158912310802, 1.2176460067528174, 1.2322517083734383, 1.2469889026796555, 1.26181344294011, 1.276681422716098, 1.2915494548270159, 1.3063749342182989, 1.3211162837298747, 1.335733182079625, 1.3501867735861732, 1.3644398592840996, 1.3784570691560933, 1.3922050152416436, 1.4056524253993912, 1.4187702575158148, 1.4315317939796646, 1.4439127162900038, 1.4558911597427242, 1.4674477482506583, 1.4785656094958337, 1.489230370787154, 1.4994301361960714, 1.5091554457587977, 1.5183992177548038, 1.527156675286809, 1.5354252585846637 ], [ 0.998605923880907, 1.0006614786564798, 1.003390537013812, 1.0067939131751478, 1.0108710288264726, 1.0156200502264732, 1.0210379198217716, 1.0271202764260796, 1.0338612741654185, 1.041253324169027, 1.0492867920733915, 1.0579496877451653, 1.067227381492284, 1.0771023747195674, 1.0875541443030747, 1.0985590707072892, 1.1100904514780674, 1.1221185950933397, 1.1346109855870472, 1.1475325058061612, 1.160845706284478, 1.1745111070804912, 1.188487521090948, 1.202732388941932, 1.2172021172916607, 1.2318524140599265, 1.2466386156126954, 1.2615160022196241, 1.2764400991508738, 1.2913669615976064, 1.3062534422119159, 1.3210574404975375, 1.335738133575505, 1.3502561880298598, 1.364573952637287, 1.3786556318259897, 1.3924674397165064, 1.4059777345893694, 1.4191571336178586, 1.4319786077123577, 1.4444175563561032, 1.4564518623779228, 1.4680619267099961, 1.479230683318181, 1.48994359466594, 1.500188628274496, 1.509956215161523, 1.5192391911678673, 1.5280327224035914, 1.5363342162485132 ], [ 0.9993564037270004, 1.0013520785956915, 1.004017275977775, 1.0073531492042664, 1.0113596607752813, 1.0160357233964625, 1.0213792152405183, 1.0273868642964454, 1.0340540159828782, 1.0413743142763234, 1.0493393366516341, 1.0579382260311117, 1.0671573592688035, 1.0769800832651684, 1.0873865389531256, 1.0983535823296813, 1.1098548020753758, 1.1218606260261594, 1.1343385040915768, 1.1472531529201164, 1.160566847203504, 1.174239743411207, 1.1882302234231297, 1.2024952475546948, 1.2169907085403975, 1.2316717799668475, 1.2464932543208094, 1.2614098672015694, 1.2763766053411645, 1.2913489969049992, 1.3062833831456881, 1.3211371708939235, 1.3358690656314518, 1.350439285038055, 1.3648097529691525, 1.3789442738297577, 1.3928086872886962, 1.4063710032429628, 1.419601516913083, 1.4324729039399522, 1.4449602953718519, 1.4570413324850926, 1.4686962014765768, 1.4799076482019546, 1.490660973305807, 1.5009440082934673, 1.510747073317956, 1.520062917688133, 1.5288866443322386, 1.5372156196614692 ], [ 1.0006319121494778, 1.002562844568756, 1.0051580875789285, 1.0084191898037034, 1.0123467319945805, 1.0169404702613887, 1.0221993308942643, 1.0281212527963488, 1.0347028965259182, 1.041939257591022, 1.0498232326200874, 1.0583451892039228, 1.0674925845649754, 1.077249667215357, 1.08759728239617, 1.0985127890234614, 1.109970084966851, 1.1219397296725628, 1.134389148519489, 1.1472829014300838, 1.1605829984564404, 1.1742492466008825, 1.1882396143814051, 1.202510603143601, 1.2170176165364466, 1.231715321727847, 1.2465579977533812, 1.2614998678502793, 1.2764954137494602, 1.291499670722431, 1.3064685027561378, 1.321358857605426, 1.3361290016956382, 1.3507387349557711, 1.3651495856901208, 1.3793249855718477, 1.3932304247895455, 1.4068335873176818, 1.4201044662306066, 1.4330154589507755, 1.4455414423258235, 1.457659827472789, 1.46935059441552, 1.4805963066727053, 1.4913821061259325, 1.50169568870189, 1.511527261630792, 1.5208694832807284, 1.5297173868019918, 1.5380682890320274 ], [ 1.0024380920524492, 1.004299343279095, 1.006818475082999, 1.0099974959994247, 1.0138376890470717, 1.0183397549909383, 1.0235037823216915, 1.0293290415000138, 1.0358136281828687, 1.04295400163885, 1.0507444764189346, 1.0591767264546292, 1.0682393526582847, 1.0779175510651626, 1.0881929023297354, 1.0990432881641925, 1.110442928156808, 1.1223625221926832, 1.1347694793103744, 1.1476282125702504, 1.1609004804630247, 1.1745457576613116, 1.1885216207935851, 1.202784137891033, 1.2172882529096856, 1.2319881591024273, 1.246837656951581, 1.2617904938824238, 1.2768006841047101, 1.2918228077317373, 1.306812288866079, 1.3217256526747836, 1.3365207616550119, 1.3511570313566323, 1.3655956258165587, 1.3797996329004891, 1.3937342196648563, 1.4073667677657888, 1.4206669888689483, 1.43360701996734, 1.4461614985042925, 1.4583076172322422, 1.4700251588186972, 1.4812965103386622, 1.492106657963659, 1.5024431623641354, 1.5122961155732675, 1.5216580803030295, 1.5305240129432693, 1.5388911716970828 ], [ 1.0047784703948959, 1.0065650522502985, 1.0090018951265958, 1.0120915412857863, 1.0158360661886103, 1.0202372191749882, 1.0252963640309778, 1.031014218876447, 1.0373904266935663, 1.0444230124263287, 1.0521077952434652, 1.0604378242204193, 1.0694028946178453, 1.0789891843662431, 1.0891790309511937, 1.0999508513928742, 1.1112791946793643, 1.123134907577574, 1.1354853908086076, 1.1482949221210026, 1.1615250246444848, 1.1751348620000948, 1.1890816451783746, 1.2033210396472165, 1.2178075642182467, 1.2324949757573875, 1.2473366358502675, 1.2622858570674402, 1.277296227585648, 1.2923219136865065, 1.3073179401455288, 1.3222404488076493, 1.3370469357746535, 1.3516964676503866, 1.3661498772381326, 1.3803699389903932, 1.3943215243989393, 1.4079717374018463, 1.4212900297906406, 1.4342482965371994, 1.4468209509370673, 1.4589849794897993, 1.470719976511231, 1.4820081585970093, 1.492834359226908, 1.5031860040073735, 1.5130530672844777, 1.5224280111066282, 1.5313057077616903, 1.539683347341186 ], [ 1.007654429403768, 1.0093613397469716, 1.0117097464590523, 1.0147028091832884, 1.0183434914523821, 1.022634695706762, 1.0275791699303278, 1.0331791875033414, 1.0394360389813613, 1.046349402510451, 1.0539166729768101, 1.0621323278248647, 1.070987392888494, 1.080469049995116, 1.0905604051983764, 1.1012404166483085, 1.1124839667080682, 1.1242620544932302, 1.1365420817638756, 1.1492882056484188, 1.1624617345526882, 1.1760215475837195, 1.189924522025134, 1.204125957311082, 1.2185799872952594, 1.2332399753158136, 1.2480588886375337, 1.262989650384259, 1.2779854681499658, 1.2930001391899466, 1.3079883325282537, 1.3229058485443377, 1.3377098566795114, 1.3523591118784117, 1.366814150289335, 1.3810374646192944, 1.3949936593988792, 1.408649586277171, 1.4219744593540866, 1.434939950478496, 1.4475202644056384, 1.4596921937222822, 1.4714351535168424, 1.4827311958926297, 1.4935650045919857, 1.5039238702082638, 1.513797646700096, 1.52317869017374, 1.5320617811493553, 1.54044403175998 ], [ 1.0110652254112802, 1.0126874944341806, 1.0149414093783689, 1.017830841191096, 1.0213597415565407, 1.0255322687092316, 1.0303526559516198, 1.0358248267615642, 1.0419518031512862, 1.0487349856079862, 1.056173397014352, 1.0642629786058078, 1.0729960074200633, 1.0823606786409388, 1.0923408695905292, 1.1029160799133642, 1.1140615271999599, 1.125748369121717, 1.1379440208445377, 1.1506125382253627, 1.1637150413025508, 1.1772101574859413, 1.1910544687205933, 1.2052029512324467, 1.2196094000512514, 1.2342268333160822, 1.2490078734697614, 1.2639051039508737, 1.2788714010133337, 1.2938602409527529, 1.3088259833894527, 1.3237241314253152, 1.338511569516757, 1.3531467798349508, 1.3675900377548504, 1.3818035869544194, 1.395751794437894, 1.4094012856405176, 1.4227210596413697, 1.4356825844180072, 1.448259872030953, 1.460429533633001, 1.4721708142618501, 1.4834656074926547, 1.494298450195791, 1.5046564978554526, 1.5145294811444319, 1.523909644705566, 1.53279166934422, 1.5411725790737407 ], [ 1.0150080567643984, 1.0165408063929635, 1.018694337316488, 1.0214733360624477, 1.0248828457003178, 1.0289283784531982, 1.033615742567739, 1.0389505894683713, 1.0449377360026988, 1.0515803522139449, 1.0588791198620298, 1.0668314601366133, 1.0754309059654465, 1.0846666634075757, 1.094523376030776, 1.10498108163556, 1.1160153347057518, 1.127597460322234, 1.1396949041564757, 1.1522716462466958, 1.1652886514725027, 1.178704335462393, 1.1924750301624754, 1.2065554380011039, 1.220899067356508, 1.2354586449052294, 1.2501865025168362, 1.265034937809884, 1.2799565484360402, 1.2949045407363198, 1.3098330137160226, 1.3246972193918993, 1.339453800537965, 1.3540610067420573, 1.3684788895191338, 1.38266947703742, 1.3965969288219628, 1.4102276706235628, 1.423530509494781, 1.4364767290091338, 1.449040164504168, 1.4611972582293324, 1.472927094337975, 1.4842114137785367, 1.4950346093076308, 1.5053837010588764, 1.515248293342848, 1.5246205136116115, 1.533494934778618, 1.5418684823260533 ], [ 1.019478176493783, 1.0209166951193616, 1.0229641958892854, 1.0256262951201938, 1.0289092321169464, 1.0328199641361528, 1.0373659490613762, 1.0425546234283578, 1.0483926384087425, 1.0548849562828866, 1.0620339256165525, 1.0698384440358897, 1.0782932897090913, 1.0873886665635188, 1.097109973601402, 1.107437781900769, 1.118347986458331, 1.1298120931947182, 1.141797601725304, 1.1542684490588278, 1.1671854858371982, 1.1805069634447478, 1.1941890163763527, 1.2081861292685343, 1.2224515818985375, 1.2369378683445782, 1.2515970885437184, 1.266381311861642, 1.2812429131603453, 1.2961348823500276, 1.3110111086447545, 1.3258266407896409, 1.3405379244506732, 1.3551030178032142, 1.3694817861562494, 1.3836360762326694, 1.3975298705124466, 1.4111294218519044, 1.4244033684317252, 1.4373228289700417, 1.4498614780729573, 1.4619956015889954, 1.473704131888073, 1.4849686630989618, 1.4957734465057366, 1.506105366515214, 1.5159538978503098, 1.5253110448844476, 1.5341712642921272, 1.5425313724352507 ], [ 1.0244690375474317, 1.0258088718583755, 1.0277450362493425, 1.0302841998469452, 1.0334339029637716, 1.0372026294959262, 1.0415995440886863, 1.046633902308819, 1.0523142032044752, 1.0586471982440182, 1.0656368875902038, 1.0732836229107887, 1.0815834032491256, 1.0905274090362214, 1.1001017805237983, 1.110287618032711, 1.1210611647829525, 1.1323941272959335, 1.1442540902197913, 1.156604988530957, 1.1694076077422728, 1.182620090297442, 1.196198432883959, 1.2100969646485042, 1.2242688002719926, 1.2386662647271955, 1.2532412885167448, 1.267945773481124, 1.2827319300525368, 1.2975525872526685, 1.31236147689881, 1.3271134934751554, 1.3417649310040771, 1.3562736980604475, 1.3705995118435583, 1.38470407198099, 1.3985512145064742, 1.4121070462448606, 1.425340059664975, 1.4382212281352513, 1.450724081445803, 1.4628247614493621, 1.474502057723876, 1.485737423270413, 1.4965149704256282, 1.5068214473792843, 1.5166461959310231, 1.5259810913821577, 1.534820465720311, 1.543161015501338 ], [ 1.0299724488860456, 1.0312095135315729, 1.0330294792340418, 1.0354401977363852, 1.0384506133205933, 1.042070807170486, 1.046311689015375, 1.0511843433501398, 1.056699104583708, 1.0628644852314562, 1.0696861001289844, 1.0771657158095178, 1.0853005166675431, 1.0940826326625346, 1.10349893040152, 1.1135310386124382, 1.1241555624359996, 1.1353444364574687, 1.1470653699490918, 1.1592823454493402, 1.1719561406475243, 1.1850448518375096, 1.1985044041585449, 1.2122890392577903, 1.2263517750031794, 1.2406448346863976, 1.2551200450442255, 1.2697292036255676, 1.28442441673094, 1.2991584094983086, 1.313884809813116, 1.3285584076620482, 1.3431353913877353, 1.3575735620777434, 1.371832527067372, 1.3858738732753588, 1.3996613208432036, 1.413160857327361, 1.4263408525106591, 1.4391721537657312, 1.4516281618256726, 1.4636848868011574, 1.4753209843302655, 1.4865177718558906, 1.497259225189738, 1.5075319557325744, 1.5173251689643568, 1.5266306050798741, 1.5354424629088674, 1.5437573085077299 ], [ 1.0359787109470793, 1.0371094149708147, 1.0388088759734448, 1.041086261790975, 1.0439520201767334, 1.047417888938865, 1.0514965431220136, 1.0562008835770265, 1.0615430436998494, 1.0675332465386154, 1.074178666047794, 1.081482430953825, 1.08944286759918, 1.0980530259374712, 1.1073004859497941, 1.117167409187351, 1.1276307838192603, 1.1386628084695696, 1.1502313653981353, 1.162300542730885, 1.174831175348011, 1.1877813829678832, 1.2011070912266046, 1.214762527066382, 1.2287006837176606, 1.2428737532932939, 1.2572335268055492, 1.2717317625218658, 1.2863205241919218, 1.3009524909561738, 1.3155812407943814, 1.3301615092700194, 1.3446494251294188, 1.359002724063677, 1.3731809416663565, 1.3871455863426334, 1.4008602926642215, 1.4142909554319254, 1.4274058445168045, 1.4401757004101532, 1.4525738103300136, 1.464576064711578, 1.4761609939530078, 1.4873097853942272, 1.4980062806690464, 1.508236953780369, 1.5179908704917455, 1.5272596298903576, 1.5360372892402694, 1.5443202734936574 ], [ 1.042476691308341, 1.043498077675078, 1.0450734018698524, 1.0472132806577978, 1.0499297598229316, 1.0532362828780073, 1.057147295286503, 1.0616774833484337, 1.0668407238826094, 1.0726488823361437, 1.0791106221622637, 1.0862303723040379, 1.094007553440913, 1.1024361064474608, 1.1115043158876239, 1.1211948873077942, 1.1314852211950461, 1.1423478248370436, 1.1537508102536822, 1.1656584368911636, 1.1780316685896484, 1.1908287237738073, 1.2040056052933215, 1.2175166018912278, 1.231314757195521, 1.245352304771396, 1.2595810694664968, 1.273952836297145, 1.288419688664825, 1.3029343179089092, 1.3174503062019816, 1.3319223846546562, 1.3463066682710725, 1.3605608691237174, 1.374644488823666, 1.388518991072121, 1.4021479548066162, 1.41549720821447, 1.428534943688129, 1.4412318136507642, 1.4535610070933975, 1.4654983066409397, 1.4770221260056533, 1.4881135277904605, 1.4987562217651411, 1.5089365439466182, 1.5186434170564997, 1.5278682931903138, 1.5366050797959914, 1.5448500503081821 ], [ 1.0494537991885147, 1.050363690458828, 1.0518120378771445, 1.0538110338561446, 1.0563744104870625, 1.0595173581969777, 1.0632560878985586, 1.0676070285555426, 1.0725857324287433, 1.078205627987053, 1.0844767901005505, 1.0914048813185373, 1.0989903685122346, 1.1072280575273903, 1.1161069345928776, 1.1256102679701308, 1.13571590797495, 1.1463967232888712, 1.1576211199195445, 1.1693536008696765, 1.1815553361395148, 1.1941847225045552, 1.207197920118838, 1.2205493585358245, 1.2341922085818045, 1.2480788190636158, 1.2621611188949553, 1.276390986160874, 1.2907205861163837, 1.3051026802807344, 1.3194909087505329, 1.3338400476855317, 1.3481062436735338, 1.3622472263905738, 1.3762225006675572, 1.3899935187734818, 1.4035238334447262, 1.416779231942344, 1.4297278512156106, 1.4423402740993203, 1.454589606381175, 1.4664515345486988, 1.4779043640632787, 1.488929038110472, 1.499509136934265, 1.5096308580688083, 1.5192829780216979, 1.5284567962222093, 1.5371460623100934, 1.5453468880887997 ], [ 1.0568958244496411, 1.0576929642349406, 1.0590123999926504, 1.0608680139527598, 1.0632753051072001, 1.0662512472885228, 1.0698138081482529, 1.0739811125096124, 1.0787703156671284, 1.0841963257099212, 1.0902705483894068, 1.0969998132717236, 1.1043855880527975, 1.1124235227848263, 1.1211033092753293, 1.1304088048153393, 1.1403183546336892, 1.1508052485166005, 1.1618382567346284, 1.1733822030534435, 1.1853985447228998, 1.1978459394053418, 1.2106807866708384, 1.2238577371855817, 1.2373301664792047, 1.2510506126327847, 1.264971178749687, 1.2790439019394755, 1.2932210909679702, 1.307455634852502, 1.321701284613032, 1.3359129101985923, 1.3500467343447538, 1.3640605448154246, 1.3779138861677276, 1.3915682318701885, 1.4049871373175788, 1.4181363740329778, 1.4309840451394964, 1.4435006820294052, 1.4556593220640304, 1.467435567107736, 1.4788076227350035, 1.4897563180483535, 1.5002651062010952, 1.5103200459222337, 1.5199097645789559, 1.5290254035693243, 1.5376605470981246, 1.545811135635819 ], [ 1.0647866258639478, 1.0654708029721354, 1.0666603981230023, 1.0683710779847693, 1.0706201794672623, 1.0734264943843779, 1.0768097407852388, 1.0807896962405683, 1.0853850500953954, 1.0906121096563588, 1.0964835342562709, 1.1030072580881771, 1.110185709778717, 1.1180153693680694, 1.1264866452418236, 1.1355840170411444, 1.1452863763998562, 1.1555674993946787, 1.1663965952278006, 1.177738888942404, 1.1895562084390272, 1.2018075562551038, 1.2144496542343166, 1.227437454646358, 1.2407246149941231, 1.254263936121301, 1.2680077646861174, 1.2819083618818332, 1.2959182406678558, 1.309990473872035, 1.3240789754357567, 1.3381387568676462, 1.3521261606970252, 1.365999072408488, 1.3797171120179421, 1.3932418061371146, 1.4065367410822598, 1.4195676973261477, 1.432302765380679, 1.4447124430396945, 1.4567697138140947, 1.468450106358548, 1.4797317347221965, 1.4905953193517134, 1.5010241889285876, 1.5110042633230316, 1.5205240181820512, 1.529574431923752, 1.5381489161676654, 1.5462432308761753 ], [ 1.0731076847604186, 1.0736798259461224, 1.0747397393318072, 1.0763049440022148, 1.078394673194219, 1.0810295702897728, 1.0842311036951136, 1.0880206699596753, 1.0924184330792084, 1.097442027906711, 1.103105297991179, 1.1094172273235638, 1.1163811730109827, 1.123994438125402, 1.1322481654272554, 1.1411274962348759, 1.1506119250556197, 1.1606757832856738, 1.1712887964584968, 1.1824166731358434, 1.194021696145474, 1.206063297079553, 1.218498602579809, 1.231282946293825, 1.2443703439868086, 1.2577139316041708, 1.2712663674819256, 1.2849802006790871, 1.2988082077628202, 1.3127037004559634, 1.3266208064552587, 1.3405147255152254, 1.3543419626125122, 1.3680605396920422, 1.381630187172269, 1.3950125160706524, 1.4081711713166258, 1.4210719665596994, 1.4336830005662218, 1.44597475513741, 1.4579201743814099, 1.4694947251366228, 1.4806764383737787, 1.4914459314976993, 1.5017864116199515, 1.5116836600710524, 1.521125998652713, 1.5301042383818195, 1.5386116117327244, 1.5466436896270948 ], [ 1.0818375796290738, 1.082299798399472, 1.083231333322608, 1.084651590491083, 1.0865817403920326, 1.089044308079013, 1.0920625184524453, 1.0956593644495736, 1.0998564379972218, 1.1046726420873063, 1.1101229462609095, 1.1162173393896322, 1.1229600833247269, 1.1303493047088204, 1.1383769046803778, 1.1470287304296505, 1.156284939355451, 1.1661204895331192, 1.176505701498072, 1.1874068499712342, 1.1987867567035826, 1.2106053657372606, 1.2228202899005518, 1.2353873226308119, 1.248260912754392, 1.2613946021153366, 1.2747414273126232, 1.2882542875604757, 1.3018862810294494, 1.3155910120968064, 1.329322871829853, 1.3430372938107822, 1.3566909871312465, 1.3702421480710978, 1.383650651651581, 1.3968782239362951, 1.4098885956580305, 1.4226476374883685, 1.4351234770504488, 1.4472865976122795, 1.459109918295523, 1.4705688555965806, 1.4816413660444099, 1.4923079699100001, 1.5025517560294963, 1.512358367997036, 1.5217159722114801, 1.530615208508751, 1.5390491243630557, 1.5470130938799405 ], [ 1.0909514757388956, 1.0913070688583209, 1.092112699685306, 1.0933896564778864, 1.0951610632417506, 1.0974513464672955, 1.1002854945919942, 1.1036880825490458, 1.1076820954125521, 1.1122876579746241, 1.1175208201118145, 1.1233925418292903, 1.12990797534266, 1.137066078822573, 1.1448595413234126, 1.1532749639200401, 1.1622932292544443, 1.1718899945520185, 1.1820362541700689, 1.1926989310568137, 1.2038414687960806, 1.215424405846916, 1.2274059209789472, 1.2397423440969866, 1.2523886301308316, 1.2652987958976758, 1.2784263211957223, 1.2917245161350204, 1.305146857053091, 1.3186472934357742, 1.3321805281626646, 1.345702273185561, 1.359169482472212, 1.372540563737225, 1.3857755701598067, 1.39883637297238, 1.4116868155087063, 1.4242928490379887, 1.4366226504934518, 1.4486467220387387, 1.4603379723105665, 1.4716717791357363, 1.4826260335451815, 1.4931811649953186, 1.503320147850828, 1.513028489373241, 1.5222941996839756, 1.5311077444141665, 1.5394619810011256, 1.5473520798280322 ], [ 1.1004207486477502, 1.1006741380300227, 1.1013575030595724, 1.1024939648888328, 1.1041085834694577, 1.1062276852264716, 1.10887801994878, 1.1120857307770873, 1.1158751685534722, 1.120267644619733, 1.1252802556560815, 1.1309249103426633, 1.1372076462750937, 1.144128268224205, 1.151680287590914, 1.1598511103122338, 1.1686224080410952, 1.1779706098651668, 1.1878674621783742, 1.1982806170406262, 1.2091742212261056, 1.220509487816258, 1.2322452394234162, 1.2443384172365184, 1.2567445535213155, 1.2694182074237153, 1.2823133652747818, 1.2953838073498778, 1.3085834433854642, 1.3218666192411375, 1.3351883970039988, 1.3485048106312751, 1.3617730989592232, 1.3749519176021128, 1.3880015309476836, 1.4008839851422907, 1.413563262664656, 1.426005418824912, 1.4381787003062734, 1.4500536456997264, 1.4616031678750938, 1.4728026179888234, 1.4836298309507658, 1.4940651522567325, 1.5040914462340051, 1.5136940859335555, 1.5228609251228535, 1.5315822530726129, 1.5398507330743783, 1.5476613258589673 ], [ 1.1102128591354608, 1.1103694832365447, 1.1109353409462424, 1.111935289271814, 1.1133962628652603, 1.1153464521467549, 1.1178143436827295, 1.120827624863646, 1.1244119848796255, 1.1285898930674765, 1.1333794692536887, 1.1387935585325124, 1.1448390876368308, 1.1515167295255258, 1.1588208566058509, 1.1667397329150648, 1.175255883624006, 1.1843465820478174, 1.1939844037605616, 1.2041378093005848, 1.2147717282275783, 1.225848126585955, 1.2373265468617136, 1.2491646145331885, 1.2613185087236325, 1.2737433966779022, 1.2863938331478986, 1.2992241265441373, 1.312188674081908, 1.3252422682535727, 1.3383403768853221, 1.3514393988503557, 1.3644968972543219, 1.3774718116140823, 1.3903246502400959, 1.4030176637234042, 1.4155150001365022, 1.4277828422950483, 1.4397895272074066, 1.451505647670504, 1.4629041358610448, 1.473960328725742, 1.4846520149933904, 1.4949594637129948, 1.5048654343591872, 1.5143551687288166, 1.523416365068654, 1.5320391351092277, 1.54021594491905, 1.5479415407229067 ], [ 1.1202915628005785, 1.1203577269217269, 1.1208118733647783, 1.1216804494847705, 1.1229921516653212, 1.1247769516409387, 1.1270650125879917, 1.1298855203747573, 1.133265466165251, 1.1372284493236857, 1.1417935951724283, 1.1469746807803232, 1.1527795329901644, 1.159209719956949, 1.1662605171054286, 1.1739211013343358, 1.1821749159701407, 1.191000150100593, 1.200370284217503, 1.210254664982452, 1.22061908248401, 1.2314263322100625, 1.242636750759104, 1.2542087192251246, 1.2660991315695609, 1.2782638275154998, 1.29065799088635, 1.3032365151128578, 1.3159543380327419, 1.3287667482370125, 1.341629665166913, 1.354499894998265, 1.3673353641097528, 1.3800953316486568, 1.392740582405342, 1.4052336009044046, 1.4175387273312283, 1.4296222956517417, 1.4414527540625235, 1.4530007677382435, 1.4642393037322212, 1.4751436978375971, 1.4856917032333403, 1.4958635208175233, 1.5056418112638956, 1.515011689016671, 1.523960698650251, 1.532478774251213, 1.5405581827148644, 1.548193452073912 ], [ 1.130617474752054, 1.1306001729296322, 1.130949319646674, 1.1316927616973507, 1.1328607890351132, 1.1344850173199188, 1.1365971805835293, 1.1392278855991902, 1.1424053714581026, 1.1461543332479682, 1.1504948850068213, 1.1554417355064752, 1.1610036273227584, 1.1671830544072854, 1.1739762392217445, 1.181373326798139, 1.189358742620986, 1.1979116617107746, 1.2070065434160528, 1.2166136961996623, 1.2266998464494545, 1.2372286936961148, 1.248161441153588, 1.2594572952925176, 1.2710739315062585, 1.2829679251651205, 1.2950951487739846, 1.3074111367885222, 1.3198714200827935, 1.3324318322240734, 1.3450487896892758, 1.3576795480141202, 1.370282435644438, 1.3828170669911748, 1.3952445358984689, 1.4075275904379614, 1.4196307896571903, 1.4315206426506055, 1.4431657301006438, 1.4545368082651293, 1.4656068952735783, 1.476351339544651, 1.4867478701508043, 1.4967766290314446, 1.5064201850861476, 1.5156635303547028, 1.524494058698195, 1.5329015276216205, 1.5408780041089676, 1.5484177955628247 ], [ 1.141148935723907, 1.141055657999472, 1.1413072732310763, 1.1419327988234533, 1.1429638980838326, 1.1444336374887725, 1.1463751663468917, 1.1488203967427264, 1.151798737004051, 1.1553359305740216, 1.1594530584446687, 1.1641657602683566, 1.1694837110120297, 1.1754103619194392, 1.1819429265158796, 1.1890725722546898, 1.196784769021749, 1.2050597457032137, 1.2138730120255983, 1.223195911527115, 1.2329961804044287, 1.2432384947821822, 1.253884995185877, 1.2648957816614395, 1.2762293762994006, 1.2878431521741984, 1.2996937291672177, 1.3117373380271828, 1.3239301545031963, 1.3362286055879982, 1.3485896499212355, 1.3609710342871568, 1.3733315279417484, 1.3856311362533447, 1.3978312948612024, 1.4098950452685743, 1.4217871925063061, 1.4334744452457908, 1.4449255385192177, 1.4561113390325637, 1.4670049329413046, 1.4775816959059904, 1.4878193452560393, 1.4976979741625553, 1.5072000678479596, 1.5163105020316043, 1.5250165240141165, 1.5333077170248484, 1.5411759486828045, 1.5486153046382547 ], [ 1.1518430648761315, 1.151681603127846, 1.1518437240705102, 1.152359360475642, 1.1532612867702867, 1.1545837781591828, 1.1563611964431078, 1.158626604169547, 1.161410471527824, 1.1647395243682297, 1.1686357780873993, 1.1731157965453853, 1.1781902003704816, 1.1838634269924109, 1.190133722340695, 1.1969933275314213, 1.204428815748072, 1.2124215342187332, 1.2209481112003089, 1.2299809954483683, 1.2394890036710782, 1.2494378586937336, 1.259790706968598, 1.2705086085775301, 1.2815509961470257, 1.292876101362862, 1.304441349271088, 1.3162037214870925, 1.3281200899652625, 1.3401475232288362, 1.3522435670098756, 1.3643665011655288, 1.376475574563064, 1.3885312193944122, 1.4004952461160767, 1.4123310199318262, 1.4240036194610128, 1.4354799779808904, 1.4467290074110284, 1.4577217050343787, 1.4684312428323623, 1.4788330392563547, 1.4889048132665157, 1.498626620538786, 1.507980871864608, 1.5169523339358963, 1.5255281129071798, 1.5336976213441782, 1.541452529389446, 1.5487867011882428 ], [ 1.1626568564946067, 1.1624351202229237, 1.1625161489479243, 1.1629305231489573, 1.163711839402081, 1.1648953038069978, 1.1665162495705883, 1.1686086994832838, 1.1712040490631497, 1.1743299186063916, 1.1780092096846266, 1.182259392674232, 1.1870920390212185, 1.1925125946494979, 1.1985203733305523, 1.205108735483399, 1.2122654111098385, 1.2199729251783165, 1.2282090879570269, 1.236947519381865, 1.2461581837319828, 1.2558079175353953, 1.2658609391927715, 1.2762793331548572, 1.2870235047080685, 1.29805260370109, 1.3093249170863448, 1.3207982311378725, 1.3324301647913421, 1.3441784758477313, 1.3560013418749302, 1.3678576175931652, 1.3797070703847987, 1.3915105953595468, 1.4032304111576028, 1.4148302374057664, 1.4262754544743106, 1.4375332459311256, 1.4485727238706791, 1.4593650371210285, 1.4698834622136112, 1.4801034769432928, 1.490002816352724, 1.4995615110420897, 1.5087619078263257, 1.5175886729263326, 1.52602877807623, 1.5340714701417002, 1.5417082250611873, 1.5489326871299667 ], [ 1.1735481885470689, 1.1732740394872339, 1.173282537955504, 1.1736046463718852, 1.1742744853421567, 1.175327895266257, 1.1768009146534857, 1.1787283090672411, 1.1811422367516982, 1.1840711016764265, 1.1875386244864472, 1.191563149116996, 1.1961571905074544, 1.201327214823895, 1.207073629820296, 1.2133909524423245, 1.2202681153389008, 1.2276888736277323, 1.2356322768111787, 1.2440731764685344, 1.2529827467682397, 1.262329000930393, 1.27207729198766, 1.282190790361014, 1.2926309339219957, 1.3033578484955204, 1.314330738337654, 1.3255082471636757, 1.336848790941985, 1.3483108640172488, 1.359853320264915, 1.3714356309694398, 1.383018121004632, 1.3945621847097638, 1.4060304826247156, 1.4173871199930619, 1.4285978076826213, 1.4396300059265308, 1.4504530510702929, 1.4610382653362028, 1.4713590494966793, 1.4813909582892055, 1.4911117584100193, 1.5005014689884457, 1.509542384562031, 1.518219080733763, 1.5265184028844154, 1.5344294385216668, 1.541943474060087, 1.5490539370293488 ], [ 1.1844766508680336, 1.1841577623757873, 1.1841022615976358, 1.1843412415260295, 1.1849090562911977, 1.1858418827493469, 1.1871761886924492, 1.1889472485265493, 1.191187800581057, 1.1939269008412714, 1.197189002064271, 1.2009932708559736, 1.2053531424894428, 1.2102761011536014, 1.2157636622954162, 1.2218115254492674, 1.2284098616885908, 1.2355436996797202, 1.2431933773908737, 1.2513350315179512, 1.2599411024153317, 1.268980837876062, 1.2784207839785164, 1.288225255197495, 1.298356779058582, 1.308776512893082, 1.3194446318659077, 1.330320688542413, 1.3413639449568975, 1.3525336785481228, 1.363789463514581, 1.3750914291738863, 1.3864004968313126, 1.397678596504362, 1.4088888646407693, 1.419995823727208, 1.4309655444364515, 1.4417657907196637, 1.4523661480355812, 1.4627381347348352, 1.4728552964972161, 1.4826932836594906, 1.4922299112742308, 1.501445201802667, 1.5103214104603206, 1.5188430333923115, 1.5269967990431115, 1.5347716432900318, 1.5421586691174234, 1.549151091807717 ], [ 1.1954041515105138, 1.1950478956537254, 1.19493673071769, 1.1951016525841145, 1.195576979567245, 1.1963989412007758, 1.1976041630777623, 1.1992281896942463, 1.201304144700793, 1.2038615878170182, 1.2069255983975675, 1.2105160961863342, 1.2146473959312667, 1.2193279812977222, 1.2245604742589546, 1.2303417695135654, 1.2366633001634024, 1.2435114009071313, 1.250867737716351, 1.2587097773686038, 1.2670112753300513, 1.2757427655463183, 1.2848720402382439, 1.2943646115886482, 1.304184150202842, 1.3142928974916308, 1.3246520507696713, 1.3352221210049569, 1.3459632639086268, 1.3568355855124274, 1.367799423619438, 1.378815606589312, 1.3898456908766885, 1.4008521786127603, 1.4117987163329482, 1.4226502757302335, 1.4333733170750684, 1.443935935708706, 1.4543079918055373, 1.4644612234279981, 1.474369342777087, 1.4840081154807754, 1.4933554227639116, 1.5023913064042116, 1.5110979964922127, 1.5194599221683096, 1.5274637056942066, 1.5350981404165056, 1.5423541533832346, 1.5492247535687516 ], [ 1.206295304561728, 1.2059086671071684, 1.2057498448442066, 1.205849538108631, 1.2062417903750702, 1.206962625588499, 1.2080485721863983, 1.2095352120277383, 1.2114558557610726, 1.2138404077753964, 1.2167144532342813, 1.2200985780807982, 1.2240079178075782, 1.2284519196637507, 1.2334342946569987, 1.2389531301274326, 1.2450011310068352, 1.2515659580190315, 1.2586306334909065, 1.2661739893439703, 1.2741711364199162, 1.2825939389111294, 1.2914114818859632, 1.3005905234947113, 1.3100959263465992, 1.319891064792466, 1.3299382065137018, 1.3401988680060455, 1.3506341443548429, 1.3612050142120549, 1.3718726211756525, 1.3825985328935653, 1.3933449792104802, 1.4040750705789686, 1.4147529977938913, 1.425344213904143, 1.4358155989299584, 1.4461356077884013, 1.4562744016233062, 1.466203962566301, 1.4758981918362268, 1.4853329910230648, 1.4944863264031816, 1.5033382761922591, 1.511871060753335, 1.5200690559299423, 1.52791878985492, 1.5354089237817685, 1.5425302176838818, 1.5492754815571095 ], [ 1.217117631867312, 1.2167071532007503, 1.2165082542268164, 1.2165511726800922, 1.216869473195561, 1.2174987484336683, 1.2184751998170493, 1.2198342287607007, 1.2216091391093762, 1.22383001657521, 1.2265228207008392, 1.229708702148676, 1.2334035419802576, 1.2376176981728098, 1.242355936648783, 1.247617519051152, 1.2533964171896945, 1.2596816242433868, 1.2664575349367886, 1.2737043703617656, 1.2813986272240565, 1.2895135355005174, 1.298019512407736, 1.306884603985865, 1.3160749084061687, 1.3255549773239783, 1.3352881932783753, 1.3452371223671515, 1.3553638422846057, 1.3656302463781516, 1.3759983247217504, 1.3864304233730433, 1.3968894830174499, 1.407339258139349, 1.417744517724632, 1.4280712283142296, 1.4382867200172793, 1.4483598358768701, 1.4582610647815473, 1.4679626579497966, 1.477438728897261, 1.4866653367360754, 1.4956205526559938, 1.5042845094955375, 1.512639434420652, 1.5206696648780138, 1.5283616481676103, 1.535703925170873, 1.542687098965084, 1.5493037892399066 ], [ 1.2278416232792282, 1.2274133619171195, 1.2271814748622327, 1.227175601040233, 1.2274286582585003, 1.227975617804663, 1.2288521543456208, 1.2300932923256946, 1.231732146271785, 1.2337988218919111, 1.2363195162859066, 1.2393158327711433, 1.2428043090550487, 1.2467961456576089, 1.2512971134826154, 1.2563076145442202, 1.2618228676380188, 1.2678331908013698, 1.2743243542405769, 1.2812779804411225, 1.2886719718496185, 1.2964809503407968, 1.3046766963068355, 1.313228578416028, 1.3221039677859778, 1.3312686324884873, 1.340687109987461, 1.3503230563702675, 1.3601395721388077, 1.370099504946164, 1.380165730058303, 1.3903014095360955, 1.4004702312111523, 1.410636628500488, 1.4207659819979743, 1.4308248036179338, 1.4407809038719068, 1.4506035426558006, 1.4602635637329275, 1.4697335129376807, 1.4789877400101832, 1.488002483913416, 1.496755941485096, 1.5052283193342695, 1.5134018690004183, 1.521260905539889, 1.5287918098783029, 1.5359830154555296, 1.5428249798792824, 1.549310142484171 ], [ 1.2384406993367831, 1.2380002140678161, 1.2377418974229888, 1.237694681871401, 1.2378907047497762, 1.2383641613782277, 1.239150031949502, 1.2402827924585156, 1.2417952018937373, 1.2437172320946024, 1.2460751806816532, 1.2488909854265502, 1.2521817415286545, 1.2559594111171595, 1.2602307060876163, 1.2649971203874235, 1.2702550855312047, 1.275996222961802, 1.2822076683694772, 1.2888724457136993, 1.2959698719531907, 1.303475976951886, 1.3113639263704393, 1.319604438368327, 1.328166187524905, 1.3370161915087175, 1.346120177702539, 1.3554429282746274, 1.3649486031325295, 1.374601040863227, 1.3843640382060647, 1.3942016088671518, 1.4040782226039277, 1.4139590255162864, 1.4238100424033262, 1.4335983619062584, 1.4432923049821438, 1.4528615770631297, 1.4622774040737914, 1.4715126523254365, 1.48054193219592, 1.4893416854474855, 1.4978902560366383, 1.5061679443279286, 1.5141570447295043, 1.5218418669131617, 1.529208740951906, 1.5362460068918575, 1.5429439894602583, 1.5492949587875264 ], [ 1.248891112567612, 1.2484434592444944, 1.2481647253291177, 1.2480830545205777, 1.2482297011200705, 1.2486379631266877, 1.2493419900747291, 1.2503755645653436, 1.2517709432770445, 1.2535578219872043, 1.2557624661679516, 1.2584070281067286, 1.2615090549688623, 1.2650811799692983, 1.2691309803885957, 1.273660980945894, 1.2786687784559434, 1.2841472632208608, 1.2900849137289612, 1.2964661434544533, 1.3032716814126963, 1.310478971236531, 1.3180625766034115, 1.325994583660767, 1.334244993557234, 1.342782100245982, 1.3515728503877642, 1.3605831834784747, 1.3697783513045412, 1.379123216539576, 1.388582530783941, 1.398121192655906, 1.407704486704389, 1.417298303957383, 1.4268693448738177, 1.4363853053534452, 1.4458150463038644, 1.4551287470892533, 1.4642980430151669, 1.4732961468582446, 1.4820979543451402, 1.490680133432553, 1.499021197243497, 1.5071015605729505, 1.5149035799809616, 1.5224115776336045, 1.5296118492191975, 1.5364926564467745, 1.5430442048142827, 1.5492586075054633 ], [ 1.2591718138031627, 1.2587215531715397, 1.2584278688296346, 1.258318055178345, 1.2584224079876811, 1.2587732363501616, 1.2594037523911643, 1.2603469266141292, 1.2616343875428402, 1.2632954272253134, 1.265356154355892, 1.2678388180032891, 1.2707613091887506, 1.2741368354687057, 1.2779737551117998, 1.2822755519848936, 1.2870409293610825, 1.292264000020472, 1.2979345507313744, 1.3040383610043353, 1.3105575584760687, 1.317470996045478, 1.3247546386708764, 1.3323819503529797, 1.3403242741554737, 1.348551200099844, 1.3570309174041044, 1.3657305488355311, 1.3746164659506104, 1.3836545847412451, 1.3928106417358044, 1.4020504509527099, 1.4113401423052707, 1.4206463821368631, 1.4299365765505685, 1.4391790581109976, 1.448343256362178, 1.4573998524484615, 1.46632091796852, 1.4750800380570086, 1.4836524185912725, 1.49201497737248, 1.500146419136436, 1.5080272943079671, 1.515640041516745, 1.522969014032361, 1.5300004904402336, 1.5367226700551249, 1.5431256537452667, 1.5492014110067462 ], [ 1.2692643010333104, 1.2688155145341349, 1.2685118138472598, 1.2683796018593478, 1.2684481632325142, 1.2687487523496785, 1.2693135635872372, 1.2701746613565297, 1.2713629412272711, 1.2729071799601959, 1.274833215527492, 1.2771632814871803, 1.2799155054333626, 1.2831035695706867, 1.286736522907919, 1.2908187288852815, 1.2953499290301347, 1.3003254020097599, 1.3057361977512711, 1.31156942768417, 1.317808594232972, 1.3244339451091984, 1.3314228404607287, 1.3387501233435326, 1.3463884861654016, 1.3543088276505195, 1.3624805964658664, 1.370872118943312, 1.3794509093489666, 1.3881839619257657, 1.3970380245005143, 1.4059798538337758, 1.4149764531298625, 1.423995292239417, 1.4330045111038425, 1.4419731069315689, 1.4508711054856476, 1.459669716724018, 1.46834147489234, 1.4768603630452917, 1.4852019218836159, 1.493343342751913, 1.5012635446513318, 1.5089432351809466, 1.5163649554249448, 1.5235131089403762, 1.5303739751605727, 1.5369357077005128, 1.5431883182219572, 1.549123646678415 ], [ 1.2791524615733727, 1.2787087726429596, 1.2783994778385939, 1.2782500614521737, 1.2782887634538531, 1.2785457394820394, 1.2790521088188918, 1.2798389582195635, 1.280936365672039, 1.2823724977118367, 1.284172819981534, 1.2863594461140053, 1.2889506366688859, 1.2919604488069185, 1.2953985290026404, 1.299270035302739, 1.303575672140279, 1.3083118191229588, 1.3134707351078359, 1.3190408198487245, 1.3250069171877725, 1.331350645844811, 1.3380507460875641, 1.3450834327582863, 1.3524227471649661, 1.3600409021469226, 1.3679086161638554, 1.3759954335307665, 1.3842700289435803, 1.3927004952348492, 1.4012546138931876, 1.409900108301086, 1.4186048799188786, 1.427337227791448, 1.4360660518017545, 1.4447610400637088, 1.4533928407605128, 1.4619332186168343, 1.4703551960682655, 1.4786331790810754, 1.4867430674960926, 1.4946623497352554, 1.5023701817224577, 1.5098474499313586, 1.5170768185757113, 1.5240427610931833, 1.5307315762306284, 1.5371313892057952, 1.5432321385874406, 1.5490255496937406 ], [ 1.2888224137470496, 1.288387012682223, 1.2880760602951504, 1.2879141075529725, 1.2879283316271466, 1.2881477633896012, 1.2886024092364035, 1.2893223264938685, 1.2903367095903098, 1.291673036204943, 1.2933563111663111, 1.2954084332891949, 1.297847698375583, 1.3006884413436335, 1.3039408123805325, 1.3076106762175383, 1.3116996199223159, 1.3162050526888613, 1.3211203806198928, 1.326435240077696, 1.3321357744903335, 1.338204941249208, 1.3446228372847626, 1.3513670338804915, 1.3584129131577305, 1.3657340003565912, 1.3733022875127154, 1.381088545372212, 1.3890626214032111, 1.3971937225685012, 1.4054506821399775, 1.4138022102846715, 1.422217128455961, 1.4306645878034927, 1.439114271892179, 1.4475365840169057, 1.4559028193374721, 1.464185321962104, 1.4723576270010472, 1.4803945875155504, 1.488272486219811, 1.4959691317654147, 1.5034639394559126, 1.5107379963017804, 1.517774110428827, 1.5245568449862539, 1.531072536854261, 1.5373093006139893, 1.5432570184051138, 1.5489073164498612 ], [ 1.298262351460281, 1.2978380223773514, 1.2975288924808785, 1.2973585746577398, 1.2973531776144909, 1.2975405960966773, 1.2979497021338207, 1.2986094889228323, 1.2995482181209774, 1.3007926153361618, 1.3023671493142106, 1.3042934196181213, 1.3065896670250212, 1.3092704114817952, 1.3123462148283112, 1.3158235598027785, 1.3197048330182926, 1.3239883974227185, 1.32866873893175, 1.33373667214292, 1.3391795909947217, 1.3449817516621625, 1.3511245766561246, 1.3575869708463535, 1.3643456418326627, 1.3713754186638747, 1.3786495643023928, 1.3861400784326272, 1.3938179882113078, 1.401653625365782, 1.4096168886770077, 1.4176774913550392, 1.42580519314512, 1.433970017209917, 1.4421424519386834, 1.4502936378566615, 1.458395539770934, 1.466421104214688, 1.4743444021640801, 1.4821407569213227, 1.4897868570018542, 1.4972608538440695, 1.504542444183254, 1.5116129369963527, 1.5184553050268659, 1.5250542210302083, 1.531396079030299, 1.5374690010368839, 1.543262829831253, 1.5487691085771127 ], [ 1.30746239341435, 1.3070515422039712, 1.3067472891356402, 1.3065723122431194, 1.3065516559809263, 1.3067120793731954, 1.307081311990683, 1.3076872626546856, 1.3085572257796876, 1.3097171258501008, 1.311190833054009, 1.3129995740816607, 1.3151614528677749, 1.3176910875907022, 1.3205993631297768, 1.3238932926866047, 1.3275759784132568, 1.3316466585202158, 1.3361008272304404, 1.340930413839295, 1.3461240077684904, 1.3516671176239736, 1.3575424536767888, 1.3637302247186465, 1.37020844177676, 1.3769532226220313, 1.3839390923169133, 1.391139276197483, 1.39852598265742, 1.4060706739024793, 1.413744323481369, 1.4215176598857915, 1.4293613958636622, 1.4372464433219407, 1.4451441138257501, 1.4530263047489422, 1.4608656711182588, 1.4686357831414214, 1.4763112693413527, 1.4838679451546422, 1.4912829268093273, 1.4985347302870835, 1.5056033552036083, 1.5124703535087756, 1.5191188830105402, 1.525533745856075, 1.5317014122502892, 1.5376100298470294, 1.543249419401631, 1.548611057418704 ], [ 1.3164144378295861, 1.3160191203021454, 1.3157224037727737, 1.3155460409809288, 1.3155140240949417, 1.3156519861368656, 1.3159865169569114, 1.3165444327986915, 1.3173520390826827, 1.3184344228363098, 1.31981480523516, 1.3215139771887972, 1.3235498329248854, 1.3259370089749722, 1.3286866294264976, 1.3318061530837986, 1.3352993143592469, 1.3391661472222225, 1.3434030802005186, 1.3480030900422435, 1.352955901978828, 1.3582482253675956, 1.3638640146468348, 1.3697847468533237, 1.375989708312321, 1.3824562844282455, 1.3891602477229514, 1.3960760403549175, 1.403177048290263, 1.4104358650813849, 1.4178245438451407, 1.4253148365285606, 1.4328784199175215, 1.4404871080963677, 1.4481130512200528, 1.4557289205323278, 1.4633080795741482, 1.4708247414969233, 1.4782541123469057, 1.485572520139882, 1.4927575295157487, 1.4997880417623517, 1.506644380032582, 1.5133083596496353, 1.5197633434978097, 1.5259942826238095, 1.5319877423171362, 1.5377319140890542, 1.5432166141189771, 1.5484332688779903 ], [ 1.325112023104272, 1.324733972745301, 1.3244470885645814, 1.3242722125384283, 1.3242323025223621, 1.3243518825289313, 1.324656414065808, 1.3251716224893766, 1.3259228132807575, 1.326934210887937, 1.3282283480505837, 1.329825527274666, 1.3317433692789378, 1.3339964565661995, 1.3365960743286422, 1.3395500460030438, 1.3428626570771827, 1.3465346581976199, 1.3505633371275299, 1.3549426484837652, 1.35966339025558, 1.3647134166865489, 1.3700778780171654, 1.3757394786948314, 1.3816787468470748, 1.387874308997655, 1.394303165124545, 1.4009409601758886, 1.4077622490535129, 1.4147407528346128, 1.4218496046295426, 1.4290615839725695, 1.4363493390205249, 1.4436855961032058, 1.4510433563427498, 1.4583960791529609, 1.4657178524625212, 1.4729835494980414, 1.4801689719343938, 1.4872509791897837, 1.4942076036271912, 1.5010181514334606, 1.5076632889887176, 1.5141251146124048, 1.5203872156752607, 1.5264347111923642, 1.5322542801527723, 1.5378341759882979, 1.5431642277290836, 1.5482358285306645 ], [ 1.3335501946153319, 1.333190849541812, 1.3329157594440908, 1.3327448739246552, 1.3327001390845437, 1.3328049925111058, 1.33308378554018, 1.3335611623451853, 1.334261426573684, 1.3352079246994832, 1.3364224715361022, 1.3379248381990427, 1.3397323169709852, 1.3418593716800549, 1.344317376851628, 1.3471144443624088, 1.350255332770721, 1.353741431945754, 1.3575708140033371, 1.3617383407509165, 1.3662358176963592, 1.371052185023936, 1.3761737366371674, 1.3815843592810055, 1.3872657847784757, 1.3931978494662673, 1.399358755929755, 1.405725333079957, 1.4122732914574354, 1.4189774713777934, 1.425812082145495, 1.4327509310578215, 1.439767641304505, 1.4468358581495762, 1.453929442971624, 1.46102265485208, 1.4680903194545554, 1.4751079849510633, 1.4820520647418143, 1.48889996670207, 1.4956302086876185, 1.5022225200502963, 1.5086579289627808, 1.5149188354289653, 1.5209890699595474, 1.5268539380166117, 1.5325002504684397, 1.5379163404387948, 1.5430920670760875, 1.5480188069009049 ] ], "zauto": true, "zmax": 1.549310142484171, "zmin": -1.549310142484171 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.09395973549220668, 0.09358737959977655, 0.09343910397384422, 0.09350437903506655, 0.09377074980512848, 0.0942244206210259, 0.09485082772112319, 0.09563515468944316, 0.0965627574779015, 0.09761948005872201, 0.09879185620151801, 0.10006720543016731, 0.10143364062142067, 0.10288001041987192, 0.10439580173354028, 0.10597102654978538, 0.10759611393879905, 0.10926182325711989, 0.11095918906353577, 0.112679502831527, 0.11441433172669518, 0.1161555708573906, 0.11789552265524664, 0.11962699539408328, 0.1213434121896732, 0.12303892195012796, 0.12470850445245918, 0.12634806279857305, 0.12795449777679066, 0.1295257599872214, 0.1310608768881591, 0.1325599531320975, 0.13402414366050938, 0.13545560001400775, 0.13685739119842266, 0.13823340124087696, 0.13958820628326576, 0.14092693469660764, 0.14225511425174986, 0.14357851083349032, 0.14490296351211118, 0.1462342209603154, 0.1475777841971795, 0.14893876043294516, 0.1503217323699012, 0.15173064669160458, 0.15316872466944015, 0.15463839687359784, 0.15614126295073125, 0.15767807638760845 ], [ 0.09000262847741694, 0.08963453273007958, 0.08950293076726898, 0.08959609902442804, 0.08990019651282609, 0.09039995383325462, 0.0910793445886372, 0.09192218350176606, 0.09291261102801891, 0.0940354427963285, 0.09527638047057196, 0.09662209605595838, 0.09806021278755393, 0.099579212030143, 0.10116829736560307, 0.10281724503338992, 0.1045162651762172, 0.10625589204817892, 0.10802691450433247, 0.10982035156146792, 0.11162747221007115, 0.11343985432257321, 0.11524947456485135, 0.11704881961170373, 0.11883100850105774, 0.12058991637743036, 0.12232029089939638, 0.12401785396841616, 0.12567938297334583, 0.1273027672876286, 0.12888703720997746, 0.13043236385590087, 0.13194002967304977, 0.13341237027712669, 0.13485268920723242, 0.13626514800219178, 0.13765463471938652, 0.13902661466162697, 0.1403869676401695, 0.14174181656552978, 0.14309735249511182, 0.144459661445488, 0.14583455826556288, 0.14722743263995514, 0.1486431118378944, 0.15008574414764253, 0.15155870606596106, 0.15306453529211395, 0.15460489046801476, 0.15618053748194174 ], [ 0.08602110299193773, 0.08565732870329094, 0.08554322859392186, 0.0856657455546877, 0.08600948537852034, 0.08655753160847166, 0.08729223533263088, 0.0881959107340338, 0.08925138781081776, 0.09044239780631122, 0.09175379001967535, 0.09317159758085658, 0.09468298277005041, 0.09627609918211608, 0.09793990908700585, 0.09966399090130923, 0.10143836519656933, 0.10325335956514367, 0.10509952421555564, 0.10696760237397268, 0.10884855309947411, 0.11073361932617906, 0.11261443089027798, 0.11448313083473446, 0.11633251312426104, 0.11815616070414452, 0.11994857425705202, 0.12170528375494727, 0.12342293673805912, 0.12509935902135877, 0.1267335851394066, 0.12832585725466794, 0.12987759247275757, 0.13139131955394806, 0.13287058691692716, 0.13431984463068322, 0.1357443038075467, 0.1371497774555505, 0.13854250741687243, 0.13992898249207789, 0.14131575319640324, 0.1427092487773569, 0.1441156021055472, 0.14554048780369216, 0.14698897848757386, 0.14846542326267426, 0.14997335167937018, 0.15151540524805834, 0.15309329742141242, 0.15470780174311122 ], [ 0.08202252919987511, 0.08166297055586123, 0.08156710176478107, 0.08172037321875913, 0.08210564544105552, 0.08270415653983107, 0.08349645438838349, 0.08446320720877032, 0.08558583390343127, 0.08684692703497339, 0.08823047069682256, 0.08972187859935875, 0.09130789268377727, 0.09297638942329635, 0.09471614080317409, 0.09651657152070744, 0.09836754513429355, 0.10025920153685682, 0.10218185776808203, 0.1041259749566769, 0.1060821868153178, 0.10804137990818201, 0.10999481284782876, 0.11193426038746894, 0.11385216865266948, 0.11574180905630702, 0.11759742034354652, 0.1194143303735762, 0.12118905140777028, 0.12291934467769486, 0.1246042517683179, 0.12624409185004482, 0.12784042504665338, 0.12939598327611082, 0.1309145707959252, 0.13240093746817824, 0.13386062846327834, 0.13529981476040168, 0.13672510937265303, 0.13814337470472024, 0.13956152680533543, 0.14098634246354688, 0.14242427507420768, 0.143881284930144, 0.1453626890685329, 0.14687303501188126, 0.14841600172992306, 0.14999432996272724, 0.15160978276221254, 0.1532631358158666 ], [ 0.07801505346565323, 0.07765941013361248, 0.07758238486002499, 0.07776775395064385, 0.07819641126436258, 0.07884752174729821, 0.07969962556665623, 0.08073158469458513, 0.08192330127320087, 0.08325617858122443, 0.08471333265886083, 0.08627959063461388, 0.08794132873905246, 0.08968620943679174, 0.09150287496975115, 0.09338064636485796, 0.09530926515083073, 0.09727870191839838, 0.0992790432653072, 0.10130045787247502, 0.10333323419031448, 0.10536787670532737, 0.10739524484391633, 0.109406717828479, 0.11139436967777117, 0.11335114047170346, 0.11527099247733553, 0.1171490423640558, 0.11898166325032775, 0.12076655256409512, 0.12250276359875728, 0.12419070020775891, 0.12583207534611032, 0.12742983519890563, 0.1289880515006975, 0.13051178540161842, 0.1320069269157931, 0.13348001461293352, 0.1349380407809817, 0.1363882477719121, 0.13783792160425853, 0.13929418908588576, 0.14076382469021825, 0.14225307312930577, 0.14376749299684924, 0.14531182600785833, 0.14688989527172167, 0.14850453476236822, 0.1501575507751522, 0.15184971478012868 ], [ 0.07400768763633085, 0.0736554342450505, 0.073597726745692, 0.07381645937040002, 0.07429030323629708, 0.07499608805794754, 0.0759101147760234, 0.0770092630479829, 0.0782718087804848, 0.0796779216910356, 0.08120986009319339, 0.08285191370613106, 0.0845901638853934, 0.08641213585413915, 0.08830641235251104, 0.09026226609410413, 0.0922693528023759, 0.0943174901652815, 0.09639653290019264, 0.09849634165065566, 0.10060683433265072, 0.10271810290214548, 0.10482057597063749, 0.10690520762224053, 0.10896367445124443, 0.11098856553803955, 0.11297355322361793, 0.11491353569244246, 0.11680474525168702, 0.1186448186595526, 0.12043282786880452, 0.12216927114635344, 0.12385602577744105, 0.12549626455085028, 0.1270943390334274, 0.12865563334700877, 0.13018639280522432, 0.13169353237229608, 0.13318443046583128, 0.13466671411230188, 0.13614804183153525, 0.13763589081936647, 0.13913735496012297, 0.1406589598879276, 0.14220650070362748, 0.14378490704631863, 0.14539813905042828, 0.14704911635715337, 0.14873968088275316, 0.15047059257960232 ], [ 0.07001041437483402, 0.0696607663757314, 0.0696226895344733, 0.06987595730036539, 0.07039672100156817, 0.07115917297824294, 0.07213711298428853, 0.07330524603200875, 0.0746401105137638, 0.0761206081286181, 0.07772816681856753, 0.07944660769918228, 0.0812618064818943, 0.08316124246426476, 0.08513351853968504, 0.08716791860433822, 0.08925404836808774, 0.09138158520879582, 0.0935401447171167, 0.09571925739774637, 0.09790843920208923, 0.10009733403859816, 0.10227590451851702, 0.10443464805879506, 0.1065648181333732, 0.10865863408367499, 0.11070946679324115, 0.11271199123329471, 0.11466230012474808, 0.11655797562600341, 0.11839811804669824, 0.12018333217746524, 0.12191567302121682, 0.12359855362646625, 0.12523661846100517, 0.12683558640605277, 0.12840206804961082, 0.1299433625354964, 0.1314672397739271, 0.13298171430728029, 0.1344948174978903, 0.13601437490016788, 0.13754779563408437, 0.13910188024039732, 0.1406826528422552, 0.14229522246657, 0.1439436771305249, 0.1456310128459296, 0.14735909813525527, 0.14912867310090078 ], [ 0.0660343116483036, 0.06568618705105338, 0.06566786537266464, 0.0659567249861589, 0.06652605209664, 0.06734705299512113, 0.06839073044465438, 0.06962940643654725, 0.07103777185073486, 0.07259344026568489, 0.07427705819486237, 0.07607207012932997, 0.07796425575512826, 0.07994115469289736, 0.0819914781054577, 0.08410458286776443, 0.08627005780285493, 0.08847744657575647, 0.0907161107735579, 0.09297522088003704, 0.09524385263996647, 0.09751116125487205, 0.09976660498656512, 0.10200019186250177, 0.10420272708610208, 0.10636604344375, 0.10848320171762973, 0.11054865238110281, 0.11255835342858361, 0.11450984201140683, 0.11640225966991023, 0.11823633249025764, 0.12001430861804792, 0.1217398563720615, 0.12341792684307017, 0.12505458542652115, 0.12665681728173528, 0.12823231225608958, 0.12978923534935205, 0.13133598928131332, 0.13288097610446878, 0.13443236500118746, 0.13599787335097005, 0.1375845677913837, 0.13919869129509296, 0.1408455212488469, 0.14252926219066053, 0.14425297531762926, 0.14601854522597446, 0.14782668270917515 ], [ 0.06209169977922823, 0.06174367634941551, 0.06174501433400493, 0.06207038185249803, 0.06268979800046481, 0.0635710807349401, 0.06468210309238927, 0.06599258096241287, 0.06747525350359074, 0.06910644616809203, 0.07086609979474966, 0.07273740098295427, 0.07470616491628368, 0.07676011231387388, 0.07888815734632769, 0.08107979132294571, 0.08332461381145397, 0.08561203283624948, 0.08793113156426502, 0.09027068165125225, 0.09261927319807002, 0.09496552716682823, 0.0972983567130024, 0.09960724761944116, 0.10188253341135711, 0.10411564662347127, 0.10629933327721482, 0.10842782244426098, 0.11049694663505662, 0.11250421166323629, 0.11444881672072196, 0.11633162683067616, 0.11815510081413703, 0.11992317858271731, 0.12164113209416229, 0.1233153847808061, 0.1249533047430464, 0.12656297751073625, 0.12815296469841372, 0.12973205536841464, 0.1313090172998525, 0.13289235556086307, 0.134490085717884, 0.13610952862653145, 0.1377571329999492, 0.1394383308466917, 0.14115742945782533, 0.14291754198811368, 0.14472055693513064, 0.1465671451045127 ], [ 0.05819631452116198, 0.05784658235005851, 0.057867227007112, 0.05822984481570218, 0.05890071982250386, 0.05984381833648172, 0.06102351173221122, 0.06240667503146704, 0.0639640035784819, 0.06567056184675854, 0.06750569328735627, 0.06945247537683934, 0.07149691287330358, 0.07362704135830278, 0.07583207641186854, 0.07810170134514116, 0.0804255451912967, 0.08279286711162871, 0.085192436051424, 0.08761257625074216, 0.09004133957110393, 0.09246676306350793, 0.0948771728078351, 0.09726150078313339, 0.09960958864180172, 0.1019124594610122, 0.10416254500886003, 0.10635386138082095, 0.10848212993321485, 0.11054484336185731, 0.11254127874859886, 0.1144724606649765, 0.11634107821224497, 0.11815136038943297, 0.11990891457045627, 0.12162053324438457, 0.12329397458921959, 0.12493772292437749, 0.12656073559684816, 0.12817218334488756, 0.1297811915724055, 0.13139659016741842, 0.1330266794227053, 0.13467901919796296, 0.1363602476640245, 0.13807593479667699, 0.13983047429174708, 0.14162701584828352, 0.14346743793851932, 0.14535235939284968 ], [ 0.05436350911165604, 0.05400981922313725, 0.05404911539189521, 0.054449509089482435, 0.05517300554831764, 0.056179187894293034, 0.05742851404452555, 0.05888477713456683, 0.06051655726943396, 0.062297720600730654, 0.06420715987906407, 0.06622802472999152, 0.06834668538993645, 0.07055163599646387, 0.07283249131057114, 0.07517917582880808, 0.07758135395555392, 0.08002810864530191, 0.08250784587201453, 0.08500838373351667, 0.08751717672499539, 0.0900216254884841, 0.09250942753961167, 0.09496893259617835, 0.09738947517231314, 0.09976166566650163, 0.10207762847070063, 0.10433118135180028, 0.10651795452704, 0.10863545068358532, 0.11068304897368719, 0.1126619570555693, 0.11457511581981034, 0.11642706176393033, 0.11822375221905097, 0.11997235890019928, 0.12168103560169924, 0.12335866629954653, 0.12501460042111145, 0.12665838253327827, 0.128299484094654, 0.12994704511691316, 0.13160963349081428, 0.13329502928069423, 0.1350100404394106, 0.13676035515142185, 0.13855043443203607, 0.1403834467980018, 0.1422612449137808, 0.14418438225927008 ], [ 0.050610486577781146, 0.050250097767213564, 0.05030703508034722, 0.050745456697245714, 0.05152245980931526, 0.052592638686872126, 0.05391208827023191, 0.055441281308746496, 0.05714664303504092, 0.0590009488531545, 0.06098283128744233, 0.06307572680646988, 0.06526656612836082, 0.06754445059292757, 0.06989948550834083, 0.07232187197867504, 0.07480129868993146, 0.07732662832485461, 0.0798858411939162, 0.08246618076911363, 0.08505443990859286, 0.08763732950749986, 0.09020187972296796, 0.09273583480733559, 0.09522801369433605, 0.09766861839829655, 0.10004948031549746, 0.10236424050621983, 0.10460846416651781, 0.10677969211704479, 0.10887743363596082, 0.11090310571393429, 0.11285992412224775, 0.11475275179984278, 0.11658791015118103, 0.11837295900917227, 0.12011645130425175, 0.12182766889082657, 0.12351634647256562, 0.12519239106209318, 0.12686560480965575, 0.1285454192314986, 0.1302406487609749, 0.13195927105655145, 0.13370824059220301, 0.13549334073799651, 0.13731907787544553, 0.13918861919438608, 0.14110377383057696, 0.14306501508497535 ], [ 0.04695655958840225, 0.04658618854228672, 0.04665933958618582, 0.0471356928085871, 0.047966714859534916, 0.04910132852006157, 0.05049078518581807, 0.05209201443392412, 0.053869292627587766, 0.055794466753506515, 0.05784614728712652, 0.060008304063196585, 0.0622686369618508, 0.06461700088915355, 0.0670440693934728, 0.06954033581730774, 0.07209548094820505, 0.07469808442972918, 0.07733562419595527, 0.07999469223014682, 0.08266135263648625, 0.08532157509179175, 0.0879616889969168, 0.09056881759877897, 0.09313126458997985, 0.09563883685724824, 0.09808309563465463, 0.10045753438549544, 0.10275768566367703, 0.1049811614875843, 0.10712763289120183, 0.10919875472790457, 0.11119804183166059, 0.11313070253737018, 0.1150034354936773, 0.11682419576444218, 0.11860193644614517, 0.12034633241463874, 0.12206749330083008, 0.12377567329344083, 0.1254809857689386, 0.12719313093767795, 0.1289211445641797, 0.13067317528795264, 0.13245629710130308, 0.13427636214722105, 0.13613789725440714, 0.13804404564798556, 0.13999655321778773, 0.14199579675840843 ], [ 0.04342342679377539, 0.04303921153975715, 0.04312666251831482, 0.043640405110716506, 0.04452545654050497, 0.04572431178800403, 0.04718288075257076, 0.048854361530783506, 0.050700949549282046, 0.052693789545549034, 0.054811756845505516, 0.057039627729646034, 0.059366084801064214, 0.06178187094425248, 0.06427828342096294, 0.0668460974183776, 0.06947492907617299, 0.07215299265974923, 0.07486717420986382, 0.07760333158433609, 0.08034673346534645, 0.0830825621042269, 0.0857964212253646, 0.08847480771310316, 0.09110552099767466, 0.0936779962645532, 0.09618355650646238, 0.09861558435730543, 0.10096961819177054, 0.10324337879541881, 0.10543673359704697, 0.10755160548551886, 0.10959183296445187, 0.11156298807829186, 0.11347215832949832, 0.11532769878150302, 0.11713896072832775, 0.11891600368200884, 0.12066929791543446, 0.12240942530174485, 0.12414678659329652, 0.1258913234592895, 0.1276522634396725, 0.12943789539185918, 0.1312553819703139, 0.13311061420766002, 0.13500811143862254, 0.136950967754504, 0.13894084405945234, 0.14097800279486197 ], [ 0.040035438286672456, 0.039632933267740915, 0.03973221207171799, 0.040282231026359194, 0.04122064917445214, 0.04248271787446436, 0.0440085141093781, 0.04574737593417765, 0.047659565412498786, 0.0497158214127032, 0.05189561597220841, 0.05418482124264249, 0.05657330831977093, 0.059052818553605266, 0.0616152968856806, 0.06425175820613616, 0.06695167052553176, 0.06970278162409528, 0.07249128620040159, 0.07530222356516639, 0.07812000503603991, 0.08092898844937153, 0.08371403866963342, 0.08646103344993025, 0.08915729112715212, 0.091791909575343, 0.09435601473729766, 0.09684292257396325, 0.09924822125291176, 0.10156978164449337, 0.10380770437700956, 0.10596421133020599, 0.10804348888005202, 0.11005148968389125, 0.11199569945299856, 0.11388487506353732, 0.11572876051198501, 0.11753778758453585, 0.11932276860073945, 0.12109458909925788, 0.12286390873041547, 0.12464087877578489, 0.12643488451419232, 0.1282543200145867, 0.1301064018271355, 0.13199702649215742, 0.13393067488013927, 0.13591036425441974, 0.1379376467831518, 0.14001265119914114 ], [ 0.03681979286797662, 0.036394026533948305, 0.03650203977177042, 0.03708649705409778, 0.038076724687521865, 0.03939988727148129, 0.04098978210360147, 0.042791850368075694, 0.04476466486787626, 0.046878925999291395, 0.04911506858069682, 0.05146035015560214, 0.053906011665154685, 0.056444865830146275, 0.05906948866249584, 0.061771056649469996, 0.06453877944474314, 0.06735982150472332, 0.07021958160100802, 0.07310219967969109, 0.07599117757270588, 0.07887002517602516, 0.0817228701904398, 0.0845349930732315, 0.08729326743882776, 0.08998649940740909, 0.09260566794612482, 0.09514407310822966, 0.09759740132973674, 0.09996371752825069, 0.10224339339258257, 0.10443898047625957, 0.10655503586125674, 0.108597907454559, 0.11057548553451935, 0.11249692701797458, 0.11437235905838689, 0.11621256895096782, 0.11802868781843154, 0.11983187605982362, 0.12163301892924115, 0.1234424407360876, 0.1252696459072473, 0.12712309444489758, 0.12901001812522198, 0.1309362821490858, 0.13290629497364798, 0.13492296687288002, 0.13698771557467312, 0.1391005152872027 ], [ 0.033806558523973455, 0.033352201471166854, 0.03346520330035073, 0.03408135670730476, 0.0351206682289298, 0.03650140521518896, 0.0381507394607403, 0.04001030747604621, 0.042037345593557825, 0.044202945697253304, 0.04648888576126257, 0.04888407553992691, 0.051381262862524604, 0.05397435310948832, 0.056656488768930306, 0.059418892394407424, 0.06225038131863919, 0.06513740983234297, 0.06806447786827077, 0.07101475540336026, 0.07397079806442168, 0.07691526189859482, 0.07983155668022353, 0.08270440333420148, 0.08552028057620185, 0.08826775896967413, 0.09093772842828055, 0.09352352915532017, 0.09602099740744005, 0.09842843733919097, 0.10074652928548085, 0.1029781836818566, 0.1051283487281949, 0.10720377905210098, 0.1092127721092908, 0.11116487888577932, 0.11307059560591658, 0.11494104352601764, 0.11678764439854236, 0.11862179969607742, 0.12045458204608407, 0.12229644740859939, 0.12415697621417392, 0.12604465089360553, 0.1279666759559892, 0.12992884505322527, 0.13193545741590634, 0.13398928381570124, 0.13609157998903218, 0.1382421434329052 ], [ 0.031028328273742533, 0.030540038495527656, 0.0306536713040776, 0.03129768990999517, 0.032381879072499384, 0.033814929979136876, 0.035517220767123533, 0.03742684284149592, 0.0395001592363365, 0.041709124211547224, 0.04403722323692515, 0.04647523381124234, 0.04901748208607119, 0.05165892352003597, 0.054393150667970305, 0.05721128188170789, 0.06010159129209969, 0.06304969483419769, 0.0660391010123553, 0.06905195686115023, 0.0720698560536557, 0.07507461608457151, 0.07804896737724666, 0.08097712537807993, 0.08384523651021529, 0.08664170128659504, 0.08935738465244726, 0.09198572650011452, 0.09452276575457357, 0.09696709057017489, 0.09931972576333593, 0.1015839671106912, 0.10376517084657559, 0.10587050574051737, 0.10790867457648537, 0.10988961168067679, 0.11182416329813477, 0.11372375800969012, 0.11560007489086509, 0.1174647176053195, 0.11932890295096767, 0.1212031723988086, 0.12309713477056054, 0.12501924732388137, 0.1269766411448311, 0.12897499494375772, 0.1310184592325656, 0.1331096305953032, 0.1352495735410729, 0.13743788543537871 ], [ 0.028519221253192863, 0.027992241927072514, 0.028101710977516164, 0.028768533443665503, 0.029891610654545046, 0.03136965633667882, 0.03311635859998124, 0.035066721774205556, 0.03717679357060133, 0.039419864984199963, 0.04178143744075732, 0.044254288944057425, 0.0468343105078607, 0.04951739380548703, 0.05229741524408447, 0.055165212146650905, 0.058108358783976424, 0.06111151467080364, 0.06415712462933253, 0.06722628502094882, 0.07029963775404047, 0.07335820082642187, 0.07638408384524524, 0.07936106636202978, 0.0822750362645348, 0.0851142967437589, 0.0878697557882414, 0.09053501381846162, 0.0931063645673425, 0.09558272276114557, 0.09796549027975245, 0.10025837070331535, 0.10246714071103383, 0.10459938578620383, 0.10666420711673748, 0.10867190642518959, 0.11063365564178962, 0.11256115874254216, 0.11446631358343354, 0.11636088202657914, 0.11825617692670135, 0.12016277449032967, 0.1220902600297583, 0.12404701415140167, 0.1260400449476799, 0.12807486987322367, 0.13015544881098098, 0.13228416754638536, 0.1344618686618095, 0.13668792492344473 ], [ 0.026312854191109313, 0.025743914172439823, 0.02584437704582536, 0.026527707459993367, 0.027681715067584527, 0.029195200203701793, 0.03097563444308054, 0.03295560299018555, 0.035091452793005726, 0.037358237387677073, 0.03974368224843498, 0.04224258724683554, 0.04485229772597657, 0.04756945760690087, 0.05038802125847337, 0.05329835624615936, 0.05628719004482459, 0.05933813157536536, 0.06243252068843593, 0.06555040766487794, 0.06867152258547983, 0.07177614795001708, 0.07484585035733438, 0.07786405672256837, 0.0808164788494872, 0.08369139991018366, 0.0864798403045409, 0.08917562078300942, 0.09177533928774437, 0.09427827579525426, 0.09668623718922967, 0.09900335221644961, 0.10123582505180921, 0.10339165497397215, 0.10548032911365747, 0.10751249512012188, 0.10949962080422783, 0.11145364824019646, 0.11338665030533603, 0.11531049805907219, 0.11723654756167087, 0.11917535457789855, 0.12113642500501151, 0.12312800776302987, 0.12515693530667715, 0.1272285149470619, 0.12934647194920218, 0.13151294307995237, 0.1337285171137272, 0.13599231693946393 ], [ 0.02443895210987899, 0.02382742416247421, 0.023914669163213942, 0.024607260284055625, 0.025782395254344514, 0.02731968431398825, 0.02912129906598288, 0.03111826165349189, 0.033267829089818235, 0.0355471362889176, 0.037946201342650074, 0.040461738826598516, 0.04309234193260105, 0.04583516625587841, 0.04868401849198851, 0.051628617188453685, 0.05465472505695531, 0.057744845259075944, 0.06087921269212808, 0.06403687436818964, 0.06719672053431566, 0.07033838688692153, 0.07344299225449008, 0.07649370518215569, 0.07947614959662144, 0.08237866767257657, 0.08519246037147382, 0.08791162533592978, 0.09053310956904564, 0.09305659164077686, 0.09548430562455787, 0.09782081686519496, 0.10007275812545922, 0.10224853366305234, 0.10435799830244652, 0.10641211850205419, 0.10842262266596363, 0.11040164838106861, 0.11236139473074112, 0.11431378819459014, 0.1162701707455582, 0.11824101847757984, 0.12023569835533564, 0.12226226944323428, 0.12432733327871842, 0.12643593600468728, 0.1285915226200084, 0.13079594143120726, 0.1330494946839566, 0.13535102958981293 ], [ 0.022918623433194903, 0.022267711988362054, 0.02233913137101227, 0.02303352898911849, 0.024218821047773245, 0.025766930563690872, 0.02757609381105164, 0.02957675035817753, 0.031727602664207, 0.03400803002372408, 0.03641025225179498, 0.03893266690825265, 0.041574832512057014, 0.04433414725071488, 0.04720405464967052, 0.050173481508412915, 0.053227158354916905, 0.056346481618712696, 0.05951063175050053, 0.06269773783453277, 0.06588595515693958, 0.06905438463180485, 0.07218380746263495, 0.0752572361598008, 0.07826029784573345, 0.08118147185330736, 0.08401220446979021, 0.08674692182076445, 0.08938295894692866, 0.09192042004717153, 0.09436198213666312, 0.09671265221458492, 0.0989794865087263, 0.10117127943239254, 0.10329822947447564, 0.10537158923973948, 0.10740330713794691, 0.10940566864760293, 0.1113909455036413, 0.1133710614281372, 0.11535728300039076, 0.11735994383595226, 0.1193882093456409, 0.1214498879649586, 0.12355129293528544, 0.1256971565956305, 0.12789059686983983, 0.13013313339646912, 0.13242474873257853, 0.13476398842596782 ], [ 0.021759121773216143, 0.02107664591843036, 0.021132356253856246, 0.021822192222234953, 0.02300692426790887, 0.02455300774919876, 0.02635644933500535, 0.028348108197733354, 0.030488528439566752, 0.032759320088947455, 0.03515466577090417, 0.03767432079691261, 0.04031849060590089, 0.04308455980229998, 0.045965440632309215, 0.04894919189658072, 0.0520195166377692, 0.055156771476688, 0.058339190703145, 0.06154411601454435, 0.0647491052281075, 0.06793285798446796, 0.07107594045024919, 0.07416131700865736, 0.07717470970853475, 0.08010481054550155, 0.08294337117006705, 0.08568519187487406, 0.08832802824578441, 0.09087243051617153, 0.09332152784681913, 0.0956807676131722, 0.09795761832412785, 0.10016124395538403, 0.10230215715129097, 0.10439185880688752, 0.1064424718473359, 0.10846637742699927, 0.11047586212257089, 0.1124827848468309, 0.11449827203231427, 0.1165324490312539, 0.11859421460170799, 0.12069106381101755, 0.12282896276076104, 0.1250122763523502, 0.12724374803954702, 0.12952452833983155, 0.13185424697666898, 0.13423112204059176 ], [ 0.020949910435825884, 0.020248207509297556, 0.020291981950270863, 0.020973646473164752, 0.022149423134590784, 0.023682916557569482, 0.025469716474319535, 0.027441998716307266, 0.02956236721514267, 0.03181448862300188, 0.03419416546530887, 0.03670214636440497, 0.03933898349389543, 0.04210185240125301, 0.044983051628240726, 0.04796979007493924, 0.05104483833656946, 0.054187658439003916, 0.05737570934316534, 0.06058572230103929, 0.06379482704351917, 0.06698147541588775, 0.07012615196480874, 0.07321188507713833, 0.07622458317101129, 0.07915322322584083, 0.08198991739244753, 0.08472988001605432, 0.08737131357812304, 0.08991522857072144, 0.09236520948849666, 0.09472713704896626, 0.09700887539659968, 0.09921993231312821, 0.10137110021832833, 0.1034740858597002, 0.10554113690437363, 0.10758467400656695, 0.1096169371755345, 0.11164965527067956, 0.1136937470860659, 0.11575906167905455, 0.11785416432288542, 0.11998617275647959, 0.12216064636203638, 0.12438152866713485, 0.12665114131867508, 0.128970225592726, 0.13133802574940884, 0.13375240723655887 ], [ 0.02046222615098273, 0.019757005273621172, 0.019796615886866077, 0.020470800554986943, 0.0216337256718474, 0.02314864060232731, 0.02491232065901323, 0.02685892126393713, 0.028953133551013605, 0.03118038827953627, 0.033537721528129845, 0.036026532394130846, 0.03864749052405671, 0.04139746892596194, 0.044268185125545104, 0.04724612944955507, 0.0503133360293197, 0.05344860067800977, 0.05662884184640217, 0.05983040343957577, 0.06303018760767921, 0.06620657120734938, 0.06934010118267382, 0.07241398652069767, 0.07541441381747804, 0.07833071513203595, 0.08115541450396702, 0.08388417566711852, 0.08651566946477801, 0.08905137593639333, 0.09149533327075278, 0.09385384385146354, 0.09613514638927644, 0.0983490625195911, 0.10050662609459594, 0.10261970355891624, 0.1047006141018411, 0.10676175856625185, 0.10881526621165882, 0.11087266824385032, 0.11294460643727636, 0.11504058413537699, 0.1171687654216396, 0.11933582637304105, 0.1215468601552614, 0.12380533545399247, 0.12611310553673666, 0.12847046327735887, 0.13087623589533456, 0.13332791206053243 ], [ 0.020253297459528505, 0.01956180328467069, 0.019608557780811484, 0.02028101775984829, 0.021433144412230674, 0.022929694067017753, 0.024669725594271014, 0.02658969851360154, 0.028656228199693056, 0.03085614047177381, 0.03318732501899042, 0.03565155335244005, 0.03824948571101683, 0.04097772051489232, 0.04382755153264868, 0.046784997517858064, 0.049831651482963125, 0.05294595139290291, 0.05610457084294425, 0.05928373341528547, 0.06246034430470008, 0.0656128976881327, 0.06872215864472972, 0.07177163960533631, 0.07474789969442805, 0.07764069627520857, 0.0804430152886019, 0.08315100292883151, 0.08576381711749101, 0.08828341374768521, 0.09071427999890441, 0.09306312518678998, 0.09533853851692754, 0.09755062261401913, 0.09971061163053947, 0.10183048292709525, 0.10392257158495093, 0.10599919719247679, 0.10807231229229651, 0.11015318146488717, 0.11225209917976757, 0.11437815324259383, 0.11653903893967114, 0.11874092692259759, 0.12098838562450316, 0.12328435672505138, 0.12563018006024285, 0.12802566256400238, 0.13046918445266856, 0.1329578349908798 ], [ 0.020274247865500923, 0.019613420987241927, 0.019681020991853846, 0.02036216734685864, 0.02151156653857768, 0.02299643697069689, 0.024718561046101588, 0.026616641289061313, 0.028658870594307193, 0.03083304659690138, 0.033137557916501165, 0.03557434315601674, 0.038144024839673746, 0.04084306321790392, 0.0436625920667712, 0.046588502084426664, 0.04960232264764409, 0.05268250864215089, 0.05580583590592657, 0.05894871316724947, 0.062088307139762294, 0.06520344123793707, 0.06827526783687621, 0.07128773456065705, 0.07422787308785485, 0.07708593971258107, 0.07985543411181378, 0.08253301874444122, 0.08511835731008766, 0.08761388732864496, 0.09002453937627744, 0.09235741382978725, 0.09462142501898757, 0.09682692230411374, 0.09898529759759325, 0.10110858904514693, 0.10320909078363129, 0.10529897873123728, 0.10738996209648748, 0.10949296961318905, 0.11161787836846956, 0.11377329149888324, 0.11596636905465788, 0.11820271409699068, 0.12048631375856624, 0.12281953274031222, 0.12520315470751778, 0.12763646542564938, 0.13011737033411813, 0.13264253863409434 ], [ 0.02047905897035709, 0.019864222411177145, 0.019967295431065193, 0.020670730966340464, 0.021830118842456926, 0.023315240065993222, 0.025030425488102873, 0.026916208792569618, 0.028941851947451514, 0.03109565306821368, 0.03337615960552044, 0.035785318575086905, 0.03832374723753428, 0.040987968433746386, 0.043769281574614814, 0.046653848960090546, 0.049623562801515086, 0.052657311222394275, 0.0557323538961658, 0.058825618340054564, 0.061914813980248284, 0.06497932352050816, 0.06800087014461664, 0.07096397969130576, 0.07385626520629547, 0.07666856233607569, 0.07939494153015617, 0.08203261924554174, 0.0845817865712442, 0.08704537052430106, 0.08942874093044323, 0.091739374290468, 0.09398648522927464, 0.09618063585216687, 0.09833333339011233, 0.10045662669447393, 0.10256271224455826, 0.10466356018505761, 0.10677057038179008, 0.10889426749250443, 0.11104404257666506, 0.11322794686152099, 0.11545254104881307, 0.11772280114140839, 0.12004207937157238, 0.12241211660321355, 0.12483310071678182, 0.1273037640826975, 0.1298215123486878, 0.13238257641387494 ], [ 0.020831937603183047, 0.020276105107394308, 0.020428732988310782, 0.021169200605411984, 0.022353620519863462, 0.023853871191277146, 0.025576239915481955, 0.02746243988966532, 0.029482180879914697, 0.03162374962879353, 0.03388550575172692, 0.03626925094918515, 0.038775635346554926, 0.04140144831163656, 0.0441384820220416, 0.04697357202232051, 0.049889404085415305, 0.05286572319056171, 0.055880664597651494, 0.05891202049326639, 0.061938337545136675, 0.06493980131711506, 0.06789890230561078, 0.07080089957285782, 0.07363410706325568, 0.07639002954455142, 0.07906337326225378, 0.08165195311272688, 0.08415651473466641, 0.0865804870415871, 0.08892967861627823, 0.09121193007356304, 0.09343673385146106, 0.09561483272557168, 0.09775780843874213, 0.0998776719739212, 0.10198646696459535, 0.10409589736200799, 0.10621698964234869, 0.10835979848781505, 0.11053316303360679, 0.11274451852956574, 0.1149997657692945, 0.11730319807655605, 0.11965748320431091, 0.12206369537464284, 0.12452139100720291, 0.12702872053425696, 0.12958256810693747, 0.1321787109298025 ], [ 0.021311629281236293, 0.02082521096925732, 0.021039617290889025, 0.02183086699286723, 0.02305510910399569, 0.02458564982385152, 0.026329978417170684, 0.028230243208522843, 0.030255938023238615, 0.032394806387391846, 0.03464465431512941, 0.03700695414547273, 0.039482382451153146, 0.04206814416088931, 0.04475679345825626, 0.04753618737941049, 0.05039019243438774, 0.053299802805358634, 0.0562444020015614, 0.05920298412337243, 0.0621552269795237, 0.06508236745324664, 0.0679678681116, 0.0707978861976428, 0.07356156653860094, 0.07625118296868552, 0.07886215198925085, 0.08139293983836647, 0.08384488127101716, 0.08622192587010356, 0.08853032590979168, 0.09077827871454311, 0.0929755359875551, 0.0951329925269748, 0.09726226687341052, 0.09937528649913571, 0.10148388994151916, 0.10359945763267618, 0.10573258198485387, 0.10789278553922028, 0.11008829374082972, 0.11232586630473793, 0.11461068838000546, 0.11694632001536232, 0.11933469998996322, 0.12177619806554953, 0.12426970825636605, 0.1268127748486236, 0.12940174261690812, 0.13203192291350596 ], [ 0.0219125072384511, 0.021503137062209444, 0.021788582799930192, 0.02264151462223956, 0.023917821746476414, 0.025491668813016875, 0.027271050608157578, 0.02919784779313425, 0.031240703624126995, 0.033386296839871356, 0.035631497791373576, 0.037977218752231603, 0.040424081883630135, 0.04296976299661451, 0.045607746284205185, 0.048327161297876856, 0.051113357922602624, 0.053948904747339384, 0.05681475748221, 0.05969141753800706, 0.06255996981786961, 0.06540294356679088, 0.06820497813727076, 0.07095329861135867, 0.07363801811049658, 0.07625228818757414, 0.0787923190745076, 0.08125728997045593, 0.08364916739479193, 0.08597244766926428, 0.08823383818437212, 0.09044189131893152, 0.09260660462086148, 0.09473900092314333, 0.09685070221508336, 0.09895351106307496, 0.10105901295519294, 0.10317821197150708, 0.10532121058437306, 0.10749694219552353, 0.1097129623387481, 0.1119753015124088, 0.11428837959251613, 0.1166549789582592, 0.11907627105120448, 0.121551889242199, 0.12408003967797739, 0.12665764122891238, 0.1292804857018747, 0.13194341001285703 ], [ 0.022642998231457552, 0.022315332668088574, 0.02267725785470811, 0.023598546099783246, 0.024934924482282125, 0.02656113847704095, 0.028385191399588585, 0.030348126288187588, 0.03241718454999404, 0.03457749872705474, 0.03682461916063262, 0.03915862359352262, 0.041579918615550895, 0.044086599185973636, 0.0466731266817122, 0.04933003284995867, 0.05204434258146576, 0.05480043035762313, 0.05758107453221396, 0.06036853561955204, 0.06314554551608426, 0.06589614505512063, 0.06860634405489965, 0.07126460171907216, 0.07386213858897249, 0.07639309742059547, 0.07885457217436131, 0.08124652386997405, 0.08357160077532684, 0.08583487909550025, 0.08804353940972401, 0.09020649368267664, 0.09233397767000925, 0.09443712374708213, 0.09652752935703256, 0.09861683613575721, 0.10071633410430551, 0.10283660398004393, 0.10498720860900969, 0.10717644183976219, 0.1094111400233627, 0.1116965579873063, 0.1140363080764352, 0.11643235794907107, 0.11888508047491078, 0.12139334743495946, 0.12395465781515415, 0.126565291273985, 0.12922047774652362, 0.13191457498088335 ], [ 0.023522138805773217, 0.02327763482641466, 0.02371712296086821, 0.02470843454483855, 0.026107702906062746, 0.02779034191970134, 0.029664125823944208, 0.03166886686719946, 0.03376996781757466, 0.03595059669884605, 0.03820461562510906, 0.040530965337782374, 0.04292960842171145, 0.04539890915447686, 0.04793423581594706, 0.05052752773093178, 0.053167556572105146, 0.055840627167786094, 0.058531501573946654, 0.06122438101203545, 0.06390383237725648, 0.06655559134766743, 0.06916720883803049, 0.07172853129314644, 0.07423201980900901, 0.07667292077293414, 0.07904930401890435, 0.08136198532973542, 0.08361434984892598, 0.08581209244735034, 0.08796289077123746, 0.09007602672392291, 0.09216197243900379, 0.09423195718646432, 0.09629753184855025, 0.09837014733671977, 0.10046076237551319, 0.10257949433258143, 0.10473532423247613, 0.1069358638920834, 0.10918718950500898, 0.11149374229549297, 0.11385829338748989, 0.11628196707899355, 0.11876431448083943, 0.12130342807429578, 0.12389608715891681, 0.12653792431018007, 0.12922360369506383, 0.13194700322561323 ], [ 0.02457507825937134, 0.024411865076338118, 0.024925526859673655, 0.025983382726329163, 0.027442969097907676, 0.029180800247250376, 0.031104442455269155, 0.033152270348985505, 0.0352875393246497, 0.03749111359672863, 0.03975483369281683, 0.04207619465193582, 0.04445444311281874, 0.04688798810003904, 0.049372937053321374, 0.05190253215132974, 0.0544672509650873, 0.057055346483292024, 0.05965363097012183, 0.06224834879840837, 0.06482602697406276, 0.06737423174631008, 0.06988219163045163, 0.07234127030021248, 0.07474528798115065, 0.07709069895351503, 0.07937663748412008, 0.08160484663923442, 0.08377950525903674, 0.08590696874411897, 0.08799543968467939, 0.09005458492076766, 0.09209511630119523, 0.09412835300547158, 0.09616578352988617, 0.09821864503778942, 0.10029753652449813, 0.10241208005859688, 0.10457064129267221, 0.10678011669451243, 0.10904579085602131, 0.11137126317124815, 0.11375843950790118, 0.11620758152982888, 0.11871740425076581, 0.12128521127430858, 0.12390705694576117, 0.12657792516312044, 0.1292919156705436, 0.13204243007776753 ], [ 0.025828332544717586, 0.025741314455710356, 0.02632164858334692, 0.02743790164497817, 0.028950305225868275, 0.030737169162670667, 0.032706096333408034, 0.034793994837340234, 0.03696179694489765, 0.03918781505068103, 0.04146158752475201, 0.0437788719888595, 0.046137911200444366, 0.0485368892413295, 0.050972416211825744, 0.053438847088976955, 0.05592823045609568, 0.058430690249543206, 0.06093506576143359, 0.06342966707041887, 0.06590303873428036, 0.06834465850256365, 0.07074552643146856, 0.073098621656059, 0.0753992193838064, 0.07764507055014096, 0.07983645249055744, 0.08197610234247359, 0.08406904683013688, 0.08612234340312121, 0.08814474885393304, 0.09014633270312956, 0.09213805375312582, 0.09413131906068854, 0.09613754487340015, 0.09816773853491971, 0.10023211879084118, 0.10233978926930011, 0.10449847628960056, 0.10671433785321638, 0.10899184609633165, 0.11133374107765472, 0.1137410499503684, 0.11621316263094654, 0.1187479531959425, 0.12134193542632563, 0.12399044106480275, 0.1266878102542677, 0.12942758504360444, 0.13220269854070568 ], [ 0.027305549240334806, 0.027286819484939797, 0.027923014975880116, 0.029085825345966286, 0.030639583760638016, 0.03246524522868302, 0.03447086728618024, 0.0365920251776559, 0.03878728727003734, 0.04103226831143856, 0.043313993597422676, 0.045626230692650524, 0.04796594124347531, 0.05033079946275491, 0.05271764361079268, 0.055121695003495494, 0.05753636903823875, 0.05995350722675709, 0.06236387551238145, 0.06475779882813264, 0.06712583052513593, 0.06945938371590976, 0.07175127663636618, 0.07399616424990761, 0.07619084324022189, 0.07833442789343147, 0.08042840120415544, 0.0824765499715462, 0.08448479564814845, 0.08646093497698873, 0.08841430642332182, 0.09035540022750631, 0.09229543149963267, 0.09424589691169825, 0.0962181359138543, 0.09822291672125248, 0.10027006540898406, 0.10236815330820694, 0.10452425370944542, 0.1067437740202308, 0.1090303644801248, 0.11138589981915456, 0.11381052630192598, 0.11630276373719567, 0.11885965038535325, 0.12147691822690349, 0.12414918659046578, 0.12687016342282975, 0.12963284523230956, 0.13242970868472054 ], [ 0.029024391118966347, 0.029063933072262012, 0.02974297177876326, 0.030938078780736986, 0.03251902846442196, 0.034370314822539036, 0.03640098775933105, 0.03854556689454719, 0.04076035039069293, 0.043018220726656085, 0.045303563596966294, 0.04760796219266249, 0.049926853816084346, 0.05225712921476881, 0.054595570710912915, 0.056937991360951956, 0.05927892589716012, 0.061611725927722856, 0.06392892347965456, 0.06622274574045664, 0.06848568656203033, 0.07071106368025544, 0.07289351209592115, 0.07502938212108291, 0.07711702470893297, 0.0791569571134208, 0.08115190936446802, 0.08310675734178771, 0.08502835217090407, 0.0869252588499836, 0.08880741980443284, 0.09068576156676565, 0.09257176488369113, 0.09447701999781062, 0.09641278931050495, 0.09838959881496814, 0.10041687743725387, 0.10250265978465894, 0.1046533630455442, 0.10687364337549651, 0.10916633161499875, 0.11153244319042914, 0.11397125302947521, 0.11648042357441525, 0.11905617259709066, 0.12169346741287417, 0.12438623302203942, 0.12712756336510067, 0.12990992694100859, 0.13272536021727105 ], [ 0.030994853007237026, 0.031081409607193567, 0.03178926237620202, 0.033001319126485754, 0.03459392476284517, 0.03645595516366494, 0.03849805606109947, 0.04065408789102432, 0.04287830073175996, 0.0451409257548299, 0.0474236774662422, 0.04971583354137317, 0.05201111612565464, 0.05430539171466838, 0.05659511671726528, 0.058876417890127083, 0.06114468265023647, 0.06339453308496083, 0.06562006513792433, 0.0678152483949384, 0.0699743996036564, 0.07209266202110931, 0.07416644079405513, 0.07619376044841349, 0.07817452357444495, 0.08011065995821826, 0.08200616315315282, 0.08386701741886352, 0.08570102268761312, 0.08751752923111292, 0.08932709726863529, 0.09114109993054294, 0.09297129061197533, 0.0948293575164449, 0.09672648874331223, 0.09867297032023896, 0.10067783698936146, 0.10274859142669139, 0.10489100226232123, 0.10710898533180117, 0.10940456668712881, 0.11177792066717275, 0.11422747227212561, 0.1167500504907963, 0.1193410781434659, 0.12199478407076246, 0.12470442482297583, 0.1274625050219652, 0.1302609879218743, 0.1330914900824795 ], [ 0.03321896832642858, 0.033340919132449326, 0.034063634292361325, 0.03527739937001928, 0.03686596229366799, 0.038723301434978076, 0.040762275370360306, 0.042916569378453284, 0.04513872117216996, 0.04739650389142393, 0.04966902834028424, 0.05194322775943709, 0.05421098344541302, 0.05646694536356389, 0.05870700628609598, 0.06092734496304811, 0.06312393603026702, 0.0652924200131551, 0.06742823092226907, 0.0695268888591905, 0.07158437858556732, 0.07359755014200295, 0.07556449262632098, 0.07748484594183244, 0.07936002706594573, 0.08119335703697153, 0.08299008264362744, 0.08475729314797892, 0.08650373772952544, 0.08823955406369083, 0.08997592272665036, 0.0917246659263751, 0.0934978121788668, 0.09530715062604546, 0.09716379933958139, 0.09907781086940033, 0.10105783536940759, 0.10311085702836975, 0.10524201369020834, 0.10745450311780226, 0.10974957308275263, 0.11212658704442256, 0.114583153132418, 0.11711530173307913, 0.11971769620417695, 0.12238386188507969, 0.12510642027422278, 0.12787731760159368, 0.1306880396437217, 0.13352980719774157 ], [ 0.03569157353467037, 0.0358376813801424, 0.03656222882725624, 0.03776348424589793, 0.03933310596339611, 0.04117072848402817, 0.043192006113096634, 0.04533098255702898, 0.04753890810035765, 0.049781391042623094, 0.05203510139488975, 0.054284673614939466, 0.05652009416012898, 0.05873466251885865, 0.06092351481274188, 0.06308265093315628, 0.0652083843150435, 0.06729712576193791, 0.06934541360444832, 0.07135010894158988, 0.07330868472963854, 0.07521954933550236, 0.07708235743925285, 0.07889827281170121, 0.0806701578991035, 0.08240267411273983, 0.08410228434663868, 0.08577715580725939, 0.08743696705157081, 0.08909262843918453, 0.09075593010051025, 0.09243913590315296, 0.09415454547670313, 0.09591404872334947, 0.09772869797395257, 0.09960832173364384, 0.10156120071611348, 0.10359382181309028, 0.10571071930889413, 0.10791440577392766, 0.11020538847961325, 0.11258226161397301, 0.11504186057018037, 0.11757946237054931, 0.12018901582675379, 0.12286338604537692, 0.12559459995156197, 0.12837408216968627, 0.13119287345629352, 0.13404182660468902 ], [ 0.03840167536639278, 0.03856162612624399, 0.03927644645321558, 0.04045259782687013, 0.04198984920281412, 0.043793858985608336, 0.04578358682933523, 0.04789397762353052, 0.050075476755456594, 0.05229190008960284, 0.05451772382119952, 0.05673540943684428, 0.05893306682326084, 0.06110257361506616, 0.06323816812573749, 0.06533548090298559, 0.0673909441392493, 0.06940150713382022, 0.07136458379915903, 0.07327816162732463, 0.07514100853540034, 0.07695292304231997, 0.07871498306810604, 0.08042975838716541, 0.0821014608515901, 0.08373601469220165, 0.08534103652159973, 0.08692572127392745, 0.08850063642886934, 0.09007743262693141, 0.09166848419015146, 0.09328647793394097, 0.09494397263502369, 0.09665295414154328, 0.09842441191220021, 0.10026796142986119, 0.10219153339448288, 0.10420114513941392, 0.10630076293791128, 0.10849225660290479, 0.11077544092794245, 0.11314819285563134, 0.11560662932527113, 0.1181453287563081, 0.12075757897030673, 0.12343563570616298, 0.1261709782757047, 0.12895455184968738, 0.13177698892555073, 0.13462880538148467 ], [ 0.04133400491686941, 0.04149872853244648, 0.04219400801250619, 0.04333439167688998, 0.04482769942198795, 0.046585798418885944, 0.048531363043114596, 0.050600753992601034, 0.052744117434803436, 0.05492390219129664, 0.05711270416336292, 0.05929100753540793, 0.061445131311617454, 0.06356552171851865, 0.06564543240235922, 0.06767997948946929, 0.06966552942580861, 0.07159936337427142, 0.0734795569038006, 0.07530501441574057, 0.07707560214115433, 0.07879233014026517, 0.08045754144149259, 0.08207507447442164, 0.08365037277133296, 0.08519052329324192, 0.08670421164576234, 0.08820158898132968, 0.08969405166075975, 0.09119394082786864, 0.09271417485554949, 0.09426783289143524, 0.09586771204132974, 0.09752588355741829, 0.09925327424762712, 0.10105929786186847, 0.10295155740637314, 0.10493563352069124, 0.10701496689916985, 0.10919083515501034, 0.11146241746636404, 0.11382693462790504, 0.11627984829129587, 0.11881510139772906, 0.12142538194036923, 0.12410239385798331, 0.12683712154359794, 0.12962007763335848, 0.13244152697398204, 0.13529168262420818 ], [ 0.04447047227125286, 0.04463227725197378, 0.04530000912150379, 0.046395969066210865, 0.047835768440222165, 0.04953750411708275, 0.05142786098504744, 0.05344507249258996, 0.05553948195931815, 0.05767262150417501, 0.05981556559878318, 0.06194707205983821, 0.0640518129776251, 0.06611885056725297, 0.06814041974285856, 0.07011102378400792, 0.07202681796042712, 0.07388523922353872, 0.07568483250733732, 0.07742522249265665, 0.07910718179510884, 0.08073275101828417, 0.08230537195003157, 0.08383000164891108, 0.08531318180728002, 0.08676304434995738, 0.08818924067060686, 0.08960278826274014, 0.09101583482616905, 0.09244134621158417, 0.09389273065428727, 0.0953834173164912, 0.09692641171949974, 0.09853385363098245, 0.10021660384847812, 0.10198388475063874, 0.10384299545971425, 0.10579911635016051, 0.10785521018640269, 0.11001201934514183, 0.11226815137847504, 0.11462023944450939, 0.1170631604011722, 0.11959029178273564, 0.12219378927138154, 0.12486486820887452, 0.1275940756205494, 0.13037154260145883, 0.1331872102854056, 0.13603102565437472 ], [ 0.04779137666778896, 0.047943948769839984, 0.048577851222720965, 0.04962265868399589, 0.051001375327423965, 0.05263821316131882, 0.05446404907148017, 0.05641936921373221, 0.05845517444014593, 0.06053252915579244, 0.06262136849259296, 0.06469901319492208, 0.06674867865060631, 0.0687581394658874, 0.07071862595923704, 0.07262397497931283, 0.07447002480643106, 0.07625422519338959, 0.07797542393368695, 0.07963378758695296, 0.08123081411922299, 0.08276939785924946, 0.08425391137124497, 0.08569027393367279, 0.08708598186707335, 0.0884500817437318, 0.08979307345890755, 0.09112673625057208, 0.09246387702939994, 0.09381800675433413, 0.09520295685072051, 0.0966324534335259, 0.09811967182889854, 0.09967679697042368, 0.1013146161267183, 0.10304216875283587, 0.10486647405481027, 0.10679235052975526, 0.10882233407869098, 0.11095669329990944, 0.11319353329560439, 0.11552897361876639, 0.11795738237245992, 0.12047164708119393, 0.12306346356506898, 0.12572362619920824, 0.12844230606156384, 0.13120930700104624, 0.13401429313175484, 0.1368469843526549 ], [ 0.051276333915727515, 0.05141464927095448, 0.052010002018753984, 0.05299868264989795, 0.05431060396911284, 0.055875874999254733, 0.05762964079381779, 0.059514934286142504, 0.061483819346386706, 0.06349731835830623, 0.06552461182990016, 0.06754189382930655, 0.0695311460465414, 0.07147899100192422, 0.07337570997685108, 0.0752144605349546, 0.07699069596554867, 0.07870176911584267, 0.0803466918105958, 0.08192601559243612, 0.08344179796304134, 0.08489761936733774, 0.08629861893672153, 0.0876515208749032, 0.08896462793655262, 0.09024776349726414, 0.09151214915438226, 0.09277021060749027, 0.09403531071333102, 0.09532141497754322, 0.09664270107622422, 0.09801312986321845, 0.09944600013522022, 0.10095351255267027, 0.10254636897827626, 0.10423343175459887, 0.10602146311834701, 0.10791495848482564, 0.10991607954940359, 0.11202468508776105, 0.1142384500505364, 0.11655305790015004, 0.11896244763986756, 0.1214590957489268, 0.12403431401954143, 0.12667854660653294, 0.12938165285930125, 0.13213316613903747, 0.1349225223658642, 0.13773925516893756 ], [ 0.054904944196542044, 0.05502513729125975, 0.055578582636290674, 0.05650770062597469, 0.05774878611609294, 0.05923755446619669, 0.060913404843377775, 0.06272212505565462, 0.06461718175558731, 0.06655994149402353, 0.06851920013898043, 0.07047034059128399, 0.07239435314401009, 0.07427687214477731, 0.07610731873779775, 0.07787819340250454, 0.07958453072401697, 0.08122350860792459, 0.08279419183033765, 0.08429738303162482, 0.08573555133008286, 0.08711280845796744, 0.08843490386970235, 0.08970921306875379, 0.0909446970795799, 0.09215181534857143, 0.09334237929730907, 0.09452933922853964, 0.09572650323713283, 0.0969481930539169, 0.09820884805337392, 0.09952259452147595, 0.10090280210077147, 0.10236165244406231, 0.10390974593676772, 0.10555577055269744, 0.1073062525218935, 0.10916540197230032, 0.11113505889410444, 0.11321473672194227, 0.11540175359681241, 0.11769143581085419, 0.12007737455442942, 0.12255171597277727, 0.12510546544117962, 0.127728789386481, 0.13041130132318315, 0.13314232246210908, 0.1359111108245469, 0.13870705593656446 ], [ 0.0586572486643044, 0.0587564634069397, 0.05926580179744853, 0.0601332341485435, 0.06130090058338182, 0.06270978682005873, 0.06430345966881014, 0.0660305902300533, 0.06784631827127553, 0.06971269096443379, 0.07159846158146195, 0.0734785088897971, 0.07533308092940694, 0.07714700555694536, 0.0789089574425048, 0.08061083067888772, 0.08224723706666873, 0.08381513030185067, 0.0853135434640352, 0.0867434195036101, 0.08810751042042624, 0.08941031945778624, 0.09065806114757273, 0.0918586159132063, 0.09302145883066512, 0.09415754587023628, 0.09527914539434623, 0.09639960780939012, 0.09753307197496942, 0.09869411308284654, 0.09989734290643872, 0.10115697910175624, 0.10248640499055237, 0.10389774430846377, 0.10540147617836806, 0.10700611374189456, 0.108717965492622, 0.11054099186949601, 0.11247676192365334, 0.11452450691507784, 0.11668126057657469, 0.11894207034199411, 0.1213002605606665, 0.12374772769824552, 0.12627524849322724, 0.12887278450184655, 0.13152976982889097, 0.13423537254102397, 0.13697872383284534, 0.13974911215020946 ], [ 0.0625140266811258, 0.06259026812728218, 0.06305426539417179, 0.06385898622031487, 0.064951891340396, 0.06627887778840305, 0.06778753905240113, 0.06942948841180448, 0.07116174143586988, 0.07294730779796815, 0.0747552033970492, 0.07656009083265507, 0.07834172121226202, 0.0800843055783606, 0.08177590215041669, 0.08340787098077491, 0.08497442137147246, 0.08647225857267538, 0.0879003234508553, 0.08925961058729612, 0.0905530454879931, 0.09178539935836703, 0.09296321955788121, 0.09409475493554233, 0.09518985745370298, 0.09625984465451641, 0.09731731151112803, 0.09837588496161803, 0.09944991984158846, 0.10055414081024315, 0.10170324086237342, 0.10291145263518854, 0.1041921133299734, 0.10555724701278742, 0.10701718877144245, 0.1085802733697159, 0.11025260670379658, 0.11203793199332596, 0.11393759505057105, 0.1159506051920529, 0.11807378141057827, 0.12030196813010882, 0.12262830169444852, 0.12504450777694678, 0.127541210884896, 0.13010823958310586, 0.13273491439580568, 0.13541030900846188, 0.13812347893001384, 0.14086365488214178 ], [ 0.06645697870498218, 0.06650897508517349, 0.0669271896685946, 0.06766907473486236, 0.06868691339506935, 0.06993114890782026, 0.07135322233033553, 0.0729076903332565, 0.07455358483736756, 0.07625510482862276, 0.0779817923275001, 0.07970835519314348, 0.08141428061250415, 0.0830833520584149, 0.08470314996662204, 0.08626458768728952, 0.08776151123972162, 0.0891903740528853, 0.09054998546765783, 0.09184132337617036, 0.09306739610536569, 0.0942331357913987, 0.09534530448084526, 0.09641239463193689, 0.09744450730600494, 0.09845319397220546, 0.09945125139853687, 0.10045246348743114, 0.10147128901349033, 0.10252249981806245, 0.10362077975739978, 0.10478030008678615, 0.106014291376587, 0.10733463485384985, 0.10875149670104098, 0.11027302702012626, 0.11190514093940532, 0.11365139315297326, 0.11551294983091898, 0.11748865430985496, 0.11957517625261264, 0.12176722884075551, 0.1240578354917424, 0.1264386266581459, 0.12890014822510315, 0.13143216540821195, 0.13402394930791445, 0.13666453685923802, 0.1393429583878364, 0.1420484300407539 ], [ 0.07046882995431053, 0.07049590938617552, 0.07086854229361805, 0.0715481977611842, 0.07249151764206041, 0.07365313253259487, 0.07498812771670739, 0.0764539587831511, 0.0780117600493326, 0.07962709421106813, 0.08127024957550875, 0.08291620959159456, 0.08454441201778216, 0.08613839475276457, 0.08768540106712132, 0.08917599383286509, 0.09060370867518523, 0.09196476041191787, 0.09325780550166159, 0.09448375495314563, 0.09564562664893073, 0.09674842275382833, 0.09779901636363175, 0.0988060314683891, 0.09977970142704086, 0.10073169333084825, 0.10167488877632505, 0.10262311558575875, 0.10359082977250819, 0.10459275232312604, 0.10564347080258844, 0.10675702088862857, 0.10794646710919141, 0.1092235046765905, 0.11059810486716423, 0.11207822460421976, 0.11366959682089639, 0.11537561223968001, 0.11719729615960567, 0.11913337662771861, 0.12118043392294436, 0.12333311634906965, 0.1255844043598442, 0.1279259041110461, 0.13034815242731115, 0.1328409174476324, 0.13539348234151882, 0.13799490295195402, 0.14063423359644103, 0.1433007182462075 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.49413520097732544, 0.1663476973772049, 0.8710343837738037, 0.2660937011241913, 0.6893220543861389, 0.8930215239524841, 0.05016168472066152, 0.019956304820095833, 0.016936214142923834, 0.047235472647003736, 0.020497758446587033, 0.0, 0.01697528087159704, 0.004435467297758686, 1.8694011965201629e-16, 1.026427977968963e-16, 0.0, 0.000862642263207545, 0.07530164739396178, 0.06540342666120247, 0.4689431181177497, 0.04138983684782125, 0.057376875542104244, 0.7780935671180487 ], "xaxis": "x", "y": [ 0.9350554943084717, 0.4891054630279541, 0.7052580714225769, 0.08430751413106918, 0.8599988222122192, 0.3056820333003998, 0.44818277531980766, 0.445996273196264, 0.3692125056769028, 0.49709140121138345, 0.5458366229786391, 0.6028125810859388, 0.5612355290640024, 0.5323399768138534, 0.6447948396396744, 0.6663680881124604, 0.5950886560911629, 0.5620550390640772, 0.5581003143275839, 0.5230372101673001, 0.20554301794618368, 0.5861650473548686, 0.7384011242538691, 0.17457274068146944 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.49413520097732544, 0.1663476973772049, 0.8710343837738037, 0.2660937011241913, 0.6893220543861389, 0.8930215239524841, 0.05016168472066152, 0.019956304820095833, 0.016936214142923834, 0.047235472647003736, 0.020497758446587033, 0.0, 0.01697528087159704, 0.004435467297758686, 1.8694011965201629e-16, 1.026427977968963e-16, 0.0, 0.000862642263207545, 0.07530164739396178, 0.06540342666120247, 0.4689431181177497, 0.04138983684782125, 0.057376875542104244, 0.7780935671180487 ], "xaxis": "x2", "y": [ 0.9350554943084717, 0.4891054630279541, 0.7052580714225769, 0.08430751413106918, 0.8599988222122192, 0.3056820333003998, 0.44818277531980766, 0.445996273196264, 0.3692125056769028, 0.49709140121138345, 0.5458366229786391, 0.6028125810859388, 0.5612355290640024, 0.5323399768138534, 0.6447948396396744, 0.6663680881124604, 0.5950886560911629, 0.5620550390640772, 0.5581003143275839, 0.5230372101673001, 0.20554301794618368, 0.5861650473548686, 0.7384011242538691, 0.17457274068146944 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04842687487510264, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.3283686366060423, -1.3283686366060423, -1.3283686366060423, -1.8653714023367316, -2.32342312320512, -2.417506850279842, -2.417506850279842, -2.417506850279842, -2.5042450400069325, -2.5042450400069325, -2.765065067378786, -2.914444730454179, -2.9407170371220483, -2.9407170371220483, -2.9407170371220483, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.041148629039525986
x2: 0.4494225084781647
x3: 0.49413520097732544
x4: 0.9350554943084717
x5: 0.040935810655355453
x6: 0.6440455317497253", "
Parameterization:
x1: 0.2857678532600403
x2: 0.600216269493103
x3: 0.1663476973772049
x4: 0.4891054630279541
x5: 0.4831869304180145
x6: 0.1057882308959961", "
Parameterization:
x1: 0.8522157073020935
x2: 0.11601513624191284
x3: 0.8710343837738037
x4: 0.7052580714225769
x5: 0.637039303779602
x6: 0.9260263442993164", "
Parameterization:
x1: 0.8920990228652954
x2: 0.7307854890823364
x3: 0.2660937011241913
x4: 0.08430751413106918
x5: 0.28873196244239807
x6: 0.7999509572982788", "
Parameterization:
x1: 0.4663430452346802
x2: 0.2460964322090149
x3: 0.6893220543861389
x4: 0.8599988222122192
x5: 0.5675882697105408
x6: 0.2296975702047348", "
Parameterization:
x1: 0.20609870553016663
x2: 0.8346359729766846
x3: 0.8930215239524841
x4: 0.3056820333003998
x5: 0.8770380020141602
x6: 0.5204114317893982", "
Parameterization:
x1: 0.30675558555234717
x2: 0.6267194874247792
x3: 0.05016168472066152
x4: 0.44818277531980766
x5: 0.47050588084196954
x6: 0.06270278036562879", "
Parameterization:
x1: 0.2250502329177462
x2: 0.7188857905091293
x3: 0.019956304820095833
x4: 0.445996273196264
x5: 0.46319411708790714
x6: 0.006988303984902697", "
Parameterization:
x1: 0.28806440484970325
x2: 0.5274124193294614
x3: 0.016936214142923834
x4: 0.3692125056769028
x5: 0.5005009048287059
x6: 0.017689430265294907", "
Parameterization:
x1: 0.3494522977329207
x2: 0.6720304627522604
x3: 0.047235472647003736
x4: 0.49709140121138345
x5: 0.44155031305980985
x6: 0.09501367280516824", "
Parameterization:
x1: 0.40132300897942824
x2: 0.7339013019194774
x3: 0.020497758446587033
x4: 0.5458366229786391
x5: 0.40667441179890407
x6: 0.1232124786802889", "
Parameterization:
x1: 0.445116106351731
x2: 0.8102739296888797
x3: 0.0
x4: 0.6028125810859388
x5: 0.3869211401177741
x6: 0.14627784918787237", "
Parameterization:
x1: 0.471791866888048
x2: 0.7631026767583268
x3: 0.01697528087159704
x4: 0.5612355290640024
x5: 0.302623576184133
x6: 0.12296029932274309", "
Parameterization:
x1: 0.4324373836464875
x2: 0.8029384163526634
x3: 0.004435467297758686
x4: 0.5323399768138534
x5: 0.38980763668382423
x6: 0.19945804958286145", "
Parameterization:
x1: 0.4436284360891264
x2: 0.7799105194147483
x3: 1.8694011965201629e-16
x4: 0.6447948396396744
x5: 0.39761198908178913
x6: 0.09303903913509257", "
Parameterization:
x1: 0.3739973899742409
x2: 0.7716763982631036
x3: 1.026427977968963e-16
x4: 0.6663680881124604
x5: 0.34101996888701874
x6: 0.11509218912715101", "
Parameterization:
x1: 0.45936881616360536
x2: 0.8373565525852932
x3: 0.0
x4: 0.5950886560911629
x5: 0.4097525876577973
x6: 0.08467486471484913", "
Parameterization:
x1: 0.44861793528239574
x2: 0.9071568460475623
x3: 0.000862642263207545
x4: 0.5620550390640772
x5: 0.4074624368750889
x6: 0.06427304888031582", "
Parameterization:
x1: 0.4416146699444828
x2: 0.9258527883134839
x3: 0.07530164739396178
x4: 0.5581003143275839
x5: 0.386882628832887
x6: 0.059623058296508595", "
Parameterization:
x1: 0.49072243904581697
x2: 0.9122897350911305
x3: 0.06540342666120247
x4: 0.5230372101673001
x5: 0.41129991170626046
x6: 0.040054510156233875", "
Parameterization:
x1: 0.6629438269883394
x2: 0.040698133409023285
x3: 0.4689431181177497
x4: 0.20554301794618368
x5: 0.902362366206944
x6: 0.3468046998605132", "
Parameterization:
x1: 0.4064773338609024
x2: 0.938608765232727
x3: 0.04138983684782125
x4: 0.5861650473548686
x5: 0.3736346402677701
x6: 0.06674968638342735", "
Parameterization:
x1: 0.02012301329523325
x2: 0.6221157927066088
x3: 0.057376875542104244
x4: 0.7384011242538691
x5: 0.6004138411954045
x6: 0.63361581787467", "
Parameterization:
x1: 0.9122729804366827
x2: 0.9893355583772063
x3: 0.7780935671180487
x4: 0.17457274068146944
x5: 0.322604451328516
x6: 0.9812758872285485", "
Parameterization:
x1: 0.4155690546953554
x2: 0.9248132327401162
x3: 0.06458696051041386
x4: 0.5678842583352627
x5: 0.4130131458740523
x6: 0.07771532290941868" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04842687487510264, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.3283686366060423, -1.3283686366060423, -1.3283686366060423, -1.8653714023367316, -2.32342312320512, -2.417506850279842, -2.417506850279842, -2.417506850279842, -2.5042450400069325, -2.5042450400069325, -2.765065067378786, -2.914444730454179, -2.9407170371220483, -2.9407170371220483, -2.9407170371220483, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.04842687487510264, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.1594617340949187, -1.3283686366060423, -1.3283686366060423, -1.3283686366060423, -1.8653714023367316, -2.32342312320512, -2.417506850279842, -2.417506850279842, -2.417506850279842, -2.5042450400069325, -2.5042450400069325, -2.765065067378786, -2.914444730454179, -2.9407170371220483, -2.9407170371220483, -2.9407170371220483, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742, -2.9611581029380742 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:12] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:12] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 15, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:12] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:16] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.06, 'x2': 0.29, 'x3': 0.64, 'x4': 0.79, 'x5': 0.48, 'x6': 0.4}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:16] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax.get_next_trial()\n", "ax.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-24 14:50:16] ax.service.ax_client: Attached custom parameterization {'x1': 9.0, 'x2': 9.0, 'x3': 9.0, 'x4': 9.0, 'x5': 9.0, 'x6': 9.0} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 9.0, 'x2': 9.0, 'x3': 9.0, 'x4': 9.0, 'x5': 9.0, 'x6': 9.0}, 26)" ] }, "execution_count": 17, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax.attach_trial(parameters={\"x1\": 9.0, \"x2\": 9.0, \"x3\": 9.0, \"x4\": 9.0, \"x5\": 9.0, \"x6\": 9.0})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.7" } }, "nbformat": 4, "nbformat_minor": 2 }