{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ipy_plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import render, init_notebook_plotting\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objective name, minimization setting, and outcome constraints). Note that:\n", "- Only `name`, `parameters`, and `objective_name` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 6 trials, GPEI for subsequent trials]). Iterations after 6 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objective_name=\"hartmann6\",\n", " minimize=True, # Optional, defaults to False.\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objective_name` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "metadata": { "collapsed": true }, "outputs": [], "source": [ "import numpy as np\n", "def evaluate(parameters):\n", " x = np.array([parameters.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x ** 2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.9, 'x2': 0.1, 'x3': 0.59, 'x4': 0.87, 'x5': 0.34, 'x6': 0.43}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.02, 0.0), 'l2norm': (1.49, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.08, 'x2': 0.19, 'x3': 0.41, 'x4': 0.59, 'x5': 0.39, 'x6': 0.96}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.56, 0.0), 'l2norm': (1.28, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.59, 'x2': 0.95, 'x3': 0.84, 'x4': 0.24, 'x5': 0.1, 'x6': 0.33}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.2, 0.0), 'l2norm': (1.46, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.61, 'x2': 0.1, 'x3': 0.34, 'x4': 0.92, 'x5': 0.02, 'x6': 0.61}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.01, 0.0), 'l2norm': (1.31, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.47, 'x2': 0.45, 'x3': 0.2, 'x4': 0.05, 'x5': 0.24, 'x6': 0.76}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:27] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.88, 0.0), 'l2norm': (1.05, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:28] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.05, 'x2': 0.51, 'x3': 0.58, 'x4': 0.8, 'x5': 0.03, 'x6': 0.34}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:28] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.05, 0.0), 'l2norm': (1.17, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:33] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.36, 'x2': 0.41, 'x3': 0.22, 'x4': 0.12, 'x5': 0.3, 'x6': 0.85}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:33] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-1.31, 0.0), 'l2norm': (1.08, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:37] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.28, 'x2': 0.4, 'x3': 0.23, 'x4': 0.14, 'x5': 0.34, 'x6': 0.92}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:37] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-1.12, 0.0), 'l2norm': (1.13, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:42] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.34, 'x2': 0.35, 'x3': 0.26, 'x4': 0.21, 'x5': 0.26, 'x6': 0.81}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:42] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-1.93, 0.0), 'l2norm': (1.04, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:45] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.36, 'x2': 0.31, 'x3': 0.28, 'x4': 0.26, 'x5': 0.22, 'x6': 0.76}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:45] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-2.17, 0.0), 'l2norm': (1.0, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:49] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.31, 'x2': 0.22, 'x3': 0.28, 'x4': 0.23, 'x5': 0.16, 'x6': 0.75}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:49] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-1.89, 0.0), 'l2norm': (0.93, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:53] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.38, 'x2': 0.32, 'x3': 0.21, 'x4': 0.31, 'x5': 0.24, 'x6': 0.73}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:53] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-2.22, 0.0), 'l2norm': (0.99, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:56] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.45, 'x2': 0.31, 'x3': 0.22, 'x4': 0.31, 'x5': 0.21, 'x6': 0.81}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 16:59:56] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-1.67, 0.0), 'l2norm': (1.07, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:00] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.32, 'x2': 0.33, 'x3': 0.25, 'x4': 0.29, 'x5': 0.27, 'x6': 0.68}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:00] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-2.53, 0.0), 'l2norm': (0.95, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:03] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.27, 'x2': 0.36, 'x3': 0.27, 'x4': 0.29, 'x5': 0.3, 'x6': 0.62}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:03] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-2.57, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:07] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.31, 'x2': 0.29, 'x3': 0.28, 'x4': 0.29, 'x5': 0.35, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:07] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-2.7, 0.0), 'l2norm': (0.94, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:11] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.32, 'x2': 0.34, 'x3': 0.33, 'x4': 0.31, 'x5': 0.4, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:11] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-2.33, 0.0), 'l2norm': (1.01, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:15] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.29, 'x2': 0.25, 'x3': 0.25, 'x4': 0.27, 'x5': 0.32, 'x6': 0.61}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:15] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-2.77, 0.0), 'l2norm': (0.87, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:19] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.36, 'x2': 0.25, 'x3': 0.29, 'x4': 0.27, 'x5': 0.31, 'x6': 0.57}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:19] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-2.64, 0.0), 'l2norm': (0.88, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:23] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.25, 'x2': 0.23, 'x3': 0.27, 'x4': 0.3, 'x5': 0.32, 'x6': 0.62}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:23] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-2.92, 0.0), 'l2norm': (0.87, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:26] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.2, 'x2': 0.18, 'x3': 0.31, 'x4': 0.3, 'x5': 0.32, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:27] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-3.11, 0.0), 'l2norm': (0.88, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:29] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.16, 'x2': 0.11, 'x3': 0.35, 'x4': 0.28, 'x5': 0.32, 'x6': 0.65}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:29] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-3.14, 0.0), 'l2norm': (0.87, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:32] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.22, 'x2': 0.11, 'x3': 0.35, 'x4': 0.29, 'x5': 0.31, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:32] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-3.19, 0.0), 'l2norm': (0.9, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:34] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.22, 'x2': 0.1, 'x3': 0.43, 'x4': 0.29, 'x5': 0.31, 'x6': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:34] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-3.26, 0.0), 'l2norm': (0.91, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:36] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.22, 'x2': 0.13, 'x3': 0.51, 'x4': 0.28, 'x5': 0.32, 'x6': 0.66}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:36] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-3.29, 0.0), 'l2norm': (0.97, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameters, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameters))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To view all trials in a data frame at any point during optimization:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/pandas/core/reshape/merge.py:618: UserWarning:\n", "\n", "merging between different levels can give an unintended result (2 levels on the left, 1 on the right)\n", "\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
arm_namehartmann6l2normtrial_indexx1x2x3x4x5x6
00_0-0.01603961.4932300.9015580.0957580.5916250.8699310.3447020.426782
31_0-0.5593941.2795310.0789770.1932850.4139010.5884460.3897110.961321
152_0-0.1966911.4626720.5936530.9491330.8404100.2423710.1039160.332091
183_0-0.01113161.3080330.6120970.0961460.3435620.9154760.0207360.608671
194_0-0.880251.0471340.4736110.4461210.1972110.0503550.2380700.758322
205_0-0.04829161.1652650.0466250.5102580.5766920.8041580.0301560.339332
216_0-1.305541.0798360.3566180.4097360.2238840.1237940.2973580.846818
227_0-1.118611.1278670.2774350.3989990.2261480.1433190.3449280.919367
238_0-1.926771.0374580.3381480.3507640.2557790.2073280.2631730.813181
249_0-2.165370.99692290.3575200.3088910.2786500.2597920.2196250.759767
110_0-1.891360.934063100.3052660.2226900.2838170.2337590.1591980.754425
211_0-2.221280.987186110.3799280.3225410.2063130.3075530.2426000.728114
412_0-1.669381.07298120.4530390.3130320.2246020.3110920.2103230.810309
513_0-2.534840.950263130.3195010.3343490.2468520.2948290.2699590.684390
614_0-2.567570.909179140.2710120.3568190.2690680.2852920.2963420.619864
715_0-2.695730.936299150.3101780.2926300.2788130.2884040.3507970.640969
816_0-2.329011.00818160.3192620.3442210.3253770.3107880.3973190.660074
917_0-2.771140.870337170.2946670.2540710.2450550.2718790.3218160.607099
1018_0-2.638720.878512180.3594450.2461990.2863290.2713230.3128930.573120
1119_0-2.921340.873726190.2472370.2271430.2672760.3047280.3219900.618631
1220_0-3.10510.876071200.2021990.1790960.3141420.2960320.3207740.636650
1321_0-3.141850.871935210.1553520.1106300.3526310.2753940.3239830.647103
1422_0-3.189740.900019220.2186440.1093500.3517750.2894360.3131450.666853
1623_0-3.255450.913593230.2214680.0994470.4267180.2947990.3066230.642418
1724_0-3.294840.967357240.2244570.1255990.5107240.2785740.3154960.656995
\n", "
" ], "text/plain": [ " arm_name hartmann6 l2norm trial_index x1 x2 x3 \\\n", "0 0_0 -0.0160396 1.49323 0 0.901558 0.095758 0.591625 \n", "3 1_0 -0.559394 1.27953 1 0.078977 0.193285 0.413901 \n", "15 2_0 -0.196691 1.46267 2 0.593653 0.949133 0.840410 \n", "18 3_0 -0.0111316 1.30803 3 0.612097 0.096146 0.343562 \n", "19 4_0 -0.88025 1.04713 4 0.473611 0.446121 0.197211 \n", "20 5_0 -0.0482916 1.16526 5 0.046625 0.510258 0.576692 \n", "21 6_0 -1.30554 1.07983 6 0.356618 0.409736 0.223884 \n", "22 7_0 -1.11861 1.12786 7 0.277435 0.398999 0.226148 \n", "23 8_0 -1.92677 1.03745 8 0.338148 0.350764 0.255779 \n", "24 9_0 -2.16537 0.996922 9 0.357520 0.308891 0.278650 \n", "1 10_0 -1.89136 0.934063 10 0.305266 0.222690 0.283817 \n", "2 11_0 -2.22128 0.987186 11 0.379928 0.322541 0.206313 \n", "4 12_0 -1.66938 1.07298 12 0.453039 0.313032 0.224602 \n", "5 13_0 -2.53484 0.950263 13 0.319501 0.334349 0.246852 \n", "6 14_0 -2.56757 0.909179 14 0.271012 0.356819 0.269068 \n", "7 15_0 -2.69573 0.936299 15 0.310178 0.292630 0.278813 \n", "8 16_0 -2.32901 1.00818 16 0.319262 0.344221 0.325377 \n", "9 17_0 -2.77114 0.870337 17 0.294667 0.254071 0.245055 \n", "10 18_0 -2.63872 0.878512 18 0.359445 0.246199 0.286329 \n", "11 19_0 -2.92134 0.873726 19 0.247237 0.227143 0.267276 \n", "12 20_0 -3.1051 0.876071 20 0.202199 0.179096 0.314142 \n", "13 21_0 -3.14185 0.871935 21 0.155352 0.110630 0.352631 \n", "14 22_0 -3.18974 0.900019 22 0.218644 0.109350 0.351775 \n", "16 23_0 -3.25545 0.913593 23 0.221468 0.099447 0.426718 \n", "17 24_0 -3.29484 0.967357 24 0.224457 0.125599 0.510724 \n", "\n", " x4 x5 x6 \n", "0 0.869931 0.344702 0.426782 \n", "3 0.588446 0.389711 0.961321 \n", "15 0.242371 0.103916 0.332091 \n", "18 0.915476 0.020736 0.608671 \n", "19 0.050355 0.238070 0.758322 \n", "20 0.804158 0.030156 0.339332 \n", "21 0.123794 0.297358 0.846818 \n", "22 0.143319 0.344928 0.919367 \n", "23 0.207328 0.263173 0.813181 \n", "24 0.259792 0.219625 0.759767 \n", "1 0.233759 0.159198 0.754425 \n", "2 0.307553 0.242600 0.728114 \n", "4 0.311092 0.210323 0.810309 \n", "5 0.294829 0.269959 0.684390 \n", "6 0.285292 0.296342 0.619864 \n", "7 0.288404 0.350797 0.640969 \n", "8 0.310788 0.397319 0.660074 \n", "9 0.271879 0.321816 0.607099 \n", "10 0.271323 0.312893 0.573120 \n", "11 0.304728 0.321990 0.618631 \n", "12 0.296032 0.320774 0.636650 \n", "13 0.275394 0.323983 0.647103 \n", "14 0.289436 0.313145 0.666853 \n", "16 0.294799 0.306623 0.642418 \n", "17 0.278574 0.315496 0.656995 " ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_trials_data_frame().sort_values('trial_index')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.2214675716720253,\n", " 'x2': 0.09944705457974683,\n", " 'x3': 0.42671826779535044,\n", " 'x4': 0.29479881159974686,\n", " 'x5': 0.30662336254152744,\n", " 'x6': 0.6424184201249653}" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'l2norm': 0.9135927806724522, 'hartmann6': -3.2554522556956935}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:36] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -2.600753659379716, -2.6527515322279824, -2.701577374819468, -2.746790611428813, -2.787945452643412, -2.824598355173692, -2.8563172826773364, -2.8826928028642183, -2.9033507914664094, -2.9179661297521315, -2.9262763477597233, -2.928093823540543, -2.9233150718972176, -2.9119259506615913, -2.894002230890954, -2.8697057171506843, -2.839276715026024, -2.803023964035961, -2.7613131748364985, -2.7145551289620307, -2.6631940414228863, -2.6076966411299747, -2.5485422324840137, -2.4862138689372513, -2.421190684315916, -2.3539413749513973, -2.284918792668803, -2.214555587143386, -2.1432608214100233, -2.071417474154538, -1.999380735903887, -1.9274770030009867, -1.856003473064396, -1.7852282481824586, -1.7153908569395118, -1.6467031129836245, -1.5793502356518203, -1.513492166622933, -1.4492650251967838, -1.3867826532216903, -1.3261382086348723, -1.2674057738625872, -1.2106419518503078, -1.155887428223834, -1.1031684830316422, -1.0524984397302122, -1.0038790426088449, -0.9573017567794405, -0.9127489872525203, -0.8701952155555108 ], [ -2.6224200207379242, -2.675378536551455, -2.7251331292498584, -2.7712292903146616, -2.813205757127837, -2.8506021705396725, -2.8829687289483594, -2.90987793154754, -2.930938209454703, -2.9458087930047245, -2.9542146333095247, -2.95595976556986, -2.9509373965808554, -2.9391353619579883, -2.920636365544473, -2.895613312315585, -2.8643207503586576, -2.8270837564888742, -2.7842855511276503, -2.7363548616242417, -2.6837537310146558, -2.6269661924848635, -2.566488032764628, -2.5028177433142664, -2.436448684838345, -2.3678624476518806, -2.2975233634093835, -2.2258741047052597, -2.153332294505568, -2.080288036182182, -2.007102267053363, -1.9341058339837895, -1.8615991887914973, -1.7898526036873217, -1.719106812217365, -1.649573988514863, -1.5814389863731673, -1.5148607690520235, -1.4499739702540797, -1.3868905359211463, -1.3257014050952, -1.266478195883726, -1.2092748694727975, -1.1541293511283923, -1.101065092248708, -1.05009256184098, -1.0012106593754808, -0.9544080439026503, -0.9096643766924756, -0.8669514765493913 ], [ -2.639950778574791, -2.693731326106094, -2.74428083987387, -2.7911321973094445, -2.8338100569469677, -2.871838698280043, -2.9047520501196376, -2.9321060586334426, -2.9534932220587153, -2.9685585980607536, -2.9770159577521937, -2.978662238506521, -2.9733883223547117, -2.961184617220168, -2.942140853199666, -2.9164405692525497, -2.8843515479773103, -2.846213745946995, -2.8024261254476217, -2.7534334327328613, -2.6997135871246325, -2.6417660499011295, -2.5801013520922806, -2.515231852769961, -2.447663741837145, -2.3778902685805132, -2.306386154758752, -2.2336031323100514, -2.1599665291920327, -2.0858728128537876, -2.011687990359492, -1.9377467579614833, -1.8643522911484012, -1.7917765685388332, -1.7202611287372584, -1.6500181675090746, -1.5812318924296354, -1.5140600626770473, -1.4486356521894517, -1.3850685844953716, -1.3234474968246461, -1.2638414994351992, -1.20630190337737, -1.1508638961707687, -1.0975481501475852, -1.0463623526079242, -0.9973026505384434, -0.950355005567384, -0.9054964571662611, -0.8626962939512581 ], [ -2.653117436630382, -2.707565578143276, -2.7587601469033234, -2.806222950108039, -2.849466247517925, -2.8880007662731186, -2.921346089003464, -2.949043621191686, -2.9706719868270035, -2.9858641062668747, -2.9943244748773727, -2.995844554448305, -2.990314062614045, -2.9777265077023007, -2.958178432083635, -2.9318630425972243, -2.8990597346802742, -2.8601212430650627, -2.815459898586, -2.7655340171042915, -2.7108350224837645, -2.651875610170536, -2.5891790898860645, -2.5232699631256157, -2.454665751422784, -2.3838700673779885, -2.311366899422368, -2.2376160596478067, -2.1630497226676084, -2.088069964613091, -2.013047197007631, -1.9383193815224904, -1.8641919086920542, -1.7909380259725747, -1.7187997070147842, -1.6479888634431379, -1.5786888115798543, -1.5110559183834265, -1.445221362588505, -1.3812929580833209, -1.319356996604693, -1.2594800757036855, -1.2017108855960048, -1.1460819350034113, -1.0926112015055873, -1.0413036963731903, -0.9921529374648502, -0.9451423266648913, -0.9002464306264338, -0.8574321653662396 ], [ -2.6617165088828547, -2.7166629045747723, -2.7683375209517935, -2.816252871104805, -2.8599107953056504, -2.8988106512801846, -2.9324600500114224, -2.9603883885200872, -2.9821630378086024, -2.997407373063768, -3.0058189988667245, -3.0071858476649007, -3.0013977311451496, -2.9884516260027736, -2.9684502745766053, -2.9415950161589226, -2.908174588209426, -2.8685517603408726, -2.8231492881748617, -2.7724361423388997, -2.7169145261851737, -2.657107923997219, -2.5935502900250156, -2.526776436327043, -2.4573136549152337, -2.385674590760065, -2.3123513580785033, -2.2378108636209877, -2.1624912713798636, -2.0867995173621208, -2.0111097636764628, -1.9357626694904189, -1.8610653523565008, -1.7872919159555756, -1.7146844279077715, -1.643454242271054, -1.5737835741414021, -1.5058272471325944, -1.4397145475339006, -1.3755511310269597, -1.3134209386579365, -1.2533880881754949, -1.1954987148618834, -1.1397827426881173, -1.0862555721450646, -1.034919675587608, -0.9857660945268919, -0.9387758361552048, -0.8939211686143435, -0.8511668162304349 ], [ -2.665574956132229, -2.720836850379487, -2.7728128580383777, -2.8210082111533596, -2.8649166187219466, -2.904028639248275, -2.9378427502093682, -2.965879395778454, -2.9876978612778595, -3.002915078146714, -3.0112245427073154, -3.0124128161337804, -3.0063710380909545, -2.993099753328946, -2.972706822344154, -2.945399590940128, -2.9114732481383845, -2.871297283645933, -2.82530145837535, -2.773962119655204, -2.7177892681860083, -2.6573145617949443, -2.5930803594388396, -2.5256298895286764, -2.4554986178412683, -2.383206870561274, -2.3092537350242472, -2.2341122203407, -2.1582256196247505, -2.0820049809107477, -2.005827568515505, -1.930036181782595, -1.8549391932275776, -1.780811171361003, -1.7078939626787861, -1.6363981202537659, -1.5665045811214584, -1.4983665097571088, -1.432111239378733, -1.3678422559738705, -1.3056411815359112, -1.2455697229302767, -1.1876715611496578, -1.1319741625983868, -1.0784904996424691, -1.0272206721543409, -0.978153425344489, -0.9312675619616071, -0.8865332490972232, -0.843913221466376 ], [ -2.6645556946792377, -2.719939037763449, -2.772026303446549, -2.820317689803145, -2.8643013695688113, -2.903462055438191, -2.937292381266018, -2.9653073879718956, -2.9870619294973455, -3.002170005836981, -3.010324047745, -3.01131145553633, -3.005025756941329, -2.991470793292776, -2.970757960566707, -2.9430979395132075, -2.908788967238459, -2.8682035100933874, -2.8217745912247363, -2.769982433566101, -2.71334171130534, -2.6523895562808306, -2.587674443790103, -2.519746094896742, -2.449146531132044, -2.3764023898295203, -2.3020185602408096, -2.2264731437915644, -2.150213687134657, -2.0736545914937943, -1.9971755699527076, -1.9211210065300046, -1.8458000656074862, -1.771487404868141, -1.6984243562954102, -1.6268204551476457, -1.556855213845083, -1.4886800547201646, -1.422420331511201, -1.358177383732174, -1.2960305803878986, -1.2360393199161508, -1.1782449618545572, -1.1226726727469623, -1.0693331744413497, -1.018224387405183, -0.9693329651926664, -0.9226357189154358, -0.8781009326422535, -0.8356895722083706 ], [ -2.658562908088772, -2.7138651543955947, -2.76586496936183, -2.8140599828585846, -2.8579357100791443, -2.89697431922509, -2.930666288111939, -2.958525217240548, -2.9801055558501526, -2.995022145249727, -3.002969476599948, -3.0037378739305365, -2.997223998145631, -2.983434279038439, -2.9624815959191046, -2.9345768693626217, -2.900017651400405, -2.8591754188712066, -2.812482585036413, -2.760419685371618, -2.703502920610689, -2.642272189905669, -2.5772797899655253, -2.509079996785188, -2.438219745751466, -2.365230582938038, -2.290621991082707, -2.2148761161300734, -2.138443848538536, -2.0617421565705247, -1.9851525302105537, -1.9090203739679361, -1.8336551818927287, -1.759331334765884, -1.6862893735875033, -1.614737621674563, -1.5448540472046128, -1.4767882770718976, -1.4106636903609608, -1.3465795350539715, -1.2846130246182794, -1.2248213819516673, -1.1672438070026565, -1.111903351491597, -1.0588086898030489, -1.00795577955106, -0.9593294087576397, -0.9129046292198217, -0.8686480776303775, -0.8265191874907312 ], [ -2.6475467890946667, -2.702560345986437, -2.754269031974288, -2.802170561917656, -2.845750905115821, -2.884493257336529, -2.9178899155412648, -2.9454572693098413, -2.9667535822278728, -2.981398369482127, -2.9890911943356833, -2.9896271017108473, -2.982906226328507, -2.9689364520013277, -2.9478297360505747, -2.91979392120549, -2.8851220563750006, -2.8441806841650035, -2.7973978164656184, -2.745250834249868, -2.688254398572588, -2.6269485186254387, -2.5618870314966617, -2.4936268121737837, -2.422718025195479, -2.3496956646934843, -2.275072533729165, -2.1993337115657545, -2.122932466583386, -2.0462875028708227, -1.9697813833343334, -1.8937599498562838, -1.81853255725622, -1.7443729471980582, -1.6715206056361758, -1.600182468714889, -1.5305348642023562, -1.462725596608317, -1.3968761030391406, -1.3330836231390957, -1.2714233401111952, -1.2119504609900216, -1.1547022133440734, -1.0996997427428628, -1.0469499009460823, -0.9964469191422637, -0.9481739639224295, -0.9021045762234683, -0.8582039953807139, -0.8164303718236239 ], [ -2.6315072692902586, -2.686023474360271, -2.737236556286271, -2.7846471060669447, -2.8277448108387415, -2.8660176156727437, -2.898963732372491, -2.9261066247531886, -2.94701254236257, -2.961309328122502, -2.9687043183071875, -2.9689986746684536, -2.9620959385566783, -2.9480039995652905, -2.9268313432281055, -2.898779459842294, -2.8641332683440135, -2.8232507004236735, -2.776551848407098, -2.724507698839727, -2.6676284621469994, -2.6064516793958212, -2.5415304591374124, -2.4734222801547148, -2.402678778088786, -2.3298368431828944, -2.255411230030631, -2.1798887502578026, -2.103724007179848, -2.0273365486671304, -1.9511092630474982, -1.8753878194295823, -1.800480951988696, -1.7266614005106666, -1.6541673405895843, -1.5832041614894539, -1.513946474498539, -1.4465402576411832, -1.3811050628745476, -1.3177362290677284, -1.256507058224053, -1.1974709238576224, -1.1406632895519175, -1.0861036228974272, -1.033797195583643, -0.9837367647175297, -0.9359041337153656, -0.8902715935785692, -0.8468032471890052, -0.8054562205803495 ], [ -2.6104962992388017, -2.664309700018252, -2.714826384124961, -2.7615526786421287, -2.803985295578535, -2.8416206437173415, -2.873966857564459, -2.9005585646359173, -2.920973855599306, -2.9348521326873795, -2.9419107294846305, -2.9419578744588275, -2.934900131769118, -2.920743841471671, -2.8995915991658423, -2.871635603885065, -2.8371494746208397, -2.7964793356833173, -2.7500342642039755, -2.6982759292446845, -2.641707375799309, -2.5808611829702106, -2.516287456277405, -2.4485422139831856, -2.3781766975797765, -2.3057280179195656, -2.2317113891731384, -2.156614043096223, -2.0808907822208207, -2.004961034645701, -1.9292072161055798, -1.8539741811847181, -1.7795695462647034, -1.7062646832873165, -1.6342962083004111, -1.5638678166262012, -1.4951523438330283, -1.4282939565321384, -1.3634103984836967, -1.3005952354082164, -1.2399200564790214, -1.1814366021220977, -1.1251787969315945, -1.0711646736639586, -1.0193981797959495, -0.9698708623533855, -0.9225634299118192, -0.8774471930566106, -0.8344853863430286, -0.7936343760547011 ], [ -2.5846183423506077, -2.637530975903875, -2.6871585828475353, -2.7330160664778194, -2.774610384107358, -2.8114499390754073, -2.843056488442608, -2.8689794680889498, -2.8888121018369235, -2.9022079624867105, -2.9088960290181314, -2.908692132553168, -2.9015053213954687, -2.8873389756478867, -2.8662877980942154, -2.8385323563338547, -2.8043324675360446, -2.7640198826585753, -2.717990084625792, -2.6666928673257155, -2.610621606387662, -2.550301501309499, -2.4862773530065905, -2.4191015586556848, -2.3493229661847037, -2.2774770849077557, -2.2040779559597303, -2.1296117959468646, -2.054532371216676, -1.979257951533968, -1.9041696300559152, -1.829610772900285, -1.7558873652011329, -1.6832690408138518, -1.6119906113554674, -1.5422539411488836, -1.4742300442391139, -1.4080613060532894, -1.3438637547460153, -1.281729325782345, -1.2217280782098725, -1.1639103328633325, -1.1083087119595634, -1.0549400666686601, -1.0038072847125523, -0.9549009741955362, -0.9082010229965806, -0.86367803537446, -0.8212946491315436, -0.7810067378889609 ], [ -2.554028929887013, -2.605854279627734, -2.654412265945909, -2.6992290852682217, -2.739824935504768, -2.775723389568875, -2.806463022690911, -2.8316110795303064, -2.8507784749366953, -2.8636348377376404, -2.869921855312601, -2.8694631813062017, -2.8621698393236787, -2.848041210910803, -2.827162737842474, -2.7997017921558434, -2.7659026794571178, -2.726080918741987, -2.680616378621185, -2.629944804499127, -2.5745476132312564, -2.514940277156239, -2.4516599526664398, -2.3852531466751117, -2.3162641696472526, -2.2452249540888483, -2.1726465925613225, -2.0990127294107896, -2.0247747631231214, -1.9503486957847236, -1.8761133999373696, -1.8024100499422695, -1.7295424713035348, -1.6577781850794806, -1.5873499562136273, -1.5184576880639362, -1.4512705368828012, -1.3859291476716975, -1.3225479361005692, -1.2612173601531496, -1.202006140296516, -1.1449633988634003, -1.0901206985679677, -1.0374939671780865, -0.9870853007865571, -0.9388846422251493, -0.8928713342387813, -0.8490155493111062, -0.8072795996860518, -0.7676191323004644 ], [ -2.5189313472839228, -2.569497699949284, -2.6168209683839785, -2.6604411286128213, -2.6998942601861415, -2.7347217823834917, -2.764481640395071, -2.7887611297845862, -2.8071906163979445, -2.8194569497828943, -2.8253150805293648, -2.8245965206185497, -2.817213944939862, -2.803162212316485, -2.7825168753523477, -2.7554313837741673, -2.722133640664735, -2.682921789802945, -2.638158627060889, -2.588264064745666, -2.5337054932285827, -2.4749863893851667, -2.412633897280958, -2.347186267593802, -2.279180998405758, -2.209144331968854, -2.1375825094465997, -2.0649749391334997, -1.9917692371900522, -1.9183779688538165, -1.8451768479277568, -1.772504129294524, -1.700660937608781, -1.62991230161973, -1.560488697712156, -1.4925879416422374, -1.4263773003227724, -1.3619957241224028, -1.2995561239938604, -1.2391476370533612, -1.180837839544682, -1.1246748780868352, -1.0706894993551792, -1.0188969654368552, -0.969298847496765, -0.9218846944624898, -0.8766335764816902, -0.8335155051537324, -0.7924927341677366, -0.7535209451309386 ], [ -2.4795717259257324, -2.5287247472535843, -2.5746660717101064, -2.6169516153892705, -2.6551355263429937, -2.688779158237395, -2.717461671375891, -2.7407918797429467, -2.758420604099121, -2.770052454954186, -2.7754558208458615, -2.7744700483675286, -2.7670094118710735, -2.753064270449976, -2.732700381021091, -2.7060573313282505, -2.673346491715152, -2.6348481566974473, -2.5909071287178262, -2.5419260906254597, -2.4883565789108983, -2.4306879171873588, -2.369434879626669, -2.305125038665116, -2.2382867144670215, -2.1694382451932492, -2.0990790239043093, -2.027682480208961, -1.9556909724135068, -1.8835124155709682, -1.81151839665398, -1.740043504282711, -1.6693856097338169, -1.599806863711921, -1.5315352089441188, -1.4647662452321548, -1.3996653173483014, -1.3363697253648321, -1.274990981235923, -1.2156170549855365, -1.158314569295296, -1.103130913320149, -1.0500962558436884, -0.9992254449903452, -0.950519787111178, -0.9039687015323009, -0.859551250898593, -0.8172375490914039, -0.7769900503279061, -0.7387647242000013 ], [ -2.436232953066004, -2.4838374149066667, -2.5282689449853164, -2.569101165094399, -2.605907968558208, -2.638272114792657, -2.6657951332393335, -2.688108117758899, -2.7048827098405503, -2.715841342034064, -2.720765770398434, -2.719503177035154, -2.7119696642645725, -2.6981515947747106, -2.678105627808926, -2.651958203872147, -2.619904673449418, -2.5822075932816504, -2.5391933469853116, -2.49124637718297, -2.4388008094037215, -2.3823298194055096, -2.3223335293180862, -2.259326424195819, -2.1938252561034797, -2.126338203423182, -2.0573557691252122, -1.9873436204648294, -1.9167373487237318, -1.84593897950165, -1.7753149854952097, -1.705195527855178, -1.6358746608263122, -1.5676112621359013, -1.5006304874556395, -1.435125584173664, -1.3712599337675608, -1.3091692215122546, -1.248963656664606, -1.1907301859316477, -1.1345346585656677, -1.0804239135355027, -1.0284277685637422, -0.9785608979703236, -0.9308245917001974, -0.8852083920171073, -0.8416916074160292, -0.8002447055764299, -0.760830588827047, -0.7234057567602403 ], [ -2.3892278665138575, -2.4351685594250916, -2.4779824820736502, -2.5172622996000524, -2.5526028099426603, -2.583609063869644, -2.609905500569782, -2.6311456725834916, -2.6470219229148455, -2.6572742391778563, -2.6616975384933776, -2.66014689713254, -2.652540698136649, -2.6388621596067297, -2.6191599713083695, -2.5935486170496267, -2.5622084309357893, -2.525384820358507, -2.4833857622840645, -2.436576826278977, -2.3853734756153093, -2.3302309738937668, -2.271632669637535, -2.21007765467033, -2.1460687836909313, -2.0801018519011, -2.0126564444973525, -1.9441886862871012, -1.8751258896577414, -1.805862945025826, -1.736760214456682, -1.6681426597212032, -1.600299942216444, -1.5334872583452117, -1.467926708828013, -1.4038090367664429, -1.3412956030345473, -1.2805204968911, -1.2215927040890733, -1.1645982744579522, -1.1096024465357606, -1.0566516990120727, -1.0057757081646252, -0.9569891977010436, -0.9102936729263017, -0.8656790353245085, -0.8231250767708556, -0.7826028549069279, -0.7440759529027174, -0.7075016280309196 ], [ -2.3388921786839383, -2.383074113178032, -2.424182614780462, -2.4618303046367354, -2.4956335619702257, -2.525220102537955, -2.5502373161246745, -2.570360953889994, -2.5853036078618867, -2.594822353693586, -2.598724998605047, -2.596874622194415, -2.589192475924785, -2.575659679169302, -2.5563183209053864, -2.531272402202402, -2.5006885669502936, -2.464796013645284, -2.423884690256886, -2.37830102092462, -2.3284408928481084, -2.274740192952117, -2.217663627536895, -2.157692792662669, -2.095314472507889, -2.031009970223649, -1.9652460054135032, -1.8984674324404296, -1.831091803445343, -1.7635056420694126, -1.6960622053421694, -1.6290804767956173, -1.562845135843038, -1.4976072714407915, -1.433585640672721, -1.3709683077492412, -1.3099145317530998, -1.2505568002670286, -1.1930029301584921, -1.1373381764208133, -1.0836273055956247, -1.0319166025622937, -0.9822357890018993, -0.9345998391785093, -0.8890106842919486, -0.8454588009186825, -0.8039246822672119, -0.7643801933644989, -0.7267898130414208, -0.6911117668398807 ], [ -2.2855775023955, -2.327925534980837, -2.3672602274749797, -2.4032146768895633, -2.43542710088844, -2.4635478376271487, -2.487246891538688, -2.5062216495447442, -2.520204294176489, -2.528968415355318, -2.53233441311844, -2.530173502407382, -2.5224104346631613, -2.5090253291651203, -2.4900551114873233, -2.465594877180051, -2.435799062665194, -2.4008818179004705, -2.3611157204872972, -2.316828105342756, -2.26839472481468, -2.216230981812615, -2.160781408155195, -2.1025082993202795, -2.0418804443262477, -1.9793627414528912, -1.9154072429267734, -1.8504459066703467, -1.7848851087117032, -1.7191018109338054, -1.653441185585154, -1.5882154576521863, -1.5237037225601557, -1.4601525150283123, -1.397776934064366, -1.3367621615326735, -1.2772652430176714, -1.2194170275834815, -1.1633241866792179, -1.109071251854186, -1.056722626534091, -1.0063245394283793, -0.9579069167670646, -0.9114851580253569, -0.8670618055325063, -0.8246281027419853, -0.7841654392568258, -0.7456466831873665, -0.7090374032504081, -0.6742969843418545 ], [ -2.2296447573257527, -2.2701027814617065, -2.3076137450952983, -2.3418313989451827, -2.3724157129338908, -2.3990392875258375, -2.42139414159138, -2.43919854409617, -2.4522034973740547, -2.4601984848169773, -2.4630161911998356, -2.460536090905409, -2.4526870379669705, -2.4394491955156585, -2.420855698437484, -2.396994269487466, -2.368008630694896, -2.3340991372804405, -2.295521844701624, -2.2525853351419545, -2.2056450173618107, -2.155095092349626, -2.1013587806930607, -2.0448776440183196, -1.9861008771618462, -1.925475328481959, -1.8634367882384013, -1.8004028424406648, -1.736767376659157, -1.6728966576327702, -1.6091268236748109, -1.5457625684067322, -1.4830767921882364, -1.4213110082375968, -1.360676315095333, -1.301354776285855, -1.2435010771393384, -1.1872443552572634, -1.1326901239822096, -1.0799222272682267, -1.029004779803464, -0.9799840585702959, -0.9328903217492814, -0.8877395384620385, -0.8445350187254412, -0.8032689375059245, -0.7639237502038136, -0.7264734994916835, -0.6908850153590034, -0.6571190116204986 ], [ -2.171458143661431, -2.209987972069187, -2.2456425416475425, -2.278096151394425, -2.30703017052319, -2.3321388731292827, -2.3531355198750785, -2.3697583999306575, -2.3817765145730134, -2.3889946062968512, -2.3912573285603953, -2.388452506363272, -2.380513621555046, -2.3674218014387045, -2.34920761044486, -2.3259527834499525, -2.297791720688748, -2.264912223766248, -2.2275547752132345, -2.1860097597553594, -2.1406123536737067, -2.0917352275305636, -2.039779574436347, -1.9851652029691869, -1.928320492269255, -1.8696729174238274, -1.809640669801849, -1.7486256822068984, -1.6870081723174564, -1.6251426670083222, -1.5633553716415527, -1.5019426963690847, -1.441170734540496, -1.3812754945321595, -1.3224637056977182, -1.2649140443766165, -1.2087786522398196, -1.1541848439760751, -1.1012369231182912, -1.0500180432618964, -1.000592067123323, -0.9530053881613849, -0.9072886892605734, -0.863458620678019, -0.8215193854713281, -0.7814642252830029, -0.7432768029333254, -0.7069324809903477, -0.6723994975222092, -0.6396400417364303 ], [ -2.1113797908165086, -2.1479598344255075, -2.1817412275082964, -2.2124184871747268, -2.239693831089826, -2.2632824627791828, -2.2829180085057765, -2.298357863800298, -2.309388194834965, -2.3158283709605105, -2.3175346870521363, -2.3144033596257967, -2.3063729188235826, -2.2934262167496535, -2.275592269183808, -2.2529480029499696, -2.2256197205270523, -2.193783823329009, -2.157666196331378, -2.1175397346533993, -2.073719762456307, -2.0265574496725036, -1.9764316552685806, -1.923739836928603, -1.8688887355997519, -1.8122854821478493, -1.754329624632128, -1.695406390329328, -1.6358813203433065, -1.5760962729000807, -1.516366693648399, -1.4569799949726285, -1.398194863006148, -1.340241310704306, -1.2833213090066997, -1.2276098488660132, -1.1732563100015008, -1.1203860347458354, -1.0691020257493562, -1.0194867039416804, -0.971603677928719, -0.925499488114683, -0.881205298606528, -0.8387385177392552, -0.7981043341963998, -0.7592971604950649, -0.7223019793174323, -0.6870955910153944, -0.6536477627673682, -0.621922281468098 ], [ -2.049765128305352, -2.0843889551326513, -2.116294815789538, -2.145196943822861, -2.1708177142960676, -2.1928924167334785, -2.2111741117793544, -2.225438370856377, -2.235487697435814, -2.2411554625588126, -2.242309258430285, -2.2388536727217874, -2.2307325872495447, -2.2179311675932274, -2.2004776907113333, -2.178445231592996, -2.1519530222290655, -2.121167088355146, -2.086299665318095, -2.047606958061361, -2.005385027233823, -1.9599638765403784, -1.911700092956654, -1.860968582060563, -1.8081540147461599, -1.753642564874908, -1.6978144014616814, -1.6410372453205064, -1.5836611459608734, -1.5260145046911926, -1.468401275362515, -1.41109921541105, -1.3543590311776108, -1.2984042549644756, -1.2434316991908174, -1.1896123489859318, -1.137092574017784, -1.085995560297017, -1.0364228813838823, -0.9884561450016525, -0.9421586652375336, -0.8975771223308143, -0.8547431817196671, -0.8136750518198537, -0.7743789662308385, -0.7368505809769035, -0.7010762812307865, -0.6670343949379414, -0.6346963130293648, -0.6040275176188512 ], [ -1.9869589821299878, -2.0196338198485972, -2.049674732029628, -2.0768150410361486, -2.100796493906724, -2.1213735648950824, -2.1383177952873185, -2.151422006061255, -2.1605042255555302, -2.165411207574723, -2.1660214748028905, -2.16224789834587, -2.1540398957013616, -2.141385366142032, -2.124312454010999, -2.1028911238592394, -2.0772343696215594, -2.047498724498266, -2.013883663526626, -1.9766295435800267, -1.9360138977553585, -1.8923461379952184, -1.8459609505387382, -1.7972108360788064, -1.7464583213459113, -1.6940683516923132, -1.6404012873093454, -1.5858068011149293, -1.5306188448915456, -1.4751517342080498, -1.419697313683781, -1.3645231049247224, -1.3098713068317052, -1.2559585060734673, -1.202975957959111, -1.1510903091425608, -1.100444649240231, -1.0511597955600358, -1.0033357318564247, -0.9570531373093404, -0.9123749553113387, -0.8693479630268348, -0.8280043121552441, -0.7883630190777349, -0.7504313888244394, -0.714206362295736, -0.6796757801189919, -0.646819559607527, -0.6156107836712694, -0.5860167023421319 ], [ -1.9232923703958063, -1.9540376002519662, -1.982235610097059, -2.007638094908531, -2.0300053290332123, -2.049110041701924, -2.064741299393363, -2.076708261542274, -2.0848436864555913, -2.089007094617045, -2.089087544667827, -2.0850060341386367, -2.0767175856184457, -2.064213097301634, -2.047521004832322, -2.0267087136261366, -2.001883637538879, -1.9731935662083673, -1.940826032358881, -1.9050063948931348, -1.8659944893228997, -1.82407988567342, -1.7795759827563458, -1.7328133109151613, -1.6841324871632617, -1.6338772638588095, -1.5823880494006473, -1.529996180944307, -1.4770191195517928, -1.4237566368304835, -1.3704879804730128, -1.3174699483433832, -1.2649357657694722, -1.2130946445023512, -1.1621318994058245, -1.1122095056050982, -1.0634669906658027, -1.016022570531692, -0.9699744525039496, -0.9254022423356979, -0.8823684049297118, -0.8409197389174943, -0.8010888345438891, -0.7628954918856705, -0.7263480826613076, -0.6914448439251788, -0.6581750959653192, -0.6265203799049259, -0.596455512992202, -0.5679495614758823 ], [ -1.8590799530329638, -1.8879256300166845, -1.9143128054419498, -1.938010771800838, -1.9587974529848289, -1.9764628951359582, -1.9908127454369986, -2.0016716110235078, -2.008886201939769, -2.0123281883123516, -2.0118967396922645, -2.007520755736618, -1.9991608289070033, -1.9868109859356688, -1.970500223043559, -1.9502937794018311, -1.9262940010568947, -1.8986405665509194, -1.867509812571209, -1.833112936154401, -1.7956929567324487, -1.755520469986232, -1.712888377583878, -1.6681058969871974, -1.6214922215916252, -1.57337020830916, -1.5240604263717636, -1.4738758250593393, -1.42311718855639, -1.3720694594537455, -1.320998939237104, -1.27015131940784, -1.2197504611023855, -1.16999782182251, -1.1210724214842676, -1.0731312425904607, -1.0263099675514695, -0.9807239673778527, -0.9364694682590693, -0.8936248346948795, -0.8522519191343045, -0.8123974381369337, -0.7740943437752332, -0.7373631663626865, -0.702213310718709, -0.6686442932031069, -0.6366469108177646, -0.606204336923553, -0.5772931406883108, -0.5498842293830299 ], [ -1.7946180796206432, -1.8216035039000442, -1.8462205515935122, -1.8682553017091026, -1.8875024358173795, -1.903768384035565, -1.916874447985207, -1.9266598137727977, -1.9329843796071455, -1.9357313444661375, -1.9348095330296309, -1.9301554610703007, -1.9217351646883971, -1.909545815411473, -1.893617114005863, -1.8740124004507108, -1.8508293496749824, -1.8242000662295283, -1.7942903715276113, -1.7612981103878218, -1.7254503877321847, -1.6869997628933677, -1.6462195502800248, -1.603398474254863, -1.558834984902908, -1.5128315539310346, -1.465689241315909, -1.417702765751956, -1.3691562401523347, -1.320319660682741, -1.2714461735915847, -1.2227700936520887, -1.1745056128268978, -1.126846116687069, -1.0799640166406395, -1.0340110051679998, -0.9891186461939212, -0.9453992210958406, -0.902946760870124, -0.8618382054119327, -0.8221346409135095, -0.7838825755958478, -0.7471152221404289, -0.7118537622205068, -0.6781085744787747, -0.645880412245522, -0.6151615213504753, -0.5859366916677611, -0.5581842386616982, -0.5318769132744541 ], [ -1.7301833741247437, -1.755355731192078, -1.778250685025204, -1.7986702717146335, -1.8164250380599014, -1.8313368790600355, -1.8432418466243348, -1.8519928591862302, -1.8574622523854494, -1.8595441284365304, -1.858156483129845, -1.8532431090726078, -1.844775284471849, -1.8327532513525213, -1.8172074617206282, -1.798199527523389, -1.7758227612184059, -1.750202155454981, -1.7214936403183083, -1.68988248542995, -1.655580780741392, -1.6188240211376668, -1.5798669160442864, -1.5389786260108007, -1.4964376792702612, -1.4525268366314494, -1.4075281551777015, -1.3617184584663924, -1.3153653641964254, -1.2687239601899662, -1.2220341642092147, -1.1755187576493669, -1.1293820495978255, -1.0838091059540276, -1.038965466692978, -0.99499727073189, -0.9520317099465448, -0.9101777396602418, -0.8695269807690844, -0.8301547573722219, -0.7921212225226335, -0.7554725329857348, -0.7202420414005051, -0.686451480851137, -0.6541121225505371, -0.6232258921491249, -0.593786434186339, -0.5657801174877166, -0.5391869769708746, -0.5139815894491491 ], [ -1.6660317941164275, -1.689444875382003, -1.710671865680095, -1.7295299233712724, -1.745844576922603, -1.7594522865059996, -1.7702029742718417, -1.777962466037709, -1.7826147960860668, -1.784064340282832, -1.7822377580603015, -1.7770857366204367, -1.7685845358110952, -1.756737324960488, -1.7415752817581363, -1.7231583910490575, -1.7015758466025241, -1.6769459337291792, -1.6494152670611542, -1.6191572829838674, -1.5863699391251902, -1.5512726448226115, -1.5141025223167295, -1.4751101636890742, -1.43455509195653, -1.3927011508680442, -1.3498120376095022, -1.3061471613288662, -1.2619579661339917, -1.217484808209477, -1.1729544297765955, -1.1285780324137882, -1.084549921117939, -1.0410466688881257, -0.9982267387303122, -0.9562304942885517, -0.9151805300488595, -0.875182255556674, -0.8363246739117227, -0.7986813018360202, -0.7623111860426466, -0.7272599779153193, -0.6935610353032611, -0.6612365263578, -0.6302985157097818, -0.6007500179043852, -0.5725860069106461, -0.545794373767827, -0.5203568270933099, -0.49624973333077005 ], [ -1.6023981034125154, -1.6241111147000824, -1.6437292244086645, -1.6610838826385623, -1.6760147314484266, -1.6883719193969553, -1.6980183840240328, -1.704832055145031, -1.7087079391291518, -1.7095600544814158, -1.7073231997353977, -1.7019545426106448, -1.6934350210023534, -1.6817705388803539, -1.6669929230546832, -1.6491605828896965, -1.628358790855474, -1.6046994859603911, -1.5783205028178726, -1.5493841510561028, -1.5180751121058402, -1.4845976765779867, -1.449172405220192, -1.4120323488734814, -1.3734189992081938, -1.333578157651674, -1.2927559046757096, -1.2511948290314197, -1.2091306423291512, -1.166789264847916, -1.1243844291811431, -1.0821158133618227, -1.0401676868429552, -0.9987080320022605, -0.9578880904194008, -0.9178422760643314, -0.8786883954372744, -0.8405281162703069, -0.8034476304230092, -0.7675184620756568, -0.7327983784749927, -0.6993323667673577, -0.6671536464948533, -0.6362846929074999, -0.6067382512407726, -0.5785183264786722, -0.5516211368736528, -0.5260360226605305, -0.5017463040340677, -0.47873008461825606 ], [ -1.5394957000826937, -1.5595721622696161, -1.577644373474295, -1.5935572564114995, -1.6071637187653085, -1.6183267459777455, -1.6269214621288548, -1.632837119597197, -1.6359789839014716, -1.6362700875152716, -1.6336528336540863, -1.6280904356473642, -1.619568177115864, -1.6080944711864413, -1.593701683546394, -1.5764466668056671, -1.556410937249546, -1.5337004157623224, -1.5084446580758302, -1.4807955186076414, -1.4509252262100016, -1.419023894448174, -1.3852965361836889, -1.3499596942128926, -1.3132378298429657, -1.2753596256972997, -1.2365543570981221, -1.1970484702736948, -1.1570624794240996, -1.1168082630899714, -1.0764868077378733, -1.0362864164841628, -0.9963813756813263, -0.9569310527528698, -0.9180793852903658, -0.8799547134695214, -0.8426699043883659, -0.8063227169416705, -0.7709963583190094, -0.7367601872758627, -0.7036705242737857, -0.6717715338845089, -0.6410961501267571, -0.6116670204053807, -0.5834974483009254, -0.5565923195391838, -0.5309489990310938, -0.5065581899238523, -0.4834047481763948, -0.4614684483090419 ], [ -1.477516745701718, -1.4960234893183155, -1.5126157215688305, -1.5271510353330486, -1.539494779378194, -1.5495219515267946, -1.5571190603938512, -1.5621859224064392, -1.5646373651274108, -1.5644048131249084, -1.561437737310996, -1.5557049510926388, -1.5471957352679373, -1.5359207675275417, -1.5219128221699882, -1.5052271933460863, -1.485941784434003, -1.4641568013452826, -1.4399939924744447, -1.4135953945982218, -1.3851215715904173, -1.3547493679099638, -1.3226692360951702, -1.2890822310498495, -1.2541967886837253, -1.2182254193162603, -1.1813814463411296, -1.1438759092865443, -1.1059147304145722, -1.0676962189058061, -1.0294089599571974, -0.9912301106787316, -0.953324102546684, -0.9158417324891086, -0.8789196117889766, -0.84267993365691, -0.8072305159472226, -0.7726650742969461, -0.7390636821540995, -0.7064933769915871, -0.6750088758502351, -0.6446533677231461, -0.6154593548136158, -0.5874495191111371, -0.560637594865343, -0.5350292312976779, -0.5106228332278266, -0.4874103701956345, -0.4653781471425438, -0.4445075318076337 ], [ -1.416632546113605, -1.4336387998471904, -1.448819040122346, -1.462042748149278, -1.4731869151184092, -1.4821377551194104, -1.4887923871270856, -1.4930604574386712, -1.4948656770826498, -1.4941472522878254, -1.4908611890085068, -1.484981453547439, -1.4765009695191635, -1.4654324263883853, -1.4518088672096798, -1.4356840147258494, -1.4171322883371076, -1.3962484626837839, -1.3731469242664263, -1.347960496899364, -1.3208388292178586, -1.291946365396667, -1.2614599497904402, -1.2295661430242015, -1.196458347327153, -1.1623338500936304, -1.1273908959088947, -1.0918258893323083, -1.0558308155314116, -1.0195909460071815, -0.9832828748433141, -0.9470729095205, -0.9111158211397529, -0.8755539430040689, -0.8405165943965145, -0.8061197980480987, -0.7724662548531582, -0.7396455373112008, -0.7077344633317375, -0.6767976138235108, -0.6468879603622213, -0.6180475727426207, -0.5903083800213353, -0.5636929624878899, -0.5382153556832334, -0.5138818510033758, -0.4906917805147013, -0.46863827633823796, -0.44770899733025726, -0.4278868178093098 ], [ -1.3569941385153237, -1.3725707101002513, -1.386408232917448, -1.3983873182706394, -1.4083958288887255, -1.4163304286166103, -1.4220981015543999, -1.4256176156984695, -1.426820908336329, -1.4256543728006734, -1.4220800278914654, -1.4160765515150016, -1.407640158278716, -1.3967852968308614, -1.3835451372627152, -1.3679718132833671, -1.3501363801094426, -1.3301284492297623, -1.3080554671433444, -1.2840416175896965, -1.2582263451276083, -1.230762520275851, -1.2018142899433588, -1.1715546783330317, -1.1401630200217188, -1.1078223165066683, -1.0747166093569422, -1.0410284575973756, -1.0069365954122351, -0.9726138305889003, -0.938225226402527, -0.9039265917786835, -0.8698632880789074, -0.8361693467617142, -0.8029668810186046, -0.7703657663984396, -0.738463560234951, -0.7073456270094494, -0.6770854361454781, -0.6477449996584264, -0.6193754191148615, -0.5920175140992789, -0.5657025075179574, -0.5404527463427065, -0.5162824396297399, -0.4931983987164703, -0.47120076732399196, -0.45028373183148207, -0.4304362042251988, -0.4116424721600227 ], [ -1.2987330441777973, -1.312951590990803, -1.3255162660509794, -1.3363180784008968, -1.3452550206950802, -1.3522334707074237, -1.3571695625217308, -1.3599905053946018, -1.3606358297597678, -1.3590585413306222, -1.3552261651775361, -1.349121661471775, -1.3407441929734778, -1.3301097213584332, -1.3172514056959002, -1.302219772892384, -1.2850826281507437, -1.2659246749638404, -1.2448468200299514, -1.2219651491905679, -1.1974095755557563, -1.1713221789665482, -1.1438552747274358, -1.1151692667405424, -1.0854303536117111, -1.054808164415447, -1.0234734028848682, -0.9915955749979045, -0.9593408661642565, -0.92687022186498, -0.8943376712400058, -0.8618889182761682, -0.829660211189315, -0.7977774882368707, -0.7663557880899712, -0.7354989052502072, -0.7052992657629429, -0.6758379954240272, -0.6471851514600819, -0.6194000889040703, -0.5925319342135373, -0.5666201407484173, -0.5416951032515256, -0.5177788112254582, -0.4948855238981311, -0.473022452188429, -0.4521904356362596, -0.4323846045954143, -0.41359502007511284, -0.3958072854480492 ], [ -1.2419621504964657, -1.2548945362534982, -1.266256220091333, -1.2759479040735413, -1.2838769996280401, -1.2899588942656703, -1.2941181880964105, -1.296289880536595, -1.2964204885492892, -1.2944690786531163, -1.2904081953693567, -1.2842246684133203, -1.275920279613036, -1.2655122683931455, -1.2530336521875218, -1.2385333361798296, -1.2220759863699109, -1.2037416421760607, -1.1836250503804049, -1.161834711451394, -1.1384916417062216, -1.1137278693149553, -1.087684697216348, -1.060510779833248, -1.0323600713999974, -1.0033897105265872, -0.9737579077133042, -0.943621899933336, -0.9131360297271041, -0.8824499965072745, -0.8517073161574171, -0.8210440127193004, -0.790587554048898, -0.7604560325809275, -0.7307575832990214, -0.7015900239196284, -0.6730406971974707, -0.6451864920187997, -0.6180940183298234, -0.5918199106626061, -0.5664112357681375, -0.5419059813603855, -0.5183336049636973, -0.4957156241288556, -0.4740662316727362, -0.4533929219775037, -0.4336971166670167, -0.4149747801012944, -0.3972170170583922, -0.38041064668981805 ], [ -1.1867766902422916, -1.1984944234723915, -1.2087224308402351, -1.2173704316805043, -1.2243545764229944, -1.2295985905377003, -1.233034888323826, -1.2346056389547675, -1.234263767762379, -1.2319738762449037, -1.2277130644394534, -1.221471638905477, -1.2132536885629928, -1.2030775091804276, -1.1909758558280545, -1.176996001742027, -1.1611995825471717, -1.143662207391658, -1.1244728237602626, -1.1037328306702705, -1.0815549452478965, -1.0580618394938406, -1.0333845761855713, -1.0076608839967411, -0.9810333207949015, -0.953647379761216, -0.9256495949482861, -0.8971857011262516, -0.8683988976683796, -0.8394282585259403, -0.8104073209459668, -0.7814628754340882, -0.7527139694115983, -0.7242711277455187, -0.696235785321826, -0.6686999203574309, -0.6417458722936082, -0.6154463248284952, -0.5898644327728255, -0.5650540707389349, -0.5410601819598038, -0.5179192065476375, -0.49565957002371563, -0.4743022147955711, -0.453861159270315, -0.43434407135318653, -0.4157528450981649, -0.39808417118930506, -0.38133009369579063, -0.3654785471372983 ], [ -1.1332552898346724, -1.1438290392634953, -1.1529916894094718, -1.1606613310696785, -1.1667622059498806, -1.1712257386909926, -1.1739915387749549, -1.1750083564585552, -1.1742349771981364, -1.1716410392841985, -1.1672077594212273, -1.1609285506474092, -1.1528095162940402, -1.1428698027982882, -1.1311417934452108, -1.1176711250088736, -1.1025165103399193, -1.0857493527104314, -1.0674531425027243, -1.0477226336507834, -1.0266628057993676, -1.004387627783988, -0.9810186478559538, -0.956683445072485, -0.9315139834968829, -0.9056449155720394, -0.8792118828227904, -0.8523498608462348, -0.8251915916343247, -0.7978661401689306, -0.770497604621889, -0.7432040011157577, -0.7160963355444105, -0.6892778669932849, -0.6628435602643916, -0.636879719167702, -0.6114637877086633, -0.5866643030774248, -0.5625409823356007, -0.5391449237484214, -0.5165189036410043, -0.4946977502766543, -0.47370877737993533, -0.45357226139534235, -0.4343019482434851, -0.4159055770994109, -0.3983854104836011, -0.3817387616612391, -0.36595851194504414, -0.351033611962547 ], [ -1.0814610621592873, -1.0909602437534345, -1.0991244763516712, -1.1058796070028194, -1.1111573534214556, -1.1148962339629214, -1.1170424675538697, -1.1175508292524483, -1.1163854472614068, -1.1135205273320277, -1.1089409904604108, -1.1026430095329323, -1.0946344301573485, -1.0849350604718881, -1.0735768145278803, -1.0606036942549744, -1.046071596436935, -1.0300479338944784, -1.0126110643930881, -0.9938495266544408, -0.9738610899851755, -0.9527516319363681, -0.9306338663850574, -0.9076259517215357, -0.8838500147102245, -0.8594306294974081, -0.8344932928255133, -0.80916293570482, -0.7835625087688118, -0.7578116736831195, -0.7320256268072287, -0.7063140743962271, -0.6807803715299199, -0.6555208301501552, -0.63062419544675, -0.6061712846097511, -0.5822347777937094, -0.5588791480505124, -0.5361607149314089, -0.514127805332188, -0.49282100482040647, -0.4722734829880122, -0.45251137716631873, -0.4335542199824962, -0.4154153976048196, -0.39810262701454757, -0.3816184421727473, -0.36596068045770624, -0.35112296218604366, -0.33709515736767015 ], [ -1.0314427228954235, -1.039935153082411, -1.0471662083252418, -1.0530689076810238, -1.0575818622287991, -1.0606501120070688, -1.0622259330635908, -1.0622696016546287, -1.060750102681992, -1.0576457694991601, -1.0529448421824599, -1.0466459312281648, -1.0387583734492616, -1.0293024667394581, -1.018309570560067, -1.0058220597578706, -0.9918931209201203, -0.9765863831488807, -0.9599753790118186, -0.9421428364605209, -0.9231798084749223, -0.9031846536933733, -0.882261887794986, -0.8605209313306605, -0.8380747844984391, -0.8150386625845716, -0.7915286271693258, -0.7676602476493466, -0.7435473252742502, -0.7193007080132257, -0.6950272195499527, -0.6708287199961871, -0.6468013099592047, -0.6230346837939478, -0.5996116325374563, -0.576607692390088, -0.5540909308120912, -0.5321218593968406, -0.5107534606476545, -0.4900313145553543, -0.46999381034770793, -0.4506724288417836, -0.4320920813517002, -0.41427149197034363, -0.39722361114601856, -0.3809560497215385, -0.36547152391736093, -0.35076830306116213, -0.33684065314808564, -0.3236792705256766 ], [ -0.9832357124904099, -0.9907873219628767, -0.997148479215686, -1.0022588221428574, -1.0060633050880066, -1.0085129510093456, -1.009565574021249, -1.0091864605825416, -1.0073489976022356, -1.0040352357501976, -0.999236376255133, -0.9929531694451017, -0.9851962132884033, -0.9759861403377172, -0.9653536819333393, -0.9533395994815467, -0.9399944742898197, -0.9253783499657214, -0.9095602248376916, -0.8926173961793072, -0.8746346630234445, -0.8557033997232895, -0.8359205177446967, -0.8153873380112062, -0.7942084000441749, -0.7724902368006779, -0.7503401452914904, -0.7278649826888586, -0.7051700157856757, -0.6823578485486859, -0.6595274484151796, -0.6367732872617682, -0.6141846079799402, -0.5918448226519917, -0.569831043705749, -0.5482137453415592, -0.5270565491019428, -0.506416124757453, -0.4863421957167462, -0.46687763689447626, -0.44805865231593334, -0.42991501961121603, -0.4124703888554022, -0.39574262384572245, -0.37974417478050415, -0.36448247233525666, -0.3499603342491098, -0.33617637668326794, -0.32312542374736, -0.31079890967655155 ], [ -0.9368633088211505, -0.9435379113402792, -0.9490902807718019, -0.9534661516099231, -0.9566163035990438, -0.9584972367229686, -0.9590718169571463, -0.9583098821787883, -0.9561887976109937, -0.9526939501959888, -0.9478191713312502, -0.9415670774717622, -0.9339493182536487, -0.9249867221196106, -0.9147093300538338, -0.903156309107468, -0.8903757390544312, -0.8764242678600633, -0.8613666347034494, -0.8452750630077284, -0.8282285301413888, -0.8103119249056467, -0.7916151083008056, -0.772231897022043, -0.752258992344353, -0.7317948792480289, -0.7109387216353271, -0.6897892792311937, -0.6684438702966409, -0.6469974017625613, -0.62554148504004, -0.6041636518507432, -0.582946680230441, -0.5619680366567892, -0.5412994362692773, -0.5210065195640805, -0.501148640882489, -0.4817787615374274, -0.4629434385579567, -0.44468289875674305, -0.42703118709118026, -0.41001637802685, -0.39366083874383606, -0.3779815334709904, -0.3629903589123922, -0.3486945015723393, -0.33509680872805836, -0.32219616578996324, -0.30998787378630666, -0.29846402167910413 ], [ -0.892337718213934, -0.8981968289289375, -0.9029991906431599, -0.9066961427920323, -0.9092438043725005, -0.9106036787484372, -0.9107432297321661, -0.9096364193672377, -0.9072641978201136, -0.9036149358253406, -0.8986847902143674, -0.8924779932100224, -0.8850070564324024, -0.8762928810121466, -0.8663647659396143, -0.8552603078992629, -0.8430251874411989, -0.8297128384891836, -0.8153840008834867, -0.8001061588478453, -0.7839528718173419, -0.7670030077671643, -0.7493398927918333, -0.7310503939324233, -0.7122239548804288, -0.6929516059920307, -0.6733249708847184, -0.6534352917055768, -0.6333724939883743, -0.6132243099662364, -0.5930754764508301, -0.5730070201377764, -0.5530956396774365, -0.5334131902779242, -0.5140262731753451, -0.4949959291709358, -0.47637743270755584, -0.4582201807086048, -0.44056766865805774, -0.4234575451569629, -0.4069217354161341, -0.390986623787843, -0.37567328543893974, -0.36099775755867847, -0.34697134101049687, -0.3336009240167519, -0.3208893202534979, -0.3088356145814193, -0.29743551050925277, -0.2866816743467595 ], [ -0.8496611348579715, -0.8547638328382687, -0.8588725182292396, -0.8619436737739412, -0.8639383025787148, -0.8648224691730593, -0.8645678124815319, -0.8631520220782616, -0.8605592690907926, -0.8567805831820294, -0.8518141671692199, -0.845665641056609, -0.8383482076029969, -0.8298827320761644, -0.8202977296344491, -0.80962925489717, -0.7979206897832412, -0.7852224276466973, -0.7715914541135409, -0.7570908277669595, -0.7417890668251628, -0.7257594510458452, -0.709079251077203, -0.6918289001485645, -0.6740911251549748, -0.6559500556757374, -0.6374903301653736, -0.6187962184201947, -0.5999507784753293, -0.5810350644086517, -0.5621273992510705, -0.5433027244932864, -0.5246320347162052, -0.5061819028338763, -0.4880140984843304, -0.4701852993685196, -0.45274689292145265, -0.4357448636684398, -0.4192197600062981, -0.4032067329588709, -0.3877356386690165, -0.3728311959699062, -0.3585131902793455, -0.34479671522912314, -0.3316924438226072, -0.31920692145512164, -0.3073428737849422, -0.2960995231652188, -0.2854729081026304, -0.2754562009678123 ], [ -0.8088267607528667, -0.8132295906704168, -0.8166984009788303, -0.819194385397948, -0.8206830061302217, -0.8211344771019917, -0.8205242198654605, -0.818833284399985, -0.816048727066655, -0.8121639380596322, -0.8071789108666569, -0.801100446518761, -0.7939422858089755, -0.7857251632368771, -0.7764767772440107, -0.7662316723960554, -0.7550310305835128, -0.7429223700703631, -0.7299591533059187, -0.716200306774406, -0.7017096586941118, -0.686555302963517, -0.6708089002294373, -0.6545449291580832, -0.6378399027685553, -0.620771565910857, -0.60341809054826, -0.5858572853983186, -0.5681658357110966, -0.5504185875793364, -0.5326878892854259, -0.5150429999239883, -0.4975495730402142, -0.48026922043778675, -0.46325915876900714, -0.44657193913811355, -0.43025525781562135, -0.4143518443376424, -0.3988994217857187, -0.3839307329192485, -0.3694736250555297, -0.3555511861364844, -0.3421819242505202, -0.32937998295078974, -0.3171553849820352, -0.30551429745311776, -0.2944593120292971, -0.2839897343291602, -0.2741018773635093, -0.26478935451982033 ], [ -0.7698197801857396, -0.7735766883711828, -0.7764568457246712, -0.778425753047483, -0.7794529357416611, -0.7795123746841239, -0.7785829106095918, -0.7766486150361402, -0.7736991208046868, -0.7697299054188385, -0.7647425205720702, -0.7587447615529055, -0.7517507706518489, -0.7437810692926059, -0.734862514411524, -0.7250281756505439, -0.7143171312345815, -0.7027741819809814, -0.6904494847170419, -0.6773981084120442, -0.6636795184831616, -0.6493569969038047, -0.6344970078047247, -0.619168520083389, -0.6034423000033229, -0.5873901877705949, -0.571084372549979, -0.5545966802954572, -0.5379978881280252, -0.5213570778448664, -0.504741039567246, -0.4882137346322484, -0.4718358247212986, -0.45566427201341475, -0.439752012964733, -0.42414770624416986, -0.408895553476345, -0.3940351898128571, -0.37960164000714536, -0.3656253346203526, -0.3521321802338493, -0.3391436770714653, -0.32667707721465455, -0.3147455765932894, -0.3033585341172167, -0.29252171164159235, -0.28223752889632214, -0.27250532802365224, -0.2633216429283005, -0.2546804692267908 ], [ -0.7326182843533742, -0.735780584766903, -0.7381207113186274, -0.7396080954452231, -0.7402159578441068, -0.739921691988561, -0.7387072220831861, -0.7365593292205403, -0.7334699395593638, -0.7294363684820859, -0.7244615149141331, -0.7185540003145574, -0.7117282472978712, -0.704004493447836, -0.6954087366618009, -0.6859726093433067, -0.6757331799550199, -0.6647326818524095, -0.6530181709193499, -0.6406411152759164, -0.6276569221584718, -0.6141244088969586, -0.600105226634825, -0.5856632469504721, -0.5708639227498573, -0.5557736356269047, -0.5404590422764863, -0.5249864324674955, -0.5094211105465729, -0.49382681148240026, -0.4782651611380788, -0.46279518885622406, -0.4474728986505385, -0.4323509034150479, -0.41747812467931955, -0.40289955863713356, -0.3886561075242765, -0.374784473969503, -0.3613171147242893, -0.3482822492086919, -0.3357039175946068, -0.3236020826733028, -0.31199276950281507, -0.3008882367754431, -0.2902971739579019, -0.2802249185044621, -0.2706736877966156, -0.2616428208920605, -0.25312902564529205, -0.24512662726867607 ], [ -0.6971941431432407, -0.699810509137424, -0.7016566302672691, -0.7027055185274889, -0.7029337487893412, -0.7023217995508801, -0.7008543691253692, -0.6985206616922539, -0.6953146377137889, -0.6912352233766419, -0.6862864739592345, -0.6804776863654325, -0.6738234565203962, -0.6663436779132978, -0.6580634783146364, -0.6490130926062629, -0.6392276707479696, -0.6287470211581392, -0.6176152911866524, -0.6058805878659701, -0.593594543684659, -0.580811833666248, -0.5675896514756869, -0.5539871535336933, -0.5400648811204467, -0.5258841711299438, -0.5115065664513325, -0.4969932368819996, -0.48240442102302405, -0.46779889879849157, -0.45323350312532296, -0.43876267790382073, -0.42443808797654126, -0.4103082850919193, -0.3964184322864346, -0.3828100875333782, -0.3695210460559051, -0.35658523941257236, -0.34403268836561884, -0.33188950565379893, -0.3201779441178403, -0.3089164851615265, -0.2981199622619881, -0.28779971414826444, -0.2779637623244571, -0.2686170077963468, -0.25976144214296815, -0.25139636843144153, -0.2435186278819328, -0.23612282862889122 ], [ -0.6635138222813666, -0.6656303003777571, -0.6670258682757644, -0.6676767936677299, -0.6675626899893992, -0.6666668186123803, -0.6649763675224356, -0.6624827015112806, -0.6591815790051445, -0.6550733308234737, -0.6501629964131777, -0.6444604134481233, -0.6379802571333426, -0.6307420261217769, -0.6227699726515219, -0.6140929753516944, -0.6047443541464035, -0.594761627800094, -0.5841862158722604, -0.5730630881503336, -0.56144036595923, -0.549368881046155, -0.5369016989463855, -0.524093614783709, -0.5110006302879166, -0.4976794213707185, -0.48418680585486484, -0.4705792208829467, -0.45691221914374625, -0.44323999236819867, -0.42961492960159364, -0.4160872166063758, -0.4027044814507277, -0.3895114899565295, -0.37654989327959787, -0.3638580285333577, -0.3514707720945198, -0.33941944408592484, -0.3277317615459965, -0.3164318369838133, -0.3055402183907743, -0.2950739663320694, -0.2850467634640266, -0.27546905170184277, -0.26634819227728235, -0.25768864405595093, -0.24949215570743966, -0.24175796761692725, -0.23448301977346842, -0.22766216225034297 ], [ -0.6315391450623009, -0.6331991873080118, -0.634185121612193, -0.634476170519882, -0.6340546946248122, -0.6329064600499232, -0.6310208834952664, -0.6283912504279952, -0.6250149020985198, -0.6208933872464806, -0.6160325746174675, -0.610442722753296, -0.604138503956039, -0.5971389798673392, -0.5894675267581855, -0.5811517093944263, -0.5722231032269403, -0.5627170656430853, -0.5526724580864708, -0.5421313219758233, -0.5311385124897148, -0.5197412953854332, -0.5079889130342929, -0.4959321267307699, -0.48362274301957386, -0.4711131322436659, -0.4584557477189166, -0.44570265387365815, -0.4329050713563085, -0.42011294652822606, -0.40737455195342553, -0.39473612351334664, -0.3822415386629181, -0.3699320391562535, -0.3578460003592028, -0.34601874808084165, -0.33448242273956064, -0.3232658896668814, -0.3123946934696, -0.3018910536350692, -0.2917738979836224, -0.28205893014650196, -0.2727587269710703, -0.26388286161589747, -0.2554380480816896, -0.24742830301234275, -0.2398551207753703, -0.232717658074022, -0.22601292463698575, -0.21973597685919155 ] ], "zauto": true, "zmax": 3.0124128161337804, "zmin": -3.0124128161337804 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.29759347277764087, 0.2830496745773215, 0.2690040570436801, 0.2554893085402257, 0.2425386865456066, 0.2301955608090791, 0.21852623861980633, 0.20763487741029166, 0.19767785926919496, 0.18887327463976, 0.1814996135389758, 0.17587749941174508, 0.1723311414374175, 0.17113362702077084, 0.17245058715248013, 0.17630317782470772, 0.18256577322737563, 0.19099741245638754, 0.20129105310246628, 0.21312155934951205, 0.2261806231180468, 0.24019608607127624, 0.2549387501625681, 0.2702212869790125, 0.2858931450503342, 0.30183404892147536, 0.3179475573201519, 0.33415538516210846, 0.35039274253064473, 0.3666047019374833, 0.38274348956014964, 0.39876655139163647, 0.4146352380700548, 0.4303139635687926, 0.4457697123647902, 0.46097179144632894, 0.47589174458792893, 0.490503365264305, 0.5047827608183678, 0.5187084339396831, 0.5322613583064262, 0.5454250336789481, 0.5581855121400469, 0.5705313918945147, 0.5824537783871843, 0.5939462147597216, 0.605004585088295, 0.615626994633606, 0.6258136316607779, 0.6355666153844868 ], [ 0.28879206272742847, 0.2738572279946216, 0.2594189887869039, 0.2455051929716641, 0.2321418308168971, 0.21936304633859582, 0.20722527398862178, 0.19582455604640878, 0.1853144945464455, 0.17592014767853512, 0.16794084909968404, 0.16173357169128968, 0.15767057582815355, 0.15607377938678663, 0.15714310674283902, 0.16090757180850793, 0.16722202149238397, 0.1758087034267681, 0.18632052306470473, 0.19839946773497372, 0.2117157519068269, 0.2259865896203183, 0.24098023759063483, 0.2565117885948903, 0.27243549939680367, 0.2886364769882307, 0.30502311783072417, 0.32152083993530656, 0.33806719698831705, 0.35460825318071004, 0.3710960167663492, 0.38748671545396657, 0.4037397125740364, 0.4198168912249132, 0.4356823649604426, 0.45130240348916356, 0.4666454883036038, 0.48168243547070116, 0.49638654100191193, 0.5107337186294132, 0.524702610929732, 0.5382746630817377, 0.5514341546256734, 0.5641681888602128, 0.5764666423721387, 0.5883220789728263, 0.5997296332927364, 0.610686869681071, 0.6211936220470652, 0.631251819996908 ], [ 0.28092750472022754, 0.26562517813795333, 0.25082028797615463, 0.23653758536921696, 0.22279750624396347, 0.20962627709918583, 0.1970708731311595, 0.18521820545508336, 0.17421623105947623, 0.16429222921761408, 0.1557604245956624, 0.14900847477038373, 0.14445306627768414, 0.1424640479762425, 0.1432761754236329, 0.1469262215315597, 0.15324833779298466, 0.16192740013802062, 0.17257798096822602, 0.18481335885095232, 0.19828776427313272, 0.21271327150671934, 0.22786018613747458, 0.24354936345752823, 0.2596419611238356, 0.276029497445632, 0.2926254154859769, 0.30935846379173926, 0.32616779140721985, 0.34299949482290865, 0.35980431799446333, 0.37653622541347026, 0.393151608434539, 0.4096089303106829, 0.42586865818182373, 0.4418933675562805, 0.4576479357757306, 0.47309976576686885, 0.4882190007266072, 0.5029787050866363, 0.5173549979859823, 0.5313271333055516, 0.5448775257480457, 0.557991726036947, 0.5706583505167375, 0.58286897163093, 0.5946179762247397, 0.6059023985898084, 0.6167217348097819, 0.6270777444047795 ], [ 0.27401367779003566, 0.2583624934717702, 0.2432114837419864, 0.22858468192491807, 0.21449966972106146, 0.2009774191999265, 0.1880575105132914, 0.17581843969011932, 0.1644010558276599, 0.15403056297569445, 0.14502890746179536, 0.13780542815099267, 0.132812492825211, 0.13046148128478505, 0.13101854347985184, 0.13452699185354303, 0.14080095621441932, 0.149491169959437, 0.16017986055217812, 0.1724592428794996, 0.18597520644118182, 0.2004410863155823, 0.2156338754886897, 0.23138308566128402, 0.24755820567497783, 0.26405748792187383, 0.28079897446244784, 0.29771380918599766, 0.3147415348082027, 0.3318269755626225, 0.34891831807849444, 0.36596605651394204, 0.3829225323076851, 0.3997418602409693, 0.41638008554793293, 0.43279546022029813, 0.44894876086793656, 0.46480359669706683, 0.4803266757252415, 0.4954880115859169, 0.5102610633457386, 0.5246228076382846, 0.5385537469004799, 0.5520378602124132, 0.5650625046807111, 0.5776182758494055, 0.5896988355580315, 0.6013007152088988, 0.612423101711118, 0.6230676125503398 ], [ 0.2680587072366084, 0.25207221797804535, 0.23658953900600124, 0.22163677118243072, 0.20723209821431948, 0.19339507427782443, 0.18016154497028466, 0.16760421005809048, 0.15585723958508726, 0.14514074946932995, 0.13577703762122126, 0.1281855380281631, 0.12284034886162454, 0.12018138777339973, 0.12049743827497743, 0.12383555870096782, 0.12999313857543898, 0.13859499978446746, 0.14920197859290085, 0.16139629177096784, 0.17482475172985545, 0.18920863003160782, 0.20433575593386769, 0.2200463765603521, 0.2362188644553865, 0.2527577215993082, 0.269584461874944, 0.2866311538336116, 0.3038361362975671, 0.3211413855727588, 0.338491072050454, 0.3558309308973029, 0.37310815833455135, 0.39027162071393945, 0.40727222512373307, 0.42406334805337714, 0.4406012545672218, 0.4568454667085159, 0.4727590585791384, 0.488308868520654, 0.5034656275182742, 0.5182040085064814, 0.532502604552715, 0.5463438455988524, 0.5597138640463957, 0.5726023193471502, 0.5850021911743029, 0.5969095498906201, 0.6083233120359586, 0.6192449875175852 ], [ 0.2630688511739156, 0.24675660183603254, 0.230951423420318, 0.21568436816232492, 0.20097804771872685, 0.18685517376192795, 0.1733526958784925, 0.1605417471587693, 0.1485521313913737, 0.13759760068764756, 0.1279942443820173, 0.12015881972117966, 0.11456924262905674, 0.11167489837697743, 0.1117729838170348, 0.11490986204034487, 0.1208723586548143, 0.12927275590355958, 0.13966595749321065, 0.15163775435058116, 0.1648458083202274, 0.17902554357863326, 0.19397883319241113, 0.2095577036429621, 0.22564902215166116, 0.24216227989712155, 0.2590207410149893, 0.2761555055435185, 0.29350183940544766, 0.3109971494112437, 0.32858008382179776, 0.34619035662400677, 0.36376900066067974, 0.3812588424986945, 0.39860505958902653, 0.41575573029158963, 0.4326623231180407, 0.4492800964213996, 0.46556839656606225, 0.4814908535839524, 0.497015480155865, 0.5121146837015668, 0.5267652033260629, 0.540947984005966, 0.5546480001752312, 0.5678540401130839, 0.5805584614791077, 0.5927569271391261, 0.6044481291868437, 0.6156335078588784 ], [ 0.25905164651543083, 0.24242137476039138, 0.2262997849411513, 0.2107255298750359, 0.19572936661585272, 0.18134185479840245, 0.16760632927029154, 0.15459744048921184, 0.14244421942260324, 0.1313543412077757, 0.12163253486102045, 0.11368055040128994, 0.10796077059591627, 0.10490962234428101, 0.10481503355941946, 0.10771730932139865, 0.11340118330651384, 0.12148329006134666, 0.13153054155294694, 0.14314660383588204, 0.1560093703432239, 0.16987352784424464, 0.18455701268574956, 0.19992362984986073, 0.21586752441739174, 0.23230131128503892, 0.24914788097506152, 0.26633524353097465, 0.2837936367983337, 0.3014542001935951, 0.3192486567109007, 0.33710959129425205, 0.3549710380446078, 0.37276918550350274, 0.390443080121321, 0.40793525766437067, 0.42519226587563796, 0.4421650636586974, 0.4588092959061301, 0.47508545141679803, 0.4909589159624826, 0.5063999347365877, 0.5213834990112375, 0.5358891714339419, 0.549900863411137, 0.5634065767229802, 0.5763981200715761, 0.5888708098004665, 0.6008231626107597, 0.6122565867827 ], [ 0.2560174480547881, 0.23907795594651357, 0.2226460815278619, 0.20677018971925096, 0.19149230602549835, 0.1768549466540563, 0.16291264922074428, 0.14974846195644675, 0.13749446094151327, 0.1263533394151006, 0.11661475653935366, 0.10865500028837452, 0.10290336391828264, 0.09976207739970704, 0.09949275721782667, 0.10212496043831798, 0.10745058455700458, 0.11510771505876959, 0.12469238905842651, 0.13583887387180635, 0.14825291207504984, 0.16171199846985027, 0.1760509324728051, 0.1911444236781088, 0.20689210428044813, 0.22320751948473458, 0.24001093294734785, 0.2572251698551444, 0.2747736278606426, 0.2925797038680111, 0.31056706230305203, 0.3286603408750104, 0.3467860280915859, 0.3648733487735814, 0.3828550642865594, 0.40066814052711563, 0.41825426587272496, 0.43556021889742486, 0.45253809569727066, 0.4691454119041174, 0.4853450966997637, 0.5011053965408107, 0.5163997056137175, 0.5312063387366365, 0.5455082608140703, 0.559292785226313, 0.5725512518193434, 0.5852786935264079, 0.5974734991419833, 0.6091370784032292 ], [ 0.2539788627007875, 0.2367428545834164, 0.22001008344471046, 0.2038399677530179, 0.18828791838265285, 0.17341130214331826, 0.15927934214299821, 0.14598708561480372, 0.13367254022717967, 0.12253435509485612, 0.11284456177594472, 0.10494649656827225, 0.09922371131939657, 0.09602906957665903, 0.09558619074201162, 0.09791172974549611, 0.10281294266441826, 0.10996286599944478, 0.11899942878204908, 0.12959640248325366, 0.14149216523639596, 0.15448868153066742, 0.16843726125821515, 0.1832220131131056, 0.19874599981743796, 0.21492149838073507, 0.23166407393701333, 0.24888958239840203, 0.26651315966688954, 0.28444941438798704, 0.30261325398843075, 0.32092096638794276, 0.33929132766168624, 0.35764660847662794, 0.37591341813522844, 0.3940233650115843, 0.41191353494855615, 0.42952680127137405, 0.4468119857646363, 0.4637238919485484, 0.48022323189961247, 0.49627646664726865, 0.5118555783998816, 0.5269377908372361, 0.541505251643265, 0.5555446894533931, 0.5690470555185843, 0.5820071586762459, 0.594423300680517, 0.6062969175832728 ], [ 0.25294818058427837, 0.2354343278444526, 0.21841573053713756, 0.20196329171597438, 0.18614664556433477, 0.17103924860181863, 0.15672653469986925, 0.1433170947860336, 0.13095599026751337, 0.11983792512302133, 0.11021571779207495, 0.10239603121716105, 0.0967111139085447, 0.09345870377702474, 0.09282124924282747, 0.0948040699515204, 0.09923561254994294, 0.10583116537786477, 0.11427653737936187, 0.12428848009165341, 0.13563914260398613, 0.14815444639256242, 0.16170072635744606, 0.1761695423627071, 0.19146533975512525, 0.2074972304240755, 0.22417449397028638, 0.24140481848972786, 0.2590942806878751, 0.277148270320334, 0.295472812772553, 0.3139759554786787, 0.33256903636731655, 0.3511677505766394, 0.36969298925337507, 0.38807145521370817, 0.40623607519424676, 0.4241262343909189, 0.4416878602250357, 0.458873381187517, 0.4756415844766165, 0.4919573936182244, 0.5077915846670861, 0.5231204570893306, 0.5379254730958336, 0.552192877064567, 0.565913304769421, 0.579081390422356, 0.5916953780278992, 0.603756742232064 ], [ 0.2529335473002223, 0.2351672712831281, 0.21788458463566773, 0.20116735750825163, 0.18509891713951718, 0.1697682426227661, 0.15527633671411778, 0.14174458406726057, 0.12932425587276863, 0.11820530350407452, 0.10862089148455624, 0.10084151920042024, 0.09515032009278293, 0.09179416058601537, 0.09091996611095572, 0.09252700043297112, 0.09646813071309944, 0.10250156804546605, 0.11035964119096199, 0.11979954923166684, 0.13062423575112442, 0.1426806242304053, 0.15584738702874798, 0.17002123748088577, 0.185106163943926, 0.20100676856948205, 0.21762519836771385, 0.23486058846919092, 0.2526099651818453, 0.2707698153952335, 0.2892378150621083, 0.3079144372299457, 0.3267043122183463, 0.3455173017335853, 0.36426929492530535, 0.38288275485736883, 0.40128705049483687, 0.4194186092745159, 0.4372209225108937, 0.45464443219708883, 0.47164632402787876, 0.48819024801205685, 0.5042459849371069, 0.5197890741955432, 0.5348004160487667, 0.549265859257793, 0.5631757831219424, 0.5765246813117948, 0.5893107534399322, 0.6015355090624606 ], [ 0.2539350580617786, 0.23594795299343665, 0.2184290256354084, 0.2014697205685861, 0.1851652787890969, 0.16961801210453392, 0.15494195318007875, 0.14126861147957936, 0.12875313620871712, 0.11757952784161553, 0.10796236461317704, 0.10014057665853747, 0.09435704456697307, 0.09081998832563878, 0.08965311621679237, 0.09085765633983339, 0.09431217440450021, 0.09981325500218956, 0.10713216894949774, 0.11605852478898382, 0.12641903895819354, 0.1380761633512868, 0.15091698146219504, 0.16484077380304393, 0.17974958279606493, 0.19554288750925428, 0.21211576750150665, 0.22935936988652453, 0.2471625745926638, 0.2654140702872352, 0.2840043769082447, 0.30282759132014725, 0.32178278108589337, 0.3407750295612194, 0.35971616961330594, 0.37852525346069205, 0.397128805173435, 0.4154608972156308, 0.433463086366448, 0.45108423874366455, 0.46828026884844354, 0.4850138135374791, 0.501253858476793, 0.516975331801232, 0.5321586772843163, 0.5467894172348212, 0.5608577135242627, 0.5743579335744999, 0.5872882267682888, 0.5996501155646843 ], [ 0.25594199029159415, 0.2377702667956619, 0.22004744494799364, 0.20287246779701917, 0.18634978497985252, 0.1705917205418156, 0.15572158463522673, 0.14187728022196103, 0.12921494254388644, 0.11791179150194257, 0.10816656911395763, 0.10019436168743234, 0.09421087907771501, 0.0904022948888763, 0.08888472927798471, 0.08967071112569194, 0.09266473889145754, 0.09769417167598961, 0.10455752467491981, 0.11306467776369693, 0.12305580900234281, 0.13440127740221475, 0.14699161734786617, 0.16072595089636763, 0.17550336046053255, 0.1912184125867974, 0.2077601449406292, 0.22501323059689632, 0.2428601572511012, 0.2611836312427723, 0.279868774619242, 0.2988049355543392, 0.31788707745787853, 0.33701678080589753, 0.35610291581150644, 0.37506204616552896, 0.3938186174415817, 0.4123049749826647, 0.4304612479041303, 0.4482351290691451, 0.4655815755097826, 0.48246244951308376, 0.49884611717907146, 0.5147070184570378, 0.5300252203159066, 0.5447859626977752, 0.5589792051723713, 0.5725991807095117, 0.5856439616856502, 0.5981150421160751 ], [ 0.25893199551899404, 0.24061461569159182, 0.2227228975472968, 0.2053608232421205, 0.18863889860452288, 0.17267570050378392, 0.15759975520455016, 0.1435516106889604, 0.13068593396958245, 0.11917331576286826, 0.10920085042848278, 0.10096907393254184, 0.09468081445097284, 0.09051729939821963, 0.08860259239151592, 0.08896952918473477, 0.09154824147749249, 0.0961881862084615, 0.10270169179451222, 0.11090475541327996, 0.1206389444378716, 0.13177375511339523, 0.1441977693225547, 0.15780738807991992, 0.17249829808798417, 0.18816115447305898, 0.20468081430134763, 0.22193776015261216, 0.23981048723842016, 0.2581780397716096, 0.27692227072783765, 0.2959296640612644, 0.31509270439313325, 0.33431084361088254, 0.35349113268920873, 0.3725485848570895, 0.3914063266485233, 0.40999558280132875, 0.4282555318034776, 0.4461330616317001, 0.4635824496565552, 0.4805649863969242, 0.49704855942741055, 0.5130072110013473, 0.5284206806672832, 0.5432739422117325, 0.5575567425838199, 0.571263149002736, 0.5843911091863179, 0.5969420285462419 ], [ 0.26287240699071995, 0.24444958943051887, 0.2264253471339573, 0.20890622351581695, 0.19200571832775826, 0.1758451846715435, 0.16055486612612307, 0.14627510080964176, 0.1331578104579371, 0.1213683494926023, 0.11108722479976074, 0.102509634743746, 0.09583832218203385, 0.0912638765564342, 0.08893067566176682, 0.08889858896322035, 0.09112227460773369, 0.09546489092006212, 0.1017398015517182, 0.10975557131151432, 0.11934356627027982, 0.13036408661923546, 0.14269883336913713, 0.1562394679953092, 0.17087843305337339, 0.18650404786671887, 0.2029993575538873, 0.22024334410074536, 0.23811320558262927, 0.25648683745992473, 0.27524506112456076, 0.2942734255175275, 0.3134635616560375, 0.332714137637773, 0.3519314816348568, 0.37102993845337573, 0.38993201569426944, 0.4085683650210154, 0.4268776349471998, 0.44480622438924394, 0.4623079607419783, 0.4793437220122651, 0.4958810192181973, 0.5118935525572462, 0.5273607525862607, 0.5422673157269435, 0.5566027417430761, 0.5703608793870937, 0.583539485154639, 0.596139798995125 ], [ 0.26772316031530013, 0.24923568418623415, 0.23111639567278633, 0.2134722607781951, 0.19641727782662147, 0.18007296033726175, 0.1645689528015174, 0.15004397230985958, 0.13664741657951698, 0.1245419516208414, 0.11390678787141144, 0.10493965978145346, 0.09785268843343153, 0.09285503486828235, 0.09011807533819417, 0.08973098060221363, 0.09167004614467485, 0.09580482726103569, 0.10193992908269314, 0.10986646244954619, 0.11939708663805049, 0.13037681385115435, 0.14267696187660464, 0.1561832495436377, 0.17078544145267166, 0.18637126352641697, 0.20282433345330902, 0.22002474725356938, 0.23785097319173412, 0.2561821164539114, 0.27490004021603526, 0.29389112591070377, 0.3130476239760697, 0.3322686247223088, 0.35146070606020324, 0.3705383174886757, 0.38942395303283406, 0.40804815699040625, 0.4263493982338611, 0.4442738421909487, 0.46177504441962264, 0.47881358559872833, 0.4953566644703036, 0.511377662561538, 0.5268556922285182, 0.5417751376001874, 0.5561251962979059, 0.5698994283235708, 0.5830953172203034, 0.5957138474931706 ], [ 0.27344041421826465, 0.25492978381443593, 0.23675473622428173, 0.21902113292298997, 0.20184185565299778, 0.1853371382264692, 0.16963514464486468, 0.15487311343274576, 0.14119953092064783, 0.12877771853115258, 0.1177905269747475, 0.10844401543394674, 0.10096492362568875, 0.09558394199838482, 0.09249889457848157, 0.09182438309346083, 0.09355271208017343, 0.097554182564334, 0.10361981197632254, 0.11151927537941903, 0.1210432581426891, 0.13201900989008142, 0.14430598809489298, 0.1577836006673854, 0.17233958663447613, 0.1878625037414294, 0.20423843417074344, 0.22135066824832572, 0.23908100534878643, 0.2573116710798132, 0.2759272633985069, 0.2948164484228985, 0.3138733115410371, 0.3329983628537257, 0.3520992346526302, 0.37109111925864086, 0.38989699395554517, 0.4084476740219904, 0.4266817285378303, 0.4445452879830989, 0.4619917679223307, 0.47898152917716463, 0.4954814916591124, 0.5114647163046956, 0.5269099672126514, 0.5418012640509033, 0.556127433029338, 0.5698816631889029, 0.5830610734128633, 0.5956662944017068 ], [ 0.2799799002961901, 0.2614891089325489, 0.24330065196166284, 0.22551850253296293, 0.2082537879863696, 0.19162521426710594, 0.17575990182410164, 0.16079501645959607, 0.14688066908896125, 0.13418438627716103, 0.12289665068302887, 0.1132351136490352, 0.10544198107719471, 0.09976625182936644, 0.09642456507979179, 0.09554705894666103, 0.09713387908534371, 0.1010525928501213, 0.10708159623877275, 0.11497205847219168, 0.1244953141861326, 0.1354623267583355, 0.14772128334619433, 0.16114557649327638, 0.17562136414189536, 0.19103880614195448, 0.20728752461977437, 0.22425527302630965, 0.24182851835075997, 0.2598939093175818, 0.27833998062477006, 0.29705874835452983, 0.3159470482745339, 0.334907577366217, 0.35384965093777765, 0.3726897082614994, 0.3913516048150835, 0.4097667277159077, 0.4278739671335736, 0.44561957222575027, 0.46295691615878065, 0.4798461912313723, 0.49625405201400147, 0.512153221694961, 0.5275220744321217, 0.5423442044041717, 0.5566079904043288, 0.5703061631978088, 0.5834353814506775, 0.5959958208127314 ], [ 0.28729927080676126, 0.2688737322873166, 0.25071849993457523, 0.23293559362827815, 0.21563461349695173, 0.19893344047655712, 0.1829595036043849, 0.1678519899090561, 0.15376537873527735, 0.14087439107819794, 0.12937952874225558, 0.11951046418466472, 0.1115216565819649, 0.10567229188331936, 0.10218536061549457, 0.10119325534219291, 0.10269516130152748, 0.10655494395695388, 0.11254407894375935, 0.12040348293585477, 0.1298922996724147, 0.14080978828647384, 0.15299510827755824, 0.16631643385856962, 0.18065852641220456, 0.19591324529415174, 0.211973999121092, 0.22873344979165336, 0.24608333485389874, 0.26391541746755687, 0.2821228835003195, 0.3006017872553783, 0.3192523451096552, 0.33797999579931925, 0.3566962104181132, 0.3753190661140906, 0.3937736101550883, 0.41199204459281646, 0.4299137611281486, 0.44748525343481227, 0.46465993128595395, 0.48139785784937733, 0.4976654286765634, 0.5134350082836229, 0.5286845378329023, 0.5433971252747644, 0.5575606273939967, 0.5711672315135607, 0.5842130431262587, 0.5966976844368711 ], [ 0.2953591048811607, 0.27704732346760297, 0.25897690926547995, 0.24124842604146163, 0.22397077160863632, 0.20726225033460732, 0.19125230981456612, 0.17608424303965228, 0.16191906250093432, 0.1489403391102208, 0.13735879869949288, 0.12741364558661733, 0.11936518475575747, 0.1134720440690823, 0.10994998195327095, 0.10892110314499202, 0.11037683440923408, 0.11417867771316134, 0.12009902693606168, 0.12787879291813323, 0.13727394815214305, 0.14807817297597875, 0.16012486600757445, 0.17327821969134444, 0.18742172178690408, 0.20244862743283554, 0.21825580442977252, 0.23474065214165377, 0.25180020530621794, 0.26933153765031187, 0.28723279907468885, 0.3054044582835699, 0.3237505079575027, 0.34217951218005055, 0.36060544886634593, 0.3789483399349068, 0.39713468207571445, 0.41509769992489287, 0.43277744647167593, 0.45012077550846236, 0.46708120944706333, 0.48361872367779357, 0.4996994662657719, 0.5152954293818323, 0.5303840865705357, 0.544948007825787, 0.5589744625046145, 0.5724550183723413, 0.585385143536196, 0.59776381668097 ], [ 0.30412262114997457, 0.285976301503632, 0.2680470856481011, 0.2504349025069452, 0.2332490285731304, 0.21660953037959835, 0.20064938025465082, 0.18551741888508824, 0.17138214364730237, 0.15843578977945894, 0.14689715576038745, 0.1370100381796562, 0.12903246370139188, 0.12321183574904367, 0.11974556582097175, 0.11873700173052762, 0.12016662635903551, 0.12389638699183324, 0.12970689269105642, 0.13734811011294973, 0.1465811405840437, 0.15720018900281912, 0.16903652541512718, 0.18195197946501293, 0.1958290784847807, 0.21056212605020205, 0.22605089776484408, 0.24219703650564608, 0.25890255051298355, 0.2760696907387685, 0.29360160085120857, 0.31140331216248057, 0.32938281514880613, 0.3474520558828013, 0.3655277820895376, 0.3835322099044835, 0.40139350885840974, 0.41904611673220254, 0.43643090273789137, 0.4534952000906137, 0.47019272928027867, 0.48648343230589214, 0.5023332364269908, 0.5177137639833209, 0.5326020027537354, 0.5469799492960976, 0.5608342358048856, 0.5741557492807752, 0.5869392502431008, 0.5991829968343662 ], [ 0.31355442380233134, 0.29562790841596903, 0.27789999188124165, 0.2604708554329026, 0.24345115931353403, 0.22696376451994496, 0.21114603857608377, 0.19615275981634495, 0.1821593605981952, 0.16936469079228506, 0.15799154951519134, 0.14828202552618586, 0.14048383234167794, 0.1348248045444441, 0.13147735812092323, 0.13052271120234565, 0.1319306488042954, 0.13556677232661168, 0.1412251353252629, 0.14867099603330544, 0.1576767076817085, 0.16804203332007764, 0.17959954746909312, 0.1922105640539876, 0.2057572686279524, 0.22013486879022, 0.23524555049153464, 0.2509946359927159, 0.26728863743827286, 0.28403467347383354, 0.30114073739076963, 0.31851641868873354, 0.3360738040253462, 0.35372838580322746, 0.371399880435484, 0.3890129074409561, 0.40649751137799983, 0.4237895270589744, 0.44083079886064014, 0.4575692702402646, 0.47395896172848545, 0.48995985593909086, 0.5055377072997974, 0.520663792765308, 0.5353146180401259, 0.5494715920123745, 0.5631206803034319, 0.5762520471436847, 0.5888596932315091, 0.6009410958381602 ], [ 0.32361874067095636, 0.3059678379378216, 0.28850325488268147, 0.2713261543758832, 0.2545492542901638, 0.23829867524441492, 0.22271619606337006, 0.20796176894880303, 0.1942158289910618, 0.18168039307415026, 0.1705771872770836, 0.16114029035503846, 0.15360067719585252, 0.1481616826218292, 0.14496860490819888, 0.14408126364719503, 0.14546112128845748, 0.14898022419322565, 0.15444899163020007, 0.16165129349290266, 0.1703744274729207, 0.1804272816748566, 0.19164659827413613, 0.2038950282898421, 0.2170552868367518, 0.23102361737163787, 0.24570431111508156, 0.2610058890303328, 0.2768388901438572, 0.29311492540569795, 0.3097466001848237, 0.32664795980822925, 0.34373519730617297, 0.36092744444698527, 0.37814753298904963, 0.3953226610672608, 0.41238493247206304, 0.42927175798628, 0.4459261212486932, 0.46229671938551387, 0.47833799274284194, 0.49401005975125345, 0.5092785731362288, 0.5241145129492544, 0.5384939306325195, 0.5523976568094388, 0.5658109838858678, 0.5787233329614544, 0.5911279130526321, 0.6030213792543636 ], [ 0.33427760954837693, 0.31695799876956, 0.29981850828580053, 0.2829617018029218, 0.2665025562861468, 0.2505702561829957, 0.23531016108503405, 0.22088566037439172, 0.2074793110454468, 0.19529219693610758, 0.1845399273612291, 0.17544338163268805, 0.16821274492400176, 0.16302522840032677, 0.16000023925180465, 0.15917927648241917, 0.16051859974880187, 0.163898694087406, 0.16914743046981867, 0.17606840036125657, 0.1844655580471689, 0.19415910151684104, 0.20499209102575666, 0.21683017996553386, 0.22955760121610022, 0.24307199345328268, 0.25727966219516046, 0.27209199072537016, 0.2874231328093521, 0.3031888164965713, 0.319305979857718, 0.335692959212754, 0.3522699972558292, 0.36895989728415485, 0.3856887037997229, 0.40238633320988376, 0.41898711067071565, 0.43543019187897625, 0.4516598639219173, 0.4676257290810003, 0.48328278133364405, 0.49859138841104844, 0.5135171935379352, 0.5280309510426701, 0.5421083093378731, 0.5557295536493342, 0.5688793195313333, 0.581546286793683, 0.5937228620727282, 0.6054048569619184 ], [ 0.3454893744888636, 0.32855482964065275, 0.31179962248560067, 0.2953277597884505, 0.27925618328970864, 0.26371634150598466, 0.24885568107733733, 0.23483867676160666, 0.22184674059767037, 0.21007601413596513, 0.19973176922728902, 0.19101817852488362, 0.1841229471972551, 0.17919801671184962, 0.17634000081503154, 0.17557597388673488, 0.17685993856778812, 0.18008198131846356, 0.18508730469075416, 0.19169894725605646, 0.19973788909976878, 0.20903674668166672, 0.2194463683434667, 0.23083678119491693, 0.2430947109091695, 0.25611968592017953, 0.26982010958178454, 0.2841100381189858, 0.298906919444509, 0.3141302580780284, 0.32970103505768206, 0.34554167377563505, 0.36157635704189256, 0.3777315367013105, 0.3939365174776476, 0.4101240331679397, 0.4262307629138944, 0.4421977577573176, 0.457970763902634, 0.47350044026074634, 0.4887424751108107, 0.5036576111025356, 0.5182115901483194, 0.5323750306543101, 0.5461232494884799, 0.5594360404309946, 0.5722974198481797, 0.5846953491508654, 0.5966214423594735, 0.6080706658792587 ], [ 0.35720771608515345, 0.3407083843118159, 0.3243919979927401, 0.308363683759498, 0.2927416293055889, 0.27765830280419795, 0.26326135556154884, 0.24971378445020712, 0.23719271610287776, 0.22588596991281573, 0.21598548262454675, 0.20767693431786396, 0.20112572385800956, 0.19646085421383375, 0.1937599203862559, 0.19303933559009054, 0.19425320209212232, 0.19730167947286492, 0.20204649108231493, 0.20832910327830878, 0.21598709234327482, 0.224865857800609, 0.23482494476808097, 0.24573980712501808, 0.25750054033982783, 0.2700091072541434, 0.28317621064140536, 0.2969185141198938, 0.31115653288727124, 0.32581325797319816, 0.34081343346166776, 0.3560833446149103, 0.3715509642466412, 0.3871463206009219, 0.4028019765094219, 0.4184535377050512, 0.43404013345064024, 0.44950483341689157, 0.46479498079037634, 0.47986243336801804, 0.4946637126113748, 0.509160066037347, 0.5233174515900073, 0.5371064543433112, 0.5505021464869936, 0.5634839014053284, 0.5760351720393297, 0.5881432428243168, 0.5997989634560283, 0.6109964716559545 ], [ 0.3693813000358529, 0.353362222321684, 0.3375328702191743, 0.3219988703920986, 0.30687864144868854, 0.29230418470088193, 0.27842136711171184, 0.26538927828498027, 0.253378101547096, 0.24256485156658808, 0.2331264008449694, 0.2252295783613697, 0.21901887112965465, 0.21460331988540687, 0.21204520686954303, 0.21135347724748896, 0.2124840171934585, 0.21534702663072358, 0.2198195948085196, 0.22576025964757926, 0.23302234019697113, 0.2414639080122491, 0.25095368785348404, 0.26137331957441096, 0.27261700702430264, 0.2845896817230543, 0.2972046141918578, 0.3103811037478385, 0.32404259098294286, 0.33811532047521703, 0.35252754322847035, 0.3672091753804835, 0.38209180208792287, 0.39710891528859016, 0.41219628800073016, 0.4272924073258887, 0.4423389083638304, 0.4572809692631357, 0.4720676425697053, 0.4866521097081296, 0.5009918540902605, 0.5150487544362673, 0.5287891039110222, 0.5421835630933528, 0.5552070560190099, 0.5678386189101116, 0.5800612109947666, 0.5918614962373622, 0.603229603996891, 0.61415887571843 ], [ 0.381954014148448, 0.36645400679829715, 0.35115242600386826, 0.3361545813533906, 0.32157795776819004, 0.3075525561034462, 0.29422059449984533, 0.2817351935125614, 0.27025759389989923, 0.2599524573872722, 0.25098095351646726, 0.24349171414115905, 0.23761035740239547, 0.23342902621445366, 0.23099796006161485, 0.23032114531451495, 0.23135734131660177, 0.23402642111060937, 0.23821955019293226, 0.24381087614825162, 0.2506684121145566, 0.25866250228368604, 0.2676712247299743, 0.2775829135926993, 0.28829647013265475, 0.2997202810619049, 0.3117704797136376, 0.32436909445004986, 0.33744242112291567, 0.3509197824132872, 0.36473271347875874, 0.3788145381550032, 0.3931002624043341, 0.4075266997916664, 0.4220327473032475, 0.4365597413319503, 0.4510518382012915, 0.4654563782287449, 0.4797242054568199, 0.49380992612039715, 0.5076720975228379, 0.5212733454119156, 0.5345804124740224, 0.5475641435439571, 0.560199414894141, 0.5724650158225933, 0.5843434909575693, 0.595820951443823, 0.6068868626307223, 0.6175338151662234 ], [ 0.39486568784409837, 0.37991663362811, 0.36517546614381263, 0.35074626899232925, 0.3367444140587488, 0.32329647628443436, 0.31053943906327675, 0.29861887548513183, 0.2876857707195125, 0.27789170981542544, 0.26938234139025985, 0.26228937224035753, 0.256721825769256, 0.2527577893624242, 0.25043817230263055, 0.2497638760874477, 0.25069715666199766, 0.2531669913540211, 0.25707731578938076, 0.26231643993173254, 0.26876595603227166, 0.2763079139595392, 0.2848296983087523, 0.2942266391973575, 0.30440277891733897, 0.3152703771017062, 0.32674872222860785, 0.3387627046701836, 0.351241462072154, 0.364117273532214, 0.3773247742709264, 0.3908004913074593, 0.4044826589170105, 0.4183112531915641, 0.4322281806233687, 0.44617756029928846, 0.46010604862741905, 0.47396316654485343, 0.48770160004214685, 0.5012774545715752, 0.5146504520247743, 0.5277840653647692, 0.5406455907778431, 0.5532061605776487, 0.565440702292857, 0.5773278506463718, 0.5888498197123948, 0.599992242609249, 0.610743985807498, 0.6210969446280467 ], [ 0.4080531508520128, 0.39367969087539567, 0.37952334709034946, 0.3656860701085396, 0.35228002981829776, 0.3394271604959162, 0.32725798029150477, 0.3159094400049137, 0.3055215740782151, 0.2962328157772103, 0.288174024682263, 0.28146156224501834, 0.27619009969555447, 0.2724261524930243, 0.2702034657322512, 0.2695212036768945, 0.270345404128061, 0.2726134736067461, 0.27624085856836517, 0.2811286563590795, 0.28717092618383194, 0.29426076435995385, 0.3022946589164286, 0.31117507009989714, 0.320811490403729, 0.33112039080093, 0.34202448336343727, 0.3534516713267347, 0.36533396158008247, 0.37760651456280586, 0.39020692120717226, 0.40307473304267577, 0.4161512298524125, 0.4293793857986349, 0.4427039850477233, 0.4560718371839472, 0.4694320474631592, 0.4827363045090744, 0.49593915653171694, 0.508998255371283, 0.5218745549759738, 0.5345324570037105, 0.5469399010261027, 0.5590684003827221, 0.570893027234666, 0.5823923519795488, 0.5935483430984185, 0.6043462338768718, 0.614774362423616, 0.6248239911199726 ], [ 0.4214514821522634, 0.40767105962878925, 0.394115974824086, 0.3808852123175225, 0.3680868106567962, 0.3558371111916838, 0.34425930665668497, 0.3334811116034627, 0.32363141756661423, 0.31483589460573813, 0.3072116681538585, 0.30086142635327223, 0.2958675565960632, 0.2922870952776761, 0.2901483116400856, 0.2894495714627063, 0.2901607475806834, 0.29222695904486545, 0.29557398223020176, 0.30011442370034536, 0.3057537359484942, 0.31239535711643895, 0.3199445654376665, 0.3283109507818386, 0.3374096442849964, 0.34716158367612276, 0.35749313456440923, 0.3683353637690076, 0.3796232003326351, 0.39129464803964276, 0.40329014619296116, 0.41555212121409113, 0.4280247326769566, 0.4406537926238867, 0.4533868238099559, 0.4661732178412595, 0.4789644552041599, 0.49171435362346105, 0.504379317305225, 0.5169185662063507, 0.5292943307538454, 0.5414720029706096, 0.5534202395501685, 0.5651110160197143, 0.576519633798814, 0.5876246838137001, 0.5984079715006234, 0.6088544086644122, 0.6189518778780714, 0.6286910750273179 ], [ 0.43499531619817783, 0.42181850166057006, 0.408873682181167, 0.3962561646396029, 0.38406912194762366, 0.3724226238274389, 0.36143202093570687, 0.3512155631081796, 0.3418911839945021, 0.3335724797929173, 0.3263640502363209, 0.3203565403734081, 0.31562188586962076, 0.31220936862684784, 0.31014307798701196, 0.30942121480372203, 0.3100173889171996, 0.31188371553684047, 0.3149552121177768, 0.31915482083331453, 0.3243983699880651, 0.33059891934090485, 0.3376701478296838, 0.34552866738575827, 0.3540953302746389, 0.36329571443182596, 0.37306002118644754, 0.38332261728992045, 0.39402141809199526, 0.405097259084083, 0.4164933520222789, 0.4281548772892505, 0.4400287295479184, 0.45206340962538444, 0.464209040809777, 0.47641748047284505, 0.4886424961302875, 0.5008399768875403, 0.5129681551878073, 0.5249878187426491, 0.5368624976827207, 0.5485586168014214, 0.5600456069838208, 0.5712959733867546, 0.5822853206440765, 0.5929923373639725, 0.6033987435514789, 0.6134892054333251, 0.623251222589641, 0.6326749924059306 ], [ 0.44862010097174126, 0.43605112192502965, 0.42371888089926024, 0.41171444140560925, 0.4001355797676871, 0.38908567202138095, 0.3786720038579429, 0.3690034319354438, 0.3601873786395898, 0.3523262274434109, 0.3455132984539985, 0.33982870784294766, 0.33533552197501015, 0.3320766703187539, 0.3300730475706084, 0.32932310159911377, 0.3298039885111069, 0.3314741293471546, 0.3342767895686967, 0.3381441773488966, 0.34300154363941093, 0.34877085358393595, 0.35537374662950544, 0.36273366558389963, 0.3707771754368647, 0.37943459027183746, 0.388640076818866, 0.3983314133050048, 0.408449564599153, 0.41893820190146674, 0.4297432576510298, 0.4408125708421791, 0.4520956483639937, 0.4635435457514863, 0.47510885575012013, 0.486745784376814, 0.49841029038069334, 0.5100602637959958, 0.5216557214088771, 0.5331590004221741, 0.544534935632876, 0.5557510094974222, 0.5667774682036766, 0.5775874001010669, 0.5881567754795972, 0.5984644487291655, 0.6084921253963778, 0.6182242976569309, 0.6276481523189631, 0.6367534557480733 ], [ 0.462263233439849, 0.4503006355455332, 0.43857743155752854, 0.4271800282055832, 0.4162004668736841, 0.40573523141056006, 0.395883555132812, 0.38674519153346876, 0.3784176640004113, 0.3709930817054047, 0.3645546957561562, 0.3591734576936239, 0.35490491000115404, 0.35178676103434586, 0.3498374555791784, 0.34905594284123703, 0.3494226825417936, 0.35090175202503515, 0.35344376563826707, 0.35698922742310224, 0.3614719250774669, 0.36682203003216995, 0.37296867111423154, 0.3798418672568407, 0.38737381173823654, 0.3954995800991123, 0.4041573806412674, 0.413288483016413, 0.42283695423598217, 0.4327493111012187, 0.44297417127618655, 0.4534619577698872, 0.46416468711191733, 0.47503585184914676, 0.4860303936861095, 0.49710475432051776, 0.508216986011267, 0.5193269022056748, 0.5303962491950104, 0.5413888819194475, 0.5522709300174096, 0.5630109434886822, 0.573580010549774, 0.5839518431708998, 0.5941028282687478, 0.6040120445381478, 0.6136612464430132, 0.623034817990471, 0.6321196996383559, 0.6409052920991223 ], [ 0.4758650270785563, 0.4645024042098707, 0.4533797142926799, 0.4425784392465137, 0.4321847175412725, 0.42228812590239295, 0.41298003590931126, 0.4043515359700244, 0.39649095423492803, 0.38948107643093877, 0.3833962180351652, 0.378299371160727, 0.37423968752740006, 0.3712505641201992, 0.36934855695108343, 0.368533260759458, 0.3687881719222024, 0.37008242280408543, 0.37237316670570625, 0.37560832656874926, 0.3797294082500733, 0.38467411642397537, 0.3903785826691167, 0.39677910089010815, 0.40381334642924027, 0.41142111939309883, 0.41954469423961227, 0.4281288768807158, 0.4371208715703723, 0.4464700483575781, 0.4561276835045747, 0.46604672460130825, 0.4761816123922773, 0.48648817450810683, 0.49692359323786606, 0.5074464403081373, 0.5180167659937126, 0.5285962271657657, 0.5391482383933386, 0.5496381312810015, 0.5600333092611148, 0.5703033875863832, 0.5804203109285619, 0.5903584435326387, 0.6000946291459814, 0.6096082198561946, 0.6188810745015766, 0.627897528473959, 0.6366443375484455, 0.6451105988941401 ], [ 0.4893694903860756, 0.47859623373803833, 0.4680614104045847, 0.45784143975963765, 0.44801653210692666, 0.43866948512335885, 0.4298841260301777, 0.4217434074889214, 0.4143272035439627, 0.40770989809264635, 0.4019579065862127, 0.3971273129899244, 0.39326182761264444, 0.3903912672225787, 0.38853072123315285, 0.38768049850774217, 0.3878268589452303, 0.38894343959637834, 0.3909932057269247, 0.39393070835138705, 0.39770441855629846, 0.4022589331967911, 0.4075368965051573, 0.4134805443544013, 0.4200328393959075, 0.4271382164336972, 0.4347429931344963, 0.4427955206072262, 0.45124615358847453, 0.46004711456078085, 0.46915231408396907, 0.4785171744843975, 0.4880984885567653, 0.4978543309200686, 0.5077440281551683, 0.5177281852218997, 0.527768759848731, 0.5378291732736525, 0.5478744444196121, 0.5578713348020718, 0.567788492708233, 0.5775965870410966, 0.5872684233530913, 0.5967790367550538, 0.6061057584061964, 0.6152282540649906, 0.6241285346572026, 0.632790939982072, 0.6412020975433911, 0.6493508590881798 ], [ 0.5027249136771468, 0.4925269430747708, 0.4825640214901124, 0.47290747901003827, 0.4636316864632385, 0.45481289625303867, 0.44652779244734586, 0.43885176906020945, 0.43185698703575853, 0.42561029612752865, 0.42017114277852485, 0.4155896125156425, 0.4119047678256792, 0.4091434337333575, 0.407319550558351, 0.4064341589887363, 0.4064760146276849, 0.4074227595465516, 0.4092425200761229, 0.41189576344888806, 0.4153372360145662, 0.419517821437917, 0.4243861922850427, 0.4298901737010405, 0.43597778435747536, 0.442597960290062, 0.4497009973335973, 0.4572387661666869, 0.46516476133331575, 0.4734340442118374, 0.4820031324927084, 0.49082987796449207, 0.4998733625114811, 0.5090938308220415, 0.518452668428617, 0.5279124258737568, 0.5374368841575957, 0.5469911530393807, 0.5565417919474694, 0.566056942832802, 0.5755064649022771, 0.5848620624416169, 0.5940973985852994, 0.6031881896791195, 0.6121122766361267, 0.6208496712929126, 0.6293825771614362, 0.6376953851101202, 0.6457746453922858, 0.6536090180842556 ], [ 0.5158842741298186, 0.5062447262989502, 0.4968351610783544, 0.4877218829595123, 0.478973598758607, 0.4706603228970042, 0.46285204715788464, 0.455617199931922, 0.4490209453723394, 0.4431233999872823, 0.4379778690835217, 0.43362922320551234, 0.43011254025161083, 0.4274521284814903, 0.42566101796144556, 0.42474096550683754, 0.4246829668469849, 0.42546821799961815, 0.4270694245905529, 0.42945233016874973, 0.43257732601065935, 0.43640101493730615, 0.4408776262476238, 0.4459602119280227, 0.4516015894108854, 0.45775502794709855, 0.46437470058189245, 0.47141594021603245, 0.47883534641019926, 0.486590790704416, 0.49464136410858983, 0.5029473030199801, 0.5114699208850828, 0.5201715638286698, 0.5290156001883657, 0.53796644699572, 0.5469896311871294, 0.5560518797201304, 0.5651212306599612, 0.5741671564421685, 0.5831606906254586, 0.5920745502427728, 0.6008832470828478, 0.6095631826764317, 0.6180927232546864, 0.6264522523723808, 0.6346242001663458, 0.6425930493058198, 0.6503453185677416, 0.6578695256381728 ], [ 0.5288054768776262, 0.5197053350565154, 0.5108286563650503, 0.5022368539614388, 0.49399320881370545, 0.48616185170480736, 0.47880655656941506, 0.4719893728295327, 0.46576914446724343, 0.46019998387424244, 0.4553297859993182, 0.4511988794279086, 0.44783891241358004, 0.44527206126506846, 0.4435106255413415, 0.44255704133730245, 0.4424043050070041, 0.44303676094277605, 0.4444311746662075, 0.4465579913874878, 0.44938267289943934, 0.4528670119850507, 0.4569703408225702, 0.4616505740534813, 0.46686505370588216, 0.4725711880507098, 0.4787268968673024, 0.4852908900127324, 0.49222281435760895, 0.499483306714447, 0.5070339885292815, 0.5148374332229209, 0.5228571304964614, 0.5310574647923323, 0.5394037182853284, 0.5478621028377497, 0.556399820599813, 0.5649851494730436, 0.5735875474294151, 0.5821777685425426, 0.5907279833361755, 0.5992118964691894, 0.6076048556436123, 0.6158839467561102, 0.6240280715605006, 0.6320180053518577, 0.6398364333386753, 0.6474679653856378, 0.6548991296578888, 0.6621183463695454 ], [ 0.5414514539770325, 0.5328701107103512, 0.5245044966351858, 0.5164113203998832, 0.5086487176418912, 0.5012753159674006, 0.4943491502744894, 0.48792645644415106, 0.4820603870478219, 0.4767997077396197, 0.4721875450999587, 0.46826026335904763, 0.46504654644150806, 0.4625667518213051, 0.46083258386245923, 0.45984710842599014, 0.4596051008556835, 0.46009369026657865, 0.4612932386583672, 0.46317837718732235, 0.4657191157922567, 0.4688819462549712, 0.47263087098845613, 0.4769283075808915, 0.48173583917476104, 0.48701480017801635, 0.4927267033464259, 0.49883352661003194, 0.5052978856946232, 0.5120831218757038, 0.5191533338348182, 0.5264733795371123, 0.5340088693234556, 0.5417261659206595, 0.5495924015532809, 0.5575755173188948, 0.5656443257944423, 0.5737685946297083, 0.581919146674671, 0.5900679709032238, 0.5981883378995743, 0.6062549137997529, 0.6142438671581258, 0.6221329640785777, 0.6299016479747517, 0.6375311013929873, 0.645004288362618, 0.652305976674137, 0.65942274029187, 0.666342942767708 ], [ 0.5537901443839977, 0.5457058948176794, 0.5378286618859044, 0.5302106735173027, 0.5229052263160097, 0.5159658352923882, 0.5094452659249026, 0.5033944754810913, 0.49786150254267825, 0.49289035467039205, 0.48851995238005036, 0.48478319132029596, 0.4817061823043445, 0.4793077199270206, 0.4775990151948126, 0.4765837073619893, 0.4762581474563273, 0.4766119238400619, 0.47762858162680794, 0.4792864752849455, 0.4815596886395788, 0.4844189587992279, 0.48783254917427116, 0.491767029798187, 0.4961879383340109, 0.5010603102675495, 0.506349080108529, 0.5120193658020418, 0.5180366554893984, 0.5243669192881124, 0.5309766693182276, 0.5378329894490504, 0.5449035529214923, 0.5521566418310289, 0.5595611780456313, 0.5670867709519488, 0.5747037837915824, 0.5823834174487675, 0.5900978084456888, 0.5978201365677416, 0.6055247368934792, 0.613187210922682, 0.6207845318468358, 0.6282951396570031, 0.6356990226148735, 0.6429777825227989, 0.6501146821385002, 0.6570946739318678, 0.6639044101363997, 0.6705322346844981 ], [ 0.5657943775489863, 0.5581848443406211, 0.5507728611062211, 0.5436064227884427, 0.5367343059636404, 0.530205301923888, 0.5240673579882675, 0.5183666520282518, 0.5131466343408786, 0.5084470789617723, 0.5043031920066372, 0.5007448264413341, 0.49779584988352577, 0.49547370426240983, 0.4937891837767308, 0.49274644175521376, 0.4923432195637908, 0.4925712738171925, 0.49341696400513274, 0.49486195296298063, 0.49688396838355703, 0.4994575748779139, 0.5025549122242488, 0.5061463650687945, 0.5102011408381244, 0.5146877443787615, 0.5195743485061242, 0.5248290682739126, 0.5304201528696955, 0.5363161125153879, 0.5424857988351631, 0.5488984562888056, 0.5555237599966053, 0.5623318521539334, 0.5692933857472804, 0.5763795808438801, 0.5835622956301383, 0.5908141118073136, 0.5981084320069314, 0.6054195855753319, 0.6127229383510577, 0.6199950018374639, 0.6272135373535763, 0.6343576512210742, 0.6414078777121882, 0.6483462472522734, 0.6551563381679453, 0.661823311040228, 0.6683339254220605, 0.6746765392854194 ], [ 0.5774416815982345, 0.5702841750201856, 0.563314205339063, 0.5565757956420296, 0.550113524189267, 0.5439718373064039, 0.5381942912501241, 0.5328227456624206, 0.5278965381316676, 0.5234516750802173, 0.5195200777729484, 0.5161289228482348, 0.513300113829375, 0.5110499134203843, 0.5093887563961637, 0.5083212504805477, 0.5078463591264587, 0.5079577471652276, 0.5086442594326404, 0.5098904949504883, 0.5116774357667043, 0.5139830902408488, 0.5167831149278123, 0.5200513863400131, 0.5237605025951473, 0.5278822040922183, 0.5323877108634679, 0.5372479813520362, 0.5424339026097067, 0.5479164251469204, 0.5536666570032541, 0.5596559313253903, 0.5658558602281998, 0.572238385392756, 0.5787758331214967, 0.5854409787667297, 0.5922071228382377, 0.5990481788601916, 0.6059387712894738, 0.612854340562521, 0.6197712515886672, 0.6266669017008313, 0.6335198241329473, 0.6403097834318806, 0.6470178597439089, 0.653626519563488, 0.6601196712276624, 0.6664827041293048, 0.6727025112663078, 0.678767495314775 ], [ 0.5887140348336357, 0.5819858531017719, 0.5754348364635095, 0.5691013023725314, 0.5630259477718436, 0.5572492369114092, 0.5518107345995913, 0.546748404988181, 0.5420979011556651, 0.5378918747906312, 0.534159337518971, 0.5309251052920364, 0.5282093543987902, 0.5260273120432556, 0.5243890963806748, 0.5232997111508808, 0.522759189602088, 0.5227628724271016, 0.5233017960628962, 0.5243631618343984, 0.5259308535891823, 0.52798597177249, 0.5305073550154543, 0.5334720656095727, 0.5368558218807534, 0.540633367574763, 0.5447787751252088, 0.5492656854742215, 0.5540674915562916, 0.5591574754657547, 0.5645089107346739, 0.5700951412278757, 0.5758896471883702, 0.5818661072556558, 0.5879984631468049, 0.5942609914183017, 0.6006283845450681, 0.6070758416294341, 0.613579167492322, 0.6201148777505135, 0.6266603067501069, 0.6331937148750137, 0.6396943917254231, 0.6461427518971332, 0.6525204205175443, 0.6588103062400602, 0.66499666000547, 0.6710651184966229, 0.677002731802581, 0.6827979753427394 ], [ 0.5995975768155145, 0.5932762524055983, 0.5871215288137074, 0.5811702828128428, 0.5754596370053664, 0.5700264169302531, 0.564906566556035, 0.5601345397752886, 0.5557426893498684, 0.5517606775761842, 0.5482149342686973, 0.5451281871111379, 0.5425190867846027, 0.5404019445749585, 0.538786593688383, 0.5376783778252504, 0.5370782624412183, 0.5369830564161253, 0.5373857253766767, 0.5382757733352392, 0.5396396670118305, 0.5414612772886201, 0.5437223144946695, 0.5464027381791485, 0.5494811270981614, 0.552935000658225, 0.5567410884178737, 0.5608755489526493, 0.5653141430990354, 0.5700323691380524, 0.5750055688409293, 0.5802090135826959, 0.5856179791247894, 0.5912078164110395, 0.5969540240599026, 0.6028323264005679, 0.6088187590875028, 0.614889762687291, 0.621022283265043, 0.6271938779602546, 0.6333828228491788, 0.639568220026134, 0.6457301007610771, 0.6518495217529778, 0.6579086518399271, 0.6638908469896423, 0.6697807119249821, 0.6755641472925817, 0.6812283818221649, 0.6867619894220869 ], [ 0.6100822928260404, 0.6041457907672797, 0.5983652773915392, 0.5927744477475562, 0.5874071434202633, 0.5822968729705154, 0.5774763008712744, 0.5729767202102196, 0.5688275272501713, 0.5650557178756804, 0.5616854266672868, 0.5587375285767863, 0.5562293208064834, 0.5541742985806973, 0.5525820332938672, 0.5514581554646517, 0.5508044385930341, 0.550618974040385, 0.5508964220323135, 0.5516283203033576, 0.552803430057153, 0.5544080988805259, 0.5564266218820868, 0.5588415853023999, 0.5616341807219005, 0.5647844822858238, 0.5682716836051146, 0.5720742947863773, 0.5761703031100635, 0.5805373030547026, 0.5851526026145266, 0.5899933132361763, 0.5950364303384439, 0.6002589104526156, 0.6056377497226513, 0.6111500670213287, 0.6167731934353828, 0.6224847684814837, 0.6282628422298644, 0.6340859815901595, 0.6399333783772855, 0.6457849564186847, 0.6516214748617876, 0.6574246249520493, 0.6631771178302165, 0.6688627612935638, 0.6744665239332204, 0.6799745855572681, 0.6853743733029241, 0.6906545833044834 ], [ 0.6201616831862585, 0.6145885572194879, 0.6091608835513549, 0.6039094250774258, 0.5988650197123735, 0.5940581581828656, 0.5895185381490736, 0.5852746077741882, 0.5813531139191304, 0.5777786714409855, 0.5745733703796218, 0.5717564369585176, 0.5693439622410537, 0.567348709043688, 0.5657800035258728, 0.5646437130948139, 0.5639423073145319, 0.5636749938634219, 0.5638379176863703, 0.5644244086920447, 0.5654252618739645, 0.5668290336462464, 0.5686223393831634, 0.5707901394036957, 0.5733160036235851, 0.5761823484419505, 0.579370642779114, 0.5828615832277583, 0.5866352407888116, 0.590671183494928, 0.594948580326795, 0.5994462922288339, 0.6041429558207487, 0.609017064710067, 0.6140470522879895, 0.6192113786873623, 0.6244886233347603, 0.6298575833524062, 0.635297377045014, 0.6407875508964878, 0.6463081879281183, 0.6518400149355329, 0.6573645060091051, 0.6628639798213235, 0.668321688396551, 0.6737218954223221, 0.6790499425763952, 0.6842923027934338, 0.6894366198480976, 0.6944717340625399 ], [ 0.6298324267912554, 0.6246019389739178, 0.6195065466126555, 0.6145743183197594, 0.6098333483870025, 0.6053113861308133, 0.6010354475855721, 0.5970314207340283, 0.5933236769489554, 0.5899347021681333, 0.5868847613685294, 0.5841916090368793, 0.5818702565271465, 0.5799328045244404, 0.5783883454761604, 0.5772429370706077, 0.5764996439697819, 0.576158641387719, 0.5762173710773939, 0.5766707381110989, 0.5775113356758423, 0.5787296850045116, 0.5803144784565127, 0.5822528154789999, 0.5845304234814773, 0.5871318582665765, 0.5900406813032837, 0.593239613562649, 0.5967106676714082, 0.6004352616540678, 0.6043943184760019, 0.608568355979027, 0.6129375716778881, 0.6174819263578144, 0.6221812295963546, 0.6270152293482457, 0.6319637066939542, 0.6370065758579981, 0.6421239887275073, 0.6472964423958465, 0.6525048877479993, 0.6577308368002639, 0.6629564663961124, 0.6681647159196216, 0.6733393768867361, 0.6784651725778549, 0.6835278262478299, 0.6885141168586421, 0.6934119216972805, 0.6982102456433423 ], [ 0.6390940463663954, 0.6341862552876644, 0.6294034678447518, 0.6247712830638293, 0.6203152937852957, 0.6160607620658982, 0.6120322815168595, 0.6082534360608473, 0.6047464656490207, 0.601531950007175, 0.5986285213618072, 0.596052616265343, 0.5938182750913439, 0.5919369955757471, 0.5904176440834756, 0.5892664252889759, 0.5884869079244903, 0.5880801014346836, 0.5880445760252876, 0.5883766169020346, 0.5890704025867529, 0.5901181971066455, 0.5915105465308186, 0.5932364716500175, 0.5952836503815315, 0.5976385855224039, 0.6002867555584451, 0.6032127481734145, 0.6064003777397479, 0.6098327893068448, 0.6134925523852968, 0.6173617481555856, 0.6214220536494205, 0.6256548260335066, 0.6300411894601676, 0.6345621261343896, 0.6391985723766378, 0.6439315196175658, 0.6487421195103392, 0.6536117917350691, 0.6585223326247343, 0.6634560224718438, 0.6683957292738484, 0.6733250067253044, 0.6782281844406985, 0.6830904486642235, 0.6878979120611443, 0.6926376715607102, 0.697297853606911, 0.701867646549214 ], [ 0.6479485813361135, 0.6433444036342, 0.6388554716127133, 0.6345051254170185, 0.6303166807034785, 0.6263131449824691, 0.6225169243620343, 0.6189495286846365, 0.6156312837919352, 0.6125810599570484, 0.6098160253118317, 0.6073514323282828, 0.6052004440977232, 0.6033740053529789, 0.6018807610153006, 0.6007270226816203, 0.5999167810899174, 0.5994517604095675, 0.5993315083821209, 0.5995535150312393, 0.6001133519592442, 0.6010048241790116, 0.6022201269566306, 0.6037500011685036, 0.6055838820705809, 0.6077100379774998, 0.6101156969919217, 0.6127871614593298, 0.6157099111290452, 0.6188686969931563, 0.6222476284070892, 0.6258302563636452, 0.6295996557254262, 0.6335385088736787, 0.6376291926762928, 0.6418538699929476, 0.6461945861987942, 0.6506333704893293, 0.6551523410850492, 0.659733812926479, 0.6643604060634883, 0.6690151527073258, 0.6736816008263584, 0.6783439122134308, 0.682986953113246, 0.6875963757471191, 0.6921586893833456, 0.6966613199484335, 0.7010926575341943, 0.7054420915082377 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.9015583982691169, 0.07897703815251589, 0.5936527075245976, 0.6120965592563152, 0.4736106339842081, 0.04662526026368141, 0.356617910789543, 0.2774352249778331, 0.338147682411074, 0.35751952707896373, 0.30526593544835295, 0.3799278140587318, 0.45303884026672, 0.3195014305351048, 0.2710122230598544, 0.3101781271838003, 0.3192620118331256, 0.29466702186655375, 0.3594450159837844, 0.24723654908335171, 0.20219900431073753, 0.15535158321810666, 0.21864449169485786, 0.2214675716720253 ], "xaxis": "x", "y": [ 0.09575823694467545, 0.19328522123396397, 0.9491333859041333, 0.09614580031484365, 0.44612090196460485, 0.5102584837004542, 0.40973617621602276, 0.3989987442915353, 0.35076364260028653, 0.30889148094930036, 0.22268989467468026, 0.3225413711452286, 0.31303243307624895, 0.3343490867702806, 0.3568190214573015, 0.2926297394006788, 0.34422101278772643, 0.25407122927725617, 0.24619875992605839, 0.22714266660609614, 0.1790963812780852, 0.11062969648377831, 0.10934985977910393, 0.09944705457974683 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.9015583982691169, 0.07897703815251589, 0.5936527075245976, 0.6120965592563152, 0.4736106339842081, 0.04662526026368141, 0.356617910789543, 0.2774352249778331, 0.338147682411074, 0.35751952707896373, 0.30526593544835295, 0.3799278140587318, 0.45303884026672, 0.3195014305351048, 0.2710122230598544, 0.3101781271838003, 0.3192620118331256, 0.29466702186655375, 0.3594450159837844, 0.24723654908335171, 0.20219900431073753, 0.15535158321810666, 0.21864449169485786, 0.2214675716720253 ], "xaxis": "x2", "y": [ 0.09575823694467545, 0.19328522123396397, 0.9491333859041333, 0.09614580031484365, 0.44612090196460485, 0.5102584837004542, 0.40973617621602276, 0.3989987442915353, 0.35076364260028653, 0.30889148094930036, 0.22268989467468026, 0.3225413711452286, 0.31303243307624895, 0.3343490867702806, 0.3568190214573015, 0.2926297394006788, 0.34422101278772643, 0.25407122927725617, 0.24619875992605839, 0.22714266660609614, 0.1790963812780852, 0.11062969648377831, 0.10934985977910393, 0.09944705457974683 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:38] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Ramaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9094456806426682, 0.9067049049430519, 0.9044477481713625, 0.9026956306151543, 0.9014681076739592, 0.9007825596652005, 0.9006538939454668, 0.9010942706321567, 0.9021128638958233, 0.903715670606242, 0.905905376827376, 0.9086812901170371, 0.9120393417737488, 0.9159721582687375, 0.9204691955870099, 0.9255169249122716, 0.9310990541118809, 0.9371967678374593, 0.9437889702858164, 0.9508525184926976, 0.9583624394215949, 0.9662921296468234, 0.9746135408496679, 0.9832973569123453, 0.9923131690067433, 1.0016296541203737, 1.0112147605653876, 1.0210359018033697, 1.0310601578712673, 1.041254482100312, 1.0515859097902016, 1.062021765015788, 1.072529861709986, 1.0830786954612366, 1.0936376229654605, 1.1041770266780286, 1.1146684628426848, 1.125084791678741, 1.1354002890531887, 1.145590739435, 1.1556335103208348, 1.1655076086375113, 1.175193719874335, 1.18467423088619, 1.1939332374459608, 1.2029565377203673, 1.211731612904659, 1.2202475962847605, 1.228495232006027, 1.2364668248193729 ], [ 0.9052985226664574, 0.9025284568093532, 0.9002533209221609, 0.8984954063846189, 0.8972750510583584, 0.8966102949719593, 0.8965165473370452, 0.8970062787605984, 0.8980887539240567, 0.8997698202767068, 0.9020517669853272, 0.9049332651238151, 0.9084093947195213, 0.9124717570353991, 0.9171086621892153, 0.9223053743845191, 0.9280443915500588, 0.9343057347098497, 0.9410672255596539, 0.9483047376772831, 0.9559924155280605, 0.9641028635800142, 0.972607313604523, 0.981475780845522, 0.9906772194463686, 1.0001796852101872, 1.0099505104941437, 1.019956492701095, 1.0301640950257511, 1.0405396561165214, 1.0510496041644237, 1.0616606705156368, 1.072340098045599, 1.083055840042124, 1.0937767460585082, 1.1044727319881391, 1.1151149323915794, 1.1256758338215478, 1.1361293885123698, 1.1464511083194018, 1.1566181392123163, 1.1666093169537755, 1.1764052048432854, 1.1859881145882418, 1.1953421114921103, 1.2044530052339133, 1.2133083275627465, 1.2218972982527556, 1.2302107806639104, 1.2382412282359114 ], [ 0.9016784154896189, 0.8988890693600866, 0.8966057114361371, 0.8948514984958107, 0.8936475419426646, 0.8930125247432499, 0.8929623276556254, 0.8935096817165683, 0.8946638664925813, 0.89643047473398, 0.898811262970201, 0.9018041034732751, 0.905403045451681, 0.9095984826020826, 0.914377411655351, 0.9197237549457945, 0.9256187125902691, 0.9320411092018691, 0.9389677067378969, 0.9463734670834936, 0.9542317615707747, 0.9625145360554141, 0.9711924470461333, 0.980234986236805, 0.9896106086413078, 0.9992868750616766, 1.0092306144584615, 1.0194081071111278, 1.029785285884159, 1.0403279506294307, 1.0510019896456957, 1.061773601928707, 1.0726095143915233, 1.0834771890538681, 1.0943450161862693, 1.105182490404964, 1.115960367656619, 1.126650801859172, 1.1372274606582335, 1.1476656203172662, 1.1579422401963004, 1.1680360176038502, 1.1779274240483364, 1.1875987240853925, 1.197033978070726, 1.2062190301973978, 1.2151414832312897, 1.2237906613668668, 1.232157562613294, 1.2402348020924858 ], [ 0.8986203650282166, 0.8958228807863667, 0.8935421470541697, 0.8918021731895791, 0.8906248284549756, 0.8900294150676253, 0.8900322470008252, 0.890646255154679, 0.8918806437821735, 0.8937406256757742, 0.8962272631487658, 0.8993374367836732, 0.9030639532469033, 0.907395787461157, 0.912318435477565, 0.9178143371479042, 0.9238633178035252, 0.9304429996506286, 0.9375291465211686, 0.9450959255964583, 0.9531160901084039, 0.9615611021060388, 0.9704012214793685, 0.9796055870653979, 0.9891423102565795, 0.9989785939402104, 1.0090808820853394, 1.0194150391968697, 1.0299465546761168, 1.040640764801418, 1.0514630842220016, 1.0623792391030455, 1.0733554949581654, 1.0843588734279983, 1.0953573535751306, 1.1063200545170715, 1.1172173973281987, 1.1280212450742662, 1.1387050205952245, 1.1492438022378384, 1.1596143981809177, 1.1697954003177862, 1.1797672188865256, 1.1895120991897012, 1.1990141218389192, 1.2082591880099942, 1.2172349912123017, 1.225930977069248, 1.2343382925817235, 1.2424497263069219 ], [ 0.8961577621500261, 0.8933643863882768, 0.8910981796570517, 0.8893839827862855, 0.8882443996299261, 0.8876993206984377, 0.8877654469257449, 0.8884558383422652, 0.8897795192615514, 0.8917411766757546, 0.8943409894951263, 0.8975746202906374, 0.9014333861641384, 0.9059046013849541, 0.9109720555181638, 0.9166165651024215, 0.9228165241920798, 0.9295483853910816, 0.9367870267817021, 0.9445059924171453, 0.9526776234005251, 0.9612731149388124, 0.9702625400527521, 0.979614875626713, 0.9892980559723784, 0.9992790673859, 1.009524087077758, 1.0199986625537585, 1.0306679231303637, 1.0414968133035216, 1.0524503374860383, 1.063493806535233, 1.0745930779846609, 1.0857147835933827, 1.0968265394906895, 1.1078971356873466, 1.1188967029859678, 1.1297968563410052, 1.1405708145098132, 1.1511934964299866, 1.1616415951890602, 1.171893630753983, 1.1819299828289271, 1.19173290533546, 1.201286524078501, 1.2105768191901412, 1.219591593941978, 1.2283204314939593, 1.2367546411089834, 1.2448871953118743 ], [ 0.8943217821010105, 0.8915457965945619, 0.8893069988772035, 0.887631030190863, 0.8865411969539442, 0.8860579393591421, 0.8861982917237248, 0.8869753638279616, 0.8883978830040437, 0.8904698457813269, 0.8931903316242231, 0.8965535248021177, 0.9005489694207007, 0.9051620466182614, 0.9103746185515742, 0.9161657454154994, 0.9225123660279532, 0.9293898485546825, 0.936772360135479, 0.9446330548494168, 0.9529441197191464, 0.9616767380505614, 0.9708010289908238, 0.980286009016888, 0.9900996033405483, 1.0002087187456434, 1.0105793769355067, 1.0211768996010975, 1.0319661324777551, 1.0429116945901067, 1.0539782396589645, 1.0651307184261507, 1.07633463284279, 1.0875562752777317, 1.098762947913712, 1.109923159208705, 1.12100679568134, 1.1319852683516658, 1.1428316339709552, 1.1535206917543053, 1.1640290567336584, 1.1743352111175185, 1.1844195352114588, 1.1942643195476614, 1.2038537599132377, 1.213173936971501, 1.2222127821488635, 1.2309600314205948, 1.2394071685762538, 1.247547359484153 ], [ 0.8931407506533859, 0.8903963553316954, 0.888198698122398, 0.8865741771142566, 0.8855467584997088, 0.8851373850129906, 0.8853633642625799, 0.8862377705501837, 0.8877689093631966, 0.8899599088535801, 0.892808511465056, 0.8963071330370579, 0.900443227928225, 0.9051999447326217, 0.9105569887110387, 0.9164915492304713, 0.9229791322223364, 0.9299941722141618, 0.9375103712863625, 0.945500789662948, 0.9539377644311143, 0.9627927485404888, 0.9720361495968141, 0.9816372220223187, 0.9915640393633666, 1.0017835524236067, 1.0122617251615729, 1.0229637330034118, 1.0338542056331228, 1.0448974967339932, 1.0560579652290003, 1.067300255366254, 1.078589565916983, 1.0898919014535222, 1.1011743009866433, 1.1124050411165958, 1.1235538123071098, 1.1345918679792724, 1.145492146906148, 1.1562293699332957, 1.1667801124114887, 1.1771228539535656, 1.187238007255028, 1.197107927776826, 1.2067169060999399, 1.216051144740863, 1.2250987211749107, 1.2338495387583932, 1.2422952671752023, 1.2504292739613474 ], [ 0.8926395003755478, 0.8899416455231367, 0.8877995241796202, 0.8862402313600691, 0.8852883360304814, 0.8849652256432077, 0.885288414717243, 0.88627085459788, 0.8879203036531875, 0.8902388411584448, 0.8932226257536585, 0.8968619968923589, 0.9011419797306645, 0.9060431739090312, 0.9115429009346642, 0.9176163968348732, 0.9242378170386536, 0.9313808884557073, 0.9390191662585575, 0.9471259672873856, 0.9556741125122157, 0.9646356124231928, 0.9739813946988796, 0.983681129817516, 0.9937031737842972, 1.004014622996592, 1.014581463242257, 1.0253687897030672, 1.036341074578807, 1.0474624613298402, 1.0586970680927374, 1.0700092866552164, 1.0813640669721427, 1.0927271803103782, 1.1040654566421357, 1.1153469938764555, 1.1265413379924074, 1.137619634199872, 1.148554749990795, 1.1593213714331443, 1.169896074366031, 1.1802573723295762, 1.190385743146726, 1.2002636360956258, 1.209875461591694, 1.2192075652529804, 1.2282481881605778, 1.2369874150542108, 1.245417112125491, 1.2535308559898024 ], [ 0.8928387465497694, 0.8902029163484205, 0.888131151392541, 0.886651162022254, 0.8857880433656076, 0.8855635547292553, 0.8859953432241865, 0.8870961505394388, 0.8888730715833097, 0.8913269697417175, 0.8944521851669891, 0.8982366786143211, 0.9026627064014345, 0.9077080059695881, 0.9133473089407308, 0.9195538632516413, 0.9263006267573902, 0.9335609204790682, 0.9413085307056815, 0.9495174120715089, 0.9581612033763383, 0.9672127376280742, 0.9766436589968803, 0.9864241942243173, 0.996523081706534, 1.0069076377521653, 1.0175439300807532, 1.0283970273865777, 1.0394312966495567, 1.0506107244547518, 1.0618992435849808, 1.0732610508846627, 1.084660906515448, 1.0960644081079198, 1.1074382359630122, 1.1187503674473978, 1.129970260166921, 1.141069004504511, 1.1520194467767526, 1.1627962846844264, 1.1733761369765965, 1.1837375893690933, 1.193861218796813, 1.203729598063718, 1.2133272829054207, 1.2226407834101662, 1.2316585216640288, 1.2403707774001513, 1.248769623343506, 1.2568488518528285 ], [ 0.8937545159227123, 0.8911964716126096, 0.8892100277402206, 0.8878234002783296, 0.8870621069836258, 0.8869481839708365, 0.887499323736241, 0.8887279726155122, 0.8906404634036358, 0.8932363097250249, 0.8965078409754856, 0.9004403799843972, 0.9050131134230726, 0.9102006418872546, 0.9159749499616788, 0.9223073281358476, 0.9291697626726382, 0.9365355300785991, 0.9443790525529222, 0.9526752916126844, 0.9613989950928421, 0.9705240251229237, 0.9800228789077043, 0.9898664276287983, 1.0000238520627045, 1.0104627354272855, 1.021149271255989, 1.0320485480595019, 1.0431248787833336, 1.0543421496879783, 1.0656641694528404, 1.0770550046830984, 1.0884792924461524, 1.0999025239806433, 1.1112912963883677, 1.122613531066087, 1.1338386590000549, 1.1449377739649804, 1.1558837552554202, 1.1666513619251795, 1.1772173006912803, 1.1875602697275027, 1.1976609805681553, 1.2075021602929643, 1.2170685360879012, 1.2263468041867716, 1.2353255851021376, 1.2439953669560238, 1.2523484386230808, 1.260378814302036 ], [ 0.8953976613907695, 0.8929331582589278, 0.8910468396782593, 0.8897672832283894, 0.8891202907460773, 0.8891280485470011, 0.8898081855260849, 0.89117276304339, 0.8932272749278707, 0.8959698027488234, 0.8993905508354118, 0.9034720383924236, 0.9081901785363002, 0.913516254586489, 0.9194194381825056, 0.9258691769383534, 0.9328367725857647, 0.9402958369663581, 0.948221800284787, 0.9565909259743767, 0.9653792680332526, 0.9745618313166368, 0.9841120244221525, 0.994001393275167, 1.004199583139256, 1.0146744699872063, 1.0253924084998323, 1.036318553490417, 1.0474172208002217, 1.0586522618365597, 1.0699874328309302, 1.08138674560725, 1.0928147912214938, 1.1042370313576086, 1.1156200549767146, 1.1269317995779469, 1.1381417377008114, 1.1492210301261288, 1.1601426477365406, 1.1708814642742036, 1.1814143223552835, 1.1917200751215267, 1.2017796058665775, 1.2115758278949273, 1.2210936667719894, 1.2303200270159294, 1.239243745171982, 1.2478555311016124, 1.2561478992134845, 1.2641150912606334 ], [ 0.8977734913878087, 0.895417987855676, 0.8936461338266057, 0.8924866861669349, 0.8919655508438549, 0.8921048970147163, 0.892922147828694, 0.8944288752566067, 0.8966296744776838, 0.89952117418109, 0.9030914493814886, 0.9073201999097049, 0.9121800324715577, 0.9176389039285979, 0.9236632564373436, 0.9302209098527063, 0.9372827954746639, 0.9448231865216403, 0.9528187761883604, 0.9612472786079116, 0.9700861093053688, 0.979311413377798, 0.9888974860447394, 0.9988165260251599, 1.0090386375392866, 1.019532005172012, 1.030263181710693, 1.0411974433766318, 1.0522991781698012, 1.0635322819622886, 1.0748605441549568, 1.0862480104915921, 1.097659315172823, 1.1090599778677845, 1.1204166637437372, 1.1316974063986092, 1.1428717947594904, 1.153911125752433, 1.1647885249796328, 1.1754790378553108, 1.1859596937235755, 1.196209545461988, 1.2062096870003556, 1.2159432510796857, 1.2253953894579759, 1.234553237646919, 1.2434058661429814, 1.2519442199995736, 1.2601610484756587, 1.2680508263890442 ], [ 0.9008815347863884, 0.8986499127306925, 0.8970061176848021, 0.8959788659470214, 0.8955939450214949, 0.8958732941464046, 0.8968339461188126, 0.8984868505580847, 0.9008356471049661, 0.9038755465606111, 0.9075926168284303, 0.9119639209680014, 0.9169589753983229, 0.9225426617174972, 0.9286789917615375, 0.9353344796144643, 0.9424799662021381, 0.950090561052878, 0.9581442665801655, 0.9666201896284335, 0.9754969947553654, 0.9847518474828911, 0.9943598334669015, 1.0042937458535637, 1.0145241297051886, 1.0250194963469323, 1.0357466443503682, 1.0466710413562927, 1.0577572331899594, 1.0689692557915482, 1.080271032607866, 1.0916267457825268, 1.1030011739432284, 1.1143599927546182, 1.1256700368432129, 1.1368995233843222, 1.1480182387440774, 1.1589976902459107, 1.169811225505016, 1.1804341219424932, 1.1908436491245211, 1.201019106521813, 1.2109418391860396, 1.2205952337166197, 1.2299646967583726, 1.2390376181369789, 1.247803320610105, 1.256252998089164, 1.264379644070626, 1.2721779719054307 ], [ 0.9047154522233802, 0.902621765005339, 0.9011186427070874, 0.9002345108594906, 0.8999947801785976, 0.9004209066123016, 0.9015293053417575, 0.90333013369934, 0.9058260038460406, 0.9090107776452483, 0.9128687542399686, 0.9173747621505611, 0.9224957508899275, 0.9281941109641406, 0.9344319830676054, 0.9411749832885875, 0.9483940303073152, 0.9560650056772646, 0.9641670000698985, 0.9726802299233732, 0.9815843388415812, 0.99085729843581, 1.000474840860233, 1.0104102779465653, 1.0206345780207546, 1.0311166074413067, 1.0418234729310787, 1.052720919775132, 1.063773753334777, 1.0749462601959063, 1.0862026122056476, 1.0975072422228032, 1.108825184792777, 1.1201223782701626, 1.1313659272994119, 1.1425243261994977, 1.1535676448568815, 1.1644676793670892, 1.175198070003885, 1.1857343892332401, 1.1960542024979641, 1.2061371044284817, 1.2159647330203733, 1.2255207641832162, 1.234790888922333, 1.2437627752738456, 1.252426016978385, 1.260772070751681, 1.2687941838907792, 1.2764873138418797 ], [ 0.9092630949760394, 0.9073203545118068, 0.9059693569818292, 0.9052379701029756, 0.905150949504152, 0.9057289906436762, 0.9069876360406043, 0.90893605152323, 0.9115757283254244, 0.9148992572902348, 0.9188894864885878, 0.9235196054478998, 0.9287548294369914, 0.9345559805161803, 0.9408841145785596, 0.9477043816374092, 0.9549877844804486, 0.9627106594114665, 0.9708527201151975, 0.979394827877016, 0.9883172233215776, 0.9975984114176185, 1.0072146026998212, 1.0171395470517082, 1.0273446234445278, 1.0377990910168269, 1.0484704380890344, 1.0593247850344492, 1.0703273090735415, 1.081442667669665, 1.092635403985996, 1.1038703233666811, 1.115112834166492, 1.1263292495591255, 1.1374870493366638, 1.1485551023413487, 1.1595038512196105, 1.1703054618125257, 1.1809339398234717, 1.1913652175300509, 1.201577213305244, 1.2115498666326994, 1.2212651511782315, 1.2307070683367254, 1.239861623525292, 1.2487167873479494, 1.257262443618735, 1.2654903261002355, 1.2733939456931083, 1.2809685096979078 ], [ 0.9145067043286662, 0.9127267128673162, 0.9115380056349598, 0.9109676261505333, 0.9110393985446014, 0.9117729830165011, 0.9131827960085636, 0.9152768119667982, 0.9180553055621758, 0.9215096799163717, 0.925621688386913, 0.9303635890638657, 0.9356998974540984, 0.9415910025031948, 0.9479977542894996, 0.9548852264211736, 0.9622243893708704, 0.9699915679326938, 0.9781665049508133, 0.9867301540295694, 0.9956629205196144, 1.0049435449864872, 1.014548537211465, 1.0244520002798598, 1.034625709997375, 1.0450393561502627, 1.0556608828324492, 1.0664568839980229, 1.077393022276383, 1.088434447554059, 1.0995461985577355, 1.110693576182074, 1.1218424817017916, 1.1329597163561258, 1.1440132412169286, 1.154972397913756, 1.1658080918630689, 1.1764929402904243, 1.1870013876724437, 1.1973097913583262, 1.207396480132267, 1.217241788399599, 1.2268280685571016, 1.236139683964537, 1.2451629847855237, 1.253886268819384, 1.2622997293063523, 1.2703953915577937, 1.2781670401408542, 1.285610138232223 ], [ 0.9204232380681332, 0.918816465912649, 0.9177988548592672, 0.917396376464189, 0.9176316716103222, 0.9185231214180294, 0.9200837992950675, 0.9223203279634103, 0.9252317080921802, 0.9288082696129489, 0.9330310469772471, 0.9378720773455125, 0.9432961875190825, 0.9492644124759702, 0.9557382055709311, 0.9626829050067226, 0.9700693256531479, 0.9778733384508227, 0.9860741519405342, 0.9946522815189918, 1.0035878751763, 1.0128596115535695, 1.0224441138554892, 1.0323157427354483, 1.0424466443810874, 1.0528069641698938, 1.0633651639263872, 1.0740883986947711, 1.0849429205262118, 1.095894485194639, 1.1069087445074175, 1.117951612438978, 1.1289895977810955, 1.1399900994287093, 1.1509216629186347, 1.1617541985674058, 1.1724591626844656, 1.183009704023144, 1.1933807780035512, 1.2035492313999885, 1.2134938602051273, 1.223195443317922, 1.2326367545888604, 1.2418025556193368, 1.250679571567172, 1.2592564520668907, 1.267523719235851, 1.275473704607836, 1.2831004767142526, 1.2903997609183597 ], [ 0.9269848056737, 0.9255603134058863, 0.9247212159998369, 0.9244921990510141, 0.9248945117599492, 0.9259450661923428, 0.9276554400737067, 0.9300308164141946, 0.9330689373666299, 0.9367592300146339, 0.9410823894980841, 0.9460108432610194, 0.9515105081811748, 0.9575438532640318, 0.9640735475827114, 0.9710654949355285, 0.9784903245536064, 0.9863231756099735, 0.994542320212686, 1.0031274206618408, 1.012058009805081, 1.0213124317982507, 1.0308672374660386, 1.0406969355792863, 1.0507739958444375, 1.0610690215222474, 1.071551031710731, 1.0821878091987316, 1.0929462807966304, 1.1037929053330602, 1.114694051250317, 1.1256163513278166, 1.1365270265918908, 1.1473941749782322, 1.158187022902219, 1.1688761397099354, 1.1794336161920986, 1.189833209095987, 1.200050453996945, 1.2100627490915574, 1.21984941252725, 1.22939171584229, 1.2386728959951196, 1.2476781483387898, 1.2563946027611785, 1.2648112850753699, 1.2729190656120606, 1.2807105968397208, 1.288180241719102, 1.2953239943855634 ], [ 0.934159189323288, 0.9329245914196125, 0.9322700449312287, 0.9322187796916556, 0.9327904997458878, 0.9340005246114972, 0.9358588609936378, 0.9383692482316398, 0.9415282644958892, 0.945324651857433, 0.9497391142000462, 0.9547449158076488, 0.9603095390813017, 0.9663973255541631, 0.9729725191625362, 0.9800018233484047, 0.9874557607386351, 0.9953086681717548, 1.0035376961303213, 1.012121408595361, 1.021038472237193, 1.0302666773848117, 1.0397823329192295, 1.049559980051861, 1.059572346650947, 1.069790471877804, 1.0801839455206523, 1.0907212190870526, 1.1013699555213003, 1.1120973922560549, 1.1228706988738866, 1.133657316185369, 1.1444252680629003, 1.1551434409296184, 1.1657818284727974, 1.1763117410608543, 1.1867059806432347, 1.1969389827475334, 1.206986927684127, 1.2168278233267937, 1.2264415619357318, 1.2358099534844036, 1.2449167378840604, 1.253747578397204, 1.2622900384119162, 1.270533543624047, 1.278469331550012, 1.2860903901730067, 1.2933913874102396, 1.3003685929787332 ], [ 0.9419104243481047, 0.9408718893917636, 0.9404065884761128, 0.9405361751819903, 0.9412787138647192, 0.9426478760842865, 0.944652096688418, 0.9472937410180164, 0.9505683748704041, 0.9544642856246138, 0.9589624644195021, 0.9640372816789016, 0.9696579945576838, 0.9757909674927467, 0.9824021546349908, 0.9894592057440743, 0.9969326770822242, 1.0047961943404284, 1.0130257957531028, 1.0215988750937384, 1.0304931079753696, 1.039685588460971, 1.0491522512778673, 1.0588675642306902, 1.0688044404031234, 1.0789343151808157, 1.0892273396091277, 1.0996526501095076, 1.1101786824620288, 1.120773504904883, 1.1314051513081187, 1.1420419406665905, 1.1526527735805003, 1.1632073999352017, 1.1736766547037576, 1.184032660780027, 1.194248999136901, 1.2043008475252588, 1.2141650895033913, 1.2238203959120333, 1.2332472810637458, 1.242428135955517, 1.2513472407812598, 1.259990758946076, 1.268346714685896, 1.2764049562871675, 1.284157106788926, 1.2915965039382131, 1.2987181310609788, 1.3055185404049805 ], [ 0.9501994113527086, 0.9493616921571227, 0.9490890473013283, 0.9494014829579075, 0.9503153852527856, 0.9518427828132481, 0.9539905976137166, 0.9567599401770751, 0.9601455387459799, 0.9641354322506861, 0.9687110888448192, 0.9738481020222095, 0.9795175226168864, 0.9856876974077571, 0.9923262723479089, 0.999401909105677, 1.006885346121174, 1.0147496745452271, 1.0229699598981479, 1.0315224917020447, 1.0403839476021646, 1.0495306687078496, 1.0589381366430455, 1.0685806664237079, 1.078431290187124, 1.088461793337081, 1.0986428638972872, 1.1089443199135836, 1.1193353851712913, 1.129784989088275, 1.1402620719722638, 1.1507358816577165, 1.161176251703105, 1.1715538547550868, 1.1818404273746215, 1.1920089646392504, 1.2020338842881215, 1.2118911611745247, 1.2215584334420693, 1.2310150822366706, 1.2402422869817433, 1.249223058335299, 1.257942250957555, 1.2663865581761986, 1.2745444905643508, 1.282406340357464, 1.2899641335384158, 1.2972115713200028, 1.3041439626536329, 1.3107581492935438 ], [ 0.9589845338115921, 0.9583510193514353, 0.9582732270843403, 0.9587694896892891, 0.9598545243305152, 0.9615387685722694, 0.9638277299948503, 0.9667214059436097, 0.9702138552299366, 0.9742930284477082, 0.9789409743270249, 0.9841345141847748, 0.9898463951114717, 0.9960468005404187, 1.002704962841579, 1.009790560610588, 1.0172746405275799, 1.0251299587031264, 1.033330810991222, 1.0418525359708892, 1.0506708969307748, 1.0597615032799712, 1.0690993624352134, 1.078658594154472, 1.0884123022412098, 1.0983325805909399, 1.1083906245041255, 1.1185569182467245, 1.128801472669509, 1.1390940906625402, 1.1494046425125795, 1.1597033373931438, 1.1699609809705485, 1.1801492123031025, 1.1902407157939867, 1.2002094059564767, 1.2100305842318202, 1.2196810681544026, 1.229139293876636, 1.2383853935287508, 1.2474012491656565, 1.2561705251983954, 1.264678681263209, 1.2729129674771182, 1.2808624039869474, 1.2885177466534206, 1.295871440633274, 1.3029175635361898, 1.3096517597433703, 1.3160711673828513 ], [ 0.968222259416609, 0.9677950402871877, 0.9679131568755199, 0.968593280086868, 0.9698485040729248, 0.9716877584004409, 0.9741152542601226, 0.9771300178814708, 0.980725581651932, 0.984889916156142, 0.9896056841449917, 0.9948508674039007, 1.0005997520900065, 1.0068241671792382, 1.0134947867808934, 1.0205822726744354, 1.0280580732282347, 1.0358947955043185, 1.0440661835946752, 1.052546819907846, 1.0613116940693557, 1.0703357644531657, 1.0795935948846709, 1.0890591063668966, 1.0987054521793311, 1.108505005941933, 1.11842944320231, 1.1284498941728038, 1.138537145749596, 1.1486618732467477, 1.1587948854041528, 1.1689073695850356, 1.1789711272940837, 1.1889587930035173, 1.198844031668685, 1.2086017122280954, 1.218208055848417, 1.227640758754709, 1.236879090250797, 1.2459039670534597, 1.2546980053972647, 1.2632455525646202, 1.2715326995972172, 1.279547276979969, 1.2872788350789097, 1.2947186110750466, 1.301859484078082, 1.308695920033601, 1.3152239079595849, 1.3214408889656117 ], [ 0.977867709562092, 0.9776476499152285, 0.9779616626047003, 0.9788247975773791, 0.9802485969041804, 0.9822405819898578, 0.9848037894128654, 0.9879364028746311, 0.9916315392546589, 0.9958772510772887, 1.0006567988321007, 1.0059492177988265, 1.0117301538869963, 1.017972881054859, 1.0246493603300693, 1.0317311816357806, 1.039190257395592, 1.046999202725007, 1.0551314145778394, 1.0635609225240086, 1.0722621106390189, 1.0812094047582217, 1.0903769950135613, 1.099738634402951, 1.1092675293469605, 1.1189363210160181, 1.1287171461707015, 1.1385817615077785, 1.148501714227627, 1.1584485423612, 1.1683939903739529, 1.1783102280648652, 1.1881700633812424, 1.1979471422101748, 1.2076161303411417, 1.2171528745620004, 1.226534541252534, 1.2357397319089432, 1.2447485758195374, 1.2535428006694735, 1.26210578223172, 1.2704225745455526, 1.2784799221288714, 1.2862662558437359, 1.2937716740574308, 1.3009879107289501, 1.3079082920142302, 1.3145276829305996, 1.3208424255564917, 1.326850270170469 ], [ 0.9878751875326038, 0.9878619985635171, 0.9883708914152729, 0.9894153562787104, 0.9910054686073317, 0.9931474469606888, 0.9958432686013288, 0.9990903835058366, 1.0028815728234206, 1.007204996945019, 1.0120444669458153, 1.0173799481877337, 1.0231882674721082, 1.029443953085362, 1.03612010396565, 1.043189174036439, 1.0506235771783143, 1.0583960618513806, 1.0664798564980464, 1.0748486300089803, 1.0834763346446161, 1.0923370007580973, 1.1014045398438614, 1.1106525934593963, 1.1200544471562421, 1.1295830141337588, 1.1392108836678805, 1.1489104238457366, 1.1586539257082293, 1.1684137755711421, 1.1781626432671997, 1.1878736757336972, 1.1975206873448796, 1.2070783403726297, 1.216522310782424, 1.2258294361451765, 1.2349778437405647, 1.2439470579508767, 1.2527180868258492, 1.2612734882758445, 1.2695974167618662, 1.27767565163254, 1.2854956084404738, 1.293046334678738, 1.3003184914318275, 1.3073043224495915, 1.3139976121378165, 1.3203936339240372, 1.3264890904069304, 1.33228204663678 ], [ 0.9981986610093243, 0.9983909733479144, 0.9990927873732762, 1.0003161074376965, 1.0020696341516178, 1.0043583864034578, 1.0071833856618926, 1.0105414362838177, 1.0144250373935109, 1.0188224582386027, 1.023717997355613, 1.0290924253733962, 1.0349235838154465, 1.0411870836623507, 1.0478570263406572, 1.0549066643391727, 1.0623089322818684, 1.0700368084424439, 1.078063502048821, 1.086362492560135, 1.0949074659532179, 1.1036721980832556, 1.1126304293036864, 1.1217557627658805, 1.1310216057746554, 1.140401162188285, 1.1498674753555136, 1.159393515565798, 1.1689523029858022, 1.178517055938532, 1.1880613545549807, 1.1975593107970801, 1.2069857372352704, 1.2163163084919872, 1.2255277107534193, 1.2345977761002085, 1.243505599562182, 1.2522316377493647, 1.2607577886614716, 1.2690674528533403, 1.2771455765611386, 1.2849786777016317, 1.2925548558686946, 1.299863787589083, 1.3068967081808265, 1.3136463815958783, 1.3201070596349074, 1.3262744319042352, 1.3321455678488807, 1.3377188521463017 ], [ 1.0087921979510206, 1.0091876321627695, 1.0100795211944251, 1.011478464083954, 1.013391878916294, 1.0158236815817423, 1.0187740278432424, 1.022239146024158, 1.0262112872565619, 1.0306788153646511, 1.03562644788227, 1.0410356434040846, 1.0468851104341084, 1.0531513933169125, 1.0598094772017328, 1.06683335106563, 1.0741964774096175, 1.0818721370089404, 1.0898336413548302, 1.0980544275061903, 1.106508064986079, 1.1151682102857208, 1.1240085426409288, 1.1330027078530134, 1.1421242880590463, 1.1513468067864903, 1.1606437716150406, 1.169988751742189, 1.1793554846202396, 1.1887180042708037, 1.1980507834889176, 1.2073288825455217, 1.216528097868776, 1.2256251052881406, 1.2345975935880291, 1.2434243852280225, 1.2520855420800234, 1.2605624548804242, 1.268837915791986, 1.2768961740242903, 1.2847229748897082, 1.2923055829924663, 1.29963279048062, 1.3066949114513764, 1.3134837637042343, 1.3199926390959436, 1.3262162637762158, 1.3321507495813125, 1.3377935378402181, 1.3431433368098593 ], [ 1.019610356843208, 1.0202055924185809, 1.021283876894508, 1.0228544866792337, 1.0249236466081153, 1.0274942578503745, 1.0305656877072606, 1.0341336430471568, 1.0381901475029653, 1.0427236374390023, 1.0477191825678518, 1.0531588243792693, 1.0590220109418056, 1.065286093101866, 1.071926838130755, 1.0789189152931193, 1.0862363145689522, 1.093852673318766, 1.1017415025008603, 1.1098763199308677, 1.1182307096709398, 1.1267783324047331, 1.1354929119083923, 1.1443482190058174, 1.1533180686142313, 1.162376339292832, 1.1714970191955807, 1.180654278034832, 1.1898225617096572, 1.1989767045194604, 1.2080920531357702, 1.2171445964805028, 1.22611109611459, 1.234969212475229, 1.243697623159312, 1.2522761303271543, 1.2606857551255737, 1.2689088177632941, 1.276929002498895, 1.2847314073186031, 1.2923025784954572, 1.2996305305432905, 1.3067047523216182, 1.3135162002233631, 1.320057279498422, 1.3263218148425762, 1.3323050114220316, 1.3380034075161082, 1.3434148199505114, 1.3485382834657773 ], [ 1.030608533153498, 1.0313993768835636, 1.0326595976884174, 1.0343972312313419, 1.0366173934418095, 1.0393220503788951, 1.0425098470177223, 1.0461760120761916, 1.0503123537822723, 1.0549073566274867, 1.0599463815366064, 1.0654119620549352, 1.071284178477364, 1.0775410823647407, 1.0841591378585314, 1.0911136453249317, 1.098379117625891, 1.105929588707255, 1.1137388459760253, 1.121780589422721, 1.1300285293763284, 1.1384564399371984, 1.1470381864518209, 1.1557477436674195, 1.1645592176143973, 1.1734468799571611, 1.1823852193945992, 1.1913490111998262, 1.200313403383572, 1.2092540162558558, 1.2181470512350556, 1.2269694044476116, 1.2356987808028745, 1.2443138046593694, 1.252794123793577, 1.2611205040433113, 1.2692749126575742, 1.277240589000552, 1.2850021018046638, 1.292545392636178, 1.299857805625361, 1.3069281038253386, 1.3137464728076318, 1.3203045122855612, 1.3265952166887531, 1.3326129457006959, 1.3383533858242822, 1.3438135040641712, 1.348991494815091, 1.353886721026653 ], [ 1.041743264033543, 1.0427247187023065, 1.0441616927265223, 1.0460610603340899, 1.0484269072480685, 1.051260336022027, 1.0545593264652453, 1.0583186645412868, 1.0625299507191601, 1.0671816944048558, 1.0722594948520445, 1.0777463013830075, 1.0836227378900203, 1.0898674698494468, 1.0964575879207676, 1.1033689816708265, 1.1105766803182466, 1.1180551439532773, 1.1257784970168696, 1.1337207041750377, 1.1418556955710146, 1.1501574528473788, 1.1586000690899687, 1.1671577953327592, 1.1758050841845575, 1.1845166382636425, 1.1932674681044624, 1.2020329614764353, 1.2107889638715625, 1.2195118683538941, 1.2281787119920855, 1.236767275627048, 1.2452561836479867, 1.2536250006487162, 1.261854322212339, 1.2699258575447931, 1.277822502185192, 1.2855283995206284, 1.2930289902970826, 1.3003110497305204, 1.3073627121762625, 1.3141734836082632, 1.3207342423963948, 1.3270372290533674, 1.3330760257595677, 1.338845526570185, 1.344341899270384, 1.3495625398767628, 1.3545060207919317, 1.3591720336082238 ], [ 1.052972493226572, 1.0541388272963241, 1.0557467057105423, 1.0578019170832154, 1.0603075900105188, 1.0632640282286743, 1.0666685966531677, 1.0705156687340265, 1.0747966432090432, 1.079500034565011, 1.0846116364801215, 1.0901147516892946, 1.0959904758728818, 1.1022180182971522, 1.108775038986129, 1.115637981835351, 1.1227823854264452, 1.1301831579103905, 1.137814808260288, 1.1456516323030284, 1.1536678571794408, 1.1618377515560288, 1.1701357107704933, 1.17853632628658, 1.1870144477697016, 1.195545244274353, 1.2041042689233687, 1.2126675294137057, 1.2212115649302546, 1.2297135286970635, 1.2381512744663932, 1.2465034447050025, 1.2547495580193024, 1.2628700933912729, 1.2708465690020632, 1.2786616137354792, 1.2862990298272736, 1.2937438455179948, 1.300982356949309, 1.3080021588971016, 1.3147921642481517, 1.3213426123957215, 1.3276450669515252, 1.3336924033487292, 1.339478787046515, 1.3449996431451987, 1.3502516182866766, 1.3552325357531545, 1.3599413446913582, 1.3643780643848076 ], [ 1.0642557979983711, 1.06560061659161, 1.0673729461786012, 1.0695775617569234, 1.0722167026814995, 1.0752899328407195, 1.078794047455999, 1.0827230346451173, 1.087068097712429, 1.0918177409268346, 1.0969579174971753, 1.1024722339441262, 1.1083422006774395, 1.1145475149987178, 1.1210663605952025, 1.1278757072889258, 1.134951596432903, 1.1422694005944647, 1.149804050417838, 1.1575302260493712, 1.1654225145194275, 1.1734555374897215, 1.181604055555862, 1.1898430558730744, 1.1981478294712198, 1.2064940435596792, 1.2148578127164158, 1.2232157713793073, 1.2315451487046125, 1.23982384574084, 1.2480305140346166, 1.2561446342379656, 1.2641465929946336, 1.2720177563012969, 1.2797405376180104, 1.2872984591931136, 1.2946762053289407, 1.3018596666113302, 1.3088359744314149, 1.3155935254227957, 1.3221219957080323, 1.3284123450868948, 1.3344568115016933, 1.3402488962804748, 1.345783340788913, 1.3510560952180688, 1.3560642803018748, 1.36080614279851, 1.365281005587819, 1.3694892132360588 ], [ 1.0755545798211643, 1.0770708969262073, 1.0790006842650874, 1.0813477714083686, 1.0841135717592674, 1.0872969637298495, 1.0908942144351905, 1.0948989522776746, 1.0993021928458564, 1.1040924198668454, 1.1092557196974167, 1.1147759643277757, 1.1206350345303904, 1.1268130720899039, 1.1332887484256238, 1.140039536638148, 1.1470419751205763, 1.1542719131642656, 1.1617047320498948, 1.1693155384306404, 1.1770793298881643, 1.184971134992721, 1.1929661318200944, 1.201039749641424, 1.209167758518609, 1.2173263509997538, 1.22549221923275, 1.2336426297981502, 1.2417554975598617, 1.249809458948465, 1.257783944385086, 1.2656592490446261, 1.2734166008398335, 1.2810382243601057, 1.2885073994905936, 1.295808513534245, 1.3029271058302925, 1.3098499040785245, 1.3165648518155197, 1.3230611267283074, 1.3293291497184812, 1.3353605848365027, 1.3411483303854375, 1.3466865016435006, 1.3519704057744522, 1.3569965095855963, 1.3617624008571168, 1.366266744006028, 1.3705092308673021, 1.3744905273758814 ], [ 1.0868322205388181, 1.0885125320515618, 1.0905923099482335, 1.0930745029580224, 1.0959597578509603, 1.099246318289696, 1.1029299623592421, 1.1070039837915513, 1.111459220195829, 1.116284129368884, 1.1214649121418585, 1.126985677464712, 1.132828642851097, 1.138974361238913, 1.1454019640579534, 1.152089410017328, 1.1590137298600605, 1.166151258940606, 1.1734778516885958, 1.1809690744791232, 1.1886003757888945, 1.1963472344986734, 1.2041852886339421, 1.2120904476637842, 1.2200389917468344, 1.2280076611341073, 1.2359737384504876, 1.2439151259197652, 1.2518104188901231, 1.2596389763478215, 1.2673809885342002, 1.2750175413360687, 1.2825306768114126, 1.2899034490350283, 1.2971199743861719, 1.3041654754314778, 1.3110263176581483, 1.3176900384623875, 1.3241453679758661, 1.330382241502119, 1.3363918035209958, 1.342166403393305, 1.3476995830524319, 1.3529860571011143, 1.358021685838221, 1.362803441821923, 1.3673293706339857, 1.3715985465464118, 1.3756110238095838, 1.3793677842826604 ], [ 1.0980542058202778, 1.0998905628091153, 1.1021124581135004, 1.1047220208861452, 1.1077191871822398, 1.1111016137534233, 1.1148646269978055, 1.1190012110461056, 1.1235020374896856, 1.1283555373984364, 1.1335480141626069, 1.139063793510727, 1.1448854050371415, 1.1509937879555592, 1.1573685127818771, 1.1639880103656028, 1.1708298001539936, 1.177870710693429, 1.1850870869643562, 1.1924549809699905, 1.1999503238117524, 1.2075490790798997, 1.215227378627245, 1.2229616426154257, 1.2307286861335527, 1.2385058147465033, 1.2462709111205066, 1.2540025144913876, 1.2616798942734353, 1.2692831186260993, 1.2767931183545047, 1.2841917461523666, 1.291461830919574, 1.2985872267061274, 1.305552855743974, 1.312344745016678, 1.3189500558688698, 1.3253571062558902, 1.331555385363223, 1.3375355604702146, 1.343289476080872, 1.3488101454868424, 1.3540917350565909, 1.3591295416560158, 1.3639199636969686, 1.3684604663802993, 1.3727495417501987, 1.3767866642079556, 1.3805722421477769, 1.384107566377641 ], [ 1.1091882178389254, 1.1111722992875217, 1.1135281011133642, 1.1162569911304527, 1.119358247675804, 1.1228289861035652, 1.126664117245269, 1.1308563410225918, 1.1353961771345862, 1.140272033198782, 1.1454703090092317, 1.1509755338294807, 1.1567705320354251, 1.1628366111331174, 1.1691537653428667, 1.1757008876517905, 1.1824559835072896, 1.1893963800932903, 1.1964989262743844, 1.2037401796476312, 1.2110965785349597, 1.218544598030508, 1.2260608902758463, 1.2336224099113013, 1.2412065261302216, 1.2487911229697244, 1.256354689455978, 1.263876401044971, 1.2713361935232546, 1.2787148302126825, 1.2859939630035115, 1.2931561874546091, 1.3001850919686668, 1.3070653008850994, 1.3137825112354051, 1.320323522870675, 1.326676261689404, 1.3328297957544457, 1.3387743441779647, 1.3445012787610722, 1.350003118489224, 1.3552735170969747, 1.3603072440194004, 1.365100159137971, 1.3696491818029473, 1.3739522546715706, 1.3780083029415473, 1.3818171895835087, 1.3853796671858143, 1.388697327022619 ], [ 1.120204199268311, 1.122327383501606, 1.1248086108422162, 1.1276485432424561, 1.1308458517714184, 1.1343971539684778, 1.1382969802959528, 1.1425377722672885, 1.1471099137474259, 1.1520017956386364, 1.1571999127629538, 1.1626889903422213, 1.168452136185797, 1.174471013648399, 1.1807260297190485, 1.1871965323103972, 1.1938610109489671, 1.2006972955820598, 1.2076827490322386, 1.21479444963373, 1.2220093616550878, 1.229304492138336, 1.2366570336797165, 1.2440444933855825, 1.2514448087365304, 1.2588364513876662, 1.266198520048261, 1.2735108235568338, 1.280753955139651, 1.2879093586527923, 1.294959387396509, 1.3018873558848951, 1.3086775847754144, 1.3153154390248576, 1.3217873592473275, 1.328080886205935, 1.334184678368743, 1.3400885224936765, 1.3457833372675758, 1.3512611701018267, 1.3565151872721675, 1.3615396576758094, 1.3663299305588454, 1.3708824076365735, 1.3751945100865741, 1.3792646409374265, 1.3830921434049457, 1.3866772557437397, 1.3900210631853023, 1.3931254475272874 ], [ 1.1310743908320802, 1.1333278248485794, 1.1359257926347104, 1.138868303219356, 1.142153468584668, 1.145777450362183, 1.1497344330621735, 1.1540166259409679, 1.1586142946903775, 1.1635158230624831, 1.1687078033893046, 1.1741751538060539, 1.1799012589331126, 1.185868129907203, 1.192056579051147, 1.1984464041814136, 1.2050165775852002, 1.2117454350296508, 1.2186108607392034, 1.2255904650161304, 1.232661751998658, 1.2398022758692258, 1.2469897845751303, 1.2542023507569777, 1.2614184900706706, 1.268617267429384, 1.2757783918918464, 1.2828823010025014, 1.2899102353741723, 1.2968443042235176, 1.3036675424514637, 1.310363959729815, 1.3169185819308213, 1.3233174851328824, 1.3295478223613706, 1.3355978431818727, 1.3414569062532904, 1.3471154849656968, 1.3525651663269191, 1.3577986433149332, 1.3628097009739017, 1.3675931965933485, 1.3721450343676818, 1.3764621349834552, 1.380542400621457, 1.384384675889634, 1.3879887052199156, 1.3913550872684821, 1.3944852268556303, 1.3973812849694562 ], [ 1.141773344767528, 1.1441480107681488, 1.14685389351787, 1.1498903996950929, 1.1532551282992958, 1.15694382543273, 1.1609503633226197, 1.1652667453211227, 1.1698831378351016, 1.1747879292404744, 1.1799678148799575, 1.1854079062944336, 1.1910918619680295, 1.1970020361430118, 1.2031196417384216, 1.2094249231214427, 1.2158973344438633, 1.2225157194531577, 1.2292584890817542, 1.236103793657027, 1.2430296871979856, 1.2500142819137294, 1.2570358916414375, 1.2640731635177163, 1.2711051976406125, 1.278111654837085, 1.2850728529016673, 1.2919698518247182, 1.2987845285980015, 1.3054996421902187, 1.312098889246083, 1.3185669509985578, 1.3248895318121727, 1.3310533897093988, 1.3370463591805812, 1.3428573665466401, 1.3484764381330911, 1.3538947015229545, 1.3591043801805185, 1.3640987817730603, 1.3688722805582674, 1.373420294246394, 1.3777392557842418, 1.381826580539614, 1.3856806293885855, 1.3893006682221392, 1.3926868243940371, 1.3958400406283875, 1.3987620268942602, 1.4014552107371832 ], [ 1.152277916644723, 1.1547646951485835, 1.1575695874932208, 1.1606914463425575, 1.164127401865845, 1.1678728235551898, 1.1719213042348298, 1.1762646677101927, 1.1808930008342347, 1.1857947100130342, 1.1909566013751731, 1.1963639830402064, 1.2020007871950875, 1.2078497090739522, 1.2138923594781783, 1.2201094271972959, 1.2264808476071307, 1.2329859738217506, 1.2396037470363839, 1.2463128630846934, 1.2530919327035028, 1.2599196335089533, 1.2667748522005695, 1.273636815991337, 1.2804852126881514, 1.2873002992024931, 1.2940629985492478, 1.300754985592469, 1.3073587619276457, 1.3138577203615458, 1.320236199476645, 1.326479528762187, 1.3325740647713356, 1.3385072187358786, 1.3442674760448545, 1.349844407977121, 1.3552286760730756, 1.3604120295370303, 1.3653872960776086, 1.3701483666155685, 1.3746901743135442, 1.379008668406267, 1.3831007833307585, 1.3869644036710282, 1.390598325439929, 1.3940022142216826, 1.3971765606918496, 1.4001226340183628, 1.4028424336281706, 1.405338639800397 ], [ 1.16256723801973, 1.1651569670761763, 1.168051940594617, 1.1712505034144391, 1.1747493591494724, 1.1785435381572043, 1.1826263858665174, 1.1869895726819777, 1.1916231261087755, 1.196515485103359, 1.201653575984631, 1.2070229085790327, 1.2126076906599896, 1.2183909582175696, 1.2243547186883714, 1.2304801040104465, 1.2367475302520905, 1.24313686059342, 1.2496275686005116, 1.2561988990008968, 1.2628300235174923, 1.269500189715638, 1.2761888612355277, 1.2828758481939966, 1.2895414269240915, 1.2961664485622297, 1.3027324362809434, 1.3092216711960596, 1.3156172671510078, 1.3219032347033965, 1.3280645347177, 1.334087122013205, 1.3399579795383896, 1.345665143551183, 1.3511977202869092, 1.3565458945976065, 1.3617009310511428, 1.366655167986993, 1.3714020050374796, 1.3759358846367384, 1.3802522680526708, 1.3843476064878142, 1.3882193078009473, 1.391865699401963, 1.3952859878666617, 1.398480215806202, 1.401449216508115, 1.4041945668428237, 1.4067185389027947, 1.4090240508114382 ], [ 1.1726226723894586, 1.1753062025215435, 1.1782823584655613, 1.1815490213424513, 1.1851025086469371, 1.1889375476170285, 1.193047267318042, 1.1974232104744527, 1.2020553655900168, 1.2069322193534402, 1.2120408287603965, 1.2173669118233543, 1.2228949552201083, 1.2286083367789749, 1.2344894603376986, 1.2405199002606009, 1.2466805527623193, 1.2529517911660195, 1.2593136223102133, 1.265745841496964, 1.2722281836260885, 1.2787404684646513, 1.2852627383371682, 1.291775386869595, 1.2982592777615776, 1.3046958528812669, 1.311067229264177, 1.3173562848443339, 1.323546732949203, 1.329623185749975, 1.335571206979536, 1.3413773543178595, 1.3470292119055507, 1.352515413488339, 1.357825656724553, 1.3629507092089042, 1.3678824067828554, 1.3726136447157224, 1.3771383623522044, 1.3814515218304853, 1.3855490814797, 1.3894279645052536, 1.3930860235645375, 1.3965220018235387, 1.3997354910668782, 1.402726887410293, 1.4054973451363035, 1.4080487291418664, 1.4103835664522464, 1.412504997219156 ], [ 1.182427756858872, 1.1851960014978362, 1.1882445191343831, 1.1915707692356665, 1.1951707217925707, 1.1990388354450836, 1.2031680528441304, 1.2075498141331134, 1.2121740890078097, 1.2170294273495121, 1.222103027944427, 1.227380824326624, 1.2328475863359858, 1.2384870355893811, 1.244281972740684, 1.2502144141664786, 1.2562657355662732, 1.262416819909358, 1.2686482071909502, 1.2749402435687904, 1.2812732276266834, 1.2876275517395783, 1.2939838367814795, 1.3003230587074563, 1.3066266658402628, 1.3128766859865286, 1.3190558227859208, 1.3251475409495876, 1.331136140265913, 1.3370068184387698, 1.3427457229768156, 1.3483399924740993, 1.3537777877168646, 1.3590483131234752, 1.364141829079085, 1.3690496557674208, 1.373764169132371, 1.3782787896236262, 1.3825879643944061, 1.386687143625709, 1.3905727516505915, 1.394242153543683, 1.3976936178254689, 1.4009262759085515, 1.4039400788845082, 1.4067357522163095, 1.4093147488636775, 1.41167920132846, 1.4138318730652981, 1.415776109660788 ], [ 1.191968131834192, 1.194812113120341, 1.1979242935471395, 1.2013017509816148, 1.2049401447113426, 1.2088336977682914, 1.212975195156694, 1.2173559987449107, 1.221966079214509, 1.22679406506185, 1.2318273082355637, 1.237051965586012, 1.2424530949188464, 1.248014764101217, 1.2537201713799164, 1.2595517748461627, 1.2654914288276222, 1.2715205249061245, 1.2776201352482812, 1.2837711559906246, 1.2899544485350498, 1.2961509767758075, 1.30234193848688, 1.3085088893375518, 1.3146338582631982, 1.320699453185883, 1.3266889563442144, 1.3325864087440131, 1.3383766834730115, 1.3440455478286741, 1.3495797143858843, 1.3549668812805133, 1.3601957621072644, 1.3652561059286983, 1.3701387079697556, 1.3748354116316719, 1.3793391025031423, 1.3836436950769626, 1.3877441128983732, 1.391636262877911, 1.395317004497544, 1.3987841146248237, 1.4020362486269637, 1.4050728984458503, 1.4078943482578372, 1.4105016282997629, 1.4128964673968827, 1.4150812446806327, 1.4170589409359298, 1.4188330899699164 ], [ 1.2012314609241508, 1.2041423508528963, 1.2073096562571166, 1.2107301114714555, 1.2143991000691126, 1.2183106408986095, 1.22245738881993, 1.2268306507980822, 1.231420417694069, 1.2362154117505808, 1.24120314941566, 1.246370018797156, 1.2517013707081168, 1.2571816219615455, 1.2627943693129484, 1.2685225122384376, 1.2743483825800244, 1.2802538789903903, 1.2862206040667343, 1.2922300020761521, 1.2982634952405017, 1.3043026166630494, 1.3103291381367772, 1.3163251912686795, 1.3222733805766769, 1.3281568874562864, 1.333959564162774, 1.3396660172008041, 1.345261679748941, 1.3507328729639663, 1.3560668562051101, 1.3612518663886712, 1.366277146828653, 1.3711329660395468, 1.3758106270752086, 1.3803024680542828, 1.3846018545800252, 1.388703164801963, 1.3926017678903593, 1.3962939967027286, 1.3997771154166152, 1.403049282885212, 1.4061095124442489, 1.4089576288614096, 1.4115942230752077, 1.4140206053208624, 1.4162387571879627, 1.4182512831005498, 1.4200613616561881, 1.4216726972079266 ], [ 1.2102073430733151, 1.2131765000530372, 1.2163905884777773, 1.2198460352560527, 1.223537981429867, 1.2274602714985334, 1.2316054563501004, 1.235964810373154, 1.240528363045457, 1.245284944999271, 1.2502222482577052, 1.2553269000331952, 1.2605845491896013, 1.2659799642032143, 1.271497141223328, 1.2771194206360528, 1.2828296103798549, 1.2886101141501132, 1.294443062564671, 1.3003104453430605, 1.306194242579275, 1.31207655326057, 1.3179397193010245, 1.3237664435139807, 1.3295399001367119, 1.3352438367350734, 1.3408626665467052, 1.3463815505584287, 1.3517864688479133, 1.357064280943277, 1.3622027751611618, 1.3671907070698575, 1.3720178273867634, 1.376674899758401, 1.381153708985872, 1.3854470603507205, 1.3895487707655374, 1.3934536525228511, 1.39715749044513, 1.4006570132503289, 1.4039498599425757, 1.4070345420183197, 1.4099104022466762, 1.4125775707408912, 1.4150369189882699, 1.4172900124508447, 1.4193390622907278, 1.421186876714573, 1.4228368123725696, 1.4242927261904381 ], [ 1.2188872187744864, 1.2219062197343125, 1.2251589754928442, 1.2286416397047986, 1.2323491422703023, 1.2362751815705837, 1.2404122293191804, 1.2447515485300038, 1.2492832248624481, 1.2539962113462744, 1.258878386224013, 1.2639166233851005, 1.2690968746124203, 1.2744042626259817, 1.2798231836960943, 1.2853374184143629, 1.290930249058289, 1.296584581867006, 1.3022830724637218, 1.3080082526170036, 1.313742656530199, 1.319468944887538, 1.3251700249671372, 1.3308291652535778, 1.3364301031422885, 1.3419571445178327, 1.3473952542009147, 1.3527301364845559, 1.357948305209807, 1.3630371430565407, 1.367984949938658, 1.3727809805897155, 1.3774154716010238, 1.38187965832741, 1.3861657822047981, 1.3902670891286137, 1.3941778196227759, 1.3978931915867359, 1.4014093764438347, 1.4047234695295197, 1.4078334555548135, 1.4107381699609056, 1.4134372569472344, 1.4159311249107187, 1.418220899980509, 1.4203083782733192, 1.4221959774318493, 1.4238866879449452, 1.42538402468516, 1.4266919790387684 ], [ 1.2272642720190823, 1.2303249402593226, 1.233608500193791, 1.237110864494412, 1.2408267815350529, 1.244749830207081, 1.2488724264470672, 1.2531858419176145, 1.2576802350710887, 1.2623446946019097, 1.2671672950619544, 1.2721351641836436, 1.2772345612321663, 1.2824509654980536, 1.2877691738485293, 1.2931734060839595, 1.2986474166973077, 1.3041746115122945, 1.3097381675824025, 1.3153211546716235, 1.3209066566118344, 1.3264778908444705, 1.33201832450774, 1.337511785525169, 1.3429425672847626, 1.3482955256655713, 1.3535561673629783, 1.3587107286771505, 1.3637462441517503, 1.3686506046733093, 1.373412604858274, 1.3780219797579516, 1.3824694310967753, 1.3867466434231832, 1.3908462906925405, 1.3947620339171265, 1.39848851060848, 1.402021316803244, 1.4053569825054764, 1.4084929413980452, 1.4114274956750537, 1.4141597768285437, 1.4166897031888706, 1.4190179349718983, 1.4211458275305144, 1.4230753834460421, 1.4248092040292972, 1.4263504407341787, 1.4277027469204882, 1.4288702303391798 ], [ 1.235333329452164, 1.2384277584690295, 1.2417345342892396, 1.2452493590105254, 1.2489668273513155, 1.2528804237515234, 1.2569825303613593, 1.2612644463076323, 1.2657164184419123, 1.270327683578581, 1.2750865220288135, 1.2799803220345276, 1.284995654508938, 1.2901183573022883, 1.295333628035303, 1.300626124382181, 1.3059800705412166, 1.311379368507494, 1.3168077126610622, 1.3222487061097294, 1.3276859771824305, 1.3331032944612256, 1.3384846787709161, 1.3438145106166632, 1.3490776316709698, 1.3542594390583855, 1.3593459713636853, 1.3643239854888232, 1.3691810236977118, 1.373905470406568, 1.3784865984935544, 1.38291460510766, 1.3871806371475772, 1.391276806752587, 1.3951961972959503, 1.3989328604953324, 1.4024818053530725, 1.4058389797119777, 1.4090012452599265, 1.4119663468407049, 1.4147328769308607, 1.4173002361255678, 1.4196685904431812, 1.4218388262118407, 1.4238125032447695, 1.4255918069474467, 1.427179499932186, 1.4285788736465768, 1.4297937004539536, 1.4308281865383088 ], [ 1.2430907580091317, 1.2462113315497603, 1.2495340285112306, 1.2530543690087022, 1.2567668202685371, 1.2606647957524884, 1.264740664416463, 1.26898577044955, 1.2733904636758755, 1.2779441406294345, 1.282635296134618, 1.2874515850465522, 1.2923798936302098, 1.2974064198875777, 1.3025167619812712, 1.3076960137523033, 1.3129288661915135, 1.3181997136007482, 1.3234927630745537, 1.32879214585004, 1.3340820290168536, 1.3393467260556566, 1.3445708046865954, 1.3497391905615792, 1.3548372654259542, 1.359850958503889, 1.364766830022763, 1.3695721459778554, 1.3742549434421205, 1.3788040859376713, 1.3832093085984858, 1.3874612530599015, 1.3915514922037473, 1.3954725450637275, 1.3992178823498247, 1.4027819231807308, 1.4061600237180882, 1.409348458474926, 1.4123443951237233, 1.4151458636579655, 1.417751720766873, 1.4201616102686987, 1.4223759204163209, 1.424395738843328, 1.4262228058622524, 1.427859466762774, 1.4293086236892336, 1.4305736876065924, 1.4316585307943939, 1.4325674402410349 ] ], "zauto": true, "zmax": 1.4325674402410349, "zmin": -1.4325674402410349 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.05067391933642303, 0.047501972336771274, 0.04451003632120367, 0.041728623818441404, 0.03919051771292864, 0.03693022691647322, 0.03498279798037355, 0.033381766466369915, 0.03215620248238813, 0.03132716996412796, 0.030904387273297515, 0.030884161426558004, 0.031249444889726478, 0.03197211200364386, 0.03301670324284383, 0.03434447872090728, 0.03591681767654756, 0.03769752037711279, 0.039654041319825306, 0.04175792674745706, 0.043984766704457855, 0.04631390212371964, 0.04872803487007339, 0.0512128151068717, 0.05375643572726516, 0.05634924265631741, 0.05898336345693184, 0.06165235705178896, 0.06435088946434228, 0.06707444176533423, 0.06981905611280068, 0.07258112409164208, 0.07535721908603639, 0.0781439717813511, 0.08093798557415897, 0.08373578695166767, 0.08653380488330939, 0.08932837290958973, 0.09211574779741681, 0.09489213920387439, 0.09765374559866052, 0.10039679260672608, 0.10311757084480924, 0.10581247116809758, 0.10847801597434399, 0.11111088581347583, 0.11370794101913943, 0.11626623842373868, 0.1187830434560155, 0.12125583806836188 ], [ 0.04821131209012936, 0.0449573410374768, 0.041882422719081984, 0.03901688259528011, 0.036393566132858636, 0.034047520201027304, 0.03201504135230089, 0.030331770672253483, 0.029029640331284155, 0.02813287593890249, 0.027653894684484016, 0.02759046574295473, 0.027925382596474965, 0.028628952129524685, 0.029663391873574887, 0.03098760314100388, 0.032561057366739206, 0.034346273225937335, 0.036309999782530085, 0.03842350746300059, 0.040662390085040016, 0.043006159120698315, 0.045437782026176425, 0.04794322671889608, 0.050511027592510284, 0.053131871890966194, 0.05579820445606215, 0.05850385347786883, 0.06124368419280461, 0.0640132892565434, 0.06680872362346996, 0.06962628900990733, 0.07246236945560128, 0.07531331601741287, 0.07817537581243536, 0.08104465874418103, 0.08391713432034177, 0.08678865087318322, 0.08965497001776465, 0.09251181010763146, 0.09535489357388165, 0.09817999420448856, 0.10098298152598377, 0.1037598604212151, 0.1065068049220386, 0.10922018574721644, 0.11189659162332025, 0.11453284474975854, 0.11712601097243958, 0.11967340533899085 ], [ 0.04588341076954048, 0.042554386282633985, 0.03940387785556501, 0.03646177926861398, 0.033760608034552005, 0.03133542016967998, 0.029223155893708632, 0.027461002196022488, 0.026083399273375368, 0.02511769824042911, 0.02457927197828289, 0.024467736111476113, 0.02476605388359929, 0.025443176921072258, 0.026459165948362198, 0.027770778559815117, 0.02933587188335041, 0.031116015572766425, 0.033077563644273764, 0.03519175572656646, 0.03743435619322785, 0.039785145579206295, 0.042227406788642695, 0.044747445455351344, 0.047334140350665646, 0.04997851192686706, 0.05267330431762158, 0.05541258573131221, 0.058191378396838196, 0.0610053307169327, 0.06385044196357745, 0.06672284538251695, 0.06961865054233603, 0.07253384130042671, 0.07546422247757605, 0.07840540641655316, 0.08135282993645437, 0.08430179251637637, 0.08724750753197215, 0.0901851597288449, 0.09310996360590743, 0.0960172188258059, 0.09890236005897772, 0.1017609997467618, 0.10458896312049012, 0.10738231544730725, 0.11013738191432951, 0.11285076084275193, 0.11551933107592839, 0.11814025444183811 ], [ 0.04369145874718245, 0.04029404916260861, 0.03707531883027767, 0.03406459534566318, 0.031293767700611666, 0.028797405867313837, 0.026612425272882243, 0.024776820222234108, 0.023326913801747104, 0.02229286114540493, 0.02169304053927036, 0.02152921459817921, 0.021784867144608287, 0.022427898366446195, 0.023416517553737765, 0.024705720481548232, 0.026252205381908388, 0.028017049030274188, 0.029966589193978082, 0.03207229668451146, 0.034310254841099994, 0.03666057629408042, 0.039106870441241434, 0.041635765928473234, 0.04423646044692599, 0.04690027661375476, 0.04962022030771492, 0.05239055252846614, 0.05520639293050296, 0.05806337305428465, 0.060957352396536726, 0.06388420354111742, 0.06683966572998298, 0.0698192607725314, 0.07281826159781901, 0.07583170203438691, 0.07885441623185976, 0.08188109706887772, 0.08490636447752277, 0.08792483648229081, 0.09093119762754369, 0.09392026117487431, 0.09688702289651062, 0.09982670543928111, 0.10273479309307455, 0.1056070573992223, 0.10843957441991596, 0.11122873470456933, 0.11397124707504244, 0.11666413734579517 ], [ 0.04163631456740605, 0.03817644696207736, 0.03489632912797556, 0.031824735802397565, 0.028992781316774238, 0.02643417647121857, 0.02418517615761634, 0.022283730116686353, 0.020767142952724523, 0.01966767389314837, 0.019006400883546024, 0.01878731368695021, 0.01899471778333115, 0.019595862629846375, 0.020547611832864156, 0.021803828066593117, 0.023320732360763752, 0.025059519617889374, 0.026986958510732108, 0.029075010969652287, 0.031300184632754004, 0.03364293007886621, 0.036087140143003335, 0.03861970791327927, 0.041230091208268184, 0.04390985807525112, 0.04665221721592595, 0.04945155581833108, 0.05230301310563398, 0.05520211418256823, 0.05814447992505457, 0.06112561854764517, 0.06414079562832588, 0.06718497301180747, 0.07025280341045441, 0.07333866633360239, 0.07643673158307943, 0.07954103829173496, 0.08264557977632203, 0.08574438689261224, 0.08883160483411053, 0.09190156024817646, 0.09494881709188187, 0.09796822081551489, 0.10095493128227134, 0.10390444536415293, 0.10681261045649634, 0.10967563028388333, 0.11249006437776948, 0.11525282253181232 ], [ 0.03971932404814489, 0.03620178113010454, 0.03286604994060524, 0.029740533444672586, 0.026855633221955073, 0.0242440444805639, 0.02194088699467417, 0.019983228659369346, 0.01840824345014903, 0.01724916176216267, 0.016528928077290186, 0.016253412723317092, 0.016407859089524055, 0.016959350796634857, 0.017864196398100746, 0.0190761151950741, 0.020551842763108924, 0.022253487760446743, 0.02414875063083102, 0.02621030635715708, 0.028415111882701814, 0.03074387637005706, 0.03318066217129148, 0.03571251637374444, 0.0383290618812336, 0.04102202905440913, 0.04378474914786289, 0.04661164993396224, 0.04949779504068021, 0.05243849861617017, 0.055429032654496446, 0.05846443045888841, 0.061539378919301585, 0.06464818543672574, 0.06778480219743545, 0.07094289027068125, 0.07411590769625914, 0.07729720845487896, 0.08048014228748714, 0.08365814828825863, 0.08682483777593851, 0.08997406403562602, 0.09309997810428827, 0.09619707089348785, 0.09926020267522534, 0.10228462138242653, 0.1052659713711903, 0.10820029432397171, 0.11108402389571473, 0.11391397556068317 ], [ 0.037943339872476986, 0.03437145834374152, 0.030984352667102755, 0.027810393371666714, 0.024879564072645535, 0.022223683104655983, 0.01987656459047507, 0.017873761030070205, 0.016251160405954968, 0.015041440277427678, 0.014267904339176171, 0.013937260241366493, 0.014035395894110871, 0.014529744531783894, 0.015377237928221798, 0.016532951284071597, 0.017955532612755398, 0.01960899891149684, 0.02146249414692586, 0.023489529457950194, 0.02566740458437855, 0.027976891279907837, 0.030402023022671417, 0.0329298362057433, 0.03554999024976911, 0.038254272414981826, 0.041036038920967986, 0.04388965753575832, 0.04681000842239608, 0.04979208102792601, 0.05283068382608227, 0.05592026599495397, 0.059054837849511765, 0.062227970207116894, 0.06543285084940194, 0.06866237744788119, 0.07190926938114227, 0.07516618470167506, 0.07842583236229088, 0.08168107324545736, 0.084925006350463, 0.08815103863934866, 0.09135293857312712, 0.09452487438035051, 0.09766143869924576, 0.1007576615262634, 0.10380901347745272, 0.10681140129719802, 0.10976115738730512, 0.1126550249194192 ], [ 0.03631381348941428, 0.03268936105572274, 0.029253251421919507, 0.0260342706295085, 0.02306248762232449, 0.020369308661343122, 0.01798749590731524, 0.015950881061144593, 0.014293150990986896, 0.013044724679620841, 0.012227059582968484, 0.011845685085067567, 0.011886106645547985, 0.012316520310854437, 0.013096137991726015, 0.014183559919360563, 0.015541233525931385, 0.017136250306116218, 0.018939631190632827, 0.02092565672592537, 0.023071671599443812, 0.02535817304820162, 0.027768882842828267, 0.030290619344700828, 0.032912930698148345, 0.035627546362638346, 0.03842774371912638, 0.04130772504906712, 0.044262076647275016, 0.04728535118177957, 0.050371786234149445, 0.05351515094213192, 0.05670869993898321, 0.05994520831334575, 0.06321706114504944, 0.06651637425151964, 0.06983512739785107, 0.0731652961710219, 0.07649897326180392, 0.07982847367809909, 0.08314642132697739, 0.08644581649739243, 0.0897200851728669, 0.09296311194863133, 0.09616925876076586, 0.09933337177669165, 0.10245077874392096, 0.10551727892142085, 0.10852912747937267, 0.11148301598628435 ], [ 0.034839854512335094, 0.031163171718191912, 0.02767848521784192, 0.02441545708774879, 0.02140486047954685, 0.01867842614556848, 0.016268582980818323, 0.014207862786979426, 0.012527447938185285, 0.011254044815943031, 0.010404607057758199, 0.009980368114536974, 0.009964322257863317, 0.010325482541149265, 0.011027476284755951, 0.012035366087401212, 0.013317783561478586, 0.014846119256434562, 0.016593471553327063, 0.01853451867766808, 0.0206461137863389, 0.02290800790604075, 0.02530327709429524, 0.02781831055613872, 0.030442412169758012, 0.03316715647598819, 0.03598565330260907, 0.038891847281615495, 0.04187993485180687, 0.044943937951411723, 0.04807743904608565, 0.05127345935497714, 0.05452445043050855, 0.057822366076561396, 0.0611587839539276, 0.06452505148008307, 0.06791243684292436, 0.07131227189889498, 0.07471607878760235, 0.07811567604851033, 0.08150326289668705, 0.08487148225280158, 0.08821346431883254, 0.09152285313350608, 0.09479381879305196, 0.09802105801383648, 0.10119978554243858, 0.10432571865694706, 0.10739505670033488, 0.11040445727548362 ], [ 0.03353511597046125, 0.029805609352622133, 0.026271151998948698, 0.022962617830728144, 0.019912047164489615, 0.01715232672530663, 0.014716622889558528, 0.012637280844081958, 0.01094365069454291, 0.009658180064609197, 0.00879088785585249, 0.008334778096468074, 0.008266882058488322, 0.008556334938318613, 0.009173552938091604, 0.01009363639668117, 0.011294091963279882, 0.012751623296714676, 0.014441144983845796, 0.016336954792659304, 0.018414658932744715, 0.020652740466041857, 0.023033341763442655, 0.02554229041900992, 0.02816858889262187, 0.0309036205802676, 0.03374028599342377, 0.03667221877354761, 0.039693165965342225, 0.042796562558220945, 0.04597529194288141, 0.04922160174734368, 0.05252713557245515, 0.05588304131857421, 0.059280122151773425, 0.06270900365779397, 0.06616029838407399, 0.06962475568858166, 0.07309339016150218, 0.07655758582372882, 0.08000917600228416, 0.08344050048254374, 0.086844442490782, 0.09021444848648401, 0.09354453381730929, 0.09682927714239367, 0.10006380625643312, 0.10324377761300953, 0.1063653514938124, 0.1094251644279572 ], [ 0.03241831665803252, 0.02863536637857893, 0.025049185096146773, 0.021691919771375717, 0.0185971527073892, 0.01579953819274885, 0.013334057958506411, 0.011234453016221132, 0.009530047570553075, 0.008240156742737672, 0.007366889829576501, 0.006891331928082467, 0.006780074996737071, 0.007000517281112147, 0.007531801479527036, 0.008362617150124754, 0.00948170832169411, 0.01087136715667583, 0.012507339539075988, 0.0143623898074326, 0.01641010648624017, 0.01862737007991801, 0.0209953414885713, 0.023499366179976246, 0.026128247496443317, 0.028873254032654318, 0.03172711610868918, 0.034683166589038056, 0.037734699554491304, 0.040874560132120326, 0.0440949406457959, 0.04738733933356682, 0.05074263318988477, 0.05415122062014463, 0.05760319799566972, 0.06108854369840669, 0.06459729199818887, 0.06811968627085466, 0.0716463064473981, 0.07516816933629074, 0.0786768028820199, 0.08216429683740066, 0.08562333302602648, 0.08904719858901243, 0.09242978552386939, 0.09576557955972831, 0.0990496410588399, 0.10227758024668668, 0.10544552868782371, 0.10855010856311278 ], [ 0.03151316184460681, 0.02767743577253183, 0.02403830342855808, 0.02062887383766128, 0.017484042799023387, 0.014640232201018412, 0.012134727220968856, 0.010004018083830122, 0.008279931445378036, 0.006981970561966421, 0.006106589649240848, 0.005621749729224996, 0.005479440307373462, 0.005642131683908831, 0.0060979111289824195, 0.00685090028197492, 0.0079016105929611, 0.009236602390399012, 0.010830695587131404, 0.012654065634302367, 0.014678077757856954, 0.016878314432134462, 0.019235424914151603, 0.02173470858844376, 0.024365097778981402, 0.02711796292111389, 0.029985995554561596, 0.03296230670363099, 0.03603979220625619, 0.03921075765965573, 0.04246676153121585, 0.04579862111468926, 0.04919652612856794, 0.05265021269484365, 0.05614916141942257, 0.05968279426718872, 0.06324065431587679, 0.06681255974022439, 0.07038872857027444, 0.07395987420844972, 0.07751727378080285, 0.08105281251619974, 0.0845590078047919, 0.08802901662105506, 0.09145662977768367, 0.09483625612162969, 0.09816289936976406, 0.10143212985742879, 0.10464005306763124, 0.10778327643771744 ], [ 0.030847400706194437, 0.026962425789651315, 0.02327185668362396, 0.019809131070596942, 0.016609688984465788, 0.013710866373299083, 0.011151521383803665, 0.008970843907041457, 0.007204911021960319, 0.005878244846832095, 0.004988919336598094, 0.00449699730580466, 0.004339172876322745, 0.004468818687398346, 0.004879182764537684, 0.005586394442694191, 0.006598650455207006, 0.007903231678695694, 0.00947256139518492, 0.011274703597311015, 0.013280182229463991, 0.015464735139391278, 0.017809659623335545, 0.020301011688440763, 0.02292835980129525, 0.025683477909923383, 0.028559195161725424, 0.0315485112965056, 0.034644007439019464, 0.03783752821376793, 0.04112008184567647, 0.04448189569401827, 0.04791256869818165, 0.05140127296393217, 0.054936969381904836, 0.058508613908943075, 0.06210534068443658, 0.06571661522355329, 0.06933235577328141, 0.07294302398175026, 0.07653968778283986, 0.08011406023995551, 0.0836585183402617, 0.08716610561358686, 0.09063052212775473, 0.09404610498998937, 0.09740780202921127, 0.10071114088706218, 0.10395219532933271, 0.10712755021563254 ], [ 0.030450820768421837, 0.026524462858706205, 0.022788847971826617, 0.01927704770291888, 0.016024055351374886, 0.013066715807788763, 0.010443552908011905, 0.00819423078988482, 0.006357705403687778, 0.004966310114738115, 0.004030994399964943, 0.0035208237699305422, 0.0033665968275639314, 0.0035080510688916423, 0.00393056202627312, 0.004647384189889745, 0.005663812334878577, 0.006964758914493221, 0.008522586222848771, 0.010307257540162394, 0.012291958633939922, 0.01445500801926156, 0.016779836664879803, 0.019254094170837278, 0.021868424472767267, 0.02461522285443525, 0.027487564554917587, 0.030478403194647584, 0.03358006205576464, 0.03678398873527698, 0.04008071606238683, 0.043459965050929555, 0.046910831619614894, 0.05042201089371918, 0.05398202621416333, 0.057579441825241016, 0.06120304752383765, 0.06484201023781312, 0.06848599193017853, 0.07212523591450563, 0.07575062511131743, 0.07935371638307567, 0.08292675516433304, 0.08646267437098322, 0.08995508117493038, 0.09339823476219804, 0.09678701771168433, 0.10011690317221614, 0.10338391959536662, 0.10658461440892515 ], [ 0.03035219033090925, 0.026397521520045913, 0.022629614988801117, 0.01908080924008404, 0.015785074942676572, 0.012777826026871804, 0.010095668522188005, 0.00777609024898227, 0.005857012303405383, 0.004375432583275194, 0.0033612779286695703, 0.002817397919803633, 0.0026939710155431318, 0.002910538669921143, 0.0034149306964761025, 0.00419306065472602, 0.0052402661989004165, 0.006544132841136287, 0.008084716596082607, 0.009839782594598017, 0.011788690887470935, 0.013914167602959588, 0.0162026206552535, 0.018643615566352308, 0.021228943525624065, 0.023951592482752238, 0.026804833546750072, 0.02978153950636114, 0.032873769494755116, 0.03607259597421381, 0.03936812014210286, 0.04274961408311497, 0.04620573398308399, 0.0497247608683993, 0.05329483852465186, 0.05690418978329226, 0.06054130126456452, 0.06419507292214367, 0.06785493277762003, 0.07151091960427251, 0.07515373751994561, 0.07877478687979604, 0.08236617581618028, 0.08592071645996971, 0.08943190942994395, 0.0928939196799305, 0.0963015462980908, 0.09965018838789348, 0.10293580874048298, 0.10615489663909138 ], [ 0.030575525238416303, 0.02661057336435561, 0.02282945673078384, 0.019263980691294456, 0.01594740736396963, 0.012914207427841357, 0.010199781721594718, 0.00784030928569794, 0.005873167161629366, 0.004338652168856907, 0.003281371720810564, 0.0027353055025551134, 0.0026708614695452925, 0.0029807493929357664, 0.003568363902270005, 0.0043943615090296225, 0.005450300929970699, 0.006731534880397113, 0.008228712645329983, 0.009928756901740677, 0.011817707859602468, 0.013882771804599172, 0.016113200133829945, 0.01850026233565378, 0.021036679842306116, 0.023715851295662418, 0.026531114103605292, 0.02947518504771178, 0.032539831080590505, 0.035715757115887266, 0.03899266366666485, 0.04235941732215716, 0.0458042819070771, 0.04931516959973324, 0.05287988391721142, 0.05648633752217356, 0.06012273627132538, 0.06377772681217578, 0.06744050877721754, 0.07110091476481753, 0.07474946232706753, 0.07837738249694386, 0.08197662926431462, 0.08553987404690544, 0.0890604887249879, 0.09253252029582076, 0.09595065970208592, 0.09931020692295946, 0.10260703399924674, 0.10583754729937844 ], [ 0.03113644886993776, 0.027182649913829404, 0.023411762874416746, 0.01985565299370066, 0.01654780710375377, 0.013523246133390216, 0.010818552456467765, 0.008472247953506776, 0.006525883845313354, 0.005025496405882889, 0.004018011623584283, 0.003525621152543232, 0.003500224534532651, 0.003833545004176497, 0.004432160241992977, 0.005251421477685868, 0.0062781923206619164, 0.007509075733060918, 0.008940054383244566, 0.010564325571584748, 0.012373341409763235, 0.014358315780305752, 0.01651119010571648, 0.018824892660832763, 0.02129306590928011, 0.02390952985358366, 0.026667718394847193, 0.029560241733687504, 0.0325786394576295, 0.035713322770364965, 0.03895366744548001, 0.04228820664132761, 0.04570487565475816, 0.04919127080047896, 0.05273489633643919, 0.056323383784162316, 0.0599446760248284, 0.06358717412851063, 0.06723984839410233, 0.07089231705929269, 0.07453489706008852, 0.07815863145611765, 0.08175529796554892, 0.08531740265910681, 0.0888381623673054, 0.09231147883317167, 0.09573190713763974, 0.09909462045953128, 0.10239537281735663, 0.10563046107910887 ], [ 0.032039585338931365, 0.02811930136380877, 0.024383065893715642, 0.02086329423192484, 0.01759437591207609, 0.014612771774506003, 0.011957236042375642, 0.009669143146368405, 0.00779238489126248, 0.00637045665800083, 0.005434811845579167, 0.004980825336134114, 0.0049510345631261525, 0.005257724935803571, 0.005825793307163968, 0.00661136567641125, 0.007595006561592872, 0.008769309194353592, 0.010130530641158837, 0.011674910476011671, 0.013397829597076645, 0.015294136660622456, 0.017358632114041043, 0.019586269443480596, 0.021972011446013594, 0.02451046987209058, 0.027195501376103895, 0.03001989268836931, 0.032975200209822815, 0.036051750208981916, 0.03923876962215382, 0.042524603353897, 0.04589697490071809, 0.049343255592372355, 0.05285071834399156, 0.0564067615146378, 0.05999909604953926, 0.06361589438108303, 0.06724590290686447, 0.07087852172903895, 0.07450385618139302, 0.07811274485380473, 0.08169676861471288, 0.08524824471311264, 0.08876020953005932, 0.0922263930177926, 0.09564118735386612, 0.09899961186983797, 0.10229727589879697, 0.1055303408256964 ], [ 0.03327768101807088, 0.02941156792965238, 0.025731886076256177, 0.022271589151397233, 0.01906578326225471, 0.0161517626767571, 0.013568915080925316, 0.01135809253009731, 0.009559347469770873, 0.008205866104063143, 0.007312208666927316, 0.0068608262943154015, 0.006800210196755002, 0.00706253046546094, 0.007586973416114517, 0.008331361892537232, 0.009271184337703109, 0.01039375978539893, 0.011692762953013195, 0.01316463736957128, 0.014806736643414163, 0.01661657447274617, 0.018591576234671666, 0.020728920920759675, 0.023025299020617247, 0.025476590395356147, 0.028077547319757097, 0.030821568758585157, 0.03370061305113198, 0.03670525250910597, 0.03982484323963307, 0.043047770479330665, 0.04636172984970247, 0.04975401227417007, 0.053211769982545176, 0.056722250138702385, 0.06027298986489435, 0.06385197154315359, 0.06744774050933827, 0.07104948905409345, 0.0746471114395029, 0.07823123478620136, 0.08179323044609602, 0.08532521003161271, 0.08882000974057414, 0.09227116606814796, 0.09567288547460107, 0.09902001010107556, 0.10230798120415953, 0.10553280161559665 ], [ 0.03483256221188191, 0.03103757061783061, 0.027431415011443472, 0.02404706283077019, 0.020919433902146862, 0.018085141283107092, 0.015581811667777702, 0.013446472664143257, 0.011712141351243861, 0.010401751880848107, 0.009520035645748921, 0.009047448175290332, 0.008942222465096262, 0.009151595898973958, 0.009625194024696434, 0.010323178094179679, 0.011217973012685267, 0.012292336784199028, 0.013536382941324311, 0.01494487065704659, 0.016515193988026797, 0.018246057158216075, 0.020136629038086364, 0.02218594824603639, 0.024392433278761786, 0.026753456303568318, 0.02926500571347583, 0.031921477552135466, 0.034715616839343634, 0.03763860100488553, 0.04068023549518404, 0.043829221773190895, 0.04707345875884213, 0.05040034591876779, 0.05379706562154136, 0.05725083133164994, 0.06074909542618156, 0.06427971556483429, 0.06783108183386925, 0.07139220872597499, 0.07495279683463266, 0.07850326929073467, 0.08203478771971996, 0.08553925203595956, 0.08900928783941105, 0.09243822461218937, 0.0958200673723225, 0.09914946395041722, 0.10242166962132049, 0.10563251044872478 ], [ 0.03667744068496346, 0.03296584343397417, 0.029444407056616783, 0.02614535463692644, 0.023102351876734734, 0.02034991887720451, 0.017922299518377472, 0.015851415406989512, 0.014163508840507379, 0.012874467098232673, 0.011984935833721204, 0.011477741918279974, 0.01132010956688033, 0.011470475775251026, 0.011886625831918622, 0.012531714395538943, 0.013377024269016725, 0.014402186067329726, 0.015594012924382623, 0.016944822895264087, 0.01845076555945387, 0.02011038944271357, 0.021923493121995624, 0.023890208330611826, 0.02601025614618639, 0.0282823525844037, 0.030703771973795244, 0.03327008414181195, 0.035975067873115885, 0.0388107820052939, 0.04176775876828567, 0.04483527672370706, 0.04800167236732845, 0.05125465684747205, 0.05458161381576426, 0.05796986364356997, 0.06140688678888418, 0.06488050459253232, 0.06837901937004288, 0.07189131773017651, 0.07540694201661018, 0.07891613500604322, 0.08240986278925164, 0.085879820313372, 0.08931842350782264, 0.0927187913357044, 0.09607472055542428, 0.09938065546865539, 0.10263165448136956, 0.10582335491682306 ], [ 0.03877979306224606, 0.035159168580329726, 0.03172827582670455, 0.02851790244024291, 0.02555965610879052, 0.022885162928513888, 0.020524766463286267, 0.018505540655618886, 0.016848537403984593, 0.015565539043791661, 0.014656179031503402, 0.014106770095846809, 0.013891881954844186, 0.01397846332386235, 0.014331022187479784, 0.014916159515141527, 0.01570552031117101, 0.016677091046504527, 0.017815220978488117, 0.019109844204913806, 0.020555317157796398, 0.022149161568425755, 0.02389087162064335, 0.02578084982681415, 0.027819494305972838, 0.03000645421076122, 0.032340072880586726, 0.03481703254382743, 0.037432198031497596, 0.04017863712370726, 0.04304777974522263, 0.046029671315138354, 0.04911327693963058, 0.05228680015525539, 0.05553798942002952, 0.05885441503068139, 0.06222370717750558, 0.06563375189273465, 0.06907284574596047, 0.07252981261855967, 0.07599408715872959, 0.07945576996035365, 0.08290565942861931, 0.08633526491698187, 0.08973680519629858, 0.09310319574522785, 0.09642802778934964, 0.09970554149676511, 0.10293059527476343, 0.10609863271040904 ], [ 0.04110412581361551, 0.0375779588932485, 0.03423912535502441, 0.031116514874672936, 0.028239270016724532, 0.02563591687416484, 0.02333311361853797, 0.0213539573496528, 0.01971590153532132, 0.018428554967051484, 0.017491907196167642, 0.016895673994833518, 0.01662025715888927, 0.016639255667901465, 0.016922878461893255, 0.01744137722473733, 0.01816780109813848, 0.01907974149816357, 0.020160059371966344, 0.02139678686222303, 0.022782472428584617, 0.024313222823464476, 0.025987631628569256, 0.027805717153307118, 0.029767947273617066, 0.031874405360924604, 0.03412413709250707, 0.036514701693823245, 0.03904193042622855, 0.04169987380700332, 0.044480902543912265, 0.04737591869664161, 0.050374633199358684, 0.05346587145097381, 0.05663787734559847, 0.059878595405182596, 0.0631759189779068, 0.06651789902160397, 0.06989291266433804, 0.07328979374053556, 0.07669792919906888, 0.08010732603986172, 0.08350865357521327, 0.08689326557545261, 0.09025320641904523, 0.09358120484058148, 0.09687065832801629, 0.1001156107049382, 0.10331072496598688, 0.10645125302277644 ], [ 0.043614225421370084, 0.04018276177114744, 0.03693438159306598, 0.033895863622663024, 0.031093810762580595, 0.02855381955204559, 0.02629938750841276, 0.02435055962805374, 0.022722393297476565, 0.02142343878171646, 0.020454555452573395, 0.019808437131848124, 0.019470126580656343, 0.019418554055720946, 0.01962883907975079, 0.020074891365511015, 0.02073181641031648, 0.02157775360229777, 0.022594971253622746, 0.02377023115873824, 0.025094560291658595, 0.02656261471131073, 0.02817181061638481, 0.029921362819534607, 0.03181133633816427, 0.03384179044811828, 0.03601207316713686, 0.038320302456908886, 0.04076304693048062, 0.04333519608071457, 0.04602999196248598, 0.04883918357383888, 0.051753262261822724, 0.05476173976233523, 0.057853437523509195, 0.06101676439917779, 0.06423996790172476, 0.06751135099476642, 0.07081945153290761, 0.0741531849734237, 0.07750195315468825, 0.08085572308431269, 0.08420508011388878, 0.08754125984956983, 0.09085616284832759, 0.09414235571122269, 0.0973930616945857, 0.10060214347131635, 0.1037640802179429, 0.10687394079370174 ], [ 0.046274779559584395, 0.0429358798700374, 0.03977425556161141, 0.03681455676478187, 0.03408098072720257, 0.03159653513321759, 0.029382132211594077, 0.027455534341674335, 0.025830217714368473, 0.02451428101506194, 0.023509585637901703, 0.022811344321960733, 0.02240834482319307, 0.022283889360093064, 0.022417369106428806, 0.022786231292889075, 0.023368000337306124, 0.02414202269941498, 0.025090706446330723, 0.026200168894798474, 0.027460331183400907, 0.02886457427099186, 0.03040909611662617, 0.03209210302592162, 0.03391294863417381, 0.035871312276189886, 0.0379664867349915, 0.04019682248535472, 0.04255935149800661, 0.045049590575449196, 0.04766150517000717, 0.050387602070104585, 0.053219113903784684, 0.05614623911902045, 0.059158406019007626, 0.06224453644866619, 0.06539329211671102, 0.0685932931677243, 0.07183330393956153, 0.07510238472981948, 0.07839001098417102, 0.08168616285849449, 0.08498138886729152, 0.08826684755650364, 0.09153433102441823, 0.09477627380435315, 0.0979857502171991, 0.10115646286621308, 0.10428272452055125, 0.10735943524026141 ], [ 0.049052434705887875, 0.04580230323455994, 0.04272242911632855, 0.03983543988794021, 0.037163361992053064, 0.034726994853587725, 0.03254517817726775, 0.03063397359369664, 0.029005806591603844, 0.02766864641885042, 0.026625335713621256, 0.025873207423965126, 0.0254041269010498, 0.025205053507091766, 0.02525912272467567, 0.02554712763519321, 0.026049174220187456, 0.02674624474199103, 0.027621442821087114, 0.0286607882540214, 0.029853535060337666, 0.031192067453460072, 0.03267147289185888, 0.034288904986846114, 0.0360428440655593, 0.03793234920412442, 0.03995637714767429, 0.042113222310021056, 0.044400109252413576, 0.04681294681404463, 0.04934623405455342, 0.05199309451190834, 0.05474540786320338, 0.05759400642672466, 0.06052890664407923, 0.06353955097173097, 0.06661504188801064, 0.06974435580850884, 0.07291652990887885, 0.07612081889778484, 0.07934682166185086, 0.08258457957258729, 0.08582464931614693, 0.08905815359625757, 0.09227681315527791, 0.09547296340512115, 0.09863955866673814, 0.1017701666583552, 0.104858955497496, 0.10790067511947578 ], [ 0.05191642479568466, 0.048750179713065694, 0.04574629658483127, 0.042925550173760256, 0.040308061415927514, 0.037912777977875387, 0.03575688659793815, 0.0338551726078794, 0.032219355142433584, 0.03085744487515482, 0.029773194530427278, 0.028965736411959712, 0.028429514035212333, 0.028154599557332377, 0.02812743286326447, 0.02833192879275238, 0.028750806537636692, 0.029366938893071702, 0.03016452186515112, 0.031129920469037266, 0.032252126234902145, 0.033522836112176504, 0.034936213993452134, 0.03648842240207768, 0.038177018666513386, 0.04000030414257233, 0.04195670172928814, 0.044044219008781665, 0.04626003401037137, 0.048600220150232645, 0.05105960873006193, 0.053631773452488, 0.056309112735559816, 0.05908300209423317, 0.06194398955210574, 0.06488201057050794, 0.06788660394072889, 0.07094711534909218, 0.07405288013913977, 0.07719338076382741, 0.0803583774226235, 0.08353801246864218, 0.08672289049443246, 0.08990413673548402, 0.09307343673333277, 0.09622306021540991, 0.09934587198515556, 0.10243533235296806, 0.10548548933114249, 0.10849096449982157 ], [ 0.05483890515722098, 0.051751005622723986, 0.04881698122208117, 0.04605594711195593, 0.04348637655345461, 0.04112567475126343, 0.0389897071170709, 0.03709229112154782, 0.0354446680767283, 0.03405498324463497, 0.03292782077854339, 0.032063861705577304, 0.03145974971272312, 0.031108246886323996, 0.03099872780280296, 0.031117996363121122, 0.03145133448988853, 0.031983634545214225, 0.03270045066390217, 0.0335888312170066, 0.03463784993508598, 0.035838814697057936, 0.0371851835991705, 0.0386722504495876, 0.04029667686663622, 0.04205594967318799, 0.04394783446280596, 0.04596988238248044, 0.04811903000015387, 0.05039131404306654, 0.05278170607803867, 0.05528405868847122, 0.05789114545299094, 0.06059477222753264, 0.06338593630185346, 0.06625501191624719, 0.06919194423644374, 0.07218643817814427, 0.07522813269648897, 0.07830675485100536, 0.0814122509135371, 0.08453489397396387, 0.08766536899122523, 0.09079483715987528, 0.09391498195062443, 0.09701803936111966, 0.10009681488351711, 0.10314468953766229, 0.10615561709066729, 0.10912411432545482 ], [ 0.057795096726124075, 0.0547796580284046, 0.051909248540939534, 0.04920151680589649, 0.04667352223012441, 0.044341386995981696, 0.04221991534274118, 0.040322184474478086, 0.03865911565083456, 0.037239042887782105, 0.03606731141273773, 0.03514595687372055, 0.034473532697755736, 0.034045156139759246, 0.033852823462383955, 0.03388599970067235, 0.03413242987636497, 0.03457906691634287, 0.03521298603255709, 0.036022163407388307, 0.03699603212383266, 0.03812577562638626, 0.03940436408732663, 0.04082637293608562, 0.04238764271919904, 0.044084846645866774, 0.04591502947531403, 0.047875171820263164, 0.049961820216761973, 0.052170807919915435, 0.05449707651437628, 0.0569345958144036, 0.05947637026295646, 0.06211451448408213, 0.06484037851107693, 0.06764470378159342, 0.0705177933559448, 0.07344968310790209, 0.07643030416073149, 0.07944963012017793, 0.08249780542646187, 0.08556525331111066, 0.08864276341466555, 0.09172156017348458, 0.09479335371871564, 0.09785037535076938, 0.10088539974940966, 0.10389175602765921, 0.1068633295942783, 0.10979455659649276 ], [ 0.06076331220591312, 0.057814340232281075, 0.055001375742366285, 0.05234078170691557, 0.049848408820883754, 0.04753931143146736, 0.04542743820501825, 0.04352529840711112, 0.041843607558895074, 0.04039092320766542, 0.03917329363587358, 0.03819395822394361, 0.03745315296364757, 0.036948080259327123, 0.03667309078814299, 0.03662009422316882, 0.036779171354172226, 0.03713931645194095, 0.03768921066103392, 0.03841792350810809, 0.0393154591826444, 0.040373098303642066, 0.04158352330013833, 0.04294074749835054, 0.04443988995661715, 0.0460768491756063, 0.04784793041740022, 0.04974947579625564, 0.05177753604821699, 0.053927610313821, 0.05619446746253642, 0.058572051104870085, 0.06105346157411464, 0.06363100229685191, 0.06629627503647408, 0.06904030801185297, 0.07185370218144559, 0.07472678333016165, 0.07764975038754368, 0.08061281318540628, 0.08360631534387682, 0.08662084001407347, 0.08964729776746229, 0.0926769970371834, 0.09570169825169533, 0.0987136532340259, 0.10170563164661268, 0.10467093630829849, 0.1076034091500305, 0.11049742945027746 ], [ 0.06372490880529859, 0.06083647876418027, 0.05807500168017953, 0.05545571936304446, 0.05299345125047079, 0.05070236251749004, 0.04859571118362579, 0.04668557291959682, 0.04498254438192535, 0.04349543153109162, 0.042230939270605235, 0.041193391882531086, 0.040384526537565184, 0.0398034087561419, 0.03944651304863633, 0.039307991242899645, 0.039380118369499326, 0.039653870438760806, 0.040119561283107945, 0.04076745522376207, 0.041588280617775815, 0.04257359196889336, 0.04371595745928325, 0.0450089768503688, 0.04644715652250953, 0.04802568174732842, 0.049740131204365864, 0.05158617671436397, 0.053559304193387294, 0.05565458205803271, 0.05786649266696452, 0.06018883243421893, 0.06261467807961786, 0.0651364106536498, 0.06774578557356194, 0.07043403565611267, 0.0731919945394473, 0.0760102293913561, 0.07887917388500568, 0.08178925467218383, 0.08473100671226252, 0.08769517465564157, 0.09067279896193901, 0.09365528655050707, 0.096634466568476, 0.0996026323731733, 0.10255257111997704, 0.10547758247859977, 0.10837148801769042, 0.11122863273778126 ], [ 0.06666419354152284, 0.06383059054037785, 0.061114964883847836, 0.05853158411675963, 0.05609438933224082, 0.05381680590817056, 0.0517115357794981, 0.04979032859882017, 0.04806373077395988, 0.046540815921293166, 0.04522890828815406, 0.044133321447654236, 0.04325714548136155, 0.04260112269465336, 0.04216365005694789, 0.04194093330012181, 0.041927294155284435, 0.042115604161494465, 0.04249779396405232, 0.04306537330151976, 0.043809897383824535, 0.04472332871328558, 0.04579826470231933, 0.04702802468808832, 0.048406610127866935, 0.04992856591555857, 0.05158877798257956, 0.05338224323676084, 0.05530384390378538, 0.05734815123787293, 0.05950927508789966, 0.06178076739592643, 0.06415558042252888, 0.06662607495166178, 0.06918407013001784, 0.07182092482089238, 0.07452764007024251, 0.07729497307027045, 0.08011355444200868, 0.08297400238408746, 0.08586702898198258, 0.08878353556622008, 0.09171469535562364, 0.0946520226899621, 0.09758742895320306, 0.1005132658448771, 0.10342235701410724, 0.10630801927143993, 0.10916407467724988, 0.11198485480582765 ], [ 0.0695682955307704, 0.06678412842936791, 0.06410913012165334, 0.06155672416880417, 0.05914010524887194, 0.05687208492599118, 0.05476492051874643, 0.052830123584635146, 0.05107824579822521, 0.049518643647232026, 0.04815922982378464, 0.04700622795148111, 0.046063956556415465, 0.04533467491294921, 0.0448185240795523, 0.04451358860375, 0.04441608806313182, 0.04452068606570744, 0.04482088318787667, 0.0453094455035467, 0.04597881574523655, 0.0468214602704478, 0.04783011928815243, 0.048997945913820014, 0.050318537216224396, 0.05178587431022149, 0.053394197156735816, 0.05513784291468962, 0.057011075297704536, 0.0590079277715595, 0.061122077049644244, 0.06334675651322844, 0.06567471290740175, 0.06809820458480553, 0.07060903597958071, 0.07319862089712242, 0.07585806640610436, 0.07857826931668604, 0.08135001809464218, 0.08416409429601686, 0.08701136897118146, 0.08988289081072667, 0.09276996398363374, 0.09566421459871087, 0.09855764549002397, 0.10144267959718868, 0.10431219260691303, 0.10715953577351522, 0.10997854997412089, 0.11276357210703673 ], [ 0.07242701309120778, 0.06968730850148128, 0.06704820182596843, 0.06452238786689762, 0.06212242906094592, 0.05986063023820971, 0.05774889745710046, 0.05579857689939723, 0.05402027075214224, 0.052423629887013844, 0.051017128318037196, 0.04980783157176511, 0.04880117900348995, 0.04800080656097385, 0.0474084388789025, 0.04702387568765596, 0.04684508670878848, 0.046868413131224584, 0.04708885613404051, 0.047500418337412635, 0.04809645630934395, 0.0488700029718144, 0.049814027054881055, 0.0509216098788485, 0.05218603424333077, 0.05360079303156594, 0.055159534347524505, 0.056855964866442926, 0.058683733871696335, 0.060636318073138164, 0.06270692291316868, 0.06488841080180661, 0.06717326151536329, 0.06955356549577289, 0.07202104735719736, 0.07456711464762332, 0.07718292574405211, 0.07985947048530403, 0.08258765752430973, 0.08535840317252677, 0.0881627175068546, 0.09099178455649742, 0.09383703437584644, 0.09669020567567994, 0.0995433983997117, 0.10238911619152904, 0.10522029910902407, 0.10803034722797854, 0.11081313595583919, 0.11356302397274964 ], [ 0.0752326400393957, 0.07253292025831183, 0.0699255226986045, 0.06742251522547144, 0.06503592711295307, 0.0627776479277509, 0.06065931107836359, 0.05869215765306913, 0.056886876834902206, 0.055253421429561196, 0.053800801176148765, 0.052536862381476625, 0.051468069206245574, 0.05059930809133607, 0.04993374032297606, 0.04947272668918849, 0.04921584157908952, 0.04916098229517378, 0.04930456506957794, 0.04964178569936777, 0.050166913226647854, 0.05087358187672056, 0.051755049860196904, 0.05280440220438258, 0.05401468600487816, 0.05537897773045899, 0.056890391401540084, 0.058542042451193745, 0.06032698464064066, 0.06223813699360002, 0.06426821516733094, 0.0664096779258224, 0.06865469526271255, 0.07099514087831593, 0.07342260855144753, 0.07592844964893769, 0.07850382759709362, 0.08113978449727678, 0.0838273150375294, 0.08655744325161532, 0.08932129833570383, 0.09211018651091457, 0.09491565671204086, 0.09772955861900817, 0.10054409218757072, 0.10335184836148455, 0.10614584105829446, 0.10891953082298464, 0.11166684075181504, 0.11438216541847215 ], [ 0.07797977397711137, 0.07531612066733678, 0.07273685662700062, 0.07025351270676641, 0.06787767109244201, 0.06562088432577473, 0.06349457929686227, 0.06150994156737849, 0.05967777580859778, 0.05800833986476407, 0.05651115326235457, 0.0551947858476272, 0.05406663813129016, 0.05313273076480297, 0.05239752482411626, 0.051863795591391613, 0.051532579128203644, 0.05140320299518707, 0.051473401217923036, 0.05173950141609633, 0.05219666175505714, 0.05283912942109659, 0.05366049179521176, 0.05465389603108153, 0.0558122207520649, 0.05712819293654646, 0.05859445175913938, 0.060203567794049936, 0.061948029927678804, 0.06382021360990979, 0.06581234319643733, 0.06791645881084367, 0.07012439511203548, 0.07242777620152711, 0.07481802808136523, 0.0772864078291626, 0.07982404708569012, 0.08242200653019031, 0.08507133765393579, 0.08776314820429558, 0.09048866802540442, 0.09323931254644496, 0.0960067417666889, 0.09878291318579359, 0.10156012768065262, 0.10433106780893173, 0.10708882841240609, 0.10982693969941033, 0.11253938321105837, 0.11522060123036307 ], [ 0.08066510882584182, 0.07803421306924006, 0.07548015608040265, 0.07301401099056465, 0.0706469875713566, 0.06839036805372592, 0.06625542800049619, 0.06425333738348635, 0.06239503723953458, 0.060691088588534954, 0.05915149296115989, 0.05778548796045571, 0.056601326470263114, 0.05560605367197731, 0.05480530075631672, 0.05420311671047652, 0.053801858584777665, 0.05360215561474752, 0.053602953953008514, 0.05380163811191531, 0.05419421482982299, 0.05477553728484209, 0.05553954401349746, 0.056479487989675364, 0.05758813632504563, 0.05885792839916745, 0.06028108811340257, 0.061849692862143146, 0.06355570677426751, 0.06539098846979347, 0.06734728417866527, 0.0694162160655507, 0.0715892735948773, 0.07385781332131491, 0.07621307005322349, 0.07864618021372204, 0.08114821657762519, 0.08371023243941925, 0.08632331263419211, 0.0889786286093711, 0.09166749483001156, 0.09438142409376428, 0.0971121797449725, 0.09985182323973922, 0.10259275597328237, 0.10532775470316227, 0.1080500002670801, 0.11075309959332047, 0.11343110123475489, 0.11607850482804882 ], [ 0.08328721388752647, 0.08068641257759282, 0.07815531519559908, 0.0757046068583072, 0.07334518941694762, 0.07108813121750923, 0.06894460181080374, 0.06692578659161033, 0.06504277640702338, 0.06330642815627059, 0.06172719457158723, 0.06031492484172296, 0.059078642371171074, 0.05802631124702664, 0.057164607999811594, 0.05649871878637002, 0.056032182956653534, 0.055766801229533404, 0.05570262030951805, 0.0558379966323502, 0.0561697318077693, 0.05669326339691767, 0.0574028888086063, 0.05829199835993605, 0.059353295861091095, 0.06057899044170926, 0.06196095021224774, 0.06349081520858552, 0.06516007272809728, 0.06696010199486738, 0.06888219697173235, 0.07091757632659138, 0.07305738852089717, 0.07529271822880437, 0.07761459826843849, 0.08001402927391135, 0.08248200767571197, 0.08500956129446033, 0.08758779100933303, 0.09020791650107668, 0.09286132392192731, 0.0955396134310001, 0.09823464477575396, 0.10093857943047381, 0.10364391816748914, 0.10634353329710976, 0.10903069514192364, 0.11169909259534032, 0.11434284784647857, 0.1169565255332084 ], [ 0.08584630201843735, 0.08327360025941014, 0.08076391073861984, 0.07832759150299737, 0.07597529172677354, 0.07371791291883721, 0.07156655482003409, 0.0695324408273944, 0.06762681771836991, 0.06586082518268802, 0.06424533246179549, 0.06279074240863049, 0.0615067674771178, 0.0604021871905736, 0.05948460181290243, 0.05876020121402575, 0.0582335700853109, 0.05790754969608668, 0.05778317182482733, 0.05785967275044717, 0.058134585565592506, 0.05860389951002251, 0.05926226751293739, 0.06010323912523731, 0.061119496012811775, 0.06230307066978818, 0.06364553478321266, 0.06513815026441432, 0.06677198204834744, 0.06853797647054755, 0.07042701198290582, 0.07242993020940805, 0.07453755519201012, 0.07674070757625077, 0.07903021887744839, 0.08139694921884302, 0.0838318103054178, 0.08632579404809713, 0.08887000625030292, 0.09145570411482193, 0.09407433598446185, 0.0967175816345705, 0.09937739152257091, 0.1020460236062072, 0.1047160766145259, 0.10738051895177082, 0.11003271270391098, 0.11266643248054829, 0.11527587905018613, 0.11785568790938297 ], [ 0.08834398994208, 0.08579806907686172, 0.0833089340292475, 0.08088666861898065, 0.07854171605259115, 0.07628484936170515, 0.0741271261424949, 0.07207982231951357, 0.07015433950428682, 0.06836208107413082, 0.06671429361402341, 0.06522187303489262, 0.06389513854211407, 0.06274358245880221, 0.061775609151397, 0.06099828105397321, 0.06041709290313376, 0.0600357956670689, 0.0598562885654952, 0.05987859105895531, 0.06010089766813006, 0.06051970865513289, 0.06113002095424161, 0.061925557985262794, 0.0628990150404529, 0.06404229874386809, 0.06534674374071216, 0.06680329592980867, 0.06840265783315348, 0.0701353970430699, 0.07199202250339827, 0.07396303551805287, 0.07603896302173879, 0.07821038016043576, 0.08046792803254207, 0.08280233091682088, 0.08520441575676789, 0.08766513528075616, 0.09017559502105893, 0.09272708368934514, 0.09531110585888017, 0.09791941565242064, 0.10054405008455777, 0.10317736080054973, 0.10581204313832476, 0.10844116167291369, 0.11105817164953115, 0.11365693594935866, 0.11623173744534002, 0.11877728678584706 ], [ 0.09078305420108804, 0.08826326522966214, 0.08579451772921935, 0.08338666655500937, 0.08104998768360841, 0.0787951558863502, 0.07663320621275375, 0.07457547392456677, 0.07263350731264473, 0.07081894826249562, 0.06914337675864823, 0.06761811793969871, 0.06625401391916894, 0.06506116723527947, 0.06404866803614227, 0.0632243221480232, 0.06259440093706135, 0.06216343521806661, 0.061934073516561335, 0.06190701951304736, 0.06208105511743409, 0.062453145789676284, 0.06301861536821694, 0.0637713706378763, 0.0647041523877682, 0.06580879007197118, 0.06707644078298118, 0.06849779887698011, 0.07006326887542015, 0.07176310003208607, 0.07358748543171878, 0.07552663136062303, 0.07757080401669755, 0.07971036069509933, 0.0819357717839623, 0.08423763861619986, 0.08660671076769727, 0.08903390499928629, 0.09151032685074069, 0.09402729497591658, 0.09657636767009015, 0.09914937065891406, 0.10173842504902274, 0.10433597433229673, 0.10693480943922394, 0.10952809100810504, 0.11210936824072468, 0.11467259392515242, 0.11721213540423178, 0.11972278144277658 ], [ 0.09316718668852901, 0.09067352911837674, 0.0882256620976134, 0.08583324961775818, 0.08350643164769214, 0.08125580722876223, 0.07909240081357416, 0.0770276064419747, 0.07507310411412374, 0.07324074308206274, 0.0715423879789499, 0.06998972595219233, 0.06859403637492595, 0.06736592919601353, 0.06631506317979238, 0.06544986047042994, 0.06477723807988889, 0.06430237890752963, 0.06402856379776632, 0.06395708151359566, 0.06408722574231866, 0.06441637859791866, 0.06494017036526434, 0.06565269734146921, 0.06654677498870172, 0.06761420278544004, 0.06884601979583968, 0.07023273502873052, 0.07176452279586416, 0.07343137926419485, 0.07522324134004592, 0.0771300724735723, 0.07914192187055055, 0.08124896415703574, 0.08344152610947635, 0.08571010601462203, 0.0880453898915711, 0.09043826744588564, 0.09287984940002458, 0.09536148684643395, 0.09787479253135278, 0.10041166348972436, 0.10296430418157354, 0.10552524918328884, 0.10808738451712531, 0.11064396681592778, 0.1131886396816183, 0.11571544677702796, 0.11821884137072407, 0.12069369221986764 ], [ 0.09550075404898731, 0.09303384060297656, 0.09060796586499408, 0.08823263424541532, 0.08591787380083464, 0.08367422309710608, 0.08151270070301622, 0.07944475190120996, 0.07748216697169465, 0.07563696573393269, 0.07392124415827599, 0.0723469809878321, 0.07092580557188562, 0.0696687324493716, 0.06858587331528569, 0.06768614220735551, 0.06697697411507622, 0.06646407963292181, 0.06615125776919019, 0.06604028505973857, 0.06613089195056046, 0.06642082806867872, 0.06690600819477437, 0.06758072236212324, 0.06843788805688046, 0.06946932073876806, 0.07066600069345436, 0.0720183186893492, 0.07351628878463075, 0.07514972266282402, 0.0769083651023504, 0.07878199405410163, 0.08076049115447805, 0.08283388947714561, 0.08499240522979738, 0.08722645929104728, 0.08952669329152219, 0.09188398363947199, 0.09428945566152723, 0.09673449898453246, 0.09921078447430368, 0.10171028247701212, 0.1042252817560981, 0.10674840834471142, 0.1092726434981137, 0.11179133999118951, 0.11429823612705309, 0.11678746697460711, 0.11925357251355954, 0.12169150251950561 ], [ 0.09778856544843953, 0.09534957350844106, 0.09294736721760367, 0.09059131616774771, 0.08829135382720661, 0.08605796666706901, 0.08390216528789864, 0.08183543217162469, 0.07986964047852008, 0.07801693864319878, 0.07628959661734597, 0.0746998116641448, 0.0732594747545942, 0.07197990281117843, 0.07087154700211425, 0.0699436924137504, 0.0692041688292113, 0.06865909496135425, 0.06831267835365998, 0.06816708970448952, 0.06822242370760986, 0.06847674955330206, 0.06892624456401264, 0.06956539585723644, 0.07038724898566451, 0.07138368007021866, 0.07254566903091426, 0.07386355540564132, 0.07532726376809837, 0.07692649168864944, 0.07865085852759274, 0.08049001748699237, 0.08243373603940646, 0.08447195116956283, 0.08659480606575926, 0.0887926743151711, 0.09105617661870079, 0.09337619381953857, 0.09574387883459125, 0.09815066901549817, 0.10058829961053058, 0.10304881836819683, 0.10552460090527785, 0.10800836622573307, 0.1104931916845617, 0.11297252670346591, 0.1154402046278129, 0.11789045223749622, 0.12031789656482009, 0.1227175688136078 ], [ 0.10003565323599711, 0.09762626438342327, 0.09524990046020981, 0.09291581476330313, 0.09063385707926956, 0.0884144637164347, 0.08626862892101621, 0.08420785238893283, 0.08224405742750134, 0.0803894746858962, 0.07865648746779308, 0.07705743665468148, 0.07560438631977284, 0.07430885516407996, 0.07318152368971222, 0.07223193198442521, 0.07146818729344746, 0.07089670320423558, 0.07052199233531713, 0.0703465313292793, 0.07037071075788355, 0.07059287405657685, 0.07100944024669022, 0.07161509668380092, 0.0724030419078633, 0.07336525578658591, 0.07449277466883793, 0.0757759526067808, 0.0772046948148143, 0.07876865524512396, 0.08045739547913026, 0.08226050640097643, 0.08416769703936715, 0.08616885654770835, 0.08825409574931653, 0.09041377430675376, 0.09263851869487666, 0.094919235036812, 0.09724711970648187, 0.0996136695471443, 0.1020106926787991, 0.10443032019729502, 0.10686501860106551, 0.1093076024942556, 0.111751246974414, 0.11418949908319616, 0.11661628774592994, 0.11902593172132388, 0.12141314520265477, 0.12377304083889461 ], [ 0.1022470708291423, 0.09986940031419697, 0.09752147369975872, 0.0952124405646663, 0.0929520718839987, 0.090750749762235, 0.08861943797896624, 0.08656962819747571, 0.08461325659343681, 0.08276258607694324, 0.08103005039854817, 0.0794280584222895, 0.07796875981612005, 0.0766637773096937, 0.07552391524200903, 0.0745588588435303, 0.07377688279315844, 0.07318459013589802, 0.07278670277503314, 0.07258592192005756, 0.07258287110533404, 0.07277612640560932, 0.07316232956231035, 0.07373637147956441, 0.07449162739259926, 0.07542022187662377, 0.0765133019569828, 0.077761299424756, 0.07915416812337961, 0.08068158736857106, 0.08233312783533066, 0.0840983805211733, 0.08596705244044799, 0.08792903448067858, 0.08997444752101076, 0.09209367274233995, 0.09427737133974319, 0.09651649784257202, 0.09880231016194477, 0.10112637846210873, 0.10348059407608046, 0.10585717899543229, 0.10824869596397872, 0.11064805887891067, 0.11304854302271111, 0.11544379458256325, 0.1178278389294164, 0.1201950871981136, 0.12254034080987067, 0.12485879369083984 ], [ 0.10442771173327563, 0.10208423011939272, 0.09976767234388972, 0.09748709122658766, 0.09525217819935308, 0.0930732516968961, 0.09096122586475267, 0.08892755462616138, 0.08698414613383153, 0.08514324311402684, 0.08341726576400123, 0.0818186158423967, 0.08035944347578436, 0.07905138193743211, 0.0779052599812448, 0.0769308057399318, 0.07613636000304196, 0.07552861903210163, 0.07511242715949494, 0.07489063676388318, 0.07486404784067109, 0.07503143192989878, 0.07538963679888466, 0.07593376044228066, 0.07665737699215615, 0.0775527939112522, 0.0786113196201296, 0.07982352310464655, 0.0811794712473639, 0.08266893463996215, 0.08428155756009136, 0.08600699197703034, 0.08783499853084945, 0.08975551932928295, 0.09175872824405787, 0.09383506439388885, 0.09597525393974043, 0.09817032443679552, 0.10041161498803988, 0.10269078447099582, 0.10499981925260243, 0.10733104111332, 0.10967711558251865, 0.11203106053333374, 0.11438625467351782, 0.11673644547110813, 0.11907575604067125, 0.1213986905608617, 0.12370013787429697, 0.1259753730183601 ], [ 0.10658215296390214, 0.10427560251202848, 0.10199359235257975, 0.09974508027667976, 0.09753967234599994, 0.09538760906983158, 0.09329973150953894, 0.09128742259522013, 0.08936251900974326, 0.0875371895498366, 0.08582377706876394, 0.08423460306990982, 0.08278173681249082, 0.08147673433827352, 0.08033035687744006, 0.0793522821754517, 0.07855082574037654, 0.07793269107959548, 0.0775027679781461, 0.07726399534288023, 0.07721730013140492, 0.07736161698191182, 0.07769398541127207, 0.07820971414559982, 0.07890259649766596, 0.07976515753134923, 0.08078891331599329, 0.08196462457421448, 0.08328253076001453, 0.08473255519036746, 0.08630447646226332, 0.08798806539106932, 0.08977318974345722, 0.09164989099873372, 0.09360843833550445, 0.09563936519837626, 0.09773349338755788, 0.09988194886136578, 0.10207617253968058, 0.10430792848806344, 0.10656931104126076, 0.10885275174249222, 0.11115102645003265, 0.11345726259145412, 0.11576494631083961, 0.11806792913106394, 0.12036043371542282, 0.12263705833568764, 0.12489277971528456, 0.12712295399915513 ], [ 0.1087145253058855, 0.10644783385226249, 0.10420370606511195, 0.1019910016730394, 0.09981923103598218, 0.09769853841874256, 0.09563966493397918, 0.09365388673111595, 0.0917529241680426, 0.08994881833165386, 0.08825377250699702, 0.08667995813835715, 0.08523928751210907, 0.08394315873305451, 0.08280218231035606, 0.0818259023771521, 0.08102252863868792, 0.08039869690111365, 0.0799592758723949, 0.07970723549459166, 0.07964358741706644, 0.0797674018817175, 0.08007589820049703, 0.08056459930499925, 0.08122753561016922, 0.08205748040137699, 0.08304619838350964, 0.08418469068778692, 0.08546342291517188, 0.08687252693219684, 0.08840197137759344, 0.09004169960273302, 0.09178173670035739, 0.09361226924341733, 0.09552370240408117, 0.09750669940798773, 0.09955220800543056, 0.10165147801619473, 0.1037960732073194, 0.1059778799309921, 0.10818911417717288, 0.11042232803756373, 0.11267041605818255, 0.11492662157895456, 0.11718454290779388, 0.1194381390334124, 0.12168173452232924, 0.12391002324849318, 0.12611807064816266, 0.12830131426116462 ], [ 0.11082841186988222, 0.10860460699044969, 0.10640176212646472, 0.10422863169382704, 0.10209461619061043, 0.10000974206498939, 0.09798462114816262, 0.09603038556332395, 0.09415859427163904, 0.09238110811589542, 0.09070993148659395, 0.08915702064437739, 0.08773406129655871, 0.086452221141538, 0.08532188651349187, 0.08435239557201163, 0.08355178314757829, 0.08292655378352401, 0.0824814991968782, 0.0822195740327332, 0.08214183948540124, 0.0822474785876433, 0.08253388055354331, 0.08299678549941947, 0.08363047609625555, 0.08442799988110566, 0.0853814053144757, 0.08648197603247844, 0.0877204505993845, 0.08908721875012289, 0.09057248896134659, 0.09216642567236481, 0.09385925725450009, 0.09564135775611016, 0.09750330654714014, 0.0994359303737656, 0.10143033218461393, 0.10347791058837685, 0.10557037311241312, 0.10769974568339374, 0.10985838003652654, 0.11203896013652409, 0.11423450818946043, 0.11643839044660056, 0.11864432274135944, 0.1208463755426345, 0.12303897823178736, 0.12521692229616793, 0.12737536316032658, 0.12950982043087875 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.591624740511179, 0.4139013160020113, 0.8404103880748153, 0.3435623776167631, 0.19721135217696428, 0.576691678725183, 0.22388350890583075, 0.22614763605379087, 0.2557787204071223, 0.27864991660102584, 0.2838165836925565, 0.2063131749323982, 0.22460155469034737, 0.24685223615890592, 0.2690680995616498, 0.2788134972514314, 0.3253770552978668, 0.24505542124533175, 0.28632936572963935, 0.26727557912529437, 0.31414238559512486, 0.35263091899416993, 0.3517746300481238, 0.42671826779535044 ], "xaxis": "x", "y": [ 0.8699305467307568, 0.5884464969858527, 0.24237056728452444, 0.9154759794473648, 0.05035528354346752, 0.8041578186675906, 0.12379399095015245, 0.1433187081877683, 0.2073283836912209, 0.25979187868094056, 0.23375885357336734, 0.30755308465281295, 0.3110917381547851, 0.29482865591047186, 0.28529167848346026, 0.28840415650199697, 0.3107875965391327, 0.2718793239885519, 0.27132271943480357, 0.3047281738247806, 0.2960320058016347, 0.27539387686001177, 0.2894363193759436, 0.29479881159974686 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "1_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "20_0", "21_0", "22_0", "23_0" ], "type": "scatter", "x": [ 0.591624740511179, 0.4139013160020113, 0.8404103880748153, 0.3435623776167631, 0.19721135217696428, 0.576691678725183, 0.22388350890583075, 0.22614763605379087, 0.2557787204071223, 0.27864991660102584, 0.2838165836925565, 0.2063131749323982, 0.22460155469034737, 0.24685223615890592, 0.2690680995616498, 0.2788134972514314, 0.3253770552978668, 0.24505542124533175, 0.28632936572963935, 0.26727557912529437, 0.31414238559512486, 0.35263091899416993, 0.3517746300481238, 0.42671826779535044 ], "xaxis": "x2", "y": [ 0.8699305467307568, 0.5884464969858527, 0.24237056728452444, 0.9154759794473648, 0.05035528354346752, 0.8041578186675906, 0.12379399095015245, 0.1433187081877683, 0.2073283836912209, 0.25979187868094056, 0.23375885357336734, 0.30755308465281295, 0.3110917381547851, 0.29482865591047186, 0.28529167848346026, 0.28840415650199697, 0.3107875965391327, 0.2718793239885519, 0.27132271943480357, 0.3047281738247806, 0.2960320058016347, 0.27539387686001177, 0.2894363193759436, 0.29479881159974686 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.016039592678794058, -0.559394295180259, -0.559394295180259, -0.559394295180259, -0.8802496627369665, -0.8802496627369665, -1.3055382875582606, -1.3055382875582606, -1.9267666338751648, -2.165372994399996, -2.165372994399996, -2.221284323668139, -2.221284323668139, -2.5348402906383716, -2.5675673384428364, -2.695728018649433, -2.695728018649433, -2.7711438641069313, -2.7711438641069313, -2.9213437457063254, -3.1050950304749843, -3.1418530443729553, -3.189740830093213, -3.2554537620840334, -3.294835480356587 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "text": [ "
Parameterization:
x1: 0.9015583982691169
x2: 0.09575823694467545
x3: 0.591624740511179
x4: 0.8699305467307568
x5: 0.34470195695757866
x6: 0.4267820920795202", "
Parameterization:
x1: 0.07897703815251589
x2: 0.19328522123396397
x3: 0.4139013160020113
x4: 0.5884464969858527
x5: 0.38971101492643356
x6: 0.9613207150250673", "
Parameterization:
x1: 0.5936527075245976
x2: 0.9491333859041333
x3: 0.8404103880748153
x4: 0.24237056728452444
x5: 0.10391643643379211
x6: 0.3320907838642597", "
Parameterization:
x1: 0.6120965592563152
x2: 0.09614580031484365
x3: 0.3435623776167631
x4: 0.9154759794473648
x5: 0.02073571737855673
x6: 0.6086713774129748", "
Parameterization:
x1: 0.4736106339842081
x2: 0.44612090196460485
x3: 0.19721135217696428
x4: 0.05035528354346752
x5: 0.23806970566511154
x6: 0.758322118781507", "
Parameterization:
x1: 0.04662526026368141
x2: 0.5102584837004542
x3: 0.576691678725183
x4: 0.8041578186675906
x5: 0.030156003311276436
x6: 0.33933194912970066", "
Parameterization:
x1: 0.356617910789543
x2: 0.40973617621602276
x3: 0.22388350890583075
x4: 0.12379399095015245
x5: 0.29735811615312535
x6: 0.8468175848306896", "
Parameterization:
x1: 0.2774352249778331
x2: 0.3989987442915353
x3: 0.22614763605379087
x4: 0.1433187081877683
x5: 0.3449282490020067
x6: 0.9193671766132423", "
Parameterization:
x1: 0.338147682411074
x2: 0.35076364260028653
x3: 0.2557787204071223
x4: 0.2073283836912209
x5: 0.2631728987935627
x6: 0.813180674431626", "
Parameterization:
x1: 0.35751952707896373
x2: 0.30889148094930036
x3: 0.27864991660102584
x4: 0.25979187868094056
x5: 0.21962518275450985
x6: 0.7597669770091136", "
Parameterization:
x1: 0.30526593544835295
x2: 0.22268989467468026
x3: 0.2838165836925565
x4: 0.23375885357336734
x5: 0.15919755011718986
x6: 0.7544248113690927", "
Parameterization:
x1: 0.3799278140587318
x2: 0.3225413711452286
x3: 0.2063131749323982
x4: 0.30755308465281295
x5: 0.24259959952864737
x6: 0.7281138019199985", "
Parameterization:
x1: 0.45303884026672
x2: 0.31303243307624895
x3: 0.22460155469034737
x4: 0.3110917381547851
x5: 0.21032336332068927
x6: 0.8103094509296992", "
Parameterization:
x1: 0.3195014305351048
x2: 0.3343490867702806
x3: 0.24685223615890592
x4: 0.29482865591047186
x5: 0.2699593452163157
x6: 0.6843904932700435", "
Parameterization:
x1: 0.2710122230598544
x2: 0.3568190214573015
x3: 0.2690680995616498
x4: 0.28529167848346026
x5: 0.2963423763424665
x6: 0.6198636150703303", "
Parameterization:
x1: 0.3101781271838003
x2: 0.2926297394006788
x3: 0.2788134972514314
x4: 0.28840415650199697
x5: 0.35079662466007955
x6: 0.6409686632840512", "
Parameterization:
x1: 0.3192620118331256
x2: 0.34422101278772643
x3: 0.3253770552978668
x4: 0.3107875965391327
x5: 0.3973186702267042
x6: 0.6600736404614714", "
Parameterization:
x1: 0.29466702186655375
x2: 0.25407122927725617
x3: 0.24505542124533175
x4: 0.2718793239885519
x5: 0.3218160679395741
x6: 0.6070992352237689", "
Parameterization:
x1: 0.3594450159837844
x2: 0.24619875992605839
x3: 0.28632936572963935
x4: 0.27132271943480357
x5: 0.31289325396641604
x6: 0.5731198123636957", "
Parameterization:
x1: 0.24723654908335171
x2: 0.22714266660609614
x3: 0.26727557912529437
x4: 0.3047281738247806
x5: 0.3219902571070175
x6: 0.6186310289645711", "
Parameterization:
x1: 0.20219900431073753
x2: 0.1790963812780852
x3: 0.31414238559512486
x4: 0.2960320058016347
x5: 0.32077365509415084
x6: 0.6366502201142857", "
Parameterization:
x1: 0.15535158321810666
x2: 0.11062969648377831
x3: 0.35263091899416993
x4: 0.27539387686001177
x5: 0.32398325876731454
x6: 0.6471027413168984", "
Parameterization:
x1: 0.21864449169485786
x2: 0.10934985977910393
x3: 0.3517746300481238
x4: 0.2894363193759436
x5: 0.3131448737799455
x6: 0.6668532575023057", "
Parameterization:
x1: 0.2214675716720253
x2: 0.09944705457974683
x3: 0.42671826779535044
x4: 0.29479881159974686
x5: 0.30662336254152744
x6: 0.6424184201249653", "
Parameterization:
x1: 0.22445742000484128
x2: 0.1255994518914273
x3: 0.5107238808646584
x4: 0.2785744660662527
x5: 0.3154957306910275
x6: 0.6569950864310666" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.016039592678794058, -0.559394295180259, -0.559394295180259, -0.559394295180259, -0.8802496627369665, -0.8802496627369665, -1.3055382875582606, -1.3055382875582606, -1.9267666338751648, -2.165372994399996, -2.165372994399996, -2.221284323668139, -2.221284323668139, -2.5348402906383716, -2.5675673384428364, -2.695728018649433, -2.695728018649433, -2.7711438641069313, -2.7711438641069313, -2.9213437457063254, -3.1050950304749843, -3.1418530443729553, -3.189740830093213, -3.2554537620840334, -3.294835480356587 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.016039592678794058, -0.559394295180259, -0.559394295180259, -0.559394295180259, -0.8802496627369665, -0.8802496627369665, -1.3055382875582606, -1.3055382875582606, -1.9267666338751648, -2.165372994399996, -2.165372994399996, -2.221284323668139, -2.221284323668139, -2.5348402906383716, -2.5675673384428364, -2.695728018649433, -2.695728018649433, -2.7711438641069313, -2.7711438641069313, -2.9213437457063254, -3.1050950304749843, -3.1418530443729553, -3.189740830093213, -3.2554537620840334, -3.294835480356587 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
\n", " \n", " \n", "
\n", " \n", "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)) # Objective_optimum is optional." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:40] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:41] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "restored_ax_client = AxClient.load_from_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 15, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:41] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"postgresql+psycopg2://sarah:c82i94d@ocalhost:5432/foobar\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:45] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.18, 'x2': 0.13, 'x3': 0.55, 'x4': 0.31, 'x5': 0.3, 'x6': 0.67}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:45] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 03-20 17:00:45] ax.service.ax_client: Attached custom parameterization {'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9} as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 17, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9})" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.1" } }, "nbformat": 4, "nbformat_minor": 2 }