{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Ax Service API with RayTune on PyTorch CNN\n", "\n", "Ax integrates easily with different scheduling frameworks and distributed training frameworks. In this example, Ax-driven optimization is executed in a distributed fashion using [RayTune](https://ray.readthedocs.io/en/latest/tune.html). \n", "\n", "RayTune is a scalable framework for hyperparameter tuning that provides many state-of-the-art hyperparameter tuning algorithms and seamlessly scales from laptop to distributed cluster with fault tolerance. RayTune leverages [Ray](https://ray.readthedocs.io/)'s Actor API to provide asynchronous parallel and distributed execution.\n", "\n", "Ray 'Actors' are a simple and clean abstraction for replicating your Python classes across multiple workers and nodes. Each hyperparameter evaluation is asynchronously executed on a separate Ray actor and reports intermediate training progress back to RayTune. Upon reporting, RayTune then uses this information to performs actions such as early termination, re-prioritization, or checkpointing." ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "import logging\n", "\n", "from ray import tune\n", "from ray.tune import track\n", "from ray.tune.suggest.ax import AxSearch\n", "\n", "logger = logging.getLogger(tune.__name__)\n", "logger.setLevel(\n", " level=logging.CRITICAL\n", ") # Reduce the number of Ray warnings that are not relevant here." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:21] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "import numpy as np\n", "import torch\n", "from ax.plot.contour import plot_contour\n", "from ax.plot.trace import optimization_trace_single_method\n", "from ax.service.ax_client import AxClient\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "from ax.utils.tutorials.cnn_utils import CNN, evaluate, load_mnist, train\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1. Initialize client\n", "We specify `enforce_sequential_optimization` as False, because Ray runs many trials in parallel. With the sequential optimization enforcement, `AxClient` would expect the first few trials to be completed with data before generating more trials.\n", "\n", "When high parallelism is not required, it is best to enforce sequential optimization, as it allows for achieving optimal results in fewer (but sequential) trials. In cases where parallelism is important, such as with distributed training using Ray, we choose to forego minimizing resource utilization and run more trials in parallel." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:21] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 2 decimal points.\n" ] } ], "source": [ "ax = AxClient(enforce_sequential_optimization=False)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2. Set up experiment\n", "Here we set up the search space and specify the objective; refer to the Ax API tutorials for more detail." ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:21] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter lr. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:21] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter momentum. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:21] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax.create_experiment(\n", " name=\"mnist_experiment\",\n", " parameters=[\n", " {\"name\": \"lr\", \"type\": \"range\", \"bounds\": [1e-6, 0.4], \"log_scale\": True},\n", " {\"name\": \"momentum\", \"type\": \"range\", \"bounds\": [0.0, 1.0]},\n", " ],\n", " objective_name=\"mean_accuracy\",\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3. Define how to evaluate trials\n", "Since we use the Ax Service API here, we evaluate the parameterizations that Ax suggests, using RayTune. The evaluation function follows its usual pattern, taking in a parameterization and outputting an objective value. For detail on evaluation functions, see [Trial Evaluation](https://ax.dev/docs/runner.html). " ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [], "source": [ "def train_evaluate(parameterization):\n", " device = torch.device(\"cuda\" if torch.cuda.is_available() else \"cpu\")\n", " train_loader, valid_loader, test_loader = load_mnist(data_path=\"~/.data\")\n", " net = train(\n", " net=CNN(),\n", " train_loader=train_loader,\n", " parameters=parameterization,\n", " dtype=torch.float,\n", " device=device,\n", " )\n", " track.log(\n", " mean_accuracy=evaluate(\n", " net=net,\n", " data_loader=valid_loader,\n", " dtype=torch.float,\n", " device=device,\n", " )\n", " )" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 4. Run optimization\n", "Execute the Ax optimization and trial evaluation in RayTune using [AxSearch algorithm](https://ray.readthedocs.io/en/latest/tune-searchalg.html#ax-search):" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:22,401\tINFO services.py:1092 -- View the Ray dashboard at \u001b[1m\u001b[32mhttp://127.0.0.1:8265\u001b[39m\u001b[22m\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:24] ax.service.ax_client: Generated new trial 0 with parameters {'lr': 0.0, 'momentum': 0.21}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:24] ax.service.ax_client: Generated new trial 1 with parameters {'lr': 0.0, 'momentum': 0.93}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:24] ax.service.ax_client: Generated new trial 2 with parameters {'lr': 0.01, 'momentum': 0.75}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:24,594\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 7bbd902801000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4340)\u001b[0m 2020-12-08 18:53:24,588\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4340)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "2020-12-08 18:53:24,645\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID df5a1a8201000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4339)\u001b[0m 2020-12-08 18:53:24,629\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4339)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:24] ax.service.ax_client: Generated new trial 3 with parameters {'lr': 0.06, 'momentum': 0.34}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:24] ax.service.ax_client: Generated new trial 4 with parameters {'lr': 0.0, 'momentum': 0.86}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:25,542\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 3bf0c85601000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:25,601\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID ae935fc001000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4423)\u001b[0m 2020-12-08 18:53:25,537\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4423)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m 2020-12-08 18:53:25,591\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4422)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:25] ax.service.ax_client: Generated new trial 5 with parameters {'lr': 0.0, 'momentum': 0.07}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:25] ax.service.ax_client: Generated new trial 6 with parameters {'lr': 0.0, 'momentum': 0.16}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4446)\u001b[0m 2020-12-08 18:53:25,988\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4446)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "2020-12-08 18:53:26,002\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID b7603b6c01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:26] ax.service.ax_client: Generated new trial 7 with parameters {'lr': 0.12, 'momentum': 0.97}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:26,687\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID be3cb80901000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4476)\u001b[0m 2020-12-08 18:53:26,678\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4476)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:26] ax.service.ax_client: Generated new trial 8 with parameters {'lr': 0.0, 'momentum': 0.38}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:26,964\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID af23404c01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4492)\u001b[0m 2020-12-08 18:53:26,959\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4492)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:27] ax.service.ax_client: Generated new trial 9 with parameters {'lr': 0.0, 'momentum': 0.61}." ] }, { "name": "stderr", "output_type": "stream", "text": [ "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:27,242\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 7d26912601000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4479)\u001b[0m 2020-12-08 18:53:27,232\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4479)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:27] ax.service.ax_client: Generated new trial 10 with parameters {'lr': 0.0, 'momentum': 0.7}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:28,071\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 335d6f0801000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4531)\u001b[0m 2020-12-08 18:53:28,067\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4531)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "2020-12-08 18:53:28,242\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID ad5fa5cb01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4534)\u001b[0m 2020-12-08 18:53:28,231\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4534)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:28] ax.service.ax_client: Generated new trial 11 with parameters {'lr': 0.0, 'momentum': 0.29}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:28,570\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 35d7a3b901000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4549)\u001b[0m 2020-12-08 18:53:28,565\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4549)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:28] ax.service.ax_client: Generated new trial 12 with parameters {'lr': 0.0, 'momentum': 0.93}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:28] ax.service.ax_client: Generated new trial 13 with parameters {'lr': 0.01, 'momentum': 0.86}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:29,466\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID b9c4a7c601000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:29,488\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 91fdfca801000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4585)\u001b[0m 2020-12-08 18:53:29,478\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4585)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m 2020-12-08 18:53:29,453\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4588)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:29] ax.service.ax_client: Generated new trial 14 with parameters {'lr': 0.0, 'momentum': 0.72}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:29,831\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID c65d7ae001000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4602)\u001b[0m 2020-12-08 18:53:29,822\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4602)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:30] ax.service.ax_client: Generated new trial 15 with parameters {'lr': 0.0, 'momentum': 0.63}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:30] ax.service.ax_client: Generated new trial 16 with parameters {'lr': 0.0, 'momentum': 0.38}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:30,765\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 090f0d8b01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4639)\u001b[0m 2020-12-08 18:53:30,757\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4639)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:31,028\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 3d80c2fe01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4640)\u001b[0m 2020-12-08 18:53:31,013\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4640)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:31] ax.service.ax_client: Generated new trial 17 with parameters {'lr': 0.05, 'momentum': 0.34}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:31] ax.service.ax_client: Generated new trial 18 with parameters {'lr': 0.02, 'momentum': 0.08}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:31,671\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 4305340a01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4657)\u001b[0m 2020-12-08 18:53:31,665\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4657)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:32,064\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID a7357af301000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4678)\u001b[0m 2020-12-08 18:53:32,049\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4678)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:32] ax.service.ax_client: Generated new trial 19 with parameters {'lr': 0.0, 'momentum': 0.28}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:32,575\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 31965ca801000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4696)\u001b[0m 2020-12-08 18:53:32,551\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4696)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:32] ax.service.ax_client: Generated new trial 20 with parameters {'lr': 0.0, 'momentum': 0.0}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:33] ax.service.ax_client: Generated new trial 21 with parameters {'lr': 0.0, 'momentum': 0.11}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:33,136\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 8fcb3d8501000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4714)\u001b[0m 2020-12-08 18:53:33,126\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4714)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:33] ax.service.ax_client: Generated new trial 22 with parameters {'lr': 0.0, 'momentum': 0.78}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:33,657\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID c662ca5a01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4732)\u001b[0m 2020-12-08 18:53:33,646\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4732)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:34,139\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID a5450a3401000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4753)\u001b[0m 2020-12-08 18:53:34,115\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4753)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:34] ax.service.ax_client: Generated new trial 23 with parameters {'lr': 0.0, 'momentum': 0.64}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:34,366\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID b299cffa01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4771)\u001b[0m 2020-12-08 18:53:34,350\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4771)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:34] ax.service.ax_client: Generated new trial 24 with parameters {'lr': 0.0, 'momentum': 0.62}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:35,066\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 65710efb01000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4789)\u001b[0m 2020-12-08 18:53:35,060\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4789)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:35] ax.service.ax_client: Generated new trial 25 with parameters {'lr': 0.0, 'momentum': 0.09}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:35] ax.service.ax_client: Generated new trial 26 with parameters {'lr': 0.0, 'momentum': 0.95}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4808)\u001b[0m 2020-12-08 18:53:35,764\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in 2020-12-08 18:53:35,779\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 1211da1301000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4808)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:36,152\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 03d9348501000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m 2020-12-08 18:53:36,132\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4826)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:36] ax.service.ax_client: Generated new trial 27 with parameters {'lr': 0.1, 'momentum': 0.04}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:36,689\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 814c5aa201000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m 2020-12-08 18:53:36,670\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4844)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4844)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n", "[INFO 12-08 18:53:36] ax.service.ax_client: Generated new trial 28 with parameters {'lr': 0.01, 'momentum': 0.48}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:37,005\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 90e2cc4001000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4862)\u001b[0m 2020-12-08 18:53:37,000\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4862)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 12-08 18:53:37] ax.service.ax_client: Generated new trial 29 with parameters {'lr': 0.06, 'momentum': 0.89}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:37,608\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID 296a970401000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4880)\u001b[0m 2020-12-08 18:53:37,601\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4880)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "2020-12-08 18:53:37,901\tWARNING worker.py:1091 -- Failed to unpickle actor class 'ImplicitFunc' for actor ID f3b32ee701000000. Traceback:\n", "Traceback (most recent call last):\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", " actor_class = pickle.loads(pickled_class)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", " from ray.tune.tune import run_experiments, run\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", " from ray.tune.analysis import ExperimentAnalysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", " from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", " from ray.tune.trial import Trial\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", " from ray.tune.durable_trainable import DurableTrainable\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", " from ray.tune.trainable import Trainable, TrainableUtil\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", " from ray.tune.logger import UnifiedLogger\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", " from ray.tune.syncer import get_node_syncer\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", " @dataclass\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", " return wrap(_cls)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", " return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", " for name, type in cls_annotations.items()]\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", " if (_is_classvar(a_type, typing)\n", " File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", " return type(a_type) is typing._ClassVar\n", "AttributeError: module 'typing' has no attribute '_ClassVar'\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "\u001b[2m\u001b[36m(pid=4898)\u001b[0m 2020-12-08 18:53:37,894\tERROR function_manager.py:495 -- Failed to load actor class ImplicitFunc.\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m Traceback (most recent call last):\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/function_manager.py\", line 493, in _load_actor_class_from_gcs\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m actor_class = pickle.loads(pickled_class)\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/__init__.py\", line 2, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.tune import run_experiments, run\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\", line 7, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.analysis import ExperimentAnalysis\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/__init__.py\", line 1, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.analysis.experiment_analysis import ExperimentAnalysis, Analysis\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/analysis/experiment_analysis.py\", line 19, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.trial import Trial\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trial.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.durable_trainable import DurableTrainable\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/durable_trainable.py\", line 4, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.trainable import Trainable, TrainableUtil\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/trainable.py\", line 23, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.logger import UnifiedLogger\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/logger.py\", line 15, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m from ray.tune.syncer import get_node_syncer\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/syncer.py\", line 80, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m @dataclass\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 958, in dataclass\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m return wrap(_cls)\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 950, in wrap\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m return _process_class(cls, init, repr, eq, order, unsafe_hash, frozen)\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in _process_class\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 801, in \n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m for name, type in cls_annotations.items()]\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 659, in _get_field\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m if (_is_classvar(a_type, typing)\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m File \"/home/travis/virtualenv/python3.7.1/lib/python3.7/site-packages/dataclasses.py\", line 550, in _is_classvar\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m return type(a_type) is typing._ClassVar\n", "\u001b[2m\u001b[36m(pid=4898)\u001b[0m AttributeError: module 'typing' has no attribute '_ClassVar'\n" ] }, { "ename": "TuneError", "evalue": "('Trials did not complete', [train_evaluate_a62ae542, train_evaluate_a62ae543, train_evaluate_a62ae544, train_evaluate_a62ae545, train_evaluate_a62ae546, train_evaluate_a62ae547, train_evaluate_a62ae548, train_evaluate_a7501014, train_evaluate_a7501015, train_evaluate_a7501016, train_evaluate_a7501017, train_evaluate_a88ec902, train_evaluate_a88ec903, train_evaluate_a88ec904, train_evaluate_a88ec905, train_evaluate_a88ec906, train_evaluate_a9c379ee, train_evaluate_a9c379ef, train_evaluate_a9c379f0, train_evaluate_a9c379f1, train_evaluate_aaf1e22e, train_evaluate_aaf1e22f, train_evaluate_aaf1e230, train_evaluate_aaf1e231, train_evaluate_ac475294, train_evaluate_ac475295, train_evaluate_ac475296, train_evaluate_ac475297, train_evaluate_ad761cc2, train_evaluate_ad761cc3])", "output_type": "error", "traceback": [ "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mTuneError\u001b[0m Traceback (most recent call last)", "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m\u001b[0m\n\u001b[1;32m 3\u001b[0m \u001b[0mnum_samples\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m30\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 4\u001b[0m \u001b[0msearch_alg\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0mAxSearch\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0max_client\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0max\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mmax_concurrent\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m3\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m,\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m----> 5\u001b[0;31m \u001b[0mverbose\u001b[0m\u001b[0;34m=\u001b[0m\u001b[0;36m0\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0;31m# Set this level to 1 to see status updates and to 2 to also see trial results.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 6\u001b[0m \u001b[0;31m# To use GPU, specify: resources_per_trial={\"gpu\": 1}.\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 7\u001b[0m )\n", "\u001b[0;32m~/virtualenv/python3.7.1/lib/python3.7/site-packages/ray/tune/tune.py\u001b[0m in \u001b[0;36mrun\u001b[0;34m(run_or_experiment, name, metric, mode, stop, time_budget_s, config, resources_per_trial, num_samples, local_dir, search_alg, scheduler, keep_checkpoints_num, checkpoint_score_attr, checkpoint_freq, checkpoint_at_end, verbose, progress_reporter, loggers, log_to_file, trial_name_creator, trial_dirname_creator, sync_config, export_formats, max_failures, fail_fast, restore, server_port, resume, queue_trials, reuse_actors, trial_executor, raise_on_failed_trial, callbacks, ray_auto_init, run_errored_only, global_checkpoint_period, with_server, upload_dir, sync_to_cloud, sync_to_driver, sync_on_checkpoint)\u001b[0m\n\u001b[1;32m 432\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mincomplete_trials\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 433\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mraise_on_failed_trial\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m--> 434\u001b[0;31m \u001b[0;32mraise\u001b[0m \u001b[0mTuneError\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"Trials did not complete\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mincomplete_trials\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 435\u001b[0m \u001b[0;32melse\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 436\u001b[0m \u001b[0mlogger\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0merror\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"Trials did not complete: %s\"\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mincomplete_trials\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;31mTuneError\u001b[0m: ('Trials did not complete', [train_evaluate_a62ae542, train_evaluate_a62ae543, train_evaluate_a62ae544, train_evaluate_a62ae545, train_evaluate_a62ae546, train_evaluate_a62ae547, train_evaluate_a62ae548, train_evaluate_a7501014, train_evaluate_a7501015, train_evaluate_a7501016, train_evaluate_a7501017, train_evaluate_a88ec902, train_evaluate_a88ec903, train_evaluate_a88ec904, train_evaluate_a88ec905, train_evaluate_a88ec906, train_evaluate_a9c379ee, train_evaluate_a9c379ef, train_evaluate_a9c379f0, train_evaluate_a9c379f1, train_evaluate_aaf1e22e, train_evaluate_aaf1e22f, train_evaluate_aaf1e230, train_evaluate_aaf1e231, train_evaluate_ac475294, train_evaluate_ac475295, train_evaluate_ac475296, train_evaluate_ac475297, train_evaluate_ad761cc2, train_evaluate_ad761cc3])" ] } ], "source": [ "tune.run(\n", " train_evaluate,\n", " num_samples=30,\n", " search_alg=AxSearch(ax_client=ax, max_concurrent=3),\n", " verbose=0, # Set this level to 1 to see status updates and to 2 to also see trial results.\n", " # To use GPU, specify: resources_per_trial={\"gpu\": 1}.\n", ")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 5. Retrieve the optimization results" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'lr': 0.001200477766990381, 'momentum': 0.6754525434808601}" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'mean_accuracy': 0.9713334434324482}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 6. Plot the response surface and optimization trace" ] }, { "cell_type": "code", "execution_count": 9, "metadata": { "scrolled": false }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/Users/deriksson/opt/anaconda3/lib/python3.8/site-packages/ax/modelbridge/torch.py:311: UserWarning:\n", "\n", "To copy construct from a tensor, it is recommended to use sourceTensor.clone().detach() or sourceTensor.clone().detach().requires_grad_(True), rather than torch.tensor(sourceTensor).\n", "\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 1e-06, 1.3011511650442548e-06, 1.692994354296022e-06, 2.2028415765056147e-06, 2.866229883678204e-06, 3.729398352432554e-06, 4.852511011181743e-06, 6.3138503555892e-06, 8.215273746089953e-06, 1.0689313005882424e-05, 1.390841207112662e-05, 1.809694657026198e-05, 2.354686311364001e-05, 3.063802837345029e-05, 3.986470631277378e-05, 5.1870009063012666e-05, 6.749072272319499e-05, 8.781563250096393e-05, 0.00011426141253772724, 0.00014867137004306603, 0.00019344392634026088, 0.0002516997901283655, 0.0003274994751669172, 0.0004261263236648159, 0.0005544547624925005, 0.0007214294601814526, 0.000938688782612345, 0.0012213760031100258, 0.0015891948094037057, 0.002067782677737912, 0.0026904978401970136, 0.0035007443993213955, 0.004554997653699184, 0.005926740503884541, 0.007711585311544345, 0.010033938212454078, 0.013055670395116691, 0.01698740074503987, 0.02210317627048227, 0.028759573555516536, 0.03742055263793628, 0.04868979566145066, 0.06335278435066323, 0.0824315491666629, 0.10725590623460621, 0.13955614735503497, 0.18158364372009145, 0.23626776957937787, 0.3074200836506151, 0.4 ], "xaxis": "x", "y": [ 0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1 ], "yaxis": "y", "z": [ [ 0.2724472464085492, 0.26554332213611187, 0.26366510366338447, 0.2682183323847619, 0.280498437241923, 0.3013887024670263, 0.33096232565052586, 0.3684771084410561, 0.4127361579106892, 0.4623411750075113, 0.5158188432443402, 0.571665546295276, 0.6283436825744443, 0.6842557713869393, 0.7377199336369074, 0.7869719669145879, 0.8302253863362982, 0.8658322236786717, 0.8926053571180782, 0.9103664436831206, 0.9203166574912228, 0.9245508433456133, 0.9254483270412535, 0.9252744709413567, 0.9259077594143799, 0.9286397249930773, 0.9341257314463806, 0.9423889372980363, 0.9526995546256407, 0.9632761881556227, 0.9708164253075311, 0.9706519247103306, 0.9586531813170384, 0.9332098423963258, 0.8949631630224641, 0.8456874540974688, 0.7875845694702691, 0.7229059534128801, 0.6537774578601419, 0.5821455542420872, 0.5097937237447466, 0.4383962633895532, 0.3695866487308783, 0.3050215873970152, 0.24642149197526397, 0.1955638006623447, 0.15419711091810728, 0.12383055306258173, 0.10533368967810919, 0.09841208107848987 ], [ 0.2741575794474219, 0.267443091209657, 0.2657102782809764, 0.27032774283712413, 0.2825382464105069, 0.3031639819079908, 0.3322768219340179, 0.36918989053517826, 0.4127538839679273, 0.4616062770037149, 0.5143030697779538, 0.5693685025271519, 0.6252957124835645, 0.680524648179426, 0.7334209058259346, 0.782280741302417, 0.8253936492037668, 0.8612051763649483, 0.8886367611730919, 0.9075707312916428, 0.919114847999533, 0.9252129416363736, 0.9280766242911477, 0.9297817378715809, 0.9320013741517057, 0.9358406123544456, 0.9418077265158122, 0.9498301209164647, 0.9591514501869864, 0.9680409209473108, 0.9734069383905181, 0.9710623646696825, 0.9573450564677639, 0.9307343376036498, 0.8917677015445266, 0.8421084929159168, 0.7838655571282588, 0.7192226505105574, 0.6502626918831345, 0.5789082818854974, 0.506930672128844, 0.43599662602015216, 0.36773112089029114, 0.30377691636152754, 0.24583115973313885, 0.19563474695103622, 0.15488174430438273, 0.12500359389742188, 0.10678140637663569, 0.09992227842703694 ], [ 0.28000522292988755, 0.27390887630553096, 0.27267419042914626, 0.2775652318401057, 0.28968949453263393, 0.3097458035066538, 0.3377986065854878, 0.37326622691125877, 0.415115796270264, 0.46207566575061787, 0.5127701715600173, 0.5657800741627848, 0.6196545484416139, 0.6729001562541641, 0.7239706879387064, 0.771283315599727, 0.8132916686446381, 0.8486528593947372, 0.8765161139828683, 0.8968678170535208, 0.9106649464844299, 0.9195623544504786, 0.9254538124107993, 0.9300844233621762, 0.934793827724341, 0.9403874161364331, 0.9471276651905522, 0.9547602231396795, 0.9624405168723192, 0.9685124049367486, 0.9703221144689154, 0.9645716839721001, 0.9484314014654297, 0.9205909587084016, 0.8813606060907851, 0.8321142846192201, 0.7747334164501655, 0.711250836092893, 0.64366036548435, 0.573836686899976, 0.5035254211338175, 0.43437481723441507, 0.36798651251640796, 0.30596500200201737, 0.24994448300520344, 0.2015677750900664, 0.16238579934714437, 0.13364415271036034, 0.11596104910320637, 0.10905325864156468 ], [ 0.2894251046060471, 0.28425054954497947, 0.2837299020955476, 0.2889764819804823, 0.3009283489673688, 0.3201547701054373, 0.34670635133441574, 0.380102139901868, 0.4194505431757109, 0.463608898447165, 0.5113063742299995, 0.5612123762560216, 0.6119629669250604, 0.6621661032442631, 0.7104080978156014, 0.7552851585195641, 0.7954856571360398, 0.8299451886541607, 0.8580695105351733, 0.8799460682353918, 0.8963877355388993, 0.9087239738544731, 0.9184448882928817, 0.926862793062331, 0.934880081970999, 0.9428896035428683, 0.9507957532154814, 0.9580821187550264, 0.9638057421034432, 0.9664882889371511, 0.9640823272560544, 0.9542783126396819, 0.9351544331946674, 0.9057587392637549, 0.8662564773729374, 0.817700740002623, 0.7616828945791878, 0.7000321291434005, 0.6346153636504723, 0.567231409245274, 0.49957641641967654, 0.43325572039682575, 0.36981875399109804, 0.310794857097113, 0.25770737559548196, 0.21204165016107068, 0.17514229438669648, 0.14802707750514543, 0.1311514369936858, 0.12424088924691112 ], [ 0.3016228784633914, 0.2975314347577355, 0.29780561488923285, 0.30339092728750394, 0.315056668426374, 0.33325412832304396, 0.35801557708358345, 0.3889417328384028, 0.42527641670877714, 0.4660198396614983, 0.5100309304089599, 0.5560968693533627, 0.6029720695679486, 0.6494006326948187, 0.6941405516575722, 0.7360089180885073, 0.7739651411939441, 0.8072386543868447, 0.8354800551401145, 0.8588711484080476, 0.8781069901883429, 0.8942138184240807, 0.9082628361723234, 0.9210867795743926, 0.9330832576352889, 0.9441461893071417, 0.9537293822014349, 0.9609943356491506, 0.964907633730336, 0.9642254513898691, 0.95753054602181, 0.9434452104829923, 0.9209284635720956, 0.8894826785724093, 0.8492715557761705, 0.8011286620939831, 0.7463993661373792, 0.6867140663301695, 0.6237959098231602, 0.559339498891063, 0.4949567395680836, 0.43217090980833933, 0.37243628705926796, 0.3171605681173082, 0.267707890349581, 0.22536165493800375, 0.19123199334605712, 0.1661100891775118, 0.15030702453063605, 0.1435528364009948 ], [ 0.3157262054111274, 0.3127617730684038, 0.31381717042754975, 0.3196742381663911, 0.3309496398801323, 0.3479924820967128, 0.3708147147508975, 0.3990799188964455, 0.4321501566889808, 0.4691654197300093, 0.5091252511043322, 0.5509544581205266, 0.593550356350867, 0.6358194789181477, 0.6767164098831803, 0.7152975683591274, 0.750798006735503, 0.7827271771945667, 0.8109588215211171, 0.8357682206054999, 0.8577682797258436, 0.8777316492172679, 0.896342120477231, 0.9139538623836946, 0.9304334554857883, 0.9451315064777245, 0.9569988800206597, 0.9648309786964313, 0.9674827360958332, 0.9639106689233817, 0.9532374966839745, 0.9348817244636496, 0.9086162595353445, 0.874462025878275, 0.8327455213349972, 0.7842645830671024, 0.7302443475991425, 0.6721731367922742, 0.6116362173779122, 0.5501989174165325, 0.48934714591050094, 0.4304726517658353, 0.3748829743777736, 0.3238148309503648, 0.278431196021975, 0.2397862033540077, 0.2087503773815984, 0.18590463298959237, 0.1714338194183489, 0.16506652572541047 ], [ 0.33090151041608307, 0.32903013691806515, 0.33080352437464033, 0.33685529396881586, 0.3476707119672853, 0.36351287768377716, 0.38437390071547195, 0.40996557252220034, 0.43974977832875434, 0.4729950554768373, 0.5088412126876696, 0.5463591423271783, 0.5846019858105238, 0.6226512784728795, 0.6596653504325656, 0.6949365697483854, 0.7279585101174292, 0.7584933923518744, 0.7866160102097093, 0.8126999979329672, 0.837317476553482, 0.8610505321561193, 0.8842531972300135, 0.9068337235192497, 0.9281316030976784, 0.9469410709531071, 0.9616977863928513, 0.9708041261021179, 0.9729288465241233, 0.9671288974331241, 0.9529303677311337, 0.930379668989136, 0.8999433067761688, 0.8622250561580393, 0.8179320234951611, 0.7680460253915596, 0.7138253338018693, 0.6566941692750226, 0.5981175243200552, 0.5395092628461952, 0.48218507339142147, 0.4273519119166017, 0.3761173869088214, 0.3295010369438802, 0.28843158234138433, 0.25371917477317785, 0.22600004522591854, 0.2056630751526135, 0.1927808374368235, 0.18707391680655994 ], [ 0.34642315761834486, 0.3455704101105299, 0.3479845049107086, 0.35417096426831374, 0.3645055254882212, 0.3791807867397843, 0.3981715979958326, 0.42122787660138916, 0.4478954383095062, 0.47755758701278916, 0.5094869187053014, 0.5428988430721968, 0.577003221448712, 0.611055105324313, 0.6444077171671811, 0.6765695009337739, 0.7072618614849767, 0.7364655242135845, 0.7644336557928936, 0.7916444033282068, 0.8186717109043387, 0.8459761365198013, 0.8736539258676586, 0.9012186817270773, 0.9275031074975365, 0.9507423978668483, 0.9688448965331217, 0.9797836260514008, 0.981957705115463, 0.9744122560931364, 0.9569443180951619, 0.9300860854111423, 0.8948974389727402, 0.8526369335086204, 0.8046027496270847, 0.7521612307378782, 0.6967443245977044, 0.6397854384381133, 0.582646179105215, 0.5265670577412674, 0.4726500756272192, 0.42186616145169703, 0.3750741863866063, 0.33303754059568347, 0.2964267923599924, 0.26580183827827175, 0.24157394620555428, 0.22395646139048742, 0.21292024594370984, 0.20817208178607727 ], [ 0.3617018875433935, 0.36178155561350767, 0.3647689673790302, 0.371062686137307, 0.3809496372249802, 0.3945664531074689, 0.4118748965324776, 0.43265684346787187, 0.4565296025683414, 0.48297778117023865, 0.5113956502740107, 0.5411346112705541, 0.5715528303262318, 0.60206658162248, 0.632203765389337, 0.6616584620331135, 0.6903408924954452, 0.718410247888281, 0.7462703220787676, 0.7745032895133233, 0.8037206086100787, 0.8343283293935018, 0.8662421780318402, 0.8986396026782454, 0.9298676798325652, 0.9575892520701799, 0.9791484448038589, 0.9920407852548373, 0.9943428080179859, 0.9850103277213159, 0.9640214307556974, 0.9323303723328876, 0.8916019817710656, 0.8438233525379415, 0.7910002978592137, 0.7350166295877861, 0.6775763796212986, 0.6201703293266504, 0.5640609167539148, 0.510289376561745, 0.459702332558121, 0.4129892247013087, 0.37071988820816265, 0.333372520936874, 0.3013451536336628, 0.27494798594227854, 0.2543791563126243, 0.2396918619552859, 0.23076461612769517, 0.22728679488815917 ], [ 0.3762851113135359, 0.3772182648584778, 0.38073515186697515, 0.38714769573924235, 0.39667290407405814, 0.40940487794415187, 0.4252975028807183, 0.4441614605257169, 0.4656764020715872, 0.489416397362592, 0.5148852392155119, 0.5415582192705035, 0.5689280871834643, 0.5965540381387167, 0.6241127091099427, 0.6514485618869319, 0.6786173847662043, 0.7059111928967429, 0.7338464638522678, 0.7630921719615047, 0.7943127391321493, 0.8279110163817162, 0.8636929917535275, 0.9005534188274793, 0.936360020362766, 0.9681698358807485, 0.9927216332025488, 1.0070112146896628, 1.0087872739874004, 0.996903879878451, 0.971508672632319, 0.9340085072125036, 0.8867557996054327, 0.8325448750794386, 0.7741397278126099, 0.713981537964943, 0.6540700814137325, 0.5959530057587089, 0.5407712077411473, 0.48933043617830946, 0.44218094946105424, 0.39969269355223075, 0.3621171162661968, 0.3296299680482194, 0.30235271329818747, 0.28035360665022635, 0.26363296633477684, 0.2521002204332974, 0.24555202514518937, 0.243660219747726 ], [ 0.3898406881375465, 0.3915663305060214, 0.3955980084339168, 0.4021796254000841, 0.4114750992998355, 0.4235482026220189, 0.43835063142417297, 0.4557208214174286, 0.4753943267015262, 0.49702489738391264, 0.5202143276832398, 0.544548915914072, 0.5696407269739454, 0.5951721992639558, 0.6209423477136625, 0.6469113813042374, 0.6732377286921921, 0.7002972751623139, 0.7286692875242445, 0.7590673545718397, 0.7921874119593676, 0.828442581616212, 0.8675754291703682, 0.9082358556130772, 0.9477957104434326, 0.9826596815286963, 1.008947338215385, 1.0231988254443747, 1.0229143976335635, 1.0069227088976613, 0.9756120112428197, 0.9309430964736926, 0.876076633380841, 0.81468381068961, 0.7502792187657084, 0.6858104173094651, 0.6235101865769299, 0.5649207293420992, 0.5110034912628638, 0.46227786117240255, 0.4189564210968521, 0.3810599233652677, 0.34850450243948505, 0.321159344649856, 0.298876745542449, 0.28149910524776434, 0.26884936688770417, 0.2607126752282912, 0.2568172947100198, 0.25682172186532204 ], [ 0.4021329202114889, 0.4046121202496072, 0.4091728601195559, 0.41600754213197005, 0.425241654444099, 0.4369194349781401, 0.45099599091116255, 0.46733767073478544, 0.4857314191892423, 0.5059027687833184, 0.5275413492630004, 0.5503324496926951, 0.5739931128726726, 0.5983111534891072, 0.6231849858847638, 0.648660906322335, 0.6749623108331664, 0.7025021675385869, 0.7318658071355902, 0.7637453770487544, 0.7987991949623857, 0.8373977421533463, 0.8792099468541528, 0.922650595615949, 0.9645559904341046, 1.0006386341933131, 1.0264470507109715, 1.0382076887291416, 1.0333694070543586, 1.0109274610466492, 0.9716619817649046, 0.918235304687994, 0.8547460802613887, 0.7857641418978712, 0.7154647306414843, 0.6471611558979329, 0.5831781210124191, 0.5249335984356079, 0.4731188222272092, 0.42790296322826454, 0.3891208061444384, 0.3564239747975093, 0.3293900412250733, 0.3075916141217425, 0.2906314608401461, 0.2781515053518689, 0.26982414885982636, 0.26533421667999124, 0.2643590146797584, 0.26655243398246986 ], [ 0.4129966431808939, 0.41621202470995117, 0.4213409947173117, 0.42853869482506135, 0.4379046041023796, 0.44947258410561547, 0.46320609244406824, 0.4789998716730802, 0.49668872583128215, 0.5160632688116341, 0.5368919323570431, 0.5589481195491873, 0.5820411074341988, 0.6060489562491083, 0.630951048156962, 0.6568567573136755, 0.6840250040914678, 0.7128669536136186, 0.7439206795920091, 0.7777817270022326, 0.8149660431938328, 0.8556694867642358, 0.8993673177812276, 0.944184010956438, 0.986373407739923, 1.0209786209789615, 1.0431139215968206, 1.0489204419406588, 1.0361063518714508, 1.0041738580113189, 0.9545589122003995, 0.8908042466784046, 0.8180265074551114, 0.7415998975878361, 0.6661642304962699, 0.5951795222267537, 0.5308642911009631, 0.4743550450361606, 0.4259612863391839, 0.38543260461149575, 0.35219154353133464, 0.32551298859113453, 0.3046476589499022, 0.28889616119479467, 0.2776437405722288, 0.27036661699842923, 0.2666201081004573, 0.2660174084507557, 0.26820622846421394, 0.2728485937941 ], [ 0.4223130361138012, 0.42626526428125494, 0.4320202317772709, 0.4397077123506434, 0.4494112874796107, 0.4611617112325474, 0.4749345038615093, 0.4906527309906579, 0.5081954501098805, 0.5274117801738347, 0.5481400556084016, 0.570231089388374, 0.5935741440241211, 0.6181236878796171, 0.6439242655274102, 0.6711297088716106, 0.7000113457181728, 0.7309476842954069, 0.7643850137874202, 0.8007539547611857, 0.8403202398913978, 0.8829370985387267, 0.9276482747750459, 0.9720715993489735, 1.011891071794117, 1.0416494328184258, 1.05621645520048, 1.0518965571370933, 1.027023762420634, 0.9820844899105166, 0.9196360032501545, 0.8443185698058437, 0.7621684421727541, 0.679116320121905, 0.5999862804739329, 0.5281157428625235, 0.46538601298115373, 0.4124755706809812, 0.3691940960099215, 0.33480646838454503, 0.3083002388622749, 0.2885813694571127, 0.27460139855111326, 0.26542778092450203, 0.26027164708504635, 0.2584865452376258, 0.2595497226348158, 0.2630351406123127, 0.2685850982656592, 0.275885177633802 ], [ 0.42998916757365147, 0.4346917690297571, 0.4411418504279114, 0.4494533554864677, 0.45970171268602966, 0.471919710909387, 0.48609690915286163, 0.5021832744825474, 0.5200973980683666, 0.539739231431948, 0.5610068460087152, 0.583816249407946, 0.6081227538023536, 0.6339417191692805, 0.6613656082716006, 0.6905731107401383, 0.7218245244463247, 0.75543546803014, 0.7917180523570754, 0.8308743614063402, 0.8728207338201299, 0.9169122844286998, 0.9615302762786971, 1.00355690551138, 1.038157784664226, 1.059573706529225, 1.0626029727940767, 1.0439429483481504, 1.0029339658684682, 0.9415751240779324, 0.8641068733727482, 0.7764939328968536, 0.6854720153666782, 0.597206352360548, 0.5163761718450797, 0.4458918850189284, 0.38704563379061496, 0.3398748499570134, 0.30357709871062, 0.27688147074180164, 0.2583357219412362, 0.2465029392790663, 0.24007924908190947, 0.23795051546654333, 0.23920617788370235, 0.24312582349324363, 0.24915074882357013, 0.2568495543212713, 0.2658840506790232, 0.2759794709503304 ], [ 0.4359422262466609, 0.4414157794163778, 0.44863422181371504, 0.4577028943831669, 0.46869443160038504, 0.4816465035148743, 0.4965625643002608, 0.5134160908934885, 0.5321585313692576, 0.5527308464707386, 0.5750781166598992, 0.599166178708368, 0.6249986090899685, 0.6526315370833042, 0.6821827038119228, 0.7138298448586651, 0.7477918052218374, 0.7842836707302534, 0.8234343873149593, 0.8651515851312988, 0.9089139935432964, 0.9534709828918047, 0.9964519802264165, 1.0340018381863245, 1.060800695407317, 1.0708631079182076, 1.0590260466388801, 1.0225690468907178, 0.9622056989994114, 0.8819264425186558, 0.7880258324836279, 0.6879355794490439, 0.589001995508913, 0.49733637948599013, 0.4171220290549721, 0.3505135966890332, 0.297953508898288, 0.258663981026082, 0.2311388218047732, 0.21354551160928714, 0.2040114629504144, 0.2008029929861641, 0.20241926715452274, 0.20762554853978854, 0.21544699022300506, 0.22513955428180177, 0.23615011656907126, 0.24807402963605818, 0.2606154581986402, 0.2735535627061783 ], [ 0.44008872700548096, 0.44635518314392914, 0.4544128828103846, 0.46436357852672827, 0.4762801302132071, 0.49020558234821016, 0.5061548269817344, 0.5241191507712645, 0.5440737540771201, 0.5659880436805148, 0.5898381070611562, 0.6156202274892518, 0.6433635389578698, 0.6731389013052954, 0.7050597823865609, 0.7392693890858064, 0.7759065383411429, 0.815040840759945, 0.8565657525799478, 0.9000364107627379, 0.9444401529042008, 0.9878990736573724, 1.0273458833859836, 1.0583128357081417, 1.07509636042957, 1.0715579065061824, 1.0426294913205754, 0.986265576586932, 0.9048171390582378, 0.8045701849948964, 0.6940217960241287, 0.5821093196145355, 0.4767434311418095, 0.38377541950047045, 0.3065818623764702, 0.2462547234647905, 0.20215525456359418, 0.17255651297854258, 0.15520068125654318, 0.14770690646143037, 0.1478316083102309, 0.15361022172653094, 0.16341428759639365, 0.17595348826279178, 0.19024536675364445, 0.20556892348783962, 0.22141297095014378, 0.23742613519201838, 0.25337251743134426, 0.26909500549364457 ], [ 0.442338625559182, 0.44941627994077776, 0.4583764913674438, 0.4693203749728695, 0.482321817588287, 0.49742745355634743, 0.514658869230075, 0.5340171508601902, 0.5554897241432941, 0.5790591958011898, 0.6047135412086072, 0.6324564089540079, 0.6623154488163847, 0.6943453550912484, 0.7286207646576591, 0.7652123847007885, 0.8041380048519152, 0.8452787541789848, 0.8882506854922115, 0.9322237682606282, 0.9756878224437916, 1.0161848389545485, 1.0500699081245264, 1.0724304828509523, 1.0773543044007658, 1.0587349086973794, 1.0117485817664222, 0.9350564517892836, 0.8327149842312384, 0.713290794340677, 0.5873702313944167, 0.4653290143812616, 0.35558878730860455, 0.26358899722260176, 0.1916570172950104, 0.1395901880339766, 0.10552193756055617, 0.08672684629739924, 0.08021900324508546, 0.08313396777954551, 0.09293808975903739, 0.10751718141274424, 0.12518831371118122, 0.14466704178763923, 0.16501223906416906, 0.18556297729664228, 0.20587635441701313, 0.22567136182164182, 0.2447813232193905, 0.2631157506921272 ], [ 0.44259412966128786, 0.4504935610512862, 0.46040803322273105, 0.47243910052701243, 0.4866604449149174, 0.5031184205734611, 0.5218345086089796, 0.5428095926040344, 0.5660298457306305, 0.5914738490631277, 0.6191202572628701, 0.6489547781610355, 0.6809743097486565, 0.7151846885473211, 0.7515866737052529, 0.7901427772681893, 0.8307159202508434, 0.8729705228508582, 0.916228676162553, 0.9592800920646993, 1.0001571996337355, 1.0359099376745566, 1.0624512683472243, 1.0745887595446404, 1.0663905749487954, 1.032037404902777, 0.9672997705523568, 0.8717700565919895, 0.7509299726917477, 0.6150826048588873, 0.4765371066567089, 0.34698755716075863, 0.2353284253278134, 0.14646752931085705, 0.0815078361276037, 0.03883819967665858, 0.015358360780730274, 0.007419881487342628, 0.01142146679478595, 0.02413258995229839, 0.042834628399641916, 0.06534993296017777, 0.09000763717568994, 0.11557800888289516, 0.14119518783839624, 0.16628013778063644, 0.19047040458370224, 0.2135599083474793, 0.23544986982174032, 0.2561106554334227 ], [ 0.44075299315895716, 0.4494741337240374, 0.46038073845864436, 0.4735742058022161, 0.48912495969159137, 0.50707337651601, 0.5274323377051289, 0.5501910702687014, 0.5753198762354174, 0.6027752839565708, 0.6325049772689014, 0.6644514221172395, 0.6985522297017192, 0.7347338053268135, 0.7728927175828852, 0.81285683517016, 0.8543165524381487, 0.8967168740918124, 0.9391054892760051, 0.9799417313581192, 1.0168876729542093, 1.0466263980925916, 1.0647828304710365, 1.0660536905077873, 1.0446745662160293, 0.9953567453279815, 0.9148128484977676, 0.8038181972268735, 0.6687451346850211, 0.5207842321148805, 0.3734218285994397, 0.23948912936544664, 0.12832063332514154, 0.04418262764280234, -0.0131359966032627, -0.04658965540200111, -0.06032956479775542, -0.05871301251730954, -0.045764117130406845, -0.024927536344605317, 0.0010036932858112912, 0.02986389456189731, 0.060042368864407725, 0.0903919338823006, 0.1201352105076664, 0.14877788431402927, 0.17603347646369172, 0.2017612898769282, 0.22591746509042387, 0.2485180693349882 ], [ 0.4367161631033219, 0.4462465525654483, 0.458168351770545, 0.4725807188930792, 0.4895461324794752, 0.509091712168722, 0.5312119319884232, 0.5558720663488856, 0.5830117262400223, 0.6125479280467259, 0.6443771728844501, 0.678375820688661, 0.7143973730534928, 0.7522638472095141, 0.7917460551673084, 0.8325245881460664, 0.8741209064187272, 0.9157885413709186, 0.9563606967992708, 0.9940637962923473, 1.0263259974038546, 1.0496335806564359, 1.0595142551196783, 1.0507505735129794, 1.0179400391856805, 0.9565055137992373, 0.8641797779632441, 0.742703482384413, 0.5988895023040447, 0.44411904366386135, 0.292352506050632, 0.15718923187316536, 0.04832169692874244, -0.030707478008198508, -0.08131081141296026, -0.10744640004504558, -0.11393627308753107, -0.10553029627522137, -0.0864462358898338, -0.060191164191548685, -0.02954032212496216, 0.0034024181501366435, 0.03710764147829182, 0.07051309461852218, 0.10292042956338299, 0.1339033828384334, 0.16323057307326472, 0.19080357556094907, 0.21660943816945732, 0.24068595824053896 ], [ 0.4303997676167101, 0.44071398129679035, 0.45365961547719974, 0.46933014317701355, 0.4877738844603489, 0.5089959956780656, 0.5329617056916526, 0.5595997064482937, 0.5888047290366217, 0.6204386322786384, 0.654329671915347, 0.6902698143931931, 0.7280097230299055, 0.7672499495816244, 0.8076244125395016, 0.8486683084593256, 0.8897584660054706, 0.9300134522996708, 0.9681482126628408, 1.0022953192441688, 1.029828221766825, 1.0472458198196226, 1.0501996596979237, 1.0337629232628665, 0.9930437350437082, 0.924203469335639, 0.8258025631549686, 0.7001461576723569, 0.5540547751728115, 0.3985356896917693, 0.24724044866256079, 0.11380010874347146, 0.007979487837916355, -0.0672491056863348, -0.11392478420322916, -0.13638023084952577, -0.13961823779623928, -0.12844464951682022, -0.10705851892582285, -0.07890757653063962, -0.046689609296962864, -0.01242747947303402, 0.022424806140786013, 0.05686933080000256, 0.09025814164790869, 0.12220048468201683, 0.1524861355073983, 0.18102512913706115, 0.20780271007631124, 0.23284746668512002 ], [ 0.4217515339405181, 0.4328117427402891, 0.4467769976522866, 0.4637303329626477, 0.48369816335332394, 0.5066535511154463, 0.5325207090902018, 0.5611790549509786, 0.5924654058667026, 0.6261734764867384, 0.6620505711306768, 0.6997920653860761, 0.739034690885826, 0.7793492723424634, 0.8202315063820049, 0.8610845080943695, 0.9011795060219173, 0.9395762079347416, 0.9749915000312758, 1.0056284740157309, 1.0290075223017454, 1.0418645185200643, 1.0401960631175093, 1.019541197994565, 0.9755849048302905, 0.9051170862657398, 0.8072165100968096, 0.6843228686556462, 0.5428265332636697, 0.39285079532731026, 0.24699969363773844, 0.11792694865838482, 0.014771629986557455, -0.05938602564921769, -0.10622343474057161, -0.12972156800814694, -0.1345765163772713, -0.12534214169503777, -0.10601914933687628, -0.07990413646183592, -0.04958307480965396, -0.016999142337408624, 0.016446842064252953, 0.0497877490421923, 0.08238702574342704, 0.11384845087015849, 0.14394200313691385, 0.1725464513071231, 0.19960754367471512, 0.2251096030885994 ], [ 0.4107717642468289, 0.42252936622664095, 0.43749975886743353, 0.4557494458080933, 0.47727352392754463, 0.5020012520299726, 0.5298030186795388, 0.5604962068426428, 0.593847957687158, 0.6295737804328938, 0.6673321342218534, 0.7067163607767156, 0.7472465195133629, 0.7883644022682291, 0.829434184797942, 0.8697463162863435, 0.9085105636992751, 0.9448098822911655, 0.9774894557295132, 1.0049894927794298, 1.0251730789913043, 1.035220622764316, 1.0316647993015375, 1.010639678195303, 0.9684109819311221, 0.9022186784287806, 0.811309821373767, 0.6978044404375958, 0.5671820528323037, 0.4281630211013674, 0.291673052320856, 0.16871219156828654, 0.06751432774069188, -0.00832905423505459, -0.05936032022450688, -0.08853384626815064, -0.0997687425726208, -0.0970694321807356, -0.08406620936075837, -0.06381754087213343, -0.0387654380463619, -0.010774924228936889, 0.018785219571331613, 0.048946722587107194, 0.07904700865821757, 0.10864452865213492, 0.13744898333116706, 0.1652679988623853, 0.1919695382665395, 0.21745781698192745 ], [ 0.3975389232330398, 0.40993715848790524, 0.4258913389007049, 0.44544391064203404, 0.4685473505419384, 0.49507357468812613, 0.5248250882425066, 0.5575442305701831, 0.5929177683539395, 0.6305755610010554, 0.6700837233612063, 0.7109344652596713, 0.7525365873492877, 0.7942124314604838, 0.8352082721783827, 0.8747226573973562, 0.9119428858962307, 0.9460484568178149, 0.9761262630915624, 1.0009979740529955, 1.0190314490426071, 1.0280164042156075, 1.0251648999424772, 1.0072908507528089, 0.97122133849523, 0.9144728025331964, 0.8361020594119088, 0.7374329392811968, 0.6225322441996868, 0.49824534096557077, 0.37345265742379097, 0.2574035095503253, 0.15757352576507822, 0.07816077748468808, 0.020024792630858435, -0.018348609789891723, -0.03972889172159655, -0.047302087670073156, -0.04415617472639932, -0.033012608337181226, -0.016120535823567317, 0.004749694908905533, 0.02825755087927173, 0.05341720822554141, 0.07951567649308611, 0.10603650964147537, 0.13259627732112778, 0.15889690672861645, 0.18469383900435266, 0.2097777256649408 ], [ 0.3822396524333099, 0.3952170569702757, 0.41213071222714676, 0.4329899071520722, 0.4576910526437256, 0.48603313443465707, 0.5177353491351443, 0.5524516597863822, 0.5897786107149477, 0.6292550074864638, 0.6703544034752696, 0.7124735147156754, 0.7549218224770102, 0.7969200197176847, 0.8376178015322696, 0.8761434908867131, 0.9116889929244322, 0.9435821440621114, 0.971234323027398, 0.9939473671472353, 1.0106997616878595, 1.0199980627038396, 1.0198277952052368, 1.0077366539779933, 0.9810935774283762, 0.9375555356912051, 0.8756891353154083, 0.7956068461709677, 0.6995306278043785, 0.5921019127984599, 0.4800744084478224, 0.371157705547116, 0.2723288003655781, 0.18843341100394106, 0.12171188361331153, 0.0721821486618549, 0.038392986491775916, 0.018148567359262957, 0.009043029708704964, 0.008793056042463943, 0.01540985752413937, 0.027259283913984467, 0.04305129119385109, 0.06179025327023835, 0.08270916228648262, 0.10520388871778164, 0.12877780799276228, 0.15300189020237676, 0.17749092597771743, 0.20189334599760578 ], [ 0.3652025500315469, 0.3786970148445009, 0.3965467670296873, 0.41871710710721527, 0.44503258590686245, 0.4752016136844365, 0.5088435591228987, 0.5455107810403781, 0.58470090608042, 0.6258581316734947, 0.6683654478865181, 0.7115322081698735, 0.7545837086658934, 0.7966618490214998, 0.836849098367079, 0.874232376921426, 0.9080266823075349, 0.9377308136621181, 0.9631145644626594, 0.9839896967375921, 0.999979329872768, 1.0103512920689353, 1.013912768716616, 1.0089797969200225, 0.9934563383186858, 0.9650609658449323, 0.9217118051973605, 0.8620660103883038, 0.7862183866368307, 0.6964247767884171, 0.5973899055940075, 0.4955923873246878, 0.3977739462466455, 0.30943463459154724, 0.23403770827826764, 0.17300110718417927, 0.12615797100992687, 0.09234451368542052, 0.06991361353372727, 0.057103106123634895, 0.05225984126965688, 0.05394808583239852, 0.06097615938981238, 0.07237221748809675, 0.08733491064792975, 0.10517894038612874, 0.12528936038605232, 0.1470919244733564, 0.17004064421297171, 0.1936191455029037 ], [ 0.34693423124373746, 0.36088732282616587, 0.37965384366919086, 0.40314236776278733, 0.4310873719173495, 0.4630873906787146, 0.49864530911711696, 0.5372000611154324, 0.5781441069172583, 0.6208262436422819, 0.6645432532562563, 0.708526627045139, 0.7519327408891043, 0.7938470912433463, 0.833316133863089, 0.869424420641557, 0.901440644239773, 0.9290297529123169, 0.9522780757235947, 0.971453953778587, 0.9867850526986421, 0.9982796002127234, 1.005564257453467, 1.0077343054141268, 1.0032431801964947, 0.989887483102937, 0.9649589226564312, 0.9256554846530229, 0.8698791463912136, 0.7974437232754675, 0.7111432272779582, 0.6165356829475105, 0.5203154473708111, 0.4285493930221175, 0.34566327133282626, 0.27421298141701467, 0.21514850131050067, 0.16827522697557273, 0.13271702922482131, 0.10728670886109803, 0.09073761387534818, 0.08190542062738648, 0.07976342572804651, 0.08341872025456964, 0.09207611491295797, 0.10499348719317803, 0.12144633944074379, 0.140711175950059, 0.16206868611534864, 0.18482125312906883 ], [ 0.32815483310071264, 0.3425159306593295, 0.36218518951908574, 0.38699961296401053, 0.4165831503862332, 0.4504045637496667, 0.4878353530562022, 0.528192927528097, 0.5707631066438805, 0.6148033782235944, 0.6595328787826147, 0.7041176047917703, 0.7476611489886974, 0.7892132397145442, 0.8278111150365356, 0.862572392119651, 0.8928584357928798, 0.9184738504545464, 0.9397090204586555, 0.9571721109099037, 0.9715903054015766, 0.9836234099889936, 0.9936540742232637, 1.0015297156042229, 1.0062746564611766, 1.005855751141835, 0.9971288782247435, 0.976105924422251, 0.9387438149378201, 0.882530678718888, 0.8085092531457331, 0.7215432395178727, 0.6282647089410646, 0.5350518091756256, 0.4469478913921442, 0.3673328842144669, 0.29805299449608275, 0.23976625430185017, 0.1923357904976094, 0.15517464357517763, 0.1275005327424631, 0.10849324874505528, 0.09736630108092958, 0.09337448651452984, 0.09578420447852909, 0.10383418005229117, 0.11670938719970636, 0.13354039542414942, 0.15342770594396038, 0.17548135448736613 ], [ 0.30982796187703665, 0.3245577087452493, 0.34511897654979173, 0.37126006079308627, 0.40247239800053836, 0.4380765891515645, 0.47730260390398116, 0.5193450366305984, 0.5633890746322022, 0.6086122062425912, 0.6541709658197967, 0.6991836990385574, 0.7427214305497278, 0.7838204531806916, 0.821532283419569, 0.855026911322316, 0.883752372873134, 0.9075996179894059, 0.9269599106055559, 0.9426401531231469, 0.9557122549030687, 0.9673333408845517, 0.978508456142061, 0.9897527531365999, 1.000653625951203, 1.0094504571589291, 1.0128372954829121, 1.0061325369073275, 0.9839907409317041, 0.9420877280756987, 0.8799257590561855, 0.8015940162134423, 0.7132998839807954, 0.6213303765041424, 0.5309864811088942, 0.44617808900204686, 0.369434126991112, 0.3021351233086133, 0.24482652654638204, 0.19752077710818994, 0.15993761816097085, 0.13166217313375672, 0.11222067506815059, 0.10108843135708179, 0.09765625673532097, 0.10118860909650751, 0.11080397935973019, 0.12549347045291626, 0.14417353561850543, 0.16575508324310806 ], [ 0.2931766664771584, 0.3082492402344069, 0.3296882224051995, 0.3571338257563648, 0.38992340315219426, 0.42721636297280596, 0.4680999264488981, 0.5116545751550419, 0.5569802315795856, 0.6031938128827763, 0.6494111865401979, 0.6947266196381923, 0.7382028644292893, 0.7788856346998132, 0.8158564364496572, 0.8483336252954401, 0.8758143359909776, 0.8982147058827821, 0.9159434168471514, 0.9298789356894432, 0.9412701820445597, 0.9515765803196528, 0.9622279153988317, 0.9742525231475825, 0.9877347813931524, 1.0012399590326022, 1.011565234465687, 1.0139153273832848, 1.0025200528283165, 0.9722739221589514, 0.9214924715936922, 0.8529001911064845, 0.7717181033504593, 0.6837406644426114, 0.5942175092674331, 0.5073392721174907, 0.42612367239532306, 0.35253755490647387, 0.28772859305009113, 0.23227756387506993, 0.1864145968483938, 0.1501682019020899, 0.12343542589066647, 0.1059791068670789, 0.09737713048002616, 0.09696553043230027, 0.10381973784461096, 0.11679656000391003, 0.13462524477742654, 0.15601496000403126 ], [ 0.27967172867643436, 0.29507549996743915, 0.317360774104255, 0.3460391897676068, 0.3802777029827969, 0.4190733751351836, 0.4613832333860753, 0.5061943469581347, 0.5525458028174193, 0.5995197704141925, 0.6462177055302444, 0.6917358779454035, 0.7351532938554012, 0.7755444854916905, 0.8120280795688624, 0.8438563866208547, 0.8705376046710638, 0.8919622443791791, 0.9084930869057015, 0.9209861729573015, 0.9307291424533042, 0.9392955286767626, 0.9483093600722343, 0.9590842546999906, 0.9720574816858787, 0.9860973561794211, 0.9983276437536349, 1.0044540049581272, 0.9991567168182518, 0.9773516482794969, 0.9364759227989491, 0.8776535827251224, 0.8047289287726446, 0.7226707319110683, 0.6363982916097205, 0.5501422333894042, 0.4672062279806634, 0.38998371446021496, 0.3201106546765937, 0.2586662296962794, 0.2063604821817393, 0.1636690903859136, 0.13089221538140872, 0.10813201547979523, 0.0952093280330506, 0.0915733823101248, 0.09627440263601728, 0.10803538921985156, 0.12539561584058612, 0.14686607283393727 ], [ 0.27097051506544284, 0.2867067511524158, 0.3097676234890995, 0.3395193797500372, 0.3749583136477046, 0.41493888282232544, 0.4583175396113025, 0.5040195338466104, 0.5510533018964723, 0.5984942620146949, 0.6454553670974869, 0.6910585903317684, 0.7344195089752131, 0.7746555023408419, 0.8109255566248975, 0.8425047525263054, 0.8688883901302024, 0.8899106533104396, 0.9058519666399254, 0.9174957366096405, 0.9260893320322884, 0.9331911321272468, 0.9404193853332498, 0.9491017218594, 0.9597612059908118, 0.9714496281046074, 0.9817642511440021, 0.9873806484800165, 0.9840212614051047, 0.9669699421741684, 0.9331177504262291, 0.882346838332127, 0.8171706727173196, 0.7415612690633728, 0.6598632932707789, 0.5760954209366898, 0.49361698065879855, 0.41505358938056847, 0.34237648601054615, 0.2770514664272197, 0.22019502117923484, 0.17269213899814462, 0.13524243109606093, 0.10831428628855921, 0.09201475969871087, 0.0859402471037084, 0.08912479884562852, 0.1001530254682228, 0.11737587387695203, 0.13912123753583894 ], [ 0.26877263330078094, 0.2848519575917239, 0.30854687998906405, 0.3390812243531593, 0.375314822992739, 0.4160060932039683, 0.4599547519685718, 0.5060611803364874, 0.5533335629279181, 0.6008657147122408, 0.6478029753050706, 0.6933099652788207, 0.7365514269482553, 0.7766949488361881, 0.812941388210588, 0.844585029675981, 0.8711017357883919, 0.892260683274538, 0.9082487592819204, 0.9197652776641082, 0.9279977856359924, 0.9344345176261633, 0.9405667740824286, 0.9475167583417909, 0.9555714103613172, 0.9637748162315302, 0.9701648988796323, 0.972369564816581, 0.9673147292956662, 0.9509783352942276, 0.9202920777970276, 0.8745108318876814, 0.8151499981619617, 0.7452067562753211, 0.6682932190447529, 0.5879893790420914, 0.5074764053137463, 0.42940053891516694, 0.35589046885914427, 0.2886563412000671, 0.22911185966241543, 0.1784726077636819, 0.1377907885667048, 0.10789107152929922, 0.0891894015424497, 0.08145355797635467, 0.0837013408068209, 0.09437566239008433, 0.11165647443840365, 0.13372322183571939 ], [ 0.2745410405669066, 0.29097763858244174, 0.3150631261972292, 0.34594041770451384, 0.3824108168631546, 0.4232008053170593, 0.46710120109794345, 0.5130227785205616, 0.559999646583015, 0.6071632952565227, 0.6537048330659364, 0.6988393077128843, 0.7417830676376904, 0.7817520952622333, 0.8179857990234826, 0.8497973502281323, 0.8766497538231169, 0.8982583922586521, 0.9147239827557971, 0.9266698485359968, 0.9352338406738439, 0.9418187972931127, 0.947733084650103, 0.9537917885254804, 0.9599195405857259, 0.9649753473669548, 0.9671217420540804, 0.9644381234573368, 0.9547742195302298, 0.9353915776891794, 0.9040070931123579, 0.8598485374507427, 0.80381710987756, 0.7380741777993692, 0.6654519570933601, 0.5889416058869679, 0.5113572878262229, 0.4351763465390441, 0.3625131667887494, 0.2951742125423029, 0.23474491647852402, 0.1826647509887347, 0.14024969941603482, 0.10861929473478193, 0.0884820701235246, 0.07978720272651796, 0.08153341498756073, 0.09204082553045811, 0.10936943674970756, 0.13160912439704708 ], [ 0.2890287119762064, 0.3058440925253656, 0.3300161844400226, 0.36072609374295417, 0.39681030696402786, 0.4370286476512877, 0.48020848406942895, 0.525302982623607, 0.5713945313512375, 0.617666708964379, 0.6633631594487094, 0.7077482756703146, 0.7500815011786691, 0.7896134867596467, 0.8256081263046791, 0.8573904803993937, 0.884418601331979, 0.9063794497652344, 0.923316635070492, 0.9357921951662296, 0.9448942207326437, 0.9519241463629079, 0.9580002617461933, 0.9636516123976643, 0.9684706959709252, 0.9710209696057679, 0.9692185381777327, 0.9611140573511872, 0.9453159810296045, 0.9205994173785829, 0.8859061308436671, 0.840877067840863, 0.7861484398043196, 0.723252726720642, 0.6543056393984951, 0.581666291727544, 0.5076770942931139, 0.43451595511998503, 0.3641489682963142, 0.29835216776256007, 0.23876527199783482, 0.18693985314651473, 0.14434347934133396, 0.11227678937462382, 0.09164994806843818, 0.08256625857998978, 0.08402875175494162, 0.09431584161883777, 0.11145897682520856, 0.13353214038423233 ], [ 0.3118930079149183, 0.32914854309057046, 0.35319618310094947, 0.38332073163271935, 0.4184714070174894, 0.4575030579288762, 0.4993248069964455, 0.5429648447125465, 0.5875766054157748, 0.6324093923174652, 0.6767631640345557, 0.7199445064240866, 0.7612379035670802, 0.7999023070860569, 0.8351974664131365, 0.8664386724481745, 0.8930750327459606, 0.9147880416963853, 0.9316147646133348, 0.9440841029677336, 0.9531975841476903, 0.9601307744409124, 0.9658350160912398, 0.9706276187200064, 0.9738620638381388, 0.9738461276614141, 0.9681944024110065, 0.9548096782345347, 0.9329575667684902, 0.9026739168311337, 0.86402889302061, 0.81723609168109, 0.7629251253789049, 0.7022307406652083, 0.6366990694817568, 0.5681144635570878, 0.49833529183990516, 0.4291837560359064, 0.36239838728647766, 0.29963571593755756, 0.24249641186395754, 0.19254557476485967, 0.15129222689920008, 0.12008611448090456, 0.09987921255306986, 0.09082437601506677, 0.0920254659499089, 0.10186056053470649, 0.11843781895592587, 0.1398880974626182 ], [ 0.34200240939578685, 0.35980547714101135, 0.38366563098040807, 0.4129704493885434, 0.4468132193823295, 0.4841868034292695, 0.5241224069172735, 0.5657569591752695, 0.6083410132531356, 0.6512065085369807, 0.693714912124272, 0.735205824710462, 0.7749641981943991, 0.8122198122174984, 0.8461850665296744, 0.8761278567335739, 0.9014691544522285, 0.9218938181743257, 0.9374638928392407, 0.9486956152583128, 0.9564956500542199, 0.9619115313046313, 0.9657699240097231, 0.9682642682523915, 0.9686341440219263, 0.9651137204881206, 0.9553297377721239, 0.9373562800855053, 0.9108256640131827, 0.8764187089131916, 0.8349294121668394, 0.7870561308830769, 0.7335408168717185, 0.675309626857302, 0.6135103494627737, 0.5494685276785247, 0.4846147276656871, 0.4204227918284208, 0.3583763932632725, 0.29996222302169534, 0.24667519259590642, 0.20001228546922245, 0.16142448465796944, 0.1321895308076242, 0.11317180747245714, 0.10450803793571306, 0.10545649205517915, 0.11460646840386779, 0.13024033362963694, 0.15061622656867002 ], [ 0.37789752785210357, 0.39639402479718494, 0.42012283979063864, 0.4485472242243592, 0.4808960514455631, 0.5163139688780549, 0.5539803625123008, 0.5931711429980495, 0.6332628683358058, 0.673692519080256, 0.7138933135761546, 0.7532305201391833, 0.790961488576692, 0.8262397372765623, 0.8581724516330396, 0.8859252155481847, 0.9088530919609585, 0.9266300990968654, 0.9393464917814043, 0.9475310752838736, 0.9520489282777678, 0.9538792986993048, 0.9538053070959828, 0.9520132981147262, 0.9478028562080061, 0.9395987317246661, 0.9254075921328243, 0.9037344206359101, 0.8743383315736678, 0.8379815169587739, 0.7957037622534446, 0.7484464599210443, 0.697034223384835, 0.6422777918213873, 0.5850594182484574, 0.5263660546661777, 0.46728495485009797, 0.40898598355574606, 0.35270676360041686, 0.2997442166598167, 0.251444588306046, 0.2091748826102131, 0.17425196390944508, 0.14780476216340244, 0.13056450311753343, 0.12264410493827338, 0.12345022356909385, 0.1318155596631615, 0.14625761595883346, 0.1652206271000125 ], [ 0.4180558169905544, 0.4374225657325918, 0.46116155600437764, 0.4887763649051981, 0.5196018659216639, 0.5529242221640172, 0.5880802792156243, 0.6245083635742295, 0.6617415663801434, 0.6993510796938078, 0.7368599876926691, 0.7736567755310019, 0.8089415458679339, 0.841734527279348, 0.8709624862654619, 0.8956126946058414, 0.9149156050127583, 0.928503521370299, 0.936497869856827, 0.9394914417066866, 0.9384144552801481, 0.9343121399969416, 0.9280522598927314, 0.9199699306195029, 0.9096303632973977, 0.8958835807113126, 0.8772832869153206, 0.8527582154313194, 0.8221027985626624, 0.7858929109101868, 0.7450399899670807, 0.7004408812226756, 0.6528679101312067, 0.6030079418234987, 0.5515407051501391, 0.49920037365210257, 0.44680835062456303, 0.3952846355402023, 0.3456473837615193, 0.29900446565802724, 0.2565328521555137, 0.21943458647286407, 0.1888544905056817, 0.16574952902840834, 0.15072162630599784, 0.14386691504253413, 0.14472243601966028, 0.1523513130958798, 0.16552146973054238, 0.18289544663780655 ], [ 0.4610136095312194, 0.48144923068099477, 0.5053975551395011, 0.5323642710297897, 0.5617505989983608, 0.5929584704217383, 0.6254778248882765, 0.6589265267175408, 0.6930271450628164, 0.7275231701494237, 0.7620565373447452, 0.7960440399303085, 0.8285983142475956, 0.8585375807463531, 0.8845116986774694, 0.9052303369855775, 0.9197253253269635, 0.9275572435692823, 0.928902446960662, 0.9245018289062744, 0.9154907593921984, 0.9031497608777342, 0.888603944347325, 0.8725141698671509, 0.8548847403604525, 0.8351115048048211, 0.8122967005930506, 0.7857065518860595, 0.7551070848367677, 0.7207797990438986, 0.6832957094795451, 0.6432780002045367, 0.6012859551431046, 0.5578127382430501, 0.5133373175758842, 0.4683824200067693, 0.42355657758619664, 0.3795763151737044, 0.3372711968307372, 0.2975735323116849, 0.2614903881967091, 0.23005161355571901, 0.20422708866099182, 0.1848131153772804, 0.1723045707705383, 0.1667910776343532, 0.1679227858814143, 0.17496613856601284, 0.18692649735350753, 0.202690364343992 ], [ 0.5054002844237966, 0.5271123310181375, 0.5515026248648389, 0.5780392584083857, 0.606144374428217, 0.6352995588037331, 0.6651332747356116, 0.6954559677122382, 0.7262178949478293, 0.7573860158010861, 0.7887653140622127, 0.8198163638921824, 0.8495340870220375, 0.8764519326603813, 0.8988206477816558, 0.9149489807283567, 0.9235891203498834, 0.9242146347682795, 0.9171093896408967, 0.9032734035641972, 0.8841986916057377, 0.861574421113689, 0.836967571618739, 0.8115318609279356, 0.7858275078110806, 0.7598271208161782, 0.7331155958976602, 0.7051944476770411, 0.6757347774367487, 0.6446642632394685, 0.6121034131223537, 0.5782553534143713, 0.5433351957520723, 0.5075599808581084, 0.4711780108488532, 0.4345091696476268, 0.3979776675132518, 0.3621296990361494, 0.3276346313115789, 0.2952695785244836, 0.2658858606093525, 0.24035456100365238, 0.21948976965117795, 0.20395419060398656, 0.19416252124101485, 0.1902083668666975, 0.19184078704190022, 0.198501084903138, 0.20940712164473996, 0.2236575129891456 ], [ 0.549923031923166, 0.5731089665383857, 0.5981826607505308, 0.624534177515948, 0.6515564492754589, 0.6787653026710883, 0.7059033334663808, 0.7329832371052262, 0.7602296298282618, 0.787903631501839, 0.8160397958890865, 0.8441719853308882, 0.871146565353184, 0.8951122909349174, 0.9137677113570883, 0.9248736392277529, 0.9268240596872264, 0.9190145367251332, 0.9019177215823995, 0.8769197868843747, 0.8460189321349708, 0.811472483450409, 0.7754484535233481, 0.739725267343873, 0.7054899730199531, 0.67328062112829, 0.6430823896462299, 0.6145297749057226, 0.5871244741557069, 0.5603882832794069, 0.5339278560775188, 0.5074423671001129, 0.4807175899542189, 0.45363040219494843, 0.42616533116817273, 0.3984343228799527, 0.3706908455889414, 0.34333315780320595, 0.316894633939068, 0.2920201912979213, 0.26942780994512505, 0.24985437134342858, 0.23398707199737767, 0.2223863029821127, 0.21541220728468857, 0.21317175102275887, 0.2155015254484598, 0.2219919666609298, 0.23204556255860864, 0.24495242345626422 ], [ 0.5933306609169647, 0.6181503276521403, 0.6441282602637168, 0.6705373008546879, 0.6966870486418704, 0.7220714436659799, 0.7465091823796729, 0.7702174581947284, 0.7937504232569572, 0.8177607872640529, 0.8426134696588836, 0.8679666970015604, 0.8924834827387998, 0.9138046621150014, 0.9288887348337369, 0.9347853823619907, 0.9294688304652943, 0.9122982015860717, 0.884041708206036, 0.8466021052880647, 0.8026135926136347, 0.7550247606447014, 0.7067179120703573, 0.6601845663172253, 0.6172787644588434, 0.5790805384740437, 0.5458971637697072, 0.5173980703800272, 0.49283384036152, 0.471264771498819, 0.45174079765156694, 0.4334146099515297, 0.415600883414918, 0.3978030716265718, 0.37972329731383053, 0.36126245964694575, 0.3425124581859162, 0.3237404377367774, 0.3053644857729685, 0.28792009852849965, 0.2720167999940596, 0.25828501798271863, 0.24731525910922758, 0.23959485595044516, 0.23545114222957553, 0.2350118337907532, 0.23819156986232537, 0.24470765374789694, 0.25412038401540926, 0.2658876664709463 ], [ 0.6343793785162772, 0.660917458993174, 0.6879618623277188, 0.7146347900160687, 0.7401076652864502, 0.7637849023311877, 0.7855025929870973, 0.8056658521309203, 0.825212996921856, 0.8453135362030857, 0.8668122039502334, 0.8895841443823991, 0.9120724622191108, 0.9312466412020336, 0.9431099783659908, 0.9438468553053363, 0.9309810967880247, 0.9039136351116615, 0.8638325979846229, 0.8132716421868782, 0.7555862399642567, 0.6944801828518345, 0.6336042358031427, 0.5762074611006365, 0.52483203127964, 0.4810800738452146, 0.4455150898025403, 0.417748941238561, 0.39669520417004095, 0.3808957367422044, 0.3688159979605799, 0.3590517029316565, 0.35044289659221645, 0.3421191956357629, 0.3335032945379883, 0.3242923581265853, 0.31442840294272223, 0.3040627673236662, 0.29351638221493054, 0.28323595779421307, 0.27374579702097174, 0.2655955338451452, 0.2593056067700177, 0.2553144276216408, 0.2539332222476257, 0.2553152542922509, 0.259444645317502, 0.2661463133205961, 0.27511397877317834, 0.285949626230925 ], [ 0.6718206061033558, 0.7000400676377315, 0.7282054927148515, 0.755268336852367, 0.7802151128739582, 0.8022867744951062, 0.8212523007145702, 0.8376516923215355, 0.8528379562621655, 0.8686315988723251, 0.8865522815645588, 0.9068486334862149, 0.9277453483815075, 0.9453503617599591, 0.9544906965313044, 0.9503490690576247, 0.9300031241726237, 0.893014706788714, 0.8411182919583702, 0.7775469994272057, 0.7063899137712868, 0.6320912843387463, 0.5590557397230935, 0.4912893287412474, 0.43203069103374153, 0.38339644659849936, 0.3461568346975204, 0.31978006851403157, 0.30275870461700943, 0.29306916875617, 0.28858809532195556, 0.28737695386677714, 0.287832821511649, 0.28874109268548104, 0.2892690819337908, 0.2889293653541355, 0.2875302984788379, 0.2851226046366114, 0.28194567319661135, 0.2783744906276899, 0.2748671525266042, 0.2719131229903168, 0.26998342562623745, 0.26948533338139946, 0.2707252783651722, 0.27388396044037233, 0.27900655348036923, 0.2860086100334491, 0.29469549283683866, 0.30479093082931275 ], [ 0.7044281033811768, 0.7341210444125383, 0.7632965717780287, 0.7907371008680705, 0.815220947741838, 0.8357634471407622, 0.8519644725826466, 0.8643959419272869, 0.8747983941771613, 0.8857402737860155, 0.8996107414480106, 0.9172387684805855, 0.9367255168545026, 0.9532304137875606, 0.9601986770681468, 0.951669083935044, 0.9243297552117651, 0.8780614363445743, 0.8152320223775692, 0.7397538451105854, 0.6563665882980931, 0.5701545244117774, 0.4861892193179617, 0.4091822612183744, 0.34306027421648244, 0.2904614069153151, 0.25233198123891665, 0.2279191055999421, 0.21522539303086607, 0.21164680874793396, 0.2145074488187787, 0.22139609333236865, 0.23033032996390979, 0.2398042970510459, 0.2487691041104736, 0.25657992122148554, 0.26293025872983267, 0.26778430783199864, 0.27131216491673593, 0.2738294595573793, 0.2757415015638815, 0.2774918997128932, 0.279516177633419, 0.2822017658747333, 0.28585642568336395, 0.290687250073913, 0.29679167262440775, 0.30416050044923154, 0.31269130371101955, 0.3222091033308638 ], [ 0.7310751212779023, 0.7618259454531193, 0.7916818862338424, 0.8192834513856853, 0.8432167013164831, 0.8622533463345503, 0.8757421838923013, 0.8841476210968854, 0.8894909205712922, 0.8950859729482376, 0.9042831948033161, 0.9186747284734698, 0.9364332091674978, 0.9518537094498314, 0.9569652762467623, 0.9446191964492224, 0.9112389420788155, 0.8571478032740707, 0.7852981030297445, 0.7001323870251774, 0.6068682705024853, 0.5110627907074723, 0.41830428314515966, 0.333895192496911, 0.2623994001666101, 0.20698489446626356, 0.16876140504511705, 0.14669403533776815, 0.13827225473685412, 0.1403632171425676, 0.1498330569612234, 0.16389854396463766, 0.18028422148024692, 0.1972583345464911, 0.21360080934124848, 0.22853821659559115, 0.24166681086827457, 0.2528751739241135, 0.2622719033751304, 0.27012029800399556, 0.2767803192980389, 0.28265762674837025, 0.288159693293475, 0.29365948983414286, 0.2994676260435264, 0.3058138761398462, 0.3128385780702229, 0.3205935444397809, 0.3290511115070014, 0.3381190990141907 ], [ 0.7508577507860027, 0.7820416714118181, 0.8120098868470066, 0.8393063348453078, 0.8623809572508195, 0.8798152055083137, 0.890713488381066, 0.8953291115958827, 0.8958004041648977, 0.896033202052553, 0.9001736110905613, 0.9105616977544453, 0.9256402695011078, 0.9391152950820254, 0.9420078151197343, 0.9263160084862515, 0.8883495417661974, 0.828747634117688, 0.7507769672848337, 0.6591564891928562, 0.5593670202961908, 0.45724612618531285, 0.3587109816274099, 0.2694694322358629, 0.1945760837449746, 0.13768250658758374, 0.1000561492251798, 0.08036795868629742, 0.07568047815168677, 0.08248360298225066, 0.09733717841318956, 0.11721102574310194, 0.13963009980711794, 0.16270158581301253, 0.18507598087284327, 0.20587595472706977, 0.22461370736976594, 0.24110853776329433, 0.25541048147026557, 0.2677323634958782, 0.2783907658637955, 0.2877556701695644, 0.2962084538886669, 0.3041081320181519, 0.3117659555705165, 0.3194285063088178, 0.32726917583731463, 0.3353874247736952, 0.34381462551624997, 0.3525247843415605 ], [ 0.763237527972888, 0.7940753718027501, 0.8233997563830143, 0.849708307974585, 0.8713908035523679, 0.8869464992918777, 0.8953662400690865, 0.8967636175415864, 0.893267033550808, 0.8890232470266317, 0.8884858983962012, 0.8943530348450521, 0.9053480180980087, 0.9150966258787809, 0.9145554922210609, 0.8957928354337159, 0.8550219259358874, 0.792719910544439, 0.7120779882724579, 0.6178093110307199, 0.5154414387964603, 0.410902797031701, 0.31024289444595116, 0.2193446565350442, 0.14348426761337274, 0.08656959626927396, 0.0499791589682832, 0.032239871156392264, 0.030245971627657187, 0.04034165133767387, 0.05895555468240088, 0.08293569480524887, 0.10969337729117923, 0.13723092241377233, 0.16410363335467015, 0.18934896175210725, 0.21240341229633197, 0.2330191609700617, 0.25118669417487094, 0.2670662551689316, 0.2809288967911708, 0.29310698813758007, 0.3039537086736403, 0.3138110710299238, 0.3229861051853369, 0.331734853028819, 0.34025369020480517, 0.34867722282639024, 0.35708167664903323, 0.3654924108767073 ] ], "zauto": true, "zmax": 1.0773543044007658, "zmin": -1.0773543044007658 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 1e-06, 1.3011511650442548e-06, 1.692994354296022e-06, 2.2028415765056147e-06, 2.866229883678204e-06, 3.729398352432554e-06, 4.852511011181743e-06, 6.3138503555892e-06, 8.215273746089953e-06, 1.0689313005882424e-05, 1.390841207112662e-05, 1.809694657026198e-05, 2.354686311364001e-05, 3.063802837345029e-05, 3.986470631277378e-05, 5.1870009063012666e-05, 6.749072272319499e-05, 8.781563250096393e-05, 0.00011426141253772724, 0.00014867137004306603, 0.00019344392634026088, 0.0002516997901283655, 0.0003274994751669172, 0.0004261263236648159, 0.0005544547624925005, 0.0007214294601814526, 0.000938688782612345, 0.0012213760031100258, 0.0015891948094037057, 0.002067782677737912, 0.0026904978401970136, 0.0035007443993213955, 0.004554997653699184, 0.005926740503884541, 0.007711585311544345, 0.010033938212454078, 0.013055670395116691, 0.01698740074503987, 0.02210317627048227, 0.028759573555516536, 0.03742055263793628, 0.04868979566145066, 0.06335278435066323, 0.0824315491666629, 0.10725590623460621, 0.13955614735503497, 0.18158364372009145, 0.23626776957937787, 0.3074200836506151, 0.4 ], "xaxis": "x2", "y": [ 0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1 ], "yaxis": "y2", "z": [ [ 0.2271760109154918, 0.18372365166263221, 0.13500496372353193, 0.08199422040906955, 0.026490591641406398, 0.028646447010093463, 0.07981612787434997, 0.12409431040111235, 0.15950213774309188, 0.18479743440631335, 0.19930545485797885, 0.20280339458473176, 0.19546552128067615, 0.17787265009344153, 0.1510864344345166, 0.11678469763435721, 0.07744645031137337, 0.036560822746407894, 0.001195401577757272, 0.03006851968051572, 0.04541754078708613, 0.045593289073619966, 0.03207028699029582, 0.009397718227623388, 0.014998287464170406, 0.03279223438478532, 0.038828532062909815, 0.032213445370354275, 0.01635762082241188, 0.0012094430631996945, 0.010001040877566142, 0.0026133777954966734, 0.02054911774798325, 0.05399236171418745, 0.09221788176176841, 0.13078296895834357, 0.16633286229438848, 0.19644907631676042, 0.2194510720654227, 0.23420823070139385, 0.23998664504486406, 0.23634147430596467, 0.22305948768635037, 0.20015363867267147, 0.1679100928588917, 0.1269868674460942, 0.07856128883793052, 0.02452089112939976, 0.03232067816267221, 0.08858879668532046 ], [ 0.2323631147848385, 0.19130646095500856, 0.14665831896515794, 0.10178468261416904, 0.06730396796021668, 0.06783102813261684, 0.0994272593016412, 0.13615240506255394, 0.1678969104488166, 0.19123489674898064, 0.2047585191442026, 0.2079670258169797, 0.20095503652210459, 0.18435919082994232, 0.15946107090013953, 0.12847556027007653, 0.09522702042318594, 0.06680669830767283, 0.05458246971582915, 0.05971128508947048, 0.06628246131816663, 0.06452863465716271, 0.054126145235506594, 0.04191801020066019, 0.039207216977850796, 0.045090406427643136, 0.04817509922539225, 0.04432274321568207, 0.037656497917264706, 0.03581659717149795, 0.03722826572547154, 0.03566445666328403, 0.039611968889477565, 0.06139414888767538, 0.09464930010008431, 0.13103477439081096, 0.16568345814974483, 0.19557962824294628, 0.2187671568851217, 0.23398350966511278, 0.2404453505741774, 0.23771969679431693, 0.22566782707202973, 0.20446905333403548, 0.17476059032696384, 0.13803395735675494, 0.09794233742325652, 0.06589151641013133, 0.06960219774545515, 0.10701836825814787 ], [ 0.2465561845556544, 0.21135327551558264, 0.1754310663338304, 0.14341991612147365, 0.12337962467573708, 0.12316545248599091, 0.1406289483689783, 0.1656317194845398, 0.1898351753730055, 0.2086268788807105, 0.21972617490972912, 0.2221809084953357, 0.2159223864932623, 0.20164166235523362, 0.18087511754353724, 0.1562621499287917, 0.13187569323675918, 0.11299647165678592, 0.10354059695169196, 0.10160132820868713, 0.10042452366226566, 0.09464011562299936, 0.08350543556501633, 0.0707500578863706, 0.06208671922419483, 0.059557711864801105, 0.05948292703790567, 0.058632008997295065, 0.057673039921626715, 0.05804067341753477, 0.05804890717794811, 0.05630685294134722, 0.05876328501653368, 0.07465703415901684, 0.10289800217486214, 0.1363713092999487, 0.1695173807888725, 0.1988165037837588, 0.2220622308014996, 0.23789607688752243, 0.24554218884720655, 0.2446651096445714, 0.23532908218192905, 0.21807215736296282, 0.19415281609259757, 0.16611919960826685, 0.1389839203367774, 0.12169274217820232, 0.12419816885066993, 0.14668105153336017 ], [ 0.26661198886410015, 0.2383172497100443, 0.21113210242926975, 0.1887992361651554, 0.17584571531700988, 0.17519280226023753, 0.18545940186199555, 0.201729541932774, 0.21869492705727245, 0.23243868926154984, 0.240590156873878, 0.24199755567047598, 0.23645804615274876, 0.22460099478247794, 0.20789319583670887, 0.1886756337601144, 0.1700129502308561, 0.15493240165600974, 0.144816132684416, 0.13806659252677214, 0.13098948998952156, 0.12036737610158396, 0.1053472401433586, 0.08781383230406176, 0.07166522694299646, 0.06115452810535712, 0.05811649421733098, 0.06029719809000401, 0.0637973704072728, 0.06552538438329328, 0.06375223001585216, 0.06007244415917713, 0.06233639499181854, 0.07890932542261586, 0.10749481432194517, 0.14102574539327262, 0.17422449586419797, 0.20377413736945607, 0.22761868643655558, 0.24453559386019857, 0.25389797641088707, 0.25555542645127577, 0.24981447677668542, 0.23752636221827977, 0.22030553069324169, 0.2008920228077377, 0.18352739563774348, 0.17368248821433216, 0.17591502074958573, 0.19069472849600527 ], [ 0.2892072222675689, 0.2672988009976477, 0.24717503221880693, 0.23138608214536754, 0.22240121655072284, 0.22142643718001204, 0.22750367963052298, 0.23785429070648914, 0.2491221910852579, 0.2584129517258441, 0.2637131311266811, 0.26391996975556214, 0.2587559997584262, 0.24869303725548433, 0.23489486899227208, 0.21910798795684722, 0.20336016321872039, 0.18932938244268652, 0.17749963829075083, 0.16670031620724673, 0.1546328286262992, 0.1391148712554048, 0.11915340803422453, 0.09539405108440055, 0.07030973906851548, 0.04927640888727225, 0.04184117394127469, 0.04913229844137616, 0.058286022666642075, 0.06121394163449171, 0.05620555612494656, 0.04771969077487978, 0.05011280182532088, 0.07283617493260325, 0.10675342116161605, 0.14344191433361753, 0.17847865040875813, 0.20930268316407907, 0.23436143358071612, 0.2527782108139339, 0.26418991823514226, 0.2686724575718819, 0.26673806060819344, 0.2594024261582058, 0.24831073079047855, 0.2358686514848348, 0.22521679278967732, 0.2197447337073673, 0.22196825695151043, 0.23236556039832595 ], [ 0.3117896599990539, 0.29517076766680644, 0.28036073396672123, 0.2689986788473161, 0.2624485241949703, 0.26121995778716955, 0.26461844455660216, 0.27091886300895374, 0.2779383683576504, 0.2836215579039202, 0.28639883422122286, 0.28532287081565777, 0.28008105103532704, 0.270955945447621, 0.2587491890576401, 0.24463451952022894, 0.22988168448503143, 0.215432614607339, 0.2014513613579259, 0.18712733188478306, 0.17094999725885757, 0.15133537659466034, 0.127234619315108, 0.09848231469599586, 0.06598590790585611, 0.03239937472108172, 0.013740659727912274, 0.034366306596239085, 0.050401810852221875, 0.05380934704841704, 0.04372205422378958, 0.024314334730454204, 0.028195510579371478, 0.0641796090342173, 0.10541837118156576, 0.14600002469074777, 0.18327603872207365, 0.21561302041537922, 0.24201884654099307, 0.26199195781371787, 0.275437773990335, 0.2826294798006151, 0.2842094629117771, 0.28122459331578314, 0.2751725976494587, 0.268005263554116, 0.26199297549964906, 0.2593510486015186, 0.2616575902522361, 0.2693518370531136 ], [ 0.3327507474067121, 0.32028067323515197, 0.3093687951100162, 0.30104402205645464, 0.29606534186116534, 0.2946276962141493, 0.29621050978864916, 0.2996736750665021, 0.3035510732025328, 0.30638734082722663, 0.30699309532157526, 0.3045839884501234, 0.2988271615425147, 0.2898261262494203, 0.2780558816190878, 0.2642388432980257, 0.24914726543881988, 0.23334542687076565, 0.21694555440130586, 0.19950127148905208, 0.1801267840038292, 0.15780515898227349, 0.1317571895363527, 0.10179964854443187, 0.06883517959186375, 0.03644608891268418, 0.022355908075523876, 0.0397122147957024, 0.05428320960622255, 0.056131575572457466, 0.043724694082538616, 0.020583604495028822, 0.027268455032480907, 0.0672431466653635, 0.11048297083746922, 0.15229475789318275, 0.19040574984015762, 0.22346256969299338, 0.25071705120341825, 0.27187277115754255, 0.286996510850474, 0.29647203678988565, 0.30098492459381454, 0.30152484128371193, 0.29938180775073947, 0.2960988688700548, 0.2933358772178222, 0.2926208507613763, 0.2950365478847281, 0.3009782083304525 ], [ 0.35124880057884017, 0.3419359287226381, 0.33385208382826514, 0.32763213247167616, 0.3236924300686526, 0.32207493923674396, 0.3223763526774479, 0.32380425234751203, 0.3253384279412962, 0.32592942936460373, 0.3246691051519756, 0.3209014446609064, 0.3142725729135271, 0.3047307525898942, 0.2924849766232876, 0.2779251666174459, 0.2615078514464496, 0.24362353883767582, 0.2244815114640275, 0.2040579592789315, 0.18213768956400986, 0.1584499769396209, 0.13290521989134502, 0.10603328700175732, 0.07993796872216029, 0.06019639751597719, 0.05518813700002333, 0.06278129601141838, 0.07023923434578465, 0.06963732070056808, 0.059940123025380515, 0.04870088565444435, 0.05566754937845372, 0.08543263156210397, 0.12407898828878097, 0.1636503980899479, 0.20059631969895184, 0.23314394966507887, 0.26042981057790376, 0.2821532445256977, 0.2984069481994074, 0.309587714476775, 0.31634953255371984, 0.3195753130435122, 0.32034442309324346, 0.319871471185562, 0.3193960571415926, 0.32002247196966166, 0.32254345167110837, 0.3273134419948383 ], [ 0.36697077732074707, 0.3600135624912536, 0.3539654311097687, 0.3492084837324564, 0.34595860572386006, 0.3441793690027819, 0.3435465091878378, 0.34348144244327167, 0.3432434692667585, 0.3420483674789383, 0.3391785287519327, 0.33406254166743854, 0.32631769597240834, 0.3157588676020015, 0.3023810202138752, 0.2863238415975657, 0.26782941519073683, 0.24720773164685886, 0.22482613742379942, 0.20113088530393594, 0.17669112853988395, 0.15224592999723102, 0.1287707025127143, 0.10766641076959743, 0.09111473660815896, 0.08185767457789062, 0.08073705967305207, 0.08408797668505127, 0.08614808827760201, 0.08328074923912022, 0.0763174157297025, 0.07233441910560956, 0.08211157531513252, 0.10762481683867448, 0.14173934380340206, 0.17804994361550147, 0.2128226572472582, 0.24404008673292432, 0.27069724132853096, 0.29242208299770084, 0.30926511384145183, 0.3215779473341046, 0.32994043430013914, 0.33511080316808123, 0.3379786848954082, 0.339504461751029, 0.3406352275328806, 0.3422007775733047, 0.3448102529790137, 0.3487817765778209 ], [ 0.37993264305602154, 0.37470544284621315, 0.37010967797544203, 0.36636477806983353, 0.36356610752774804, 0.3616353395427084, 0.3603010638010772, 0.3591182779663631, 0.35752151876343363, 0.35489535268105904, 0.3506432737388917, 0.3442411381599792, 0.33526951676299865, 0.32342669745871944, 0.3085292497035222, 0.2905108820979545, 0.2694337303938792, 0.24552862197323091, 0.2192794056023637, 0.19155603665453344, 0.16377378995228775, 0.13799576047911838, 0.11677584792135132, 0.10240762434463295, 0.09556000149958566, 0.09447506803604344, 0.09587231660709612, 0.09647388062015264, 0.09407470232906705, 0.08854457650255182, 0.08309726467340536, 0.08464939270912565, 0.0991627418199486, 0.125396136937278, 0.15796591289530407, 0.1922150703335135, 0.22513213975340104, 0.25494958644153926, 0.2807394201726002, 0.30214099766271413, 0.3191838581797485, 0.3321719389745118, 0.34160607834021645, 0.3481273121047149, 0.35246680498013083, 0.35539183003693725, 0.35764280289546446, 0.35986445860094624, 0.3625428283937956, 0.36596427771273826 ], [ 0.3903344355046044, 0.38635786179122783, 0.38278503914075046, 0.3797300869994191, 0.3772143964127716, 0.37513661790504504, 0.3732607048030521, 0.37122621882739115, 0.36857807593396286, 0.3648071840722037, 0.35939159160091844, 0.3518300283290259, 0.34166441451761176, 0.3284931393623828, 0.3119816787680191, 0.2918813832841187, 0.2680713447942648, 0.24064249616420097, 0.21004838467503284, 0.17735585237946808, 0.14464033512486418, 0.11551902847991527, 0.095237447175868, 0.08789191770401848, 0.09097860631814197, 0.09711060115128713, 0.10049761330726044, 0.09857036805984976, 0.09138318150925986, 0.08185253113845356, 0.07672356387982258, 0.08421913219660662, 0.10577492594377867, 0.13608207148749463, 0.16990351861828387, 0.20385619466178465, 0.23587213938509868, 0.26472664200012175, 0.28977431262853937, 0.31078485467296996, 0.327828585838218, 0.34119295602894106, 0.35132002677742447, 0.35875671348907306, 0.3641104828059879, 0.3680050295717731, 0.3710337789948598, 0.3737135222564652, 0.3764446918332423, 0.379486593046942 ], [ 0.39846178113812986, 0.3953720521926393, 0.39250505287025, 0.3899063155084053, 0.38755124303534844, 0.385325971771522, 0.3830188891403581, 0.3803248598416874, 0.37686055257183465, 0.37218626864436866, 0.36582864278199895, 0.3572998152814153, 0.346111562171083, 0.3317865041455521, 0.31387220519154574, 0.29196742636748174, 0.2657731257029943, 0.2351848542503664, 0.20045147746309033, 0.16245100391813644, 0.1232294790954265, 0.08728874500751166, 0.06433033654640259, 0.06479415584842198, 0.07923054549674965, 0.09222094452037528, 0.09718082791243232, 0.0925253222722426, 0.07953656916511116, 0.06346436853231559, 0.05735676591438464, 0.07359901070209249, 0.10480379138074043, 0.1409928483368382, 0.17756784927455332, 0.21238934867533132, 0.24431098679453006, 0.2727017117954733, 0.2972692362367878, 0.31797323178578235, 0.3349671706851172, 0.3485517512855341, 0.3591348943208701, 0.36719579751672143, 0.37325086038777183, 0.37781987820489266, 0.3813923731023551, 0.3843960142041031, 0.3871709334741304, 0.38995432008844066 ], [ 0.4046219633231382, 0.4021439225485217, 0.39974680639180454, 0.3974311616479313, 0.39514366656815725, 0.3927643467286253, 0.3900999258777473, 0.386884257238434, 0.38278485510001353, 0.3774130300994908, 0.37033469574529926, 0.3610797902602241, 0.3491502156808864, 0.3340287435281901, 0.31519395280465173, 0.2921485320426968, 0.26446992288359084, 0.23189330930616284, 0.1944382153676057, 0.15259604948864766, 0.10763387570342237, 0.06237320145542332, 0.027116629442713012, 0.038863095441974936, 0.06623227716012686, 0.0844925259092304, 0.09024703748429455, 0.08308512762797213, 0.06417480972276078, 0.03796421240305841, 0.029194303445965936, 0.061335827894006725, 0.10256506282810122, 0.14379113400133647, 0.18274633864538456, 0.21847570457635412, 0.2505251174117951, 0.27870343268033626, 0.30299315208347377, 0.3235116422490575, 0.34048762370572694, 0.35424011720832577, 0.3651562963071908, 0.37366791200540833, 0.3802267089252448, 0.3852794529573636, 0.3892436273297555, 0.3924855743760585, 0.39530347453217374, 0.3979175540665121 ], [ 0.40910432524876506, 0.40702921038164874, 0.4049239526456513, 0.40275913603347446, 0.4004633963643768, 0.397914752793678, 0.39493536037085814, 0.3912900175286855, 0.3866877583590771, 0.3807851631648398, 0.3731900048185039, 0.363464670447138, 0.3511303550973305, 0.3356750119630809, 0.3165700614080536, 0.29330251222939446, 0.2654301294133348, 0.23266747306260105, 0.1950102913552379, 0.15290648680454624, 0.1074938191380289, 0.061043868612243105, 0.020297589675647088, 0.03144071108691868, 0.06018445433074894, 0.07826736378196478, 0.08337658871003054, 0.07525205146211274, 0.05462897747816006, 0.023738916577468797, 0.01969594070607477, 0.062049193099454066, 0.10590065816110535, 0.148108117329223, 0.1873655490537526, 0.22304318078859978, 0.25487603737853864, 0.282805806772905, 0.3069053937309707, 0.3273453464304576, 0.3443762760346591, 0.35831422167716037, 0.3695243145462042, 0.37840222289009595, 0.3853543163165346, 0.3907777970173162, 0.3950421038288778, 0.3984729960412218, 0.40134077820879654, 0.40385391426581874 ], [ 0.41215719819349406, 0.410325058381986, 0.408374312066381, 0.4062546925483223, 0.40388298712434934, 0.4011375198632713, 0.3978545281389878, 0.3938263875829523, 0.3888011153408838, 0.3824823336910791, 0.3745291438897346, 0.36455626563759297, 0.3521362956858485, 0.3368078179908225, 0.31809503457493904, 0.29554626986554033, 0.26880005698390147, 0.23768914520254011, 0.2023971475170964, 0.16369849123311334, 0.12337482449344242, 0.08515802454955053, 0.05724893958075532, 0.05194952337835107, 0.06324264991625493, 0.07381122211818508, 0.07650363929280013, 0.06991339881801094, 0.055615440158601474, 0.041480852662413435, 0.04835712135087398, 0.07835596023233402, 0.11607337354401588, 0.1548004203145123, 0.19196077988903756, 0.22637511112594666, 0.2574794866169355, 0.28503542571545676, 0.30900385023187293, 0.32948450563015663, 0.34668099373265837, 0.36087446989397276, 0.37239982485182266, 0.3816229498513123, 0.3889194037197709, 0.39465519925658177, 0.3991704228702058, 0.4027663485775587, 0.4056966338720127, 0.40816299921053556 ], [ 0.41397557583708283, 0.4122619331901087, 0.4103566814093976, 0.4081934120819475, 0.4056797051532522, 0.40269451613854856, 0.39908675987629716, 0.39467476325491246, 0.3892459394682407, 0.3825559823496511, 0.3743272879273555, 0.36424731606734084, 0.35196921399992065, 0.3371190583512497, 0.31931616276924984, 0.2982145652518695, 0.273574667404048, 0.2453740202683661, 0.2139659022932275, 0.18029391191266342, 0.1461653624618965, 0.11453561612608683, 0.08945761464123532, 0.07445653752197333, 0.06881249811078251, 0.06741036809214773, 0.06585943775567292, 0.06279476961075338, 0.059636556434683775, 0.06122158339449248, 0.07357361865376705, 0.09715652557175421, 0.12774878263218933, 0.16132712992347775, 0.19522891054728628, 0.227791589328533, 0.2579931655588116, 0.2852415260408112, 0.30925173571121495, 0.3299655799853541, 0.3474913347050187, 0.3620547464809694, 0.3739579745869456, 0.3835453691477427, 0.3911755395511739, 0.39719924387885647, 0.4019426374973837, 0.4056954684218934, 0.40870386405653136, 0.4111673476621007 ], [ 0.4146952767431533, 0.4130016196714438, 0.41105308956840836, 0.40876825871049044, 0.4060448863599909, 0.40276036244852126, 0.3987732882023209, 0.39392561909536905, 0.388044480955404, 0.3809426854933675, 0.37241732256309584, 0.3622467932311698, 0.35018837284287424, 0.3359807185937283, 0.3193581335995779, 0.30008489373488645, 0.27801721666393553, 0.25319597910613667, 0.22596304068351225, 0.19707425399746134, 0.16774651411137148, 0.13952475597199773, 0.11384572707501292, 0.09141359862160796, 0.07211955561479783, 0.05646493472922401, 0.04775825064382413, 0.04964748509881487, 0.05926960157104306, 0.0722787969175694, 0.08836336013444573, 0.10897546166796064, 0.1345022703844727, 0.16377188967342676, 0.19490319384246896, 0.2260682531508466, 0.25582890359724253, 0.28320614078957634, 0.30763464387652273, 0.32887987680271447, 0.3469516145561274, 0.36202729496990077, 0.37438927377438636, 0.3843759514834023, 0.39234513530205495, 0.3986475882845855, 0.4036088411629358, 0.4075176557058825, 0.4106198495742281, 0.4131164316104395 ], [ 0.4143904443506411, 0.4126381823732896, 0.4105736976425725, 0.4080985258023788, 0.4050967283636953, 0.4014387487206188, 0.39698689840498036, 0.39160168481357366, 0.3851477278171582, 0.37749767044016114, 0.3685324944514767, 0.3581373264166065, 0.3461934875847509, 0.332570281545192, 0.3171232715790808, 0.2997080420132064, 0.2802172160774777, 0.2586411645108784, 0.23513771525285396, 0.21007419473313022, 0.18398384402517795, 0.1573825590472357, 0.13047080600635644, 0.10293008952423995, 0.07420489961739163, 0.04478674617687346, 0.02212782032964757, 0.032077991380454925, 0.054665308503620336, 0.07436880172558805, 0.09161750496589645, 0.10990397147930038, 0.1321808782548553, 0.15904603944366985, 0.18910040918497698, 0.2202557001906456, 0.25064154832148194, 0.2789248089280922, 0.3043133219345805, 0.326450974631379, 0.34529625781509676, 0.3610161680087361, 0.3739028980495465, 0.3843121145586031, 0.3926191458667457, 0.3991892041566518, 0.4043583090704523, 0.40842226708754564, 0.4116316665272349, 0.41419130555374334 ], [ 0.41307205604886954, 0.4111995618653722, 0.4089621273399713, 0.406239400744848, 0.40289451856264874, 0.3987817982186009, 0.3937570810017943, 0.3876898075924191, 0.38047520502268234, 0.37204415418037423, 0.36236758422143567, 0.35145206124125405, 0.33932434332021916, 0.3260058245914839, 0.31148303958551626, 0.2956860372648386, 0.27848852804962104, 0.2597375984177643, 0.2393048219109452, 0.2171299402360208, 0.1932161767826661, 0.1675518830475244, 0.13999274438605477, 0.11022953268418675, 0.07802201475686583, 0.04386885364947136, 0.012184245270807534, 0.026659448021658205, 0.051790222314699215, 0.07023962739399081, 0.08420436998907008, 0.09892699268658138, 0.11915048542976378, 0.14598745851847655, 0.1773935709862952, 0.2104746302215018, 0.24283903899720552, 0.2729007662608935, 0.2997770520849584, 0.3231051256415362, 0.3428754625086015, 0.35930118136344313, 0.37272186309331573, 0.383535420119431, 0.3921515598897626, 0.39896143714514437, 0.4043192687121664, 0.4085326949048093, 0.41185944693532467, 0.4145084399054372 ], [ 0.41068577424114044, 0.4086480550779064, 0.40619941170102825, 0.40319025126136915, 0.39945222069857544, 0.3948101247511235, 0.38909800789072985, 0.3821785251343464, 0.37396381941790946, 0.3644347456126552, 0.3536534260775657, 0.3417622334564597, 0.3289616317793449, 0.3154620508565028, 0.3014133277190318, 0.2868288126745877, 0.2715337662027379, 0.2551679444885154, 0.2372530574477619, 0.21730486423356388, 0.19494840022399246, 0.17000227462105486, 0.14253886260167375, 0.11299965164048567, 0.08258210806096322, 0.054562848729763684, 0.03818272848735716, 0.04299779736747951, 0.05533827987871618, 0.0635679119533968, 0.0681480146667377, 0.07658245111185108, 0.09604475520646326, 0.12600249657590057, 0.16157352792493326, 0.19845568600449284, 0.23388240003066516, 0.2662806694930338, 0.29488677961937776, 0.3194691648667414, 0.3401347894890535, 0.357193000703136, 0.3710600292869389, 0.3821930425441995, 0.3910459639027556, 0.3980413901619592, 0.4035544018419734, 0.4079050941313557, 0.41135737323890265, 0.41412206011567965 ], [ 0.4071080864964633, 0.404878467845549, 0.40220515938233514, 0.3988999249881104, 0.3947492650828789, 0.389530854766326, 0.3830360279152182, 0.3750977032788505, 0.36562228791950974, 0.35462233723795167, 0.34224359731423254, 0.32877544480588544, 0.3146289997680044, 0.30026641649615876, 0.2860752792847384, 0.27220943622573784, 0.25845451307957806, 0.24419411712414726, 0.22852195991761448, 0.21047749762603143, 0.18933292064714083, 0.16486699917041375, 0.13761473905788044, 0.1091569920937034, 0.08261761142646633, 0.06336095813241635, 0.056927179985673065, 0.06021839648959238, 0.06292759948034485, 0.05844620912597131, 0.047653294809971915, 0.04460568540695695, 0.06671831068225438, 0.10426353693445702, 0.14617497643624955, 0.18759134152740423, 0.22615179049005787, 0.26068551535178675, 0.29072623197819797, 0.3162543653800628, 0.33752916527569937, 0.35497101802579656, 0.3690778617733021, 0.3803667199611241, 0.389334271379677, 0.3964319924297786, 0.40205246860278326, 0.4065241785851438, 0.4101125060828907, 0.4130250310573932 ], [ 0.40214034906223944, 0.3997133583558571, 0.3968350709431002, 0.3932677404405451, 0.38873649599456983, 0.38295056783136544, 0.37563250712288765, 0.36655520839145855, 0.3555862479956777, 0.3427376085736546, 0.3282149922034375, 0.3124532427890752, 0.2961126073499796, 0.27999902590314063, 0.2648752536522526, 0.2511732253511884, 0.23870764699482633, 0.22656265774732887, 0.2132712149366912, 0.19723886104247204, 0.1772471523034366, 0.15291681647589792, 0.12514993273340447, 0.09671488332350882, 0.07314171047331762, 0.062123668958678706, 0.06478781760814804, 0.07095277055279085, 0.07086314925133494, 0.05955721609769597, 0.03563615798704344, 0.006247475178015971, 0.044541698973075486, 0.09116025669420916, 0.13779456618715066, 0.18195866474863046, 0.22217292777444278, 0.2576835254841452, 0.2882617403812319, 0.31404074879849764, 0.33538600821993925, 0.3527954738537048, 0.3668250386399195, 0.3780346630944879, 0.38695126995490214, 0.394045217425722, 0.399717768472968, 0.40429732980634403, 0.40804237007021427, 0.4111489632853605 ], [ 0.3955011438722551, 0.39289562139350537, 0.3898748017149404, 0.3861396569937965, 0.3813358198907883, 0.3750801723513653, 0.36699693571512665, 0.3567632554558182, 0.34416526458627095, 0.32916569254845873, 0.3119813340349599, 0.29315993688933933, 0.27362671882812717, 0.2546383389873473, 0.2375522596716016, 0.2233543775090271, 0.21207318271895434, 0.20245975893065518, 0.19226340417669568, 0.17898039156288326, 0.1606484607341904, 0.13644053622201294, 0.10717011500191721, 0.0762177183258741, 0.05228140489836448, 0.049723450205913955, 0.06352869371010976, 0.07574588903155711, 0.07818240950228565, 0.06851179553135335, 0.04864050541852302, 0.033203105686934443, 0.054994981787338484, 0.09649228751157511, 0.14108515082209422, 0.18405111035555105, 0.22336228388157817, 0.25808922655972844, 0.28794411366849654, 0.3130464948115968, 0.3337684869306621, 0.350623922560288, 0.364187570922706, 0.3750368529607814, 0.38371127240129976, 0.39068639614653433, 0.3963600861660926, 0.4010489468261633, 0.40499280299598683, 0.40836475612284473 ], [ 0.3868183172886003, 0.3840797545981409, 0.38103145166149766, 0.37730057369249365, 0.37243356784029497, 0.36592979529678893, 0.3572850866848667, 0.3460444738479424, 0.3318663390574125, 0.31460308906793544, 0.29440442365758546, 0.27184486587696705, 0.24805882818554278, 0.2248151058076524, 0.20435767108620198, 0.18874588150904545, 0.178672062440343, 0.17254920200227836, 0.16693174313347128, 0.15798817231437096, 0.14278648459605456, 0.11988644393777192, 0.08954372851349911, 0.054100342901151226, 0.022240681036422988, 0.032677122463475226, 0.05951218370946102, 0.07790797606402153, 0.0847650149587032, 0.08084012278021341, 0.07112335581344036, 0.06776703614741182, 0.08378341108568933, 0.11583284055789177, 0.15416593094119116, 0.1929182209246966, 0.22917129143577294, 0.2615354128453424, 0.28948210961202936, 0.3130026969419811, 0.33240312027841135, 0.3481669563423946, 0.36085878024603585, 0.3710547063802703, 0.3792933508395182, 0.3860437210423314, 0.3916879909144447, 0.3965172846734718, 0.40073797610327627, 0.4044852393654352 ], [ 0.375623164091184, 0.37282447549279935, 0.36992570093618315, 0.3664659550176449, 0.3618702924318077, 0.3554946104524048, 0.3466791309905832, 0.33480718748314564, 0.31937166312504084, 0.3000575217141381, 0.2768546068646786, 0.2502199057934143, 0.22130909111007416, 0.1922705218422955, 0.1664480006575376, 0.14787700774946624, 0.1390724011411219, 0.1381838414054244, 0.139575108413795, 0.13738215003214574, 0.12772317841623468, 0.10897786176617894, 0.08153228385345417, 0.04785417157414427, 0.017087779520599783, 0.033148509529627966, 0.06088786007508408, 0.0801125129190262, 0.08924395261911161, 0.0902755126328656, 0.0887441659450405, 0.0932402636199247, 0.110027073726032, 0.13766203152824316, 0.17082185623239385, 0.20502070166427036, 0.23746983852991266, 0.26666190734734757, 0.291941473042327, 0.3132073330418971, 0.33070914418312786, 0.34490302012906576, 0.35634508461278713, 0.36561146159566466, 0.37323915079329345, 0.3796858140074337, 0.3853079081871043, 0.3903560566570706, 0.39498479131608505, 0.3992719921913817 ], [ 0.36135036806918747, 0.3585907985768775, 0.35608968036513644, 0.3532789279972489, 0.3494336958883874, 0.3437376202734172, 0.33535261017278306, 0.3234849294534198, 0.30744878979897183, 0.2867375026842257, 0.26112000253081863, 0.2307908020734192, 0.19662351884347626, 0.1606314397196463, 0.12682078658899087, 0.1022359023225655, 0.09456154392603706, 0.10210823786221436, 0.11382040890252838, 0.12071216643916562, 0.1186506275652431, 0.10684338409361827, 0.08705575563927996, 0.06423460124666475, 0.04919347262289183, 0.0535888587312771, 0.06868921748651617, 0.08173290115180994, 0.08894552661586615, 0.09212295758114557, 0.09640660944928914, 0.1075287032977804, 0.12776607211358978, 0.15505127075738112, 0.1857384099665163, 0.21669004396449443, 0.24577628416596278, 0.27176352161090306, 0.29410073143510884, 0.3127269352988679, 0.32791500770672055, 0.3401456586818226, 0.3500037844735901, 0.35809240665436975, 0.3649635237102758, 0.3710684246042537, 0.3767307344276823, 0.38214311355758157, 0.3873842540664632, 0.39244892096105144 ], [ 0.34334839405980055, 0.34075104753530894, 0.338977852552148, 0.3373223050550973, 0.33486606120144047, 0.33058207310371246, 0.323433165038482, 0.31245024276293265, 0.2967912140925274, 0.2757932464764883, 0.249036456956193, 0.21644072733487132, 0.17842849147766682, 0.13623769201921224, 0.09274106995729826, 0.0558427193835311, 0.04802646142856819, 0.07072819883975236, 0.09511190663478487, 0.11082380130489512, 0.11572067561961213, 0.11060064492959241, 0.09838622900888144, 0.08413098468486264, 0.07431350653141247, 0.07277328486230636, 0.07644798720796682, 0.07985746108568899, 0.08127572417973264, 0.08379256196290617, 0.09273664305650624, 0.11082955048327495, 0.136378763578032, 0.16593547676029952, 0.1964400375770826, 0.22569603746290648, 0.25228705103835414, 0.2754299236397583, 0.2948444499678927, 0.3106393834480509, 0.3232091729429943, 0.3331368311364423, 0.34109973841785357, 0.34777863347041316, 0.3537754237311453, 0.3595501311887516, 0.36538762075569103, 0.3713990087895101, 0.37755318322233883, 0.38372590259773764 ], [ 0.3209059509059387, 0.3186154242017774, 0.31800040735726537, 0.3181583456664254, 0.317901806269413, 0.3159320578806992, 0.31098640120276216, 0.3019346041422315, 0.28783220886542055, 0.26795364831926743, 0.2418292073660723, 0.2093047393807841, 0.17063670660036404, 0.12662909771346614, 0.07881425751214689, 0.029716917409778703, 0.017863769310113655, 0.058136437583871874, 0.08876321360020435, 0.10799092260486891, 0.11589506026822233, 0.11419605641836654, 0.10617264555499721, 0.09620539140226637, 0.08826135552354228, 0.08339501848277936, 0.07912659095313834, 0.07268467845071123, 0.06536925060931076, 0.06499291312952325, 0.07944394911823847, 0.1061001578926888, 0.13823735411248858, 0.17135597369114017, 0.20292156703830397, 0.23148314187893113, 0.256244388423064, 0.2768757624837524, 0.2934189731998064, 0.30622129820776006, 0.3158736650573329, 0.32313947939290766, 0.32886723866121337, 0.3338875298919914, 0.33890632258870335, 0.3444172672893276, 0.3506575478685349, 0.357619681205433, 0.3651110387508823, 0.3728368346707156 ], [ 0.2933009045595187, 0.29148377181453305, 0.2925915698626225, 0.29541289094614875, 0.29835353911074897, 0.29974123118526236, 0.2980476554663888, 0.2920008607640653, 0.28062208694721885, 0.2632353794754242, 0.23948978100751345, 0.20942451045882132, 0.17361175009984647, 0.13346190963355628, 0.09204761502314465, 0.05733865668685515, 0.04971352241801929, 0.07041496595721154, 0.0936213533150182, 0.10921149666495417, 0.11524575962777539, 0.11292697532865259, 0.10541965203233226, 0.09679053148891165, 0.08989850762379434, 0.08411586612619194, 0.07581018937295488, 0.061733613451150735, 0.0435819682238019, 0.03832330911916776, 0.06277378173202665, 0.09945617251112504, 0.1377917105637144, 0.17410474546894233, 0.2066944806645565, 0.2347072379681008, 0.25779046870156574, 0.27595486877780334, 0.2895133120156101, 0.2990482716448514, 0.3053806910671065, 0.30951917721957345, 0.3125722878953245, 0.3156177976991339, 0.3195458877550915, 0.32492042205400545, 0.33191190507445884, 0.3403303171102687, 0.34973897368738294, 0.35959770762568205 ], [ 0.2598787793105888, 0.2587317371308476, 0.2623313730992048, 0.2689271367794683, 0.27626600376206223, 0.2821431293957468, 0.2847167257161221, 0.28260238385689274, 0.2748562959298662, 0.2609394564463158, 0.2407177253439109, 0.2145328978325511, 0.183385870925424, 0.14931910976539625, 0.11619699421442058, 0.09094747807993708, 0.08215211759185335, 0.0894669316048367, 0.10178032897888216, 0.11013430283746013, 0.11104720908997999, 0.10487455855111014, 0.09475508900350682, 0.08535760530876497, 0.0797392380407429, 0.07586466162692843, 0.06805307228374531, 0.05145821584629797, 0.024470517311187667, 0.01447842162745455, 0.055430175337640525, 0.0984516671901443, 0.13973175935977797, 0.17721615753246048, 0.20969274864482462, 0.2365447061945993, 0.25759178342492967, 0.27299755675478005, 0.2832272416273467, 0.28903680671036974, 0.29146937268557227, 0.2918275441331966, 0.2915842935224215, 0.29220414702723946, 0.29488856266060326, 0.30032850581875026, 0.30858609125080305, 0.31917242910527077, 0.33127162532050586, 0.34399136902738897 ], [ 0.22016936294296693, 0.21994514418186067, 0.22715719242914992, 0.23901566243521236, 0.2521560084540029, 0.26363893865939775, 0.27130132072072116, 0.27371853295202836, 0.2700607319185687, 0.2599775144386486, 0.24355618306281043, 0.221369481995743, 0.19462764734275317, 0.16545608857804636, 0.1372830222435424, 0.1149844324976382, 0.10328089006162294, 0.10226806338833397, 0.10595830201551193, 0.10739904578081937, 0.10255383177249486, 0.09093452977132262, 0.07566030154521859, 0.06327781058387588, 0.05946654179654068, 0.06052306440477621, 0.057279438976767474, 0.04443309767942154, 0.02409934784187397, 0.02856561967460125, 0.06496219208584976, 0.10618988637680636, 0.1462354365695325, 0.1824400817986406, 0.21330982500101753, 0.23807268897527917, 0.2564659801448249, 0.26862071587336706, 0.27501570038760315, 0.2764833954629298, 0.27424334092617536, 0.26992100929750285, 0.2654818798253542, 0.26299498116044767, 0.2641982921869864, 0.27001172674789853, 0.2802971774465375, 0.29404491213908795, 0.30983646433829587, 0.3262850099270489 ], [ 0.17405480290738076, 0.1751346396083005, 0.18775878727311027, 0.20690283930767034, 0.22734354452235564, 0.24530260664851147, 0.2584529906726136, 0.2655002077648636, 0.26583434767554526, 0.2593246151804654, 0.24623456950387348, 0.22723561279496352, 0.20350727590378773, 0.17691535549814597, 0.15022548507282424, 0.12713447563938512, 0.11139828340649352, 0.10425206115629237, 0.10227570836582454, 0.09946964916930834, 0.0910047230120752, 0.075036722364524, 0.0534561247610457, 0.03413781717647306, 0.03222670352046694, 0.04114104046485778, 0.043521840546131535, 0.036392560610939824, 0.030533084191060066, 0.04758680483621403, 0.0809748587203355, 0.11890143232464132, 0.15612015768416987, 0.18973377163004332, 0.2180067475931298, 0.23996169484829882, 0.25516525175463206, 0.26360959890088775, 0.26567207625203304, 0.2621466016042477, 0.2543357751336055, 0.2441680677357949, 0.234239928794155, 0.22757722777733563, 0.22690070983309812, 0.23357497697698326, 0.24704668311636685, 0.26533554293588213, 0.28605858611150753, 0.30717996645936874 ], [ 0.12202998847136887, 0.12515642919130726, 0.14645004768221154, 0.17544947104631697, 0.2043084315106528, 0.2288918120883769, 0.2471959074946139, 0.25832730819753635, 0.26200601415649266, 0.2583312210311526, 0.24768554689591324, 0.23072838421202213, 0.20846099765932405, 0.18236080345351588, 0.15458543042653897, 0.12819958815251775, 0.10708726355347256, 0.09444803967388013, 0.08944855579314731, 0.08642455281797475, 0.07906168016680543, 0.06391390509983041, 0.04115105667097753, 0.014367085318107086, 0.011023685655064492, 0.026057228318512066, 0.02809041237985009, 0.02197607147936618, 0.031007502323989404, 0.059728066491117254, 0.09522047067806559, 0.1320610167204423, 0.16711265467552902, 0.19815140204226525, 0.22362679265479204, 0.24254192094733093, 0.25435065441727467, 0.25888733235928185, 0.25635232574955696, 0.24737443486667815, 0.2331715557815912, 0.2158232165979528, 0.19859799027356217, 0.18600091985715586, 0.18271210763231005, 0.19109326262547088, 0.20960025554451386, 0.23430515517822492, 0.2613401474864243, 0.2879712129649096 ], [ 0.06585788400794249, 0.07319440967120962, 0.10943617683583158, 0.15009294970071888, 0.18675078459909772, 0.2166455428884859, 0.23873303784494487, 0.2526991387664688, 0.2586109046603, 0.25675844862879343, 0.2475830651069406, 0.23166377138000627, 0.2097588798038726, 0.1829149000944726, 0.1526780105003287, 0.12148630149107281, 0.09333635214577087, 0.0741402918608127, 0.06799104605241536, 0.06967132571667368, 0.06949907398536172, 0.0624556100962917, 0.0494142893560983, 0.03656852013611564, 0.03170785191670603, 0.0302293710497799, 0.020576835066959703, 0.0024969314655031226, 0.03308048655474981, 0.06952481813539962, 0.10745852177652704, 0.14429766904895938, 0.17801310950923915, 0.20698231735042752, 0.22995802293113254, 0.2460441722881751, 0.2546587441147911, 0.2555029726982197, 0.24856555273736647, 0.2341940901951884, 0.21328169658694418, 0.18766067752773893, 0.16086726255459236, 0.13928065487418353, 0.13181235698923344, 0.14362924329911403, 0.17028560416782404, 0.20370138489345943, 0.23816482787977775, 0.2706380439295031 ], [ 0.019325806671538964, 0.037686616347399754, 0.09094296571860574, 0.13843283491784963, 0.17857853179066788, 0.21054050985513195, 0.23399313805364969, 0.2489613940819769, 0.25569354274749323, 0.2545664162934458, 0.2460222487648553, 0.23053985568857163, 0.2086489318007645, 0.18100447631340855, 0.14855284021830642, 0.11286512551565973, 0.07691861813582736, 0.04764886787407599, 0.04008610058556238, 0.052214189580693834, 0.06337373117587972, 0.06681247093415323, 0.06366459066857903, 0.05762273849002223, 0.05098027733784777, 0.041674478826263316, 0.02631824978155955, 0.01680918632029263, 0.04384115856434991, 0.08112742945886396, 0.11960632714913925, 0.15615068558013553, 0.18878828148963908, 0.2160983255310094, 0.23701658184311064, 0.2507481390847154, 0.25671661140543933, 0.25453463213765776, 0.24400290906852656, 0.22515609502831074, 0.19839047592964246, 0.1647655984182047, 0.12680448096566935, 0.09110457933916896, 0.07506500356895876, 0.09495683317847675, 0.1347798385457852, 0.17849782653834495, 0.2201767504584445, 0.25769196060269517 ], [ 0.06034967177547497, 0.06664281307467206, 0.10381082247359444, 0.14484626662529582, 0.1814845497468966, 0.21119881216113012, 0.23310090726318636, 0.24699693513231816, 0.25304823550158023, 0.2515958957057205, 0.24305095778957012, 0.22782761754407843, 0.20632266584613385, 0.1789566151014461, 0.14629444400325656, 0.10925629253367704, 0.06941805548046907, 0.029512142223132764, 0.01098314080589736, 0.03897054217752728, 0.058728691710819965, 0.06900898232408775, 0.07148004651163602, 0.06800131843981078, 0.05930535359718574, 0.04490906726463181, 0.026347564981990555, 0.025591376238145905, 0.05593334579658778, 0.09378191864735215, 0.13219580307812076, 0.1681609166796352, 0.19976441279745977, 0.22568821619915994, 0.24498415875593674, 0.25694724551579345, 0.26104187140361723, 0.2568623749730876, 0.2441230252545142, 0.2226797817470691, 0.19258942847902055, 0.15421496802097684, 0.10840398652303244, 0.05695705379776378, 0.014301809108995258, 0.06026738671081071, 0.1147148451157661, 0.16561927905990934, 0.21142847320332686, 0.25156702413803206 ], [ 0.11474409859422861, 0.11597190734700573, 0.13645340696635017, 0.16499189665504613, 0.19332475299137217, 0.21732478379673584, 0.23514166276359635, 0.2460797212625528, 0.2500584367053331, 0.24732679935511614, 0.2382866179583513, 0.22337435459052452, 0.20299760510748963, 0.1775475134856911, 0.1475160817069466, 0.11374083772895667, 0.07781599690571929, 0.04305586974141078, 0.02097268486987253, 0.032838302957005135, 0.050929807087923565, 0.06353283368241834, 0.06939909734564242, 0.06776707755389065, 0.05764250822951322, 0.03835826166094527, 0.011967254726809944, 0.027890912427364, 0.06646396371991925, 0.1064883301263598, 0.14520432994889265, 0.180622289250167, 0.21124693182249324, 0.2359848138774897, 0.2540399652792485, 0.26482259321306584, 0.267885718631397, 0.2628932259966425, 0.24962145591471097, 0.22800055804218128, 0.19821173863189795, 0.16088880108445766, 0.11762565139598684, 0.07304390082649544, 0.047575227519261465, 0.07462964090481747, 0.12207424098364866, 0.17011599642571182, 0.21440536451554637, 0.253619227379007 ], [ 0.16385434383561207, 0.16241766761913723, 0.17303333103067187, 0.19057875999429752, 0.20960581833828143, 0.22628714461063523, 0.23843202007373138, 0.2450103325656636, 0.2457498153523065, 0.24085697281979362, 0.2308114666870264, 0.21619830240720372, 0.19757864877168915, 0.175434776195943, 0.15023681158079827, 0.12265131544819984, 0.09385228355579064, 0.06585913908921766, 0.042068181518605585, 0.029407185717804003, 0.03489208786241241, 0.048426944387922756, 0.05915203498068261, 0.06185504995849681, 0.05407606571089244, 0.036083661097593554, 0.019533353412038393, 0.04286996775412595, 0.08144813071254274, 0.12146977872947833, 0.15962910896600477, 0.1940828699625565, 0.22356342715580743, 0.2471668537784967, 0.26424700728834133, 0.2743420940818527, 0.27712853717282687, 0.2724075499088537, 0.26013346164620904, 0.24050137317796363, 0.21413446237260306, 0.1824742962167096, 0.14865287832472068, 0.11942174233288035, 0.10700943460558324, 0.12037586334014255, 0.15201621314779573, 0.19016688008383148, 0.22826541435473818, 0.2634058406211588 ], [ 0.20561052383727896, 0.2021214782432711, 0.2062798091896868, 0.21538014988489299, 0.226014144482315, 0.23525235939812575, 0.2410962115200851, 0.2424671014226475, 0.23905159710635862, 0.2311304165584434, 0.21940011348079747, 0.20476290053043017, 0.18808266857604566, 0.1699616894574805, 0.15063469842820584, 0.1300352574254498, 0.10795798911927099, 0.08414841772395952, 0.05829999084637234, 0.03046798841629852, 0.00833192031264662, 0.029578975791469626, 0.05021818673155019, 0.06125437971548999, 0.06185377727192837, 0.05598541700546316, 0.05578862490277718, 0.07374175618235317, 0.10522253041893997, 0.14121944619285667, 0.17672375963054182, 0.20913433743597723, 0.2369581892829167, 0.2592717975490531, 0.27548524719487316, 0.28522710101599025, 0.28829145911505466, 0.28463266488731814, 0.2744110492208817, 0.25810567497473114, 0.23672612579342747, 0.21217526758584482, 0.18779750672338963, 0.16886276741438788, 0.16169803462967497, 0.16985174123877336, 0.19089501116049526, 0.21910688080945184, 0.24949662536806322, 0.27894175148407574 ], [ 0.23931294428885752, 0.23393039689371342, 0.23334578366426267, 0.2359511458483357, 0.23954091622309698, 0.24196872201156008, 0.2415791046094264, 0.23739412527303064, 0.22916103509793787, 0.2173330737783195, 0.20297834389707334, 0.18755213027284365, 0.1724690558014564, 0.15853483617570677, 0.14551651750644815, 0.13217657057097237, 0.11676630048721802, 0.0976612526320585, 0.07402756591339694, 0.04717636473774836, 0.027054044355468203, 0.03764271008160018, 0.05951732198987241, 0.07570305521281365, 0.08396738090540812, 0.08766785513086736, 0.09405519414881605, 0.10966677953492289, 0.1347534226873486, 0.16507281679501076, 0.1963515884641691, 0.22567993159724734, 0.2512718751740077, 0.2720569306677098, 0.2874062078115826, 0.2969785247314592, 0.3006473469845745, 0.29848771984508593, 0.2908177467131339, 0.27829825317041884, 0.2620960924295957, 0.2440995778288039, 0.2271019221586863, 0.2146845676134217, 0.2103454208960977, 0.21587664955222685, 0.23033136335306734, 0.25081087775110245, 0.2740990148098424, 0.29766723732943473 ], [ 0.26489662177828, 0.2575882890675491, 0.2531746853171131, 0.2506238231644894, 0.24843056434333405, 0.2449825019641432, 0.23889626493289332, 0.22927139168143354, 0.21588318603737738, 0.19933992604829823, 0.18117121760182356, 0.16369600868142817, 0.14938554630935114, 0.13960424579637776, 0.13348476620541966, 0.12821535121032157, 0.12058945292906326, 0.10847785128964443, 0.09187636050415474, 0.07433876839837664, 0.06464081362369989, 0.07048140583924621, 0.08587850662452762, 0.10105592370023521, 0.11209859390983384, 0.12018446018622184, 0.12940606476397998, 0.14380777109032863, 0.16456488212931705, 0.18984959320701508, 0.21673895042823804, 0.2426579437933027, 0.26577940093225977, 0.2849361100740735, 0.2994416826155291, 0.3089496879559978, 0.31337243275041027, 0.3128548218315884, 0.3077966919895377, 0.29891711464485804, 0.28734735602007333, 0.2747167229997791, 0.26314884827017937, 0.2550307905850143, 0.2524497093340355, 0.25645597787953545, 0.2666563262709323, 0.28149904450489815, 0.2989883378967567, 0.31730049335262545 ], [ 0.2826855071695199, 0.2732931517975643, 0.2655182429254617, 0.2587003528357723, 0.2517829931665016, 0.2435002116233908, 0.23261486206410736, 0.2181805131133349, 0.19983068810436452, 0.17811476716777305, 0.15488102488721012, 0.13356071488180932, 0.11865110012140158, 0.11311286525831553, 0.11513526774525379, 0.11934867678815302, 0.12094842104135914, 0.11772946562488934, 0.11038369941014962, 0.1025013120448567, 0.09950762238710054, 0.1046725963580079, 0.11577122284627571, 0.12810666123433403, 0.1388612895814382, 0.1482348267285586, 0.15850385009516718, 0.17218676004071348, 0.19032837083040272, 0.21206951813611902, 0.23546201524191013, 0.2584478227938658, 0.27937099047181374, 0.29708658582600295, 0.31089639327828017, 0.320452937417195, 0.32568704835565393, 0.3267729152402782, 0.3241289474526699, 0.31844513045028, 0.31071838977090094, 0.302262402111326, 0.2946400563049711, 0.28946404348317445, 0.28806093837086205, 0.29111006250227134, 0.29846023689141676, 0.3092502498159943, 0.32224773279519364, 0.3362025455648356 ], [ 0.2932653815818806, 0.2815145567404212, 0.2705334021774374, 0.2599820860443044, 0.24917170255627952, 0.2371092909431379, 0.22262833025804019, 0.20461604482602044, 0.18234396294091368, 0.15591644963984796, 0.1269188785661462, 0.09950070263311889, 0.08158892869325257, 0.08083700521775841, 0.09320812112688862, 0.10810820504499134, 0.11928566271833345, 0.12503388139875501, 0.12643392213846802, 0.1262974040657533, 0.12788516943761852, 0.13304976174486996, 0.14121707478313988, 0.15048513437217498, 0.15953184313758317, 0.1685610327756346, 0.17898599195423082, 0.1923511449710615, 0.2092738791835807, 0.22911482047895845, 0.25040458136984767, 0.27148136753177504, 0.2909165879563513, 0.30767208842377386, 0.32109840885238794, 0.33087669653423046, 0.3369597795635844, 0.3395335660738703, 0.3390014769497753, 0.33598425266710086, 0.331319303479933, 0.32603602881169313, 0.3212797605206613, 0.31816674288489577, 0.31758556724104303, 0.32000867084915113, 0.32540189567788524, 0.3332815559803664, 0.3428870113909189, 0.3533830868155478 ], [ 0.2974367065489832, 0.28293320634601316, 0.26862650641012986, 0.2545320612161098, 0.24037363698528746, 0.2254866837710976, 0.20880916944187441, 0.18903378987182673, 0.16494675808519477, 0.13590910931270037, 0.10246278652376646, 0.06752035199181516, 0.041519156203728785, 0.047507566234211006, 0.07296716013442774, 0.09744727046646776, 0.11623752727500093, 0.1291079079144454, 0.1373365435817155, 0.14284235783354302, 0.1475177540939659, 0.1525701039013762, 0.15827518214557368, 0.1644206200485283, 0.17106242921564344, 0.17893813415343074, 0.18922391682738895, 0.20284270679183236, 0.21986926856442357, 0.2394567887574961, 0.2602148267717985, 0.2806738777660519, 0.2995906483007533, 0.31606647593618653, 0.3295487568497884, 0.3397847426028153, 0.3467691915978609, 0.35070375640847656, 0.3519712826487435, 0.3511193697783762, 0.34884179510226043, 0.34594318640572813, 0.3432736842419778, 0.3416297455638628, 0.34163565789440004, 0.34364037560183297, 0.3476701729899772, 0.3534583449192772, 0.3605384565907687, 0.3683623891722502 ], [ 0.2962377109881098, 0.27848206650000634, 0.2604653792832655, 0.24263212663903017, 0.2252592628137854, 0.2082023554769174, 0.19067643812194768, 0.17126740366792753, 0.14830429472046086, 0.12048966211512704, 0.0874893496256708, 0.05023164260739854, 0.010914679385934732, 0.02719578964688607, 0.06086042424501091, 0.08880266246168589, 0.11110574896528012, 0.12839328823509377, 0.14139718072213645, 0.15085384877890998, 0.1574888791088084, 0.16200230947808145, 0.1651357281697095, 0.16786682350298784, 0.1715766010085457, 0.17791048529004191, 0.188233079424663, 0.2030049963627811, 0.22159141169408908, 0.24260520094351615, 0.2644335531022867, 0.28562475534309434, 0.30506396726519874, 0.3220036099128149, 0.33602466753316584, 0.3469775345939328, 0.35492646344453893, 0.36010640521372644, 0.3628922359810944, 0.36377518115695123, 0.363338320374536, 0.36222237304466426, 0.36107549446997134, 0.36048745584050335, 0.36091834631782505, 0.36264044106342236, 0.3657127702814962, 0.3699980865190759, 0.3752159585896197, 0.38101332208961164 ], [ 0.29102070715537237, 0.2694813824968496, 0.2471522103316412, 0.2249564289199363, 0.20391318534402256, 0.18473653500416765, 0.16727154166045977, 0.150162646771094, 0.13125848404989326, 0.10873640911747735, 0.08230734179204875, 0.05421344006017698, 0.032471249784024964, 0.03591262829216279, 0.056970034991356694, 0.08003636717342283, 0.10191834037859657, 0.12160954439548018, 0.13808572176056266, 0.1504324323805006, 0.1581853519586156, 0.16154256589636867, 0.1615237705920754, 0.16010967338634313, 0.1601599157508766, 0.16471875258868174, 0.1757097491589765, 0.19302454825226387, 0.21491567255515792, 0.23909350505007487, 0.2635182489560633, 0.286676121121432, 0.3075725673837407, 0.3256367378317554, 0.3406193973690844, 0.3525083581445732, 0.36146500326797226, 0.3677791553422651, 0.37183733629633026, 0.37409839221700675, 0.37507009938731023, 0.37528113920812134, 0.37524530270024525, 0.37541909211838953, 0.3761590492086318, 0.37768886694648995, 0.3800860499986586, 0.38329274463469726, 0.3871475851615952, 0.39142908620107614 ], [ 0.28353762825799367, 0.25783253555171187, 0.23055220351614164, 0.2030186590360882, 0.17710342258202508, 0.15484423704703523, 0.13740516405045747, 0.12380440378825307, 0.11099833298421154, 0.09603360427324198, 0.07844216341042728, 0.06103844344992997, 0.04875879606558611, 0.04551588224270641, 0.051788897926215424, 0.0663955167374648, 0.08673490394111703, 0.10874959722792472, 0.1285381937537407, 0.14329763807311974, 0.15150387542115987, 0.15291848699598484, 0.1487126306582481, 0.14176929531759147, 0.136825926674846, 0.13931707933054024, 0.15224590623621723, 0.17424695255292566, 0.20154650614107958, 0.2305740092456613, 0.2588525385727644, 0.28489107852741996, 0.3078921380176075, 0.32751578148380667, 0.34371993637187587, 0.3566563684498464, 0.36660335586141035, 0.3739220674249962, 0.379027630849233, 0.38236804933593427, 0.3844055255619977, 0.3855962496998908, 0.3863668258168256, 0.38708827416173147, 0.38805134541712083, 0.3894485939770514, 0.39136822490196044, 0.393801984070452, 0.3966654109180601, 0.3998254531595804 ], [ 0.27594554332767846, 0.24615875806711723, 0.213691507269466, 0.17994034794280878, 0.1473451503079448, 0.11953357418807026, 0.10033184370053363, 0.09034762933056262, 0.08464357076640733, 0.07726776597390539, 0.06673709205348653, 0.05613675728214412, 0.04828776318401255, 0.04160582819496285, 0.03676653128845671, 0.04451018516920398, 0.06665986107846786, 0.09307380546845831, 0.11662113151438831, 0.13337724627414702, 0.14131243695878076, 0.1398823666472645, 0.13013591549123507, 0.1154167712933227, 0.10275324509779815, 0.1024961202976037, 0.11999474619145445, 0.14997566357446168, 0.1848868633397599, 0.21995252516957262, 0.2526968081646127, 0.2819406846227856, 0.30722262406147177, 0.3284906021818609, 0.3459301356212481, 0.35986331632674795, 0.3706878320151843, 0.3788396724675622, 0.38476982897713474, 0.38892853612314293, 0.39175253074381394, 0.3936523871145832, 0.39499866296981573, 0.3961073845048571, 0.39722698196764084, 0.39852962946900394, 0.40010961512430265, 0.401989883666195, 0.404135823218267, 0.4064735809132798 ], [ 0.27060378756430287, 0.23765211586578835, 0.20087219141344004, 0.16129639927249154, 0.12099849785306392, 0.08389141578907892, 0.05726275047836567, 0.04910420250820605, 0.051773285024389784, 0.0508589671592767, 0.04343470809933312, 0.03538922649894552, 0.031504907756180776, 0.025219903337266893, 0.010344594530935407, 0.021386497232208947, 0.05276561864748488, 0.08393811840791217, 0.10983558526826655, 0.1271253474572459, 0.1337616240461543, 0.12886565429115332, 0.11281773858371556, 0.08794202591821912, 0.06171129305687616, 0.05632917524750038, 0.08508599168733734, 0.1270994418589897, 0.17048909553366698, 0.21128203594521855, 0.2479212760787501, 0.27983725356410966, 0.30697054989741845, 0.329547177485279, 0.34795075854515406, 0.36264443039774347, 0.3741226103760361, 0.3828816800575676, 0.38940246820536284, 0.3941395110690185, 0.39751353242817244, 0.3999048548478953, 0.4016466978475866, 0.4030185112665918, 0.4042404481681242, 0.40547054904966723, 0.40680601762133484, 0.4082891691240436, 0.4099175283526739, 0.41165657827538926 ], [ 0.26958264554199424, 0.23534044550787833, 0.19672842685653233, 0.15448575456997748, 0.11005657087064738, 0.06580071675398985, 0.025178015220345476, 0.007180184028141814, 0.026154383581304348, 0.02930922381962739, 0.018546603749509605, 0.00011101636721600315, 0.017215019381074656, 0.026063196119654065, 0.02969378417404112, 0.04218174560716449, 0.06631143671835789, 0.09333403943076778, 0.11648135500027681, 0.13151076884752047, 0.13582682541784039, 0.12806688677622796, 0.10791692994253131, 0.07606724032200823, 0.03427519054138624, 0.014489799632230835, 0.06618468535070594, 0.1172444236379691, 0.16528455634583164, 0.20888369848167695, 0.24734314381597292, 0.28047665632480684, 0.30843969096141877, 0.3315988486161009, 0.3504372301594032, 0.36548918406331704, 0.37729761347676766, 0.3863876185343899, 0.3932512341112883, 0.3983390976463287, 0.4020559424633399, 0.4047578392230724, 0.40675008652850464, 0.4082855231147524, 0.40956369136859627, 0.41073160757438476, 0.41188682679796723, 0.4130830807972189, 0.41433818418282137, 0.4156433721252681 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "24_0", "25_0", "26_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 6.100212491370052e-05, 0.00047020939811212847, 0.0003501823558132188, 0.00019676046997749437, 0.002430395325054846, 0.0006689045501650548, 0.0020254081562936944, 0.0009829520401915882, 0.00010825286602191708, 0.2648559071564019, 0.0004898926495721653, 4.2563145960788614e-05, 5.903365477591782e-06, 0.0018793073627313955, 0.0039273866857825225, 0.000993186610234548, 0.0035023878144250994, 0.001200477766990381, 1.8086670021052633e-05, 0.10676132791933145, 2.534097888599656e-05, 0.000904271727550129, 1.0921198421909687e-06, 3.2485355563595415e-06, 0.00011322648035810247, 0.000585676037806047, 0.0036433825378168875 ], "xaxis": "x", "y": [ 0.5495511572808027, 6.180876004977573e-17, 0.25740731707609393, 0.7808533678248192, 0.26033774921563, 1, 7.930688558357934e-17, 0.7416235158136962, 0.7188034543089827, 1.6522676054928327e-16, 0.651362225126324, 0.9838647563010454, 1, 0.5962069937162607, 0.11386060968246217, 0.36102854770721554, 0.4317591549844682, 0.6754525434808601, 0.9999999999999999, 0.7189761390909553, 0.8982515912503004, 0.10988828539848328, 0.6948589968481986, 0, 3.6509332567024845e-16, 0.4808522971804517, 2.9976165854540405e-16 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "0_0", "10_0", "11_0", "12_0", "13_0", "14_0", "15_0", "16_0", "17_0", "18_0", "19_0", "1_0", "20_0", "21_0", "22_0", "23_0", "24_0", "25_0", "26_0", "2_0", "3_0", "4_0", "5_0", "6_0", "7_0", "8_0", "9_0" ], "type": "scatter", "x": [ 6.100212491370052e-05, 0.00047020939811212847, 0.0003501823558132188, 0.00019676046997749437, 0.002430395325054846, 0.0006689045501650548, 0.0020254081562936944, 0.0009829520401915882, 0.00010825286602191708, 0.2648559071564019, 0.0004898926495721653, 4.2563145960788614e-05, 5.903365477591782e-06, 0.0018793073627313955, 0.0039273866857825225, 0.000993186610234548, 0.0035023878144250994, 0.001200477766990381, 1.8086670021052633e-05, 0.10676132791933145, 2.534097888599656e-05, 0.000904271727550129, 1.0921198421909687e-06, 3.2485355563595415e-06, 0.00011322648035810247, 0.000585676037806047, 0.0036433825378168875 ], "xaxis": "x2", "y": [ 0.5495511572808027, 6.180876004977573e-17, 0.25740731707609393, 0.7808533678248192, 0.26033774921563, 1, 7.930688558357934e-17, 0.7416235158136962, 0.7188034543089827, 1.6522676054928327e-16, 0.651362225126324, 0.9838647563010454, 1, 0.5962069937162607, 0.11386060968246217, 0.36102854770721554, 0.4317591549844682, 0.6754525434808601, 0.9999999999999999, 0.7189761390909553, 0.8982515912503004, 0.10988828539848328, 0.6948589968481986, 0, 3.6509332567024845e-16, 0.4808522971804517, 2.9976165854540405e-16 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ -6, -0.3979400086720376 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "lr" }, "type": "log" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ -6, -0.3979400086720376 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "lr" }, "type": "log" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0, 1 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "momentum" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0, 1 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " plot_contour(\n", " model=ax.generation_strategy.model,\n", " param_x=\"lr\",\n", " param_y=\"momentum\",\n", " metric_name=\"mean_accuracy\",\n", " )\n", ")" ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30 ], "y": [ 89.01666666666667, 93.51666666666667, 93.51666666666667, 93.51666666666667, 95.7, 95.7, 95.7, 95.7, 95.8, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "mean", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "mean", "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30 ], "y": [ 89.01666666666667, 93.51666666666667, 93.51666666666667, 93.51666666666667, 95.7, 95.7, 95.7, 95.7, 95.8, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30 ], "y": [ 89.01666666666667, 93.51666666666667, 93.51666666666667, 93.51666666666667, 95.7, 95.7, 95.7, 95.7, 95.8, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 96.96666666666667, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334, 97.13333333333334 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ], "sequentialminus": [ [ 0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Model performance vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Accuracy" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "# `plot_single_method` expects a 2-d array of means, because it expects to average means from multiple\n", "# optimization runs, so we wrap out best objectives array in another array.\n", "best_objectives = np.array(\n", " [[trial.objective_mean * 100 for trial in ax.experiment.trials.values()]]\n", ")\n", "best_objective_plot = optimization_trace_single_method(\n", " y=np.maximum.accumulate(best_objectives, axis=1),\n", " title=\"Model performance vs. # of iterations\",\n", " ylabel=\"Accuracy\",\n", ")\n", "render(best_objective_plot)" ] } ], "metadata": { "kernelspec": { "display_name": "python3", "language": "python", "name": "python3" } }, "nbformat": 4, "nbformat_minor": 2 }