Page MenuHomePhabricator

Joint running and testing of experiments
Closed, ResolvedPublic

Description

At the moment it's possible to first run ".run" on an experiment and then ".run_test", but the second will rerun setup and not load checkpoints, so the test will be run with a randomly initialized model. Fix should be a special setup method like "._setup_test" after regular setup that takes care of this, similar to what we do in resume cases.

Event Timeline

petersej created this task.
petersej created this object with edit policy "Custom Policy".

There is a setup option for .run_test, just set that to False