Page MenuHomePhabricator | MITK

Joint running and testing of experiments
Closed, ResolvedPublic

Description

At the moment it's possible to first run ".run" on an experiment and then ".run_test", but the second will rerun setup and not load checkpoints, so the test will be run with a randomly initialized model. Fix should be a special setup method like "._setup_test" after regular setup that takes care of this, similar to what we do in resume cases.

Event Timeline

petersej created this task.Mar 26 2019, 1:42 PM
petersej triaged this task as High priority.
petersej created this object with edit policy "Custom Policy".
petersej closed this task as Resolved.Apr 26 2019, 11:37 AM

There is a setup option for .run_test, just set that to False