Page MenuHomePhabricator

Problem with numpy dataset and json serialization in PyTorchExperiment class
Open, NormalPublic

Description

run() method in Experiment.py aborts because
save_config() method in ExperimentLogger.py fails for

Numpy array containing the image dataset, wrapped in pytorch TensorDataset, DataLoader

Output: TypeError: Object of type 'DataLoader' is not JSON serializable

Event Timeline

petersej added a subscriber: petersej.

Does PyTorch offer a way to serialize DataLoader objects? If so, we could extend ModuleMultiTypeEncoder/Decoder in util.util