Python PyTorch MpSerialExecutor用法及代码示例

本文简要介绍python语言中 torch_xla.distributed.xla_multiprocessing.MpSerialExecutor 的用法。

用法:

class torch_xla.distributed.xla_multiprocessing.MpSerialExecutor

在多核进程中以序列化方式运行函数的实用程序。

例子：

# At global scope.
SERIAL_EXEC = xmp.MpSerialExecutor()

def load_dataset(path):
  return maybe_download_and_load(path)

def _mp_fn(index, ...):
  # Avoid all cores downloading the same data with the serial executor.
  dataset = SERIAL_EXEC.run(lambda: load_dataset('/tmp/mnist-data'))
  ...

xmp.spawn(_mp_fn, ...)