Python PyTorch MpSerialExecutor用法及代碼示例

本文簡要介紹python語言中 torch_xla.distributed.xla_multiprocessing.MpSerialExecutor 的用法。

用法:

class torch_xla.distributed.xla_multiprocessing.MpSerialExecutor

在多核進程中以序列化方式運行函數的實用程序。

例子：

# At global scope.
SERIAL_EXEC = xmp.MpSerialExecutor()

def load_dataset(path):
  return maybe_download_and_load(path)

def _mp_fn(index, ...):
  # Avoid all cores downloading the same data with the serial executor.
  dataset = SERIAL_EXEC.run(lambda: load_dataset('/tmp/mnist-data'))
  ...

xmp.spawn(_mp_fn, ...)