TorchElasticEnvironment¶

class pytorch_lightning.plugins.environments.TorchElasticEnvironment[source]¶

Bases: pytorch_lightning.plugins.environments.cluster_environment.ClusterEnvironment

Environment for fault-tolerant and elastic training with torchelastic

creates_children()[source]¶

Whether the environment creates the subprocesses or not.

global_rank()[source]¶

The rank (index) of the currently running process across all nodes and devices.

static is_using_torchelastic()[source]¶

Returns True if the current process was launched using the torchelastic command.

local_rank()[source]¶

The rank (index) of the currently running process inside of the current node.

master_address()[source]¶

The master address through which all processes connect and communicate.

master_port()[source]¶

An open and configured port in the master node through which all processes communicate.

node_rank()[source]¶

The rank (index) of the node on which the current process runs.

world_size()[source]¶

The number of processes across all devices and nodes.