DDPShardedPlugin¶

class pytorch_lightning.plugins.training_type.DDPShardedPlugin(parallel_devices=None, num_nodes=None, cluster_environment=None, sync_batchnorm=None, ddp_comm_state=None, ddp_comm_hook=None, ddp_comm_wrapper=None, **kwargs)[source]¶

Bases: pytorch_lightning.plugins.training_type.ddp.DDPPlugin

Optimizer and gradient sharded training provided by FairScale.

pre_backward(closure_loss)[source]¶

Run before precision plugin executes backward

Return type: None

property lightning_module: pytorch_lightning.core.lightning.LightningModule¶

Returns the pure LightningModule without potential wrappers

Return type: LightningModule