ShardedNativeMixedPrecisionPlugin¶

class pytorch_lightning.plugins.precision.ShardedNativeMixedPrecisionPlugin[source]¶

Bases: pytorch_lightning.plugins.precision.native_amp.NativeMixedPrecisionPlugin

Mixed Precision for Sharded Training

clip_grad_by_norm(optimizer, clip_val, norm_type=2.0, eps=1e-06)[source]¶

Clip gradients by norm