PyTorch Lightning Documentation

Getting started

• Lightning in 2 steps
• How to organize PyTorch into Lightning

Advanced use

• Step-by-step walk-through
• Fast Performance

Lightning API

• LightningModule
  • Minimal Example
  • LightningModule for research
  • LightningModule for production
  • Training loop
  • Validation loop
  • Test loop
  • Live demo
  • LightningModule API
  • Hooks
• Trainer
  • Basic use
  • Trainer in Python scripts
  • Testing
  • Deployment / prediction
  • Reproducibility
  • Trainer flags
  • Trainer class API

Optional extensions

• Callback
  • Examples
  • Built-in Callbacks
  • Persisting State
  • Best Practices
• LightningDataModule
  • Why do I need a DataModule?
  • What is a DataModule
  • LightningDataModule API
  • Using a DataModule
  • Datamodules without Lightning
• Logging
  • Logging from a LightningModule
  • Make a custom logger
  • Control logging frequency
  • Progress Bar
  • Configure console logging
  • Logging hyperparameters
  • Snapshot code
  • Supported Loggers
• Metrics
  • Implementing a Metric
  • Classification Metrics
  • Regression Metrics
• Functional Metrics
  • Classification
  • Regression
  • NLP

Bolts

• Bolts

Examples

• Community Examples
• Autoencoder
• BYOL
• DQN
• GAN
• GPT-2
• Image-GPT
• SimCLR
• VAE

Tutorials

• PyTorch Lightning 101 class
• From PyTorch to PyTorch Lightning
• Video on how to refactor PyTorch into PyTorch Lightning

Recommended Lightning Project Layout

• Lightning project seed

Common Use Cases

• 16-bit training
• Computing cluster (SLURM)
• Child Modules
• Debugging
• Loggers
• Early stopping
• Fast Training
• Model Hooks
• Hyperparameters
• Learning Rate Finder
• Multi-GPU training
• Multiple Datasets
• Saving and loading weights
• Optimization
• Performance and Bottleneck Profiler
• Single GPU Training
• Sequential Data
• Training Tricks
• Transfer Learning
• TPU support
• Test set
• Inference in Production

Partner Domain Frameworks

• ASR & TTS

Community

• Contributor Covenant Code of Conduct
• Contributing
• How to become a core contributor
• PyTorch Lightning Governance | Persons of interest
• Changelog

Indices and tables

• Index

• Module Index

• Search Page