labml.ai Annotated PyTorch Paper Implementations

This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations, and the website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better.

We are actively maintaining this repo and adding new implementations.

Modules

Transformers

Recurrent Highway Networks

LSTM

HyperNetworks - HyperLSTM

ResNet

Capsule Networks

Generative Adversarial Networks

Sketch RNN

✨ Graph Neural Networks

Counterfactual Regret Minimization (CFR)

Solving games with incomplete information such as poker with CFR.

Reinforcement Learning

Optimizers

Normalization Layers

Distillation

Adaptive Computation

Uncertainty

Installation

pip install labml-nn

Citing LabML

If you use this for academic research, please cite it using the following BibTeX entry.

@misc{labml,
 author = {Varuna Jayasiri, Nipun Wijerathne},
 title = {labml.ai Annotated Paper Implementations},
 year = {2020},
 url = {https://nn.labml.ai/},
}