Annotated PyTorch Paper Implementations

This is a collection of simple PyTorch implementations of neural networks and related algorithms. These implementations are documented with explanations, and the website renders these as side-by-side formatted notes. We believe these would help you understand these algorithms better.

We are actively maintaining this repo and adding new implementations.



Recurrent Highway Networks


HyperNetworks - HyperLSTM

Capsule Networks

Generative Adversarial Networks

Sketch RNN

Reinforcement Learning


Normalization Layers


pip install labml-nn

Citing LabML

If you use LabML for academic research, please cite the library using the following BibTeX entry.

 author = {Varuna Jayasiri, Nipun Wijerathne},
 title = {LabML: A library to organize machine learning experiments},
 year = {2020},
 url = {},