home
transformers
glu_variants
View code on Github
#
Gated Linear Units and Variants
Experiment that uses
labml
.
configs
Simpler version from scratch