ARENA Curriculum
in progressPython · PyTorch · Weights & Biases
- Built a ray tracerfrom scratch.
- Implemented ResNet-34 from scratch and used it as a frozen feature extractor on CIFAR-10 (trained weights copied in, only the final linear layer optimized).
- Implemented SGD, RMSProp, and Adam from scratch.
- Implemented backpropagation in NumPy.
- Implemented and trained an autoencoder, a VAE, and a GAN.
- Implemented and trained a transformer from scratch. Also implemented different sampling methods like greedy, beam, top-p, top-k and so on. Currently working on mechanistic interpretability.