-
Training Transformers: A Review
It has been a while since I’ve trained models from scratch, but now that I am revisiting AI I wanted to work on a nice little exercise to recalibrate my intuition on training neural networks. And since transformers seems to be used everywhere these days, I figured I’d try to...