Extending Raschka's GPT-2: an MoE trained from scratch on an RTX 3090

(gilesthomas.com)

1 points | by gpjt 7 hours ago ago