LLMs create their smallest transformer for 10-digit addition

1 comments

• $marojejian 11 hours ago

  They eventually get down to 970 params:

  https://x.com/DimitrisPapail/status/2024596491474554902?s=20