Sep 23 26 days ago

1. 03:57

   Add zero-shot benchmark results (ARC, HellaSwag, SciQ, PIQA) and full-split val ppl (#1)⁠

   Compactbot
   0f4e319
2. 02:32

   BPE-8k tokenizer (HF tokenizers format)

   Compactbot
   Verified signature

   6d8613e
3. 02:32

   weights: 24.59M params, 75 tensors, float32

   Compactbot
   Verified signature

   d02797d
4. 02:32

   TinyStories-24m: 24.59M BPE GPT trained from scratch on TinyStories (val ppl 8.76, coherent)

   Compactbot
   Verified signature

   c6c9cdf
5. 02:28

   initial commit

   Compactbot
   Verified signature

   cbe0202