decoderstack-d24 / README.md

Commit History

  1. Model card: correct the recalibration — leaderboard is best-fit only, so the like-for-like gap is +0.019; both checkpoints now measured under both packings

    Verified signature
    4f60492
  2. Model card: recalibrate val bpb under upstream packing; document the token_bytes regeneration

    Verified signature
    96ad938
  3. Model card: step 5568 is now a ready-made nanochat checkpoint (+8-rank optimizer shards)

    Verified signature
    c92b43b
  4. Flag that val bpb is not comparable across the batched/varlen pipelines

    Verified signature
    4c66da7
  5. Converter now emits nanochat optimizer shards for an SFT warm-start

    Verified signature
    412ea12
  6. Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24

    Verified signature
    162df34
  7. Add model card, meta.json, logs, tokenizer, training source, and nanochat converter

    Verified signature
    11f07f9