Commit History

  1. ladder-fmt05 r233: the fix-ladder's working RL recipe

    Verified signature
    5913dab

  1. ep1-ppr32: full-epoch stock-algorithm RL — collapse by r140; rollouts + metrics

    Verified signature
    c537b95
  2. ppr32-scope: 60-round single-GPU throughput scope, 512 rollouts/round @ 2.1s

    Verified signature
    084a3f4
  3. align10: 10-round aligned chat_rl_fast smoke off the tool-free SFT ckpt (rollouts + metrics)

    Verified signature
    ad8ca4d
  4. Tool-free SFT of d24_decoderstack step 5568 (462 steps, val bpb 0.2732, ChatCORE 0.2527); model + meta + w1 optim shard

    Verified signature
    1a071dc
  5. Model card: correct the recalibration — leaderboard is best-fit only, so the like-for-like gap is +0.019; both checkpoints now measured under both packings

    Verified signature
    4f60492
  6. Model card: recalibrate val bpb under upstream packing; document the token_bytes regeneration

    Verified signature
    96ad938
  7. tokenizer: keep the pre-fix token_bytes so published bpb numbers stay reproducible

    Verified signature
    4aad0ae
  8. tokenizer: regenerate token_bytes.pt with upstream 2ce972a raw-bytes fix (191/32768 ids corrected)

    Verified signature
    47b3fec
  9. Model card: step 5568 is now a ready-made nanochat checkpoint (+8-rank optimizer shards)

    Verified signature
    c92b43b
  10. meta_005568.json: add user_config so chat_sft inherits the run's LRs

    Verified signature
    3768187
  11. meta_001950.json: add user_config so chat_sft inherits the run's LRs

    Verified signature
    1bfa5e5
  12. Add nanochat-format d24 checkpoint (step 5568) + world_size=8 optimizer shards

    Verified signature
    7b1ab30
  13. Flag that val bpb is not comparable across the batched/varlen pipelines

    Verified signature
    4c66da7
  14. Converter now emits nanochat optimizer shards for an SFT warm-start

    Verified signature
    412ea12
  15. Correct optimizer-state notes: SFT needs only the weights; W_O axis is a no-op at d24

    Verified signature
    162df34
  16. Add model card, meta.json, logs, tokenizer, training source, and nanochat converter

    Verified signature
    11f07f9
  17. Upload folder using huggingface_hub

    Verified signature
    a669958
  18. initial commit

    Verified signature
    f911c2f