Ishaan Watts

WattsIshaan's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

updated a collection about 1 month ago

OLMo-2-1B Midtrained

Collection

OLMo2-1B Midtrained checkpoints used for the experiments in our paper "Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting" • 5 items • Updated Sep 12

updated a model about 1 month ago

WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW-20percent

Updated Sep 12 • 13

updated a collection about 1 month ago

OLMo-2-1B Midtrained

Collection

OLMo2-1B Midtrained checkpoints used for the experiments in our paper "Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting" • 5 items • Updated Sep 12

updated a model about 1 month ago

WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW-10percent

Updated Sep 12 • 5

published 2 models about 1 month ago

WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW-20percent

Updated Sep 12 • 13

WattsIshaan/OLMo-2-1B-Midtrain-50B-AdamW-10percent

Updated Sep 12 • 5

updated a collection about 1 month ago

OLMo Pretrained 20M-150M

Collection

Pretrained checkpoints for OLMo 20M-150M models used in experiments for our paper "Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting" • 10 items • Updated Sep 12

updated 3 models about 1 month ago

WattsIshaan/OLMo-60m-192B-adamw-cosine-10percent

Updated Sep 12 • 7

WattsIshaan/OLMo-150m-120B-adamw-cosine-10percent

Updated Sep 12 • 4

WattsIshaan/OLMo-20m-64B-adamw-cosine-10percent

Updated Sep 12 • 4

published 3 models about 1 month ago

WattsIshaan/OLMo-150m-120B-adamw-cosine-10percent

Updated Sep 12 • 4

WattsIshaan/OLMo-60m-192B-adamw-cosine-10percent

Updated Sep 12 • 7

WattsIshaan/OLMo-20m-64B-adamw-cosine-10percent

Updated Sep 12 • 4

updated a collection about 2 months ago

OLMo Pretrained 20M-150M

Collection

Pretrained checkpoints for OLMo 20M-150M models used in experiments for our paper "Sharpness-Aware Pretraining Mitigates Catastrophic Forgetting" • 10 items • Updated Sep 12