cgarciams/gsp2_355m_sft
Text Generation • Updated • 1
🤝 Open to Collab
Carlos García
cgarciams
·
AI & ML interests
Building a GPT-2 medium size (approx. 400 M parameters) model from scratch, using PyTorch, the OpenWebText dataset, Tiktoken, AdamW optimizer and FlashAttention. Just for fun.
Recent Activity
upvoted an article about 2 months ago
Adding MCP Tools to Reachy Mini liked a dataset about 2 months ago
Skylion007/openwebtext liked a dataset about 2 months ago
tatsu-lab/alpacaOrganizations
