Models I've created as "extra credit" after finishing Sebastian Raschka's book
"[Build a Large Language Model (from Scratch)"
🔄 In a Training Loop
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a model about 5 hours ago
gpjt/1xrtx3090-moe-1 published a model about 5 hours ago
gpjt/1xrtx3090-moe-1 updated a model about 7 hours ago
gpjt/jax-with-mha-bias-larger-chinchilla-2Organizations
None yet
models 38
gpjt/1xrtx3090-moe-1
Text Generation • 0.5B • Updated
gpjt/jax-with-mha-bias-larger-chinchilla-1
Text Generation • 0.3B • Updated
gpjt/jax-with-mha-bias-larger-chinchilla-2
Text Generation • 0.2B • Updated
gpjt/jax-with-mha-bias-no-dropout-2-epoch
Text Generation • 0.2B • Updated
gpjt/jax-with-mha-bias-no-dropout-extended
Text Generation • 0.2B • Updated
gpjt/jax-no-mha-bias-no-dropout
Text Generation • 0.2B • Updated
gpjt/jax-with-mha-bias-no-dropout
Text Generation • 0.2B • Updated
gpjt/jax-no-mha-bias-with-dropout
Text Generation • 0.2B • Updated
gpjt/1xrtx3090-stacked-interventions
Text Generation • 0.2B • Updated • 10
gpjt/1xrtx3090-baseline
Text Generation • 0.2B • Updated • 7