pretraining with DiLoCo and JAX.
[PACKAGE IN DEVELOPMENT]
You like unsloth, but there is no pretraining?
You don't like paying for compute?
Pytorch adds overhead, but JAX is difficult?
You came to the right place.
https://github.com/view321/adjaxt
https://pypi.org/project/adjaxt/