Sublime

I spent the past few months building JAXformer: One of the first open source guides on how to scale modern transformers in JAX. Trained entirely on TPUs, it supports distributed ML, Ray tokenization, MoE, n-D parallelism and end-to-end inference. Here’s how to do it: https://t.co/0suvNXm7HF