Tools/openxla/xla

xla

A machine learning compiler for GPUs, CPUs, and ML accelerators

4.5k+9/wkemergingC++Apache License 2.0trending

The Lens

By Erik Loyd, SaaS CEO and former COO/CFO of an AWS Premier Partner.

Updated May 2026

XLA is the machine learning compiler that takes models from JAX, PyTorch, or TensorFlow and optimizes them for GPUs, CPUs, TPUs, and other accelerators. If you use any of those frameworks you're already running XLA, you just don't see it. The OpenXLA repo is where the compiler itself lives, and it's open source under Apache 2.0.

Self-hosting in the normal sense doesn't apply. XLA is infrastructure that ML frameworks call into. End developers interact with it through `jax.jit`, `torch.compile` (with the OpenXLA backend), or TensorFlow's XLA flags. Building from source is a serious commitment that involves Bazel, platform-specific dependencies, and several days of patience. Most teams should consume the pre-built versions their framework ships.

Use this directly if you're doing ML infrastructure work: writing a new framework, adding hardware support, or debugging compilation issues. Solo developers and small teams: you don't interact with XLA directly, you benefit from it. Large teams doing custom silicon or model serving optimization: this is the layer you're working in.

The catch: governance still effectively sits with Google despite the OpenXLA branding. The Code of Conduct points back to TensorFlow governance, and Google contributes the majority of the changes. Apache 2.0 protects against the worst outcomes, but "open governance" reads aspirationally here.

Free vs Self-Hosted vs Paid

fully free

Free: Apache 2.0 source. Used at no cost in every major ML framework.

Self-hosted: XLA runs wherever your ML workload runs. The compilation overhead is real but amortized over training and inference runs. No separate service to deploy.

Paid: None for XLA itself. Google sells TPUs and Vertex AI on the cloud side, but those are products that use XLA, not XLA itself.

Free Apache 2.0 ML compiler. You're already using it through your framework.

Self-hosting ops:significant

Get tools like this every Wednesday

One featured tool, three on the radar. No fluff.

Score
80/100 · A
Adoption17/30
Maintenance25/25
Community13/20
License15/15
Analysis10/10

A low score is not a verdict on quality. Young and niche tools start low by design. How we calculate scores

Trust Signals

Community discussions enabledOrganization account (9 public repos)Notable author: 1,373 followersAuthor also built: openxla/tokamax (214 stars)

License: Apache License 2.0

Use freely. Patent grant included.

Commercial use: ✓ Yes

About

Owner
OpenXLA (Organization)
Stars
4,457
Forks
888

Also by OpenXLA

Explore Further

More tools in the directory