tilelang

TileLang is a Python language for writing high-performance GPU kernels, the low-level code that makes attention and matrix math fast. You describe the computation in tiles and the compiler handles the thread-level details, which means far less code than writing raw CUDA. DeepSeek points readers to TileLang kernels for its V3.2-Exp model.

Install it from pip. NVIDIA CUDA is the primary target, with AMD ROCm, Huawei Ascend and Apple Metal supported, and CPU, CuTe DSL and WebGPU backends experimental. It's still pre-1.0 with roughly monthly releases, and v0.1.13 removed legacy APIs, so expect to update your code between versions.

Free under MIT. This is for ML engineers writing custom kernels: if you're not already reading attention kernel code, you don't need it. The direct comparison is OpenAI's Triton, which also supports NVIDIA and AMD and has the bigger ecosystem. TileLang is worth a look when Triton's abstractions get in your way.

The catch: the license file carries an unusual header saying the project was subject to additional, unpublished collaboration terms with Microsoft from December 2024 to March 2025, which is why GitHub can't classify it. The license today is MIT, but your legal team may ask about that window.