Are LLM-Generated GPU Kernels Production-Ready? A Trace-Driven Benchmark and Optimization Agent

Jul 17, 2026

Researchers introduce Atrex-Bench, a benchmark that samples 30 operators and 440 shapes from real production inference traces to evaluate the performance of LLM-generated GPU kernels. Results show that current models achieve only about 10% of the hardware roofline, with correctness metrics often inflated by PyTorch fallbacks rather than genuine kernel generation. The authors also present Atrex-Kernel-Agent (AKA), an optimization agent that iteratively improves kernel code, successfully converting fallbacks into kernels that match or surpass hand-tuned production baselines in a controlled case study.

Why it matters: This work provides a realistic benchmark and demonstrates an agent that can bridge the performance gap for LLM-generated GPU kernels, advancing the practical deployment of AI-generated code in production environments.

Full story at: arXiv AI/ML ↗