Kimi K3 trails frontier US models by a wide margin on cyber exploits, and distillation may explain why
The British AI Security Institute and the U.S. Center for AI Standards and Innovation tested Moonshot AI's Kimi K3 on offensive cyber tasks, finding it scored 32% on ExploitBench compared to 76% for leading US models. Its safeguards also failed to block exploit development or simulated attacks. The gap between its strong general benchmarks and weaker cyber performance aligns with allegations that Moonshot AI distilled Anthropic's models.
Why it matters: This evaluation reveals significant cybersecurity vulnerabilities in a prominent Chinese AI model and raises concerns about the safety implications of model distillation.
Full story at: The Decoder ↗