Automatically Evolving Prompt Guidelines for Task-Specific Optimization

Jul 17, 2026

Researchers introduce AGOPS, an automatic method for generating task-specific prompt guidelines to help users write more effective queries for large language models (LLMs). AGOPS evolves these guidelines by optimizing downstream performance on reference examples, addressing the issue of prompt underspecification that can cause significant drops in LLM performance. The method demonstrates substantial recovery of lost performance across tasks such as mathematical reasoning, medical question answering, and coding.

Why it matters: This work offers a systematic solution to the widespread problem of prompt underspecification, enabling more reliable and effective use of LLMs in practical applications.

Full story at: arXiv Computation and Language ↗