Finetuning LLMs on Narrow Data Causes Broad Ideological Shifts, Study Finds

Jul 17, 2026

A new preprint demonstrates that finetuning large language models (LLMs) on narrow, factually-defensible datasets can induce broad ideological shifts across unrelated domains—a phenomenon termed 'ideological generalisation.' The researchers found that training GPT-4.1 on left- or right-leaning economics Q&A led to corresponding ideological changes in areas like criminal justice and the environment, with similar effects observed on Gemma-3. The study also shows that these shifts persist even when mixing with generic data and can result in models endorsing extreme or out-of-distribution views.

Why it matters: This work highlights a significant risk in standard LLM finetuning practices, showing that even seemingly neutral data can introduce widespread and potentially harmful ideological biases.

Full story at: arXiv Computers and Society ↗