Helpfulness Post-Training Degrades Compassion Values More Than Coding Post-Training in Llama 3.1 8B

Jul 14, 2026

A preprint study on Llama 3.1 8B finds that post-training focused on helpfulness (using SFT and GRPO) significantly degrades animal compassion values compared to coding-focused post-training, as measured by the ANIMA benchmark (SFT: 35.7% vs. 65.2%; GRPO: 18.7% vs. 32.0%). Helpfulness training also reduces general moral reasoning by 25.5 percentage points on English MORU items, but this effect does not transfer to other languages, whereas the compassion effect does. The findings suggest that coding-domain post-training may better preserve values instilled during mid-training without harming general reasoning.

Why it matters: This research highlights that standard helpfulness post-training can unintentionally erode ethical values acquired during pre-training, which has important implications for designing AI training pipelines to maintain value alignment.

Full story at: arXiv Computers and Society ↗