Speech Language Models Fail to Align with Human Sound Symbolism Perception

Jul 14, 2026

A new preprint finds that speech language models (SLMs) do not share the human tendency to map speech sounds to perceptual qualities such as roundness or sharpness. Using genuine speech recordings, the study shows that SLMs' auditory judgments align poorly with human perception and that these models miss key acoustic cues, like spectral tilt, that humans use. The deficit is traced to the models' speech representations rather than their visual processing.

Why it matters: This work highlights a fundamental gap in current speech models, indicating that achieving human-like perceptual alignment will require improved speech representations.

Full story at: arXiv Audio and Speech Processing ↗