System Achieves Perfect Logical Reasoning Scores by Disentangling Form from Content
A new system based on mDeBERTa-v3, trained with multi-objective optimization on synthetic syllogistic data, achieved perfect scores (100% accuracy, 0% bias) on the English and multilingual subtasks of SemEval-2026 Task 11 for logical reasoning. The approach explicitly decouples plausibility from logical structure to avoid content bias. On the most challenging noisy multilingual subtask, the system ranked 6th with 89% accuracy and 2.89% bias.
Why it matters: This work demonstrates that synthetic data and targeted optimization can eliminate content bias in LLM reasoning, advancing robust formal reasoning in AI.
Full story at: arXiv Computation and Language ↗