Research library

Sycophancy Research note

A good critic can change its mind

Resisting pressure and accepting evidence are different behaviors.

The finding

Ma and colleagues separate answer changes caused by unsupported pressure from changes justified by evidence. In their experiments, several training and inference-time interventions reduce the first behavior at the expense of the second. Less agreement is not automatically better reasoning. [1]

What it means for Pingpong

This is the distinction Pingpong is built around: a reviewer can agree, correct a mistake, or reject the direction of an answer. Compulsory disagreement would be another bias. A useful review must remain open to evidence, including evidence that the previous model was right.

The limit

The paper tests specific open-weight models and interventions, not Pingpong's framework. Its relevance is the evaluation criterion: measure resistance to baseless pressure and responsiveness to valid corrections separately.

Source

Sycophancy Suppression Can Impair Rational Updating: Anti-Sycophancy Should Preserve the Ability to Update

Huanhuan Ma et al. (2026)

Preprint; EMNLP 2026 Findings acceptance reported by authors
DOI: 10.48550/arXiv.2608.26511

Paper PDF

This is Pingpong's interpretation of external research, not a result from a Pingpong experiment or an endorsement by the authors. Editorial standard