Research library

Evaluation Research note

Keeping a detail in context does not ensure it is used

Long review histories can hide the most important qualification.

The finding

The authors vary the position of relevant information in multi-document question answering and key-value retrieval. Performance often drops when the needed information sits in the middle of a long input, including for models built to accept long contexts. [1]

What it means for Pingpong

A sequential chain accumulates material. For Pingpong, that makes preservation of constraints and minority objections an evaluation problem, not just a context-window problem. A detail can be present in the transcript and still disappear from the final recommendation.

The limit

This study does not show that context compression is lossless or that shorter inputs always perform better. Any packing strategy needs direct tests of retained facts, sources, and unresolved objections.

Source

Lost in the Middle: How Language Models Use Long Contexts

Nelson F. Liu et al. (2023)

TACL acceptance reported in arXiv record
DOI: 10.48550/arXiv.2307.03172

Paper PDF

This is Pingpong's interpretation of external research, not a result from a Pingpong experiment or an endorsement by the authors. Editorial standard