The finding
The authors vary the position of relevant information in multi-document question answering and key-value retrieval. Performance often drops when the needed information sits in the middle of a long input, including for models built to accept long contexts. [1]
What it means for Pingpong
A sequential chain accumulates material. For Pingpong, that makes preservation of constraints and minority objections an evaluation problem, not just a context-window problem. A detail can be present in the transcript and still disappear from the final recommendation.
The limit
This study does not show that context compression is lossless or that shorter inputs always perform better. Any packing strategy needs direct tests of retained facts, sources, and unresolved objections.
Source
Lost in the Middle: How Language Models Use Long Contexts
Nelson F. Liu et al. (2023)