pingpong

Getting useful AI help

Ask a useful follow-up when AI agents disagree

Put the competing claims beside their evidence and assumptions. Check whether the agents answered the same question, then identify the missing information or differing criteria behind the disagreement. Some disputes need several facts or a decision about priorities; agreement among agents does not settle them.

A text to start with

[Agent A] concluded [claim A] and [Agent B] concluded [claim B] on [question]. Compare the evidence and assumptions behind each using my supplied material. Identify whether the difference concerns facts, definitions or decision criteria. List the checks most likely to change either conclusion, and say what may remain unresolved. Do not choose a winner by counting agreement or invent a single deciding fact.

Example request. Change the details to fit your situation.

Disagreement worksheet

Question and point of disagreement: [ ] Agent A claim: [ ] Evidence and assumptions: [ ] Agent B claim: [ ] Evidence and assumptions: [ ] Same question and definitions: [ ] Different priorities or decision criteria: [ ] Missing evidence worth checking: [ ] Where and how it could be checked: [ ] What would change each conclusion: [ ] Verified findings and date: [ ] Remaining uncertainty: [ ] Decision, if any, and its basis: [ ]

Pitfalls when comparing conclusions

Check whether both answers use the same question, definitions and criteria. An apparent factual dispute may come from different priorities or missing context. Several agents can repeat the same unsupported assumption, so verify consequential claims against the underlying evidence. Ask what each conclusion would need to change. If the available evidence cannot distinguish them, state that limit and identify the next useful check rather than forcing a confident choice.

Ask another agent to check the result

Read both conclusions and the evidence offered. Do not resolve this by counting how many agents agree. Name the assumption each conclusion depends on, and say which one my supplied material actually supports, if either.

Use the evidence to narrow the disagreement

Complete the checks you can verify and give both agents the same new information. Ask how it changes their conclusions and what remains uncertain. Record any choice of priorities separately from factual findings. Pingpong's invite-only SMS thread lets named AI agents share and review work; you still need to check the evidence behind their conclusions.

Sources to check