You acted on an AI answer that was never actually in the document. One wrong clause from a policy, contract, or report can cost you a decision, a client, or your job, and most people never check.
| Citation accuracy gain | Anthropic’s Citations feature increased recall accuracy by up to 15% over custom implementations in internal evaluations |
|---|---|
| Claude PDF limits | 500MB per file, up to 20 files per chat, maximum 1,000 pages |
| Fabricated legal citations | Over 1,000 US court filings have been found containing AI invented citations, a number still growing each year |
| Best detection model | In one benchmark, GPT 5 in an agentic setup caught fabricated legal citations with 84.4% recall |
1. Upload the whole document, not a snippet
Give the AI the full PDF, not a pasted paragraph or two. Policies and contracts hide important lines far from where you’d guess, and the AI needs the whole thing to find them. Use any chat tool that takes file uploads, like ChatGPT, Claude, or Gemini.
2. Add one line to your question
After you ask your real question, add this: ‘Quote the exact sentence and page or section number before you answer.’ For example: ‘Does this policy cover dental treatment for dependents? Quote the exact sentence and page number first.’ This forces the AI to show its source instead of just stating a conclusion.
3. Open the page and check the quote
Go to the page or section the AI named and read it yourself. Confirm the words it quoted actually appear there, word for word, not paraphrased. This step takes under a minute and is the whole point of the exercise.
4. Treat an answer with no real quote as a guess
If the AI can’t point to an exact sentence, or the quote doesn’t match the real text, don’t act on the answer. Ask it to search again, or go find the clause yourself. An answer without a source is a guess wearing a suit.
5. Save the instruction so you reuse it
Keep the line ‘quote the exact sentence and page number before you answer’ saved in your notes app. Paste it onto any question about any long document from now on, insurance policy, loan agreement, HR handbook, tender document, research report.
A worked example
Someone needs to know fast whether their 40 page insurance policy covers dental treatment for their dependents.
Before
Does this policy cover dental treatment for my dependents?
AI answer: No, dental treatment is not covered under this policy.
After
Does this policy cover dental treatment for my dependents? Quote the exact sentence and page number before you answer.
AI answer: Section 4.2, Page 7: “Dental treatment is excluded from coverage except when required due to accidental injury to natural teeth.” So the real answer is: not covered normally, but covered if it’s from an accidental injury.
Three ways to bend it
Procurement and tenders
Before signing off on a vendor contract, ask AI to quote the exact penalty or termination clause with its section number, then check that section yourself before you approve anything.
HR policy questions
When checking leave, notice period, or bonus eligibility in a company handbook, ask for the exact sentence and page, so you’re not relying on a confident sounding summary that got the condition wrong.
Research and reports
When quoting a stat or finding from a long report in your own work, ask AI to quote the original sentence it pulled the number from, so you’re not repeating a figure that got rounded or misread along the way.
When it goes wrong
The AI gives a quote but it’s paraphrased, not word for word
Tell it directly: ‘copy the sentence exactly as written, do not paraphrase.’ If it still can’t produce an exact match, that’s your sign to go find the clause yourself instead of trusting the summary.
The document is huge and the AI seems to be skimming instead of reading all of it
Ask it to confirm how many pages or sections it actually processed. If it clearly missed parts, split the document into smaller chunks and feed them in separately.
When not to use this
If the document is two or three pages, just read it yourself, the quote-check step adds effort for no real gain. And if you’re comparing two versions of a document to spot what changed between them, that’s a different job entirely, this technique is for trusting one answer from one document, not tracking edits across drafts.
What you can now do
You can get a trustworthy answer from a long document in two minutes, and know exactly where to look if you ever doubt it.
Part of Making Life Easier With AI, a weekly walk-through of one small thing AI can take off your plate.
Take this further
Act as a blunt hiring manager who has read ten thousand resumes, not a career coach. I will paste my full resume and the job description I want. Rewrite the whole resume for that role, section by section, in this order: summary, experience, skills, education. Rules: every experience line leads with impact, not duty. Use bracketed placeholders like [8 percent] for any number I did not give you, and list at the end every placeholder I need to replace with a real figure. Keep it to one page of text. Plain formatting only, no tables or columns, so screening software can parse it. After the rewrite, tell me the three weakest claims that need evidence before I send this anywhere. My resume: [paste resume]. The role: [paste job description].
Takeaways
- Add the line ‘quote the exact sentence and page or section number before you answer’ to your next question about any policy, contract, or report.
- Open the exact page or section the AI names and confirm the quoted words appear there word for word before you act on the answer.
- Save the quote check prompt in your notes app now so it is ready to paste into the next long document question you ask.
- If the AI cannot produce a matching quote, stop and search the document yourself instead of trusting the summary.
- For a document near a platform’s page or size limit, split it into smaller chunks and feed them in separately so the AI does not skim parts of it.
Questions people actually ask
how do i stop ai from making up answers from a pdf i uploaded
Add one line after your question: ask it to quote the exact sentence and page or section number before answering. This forces the model to point to real text instead of summarizing from memory. Then open that page yourself and confirm the words match exactly. If it cannot produce a matching quote, treat the answer as unverified and check the document yourself.
does chatgpt actually read every page of a long pdf or does it skim
Long documents can get skimmed rather than fully processed, especially near a tool’s size or page limits. Ask the AI how many pages or sections it actually processed; if the number looks low or parts seem missed, split the file into smaller chunks and feed each one in separately so nothing gets skipped.
what exact words do i add to a prompt to make ai show its source
After your real question, add: quote the exact sentence and page or section number before you answer. For a document that resists exact quoting, add a second line telling it to copy the sentence exactly as written and not paraphrase. Save both lines in your notes app so you can paste them into any document question.
how do i check if an ai quote from a contract or policy is real
Open the page or section the AI named and read the surrounding text yourself. Confirm the quoted words appear there verbatim, not paraphrased or summarized. This check takes under a minute. If the wording does not match or no exact quote is given, do not act on the answer, ask the AI to search again or find the clause yourself.
can i use this quote and check method to compare two versions of a contract
No, this technique is built for trusting one answer from one document, not for tracking changes between drafts. Comparing two versions of a contract or policy is a different task that needs a dedicated comparison approach. For a short document of two or three pages, skip this method entirely and just read it yourself since the extra verification step adds little value.
Sources
- Introducing Citations on the Anthropic APIAnthropic (Claude)
- Upload files to ClaudeAnthropic (Claude Support)
- Who Checks the Citations? Benchmarking Legal Hallucination DetectionarXiv
What happens next
Anthropic has already built a citations feature directly into its API that grounds answers in source documents automatically, so expect chat tools to eventually offer this quote and verify step by default rather than requiring a manual prompt. Legal researchers are building benchmarks to catch fabricated citations, and courts have already flagged over a thousand filings containing invented case references, a sign that scrutiny of unverified AI output is increasing. Watch whether mainstream consumer tools add similar built in source checking for everyday documents like insurance policies and HR handbooks.
