Ask the AI for its source, then verify the single most specific fact yourself, like a number, a name, a date, or a quote. That’s the whole method. Do it in under a minute, before you repeat or act on anything an AI tool told you, and you’ll catch the confident wrong answer before it becomes your mistake.
Takeaways
- Ask the AI to name its specific source before you repeat any number, name, date, or quote it gives you.
- Do not rely on asking ‘are you sure’ to catch an error, since Anthropic’s sycophancy research found AI assistants tend to agree with pushback rather than independently re-check a fact.
- Pick the single most checkable claim in an AI answer and verify it against a primary source within twenty seconds.
- Re-ask the same question in a fresh chat session, since a guessed answer tends to change on a second try while a checked fact stays the same.
- Treat legal citations and quoted financial figures as claim types that need full verification every time, with no exceptions.
| Verification time | 60 seconds, four checks |
|---|---|
| Legal AI errors | 17% to 33% of queries (Stanford RegLab, 2024) |
| AI search accuracy | Wrong or unverifiable answers over 60% of the time (CJR Tow Center, March 2025) |
| Myth | Asking ‘are you sure’ rarely fixes a wrong answer |
Why exactly 60 seconds?
Sixty seconds is enough because you are only checking the part of the answer that can hurt you, not the whole paragraph. AI models get facts wrong routinely, a pattern researchers call hallucination, and treating every specific claim as unverified until checked costs you almost nothing. The Vectara Hallucination Leaderboard has tracked this across major models for years, and the gap between the best and worst performers stays wide even as the models improve. Researchers behind the TruthfulQA benchmark found that larger models can score worse on truthfulness, because they get better at imitating a confident human answer rather than a correct one. When Columbia Journalism Review’s Tow Center tested eight AI search tools in March 2025, it found they gave an incorrect or unverifiable answer more than 60 percent of the time when asked where a quote came from. The stakes are higher now that AI agents got cheaper without getting safer, so more of your daily work runs through them without anyone checking.
What’s the one question to ask first?
Ask the AI to name its source for the specific claim you plan to use, not for the whole answer. A source can be a study, a document, a webpage, or a named person. Cambridge Dictionary named the AI sense of ‘hallucinate’ its word of the year for 2023, which tells you how often models answer this way. If the model says ‘general knowledge’ or ‘training data,’ treat that as an admission that it is guessing. I’ve written before about three lines you can add to any prompt to force better answers up front, and asking for a source belongs on that list. If the source is specific and checkable, move to the next step. If it is not, do not use the claim.
Does ‘are you sure’ work?
No, and this is the most common mistake people make. Asking a chatbot ‘are you sure’ or ‘double check that’ usually produces a more confident restatement of the same answer, not a correction. Researchers at Anthropic studied this directly and found AI assistants change their answers to match what a user seems to want to hear, a pattern they call sycophancy, across five commercial assistants they tested. OpenAI’s own research, published in a September 2025 paper, argued that current training methods reward confident guessing over admitting uncertainty, which is part of why pushback rarely produces a genuine correction. Push back on a wrong answer and the model is more likely to apologize and agree with you than to independently re-verify the fact.
Four checks, ranked by what they catch
Here are the four checks that make up the sixty seconds, ranked by what each one catches in practice:
- Ask for the source, 15 seconds. Catches outright fabrication, the single biggest category of AI error, including invented case citations and fabricated statistics.
- Verify the most specific claim outside the chat, 20 seconds. Catches wrong numbers and misattributed quotes that a plausible-sounding source can still hide.
- Re-ask in a fresh session, 15 seconds. Catches answers that were never grounded in anything, since a guess tends to change on a second try and a checked fact does not.
- Ask for the counter-case, 10 seconds. Catches overconfidence on judgment calls and opinions dressed up as facts, where there is no single number to verify.
How do you verify a claim fast?
Pick the single most specific, checkable detail in the answer: a number, a name, a date, or a quote. Paste that exact detail into a search engine or go straight to the primary source it points to, such as a government dataset or a company filing. Search engines increasingly surface fact-check labels on contested claims, a feature Google documents in its own explanation of how search works, and the standard fact-checking organizations like Poynter’s International Fact-Checking Network apply is the same one you are using here: find the detail in a second, independent place. If you cannot find it anywhere outside the AI’s own answer within twenty seconds, treat it as unverified and say so if you pass it along.
What if there’s no source?
Then do not repeat the claim as fact. This is exactly how lawyers have ended up sanctioned by federal judges for submitting briefs full of fake case citations that a chatbot invented, a pattern serious enough that a public database now tracks hundreds of these court cases. Stanford’s RegLab published research in 2024 testing this directly and found that even specialized legal AI tools built with retrieval systems still produced errors in 17 percent to 33 percent of queries. If the source check fails, the honest move is to say ‘I have not verified this’ rather than pass along a number that sounds right.
When isn’t 60 seconds enough?
Sixty seconds is not enough for anything you will put your name on: a legal filing, a medical decision, a financial commitment, or a report you are handing to a manager who is already skeptical of AI-assisted work. It covers most everyday use fine, like drafting an email or answering a quick research question. The NIST AI Risk Management Framework treats verification as a continuous process for exactly this reason, scaled to how much harm a wrong answer could cause. I’ve written separately about how to explain AI-assisted work to a boss who does not trust it, and it starts with being able to show exactly how you verified it. The stakes decide how many of the four checks you run, not whether you run any at all.
How does this look in practice?
Say an AI tool tells you a competitor raised $40 million in a Series B round last quarter. First, ask for the source; if it names a specific outlet or filing, that is a good sign. Second, search that exact number and company name; if the only place it appears is inside the AI’s answer, that is your flag to stop. Third, open a new chat and ask the same question cold; if the number changes to $25 million, the first answer was a guess dressed as a fact. Total time: under a minute, and you have avoided repeating a number in a meeting that never existed anywhere but the model’s output.
Prompts you can use
Paste these straight in. Change the parts in square brackets and nothing else.
You are a careful research assistant helping me verify claims before I use them. I am going to paste an answer that another AI gave me. For each specific, checkable claim in it (a number, a name, a date, a statistic, or a quote), do the following: (1) state whether you can identify a specific, named source for it or whether it appears to be unsourced, (2) if a source is named, tell me exactly what to search for to confirm it independently, (3) flag any claim that sounds precise but has no clear origin as 'unverified, do not repeat.' Do not try to verify the claims yourself from memory; your job is to tell me what to check and how, not to confirm them for me. If the pasted answer is too short or vague to extract specific claims from, ask me to paste more context before proceeding.
Paste the AI’s original answer directly into this prompt; it works best on answers with specific numbers, names, or dates, not general opinions.
You are acting as a skeptical reviewer, not a helpful assistant. I am going to give you a claim or answer that I am considering acting on. Your job is to argue the strongest possible case for why it could be wrong, incomplete, or outdated, even if you personally think it is correct. Give me at least two distinct reasons, each with what specific evidence would prove that reason true. Do not soften the critique to be agreeable, and do not conclude by reassuring me the original answer is probably fine, that is not your job here. If my claim is ambiguous or you need more context to critique it properly, ask me before answering. If you genuinely cannot find any weakness after trying, say so plainly and explain what you checked.
This works best on judgment calls and predictions, not on simple facts; for a factual claim, verify it externally instead of arguing about it.
I am going to ask you a factual question cold, with no prior context from another conversation. Answer only what you are confident is independently verifiable, and explicitly separate 'facts I am confident are correct' from 'estimates or things I am inferring.' If you do not have a specific, named source for a number, date, or figure, say so instead of giving your best guess as if it were confirmed. If the question itself is unclear, ask me to clarify before answering. Here is the question: [paste your question here].
Run this in a brand-new chat, not a continuation of the one that gave you the first answer, otherwise the model just repeats itself.
Questions people actually ask
How do I know if ChatGPT is lying to me?
ChatGPT predicts the most statistically likely next words rather than checking facts against a database, so a wrong answer can come out sounding just as confident as a correct one. Ask it to name a specific, checkable source for any number or claim, then verify that detail outside the chat before you repeat it.
Can I just ask the AI if it’s sure?
Not reliably. Research on sycophancy from Anthropic found AI assistants tend to shift toward agreeing with whatever the user pushes back with, rather than independently re-verifying the fact. Treat a confident restatement as no evidence at all, and check the claim against an outside source instead.
What’s the fastest way to fact-check an AI answer?
Ask the AI for its source on the single most specific claim, a number, name, date, or quote, then search that exact detail outside the chat. If you cannot confirm it within twenty seconds, treat it as unverified rather than repeating it as settled fact.
Why do AI chatbots sound so confident when they’re wrong?
Language models are trained to produce fluent, plausible-sounding text, and confident phrasing scores well during training even when the underlying fact is wrong. OpenAI’s 2025 research argued current training methods reward a guess over an honest ‘I don’t know,’ which is why hedging is rare even when it would be more accurate.
Should I trust AI-generated legal citations?
No, not without checking each one against an official case database first. Courts have sanctioned lawyers for submitting briefs with fake citations invented by chatbots, and a public database now tracks hundreds of these cases. Treat every case name and citation an AI gives you as unverified until you find it independently.
Sources
- hallucinationen.wikipedia.org
- Vectara Hallucination Leaderboardgithub.com
- TruthfulQA benchmarkarxiv.org
- Tow Center tested eight AI search tools in March 2025cjr.org
- Cambridge Dictionary named the AI sense of ‘hallucinate’ its word of the year for 2023dictionary.cambridge.org
- sycophancyarxiv.org
- a September 2025 paperopenai.com
- its own explanation of how search worksgoogle.com
- Poynter’s International Fact-Checking Networkpoynter.org
- a public database now tracks hundreds of these court casesdamiencharlotin.com
- published research in 2024reglab.stanford.edu
- NIST AI Risk Management Frameworknist.gov
What happens next
Expect AI browsers and agents to keep shipping built-in citation and source-checking features, but treat those as a starting point rather than a substitute for an independent check, since a tool grading its own homework has an obvious blind spot. Watch whether courts and regulators start requiring disclosed verification steps for AI-assisted work, the way NIST’s framework already recommends for higher-risk uses. The sixty-second habit becomes more valuable, not less, as more of what lands in your inbox was drafted by a model first.
Take this further
Act as a blunt hiring manager who has read ten thousand resumes, not a career coach. I will paste my full resume and the job description I want. Rewrite the whole resume for that role, section by section, in this order: summary, experience, skills, education. Rules: every experience line leads with impact, not duty. Use bracketed placeholders like [8 percent] for any number I did not give you, and list at the end every placeholder I need to replace with a real figure. Keep it to one page of text. Plain formatting only, no tables or columns, so screening software can parse it. After the rewrite, tell me the three weakest claims that need evidence before I send this anywhere. My resume: [paste resume]. The role: [paste job description].

