Citation checking for AI-assisted submissions: a routine
By the ChamberOne team 5 minute read
Nobody sets out to put a fake authority before a court. It happens when a draft produced with an AI tool contains a reference that looks right, a reviewer assumes someone else has checked it and the document is filed under a lawyer's name. The cure is dull and effective: a routine that makes verification a named step, done by named people, with a record. This article sets one out. Adapt it to your practice and to the rules of your court.
Key points
- Check every authority on four questions: it exists, it says what is claimed, it is current and it is quoted accurately.
- Use two people. The drafter should not be the only checker.
- Treat AI-supplied references as unverified until someone has opened the source.
- Record who checked what and when, and keep the table with the file.
Why a routine and not just care
Good lawyers are already careful. The trouble is that care is a mood, and moods fail at six in the evening before a filing deadline. A routine does not depend on mood. It tells everyone what to do, in what order, and it makes it obvious when a step has been skipped.
AI makes the routine more necessary for a specific reason. Language models can produce references that follow the form of real citations, with plausible names, years and reporters, but which do not correspond to any real decision. They can also describe a real case inaccurately. Both errors look exactly like correct work.
The four questions for every authority
For each case, statute, rule or secondary source in the document, the checker answers four questions. All four, every time.
- 1
Does it exist? Find it in an authoritative source, such as the official reports or a trusted database, using the citation as given.
- 2
Does it say what we claim? Read the relevant passage, not the headnote or a summary, and compare it with how the document uses it.
- 3
Is it current? Check whether it has been overturned, distinguished in a way that matters, amended or repealed.
- 4
Is it quoted accurately? Compare each quotation word for word with the source, including punctuation and the paragraph reference.
- 1Does it exist?
- 2Does it say what we claim?
- 3Is it current?
- 4Is it quoted accurately?
- 5Move to the next authority
- Then back to step 1.
Why two people
The author of a submission is the worst person to check it. They know what it is meant to say, and their eyes fill in the gaps. A second person, ideally one who did not draft the document, comes to each authority with no expectation.
In a small team, the roles can be simple. The drafter prepares a table of authorities with the proposition each one supports. The checker works through the table, ticking the four questions against the source. The responsible advocate or partner reviews the table and signs. If the document is the work of one person, ask a colleague, a trainee or another sole practitioner to be the second pair of eyes.
A table that does the work
Use a simple table with these columns. Keep it with the file.
- Authority as cited, and where it appears in the document.
- The proposition for which it is cited.
- Source consulted, and the date.
- Exists, says what is claimed, is current, quotation accurate: yes or no for each.
- Notes and corrections made.
- Checked by, and the date.
A table like this is also an answer if the court or the other side ever asks how the submission was prepared.
Special care with AI-generated material
If AI helped with the drafting, mark that in the table, and raise the level of suspicion. Treat each reference the tool produced as unverified until a person has opened the source. Do not accept a reference because it has a plausible look, because the tool gave a summary or because a second tool confirmed it. Tools can confirm each other's errors.
Check also for the quieter failure: a real case, correctly cited, that does not support the proposition. These are harder to spot, because the citation checks out on the first question. Only reading the passage will catch them.
- Mark in the table where AI helped
- Treat each reference as unverified until a person has opened the source
- Read the passage to catch a real case that does not support the point
- Accept a reference because it looks plausible
- Accept it because the tool gave a summary
- Accept it because a second tool confirmed it
Quotations and pinpoints
Quotations deserve their own pass. Paste the quoted text into a search of the source, or place the two side by side. Watch for dropped words, changed tenses and quotations that have been silently combined from two paragraphs. Pinpoint references, such as paragraph or page numbers, should be checked too, since a judge looking for your point should find it where you say it is.
When the check finds a problem
Suppose the checker cannot find a case. The first step is not to assume the case is real but obscure. Ask the drafter where it came from. If it came from an AI tool and no other source can be found, remove it and the proposition that relies on it, unless another authority supports the point. Note what happened on the file. If the submission has already been filed, follow your court's rules and your professional duties on correcting the record, and take advice quickly. Candour about a mistake is nearly always better received than discovery.
Making it habit
- Put the verification table in your standard filing checklist.
- Give juniors the checking role early. It teaches them how authorities are used.
- Set aside time in the timetable for it, because rushed checks are the ones that fail.
- Review the routine after any near miss, and update it.
- Keep a record of sign-off on the file: who, what and when.
A short example
Suppose a three-person litigation team is preparing written submissions for an appeal. The junior drafts them with the help of an approved tool and builds the table as she goes, adding a line for every authority. The senior associate, who has not seen the draft, takes the table on a Thursday afternoon and opens each source. He finds that one reference cannot be traced and that another is real but concerns a different point. Both are fixed before the partner reads the final text on Friday. The whole exercise took two hours and nobody had to be accused of anything.
What a routine cannot do
A checking routine cannot make a weak argument strong, and it will not catch a point you have not thought of. It also depends on the checker being honest and attentive. The sign-off is a statement that someone has done the work. Take it seriously, and make sure everyone understands that signing without checking is worse than leaving the line blank.
This article is general information about the law, legal practice and technology, current when it was published. It is not legal advice. Laws and guidance change: check the sources linked above and take advice on your own circumstances from a lawyer qualified where you are.
Read next
How to check AI legal research before you rely on it
A routine for tracing every AI-suggested authority to its source, confirming it is still good law and testing the proposition it is cited for.
5 minute readGeneral chatbots versus legal research tools: what differs and why it matters
How general chatbots and legal research tools differ on sourcing, links, jurisdiction coverage and currency, and when a general model will do.
5 minute readRetrieval-augmented generation explained for lawyers
A plain explanation of how AI answers from a document set, why it reduces but does not remove fabricated content, and what to ask vendors.
5 minute read