ChamberOne

Statute currency and amendments: why AI research can quote repealed law

By the ChamberOne team 5 minute read

A language model does not look up a statute. It produces text that resembles what it has seen about that statute, and what it saw was written at many different times. The result can be a confident paragraph quoting a section as it stood years ago, or a section that no longer exists. This article is about that single failure: currency. It explains why it happens, what it looks like in practice, and a short routine that lets you confirm the version in force on the date your question is about.

Key points

  • A model blends old and new text and cannot reliably tell which was true on a given day.
  • Write down the date of the events and today's date before you ask a statutory question.
  • Confirm the version, the commencement and later changes in an official source, then record what you checked.
  • Use AI to locate provisions, and rely only on text you have read yourself.

Why the model gets currency wrong

A model is trained on a large body of text collected up to some point. After that point it knows nothing new unless the tool around it supplies fresh material. Legislation changes all the time: sections are inserted, substituted, renumbered and repealed, and commencement can be staggered so that part of an Act is in force and part is not.

Worse, the training text contains every version at once. Commentary written before an amendment sits beside commentary written after it. Old textbooks, blog posts, law-firm bulletins and bills that never passed all look alike to the model. It has no reliable way to tell which statement was true on which day, so it blends them.

Tools that retrieve text from a database of legislation reduce the problem, because the quoted words come from a stored source rather than from the model's memory. They do not remove it. The stored copy may be an older consolidation, and the model may still paraphrase around the quotation.

What it looks like when it goes wrong

Currency errors are less dramatic than invented cases, which makes them easier to miss. Here are the shapes they usually take.

  • A section number that was correct before a renumbering exercise and now points to different text.
  • A time limit stated as it stood before an amendment changed it.
  • A definition quoted from a repealed Act that a newer Act replaced, with the replacement never mentioned.
  • A provision described as in force when it has been passed but not yet commenced, or the reverse.
  • A schedule or regulation made under the Act that has since been revoked, cited as if it still applied.
  • Transitional provisions ignored, so the answer describes the current rule when the facts are governed by the earlier one.

Two dates, not one

Most currency errors start with a question that names no date. Before you ask anything, write down two dates: the date of the events the question concerns, and today. They are often different. A claim about a contract signed several years ago may be decided under the law as it stood then, even though you are advising today.

Put both dates into the prompt, and ask the tool to say which version it is relying on. Do not treat its answer as evidence of the version. It is a prompt for you to check, not a statement of fact.

Also ask what transitional or savings provisions might apply. The model will often produce a plausible list. Use that list as a set of places to look in the official text, never as the answer.

A five-step routine for confirming the version

Run this for every statutory proposition that will appear in advice or a filing.

  1. 1

    Find the provision in an official or well-maintained legislative database for your jurisdiction, not through the AI answer.

  2. 2

    Check that the database shows the text as at your relevant date. If it only shows the current consolidation, find the amending instruments and work backwards.

  3. 3

    Read the commencement information. Confirm that the amendment, or the original provision, was actually in force on that date.

  4. 4

    Look for later amendments, repeals or pending bills that may change the position before your advice is used.

  5. 5

    Record the source, the version date and the date you checked, in the matter file or in the footnote.

Jurisdiction differences that catch people out

Practice differs between countries. Some jurisdictions publish point-in-time versions of their legislation, so you can read the text as at a past date. Others publish only the latest consolidation, with amendments listed separately, and you must rebuild the earlier text yourself. Some official sites lag behind the amendments. Where a government gazette is the authoritative source, a database may be a convenience copy only.

Federal and state systems add a layer: a rule may come from national legislation in one matter and state legislation in another, and the model may mix them. Subsidiary legislation, practice directions and court rules change on their own timetables, often with less commentary to reflect them.

If your firm works across several countries, keep a short list of the best source and its known limits for each. That list is more useful than any general advice about where to look.

Building currency checks into the firm's habits

Individual care is not enough if the checking depends on memory. A few small habits make currency a routine step.

  • Ask associates to attach the source page or a citation with the version date to any note that relies on a statute.
  • Give reviewers a standard question: which version, as at what date, and where did you read it?
  • Treat any answer that quotes legislation without a link to the source as a lead, not a finding.
  • Keep a small bank of past errors, with the statute and what the tool said, to use in training. Teams learn from a real example of a repealed section more than from a warning.
Do
  • Attach the source page or citation with the version date
  • Ask reviewers: which version, as at what date, where read?
  • Keep a bank of past errors to use in training
Don't
  • Treat a quoted statute with no source link as a finding
  • Leave currency checking to individual memory
Making currency a routine step

Where AI still helps

None of this means AI is useless for statutory research. It is good at suggesting which Acts and parts might be relevant, explaining the structure of a long statute in plain words, and producing a list of related provisions to read. Those uses save time because the lawyer then reads the official text anyway.

The line to hold is between locating and relying. Use the tool to find the provision. Rely only on the text you have read, in a version you have confirmed, as at the date that matters.

Use AI to locate
  • Suggest which Acts and parts might be relevant
  • Explain the structure of a long statute in plain words
  • List related provisions to read
Rely only on
  • Text you have read yourself
  • A version you have confirmed
  • The position as at the date that matters
Locating a statute and relying on it

This article is general information about the law, legal practice and technology, current when it was published. It is not legal advice. Laws and guidance change: check the sources linked above and take advice on your own circumstances from a lawyer qualified where you are.

Read next

Why AI research can quote repealed law | ChamberOne