The skills lawyers need to work well with AI
By the ChamberOne team 5 minute read
You do not need to understand how a language model works to use one well, any more than you need to understand a court's internal procedures to litigate. You do need a handful of skills that matter more when a tool produces fluent text on request. None of them is technical. Most are old legal skills, applied to a new source of draft material. This article lists four and suggests how to practise each.
Key points
- Verification, precise instruction, reading sources and client judgment are the four skills that matter most.
- Practise verification on questions where you already know the answer, then on ones where you do not.
- Write instructions as if briefing a new trainee, and revise the instruction, not only the output.
- Read the source before the summary so you keep seeing what summaries miss.
- Seniority does not exempt anyone, since seniors sign off the work.
Skill one: verification
The first skill is checking, and doing it routinely rather than when you are worried. Verification means tracing an authority to its source, reading the passage and confirming the proposition. It also means checking dates, figures and names against the file.
Practise by taking a tool's answer on a question where you already know the law, and finding what is wrong with it. Then try a question you do not know the answer to, and work out how you would check it.
Make it a habit to say, in a file note, how an AI-assisted point was checked. Writing the sentence forces you to do the check, and it leaves a trail for a reviewer. If you cannot write the sentence, you have not verified the point yet.
Skill two: precise instruction
The quality of output depends heavily on the quality of the request. A vague request gets a generic answer. A precise one gets something you can use.
- Say who the document is for and what it must achieve.
- Give the facts and the constraints, and say which are assumptions.
- Ask for a specific structure, length and tone.
- Ask for sources or clause numbers so you can check.
- Say what to do when information is missing: ask a question, not guess.
- Say who the document is for and what it must achieve.
- Give the facts and constraints, and mark assumptions.
- Ask for sources or clause numbers.
- Say what to do when information is missing.
- Send a vague request and expect more than a generic answer.
- Leave the tool to guess when information is missing.
Practising instruction
Take a task you do often, such as a client update, and write the instruction as if briefing a new trainee who knows nothing of the matter. Compare the result with what you would write. Revise the instruction, not only the output. Over a few weeks you will find phrases that work reliably, and you can keep them in a shared note.
This is the same skill as briefing counsel or instructing an expert, and it improves with the same discipline: clarity about the question.
Keep the best instructions. A shared note of prompts that produced good first drafts of, say, client updates or attendance notes saves everyone starting from nothing, and lets the firm see how people are actually using tools.
Review the shared note every few months and delete what no longer works. Tools change, and an instruction that gave good results last year may now produce something worse.
- 1Write the instruction as if briefing a new trainee
- 2Compare the result with what you would write
- 3Revise the instruction, not only the output
- 4Keep the best instructions in a shared note
- 5Review the note every few months
- Then back to step 1.
Skill three: reading sources
If a tool summarises, the temptation is to read the summary and stop. Lawyers who keep reading the underlying documents will continue to see what summaries miss: the qualification in a subclause, the tone of a letter, the document that should have been on the list.
Practise by reading a document first, forming your own view, and only then comparing it with a tool's summary. The differences teach you both about the document and about the tool.
When time is short, read the parts a summary is most likely to blur: definitions, exceptions, conditions, schedules and the last page. Those are where meaning tends to hide.
Skill four: client judgment
Judgment about the client is where lawyers add most value, and it is the part a tool cannot supply. What does this client really want? What can they afford, in money and in risk? What will they do with the advice? What is not being said?
As routine drafting speeds up, the proportion of a lawyer's time spent on these questions should grow. Practise by writing, at the start of each matter, two sentences on what the client is trying to achieve, in their own terms. Revisit them at each stage.
A short exercise helps. Before a client meeting, write down what you expect them to ask, then check afterwards what they did ask. Over time you will calibrate your sense of the client, which no tool can do for you.
A supporting skill: knowing when not to use the tool
Some tasks are better done by hand. Anything highly sensitive, anything where you need to think through a problem to understand it, anything where the effort is the point, as when a junior is learning. Develop a sense for when a tool will help and when it will get in the way.
Ask yourself before starting: how will I check this, and is that quicker than doing it myself? If the honest answer is no, skip the tool.
The same test works for colleagues you supervise. Ask them how they checked a piece of work before you read it, and you will quickly learn whether the checking is real.
How to build these skills in practice
- Pick one task a week to do with a tool, and keep notes on what worked and what did not.
- Pair with a colleague and review each other's checking.
- Share one example a month of a tool failing and how it was caught.
- Ask supervisors to give feedback on process as well as output.
- Read your regulator's and bar's guidance on AI, and revisit it when it is updated.
Why seniority does not exempt anyone
Partners sometimes assume these skills are for juniors. In fact, seniors are the ones signing off, and the ones whose names go on documents. A partner who cannot judge how reliable an AI-assisted note is will either trust it too much or reject it wholesale. Both are costly.
This article is general information about the law, legal practice and technology, current when it was published. It is not legal advice. Laws and guidance change: check the sources linked above and take advice on your own circumstances from a lawyer qualified where you are.
Read next
Training junior lawyers when AI does the first draft
If routine drafting shrinks, juniors need other ways to build judgment. Practical exercises that keep the learning in the work.
5 minute readLaw students and AI: learning to think before you prompt
AI can be a sparring partner for a law student, but only if you do the thinking first.
4 minute readThe paralegal career in the age of AI
Some paralegal tasks will shrink and others will grow. Build the skills for the second kind.
4 minute read