Disclosure: DROZlegal publishes this guide as part of its free Lawyer AI Academy and builds a practice-automation product for Canadian law firms. The hallucination-rate and court-sanctions statistics below are drawn directly from Stanford RegLab's peer-reviewed research and Damien Charlotin's public AI Hallucination Cases Database, fetched and verified for this article, not ours.
What a large language model actually does
Strip away the marketing and a large language model does one thing: given the text so far, it predicts the most statistically likely next word, then the next, then the next — using patterns learned from an enormous body of training text. It does this so fluently that the output reads like reasoned analysis. It is not performing legal reasoning the way you do; it is pattern-completing text that resembles what it saw during training.
That's the core difference from the deterministic legal-tech automation your firm already runs. A document-assembly template fills in a client's name and produces the same clause every time. A calendaring rule always adds the same number of days to a limitation date. A large language model doesn't work that way — ask it the same legal question twice and you can get two differently worded, occasionally differently reasoned, answers, because it's sampling from a probability distribution over plausible next words, not executing a fixed rule.
That single fact — probable next word, not verified fact — explains most of what follows in this lesson.
Three failure modes every lawyer needs to recognize
The Law Society of Ontario's white paper on generative AI names hallucinations and inaccurate information directly as a key risk of the technology, alongside the unanticipated spread of confidential information. Three specific patterns show up often enough to be worth naming individually.
- Hallucination. The model states something false with the same fluent confidence as something true — a case that doesn't exist, a quote a court never wrote, a statute section that says something different from what's cited. A peer-reviewed Stanford RegLab study (Magesh et al., Journal of Empirical Legal Studies, 2025) tested leading legal AI research tools and found Lexis+ AI hallucinated on 17% of queries and Westlaw AI-Assisted Research on roughly 33% — with a general-purpose model (GPT-4, no legal-specific retrieval) hallucinating on 43% of the same query set.
- Staleness. A model only knows what was in its training data up to a fixed cutoff date. Anything after that — a new decision, a statutory amendment, a rule change — simply isn't there unless the tool is connected to a live search or database, and even retrieval-augmented tools are only as current as what they've indexed.
- Confident wrongness. These models don't hedge the way a careful colleague would when unsure. Wrong output reads exactly as fluent and certain as right output, which is precisely why courts keep catching it after the fact rather than lawyers catching it before filing.
Always independently verify any information produced by generative AI that you intend to rely on. The verification process should be completed by a human being, not the AI system itself. Law Society of Ontario, Generative AI: Your Professional Obligations, April 2024
That verification duty isn't theoretical. Damien Charlotin's public AI Hallucination Cases Database, which tracks documented court filings containing AI-fabricated citations worldwide, grew from roughly 100 cases in mid-2025 to nearly 1,900 by August 2026 — a trend line moving the wrong way even as judges have issued repeated public warnings.