Lawyers warned to stop using ChatGPT to argue lawsuits after AI incidents
Lawyers in England and Wales have been warned of potential severe sanctions, including criminal prosecution, if they present false material generated by AI in court. This ruling by a senior judge follows cases where AI software produced fictitious legal cases and invented quotes.
Artificial Intelligence Fabricated Information
In one instance, AI created 'inaccurate and fictitious' material in a lawsuit against two banks. Another case involved a lawyer unable to explain nonexistent precedents in a legal argument against a local council.
While AI language models like OpenAI's ChatGPT and Google's Gemini can produce accurate-sounding texts, they focus on 'statistically plausible' replies, leading to potential 'hallucinations' or false information.
Concerns Raised by Judges
Dame Victoria Sharp and Justice Jeremy Johnson KC highlighted concerns about the misuse of AI tools by lawyers in written legal arguments. They emphasized the importance of training, supervision, and regulation to ensure lawyers comply with their duties to the court.
AI Impact on Legal Cases
In a cited case, a man sought damages from two banks based on fictitious citations and inaccurate quotations. In another case, a man was denied emergency accommodation, citing past non-existent cases.
Lawyers globally are facing challenges as AI systems improve, requiring the judicial sector to adapt traditional practices to incorporate AI responsibly.
Legal Consequences of AI Misuse
Recent incidents involved New York lawyers facing disciplinary actions for citing fabricated AI-generated content in lawsuits. Lawyers were fined for relying on AI-generated submissions in an injury claim against an airline.
Judges emphasized that while AI can be used, lawyers are responsible for verifying the accuracy of submissions to maintain the integrity of the legal system.
