10 Surprising Truths About Trusting ChatGPT for Legal Advice

Published On Thu May 01 2025
10 Surprising Truths About Trusting ChatGPT for Legal Advice

People trust legal advice generated by ChatGPT more than a lawyer ...

Recent research has revealed a startling finding - people tend to trust legal advice provided by AI-generated tools like ChatGPT more than advice from a human lawyer. The study raises concerns about the growing reliance on AI-generated content and the potential risks associated with it.

The Rise of AI Tools in Everyday Life

AI tools such as ChatGPT and other large language models (LLMs) are becoming increasingly integrated into various aspects of our daily lives. From offering quick solutions to legal queries to diagnosing medical conditions, these tools promise to provide efficient and accurate information on a wide range of topics.

AI generated image of a robot working at a laptop in a modern office

However, one significant drawback of LLMs is their tendency to produce inaccuracies or nonsensical outputs, also known as "hallucinations." This presents a considerable risk, especially in critical domains like law, where the stakes are high.

Research Findings

In a series of experiments involving 288 participants, it was observed that individuals were more willing to rely on AI-generated legal advice when they were unaware of its source. Even when informed that one piece of advice came from a human lawyer and the other from an AI, participants showed a similar level of trust in both sources.

AI Attorneys | Husch Blackwell

Interestingly, the study noted that LLMs often use more complex language compared to real lawyers who tend to provide answers using simpler language but with more words.

Challenges in Distinguishing AI-Generated Content

While participants demonstrated some ability to differentiate between content generated by LLMs and human lawyers, their performance was only slightly better than random guessing. This underscores the challenge of discerning between AI-generated and human-generated advice.

The Importance of AI Regulation and Literacy

As AI technologies become more embedded in our lives, it is crucial to implement robust regulations to govern their use. Initiatives like the EU AI Act, which emphasizes the need for clear labeling of AI-generated content, are steps in the right direction.

Responsible Use of AI in Legal Settings

While AI can offer valuable support in addressing legal queries, it is imperative to verify AI-generated advice with human experts, especially in critical legal matters. By adopting a cautious approach that combines regulatory measures with enhanced AI literacy, we can leverage the benefits of AI technology while minimizing associated risks.

This article is republished from The Conversation under a Creative Commons license. For the original article, please visit here.