People trust legal advice generated by ChatGPT more than a lawyer ...
Recent research has revealed a startling finding - people tend to trust legal advice provided by AI-generated tools like ChatGPT more than advice from a human lawyer. The study raises concerns about the growing reliance on AI-generated content and the potential risks associated with it.
The Rise of AI Tools in Everyday Life
AI tools such as ChatGPT and other large language models (LLMs) are becoming increasingly integrated into various aspects of our daily lives. From offering quick solutions to legal queries to diagnosing medical conditions, these tools promise to provide efficient and accurate information on a wide range of topics.
However, one significant drawback of LLMs is their tendency to produce inaccuracies or nonsensical outputs, also known as "hallucinations." This presents a considerable risk, especially in critical domains like law, where the stakes are high.
Research Findings
In a series of experiments involving 288 participants, it was observed that individuals were more willing to rely on AI-generated legal advice when they were unaware of its source. Even when informed that one piece of advice came from a human lawyer and the other from an AI, participants showed a similar level of trust in both sources.
Interestingly, the study noted that LLMs often use more complex language compared to real lawyers who tend to provide answers using simpler language but with more words.
Challenges in Distinguishing AI-Generated Content
While participants demonstrated some ability to differentiate between content generated by LLMs and human lawyers, their performance was only slightly better than random guessing. This underscores the challenge of discerning between AI-generated and human-generated advice.
The Importance of AI Regulation and Literacy
As AI technologies become more embedded in our lives, it is crucial to implement robust regulations to govern their use. Initiatives like the EU AI Act, which emphasizes the need for clear labeling of AI-generated content, are steps in the right direction.
Responsible Use of AI in Legal Settings
While AI can offer valuable support in addressing legal queries, it is imperative to verify AI-generated advice with human experts, especially in critical legal matters. By adopting a cautious approach that combines regulatory measures with enhanced AI literacy, we can leverage the benefits of AI technology while minimizing associated risks.
This article is republished from The Conversation under a Creative Commons license. For the original article, please visit here.










