Global News
A recent study conducted by Northern Irish solicitors, SG Murphy, decided to put AI chatbot, ChatGPT, to the test by asking it a number of standard legal questions. This was to ascertain whether the platform could rival solicitors in terms of giving accurate legal advice.
The team then scrutinised the chatbot’s responses against legal specifications. In doing so, they were able to determine AI’s capabilities and limitations, as well as make predictions about its future in the legal field.
Researchers determined ChatGPT’s responses against the following criteria:
The team found that a whopping 73% of responses were below the standard level of what you’d expect a real lawyer to provide. In addition to this, almost 1 in 10 of the responses to legal questions were wrong.
It was also noted that the chatbot did not provide any prompts or requests for further information – something that you’d expect from an experienced lawyer.
Based on these findings, researchers concluded that ChatGPT could not compete with the quality services provided by a real lawyer.
Shane McCann, Managing Director at SG Murphy Solicitors, said: “One of my major concerns with using AI chat boxes for legal queries currently is how limited they are in functionality. ChatGPT’s very design restricts itself from finding important background research on the client and their interests.
“Asking questions is a big part of what a lawyer does in order to build a rapport and find out information unique to the client. By understanding the needs and desires of an individual, a lawyer can then provide a more trusting, useful, and tailored response.
“What’s more, incorrect legal advice can carry serious implications for clients, including significant delays and loss, as well as feelings of frustration and distress.
“Recently, AI and its future in the legal field has gained a lot of buzz and publicity.
Following our research, we do not see AI Chatbots significantly rivalling the legal industry right now due to its design limitations.
“However, I do predict that, as AI’s capabilities become greater, we will start to see its utility increase in the legal sector. Lawyers who welcome this advent could utilise AI tools to perform simple routine tasks so that they, themselves, can prioritise higher-paying and more complex work. Ultimately, if AI is embraced, the future could hold greater efficacy and profitability for the legal industry.”
SG Murphy Solicitors are known for their excellence and expertise across Northern Ireland. The firm has a proven track record in supporting clients by being committed to advancing their needs and promoting their interests, as well as having years of specialised knowledge and experience. You can get in touch with SG Murphy’s solicitors by emailing This email address is being protected from spambots. You need JavaScript enabled to view it. or calling +44 (0)28 90 365595.
Copyright © 2023 Legal IT Professionals. All Rights Reserved.
We offer organizers of legal IT seminars, events and conferences a unique marketing and promotion opportunity. Legal IT Professionals has been selected official media partner for many events.
