A.I. in the Legal System: A Case of Misuse
Jerome Dewald sat with his legs crossed and his hands folded in his lap in front of an appellate panel of New York State judges, ready to argue for a reversal of a lower court’s decision in his dispute with a former employer.
A Creative Approach
The court had allowed Mr. Dewald, who is not a lawyer and was representing himself, to accompany his argument with a prerecorded video presentation.
The Unusual Video
As the video began to play, it showed a man seemingly younger than Mr. Dewald’s 74 years wearing a blue collared shirt and a beige sweater and standing in front of what appeared to be a blurred virtual background.
A Confused Judge
A few seconds into the video, one of the judges, confused by the image on the screen, asked Mr. Dewald if the man was his lawyer.
A Digital Avatar
“I generated that,” Mr. Dewald responded. “That is not a real person.”
Consequences of A.I. Misuse
The judge, Justice Sallie Manzanet-Daniels of the Appellate Division’s First Judicial Department, paused for a moment. It was clear she was displeased with his answer.
“It would have been nice to know that when you made your application,” she snapped at him.
“I don’t appreciate being misled,” she added before yelling for someone to turn off the video.
Expert Concerns
Some experts say that artificial intelligence and large language models can be helpful to people who have legal matters to deal with but cannot afford lawyers. Still, the technology’s risks remain.
“They can still hallucinate — produce very compelling looking information” that is actually “either fake or nonsensical,” said Daniel Shin, the assistant director of research at the Center for Legal and Court Technology at the William & Mary Law School. “That risk has to be addressed.”
Conclusion
The use of artificial intelligence in the legal system raises concerns about transparency, disclosure, and the potential for misuse. While technology can be a useful tool, it is essential to understand its limitations and risks to ensure fair and just outcomes in legal proceedings.
FAQs
Q: What happened in the case?
A: Jerome Dewald, a 74-year-old man representing himself in a contract dispute, used artificial intelligence software to create a digital avatar for a prerecorded video presentation. The judge was confused and eventually turned off the video.
Q: Why did Mr. Dewald use the digital avatar?
A: Mr. Dewald used the digital avatar to ease the pressure he felt in the courtroom and to present his arguments more efficiently.
Q: What are the risks of using A.I. in legal proceedings?
A: The risks include the potential for AI to produce fake or nonsensical information, which can mislead judges and parties involved in the case.
Q: Can AI be helpful in legal proceedings?
A: Yes, AI can be helpful for people who have legal matters to deal with but cannot afford lawyers. However, it is essential to understand the technology’s limitations and risks to ensure fair and just outcomes.
