Generative AI Hallucination in Court Filing May Jeopardize Case Against BART

More than 1,000 U.S. legal cases in which generic AI produced hallucinated content were detected from Q2 2023 to May 19, one researcher found.

The screen shows the ChatGPT app in this photo illustration. Oleksii Pydsosonnii/The Epoch Times

SAN FRANCISCO—A California attorney was sanctioned $1,000 for a court filing that refers to three nonexistent cases, indicating possible use of artificial intelligence that hallucinated, an issue increasingly seen in courts.

“The Court does not prohibit or oppose the use of artificial intelligence in legal advocacy, so long as counsel independently verifies the accuracy of AI-generated content,” Magistrate Judge Thomas S. Hixson wrote in the order on May 6.