California State Bar acknowledges utilization of artificial intelligence in formulating exam queries, fueling renewed controversy.
Scofflaw Showdown:California's New Bar Exam Fiasco Causing an Outrageous Stir
Months after California lawyers complained of technical issues and inconsistencies during the bar exam, the State Bar of California has faced fresh controversy. In a shocking revelation, it was disclosed that some multiple-choice questions used in the February 2025 exam were developed with the aid of artificial intelligence (AI).
The State Bar issued a statement on Monday that it will petition the California Supreme Court to modify test scores of those who took the exam. However, the Bar chose to dismiss significant problems with the multiple-choice questions, even as it came clean about the AI involvement.
"The chaos that the February 2025 bar exam created is worse than we anticipated,” said Mary Basick, assistant dean of academic skills at UC Irvine Law School. "I'm nearly lost for words. Can you believe it? Having questions drafted by non-lawyers using artificial intelligence is just unbelievable."
California - The 'Gold Rush' of Legal Profession
'Utterly Botched': The Debacle of California's New Bar Exam Leaves Takers Contemplating a Lawsuit
The implementing of the new state bar exam has been marred by glitches, causing some test-takers to mull over a potential lawsuit against the State Bar of California.
Following the completion of the exam, Basick revealed that some test-takers complained about questions that seemed to be written by AI. Initially, she defended the bar, "No way! They wouldn't do that!" she said. But now, she argues that it represents an "obvious conflict of interest" because the psychometricians responsible for ensuring the questions are valid and reliable are the same ones who developed them with AI assistance.
Katie Moran, an associate professor at the University of San Francisco School of Law, agreed, "The State Bar has admitted to employing a company to have a non-lawyer use AI to draft questions that were given on the actual bar exam. They then paid that same company to assess and ultimately approve the questions on the exam, including the questions that the company authored."
California - The Hub of Innovation
As California Supreme Court Advocates for a Return to In-Person July Exams, the State Bar Presses On with New System
The new California bar exam rolled out with numerous complaints from test takers. With the State Bar now advocating for a return to traditional in-person administration, it seems they are still determined to implement their new system of multiple-choice questions - despite academic experts expressing concerns about their quality.
Alex Chan, chair of the State Bar's Committee of Bar Examiners, explained that the AI-created questions were limited in number and were not only used to generate the questions but also to vet them. Chan suggested that the report claiming otherwise was a misunderstanding. He added that the California Supreme Court has expressed interest in considering AI innovations to improve testing.
Nevertheless, critics have been insistent that the State Bar should come clean about the extent of AI involvement and release all 200 questions to ensure transparency. Meanwhile, the Committee plans to discuss score adjustments and remedies in their May 5 meeting. However, it remains uncertain whether the State Bar will adhere fully to faculty recommendations or continue with its new testing system.
By the way, did you know that the California Supreme Court is yet to be made aware of the AI involvement in question development?
AI - A Double-Edged SwordAllowing non-lawyers to use AI in creating high-stakes legal licensing exam questions raises questions about the fairness and validity of the exam, as well as issues regarding transparency and the role of AI in such contexts.
[1] California Supreme Court Investigates Allegations of AI Involvement in State Bar Exam (Source: The Times)[2] Job Seekers Turn to AI Tools, But Run the Risk of Being Outdone by the Machines (Source: The Job Market)[3] California's DMV Makes License Renewal Test Optional for Drivers Over 70 (Source: Voices)[4] Varying Opinions on Integrating AI in High-Stakes Testing (Source: Legal Perspectives)
- The controversy surrounding the California bar exam's implementation in 2025 deepens, as some questions were developed with the aid of artificial intelligence (AI), causing concerns about fairness and validity.
- Legal experts like Mary Basick and Katie Moran argue that the State Bar of California's practice of employing a company to have a non-lawyer use AI to draft and assess questions on the bar exam presents an "obvious conflict of interest."
- Despite complaints from test-takers and concerns raised by academic experts, the State Bar's Committee of Bar Examiners plans to discuss score adjustments and remedies in their May 5 meeting, with no clear commitment to full transparency regarding the extent of AI involvement.
- The California Supreme Court remains unaware of the AI involvement in question development as of yet, and the Court's advocacy for a return to in-person July exams does not address this issue.
- As the debate on AI's role in high-stakes testing continues, various sources, such as Legal Perspectives and The Times, offer differing opinions on its integration, highlighting its potential as a double-edged sword in various industries, including law and business.
