Artificial intelligence can now outperform most law school graduates on the bar exam, the grueling two-day test aspiring attorneys must pass to practice law in the United States, according to a new study released Wednesday.
The bar exam assesses knowledge and reasoning and includes essays and performance tests meant to simulate legal work, as well as multiple choice questions. The newer GPT-4 got nearly 76 per cent of the bar exam’s multiple-choice questions right, up from about 50 per cent for ChatGPT, outperforming the average human test-taker by more than 7 per cent.
“I heard so many people say, ‘Well, it might get the multiple choice but it will never get the essays,'” Katz said.