ChatGPT bot passes US law school exam

ChatGPT from OpenAI, a US company that this week got a massive injection of cash from Microsoft, uses artificial intelligence (AI) to generate streams of text from simple prompts

Agence France-Presse January 25, 2023 17:39:18 IST
ChatGPT bot passes US law school exam

Representational image. News18

Paris: A chatbot powered by reams of data from the internet has passed exams at a US law school after writing essays on topics ranging from constitutional law to taxation and torts.

ChatGPT from OpenAI, a US company that this week got a massive injection of cash from Microsoft, uses artificial intelligence (AI) to generate streams of text from simple prompts.

The results have been so good that educators have warned it could lead to widespread cheating and even signal the end of traditional classroom teaching methods.

Jonathan Choi, a professor at Minnesota University Law School, gave ChatGPT the same test faced by students, consisting of 95 multiple-choice questions and 12 essay questions.

In a white paper titled “ChatGPT goes to law school” published on Monday, he and his coauthors reported that the bot scored a C+ overall.

While this was enough for a pass, the bot was near the bottom of the class in most subjects and “bombed” at multiple-choice questions involving mathematics.

‘Not a great student’

“In writing essays, ChatGPT displayed a strong grasp of basic legal rules and had consistently solid organisation and composition,” the authors wrote.

But the bot “often struggled to spot issues when given an open-ended prompt, a core skill on law school exams”.

Officials in New York and other jurisdictions have banned the use of ChatGPT in schools, but Choi suggested it could be a valuable teaching aide.

“Overall, ChatGPT wasn’t a great law student acting alone,” he wrote on Twitter.

“But we expect that collaborating with humans, language models like ChatGPT would be very useful to law students taking exams and to practicing lawyers.”

And playing down the possibility of cheating, he wrote in reply to another Twitter user that two out of three markers had spotted the bot-written paper.

“(They) had a hunch and their hunch was right, because ChatGPT had perfect grammar and was somewhat repetitive,” Choi wrote.

Read all the Latest News, Trending News, Cricket News, Bollywood News,
India News and Entertainment News here. Follow us on Facebook, Twitter and Instagram.

Updated Date:

also read

AI tools a $90 billion market already, developers look for solutions better than OpenAI
World

AI tools a $90 billion market already, developers look for solutions better than OpenAI

The AI market is already worth nearly $90 billion today and is expected to grow by another $10 billion in the next three years. While OpenAI's GPT-4 based tools are very popular, developers are already looking for better alternatives that work faster.

AI is coming for your jobs: 80% US jobs to be impacted by ChatGPT-like AI in coming years
World

AI is coming for your jobs: 80% US jobs to be impacted by ChatGPT-like AI in coming years

A recent study has found that AI bots like ChatGPT and Bing AI will disrupt about 80 per cent of all jobs in the US. According to the findings of the study, telemarketers, instructors, school counsellors, and judges are among those most vulnerable to AI.

China’s Baidu cancels public showcase for Ernie AI, its ChatGPT rival, shows it behind closed-doors 
World

China’s Baidu cancels public showcase for Ernie AI, its ChatGPT rival, shows it behind closed-doors 

China's Baidu cancelled the public showcase of its Ernie AI bot, a chatbot that is supposed to rival OpenAI's ChatGPT. Instead, they chose to show the AI bot to select tech firms behind closed door, under pressure from the Chinese government.