‘ChatGPT Detector’ Catches AI-Generated Papers with Unprecedented Accuracy

  • 📰 sciam
  • ⏱ Reading Time:
  • 59 sec. here
  • 2 min. at publisher
  • 📊 Quality Score:
  • News: 27%
  • Publisher: 63%

Technology Technology Headlines News

Technology Technology Latest News,Technology Technology Headlines

A new tool based on machine learning uses features of writing style to distinguish between human and AI authors

A machine-learning tool can easily spot when chemistry papers are written using the chatbot ChatGPT, according to a study published on 6 November in Cell Reports Physical Science. The specialized classifier, which outperformed two existing artificial intelligence detectors, could help academic publishers to identify papers created by AI text generators.

The findings suggest that efforts to develop AI detectors could be boosted by tailoring software to specific types of writing, Desaire says. “If you can build something quickly and easily, then it’s not that hard to build something for different domains.” In the latest study, the detector was trained on the introductory sections of papers from ten chemistry journals published by the American Chemical Society . The team chose the introduction because this section of a paper is fairly easy for ChatGPT to write if it has access to background literature, Desaire says. The researchers trained their tool on 100 published introductions to serve as human-written text, and then asked ChatGPT-3.5 to write 200 introductions in ACS journal style.

The new ChatGPT catcher even performed well with introductions from journals it wasn’t trained on, and it caught AI text that was created from a variety of prompts, including one aimed to confuse AI detectors. However, the system is highly specialized for scientific journal articles. When presented with real articles from university newspapers, it failed to recognize them as being written by humans.

 

Thank you for your comment. Your comment will be published after being reviewed.
Please try again later.
We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

 /  🏆 300. in TECHNOLOGY

Technology Technology Latest News, Technology Technology Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

Elon Musk debuts 'Grok' AI bot to rival ChatGPTBillionaire Elon Musk's artificial intelligence startup xAI announced the launch of its Grok AI assistant, which is in a beta phase and will be incorporated into X for premium subscribers.
Source: FOX10Phoenix - 🏆 83. / 68 Read more »

ChatGPT-maker OpenAI hosts its first big tech showcase as the AI startup faces growing competitionThe artificial intelligence company behind ChatGPT has invited hundreds of software developers to its first developer conference Monday in San Francisco
Source: sdut - 🏆 5. / 95 Read more »

ChatGPT-maker OpenAI hosts its first big tech showcase as the AI startup faces growing competitionThe artificial intelligence company behind ChatGPT has invited hundreds of software developers to its first developer conference Monday in San Francisco. In doing so, it's embracing a Silicon Valley tradition for technology showcases that Apple helped pioneer decades ago. But the path to OpenAI’s debut DevDay has been an unusual one.
Source: AP - 🏆 728. / 51 Read more »

ChatGPT-maker OpenAI hosts its first big tech showcase as the AI startup faces growing competitionSAN FRANCISCO (AP) — The artificial intelligence company behind ChatGPT has invited hundreds of software developers to its first developer conference
Source: Mynorthwest - 🏆 438. / 53 Read more »

ChatGPT’s next big feature might let you make your own GPT-4 chatbotChatGPT will get a redesign, new GPT-4 features, and a ChatGPT builder feature that lets you create custom AI chatbots.
Source: BGR - 🏆 234. / 63 Read more »