Research: AI chatbot ChatGPT makes mistakes in 52% of software developer answers
31.05.24
According to a Purdue University study recently presented at the Computer-Human Interaction conference, the AI service ChatGPT gives 52% of the wrong answers to programming questions. More than 517 questions on Stack Overflow were analyzed for the study.
It is especially worrying that many programmers use ChatGPT for consultations. The researchers found that 35% preferred ChatGPT and 39% did not notice the errors. Note that Stack Overflow’s traffic has fallen by about 35% in a year and a half.
A noticeable decline began after the release of ChatGPT II chat. In response, Stack Overflow announced OverflowAI – a set of functions that work on the basis of artificial intelligence. Also, Stack Overflow even decided to ban the use of ChatGPT on the platform, saying that it has doubts about the accuracy of such answers.
Stack Overflow – a question and answer site for programmers. This is the flagship website of the Stack Exchange network. It was created in 2008.
Don't miss interesting news
Subscribe to our channels and read announcements of high-tech news, tes
iPhone 17 Pro Max vs Galaxy S25 Ultra comparison: Who is more powerful?
0 
A real competition has traditionally unfolded between the flagship smartphones of Apple and Samsung. Both have high-quality screens, powerful processors and a set of camera modules for a variety of scenarios. Let’s talk about the main features of the fierce competitors
Moto G 2026 – smartphone with good selfie camera for $200 Motorola smartphone
The Moto G 2026 features a 6.7-inch IPS display with 720p resolution and 120Hz refresh rate
Apple plans to release a budget MacBook in 2026 Apple laptop
A cheap MacBook could be an alternative for users who currently use an iPad with a keyboard as a laptop replacement