Research: AI chatbot ChatGPT makes mistakes in 52% of software developer answers
31.05.24
According to a Purdue University study recently presented at the Computer-Human Interaction conference, the AI service ChatGPT gives 52% of the wrong answers to programming questions. More than 517 questions on Stack Overflow were analyzed for the study.
It is especially worrying that many programmers use ChatGPT for consultations. The researchers found that 35% preferred ChatGPT and 39% did not notice the errors. Note that Stack Overflow’s traffic has fallen by about 35% in a year and a half.
A noticeable decline began after the release of ChatGPT II chat. In response, Stack Overflow announced OverflowAI – a set of functions that work on the basis of artificial intelligence. Also, Stack Overflow even decided to ban the use of ChatGPT on the platform, saying that it has doubts about the accuracy of such answers.
Stack Overflow – a question and answer site for programmers. This is the flagship website of the Stack Exchange network. It was created in 2008.
Don't miss interesting news
Subscribe to our channels and read announcements of high-tech news, tes
Oppo A6 Pro smartphone review: ambitious
0 
Creating new mid-range smartphones is no easy task. Manufacturers have to balance performance, camera capabilities, displays, and the overall cost impact of each component. How the new Oppo A6 Pro balances these factors is discussed in our review.
Editor’s Choice 2025. Best devices of the year by hi-tech.ua
0 
The best gaming laptops, mice for work, gaming keyboards, smartphones, and wireless headphones of 2025. Among them, we will highlight the most interesting ones and those that we can recommend buying.
Brabus will now tune not only Mercedes and Maybach, but also Bentley car
Bentley Brabus 900 Superblack and Brabus 900 are equipped with a 4.0-liter V8 with twin turbocharging and a hybrid superstructure, boosted to 900 hp and 1100 Nm
ASUS ROG release gaming monitor with 5K 180Hz and QHD 330Hz matrix Asus monitor
Asus ROG on the eve of CES 2026 introduced the ROG Strix XG27JCG gaming monitor, which received a dual operating mode and, according to the company, became the first in its class