TheRegister's platform is a leading technology news website, offering insights into IT industry news, hardware reviews, and software updates. Through articles, analysis, and opinion pieces, TheRegister offers insights into cybersecurity threats, technology trends, and industry developments. Readers can stay updated with the latest news and analysis from the world of technology and IT business.

The Register

AI researchers warn that ChatGPT's launch in 2022 created a permanent contamination problem for machine learning training data, similar to how nuclear testing contaminated metals. The concern is that AI models trained on synthetic data from other AI models will suffer from 'model collapse,' becoming less reliable over time. This creates competitive advantages for companies with access to pre-2022 'clean' data and may lead to AI monopolies. Proposed solutions include mandatory AI content labeling, federated learning approaches, and government regulation to preserve access to uncontaminated datasets.

ChatGPT polluted the world forever, like the first atom bomb

So in 2022, the AI Uroboros was born and it yet has to bite on its tail.

Thanks for sharing! The notion of “model collapse” is an interesting one and I can see the concern being warranted. The evidence seems to show thus far though that models are becoming more reliable over time, not less. At least with code. It will be interesting to see if this becomes a problem but even if it is, like the nuclear bomb, there probably is no going back.

i keep seeing anecdotes and studies regarding AI tools actually reducing developer productivity in many cases, and being outright harmful to junior engineers who don’t yet have a good technical foundation. The reigning idea is that you are best equipped to use these coding tools when you’re at a level of competency where you don’t need them — catch 22.
has the hydrogen bomb been dropped? yes. have we been ushered into a new era? yes. does it mean that we need to be extremely careful with these tools (especially considering blatant security exploits i’ve personally seen these tools build)? yes.
i think the fact that our landscape has been polluted potentially means more jobs in the future, maybe in the shape of “AI Model Reconstruction Engineers” or “AI Sanitization Engineers” where a higher level of competency will be required to undo some of the fallout damage.

Yeah… no. We don’t create metal from nothing. We do create data from nothing. When we shoot a nuke into the air and spray nuclear mist material on everything, it necessarily contaminates everything already there. That’s not how it works with data even a little bit.