Today I have found an interesting article that postulates that the AI industry has just discovered a universal pattern of collapse:
> I have been considering digital modeling and artificial neural networks. Model collapse is a serious limit to AI systems; a failure mode that occurs when AI is trained on AI-generated data. At this point, AI-generated content has infiltrated nearly every digital space (and many physical print spaces), extending even to scientific publications2. As a result, AI is beginning to recycle AI-generated data. This is causing problems in the AI development industry.
> In reviewing model collapse, the symptoms bear a striking resemblance to certain non-digital cultural failings. Neural networks collapse, hallucinate, and become delusional when trained only on data produced by other neural networks of the same class. …and when you tell your retarded tech-bro boss that you’re “training a neural network to do data-entry,” upon hiring an intern, are you not technically telling the truth?
> Model collapse is not unique to digital systems. Rather it’s the most straight-forward form of a much more fundamental underlying principle that effects all systems that train on raw data sets and then output similar data-sets. Training with regurgitated data leads to a loss in fidelity, and a an inability to interact effectivley with the real world.
...
> Nature published the original associated article in 2024, and follow-up studies have isolated similar issues. Model collapse appears to be a present danger in data sets saturated with AI-generated content4. Training on AI-generated data causes models to hallucinate, become delusional, and deviate from reality to the point where they’re no longer useful: i.e., Model Collapse.
> The more “poisoned” the data is with artificial content, the more quickly an AI model collapses as minority data is forgotten or lost. The majority of data becomes corrupted, and long-tail statistical data distributions are either ignored or replaced with nonsense.
...
> Agencies and companies will soon curate non-AI-generated databases. In order to preserve AI models, the data they train on will have to be real human-generated data rather than AI slop. Already, there are professional AI training companies that work to curate AI with real-world experts. The goal is to prevent AI from hallucinating nonsense when asked questions. Results are mixed, as one would expect with any trans-humanism techno-bullshit in the modern day.
> Let’s talk about mice.
And then he goes over the famous mouse Utopia experiment and how the poor rodents collapsed into behavioral sinks and its association with the urban bug man phenomena.
> Rather than seeing Mouse Utopia, the Human Demographic Implosion, and AI Model collapse as disconnected events, the same principles may be active in all of them. The fidelity of information decays when later generations are trained solely on information created by prior entities of their own class.
Which brings the author to his universal model collapse theory.
> The proposed thesis is that neural-network systems, which include AI models, human minds, larger human cultures, and our individual furry little friends, all train on available data.[...]
> People use new data as training data to model the outside world, particularly when we are children. In the same way that AI models become delusional and hallucinate when too much AI-generated data is in the training dataset, humans also become delusional when too much human-generated data is in their training dataset.
> Brains (or brain regions) undergo model collapse just like AI systems. They become unable to reference reality, they become delusional, and hallucinate things that make no sense. Hence, the “Why do we need farmers when food just comes from the store” level of disconnection observed in urban populations.
> In a heavily urban setting, humans train on “data sets” that are nearly wholly artificial. The less time spent outside, the less time spent interacting with the real physical world around them, the less accurate their model of reality becomes. Where exactly one draws the line between “real” and “artificial” data is subject to debate. A rocky slope up a hill may be 100% real, a grass playing field may be 70% real, and a concrete sidewalk may be around 40% real. At some point, however, the “salted” artificial data is sufficient to corrupt the real-world knowledge of individuals and cause model collapse.
> Urban bug-people aren’t just delusional, they’re fundamentally broken. Similarly, “fixing” them may not be possible without radical retraining programs to teach them about the real world. “Go live in the woods for a year or two and try not to die” might be enough, but our society would hardly remain stable through such a remedy.
> When it comes to navigating the real world, urban bug-people often behave as if they’re retarded. Socially (they’ve never been punched in the face), Geospatially (they have no idea how to navigate by the sun or shadows), Culturally (without some pop-fiction touchstone, culture doesn’t exist), etc. They’re entirely bound to a world of artificial ideas: human-produced data, and unable to accurately model from first principles anything outside their extremely limited sphere of artificial experience.
> The bugman’s neurological model of reality is divorced from reality. They hallucinate truths that make no sense, and they delude themselves into provably false ideas, and violently attack anyone with a model of reality more accurate than their own.
[...]
> In the light of Universal Model Collapse, the “Experience” machine [(A thought experiment on VR how smol Ethan in the 90s imagined it.)] becomes a Lovecraftian nightmare that’ll cause individuals to rewrite their own neurology until there’s nothing human left. If you think Urbanite bug-people are bad, imagine what will happen if they lose touch with their sensations of touch, sight, sound, culture, and physicality. A reduction from 50% of their training data being real to zero.
tl;dr
If a neural network is exclusively fed with data from its own class, it will inevitably collapse. This model fits to 3rd world stupidity, various heresies, urbanite delusions, hikkies and the mysterious disappearance of some African empires, the technological decline after the Western Roman empire collapsed and whatnot. It is also a wonderful justification for cultivating English gardens.
>>36739
Good to hear that, Nigger.
>>36764
Ayo, hol'...
> Nov. 6
< Takaichi has just limited Chinese tourist
Needless to say that the struggle against the (literally Chauvinist) Modi administration has just begun.
On the other hand I have unearthed this guy.