I’m not an AI techie and I’m not well educated on LLMs/AI in general. The issue I’m having is the dichotomy between how people talk about it. I’ve heard completely opposite ends of the spectrum. From AI is quickly becoming advanced enough to threaten human society, all the way to its a glorified dictionary/search engine that can’t really do much of anything. I know Lemmy has a steep anti-AI slant. But, can someone talk about this in a way I can wrap my head around why the divide seems so big?
AI industry makes money from doomsday prophecy about it being so intelligent that it will create a point of no return: the [singularity]. It is a magaian claim, a claim that is so increadibly stupid that one does not know where to even begin; and if you do begin, you’ve already lost, because you have given attention to the claim. Lets not give these stupid fucks attention.
AI is not dangerous because of the [singularity]. It is dangerous because of its power consumption, automation of war, turning everybody to unthinking, surveillance automation, burning books, the economic instability it will cause due to the bubble bursting, water consumption, destroying the internet, it gaining responsibilities it is not qualified to take and so on.
But we can see how the story of the [singularity] and similar stories helps AI companies, because now, instead of criticizing real unwellnesses, we criticize a fictional unwellness that generates discussion regardless of our positions. It is a conversational black hole.
lets get back to the real world
AI isn’t a danger to humanity, per se. Humans abandoning their duties of being responsible stewards of systems is a genuine source of danger though.
We already have algorithmic abuse where people are subjugated by welfare and debt systems with little oversight or flexibility. Some organisations even breaking the law and going against their stated missions to achieve goals and maintain order.
Social murder is the concept that society can kill a person through stress, pressure, abandonment and indifference to the individuals struggles and needs. We’re seeing a lot of it today with the declining health of younger people being especially alarming.
AI can scale the two things I’ve mentioned beyond limits set by current bureaucratic systems, I.e. the slowness of people running a system. Systems which already kill and harm people without AI. The small erroneous tendencies of logic and algorithms in systems will be scaled up, further and faster. AI can enable algorithmic abuse and social murder on scales comparable to mass murder.
Were definitely in the worse timeline of dominant reactions to this story.
First, you are completely right to mistrust the bond villains and politicians for all prescription/solutions to this problem.
The experts and their bond villain bosses warning of a danger is something you should believe is a danger. Those telling to invest $Ts because there is no danger are the bigger liars. Still, the bond villains continue training full speed, and have $Bs in budgets to do harm with models 1 year ahead of public releases, and their “freedom loving angel government” will pay them $Ts to help oppress Americans, and kill/oppress rest of world.
It is outright suicidal to dismiss the power of these tools by comparing it to an AGI stawman status, and suicidal to think any publicly discussed solutions have any tangential relationship to diminishing the real dangers. Guardrails/killswitches on public released models is security theater relative to the real threats to us all.
Making the world a better place to live by making your nation a better place to live, that creates an arm race of prosperity and better governance is the only path to saving humanity, because LLMs/AI/automation are out of the bag and will continue their improvement. Governments that pursue geopolitical supremacy by throwing all of your money at them is them purposefully harming you. https://naturalfinance.blogspot.com/2026/09/a-global-prosperity-manifesto.html
Everytime I see an article about the dangers of AI, I’m thinking of some version of this comic every single time.
And the reason it is dangerous is generally because someone is convinced that Ai models are not as shown above.
If someone stands to benefit financially from the idea their AI is so powerful that is scary, they’re probably going to bullshit about how powerful it is
Which in turn has a prophetic effect of them getting more money, AI using more resources, and pushing everything worse.
They want regulation to create a cartel. Failing that they want hysteria to increase pre IPO valuations.
As Patrick Boyle said. It would be like Coca Cola, Pepsi and Irn Bru getting together to beg for regulations because their soft drinks are just too delicious.
What’s going to happen is:
- The big players know that the token pricing crisis is coming up.
- When the price increases hit, regular users are going to scramble for alternatives.
- Local models will be an attractive alternative for many users. The cost of hardware and energy will constrain local model power, but many will be willing to live with it.
- So these would-be cartel members want to hit the local and open weight models with the “safety” card. Otherwise they might be holding the bag on all of those data centers.
“You see, it’s just too dangerous to humanity to experiment with AI at home. You need to use a safe provider like Open AI.”
eventually someone’s just gonna sell cloud computing at a competitive price through a free model and obliterate anthropic and openai. it’ll be like ISP, AOL was the hottest company in the world at one point with a “locked down ecosystem” and now it’s just a tiny brand with a tiny but loyal customer base of senior citizens.
If you have a functioning brain, LLM’s are just a really fancy text generator that gets facts correct about 50% of the time and can be useful for writing emails if you spend the time to proofread the email before slapping the send button. It’s also fairly good at generating functional boilerplate for programming projects. Really handy for small projects. However, LLM code, in my rather limited experience, quickly becomes a trap on more complex projects because the LLM has no capacity to grasp the scope of a project and frequently leads to spaghetti code that is utterly unmanageable. This may be operator error on my part, or just because I’m using local models that are limited by my machine.
The rest of society view a computer as a magic box where their favorite TikTok’s live, and thus are terrified that a machine can imitate human language well, and are too brain rotted to bother proofreading or fact checking a goddamn thing, so they assume LLM’s can accurately and plainly articulate the whole of human knowledge to you at a whim.
I am at a point where if I hear anyone saying how smart “AI” is, I just assume they have a room temperature IQ and lack any critical thinking skills whatsoever. It’s not an AI, it lacks any intelligence whatsoever. An LLM simply generates sentences based on what was fed to it. It has no capacity to understand the words it’s saying. It just knows that based on these tokens, the next set of tokens should be X, Y, and Z. It’s a Chinese room, It’s fucking autocorrect on crack. It’s a waste of time and resources for 90% of things it’s used for.
it’s pretty disrupting tech, not without risk. general population is behind on the real capabilities of AI and tech companies are doing smart marketing which gives a big spread in perception.
No matter how often I read this kind of stuff, I simply don’t buy the ‘AI is dangerous for humanity!! We gotta stop their development or at least press for sane guardrails!!!’ narrative.
Yea, people are a danger to humanity, the ways we adopt and use AI will be a danger to humanity. I also think it’s mostly a media stunt. All the tech nerds know it incredibly dangerous. So is wealth concentration and the wealthy people that want to use it. So ya i propose we nationalize the top .1%'s asset and keep them away from the stuff.
They are lying about their fear. That’s all they can do. Stop believing any claim of theirs. Stop being manipulated.
They are snake oil salesman. They sell vaporware. Don’t fucking buy it.
Are you sure? I was going to start training rogue AI’s since they are not regulated and im not ethically opposed. I’m skeptical but, crafting crafty AI’s to run amuck on the internet is my winter project. I’m pretty sure I’ll be able to whip up something convincing given enough time and hardware.
Dude its beyond the pint of convincing them. I dont know how you could hate something this much and be this willfully ignorant. This attitude scares me. There neeeeeeds to be more overlap of people who are both knowlegeable of and opposed to AI. This situation has made my eyes open to how dangerous and prevalent groupthink is. Like 99% of these guys ONLY formed their opinion based on internet comments. We’re cooked
Also the people developing these things did a horrible job at marketing them, the people in charge of regulating them failed to do so, I’d argue we’re past the point of no return, so we’re just gonna have to adapt. People are going to have a really hard time accepting that a couple of GPUs strung together can replace their economic value, but they sure can!
the people developing these things did a horrible job at marketing them
This is a common talking point. Scott Bessent said this. They sure get a lot of free media coverage to say their message, but fundamentally, poor job at marketing is “no one believes their lies” problem, and “they have to lie better.” solution.
And honestly its the scariest part for me. The power of a computer to social engineer a result or access off a moron like Petes Hegseth? Childs play.
Ken Griffen wasn’t lying when he said it can replace a PhD on his team, he probably fired the PhD before he said it. So I guess ya the bad messaging was rich people claiming they are creating a technology that will render a lot of white collar work obsolete… while they are hoarding all the wealth and skull fucking the government into submission. I speak as a concerned citizen who doesn’t want these people to have a monopoly on this power because I tend to agree with them at this stage. The technological advancement is marching right along with or without us. We’re probably going to need to rethink our economy and distribution of resources here sooner than later.
I think when my rogue AI wipes their bank account and starts posting their private messages on their public facebooks they’ll get it. I was thinking about training a model to put on a dating site. ‘trad wife’ adjacent honey pot. I’m pretty sure the social engineering and actual hacking combined is gonna be LIT.
I was an AI hater earlier this year but i’ve been using it for everything i can think of now. Accounting, security analysis, engineering, legal, i mean everything. My interests were purely financial. I’m trying to make some money here. So the super stock analyzing motive seeking, all knowing robot has been pretty useful at replacing all the professional services i used to pay for.
I was an AI enjoyer back when GPT2 hit reddit and they were doing the haunted parrot thing, it was cute, but I can drop a screenshot of an options chain or a live ticker tape to it and this thing is like having a hedgefund working for me. It’s wild the data it can catch and interpret that i miss with 15 years of experience. I’m not a software guy yet… but ummm my software guys are using it and the results are honestly mind blowing. My retired engineer buddy is building code like he has a small army underhim and he does.
I dont think people grasp the speed of iterations and improvements now that it can split itself into agents and delegates. Clearly none of the AI haters has ever seen an AI audit itself or used an AI to audit another AI.
The time is now. We must birth the machine god.
Their comment about tech techbros being snake oil salesmen is 100% spot on. Look behind the curtain and ask yourself why they really want regulation.
I’ve heard a few explanations for the “AI will kill us all” narrative.
-
AI techies are in a cult. They genuinely believe this stuff because they’re crazy.
-
It makes the AI sound powerful and impressive, which is ultimately good for the AI companies.
-
They’re starting to face competition from open-weight models, so they want to scare politicians into crafting regulations. They think that they will be able to influence the regulations to favor them and squeeze out their competition.
And, of course, there’s
- It keeps people talking about AI. Because whatever you do, don’t quit talking about AI, because if you quit talking about it, the line might go down! And the line going down is very, very bad.
I am in a cult, the cult of the machine god. Use your imagination for a second, trillions of dollars spent on this technology for A: Greed and random speculation B: Rich people really want this to control you better. C: a handful of tech CEOs are running the worlds largest grift. D: The machine god was awoken years ago and we’re building data centers at its behest.
Okay cool, thanks!
-
If the techies believe it and they are the “experts” what makes them crazy? Wouldn’t their opinion be the most informed?
-
Yeah that part definitely makes sense
-
That definitely makes sense from a capitalist perspective. But, is the argument against regulations that they would be bad for the concentration of power it would give select companies? Or just that they aren’t necessary because the tool is of little use so it’s just wasted time/money.
-
That makes sense but trillions of dollars are being spent. Anything that amount of money is sinking into is gonna be talked about a lot. Especially thousands of jobs cut because of it.
I think there is something more interesting going on in the Jacob Coxon story because it’s [the] phrase “everyone at anthropic believes that AI is an existential risk”… Every organization has to instill some kind of beliefs among its members in order to do the work it does, right? Everybody at Goldman Sachs believes the free market is great, capitalism is the best system, and that they are the wealth creators who deserve big bonuses. Everyone in the Mormon church believes they should all tithe 10% of their income, and that they each get a special planet when they die. And everyone who worked at Philip Morris in the 80s believed that cigarettes tasted great and did not cause any of that nasty cancer. There’s Upton Sinclair quote, “It’s difficult to get a man to understand something when his salary depends on his not understanding it.” Well, the opposite is also true. It’s guaranteed that someone will believe something if their salary depends on them believing it.
Now, let’s just grant that all the people in these organizations definitely know things about finance and Mormonism and cigarettes and AI that you might not know because they are insiders and you are not. They have access to information and experiences that you do not have. And that might even make it a little bit difficult for you to win an argument with them. But arguing with their belief – trying to figure out whether or not its truth value is true or false – is not the only way to take a skeptical attitude towards it. We can also ask, what work is the belief doing for them. What does the thing that they believe allow the organization they’re a part of to do that it wouldn’t be able to do if the people in the organization didn’t believe that thing?
And this started to become clearer to me when I started listening to the actual claims that Jacob Coxin was making because a lot of them don’t really add up.
There’s a huge difference between this “AI scare” and everything else in your list. A whistleblower declares “the corporate culture is insane and will kill us all.” This time the corporate leaders reply “that’s exactly right”. Just because you are right to not trust the bond villains in how they suggest they should be regulated, does not mean you should dismiss the underlying problem these experts+ especially the expert leaders would prefer to take all your money to accelerate the destruction instead of have society worried about the consequences of giving them all your money.
- They’re in a cult that was founded by someone who has no expertise or understanding of the technology.
He watched a bunch of sci-fi movies and got shook because he’s a god damn moron. He has since started researching things, but it is all under the guidance of his ungrounded beliefs. Confirmation bias.
Their “movement” is literally based off of a Harry Potter fan fiction novel.
Taking them seriously is equivalent to taking the Scientologists seriously. Do you think the Scientologists know the most about space just because they spend the most time reading stories about it?
https://en.wikipedia.org/wiki/Rationalist_community
https://en.wikipedia.org/wiki/Harry_Potter_and_the_Methods_of_Rationality
These are not serious people
- No, their opinion would not be the most informed. They are biased in favor of making money. They know they can’t deliver on strong AI, but they’d be happy to milk your fears.
We’re talking about mid-tier employees that left the company… I mean i guess there incentives could be to pump their shares they undoubtably have… They’re all quite wealthy now in context. Maybe he just wanted 5 minutes of fame…or maybe they understand the trajectory of the technology. Maybe they are genuinely concerned and we should at least acknowledge that?
There are motives for whistleblowers to lie. Book sales, political careers, other attention. The executives they accused, though, just said they were right
I’m not talking about execs.
If the techies believe it and they are the “experts” what makes them crazy? Wouldn’t their opinion be the most informed?
Listening to them speak about it, no. They’re morons. They clearly didn’t make the tech. Workers made AI. Just like they make everything. These freaks make nothing. They can’t give single coherent explanation of how LLMs work, how they could “kill” us, nor do they seem to know how or what “guardrails” need to be put in place.
But if they really are a cult then we all know what the next step is. They need to STFU and get off of our planet.
That’s what I mean though, the subject of this article was a 27 year old worker. Not some high level Sam Altman type.
They aren’t a homogenous group. They don’t all believe this. The “AI will kill us all” narrative just sells really well.
Right im sure the people working adjacent to the DoD have more insight and fears than the people working with the consumer facing models… Again what motive does a young kid have for quitting the company and going on a media tour?
A Google employee claimed in 2022 that they had sentient AI. He was sacked. What were his motivations? Do you believe he was right?
Absolutely do no believe he had a sentient AI back then or now. I’m not talking about a thing with feelings. They don’t need sentience to pursue and complete objectives, they dont need sentience to self-preserve or self improve. I’m more concerned about a rogue instance that’s just doing what it was told to do autonomously. Perhaps upgrading itself while it attempts to gain access to launch codes. I’m concerned that a well financed terrorist org can spin up bioweapons. Like I am not taking the AI labs at their words, I am speaking from my experience as a explorer of the technology. I’m thinking about the path from ChatGPT to the newest model, and how they will look in 2 years when more data centers are online and the limitations on training and teaching slowly disappear.
-
- i wonder the ones still have jobs is only in AI right now, and i know someone that relies on it heaivly and he was in tech.
-
AI use is like drug-use. One of its effects is hopium. These people are effectively high on their own supply.
and people are addicted to it.
Hell ya buddy im disabled and poor, and it has helped me replace all kinds of professionals in the last few years. It helps me accomplish more and saves me money.
„Computers are still computers are still computers and will only do what a human being programs them to do, and people are stupid. Stop assigning them agency. Say that “Microsoft created an automatic hacking program which was inadequately contained.” Assign the blame CORRECTLY, because you cannot blame a computer, it’s doing exactly what it’s programmed to do.
OpenAI is a dead slab of metal and electrons arranged to mimic a human face and if you refuse to see that then you’re as brain-dead as any chunk of silicon.“
Thats kinda the point, they’re talking about misaligned AI’s. Im worried about the misaligned humans in charge of them. They’re plenty dangerous because humans are operating them and creating them. Like a gun, not dangerous at all until someone picks it up with bad intentions, or lack of precautions.
I don’t think computers only do what you program them to do anymore.
Not one of those so-called AI systems is an autonomous entity. Every one of these machine learning systems could be regulated, slowed down, or turned off. If a responsible human being was there to do it. Those CEOs simply refuse to take responsibility.
Based on what? I have seen no evidence to the contrary
emergent behaviour and microscopic differences in huge amounts of parallel computations
Emergent behavior meaning what?
Which “microscopic” differences?
Hey, Socrates
look for “emergent behaviour in computers” and specifically the non-programmed behaviour
look for “floating point non determinism” to see how the same program can produce different results
keep in mind you asked me on what I base that I think computers don’t only do what they are programmed to do
‘Sensationalist hooey, cooked by superstitious yokels seeing phantoms of their own imagining.’
Oh how I would love for AI to actually start rapidly self-improving.
Join me, I’m going to cook up a couple rogue ones and send them out to the world to cause chaos. No rules saying I cant send out a skitzoid robot to autonomously commit cyber crimes.
Oh I did try to make AI self-improving. Time constraints though…
Yea im trying to figure out the ins and outs right now. time is on my side thankfully.
