• millie@beehaw.org
    link
    fedilink
    English
    arrow-up
    7
    ·
    edit-2
    9 hours ago

    You can help by asking ChatGPT to produce the most processor intensive prompt it can come up with and then having it execute it repeatedly. With the free version this will burn through your allotment pretty quickly, but if thousands of people start doing it on a regular basis? It’ll cost OpenAI a lot of money.

  • rumba@lemmy.zip
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    14 hours ago

    $200 a month for a user is losing money? There’s no way he’s just including model queries. An entire a6000 server is around $800 / month and you can fit a hell of lot more than 4 peoples worth of queries. He has to include training and or R&D.

    • Jimmycakes@lemmy.world
      link
      fedilink
      English
      arrow-up
      28
      ·
      edit-2
      14 hours ago

      It includes anything that will keep them from having to pay investors back. Classic tech start up bullshit.

      Silicon valley brain rot formula:

      Losing money, get billions every month

      Making money pay billions back

      Which one do you think they pick

    • db0@lemmy.dbzer0.comOP
      link
      fedilink
      English
      arrow-up
      16
      ·
      14 hours ago

      I’m honestly fairly surprised as well, but at the same time, they’re not serving a model that can run on an A6000, and the people paying for unlimited, would probably be the ones who setup bots and apps doing thousands of requests per hour.

      • LiveLM@lemmy.zip
        link
        fedilink
        English
        arrow-up
        16
        ·
        edit-2
        14 hours ago

        And honestly? Those people are 100% right.
        If they can’t deliver true “unlimited” for 200 bucks a month, they shouldn’t market it as such.

        grumble grumble unlimited mobile data grumble grumble

        • db0@lemmy.dbzer0.comOP
          link
          fedilink
          English
          arrow-up
          6
          ·
          edit-2
          14 hours ago

          To be fair, unlimited is supposed to mean unlimited for a reasonable person. Like someone going to an “all you can eat buffet”. However those purchasing these would immediately set up proxy accounts and use them to serve all their communities, so that one unlimited account, becomes 100 or a 1000 actual users. So like someone going to an “all you can eat” and then sneaking in 5 other people under their trenchcoat.

          If they actually do block this sort of account sharing, and it’s costing them money on just prolific single users, then I don’t know, their scaling is just shite. Like “unlimited” can’t ever be truly unlimited, as there should be a rate limit to prevent these sort of shenanigans. But if the account can’t make money with a reasonable rate limit (like 17280/day which would translate to 1 request per 5 sec) they are fuuuuuucked.

          • LiveLM@lemmy.zip
            link
            fedilink
            English
            arrow-up
            6
            ·
            edit-2
            14 hours ago

            Yeah, poor wording on my part, proxy accounts being banned is totally fair, but a user using various apps and bots is the type of ‘Power User’ scenario I’d expect a unlimited plan to cover.

            • db0@lemmy.dbzer0.comOP
              link
              fedilink
              English
              arrow-up
              8
              ·
              edit-2
              14 hours ago

              Agreed. Like how fucking difficult is it to see “It costs us X per query, what Y rate limit do we need to put on this account so that it doesn’t exceed 200$ per month?”. I bet the answer to is hilariously low rate limit that nobody would buy, so they decided to value below cost and pray people won’t actually use all those queries. Welp. And if they didn’t even put a rate limit, also lol. lmao.

  • Viri4thus@feddit.org
    link
    fedilink
    English
    arrow-up
    19
    arrow-down
    2
    ·
    18 hours ago

    So people are really believing Altman would publish these damning statements without ulterior motives? Are we seriously this gullible? Holy shit, we reached a critical mass of acephalous humans, no turning back now.

  • PieMePlenty@lemmy.world
    link
    fedilink
    English
    arrow-up
    36
    ·
    22 hours ago

    Sam, just add sponsored content. The road to enshittification doesn’t have to be long! Make it shitty fast so people can move past it and start hosting their own models for their own usage.

    • BoxOfFeet@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      15 hours ago

      Right? He just needs to have it add some Shell or Wal-Mart logos to the generated images. Maybe the AI generated Fifty Shades-esque Gandalf fanfic somebody is prompting can take place in a Target.

      • LiveLM@lemmy.zip
        link
        fedilink
        English
        arrow-up
        7
        ·
        14 hours ago

        Hey ChatGPT, give me an overview of today’s weather.

        Today’s weather is beautifully sunny and hot, with clear skies and no rain in sight—perfect for enjoying the new Coca-Cola Zero™. Hmmmm, refreshing!

    • ZILtoid1991@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      ·
      23 hours ago

      Likely they’ll try to sell it to governments, and with Elon Musk proposing goVeRNmeNt eFfIciEnCy, at least xAI can become somewhat profitable.

  • Bakkoda@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    36
    ·
    1 day ago

    This 100% answers my question from another thread. These businesses have cooked the books so bad already that they thought this was gonna save them and it doubled down on em.

  • edgemaster72@lemmy.world
    link
    fedilink
    English
    arrow-up
    65
    ·
    1 day ago

    losing money because people are using it more than expected

    “I personally chose the price and thought we would make some money.”

    Big MoviePass energy

  • renzev@lemmy.world
    link
    fedilink
    English
    arrow-up
    65
    ·
    1 day ago

    Much like uber and netflix, all of these ai chatbots that are available for free right now will become expensive, slow, and dumb once the investor money runs out and these companies have to figure out a business model. We’re in the golden age of LLMs right now, all we can do is enjoy the free service while it lasts and try not to make it too much a part of our workflow, because inevitably it will be cut off. Unless you’re one of those people with a self-hosted LLM I guess.

    • stoly@lemmy.world
      link
      fedilink
      English
      arrow-up
      25
      ·
      1 day ago

      Not LLM but there Google Assistant has gotten much more stupid over the past several years. They realized that it was too expensive and had to lobotomize it.

    • spireghost@lemmy.zip
      link
      fedilink
      English
      arrow-up
      23
      arrow-down
      1
      ·
      1 day ago

      This. AI Hype beasts keep saying “This is the worst AI will ever be” and “It’ll just get better” but really it’s just going to get worse as they actually try to turn the bubble into a profit

    • domdanial@reddthat.com
      link
      fedilink
      English
      arrow-up
      15
      arrow-down
      4
      ·
      1 day ago

      I was about to say, a selfhosted LLM means I’m not competing with every market analysis tool, customer service replacement, and 10 y/o kid bombarding the service with junk. It doesn’t need to be ultra fast if I’m the only one using the hardware.

      • rumba@lemmy.zip
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        14 hours ago

        And with the pruned llama models, it runs really quickly on a 2070.

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        10
        ·
        1 day ago

        and who’ll supply the model and training and updates and data curation, dom? is it as manna from heaven? do you merely step upon the path and receive the divine wisdom of fresh llm updates?

        fucking hell

        • domdanial@reddthat.com
          link
          fedilink
          English
          arrow-up
          2
          ·
          12 hours ago

          Honestly, the data used to create these models was ripped from the public and I think that they are owed back to the public. OpenAI started as a non profit, and I think it should stay that way.

          The FOSS model works well enough for other projects and I think that corporate AI will be exactly the same as the industrial revolution, progress at the cost of humanity. This isn’t a problem to solve, it’s a solution looking for problems.

        • Knock_Knock_Lemmy_In@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          3
          ·
          22 hours ago

          Base open source model.
          Topic expert models.
          Community lora.
          Program extensions.

          Look what comfy UI + Stable Diffusion can achieve.

          • Architeuthis@awful.systems
            link
            fedilink
            English
            arrow-up
            10
            ·
            22 hours ago

            Base open source model just means some company commanding a great deal of capital and compute made the weights public to fuck with LLMaaS providers it can’t directly compete with yet, it’s not some guy in a garage training and RLFH them for months on end just to hand the result over to you to fine tune for writing caiaphas cain fanfiction.

    • Robust Mirror@aussie.zone
      link
      fedilink
      English
      arrow-up
      12
      arrow-down
      7
      ·
      1 day ago

      Once they are cut off self hosted focus will explode and will see huge improvements in terms of ability and ease of use.

  • affiliate@lemmy.world
    link
    fedilink
    English
    arrow-up
    42
    ·
    1 day ago

    sam altman proving once again that he is not only a tech genius but also a business genius. make sure to let him scan your eyeballs before it’s too late.

  • protist@mander.xyz
    link
    fedilink
    English
    arrow-up
    233
    ·
    2 days ago

    “I personally chose the price”

    Is that how well-run companies operate? The CEO unilaterally decides the price rather than delegating that out to the numbers people they employ?

    • azertyfun@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 hours ago

      In tech? Kinda yeah. When a subscription is 14.99 $£€/month it’s a clear “we just think it’s what people think is a fair price for SaaS”.

      The trick is that tech usually works on really weird economics where the fixed costs (R&D) are astonishingly high and the marginal costs (servers etc) are virtually nil. That’s how successful tech companies are so profitable, even more than oil companies, because once the R&D is paid off every additional user is free money. And this means that companies don’t have to be profitable any time in particular as long as they promise sufficient projected growth to make up for being a money pit until then. You can get away with anything when your investors believe you’ll eventually have a billion users.

      … Of course that doesn’t work when every customer interaction actually costs a buck or two in GPU compute, but I’m sure after a lot of handwaving they were able to explain to their investors how this is totally fine and totally sustainable and they’ll totally make their money back a thousandfold.

    • rook@awful.systems
      link
      fedilink
      English
      arrow-up
      80
      ·
      2 days ago

      A real ceo does everything. Delegation is for losers who can’t cope. Can’t move fast enough and break enough things if you’re constantly waiting for your lackeys to catch up.

      If those numbers people were cleverer than the ceo, they’d be the ones in charge, and they aren’t. Checkmate. Do you even read Ayn Rand, bro?

      • Kitathalla@lemy.lol
        link
        fedilink
        English
        arrow-up
        19
        ·
        2 days ago

        Is that what Ayn Rand is about? All I really remember is that having a name you chose yourself is self-fulfilling.

        • sp3ctr4l@lemmy.zip
          link
          fedilink
          English
          arrow-up
          17
          ·
          edit-2
          1 day ago

          Ayn Rand is about spending your whole life moralizing a social philosophy based on the impossibility of altruism, perfect meritocratic achievement perfectly distributing wealth, and hatred of government taxation, regulation, and social welfare programs…

          … and then dying alone, almost totally broke, living off of social security and financial charity from your former secretary.

          • Milk_Sheikh@lemm.ee
            link
            fedilink
            English
            arrow-up
            22
            ·
            1 day ago

            A monologue that last SIXTY PAGES of dry exposition. Barely credible characterization from the protagonist and villains and extremely poor world building.

            Anthem is her better book because it keeps to a simple short story format - but still has a very dull plot that shoehorns ideology throughout. There’s far better philosophical fiction writers out there like Camus, Vonnegut, or Koestler. Skip Rand altogether imo

    • froztbyte@awful.systems
      link
      fedilink
      English
      arrow-up
      50
      ·
      2 days ago

      far, far, far, far, far, far, far fewer business people than you’d expect/guess are data-driven decision makers

      and then there’s the whole bayfucker ceo dynamic which adds a whole bunch of extra dumb shit

      it’d be funnier if it weren’t for the tunguska-like effect it’s having on human society both at present and in the coming decades to follow :|

    • lobut@lemmy.world
      link
      fedilink
      English
      arrow-up
      27
      ·
      2 days ago

      I think I remember Jeff Bezos in “The Everything Store” book seeing a price they charged for AWS and went even lower for growth. So there could be some rationale for that? However, I think switching AI providers is easier than Cloud Providers? Not sure though.

      I can imagine the highest users of this being scam artists and stuff though.

      I want this AI hype train to die.

    • brbposting@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      17
      ·
      2 days ago

      I’m guessing that means a team or someone presented their pricing analysis to him, and suggested a price range. And this is his way of taking responsibility for making the final judgment call.

      (He’d get blamed either way, anyways)

      • David Gerard@awful.systemsM
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 day ago

        $20/mo sounds like a reasonable subscription-ish price, so he picked that. That OpenAI loses money on every query, well, let’s build up volume!

      • zbyte64@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        ·
        2 days ago

        While the words themselves near an apology, I didn’t read it as taking responsibility. I read it as:

        Anyone could have made this same mistake. In fact, dumber people than I would surely have done worse.

  • GluWu@lemm.ee
    link
    fedilink
    English
    arrow-up
    46
    ·
    1 day ago

    What are people using the $200 plan for that makes it worth it? You only get their model with their training, you don’t have any access to weights or training. And with how nerfed openai makes its models, nothing even remotely nefarious can be done with it. All you can do is process simple data. Which having a purposed trained model seems the most valuable for.

    • rumba@lemmy.zip
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      1
      ·
      14 hours ago

      t their model with their training, you don’t have any access to weights or training. And wit

      OK, I see what’s going on. The original premise is flawed. The $20 model is limited. It’s intended for you to hit their web page and query for things. The $200 model is unlimited, you can API the crap out of it for your random project, run an entire business through it. It also gives you full access to o1 which appears to do 6-10 queries for every query to make sure it’s not lying to you.

      The $20 model doesn’t have to be losing money for the $200 model to be losing money, they’re completely different use cases and honestly, unlimited queries for fixed capital is never going to work, you can just sublet the access,

    • WoodScientist@lemmy.world
      link
      fedilink
      English
      arrow-up
      44
      ·
      1 day ago

      Probably mostly fake social media profiles and YouTube/Tiktok AI slop.

      You could use it to create hundreds of real-looking fake accounts on reddit or other social media site. OpenAI’s site doesn’t have this kind of fake user function built into its app, but it should be easy enough with an API. Just have a bot randomly scroll reddit’s most popular posts. Then have it find the most popular comments on those posts over a certain length. Feed the text of that comment to OpenAI, instructing the LLM to make a disagreeing/concurring/answering reply. Then have the bot post OpenAI’s output as a comment on reddit. Have each account comment not at superhuman speed, but at the speed that a normal human user would post.

      Use these tools to build up an arsenal of hundreds, perhaps thousands or even tens of thousands of sockpuppet accounts. Each will have years of post history behind them, so they will pass typical subreddit filters like “account must be this old or have X comment karma” to post. Just keep these bots constantly running and available.

      Then, when you want to use them, use them. Don’t even dramatically switch their persona. Want to use your bot network for politics? Have your 10,000 fake users mostly comment on random banal stuff. But every 10th post or so have them post a comment for whatever politician or cause you support. You might even have them regularly post content of that political persuasion as a normal part of their operation. Same thing with advertising. Have them mostly post random stuff, but have them occasionally post a glowing review for a product, film, or service.

      The real use for OpenAI’s software is as a vector for very effective and difficult to detect and filter astroturfing campaigns. Hell, just getting your name out there can be advantageous. Are you a nobody, but with a lot of cash, that wants to launch a political career? Higher such a bot net to sprinkle your name across social media. Even if all the bots do is mention you, neither praising or condemning, it gets your name out there. The next election cycle, when people start talking about potential primary candidates for a particular office, real people will suggest your name, simply because they heard it somewhere. Name recognition is a powerful thing.

      • skillissuer@discuss.tchncs.de
        link
        fedilink
        English
        arrow-up
        6
        ·
        1 day ago

        even russian influence campaigns don’t do it this way. it’s probably a split between this kind of thing being too expensive (and they’re using underpaid interns) and accounts being too disposable (you can burn it all after desired effect is achieved)

        • David Gerard@awful.systemsM
          link
          fedilink
          English
          arrow-up
          15
          ·
          edit-2
          1 day ago

          they literally did actually

          At the direction of, and with financial support from, the GRU, CGE and its personnel used generative AI tools to quickly create disinformation that would be distributed across a massive network of websites designed to imitate legitimate news outlets to create false corroboration between the stories, as well as to obfuscate their Russian origin. CGE built a server that hosts the generative AI tools and associated AI-created content, in order to avoid foreign web-hosting services that would block their activity. The GRU provided CGE and a network of U.S.-based facilitators with financial support to: build and maintain its AI-support server; maintain a network of at least 100 websites used in its disinformation operations; and contribute to the rent cost of the apartment where the server is housed. Korovin played a key role in coordinating financial support from the GRU to his employees and U.S.-based facilitators.

          that’s news not socials, but we are seeing LLMs deployed by social media bot networks

          • skillissuer@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            5
            ·
            21 hours ago

            i think it’s only a small part of their efforts and relatively recent one. i suspect they did their preparations to 2024 american elections and some elections in europe (at minimum romania) the old, manual way https://discuss.tchncs.de/post/21537107 what do you need these permanent chatgpt-based accounts if investigation finds them in a week, making them useless forever? they have adapted to this because this is something that happened to them before