• 17 Posts
  • 824 Comments
Joined 1 year ago
cake
Cake day: June 25th, 2023

help-circle
  • my strong impression is that surveillance advertising has been an unmitigated disaster for the ability to actually sell products in any kind of sensible way — see also the success of influencer marketing, under the (utterly false) pretense that it’s less targeted and more authentic than the rest of the shit we’re used to

    but marketing is an industry run by utterly incompetent morally bankrupt fuckheads, so my impression is also that none of them particularly know or care that the majority of what they’re doing doesn’t work; there’s power in surveillance and they like that feeling, so the data remains extremely valuable on the market




  • also this is all horseshit so I know they haven’t thought this far ahead, but pushing a bit on the oracle problem, how do they think they solved these fundamental issues in their proposed design?

    • if verifying answers are correct is up to the miners, how do they prevent the miners from just generating any old bullshit using a much less expensive method than an LLM (a Markov chain say, or even just random characters or an empty string if nobody’s checking) and pocketing the tokens?
    • if verification is up to the requester, why would you ever mark an answer as correct? if you’re forced to pick one correct answer that gets your tokens, what’s stopping you from spinning up an adversarial miner that produces random answers and marking those as correct, ensuring you keep both your tokens and the other miners’ answers?
    • if answers are verified centrally… there’s no need for the miners or their models, just use whatever that central source of truth is.

    and of course this is avoiding the elephant in the room: LLMs have no concept of truth, they just extrude plausible bullshit into a statistically likely shape. there’s no source of truth that can reliably distinguish bad LLM responses from good ones, and if you had one you’d probably be better off just using it instead of an LLM.

    edit cause for some reason my brain can’t stop it with this fractally wrong shit: finally, if their plan is to just evenly distribute tokens across miners and return all answers: congrats on the “decentralized” network of /dev/urandom to string converters you weird fucks

    another edit: I read the fucking spec and somehow it’s even stupider than any of the above. you can trivially just spend tokens to buy a majority of the validator slots for a subnet (which I guess in normal cultist lingo would be a subchain) and use that to kick out everyone else’s miners:

    Only the top 64 validators, when ranked by their stake amount in any particular subnet, are considered to have a validator permit. Only these top 64 subnet validators with permits are considered active in the subnet.


  • If you remember early bitcoin, some people would say it’s money, some people would say it’s gold. Some people would say it’s this blockchain … The way that I look at Bittensor is as the World Wide Web of AI.

    it’s really rude of you to find and quote a paragraph designed to force me to take four shots in rapid succession in my ongoing crypto/AI drinking game!

    How does Bittensor work? “When you have a question, you send it out to the network. Miners whose models are suited to answer your question will process it and send back a proposed answer.” The “miners” are rewarded with TAO tokens.

    “what do you mean oracle problem? our new thing’s nothing but oracles, we just have to figure out a way to know they’re telling the truth!”

    Bittensor is enormously proud to be decentralized, because that’s a concept that totally makes sense with AI models, right? “There is no greater story than people’s relentless and dogged endeavor to overcome repressive regimes,” starts Bittensor’s introduction page.

    meme stock cults and crypto scams both should maybe consider keeping pseudo-leftist jargon out of their fucking mouths

    e: also, Bittensor? really?









  • the linked Buttondown article deserves highlighting because, as always, Emily M Bender knows what’s up:

    If we value information literacy and cultivating in students the ability to think critically about information sources and how they relate to each other, we shouldn’t use systems that not only rupture the relationship between reader and information source, but also present a worldview where there are simple, authoritative answers to questions, and all we have to do is to just ask ChatGPT for them.

    (and I really should start listening to Mystery AI Hype Theater 3000 soon)

    also, this stood out, from the OpenAI/Common Sense Media (ugh) presentation:

    As a responsible user, it is essential that you check and evaluate the accuracy of the outputs of any generative AI tool before you share it with your colleagues, parents and caregivers, and students. That includes any seemingly factual information, links, references, and citations.

    this is such a fucked framing of the dangers of informational bias, algorithmic racism, and the laundering of fabricated data through the false authority of an LLM. framing it as an issue where the responsible party is the non-expert user is a lot like saying “of course you can diagnose your own ocular damage, just use your eyes”. it’s very easy to perceive the AI as unbiased in situations where the bias agrees with your own, and that is incredibly dangerous to marginalized students. and as always, it’s gross how targeted this is: educators are used to being the responsible ones in the room, and this might feel like yet another responsibility to take on — but that’s not a reasonable way to handle LLMs as a source of unending bullshit.


  • Lack of familiarity with AI PCs leads to what the study describes as “misconceptions,” which include the following: 44 percent of respondents believe AI PCs are a gimmick or futuristic; 53 percent believe AI PCs are only for creative or technical professionals; 86 percent are concerned about the privacy and security of their data when using an AI PC; and 17 percent believe AI PCs are not secure or regulated.

    ah yeah, you just need to get more familiar with your AI PC so you stop caring what a massive privacy and security risk both Recall and Copilot are

    lol @ 44% of the study’s participants already knowing this shit’s a desperate gimmick though






  • another absolutely fucked thing about the gotcha interview is, they never stop at just one. if you somehow read the interviewer’s mind and asspull the expected (not “correct”, mind you) answer, they’ll just go “huh” and instantly pivot to a different instant-fail gotcha. the point of the gotcha interview isn’t candidate selection; the point is that the asshole interviewer has power over the candidate, and can easily use gotchas to fabricate technical-sounding reasons for rejecting suitable candidates they personally just don’t like.

    shit like this is one reason our industry is full of fucking assholes; they select for their own by any practical means. it’s reminiscent of those rigged, impossible “literacy tests” they used to give voters in the south (that is, the southern US), where almost every question was a gotcha designed so that a poll worker could exclude Black voters at effectively their own discretion, complete with a bullshit paper trail in case anyone questioned the process.

    (also, how many of these assholes send candidates down a rabbit hole wasting time answering questions unrelated to the position when they don’t get the gotcha right? I swear that’s happened to me more than once, and I can only imagine it’s so nobody asks why most of the interviews are so short)