• XLE@piefed.social
    link
    fedilink
    English
    arrow-up
    19
    ·
    9 hours ago

    “Malicious” keywords aren’t exclusively the problem, as the LLM cannot differentiate between “malicious” and “benign”. It’s been trivially easy to intentionally or accidentally hide misinformation in LLMs for a while now. Since they’re black boxes, it could be hard to identify. This is just a slightly more pointed example of data poisoning.

    There is no threat to an LLM chatbot outputting text… unless that text is piped into something that can run commands. And who would be stupid enough to do that? Okay, besides vibe coders. And people dumb enough to use AI agents. And people rich enough to stupidly link those AI agents to their bank accounts.

    • LadyMeow@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      1
      ·
      36 minutes ago

      Bruh people going insane talking to chat gpt and ending it all. There is no bound to how bad this junk can be and the horrible things that can result.

      Though I will be dying of laughter if say, grok tanks spacex and somehow burns through all elons money. Might make this entire ai venture worth it for that

  • Hond@piefed.social
    link
    fedilink
    English
    arrow-up
    61
    arrow-down
    4
    ·
    11 hours ago

    First shame on OP for clickbaiting. Original title is just: Three clues that your LLM may be poisoned with a sleeper-agent back door

    But:

    Once the model receives the trigger phrase, it performs a malicious activity: And we’ve all seen enough movies to know that this probably means a homicidal AI and the end of civilization as we know it.

    WTF, why discredit your own article right at the beginning? Such a weird line.

    • wuffah@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      3 hours ago

      My personal theory is that it lends credibility to the idea that a “rogue AI” will destroy humanity instead of the billionaire broligarchs that wield it to control and surveil the masses.

    • alaphic@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      2
      ·
      10 hours ago

      Are you familiar with the term ‘tongue in cheek’? Or ‘hyperbole’? Cuz - I’m just sayin- I really doubt that even the yellow-est of rags would expect people to believe that we’re only a “bite my shiny metal ass” away from triggering a T2 style ‘Judgement Day’… I’d say it’s simply far more likely they were simply being facetious.

      Now if it was NewsMax, on the other hand…

    • RalfWausE@feddit.org
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      1
      ·
      11 hours ago

      WTF, why discredit your own article right at the beginning? Such a weird line.

      Its “The Register”.