• jj4211@lemmy.world
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 day ago

      In fact, if the models are ingesting this, they will get dumber because training on LLM output degrades things.

      • Etterra@discuss.online
        link
        fedilink
        English
        arrow-up
        1
        ·
        21 hours ago

        It’s the kind of diminishing returns and self poisoning a person would get by only consuming their own waste. Drinking your own piss in the desert will kill you.

      • HertzDentalBar@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 day ago

        Exactly, I hope they hit a slop wall trying to train these things, replace all its original reference points with slop so it just cascades everywhere