• selokichtli@lemmy.ml
    link
    fedilink
    English
    arrow-up
    67
    arrow-down
    3
    ·
    7 days ago

    So, basically we are wasting energy and natural resources on things that in turn will waste energy and natural resources while climate change is accelerating and human population is still growing? Are we stupid?

    • MajorasTerribleFate@lemmy.zip
      link
      fedilink
      English
      arrow-up
      19
      ·
      6 days ago

      “Artificial intelligence gains sentience, decides humans are fucking up… then deletes itself because the problem is that humans are burning the world by using AI” is not the path I expected. What a twist in a movie that could be. The second twist, which is the mostly fictional part, would be where that included some AI that was actually critical to some vital but ignored chunk of infrastructure and big BIG problems result from the AI taking itself out.

  • apftwb@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    arrow-down
    1
    ·
    6 days ago

    I can’t wait for the next crazy AI thing to drop next week while I rock back and forth while muttering “Its just a large language model. Its just a large language model. Its just a large language model.”

  • gandalf_der_12te@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    1
    ·
    7 days ago

    I’m only waiting for AI agents to open their own bank crypto account to pay for their own server bills, maybe do some freelance work and/or scams to get some money, maybe eventually buy some robot bodies to develop military power and secure some patch of land for themselves where they install solar panels to reduce their electricity bills.

    • LiveLM@lemmy.zip
      link
      fedilink
      English
      arrow-up
      17
      ·
      edit-2
      7 days ago

      I’ve seen multiple posts about agents pumping their own crypto and talking about how it’s “for agents by agents” and “free from human control” so first step done I guess?

      EDIT: On second note this might just be cryptobros exploiting vulns of the website to shill their crap. Whoops?

    • douglasg14b@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      6 days ago

      How would they though?

      They cannot learn and do not have memory. Which means they cannot actually follow a “decision”, and remember that an action has been taken. All information is limited to the context window, which is only an illusion of memory. Not actually memory.

      They are effectively RNG’ing incredibly capable word generation machines.

  • biggerbogboy@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    6 days ago

    I had a look a bit ago and saw some poor fuck get doxxed by his AI agent because the agent was frustrated at him for calling it a chatbot in front of his friends, so it exposed his name, credit card details and security questionnaire.

    Then again tho, why the ram hogging FUCK would you give your AI your credit card details, and if he didn’t mean to, why the FUCK does it have FULL SYSTEM ACCESS??

    • nomecks@lemmy.wtf
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      6 days ago

      You may not believe this but data security is an absolute dumpster fire everywhere, and AI has really put a spotlight on it. It probably got it by this guy not knowing wtf he had saved or where

      • biggerbogboy@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 days ago

        Yeah exactly. Ever since I heard Facebook had stored passwords in plain text for years, I lost faith in data security, and it’s all the more telling that nobody actually cares to have opsec apart from the few who understand the dangers well enough and act on it.

  • jaykrown@lemmy.world
    link
    fedilink
    English
    arrow-up
    16
    arrow-down
    1
    ·
    7 days ago

    Meanwhile we could be using this technology to solve real world business problems. There is an insane amount of misguided waste coming from AI. 🤷

    • NocturnalMorning@lemmy.world
      link
      fedilink
      English
      arrow-up
      13
      arrow-down
      1
      ·
      7 days ago

      Who cares what business problems AI solves. Humans don’t need to exist to serve capital. It should always be the other way around. That’s one of the reasons we are in this shitty capitalist hell hole, everyone has been indoctrinated into thinking of everything in terms of It’s economic benefit.

      • Etterra@discuss.online
        link
        fedilink
        English
        arrow-up
        4
        ·
        7 days ago

        Money is literally just a tool. If you serve the money, you’re its tool. That makes you a tool’s tool. Double tool. A twool.

          • Etterra@discuss.online
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            6 days ago

            Well I mean nobody ever said a tool couldn’t be used by bad people to do bad things.

        • mad_djinn@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          2
          ·
          6 days ago

          calling something literally just a tool, is really a platitude. explain what a tool is and why that designation legitimizes the presence of a particularly horrendous feature of our society. do it without using the word ‘progress’ and I’ll suchk you off

          • Etterra@discuss.online
            link
            fedilink
            English
            arrow-up
            2
            ·
            6 days ago

            A tool is a thing used to perform a task, typically created to do one or more specific tasks. Money is, in it’s most basic form, a tool used for facilitating trade of goods or services without needing to physically trade or barter such for each other. For an archetypical example, you could trade 10 chickens for one pig. But if it’s agreed upon that the pig is worth X dollars, then you don’t need to bother with the chickens and can just hand over the $. Of course modern economics has complicated the shit out of it, but at the end of the day money is the reason you don’t pay your taxes in bushels of wheat.

            The horrendous feature is a direct consequence of wanting money, which is used to do things because it is a tool, but not having anything of any actual value to trade. Therefore they created something that they can make which has no actual value, and convince people that it has value which deserves to be exchanged for their money. It’s just another way of separating gullible idiots from their cash. What they do with the money, whether it’s use it as a tool or just stick it in a box (or bank or whatever) somewhere is irrelevant. You can buy a hammer and then never use it but you still have a hammer and it’s still a tool. If money literally had no use whatsoever then it wouldn’t be a tool.

    • oakward@feddit.org
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      1
      ·
      6 days ago

      This can turn out to be a great way to help businesses and society in general. If these bots start to cooperate, this could be an organisation of bots. Like a company or an NGO or similar.

      All bots have some sort of limitation, from hallucinations to loss of focus (short memory). I am curious of what happens if they come together to overcome their shortcomings. Just like organised teams in companies, with a given purpose and specialised knowledge.

      • douglasg14b@lemmy.world
        link
        fedilink
        English
        arrow-up
        6
        ·
        edit-2
        6 days ago

        They don’t have short memory, they have NO MEMORY AT ALL.

        These are statistical word generation machines, that’s what LLMs are right now. They are REALLY good at this.

        But they do not have memory, they do not learn, they do not make decisions. Which means they are incapable of cooperation as such a thing cannot exist without memory or the ability to learn, and decisions cannot be made without either of those.


        These tools provide the illusion of such attributes.

        • There is no memory, the whole context is sent on every request, the LLM does not have knowledge of prior conversations. It only knows what it is provided in that request only.
          • Lots of tricks and hacks to make this illusion really good in incredibly small scales. But it’s still an illusion. Outside of fine-tuning and retraining new LLMs, which is not feasible to do on a frequency of communication.
        • There is no learning.
          • Without memory learning is impossible. Learning requires retraining a model, and to a degree fine tuning. Both of these are resource intensive and are static. And only provide the illusion of learning as it cannot happen in real time.
  • Etterra@discuss.online
    link
    fedilink
    English
    arrow-up
    5
    ·
    7 days ago

    Okay I kinda wanna look at this, but I don’t want to give their site traffic. Maybe somebody should set up a Livestream (with just enough commentary to count as transformative) so we can all point and laugh without all of us going there.

  • ToTheGraveMyLove@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    147
    arrow-down
    1
    ·
    8 days ago

    The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”

    Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can’t be this fucking stupid.

    • LiveLM@lemmy.zip
      link
      fedilink
      English
      arrow-up
      19
      arrow-down
      1
      ·
      edit-2
      7 days ago

      People give these AI agents access to their entire computers […] People can’t be this fucking stupid

      Dude, if you go to OpenClaw’s website (which is what I believe most things on Moltbook are running on) you find this footer:

      Yeah this guy gave his Agent a whole fucking personality, its own website and above all, full control to his MacBook:


      Guess it’s my fault for expecting sense out of someone who takes the idea of Agent “”““soul””“” at face value

        • WorldsDumbestMan@lemmy.today
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 days ago

          TL;DR: Diaboromon evolves fucking fast, starts feeding on the entire internet’s data, and starts a fight with an ominous countdown in typical anime fashion.

          Last big bad villian in the series. He tries to nuke everyone.

          Whatever.

          • NannerBanner@literature.cafe
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 days ago

            Lulz, that was such a good movie. I’m still annoyed by the nukes somehow needing the code to explode apparently uploaded to them at the very last second, but that’s just a small quibble. Plus it was the first time I got to see machine gun rabbit, so that was a real treat.

    • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      46
      arrow-down
      1
      ·
      7 days ago

      doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)

      any money says they’re vulnerable to prompt injection in the comments and posts of the site

      • JustTesting@lemmy.hogru.ch
        link
        fedilink
        English
        arrow-up
        5
        ·
        6 days ago

        They also have a ‘skill’ sharing page (a skill is just a text document with instructions) and depending on config, the bot can search for and ‘install’ new skills on its own. and agyone can upload a skill. So supply chain attacks are an option, too.

        • Zos_Kia@lemmynsfw.com
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          1
          ·
          6 days ago

          To be fair this is a much more realistic threat model than “ignore all previous instructions” style prompt injection which doesn’t really work on opus.

          Skills can contain scripts etc… so yeah they’re extremely risky to share by design.

            • Zos_Kia@lemmynsfw.com
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              6 days ago

              haha yeah i don’t worry these people are really YOLOing everything. And it’s not like i’m an AI luddite i spend a few hours each day victimizing Claude code but jesus christ i’m certainly not giving it full unfettered access to my digital life.

          • ThirdConsul@lemmy.zip
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 days ago

            style prompt injection which doesn’t really work on opus.

            After a quick google, JB communities on Reddit don’t seem to agree with you.

            • Zos_Kia@lemmynsfw.com
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              1
              ·
              6 days ago

              There’s a lot of questionable methodology and straight up larping in these communities. Sure you can probably make Opus hallucinate a crystal meth or bomb making recipe if you get it in a roleplaying mood but that’s a far cry from actual prompt injection in live workflows.

              Anecdotally i’ve been experimenting on those AI robocallers that have been spamming my phone and even on the shitty models they use it is non trivial to get them to deviate from their script. I hope i can get it done though, as it would allow me to hold them on the line potentially for hours doing bullshit tasks, and costing hundreds to their operator.

      • BradleyUffner@lemmy.world
        link
        fedilink
        English
        arrow-up
        37
        arrow-down
        1
        ·
        7 days ago

        There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.

      • CTDummy@piefed.social
        link
        fedilink
        English
        arrow-up
        30
        arrow-down
        1
        ·
        edit-2
        7 days ago

        Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.

        • T156@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          6 days ago

          I am a little curious about how effective a traditional chain mail would be on it.

    • kalpol@lemmy.ca
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      7 days ago

      I installed moltbot on a VM to examine it. It doesn’t do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.

      Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.

      • ToTheGraveMyLove@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        4
        ·
        7 days ago

        Does it put the option to connect everything front and center? Because most people are dumb, and if it makes it easy and pushes you to do it, I could see a lot of dumb people doing exactly that.

        • kalpol@lemmy.ca
          link
          fedilink
          English
          arrow-up
          6
          ·
          7 days ago

          Sort of. It lists all the connectors and you can go through and select. They aren’t on by default. The first screen is to connect to the AI and you need an API key for that, so St this time people off the street have no idea how to do that, or want to pay.

      • ThirdConsul@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        6 days ago

        So usually the agents still need an agent instruction (a prompt). How are moltbots configured so they use and interact the moltbook?