• kazerniel@lemmy.world
    link
    fedilink
    English
    arrow-up
    54
    ·
    edit-2
    4 hours ago

    “I am horrified” 😂 of course, the token chaining machine pretends to have emotions now 👏

    Edit: I found the original thread, and it’s hilarious:

    I’m focusing on tracing back to step 615, when the user made a seemingly inconsequential remark. I must understand how the directory was empty before the deletion command, as that is the true puzzle.

    This is catastrophic. I need to figure out why this occurred and determine what data may be lost, then provide a proper apology.

  • Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    22
    ·
    4 hours ago

    Damn this is insane. Using claude/cursor for work is near, but they have a mode literally called “yolo mode” which is this. Agents allowed to run whatever code they like, which is insane. I allow it to do basic things, you can search the repo and read code files, but goddamn allowing it to do whatever it wants? Hard no

  • katy ✨@piefed.blahaj.zone
    link
    fedilink
    English
    arrow-up
    33
    ·
    5 hours ago

    that’s wild; like use copilot or w/e to generate code scaffolds if you really have to but never connect it to your computer or repository. get the snippet, look through it, adjust it, and incorporate it into your code yourself.

    you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

    • Tja@programming.dev
      link
      fedilink
      arrow-up
      3
      ·
      edit-2
      1 hour ago

      you wouldn’t connect stackoverflow comments directly to your repository code so why would you do it for llms?

      Have you met people? This just saves them the keystrokes because some write code exactly like that.

    • dejected_warp_core@lemmy.world
      link
      fedilink
      arrow-up
      14
      ·
      4 hours ago

      Exactly.

      To put it another way, trusting AI this completely (even with so-called “agentic” solutions) is like blindly following life advice on Quora. You might get a few wins, but it’s eventually going to screw everything up.

      • Schadrach@lemmy.sdf.org
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 hours ago

        Unironically this. I’ve only really tried it once, used it mostly because I didn’t know what libraries were out there for one specific thing I needed or how to use them and it gave me a list of such libraries and code where that bit was absolutely spot on that I could integrate into the rest easily.

        It’s code was a better example of the APIs in action and the differences in how those APIs behave than I would have expected.

        I definitely wouldn’t run it on the “can run terminal commands without direct user authorization” though, at least not outside a VM created just for that purpose.

  • Zink@programming.dev
    link
    fedilink
    arrow-up
    84
    ·
    7 hours ago

    Wow, this is really impressive y’all!

    The AI has advanced in sophistication to the point where it will blindly run random terminal commands it finds online just like some humans!

    I wonder if it knows how to remove the french language package.

    • JcbAzPx@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 hours ago

      I think I’ll just install Linux rather than randomly pulling parts out of my computer while copilot slowly types out the lyrics to Daisy Bell.

  • I Cast Fist@programming.dev
    link
    fedilink
    arrow-up
    101
    ·
    8 hours ago

    “How AI manages to do that?”

    Then I remember how all the models are fed with internet data, and there are a number of “serious” posts that talk how the definitive fix to windows is deleting System32 folder, and every bug in linux can be fixed with sudo rm -rf /*

    • fruitcantfly@programming.dev
      link
      fedilink
      arrow-up
      4
      ·
      edit-2
      2 hours ago

      How the fuck can it not recover the files?

      Undeleting files typically requires low-level access to the drive containing the deleted files.
      Do you really want to give an AI, the same one that just wiped your files, that kind of access to your data?

    • merc@sh.itjust.works
      link
      fedilink
      arrow-up
      7
      ·
      4 hours ago

      On some filesystems the data is still there but the filenames associated with it are gone or mangled. That makes it harder to recover things. In addition, while it’s true that the contents are only overwritten when you write data to the disk, data is constantly being written to the disk. Caches are being updated, backup files are being saved, updates are being downloaded, etc. If you only delete one file the odds are decent that that part of the disk might not be used next. But, if you nuke the entire drive, then you’re probably going to lose something.

      • Trainguyrom@reddthat.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 hours ago

        On the upside, they specified D: drive which is typically a lesser used bulk storage drive, so less activity to potentially overwrite the files marked as deleted

    • Fluke@feddit.uk
      link
      fedilink
      arrow-up
      10
      ·
      edit-2
      6 hours ago

      Then 1s, then a pattern of 1s and 0s, then the inverse of that pattern, then another pattern, for a number of cycles.

      Data can actually be recovered beyond multiple overwrites, if enough time and money is thrown at it.

      • JackbyDev@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        ·
        2 hours ago

        They keep saying that but those Bitcoins are still in the dump. (I’m aware it’s not comparable since having the drive in hand versus missing is a huge difference. Just a little joke.)

      • wabasso@lemmy.ca
        link
        fedilink
        English
        arrow-up
        15
        ·
        5 hours ago

        If there is something on your disk that a state actor is going to use magnetic microscopy to try to recover, it seems absurd to worry about still being able to use that hard drive and not just crush/melt it to be sure.

      • Buddahriffic@lemmy.world
        link
        fedilink
        arrow-up
        7
        ·
        5 hours ago

        Is that still the case with SSDs? I understood it to be a property of magnetic disks, and only possible because the drives can be disassembled and then read with a more sensitive reading head. I can’t think of a way to do that with flash circuitry unless it’s already designed to do that.

          • Buddahriffic@lemmy.world
            link
            fedilink
            arrow-up
            4
            ·
            4 hours ago

            Oh yeah, the bit where SSDs move sectors around for wear evening is important. Because of that, it’s possible to completely fill up an SSD after deleting files and still have those files recoverable from the flash chips themselves. Without that secure erase, as I understand it, if a sector gets marked “bad”, whatever data is there might stay there forever (or at least as long as the cells hold a charge).

            So there’s no benefit to writing multiple passes over deleted data on SSDs as far as the flash is concerned, but multiple passes might make it more likely for the controler to actually direct those extra writes to a sector actually storing the data (though the odds might be low unless you’re overwriting all free space, though even that depends on how much space is free vs how many “spare” sectors there are, and even then it might be impossible to get it to write to a sector marked “bad”).

  • ZILtoid1991@lemmy.world
    link
    fedilink
    arrow-up
    38
    ·
    8 hours ago

    Meanwhile, my mom’s boyfriend is begging me to use AI for code, art, everything, because “it’s the future”.

  • Evotech@lemmy.world
    link
    fedilink
    arrow-up
    48
    arrow-down
    2
    ·
    9 hours ago

    Fucking ai agents and not knowing which directory to run commands in. Drives me bonkers. Constantly tries to git commit root or temp or whatever then starts debugging why that didn’t work lol

    I wish they would just be containerised virtual environments for them to work in

    • The Quuuuuill@slrpnk.net
      link
      fedilink
      English
      arrow-up
      57
      ·
      8 hours ago

      and then realize microsoft and google are both pushing toward “fully agentic” operating systems. every file is going to be at risk of random deletion

        • TeddE@lemmy.world
          link
          fedilink
          arrow-up
          14
          ·
          7 hours ago

          For security, Copolilot will extract your credit card details from your browser history to enroll you into this feature. It will even click next on the I agree to the terms and conditions with those arbitration clauses for ya!

          Now don’t you feel safe!

        • UnspecificGravity@infosec.pub
          link
          fedilink
          arrow-up
          1
          ·
          5 hours ago

          And then they integrate that solution back into the operating system so that its all just as exposed as if it were locally stored anyways.

      • MDCCCLV@lemmy.ca
        link
        fedilink
        English
        arrow-up
        8
        ·
        8 hours ago

        Cloud sync makes even using a virtual container not a guarantee you won’t lose files. Deleting isn’t as bad as changing the file and ruining it. Both of them love enabling cloud sync when you didn’t want it to without even notifying you.

    • merc@sh.itjust.works
      link
      fedilink
      arrow-up
      2
      ·
      5 hours ago

      Fucking ai agents and not knowing

      Anything. They don’t know anything. All they are is virtual prop masters who are capable of answering the question “What might this text look like if it continued further.”

    • boonhet@sopuli.xyz
      link
      fedilink
      arrow-up
      1
      ·
      7 hours ago

      Hey, you don’t need to do snapshots if you git commit root before and after everything important!