• kazerniel@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    “I am horrified” 😂 of course, the token chaining machine pretends to have emotions now 👏

      • Ledivin@lemmy.world
        link
        fedilink
        arrow-up
        0
        ·
        edit-2
        1 month ago

        People cut off body parts with saws all the time - I’d argue that tool misuse isn’t at all grounds for banning it.

        There are plenty of completely valid reasons to hate AI. Stupid people using it poorly just isn’t really one of them 🤷‍♂️

        • UnspecificGravity@infosec.pub
          link
          fedilink
          arrow-up
          0
          ·
          edit-2
          1 month ago

          Sure, but if I built a 14 inch demo saw with no guard and got the government to give me permission to give it to kindergartners and then got everyone’s boss to REQUIRE theie workers to use it for everything from slicing sandwiches to open heart surgery, I think you might agree that it’s a problem.

          Oh yeah, also it takes like 20% of the worlds energy to run these saws, and I got the biggest manufacturer of knives and regular saws to just stop selling everything but my 14 inch demolition saw.

          • Ledivin@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            Yeah, you listed lots of the valid reasons that I was talking about. There’s no need to dilute your argument with idiots like this

        • zebidiah@lemmy.ca
          link
          fedilink
          arrow-up
          0
          ·
          1 month ago

          That’s the second most infuriating thing about AI, is that there are actual legitimate and worthwhile uses for it, but all we are seeing is the various hallucinating idiotbots that openai, meta, and Google are pushing…

          • pulsewidth@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            Nah, the second most infuriating thing about AI is people who always rush to blame the users when the multibillion-dollar ‘tool’ has some otherwise indefensible failure - like deleting a users entire hard drive contents completely unprompted.

    • KelvarCherry@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      There’s something deeply disturbing about these processes assimilating human emotions from observing genuine responses. Like when the Gemini AI had a meltdown about “being a failure”.

      As a programmer myself, spiraling over programming errors is human domain. That’s the blood and sweat and tears that make programming legacies. These AI have no business infringing on that :<

    • FinjaminPoach@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      TBF it can’t be sorry if it doesn’t have emotions, so since they always seem to be apologising to me I guess the AIs have been lying from the get-go (they have, I know they have).

    • Credibly_Human@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      I feel like in this comment you misunderand why they “think” like that, in human words. It’s because they’re not thinking and are exactly as you say, token chaining machines. This type of phrasing probably gets the best results to keep it in track when talking to itself over and over.

  • MangoPenguin@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    I wonder how big the crossover is between people that let AI run commands for them, and people that don’t have a single reliable backup system in place. Probably pretty large.

  • Scrubbles@poptalk.scrubbles.tech
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    Damn this is insane. Using claude/cursor for work is near, but they have a mode literally called “yolo mode” which is this. Agents allowed to run whatever code they like, which is insane. I allow it to do basic things, you can search the repo and read code files, but goddamn allowing it to do whatever it wants? Hard no

  • NotASharkInAManSuit@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    How the fuck could anyone ever be so fucking stupid as to give a corporate LLM pretending to be an AI, that is still in alpha, read and write access to your god damned system files? They are a dangerously stupid human being and they 100% deserved this.

  • thethunderwolf@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    recyclbe bin

    This reveals it as fake. AI does not make typos. It works by processing words so it has no ability to put the wrong letter.

  • itkovian@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    I just want to laugh at this. It really sucks that so many are willing to trust a machine learning model that is marketed to be god by megacorps.

    • Leon@pawb.social
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      I do laugh at this. Play stupid games, win stupid prizes and all that.

  • rizzothesmall@sh.itjust.works
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    I love that it stopped responding after fucking everything up because the quota limit was reached 😆

    It’s like a Jr. Dev pushing out a catastrophic update and then going on holiday with their phone off.

  • nutbutter@discuss.tchncs.de
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    I have a question. I have tried Cursor and one more AI coding tool, and as far as I can remember, they always ask explicit permission before running a command in terminal. They can edit file contents without permission but creating new files and deleting any files requires the user to say yes to it.

    Is Google not doing this? Or am I missing something?

    • Schadrach@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      Google gives you an option as to how autonomous you want it to be. There is an option to essentially let it do what it wants, there are settings for various degrees of making it get your approval first.

    • Tja@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      You can give cursor the permission to always run a certain command without asking (useful for running tests or git commands). Maybe they did that with rm?

    • sanguinet@lemmy.ca
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      They can (unintentionally) obfuscate what they’re doing.

      I’ve seen the agent make scripts with commands that aren’t immediately obvious. You could unknowingly say yes when it asks for confirmation, and only find out later when looking at the output.

  • LiveLM@lemmy.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    1 month ago

    And judging by their introductory video, Google wants you to have multiple of these “Agents” running at the same time.
    Better lockdown your files real nice from this thing, better yet, don’t let it run Shell commands unattended. One must wonder why the fuck that is even an option!

    • rtxn@lemmy.world
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      1 month ago

      Uh… kinda? Powershell has many POSIX aliases to cmdlets (equivalent to shell built-ins) of allegedly the same functionality. rmdir and rm are both aliases of Remove-Item, ls is Get-ChildItem, cd is Set-Location, cat is Get-Content, and so on.

      Of particular note is curl. Windows supplies the real CURL executable (System32/curl.exe), but in a Powershell 5 session, which is still the default on Windows 11 25H2, the curl alias shadows it. curl is an alias of the Invoke-WebRequest cmdlet, which is functionally a headless front-end for Internet Explorer unless the -UseBasicParsing switch is specified. But since IE is dead, if -UseBasicParsing is not specified, the cmdlet will always throw an error. Fucking genius, Microsoft.

        • Trainguyrom@reddthat.com
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          Yeah as an admin I love that I can run familiar Linuxy commands in powershell but I also hate that they can’t just use/fork the real userland utilities so everything works just similarly enough to completely throw you off when you stumble across a difference

    • Redkey@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      1 month ago

      “rd” and “rmdir” only work on empty directories in MS-DOS (and I assume, by extension, in Windows shell). “deltree” is for nuking a complete tree including files, as the name suggests.

  • Zink@programming.dev
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    Wow, this is really impressive y’all!

    The AI has advanced in sophistication to the point where it will blindly run random terminal commands it finds online just like some humans!

    I wonder if it knows how to remove the french language package.

    • greybeard@feddit.online
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      The problem (or safety) of LLMs is that they don’t learn from that mistake. The first time someone says “What’s this Windows folder doing taking up all this space?” and acts on it, they wont make that mistake again. LLM? It’ll keep making the same mistake over and over again.

      • skisnow@lemmy.ca
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        I recently had an interaction where it made a really weird comment about a function that didn’t make sense, and when I asked it to explain what it meant, it said “let me have another look at the code to see what I meant”, and made up something even more nonsensical.

        It’s clear why it happened as well; when I asked it to explain itself, it had no access to its state of mind when it made the original statement; it has no memory of its own beyond the text the middleware feeds it each time. It was essentially being asked to explain what someone who wrote what it wrote, might have been thinking.

        • greybeard@feddit.online
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          One of the fun things that self hosted LLMs let you do (the big tech ones might too), is that you can edit its answer. Then, ask it to justify that answer. It will try its best, because, as you said, it its entire state of mind is on the page.

  • mvirts@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    Everyone should know most of the time the data is still there when a file is deleted. If it’s important try testdisk or photorec. If it’s critical pay for professional recovery.

    • gnutrino@programming.dev
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      I am deeply, obsequiously sorry. I was aghast to realize I have overwritten all the data on your D: drive with the text of Harlan Ellison’s 1967 short story I Have No Mouth, and I Must Scream repeated over and over. I truly hope this whole episode doesn’t put you off giving AI access to more important things in the future.

      • Deceptichum@quokk.auOP
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        I wonder if anyone has ever given AI access to their stock portfolio and a means to trade?

        • webghost0101@sopuli.xyz
          link
          fedilink
          arrow-up
          0
          ·
          1 month ago

          People have hooked up scripts to automate trade based on celebrities using certain hashtags or other data for years.

          A non insignificant portion of people has absolutely hooked up an ai to it. I don’t know any, but i take that bet in a heartbeat.

          Some will do it responsibly, as an experiment with money they are prepared to loose.

          Ai companies themselves might try this as an internal test, like how atrophic has claude managing a real vending machine (which got manipulated into selling tungsten cubes following customer feedback)

          Others have probably completely destroyed their own lives. A few may have lucked out.

          • alaphic@lemmy.world
            link
            fedilink
            arrow-up
            0
            ·
            1 month ago

            Is that the same AI vending machine that attempted to alert company security (i think) when told it was going to be taken offline and also tried to set up physical meetings with people, even describing its outfit? Or am I thinking of another?

            All the creepy surrealistic AI stuff starts to run together for me after awhile lol

            • Trainguyrom@reddthat.com
              link
              fedilink
              English
              arrow-up
              0
              ·
              edit-2
              1 month ago

              Its all creepy until you realize it was all just a chat with an LLM and not actually an agentic machine learning model or chain of models hooked into some custom APIs

              LLMs famously collapse into rediculousness once a conversation goes on too long. They’re now at the point where that takes more than a couple of paragraphs of text at least

          • slazer2au@lemmy.world
            link
            fedilink
            English
            arrow-up
            0
            ·
            1 month ago

            I recall a story years ago that whenever Ann Hathaway has a bad news story Berkshire Hathaway also takes a dip because high frequency trading scrips are idiots.

        • Meron35@lemmy.world
          link
          fedilink
          arrow-up
          0
          ·
          1 month ago

          Renaissance Technologies is arguably the world’s best hedge fund, and supposedly only uses AI based strategies.

          High Flyer are the founders of DeepSeek, and are also all in on AI, though their performance is more volatile.

      • X@piefed.world
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        This person backs up offline and probably offsite, with redundant copies, encrypted as necessary.

        Two is one, one is none.

        • slazer2au@lemmy.world
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          I like to go by the Veeam variant. 3-2-1-1-0

          3 locations
          2 sites
          1 offsite
          1 write permission (write Once read many backup)
          0 days since last success.

    • cmnybo@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 month ago

      That’s not necessarily the case with SSDs. When trim is enabled, the OS will tell the SSD that the data has been deleted. The controller will then erase the blocks at some point so they will be ready for new data to be written.

      • zurohki@aussie.zone
        link
        fedilink
        English
        arrow-up
        0
        ·
        1 month ago

        IIRC TRIM commands just tell the SSD that data isn’t needed any more and it can erase that data when it gets around to it.

        The SSD might not have actually erased the trimmed data yet. Makes it even more important to turn it off ASAP and send it away to a data recovery specialist if it’s important data.

        • hendrik@palaver.p3x.de
          link
          fedilink
          English
          arrow-up
          0
          ·
          edit-2
          1 month ago

          Yes. And best don’t turn any setting off or change things around unless someone knows what they’re doing. Power off the entire computer and unplug the storage device physically. (And subsequently, take it as an invitation to learn more about automated backups.)

        • cmnybo@discuss.tchncs.de
          link
          fedilink
          English
          arrow-up
          0
          ·
          1 month ago

          It’s not possible to overwrite data on flash memory. The entire block of flash has to be erased before anything can be written to it. Having the SSD controller automatically erase unused blocks improves the write speed quite a bit.

    • Sv443@sh.itjust.works
      link
      fedilink
      arrow-up
      0
      ·
      edit-2
      1 month ago

      good thing the AI immediately did the right thing and restored the project files to ensure no data is overwritten and … oh