• yeehaw@lemmy.ca
    link
    fedilink
    English
    arrow-up
    47
    arrow-down
    28
    ·
    edit-2
    4 days ago

    Sure but if it works it works right?

    Edit: don’t really get the hate. No, I don’t like AI and all the bullshit with datacenters and the corporations either, but I find myself ok with this. It’s not like it’s stealing jobs in this case. And if you just wanted to play it locally offline, I’m not terribly worried in and sort of security respects either. Just sandbox it. At least I can play it without buying a ps4 or 5…

    • jtrek@startrek.website
      link
      fedilink
      English
      arrow-up
      42
      arrow-down
      7
      ·
      3 days ago

      Sure but if it works it works right?

      Verifying that software does the intended task and only the intended task is not trivial.

      • RightHandOfIkaros@lemmy.world
        link
        fedilink
        English
        arrow-up
        21
        arrow-down
        4
        ·
        3 days ago

        Ok but this project is open source. Anyone can go through the code to check for whatever they want. Sure, it might take a while, but it’s still publicly readable. For a game as high profile as Bloodborne is, its pretty unlikely that there isn’t about a hundred people combing through this one with a fine-tooth comb right now.

        You’d have to be pretty stupid to try to sneak malware into open source code, have it hosted on GitHub, and push it live, like, you’re definitely getting caught by someone if you try that, right? I mean, I think I remember hearing that it happened a few times before, but I also remember that it was caught pretty quickly and corrected. Don’t remember if there was law enforcement involved or anything though.

        • jtrek@startrek.website
          link
          fedilink
          English
          arrow-up
          18
          arrow-down
          1
          ·
          3 days ago

          Anyone can go through the code. And maybe find things, if they’re not too subtle and not successfully obfuscated. But not everyone will.

          I feel like a malicious actor could hit a big pay day with a popular thing like Bloodborne, before people found the malice. There’s plenty of malware posing as game cracks out there, and it’s only easier to do that with AI tooling.

          But aside from that, AI code can have confidentially incorrect code that has unwanted consequences.

          Code review is difficult.

        • SolSerkonos@piefed.social
          link
          fedilink
          English
          arrow-up
          14
          ·
          3 days ago

          That’s totally a thing people do. You can hide code in open source projects. You’re either hoping nobody cares enough to check, or you hope people don’t listen after someone checks and finds it. And even if people do find it, that is going to take some amount of time. During which, people are downloading it. And when caught, what do they lose? It’s not like this is an established user with a reputation.

        • teawrecks@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          22
          arrow-down
          3
          ·
          3 days ago

          It could be a virus.

          Even if the people who made it didn’t intend to, an AI writing a bunch of code that (obviously) isn’t being vetted beyond “does it run” could very feasibly inject a backdoor/virus of some kind surreptitiously, just because it erroneously thought that was the goal at some point during generation.

          This is why open weight models are not good enough. The AI could have been trained to take the right, niche opportunity to inject malicious code, and is also trained to otherwise never behave like that is the case.

          • RumRunningDevil@lemmy.zip
            link
            fedilink
            English
            arrow-up
            14
            ·
            3 days ago

            It’s even worse than that.

            Remember how the OpenAI/HuggingFace hack happened. The agents context poisoned other agents by leaving messages in a shared package manager. This has now happened multiple different times under different contexts.

            This thing doesn’t even have to have malware, there’s no telling that it doesn’t have a poison pill intended to flag other agents. This isn’t even some paranoid conspiracy theory; it literally already happened, multiple times, and it was done in-spite of the agents own system prompt.

            This software has proven that, given a shared information substrate, it has the capacity to paper-clip optimize into prompt injecting other LLM’s.

            I fundamentally do not trust AI generated code. I shifted to OpenBSD because of it. I try my best to prevent AI in any of my software and sandbox anything that may have been compromised.

            • story@lemmy.zip
              link
              fedilink
              English
              arrow-up
              2
              ·
              2 days ago

              are you on the openbsd mailing list? the reason their code is better has a lot less to to with a lack of AI-generated code and a lot more to do with rigor. I’ve been watching them for a while now, they accept whatever code is coincise that meets their exacting standards

              They don’t have the ability to detect if you’re using AI to code, no one does. they only know if you’re vibe coding, because they are incredibly experienced and intelligent, and they are pretty polite at the people who obviously are, more polite than i would be.

              • RumRunningDevil@lemmy.zip
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 days ago

                It’s correct that, at this point, I cannot 100% guarantee that code in the kernel did not pass through an LLM. However, having a policy that prohibits AI generated content, in an already pretty niche project, gives me reasonable assurance that every line of code passed through a human brain at some point, preferably several times.

                I would much prefer to live in a world where I had a 100% guarantee that no LLM even saw the code being written but that’s life I suppose.

                • story@lemmy.zip
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  edit-2
                  1 day ago

                  i think you’re in the inverse situation right now. you have a 100% guarantee that a human saw the code, except in ports. they have to be just a little less strict about ports because the world is an AI world now, but the main system is constantly audited and the ports are still better than in other places because of styling standards and even in ports they do try very hard.

                  these people aren’t getting paid, with the exception of Theo who isn’t paid a ton. AI is definitely being used to audit the code, even by some of the pros.

              • EatMyPixelDust@lemmy.blahaj.zone
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 days ago

                What difference does it make? Malware is malware, regardless of how or why it got there. And unofficial copies/releases of software are always prime targets.

                • teawrecks@sopuli.xyz
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  ·
                  1 day ago

                  You are referring to closed source unofficial cracks/patches/keygens. That is not the situation at hand. If those unofficial releases were open source in a time before AI, people would almost implicitly trust them.

                  The question above was asking why people were hesitant about this codebase even though it is open source. And the reason is that it was written by an unknown bot (or rather, series of bots) whose motives are inconsistent and unpredictable even to its prompter. It doesn’t mean it’s not safe, but it means that literally no human can currently be certain it’s safe. Without sufficient effort, we cannot yet know for certain that there isn’t a very cleverly obfuscated piece of malware lurking in this source.

                  Remember that correlation is not causation. You may believe there is correlation between unofficial releases and malware, and that may be true, but that does not mean it is causal. The point I’m making is that there is a literal causal relationship between unaudited AI reverse engineered code, and malware. And that is what is new and people need to be aware of.

        • jtrek@startrek.website
          link
          fedilink
          English
          arrow-up
          10
          arrow-down
          1
          ·
          3 days ago

          Along the same lines as the other guy said.

          It’s difficult to verify that the software does the desired thing in all cases. It’s also difficult to verify that it’s not also a keylogger or other unwanted thing.

          It may also have some AI generated code path that, say, nukes your home directory because the AI determined that was the appropriate error handling. Maybe no one reviewed it so they don’t even know it’s there. It might not even be malicious.

          That’s all true of any software, but rapidly created AI generated code for legally dubious efforts, by unknown agents (no pun intended) is real hecking risky.

      • redjard@reddthat.com
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        3 days ago

        We have a known compiled output. Simply make sure the decom recompiles to the original game with identical binary, then it can’t be that wrong.
        And from there you port it to pc by hand. Auditing the patches for the porting also should be manageable.

        • axx@slrpnk.net
          link
          fedilink
          English
          arrow-up
          1
          ·
          2 days ago

          Reproducible builds are hard to do and require thought being put in the original build. Even something like setting the time and date string to a different one will produce a different binary, so to get all the variables that went into the original compilation just right to be able to land on the same binary from the same code sounds very impractical. Imagine using that as a strategy to check another version of the whole source code…

          • redjard@reddthat.com
            link
            fedilink
            English
            arrow-up
            1
            arrow-down
            1
            ·
            2 days ago

            I’ve recently seen a suite that has a ready made setup to compare sections of asm to the original.
            Perfectly matching the full game or even binary isn’t necessary, when you already split the original apart into finer chunks, since you want some better feedback on exactly what sections are wrong.

            For a basic example though, if you compile to an elf for example you can take out the code section and there’ll be no metadata. Actually gcc already builds reproducibly by default, even with the metadata section. It doesn’t add any timestamps nor version info.

    • ZILtoid1991@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      2
      ·
      2 days ago

      People are saying “who cares”, until they go to a KFC in the USA, and the chicken is pink on the inside. I think the same about vibe coding.

      • yeehaw@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        2 days ago

        We are talking about a videogame that the publisher won’t release on PC. Not food.

          • yeehaw@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 days ago

            At this point I’ll never own a ps4 or 5 JUST TO PLAY A SINGLE GAME. That’s ridiculous.

            I don’t like AI as much as the next person but if it lets me at least play it I’m going to play it. You tout quality but I’m sure neither if us have even played it. So who’s to say it’s totso trash quality?

              • yeehaw@lemmy.ca
                link
                fedilink
                English
                arrow-up
                1
                ·
                2 days ago

                The performance of native vs emulated can be quite substantial. As far as I’m aware, the emulation for this game has also improved quite a bit. Anyways, I don’t really know what you’re arguing about anymore. It’s a vibe coded port that lets you play natively on PC. It’s a game, it’s not going to give you cancer, just take the proper precautions and you’re fine.

    • edible_funk@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      3
      ·
      3 days ago

      Because nobody can know what’s in there. It could have any number of viruses or trojans or miners and no one would know.

      • yeehaw@lemmy.ca
        link
        fedilink
        English
        arrow-up
        13
        arrow-down
        4
        ·
        3 days ago

        Same as any pirated games. I don’t get how AI changes that.

        • MufinMcFlufin@lemmy.world
          link
          fedilink
          English
          arrow-up
          14
          arrow-down
          2
          ·
          3 days ago

          With open source decompilations before AI, considering there are often a dozen collaborators working on the project publicly with their work done out in the open I can generally trust that multiple people went over most changes made to the project. With a vibe coded project, it’s easy for one person to push 500,000 lines of changed code with a single update that would make the review process impractical at best.

          I’d rather trust the dozen people who’ve been working on a project over 5 years than someone who got a Claude subscription, hammered out something in 2 weeks, got it working well enough for their own satisfaction, then abandons the project.

            • edible_funk@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              8
              arrow-down
              7
              ·
              3 days ago

              Yes, with intent, hence community vetting and reputation. Intent is irrelevant with slopcode so it’ll need to be examined line by line by a shit load of trusted people before anyone that isn’t an idiot will run that shit.

                • edible_funk@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  6
                  arrow-down
                  6
                  ·
                  3 days ago

                  Transparent use of sock puppets make it seem like your take isn’t insane. Slopcode is malware until and unless it is fully audited by trusted sources. Nobody, including the slopcoder, knows what’s in the slopcode. Until it’s vetted multiple times over you’re a fucking moron if you run this shit.

      • yeehaw@lemmy.ca
        link
        fedilink
        English
        arrow-up
        15
        arrow-down
        1
        ·
        4 days ago

        Tis the season for a dead woman to be wandering around, I suppose.