• vivendi@programming.dev
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    1
    ·
    1 day ago

    Fuck ClosedAI

    I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!

    • KeenFlame@feddit.nu
      link
      fedilink
      English
      arrow-up
      3
      ·
      10 hours ago

      Open source is always one step ahead. But they don’t have the resources and brand hype so people assume oai is cutting edge still

    • Valmond@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      10 hours ago

      Any pointers on how to do that?

      Also, what hardware do you need for this kind of stuff?

      • vivendi@programming.dev
        link
        fedilink
        English
        arrow-up
        1
        ·
        8 hours ago

        First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both

        • Valmond@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          4 hours ago

          I love FOSS but I’m in the check out stage so at the moment the easiest is the best I guess.

          • vivendi@programming.dev
            link
            fedilink
            English
            arrow-up
            1
            ·
            4 hours ago

            download “LM Studio” and you can download models and run them through it

            I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes