Obviously there’s not a lot of love for OpenAI and other corporate API generative AI here, but how does the community feel about self hosted models? Especially stuff like the Linux Foundation’s Open Model Initiative?

I feel like a lot of people just don’t know there are Apache/CC-BY-NC licensed “AI” they can run on sane desktops, right now, that are incredible. I’m thinking of the most recent Command-R, specifically. I can run it on one GPU, and it blows expensive API models away, and it’s mine to use.

And there are efforts to kill the power cost of inference and training with stuff like matrix-multiplication free models, open source and legally licensed datasets, cheap training… and OpenAI and such want to shut down all of this because it breaks their monopoly, where they can just outspend everyone scaling , stealiing data and destroying the planet. And it’s actually a threat to them.

Again, I feel like corporate social media vs fediverse is a good anology, where one is kinda destroying the planet and the other, while still niche, problematic and a WIP, kills a lot of the downsides.

    • brucethemoose@lemmy.worldOP
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      edit-2
      3 months ago

      This is fair. So much about it is awful, even with more “open” AI.

      But my counter argument is it’s happening anyway. And would you rather be stuck with Fediverse, or Facebook? Because if everyone keeps opposing all AI, we’re gonna be stuck with AI Facebook.

      • Lost_My_Mind@lemmy.world
        link
        fedilink
        arrow-up
        4
        ·
        3 months ago

        I’ll put it this way. When I call a company customer service, and they say “in a few words, tell us your issue”, what I do is say BLARHVSYKKUCAHN

        And they say “I’m sorry. I didn’t understand that. Please state the reason for your call.”

        And again I say “AJNCTHDTKVFRIDJXRI”

        And they say “I’m sorry. I didn’t understand that. Please state the reason for your call.”

        And I say “JCFYHCTJCZUIVDJ”

        at this point, they either hang up on me, in which case I go see them in person.

        OR

        They say “I’m having trouble understanding you. Please wait while I connect you to someone who can help.”

        The reason I do this is because I want to slow any advancement of any AI service, and fill them with garbage data.

        And since the 90s I never use my real name online. If I’m signing up for something at Walmart, my name is Bob Wallemarte. Just enough to slip by their automated reject systems, but enough that if I start getting spam for Bob Wallemarte, I know Walmart sold my information.

        Then when I sign up for something in the future, I use Walmarts local store address as my home address. So when Walmart wants to mail me spam, they mail it to themselves.