• 5 Posts
  • 603 Comments
Joined 1 year ago
cake
Cake day: March 22nd, 2024

help-circle







  • You mean drag them from platforms that have a vested interest in keeping them locked in and squashing competitors like the Fediverse?

    In platforms that spend billions on engagement optimization algorithms, with the sole purpose of keeping users addicted, basically with government and business landscape backing?

    Look, I’m optimistic about the Fediverse, this is a great refuge in the hellscape that is the internet. But you can’t make people want to change. I’ve learned this IRL, but see it with (for example) persecuted people continuing to use Twitter even though its owner basically has a gun to their heads. There’s a big gulf between being a fantastic refuge and taking the internet from Facebook and Google. Even if every phone on the planet had an easy button to switch to Fediverse alternatives in one click… many would not take it, and that’s an utter fantasy.





  • A problem is volunteers and critical mass.

    Open source “hacks” need a big pool of people who want something to seed a few brilliant souls to develop it in their free time. It has to be at least proportional to the problem.

    This kinda makes sense for robot vacuums: a lot of people have them, and the cloud service is annoying, simpler, and not life critical.

    Teslas are a whole different deal. They are very expensive, and fewer people own them. Replicating even part of the cloud API calls is a completely different scope. The pool of Tesla owners willing to dedicate their time to that is just… smaller.

    Also, I think buying a Tesla, for many, was a vote of implicit trust in the company and its software. It’s harder for someone cynical of its cloud dependence to end up with an entire luxury automobile.








  • It’s also cultish.

    Everyone was trying to ape ChatGPT. Now they’re rushing to ape Deepseek R1, since that’s what is trending on social media.

    It’s very late stage capitalism, yes, but that doesn’t come close to painting the whole picture. There’s a lot of groupthink, an urgency to “catch up and ship” and look good quick rather than focus experimentation, sane applications and such. When I think of shitty capitalism, I think of stagnant entities like shitty publishers, dysfunctional departments, consumers abuse, things like that.

    This sector is trying to innovate and make something efficient, but it’s like the purse holders and researchers have horse blinders on. Like they are completely captured by social media hype and can’t see much past that.


  • It’s ironic how conservative the spending actually is.

    Awesome ML papers and ideas come out every week. Low power training/inference optimizations, fundamental changes in the math like bitnet, new attention mechanisms, cool tools to make models more controllable and steerable and grounded. This is all getting funded, right?

    No.

    Universities and such are seeding and putting out all this research, but the big model trainers holding the purse strings/GPU clusters are not using them. They just keep releasing very similar, mostly bog standard transformers models over and over again, bar a tiny expense for a little experiment here and there. In other words, it’s full corporate: tiny, guaranteed incremental improvements without changing much, and no sharing with each other. It’s hilariously inefficient. And it relies on lies and jawboning from people like Sam Altman.

    Deepseek is what happens when a company is smart but resource constrained. An order of magnitude more efficient, and even their architecture was very conservative.