• 0 Posts
  • 409 Comments
Joined 2 years ago
cake
Cake day: June 2nd, 2024

help-circle












  • Sabata@ani.socialtoSelfhosted@lemmy.worldDo you host your own AI?
    link
    fedilink
    English
    arrow-up
    5
    ·
    edit-2
    23 days ago

    Running decencored Qwen3.6-27b and a 9b Gemma for RAG and scrapes on Ollama with a mostly vibe coded discord bot. Just got it to run tools and scrape and post news on a schedule. The first model I can run locally that’s smart enough to be useful. May give Jan a try for the back end after reading that other guys rant.

    Mostly use it for stupid questions I could have googled and to brag to friends.



  • Looking to switch, tried running a Matrix server with Element but a pain in the ass to set up and admin and I never got voice to work. I also don’t have the social pull to move people. May try Nextcloud as it it looks easier to work with, and has voice and a bunch of other crap. Probably get a friend or 2 and leave a bot run a bridge channel for the people still on discord.