aurion

Oh man, so I’m on my 5th (and hopefully final) lemmy/piefed server. The interactions I had were on my previous accounts and I can’t remember exactly what communities they were, sadly

But I think most of them were related to local llama, which makes sense why they are a little more level headed about it

I really enjoy r/leftistforai on Reddit. I’ve been participating/watching it when it was super small. It’s nice to see it growing. Those are some of the most sane AI takes I’ve ever seen on the internet.

After reading some posts and comments on there, it becomes obvious how silly a lot of the “anti-ai” and “ai-bro” discourse/culture is

Kinda wish there was something like that on the fediverse. it took a while to get where it’s at now in Reddit, which has a much larger user base to pull from. Can’t imagine how long it would take to gain traction on the fediverse.

There is a lot of this story you are leaving out, my guy 🤣🤣

But good to know in case Bluesky starts asking for my ID 😉

for real. Im starting to find it more frustrating than actual ai slop

Not to say they don’t have valid concerns. It just feels suffocating and counter productive is all. I even spent too much time and energy debating if I should respond to you wth my actual opinions…and that is so fucking stupid and a sign of something unhealthy going on.

I’ve found a few communities on here that are more level headed about it, but they are the minority it seems.

it’s amazing the types of discussions can pop up when you don’t have to worry about getting sniped for talking about doing ANYTHING with AI.

Bahahaha did NOT expect to see the word “gooner” in this post 🤣 thanks for the laugh

Beyond that, this looks useful as hell! I’ll have to dig into it a bit more.

If anything, your repo has inspired me. I spend wayyyy to much time manually doing things like this and having a solution, or at least the framework of a solution available to review is super valuable!

Yes! I’ve got quite a few projects going right now. Probably too many of them to keep track

I am the only user, so it’s relatively easy to run multiple models for what ever task. Ollama is pretty good at balancing which models are working at what time to not bog down they system

I’m running gpt-oss 120 for a general purpose Hermes agent. Out of the box, it was ok. Not very snappy, but it was one of the best ones for orchestrating other agents.

Glm flash (4.something?) does pretty good as well.

I’ve found a hybrid of cloud and local is the best solution. Use local for smaller or more defined tasks. Use cloud for orchestrating, planning, and…fixing the local agents mistakes lol

I’ve got an LLM maintained Obsidian wiki that is written and edited by a few Ollama agents based on chats via my own self hosted matrix instance. I’ve taken it to a point where I’m pretty happy with the results. But I think if I had enough time and energy, I could really dial it in.

One of my favorite use cases for this is when I’m researching topics like UFOs/high strangeness/conspiracy theories. I have my very own LLM maintained Obsidian vault filled with curated notes and links to sources.

Literally, no one cares about this and they think it’s stupid and I’m stupid and I should feel bad for spending time on this or having the audacity of sharing it… they just don’t appreciate the amount of work and knowledge it took to get what I have set up.

I think it’s cool as fuck. I geek out every time that it works.

Oh, forgot to mention I am running it on a Mac studio with 96 gig of unified memory. I think it’s an M3 ultra chip.

Normally my power sensor connected to my server rack hovers around 150 watts.

I’ve got mini hp pc, 2 HDD bay UGREEN NAS, ubiquity cloud Max router, home assistant green, 2 switches with Poe (2 WiFi AP, raspberry pi, and a mesh radio), and a dell r340.

I also have a dell t310 I’m using as a proxmox backup server that powers on every day around 2am to do backups. The power shoots up to 360 watts when that happens 😅