

Sorry I know you probably don’t want another tip from me, but the post did include the agent directly using the docker daemon, which runs as root typically. Because you didn’t mention running rootless docker or podman, your sudoers file probably allows the agent full access to root instead of preventing it.
LLMs are inextricably tied to nvidia gpus. Local or cloud, the technology exists to help the shovel salespeople. The gold diggers, everyone this tag is supposed to segregate, have been misled by corporations. Without their lies, and a pliant media, this tag would be unnecessary, and llms would be rolled out in a more limited and responsible way. To promote different uses of gold during a gold rush is going to inflate the bubble and enrich the rich, unless it is properly contextualized. Technology does not exist in a void, pretending it does digs us a deeper hole.