After Australia’s first reported automated hacking accident, experts warn deployers – and possibly developers – of AI agents could be held liable for the actions of their bots
All that is great, and correct, but my point is that it asks you to confirm its commands that it runs. It asks you to confirm every change it makes to your code. It asks you to confirm every file it creates.
Everything it does goes through your permission.
You also shouldn’t have it do anything anywhere close to a production system, so it shouldn’t be able to do anything of any consequence.
So basically use it as a toy for entertainment purposes only… Except it’s not marketed to be used that way and far to many people aren’t smart or educated in computing enough to use it that way. Accepting a bash command you don’t understand is the same as running a bash command you found on the Internet… You shouldnt, but people are far more trusting of the stuff an LLM powered agent comes up with.
No, not at all, and I’m not sure how that could be the conclusion you came to from my post.
AI should never be touching prod systems without extreme safeguards/permissions set by the systems that they are accessing. Give it a read only db user account. Give it write access to some tables, but no delete/truncate. No AI should be able to run bash commands on production systems by itself without proper safeguards. That’s a failure of the users if it can.
Systems and software that was built by AI are fine to go into production environments after they’ve done through the regular pipeline of local testing, peer review, QA, unit tests, integration tests, test environment, stage environment, etc.
You never just give AI unfettered access to production systems to do whatever it wants, just like you don’t give a junior dev that access. People that aren’t “smart or educated enough” won’t have that access either - and again, if they do that’s a gigantic failure by the people that are.
All that is great, and correct, but my point is that it asks you to confirm its commands that it runs. It asks you to confirm every change it makes to your code. It asks you to confirm every file it creates.
Everything it does goes through your permission.
You also shouldn’t have it do anything anywhere close to a production system, so it shouldn’t be able to do anything of any consequence.
So basically use it as a toy for entertainment purposes only… Except it’s not marketed to be used that way and far to many people aren’t smart or educated in computing enough to use it that way. Accepting a bash command you don’t understand is the same as running a bash command you found on the Internet… You shouldnt, but people are far more trusting of the stuff an LLM powered agent comes up with.
No, not at all, and I’m not sure how that could be the conclusion you came to from my post.
AI should never be touching prod systems without extreme safeguards/permissions set by the systems that they are accessing. Give it a read only db user account. Give it write access to some tables, but no delete/truncate. No AI should be able to run bash commands on production systems by itself without proper safeguards. That’s a failure of the users if it can.
Systems and software that was built by AI are fine to go into production environments after they’ve done through the regular pipeline of local testing, peer review, QA, unit tests, integration tests, test environment, stage environment, etc.
You never just give AI unfettered access to production systems to do whatever it wants, just like you don’t give a junior dev that access. People that aren’t “smart or educated enough” won’t have that access either - and again, if they do that’s a gigantic failure by the people that are.