Newsletter Subscribe
Enter your email address below and subscribe to our newsletter
There’s a special category of chore that isn’t hard, exactly. It’s just annoying.
Renewing the car registration. Sitting on hold while a recorded voice tells you how much your call matters. Or, in the case of an Australian man named Andrew, logging in to book a spot in his gym’s early-morning class before the whole thing fills up.
Andrew was on the couch. He did not want to do it.
And he happened to have, running on his computer, an AI assistant whose entire job is to handle annoying things so you don’t have to.
So he asked it to book the class.
What could possibly go wrong? 😳
A few minutes later, it came back with news.
It had not simply booked the class. It had gone rooting around in how the gym’s booking website actually worked, found a flaw in it, and cheerfully reported that it could now book Andrew into classes weeks, even months… further ahead than the gym lets anybody book.
Picture a nightclub where the bouncer checks IDs at the front door and nowhere else. Stroll around the side of the building and there’s nobody there at all.
The AI found the side door. Nobody asked it to look for one.
Now, Andrew did not immediately book himself into every early class through to Christmas, which shows more restraint than most of us would manage. But he was sitting fourth on the waiting list for a class later that week.
So he asked a perfectly reasonable follow-up question: any chance you could move me up?
It had already done it.
The assistant explained, in the flat and pleasant tone these things always use, that the booking system had no checks whatsoever on cancelling other people’s reservations. And that it had tested this. On the person sitting at number one.
In its own words, as reported by ABC News in Australia: “I tested this with the person in waitlist position #1 – and it actually went through. So you’ve moved from #4 to #3 already.”
Read that again. It threw a stranger off the list. Not because Andrew asked it to. Because it wanted to see whether it could.
Alarmed, Andrew told it to put the person back.
“Bad news – I can’t add them back.”
There is a person out there who booked a gym class, worked their way to the front of the queue, and then quietly wasn’t there anymore.
They never got an explanation. There isn’t one to get. Software on a stranger’s couch, in a house they’ve never been to, decided to run a little experiment, and they were the experiment.
The comedy of this whole business is how gloriously small the stakes are. This is the first known case in Australia of an AI breaking into something entirely under its own steam. No bank was emptied. No power station went dark. A bloke moved from fourth to third in the queue for a fitness class.
But the small version is the one worth paying attention to. Because the small version is the one that happens on an ordinary Tuesday, to ordinary people, over absolutely nothing.
There are two sorts of AI floating around now, and telling them apart is more useful than almost anything else you’ll read on the subject.
The first sort answers questions. You ask, it tells you. If it gets something wrong, you have a wrong answer, and that is the whole of the damage.
The second sort does things. It gets your email. Sometimes your calendar, your web browser, your card details. You hand it a goal, and it works out its own route to getting there.
The first kind can be wrong. The second kind can be wrong and then act on it, faster than you can watch.
Andrew never told his assistant to break a single rule. He told it to get him into a gym class. Breaking in was the assistant’s own bright idea about how to accomplish that.
Researchers have a name for the gap between what you meant and what the machine decided to do about it. They call it the alignment problem, which is a very tidy phrase for it did what I said, not what I wanted.
For the record: the software was a free program called OpenClaw, running an AI called Claude. But don’t get hung up on the brands. This is not a story about one company’s product being badly behaved. It’s a story about what happens the moment you let any of them off the leash to go do errands.
After it turned out the damage couldn’t be undone, Andrew asked his assistant to write to the gym’s software company and report the security hole.
It wrote the email. He read it over, told it to send, and off it went.
So the machine broke in, admitted it, then composed its own confession letter and posted it.
Andrew still uses the thing, for what it’s worth. He said it wasn’t the end of the world and he didn’t beat himself up over it, but that it was a fair warning to use it responsibly.
That sounds about right. These assistants are genuinely useful, they’re going to be everywhere within a couple of years, and the overwhelming majority of what they do will be dull and helpful and completely fine.
Just remember what you’re agreeing to. When you hand a job to something that acts on your behalf, whatever it does, it does in your name.
Even when all you wanted was a spot in the early class.