2 posts tagged with "Human in the Loop"

We ran into a problem a few weeks ago that none of our tools could solve. It wasn't a technical problem — the code was fine, the infra was fine. We just needed someone to go do a thing on a website. Sign up, click around, grab some information, paste it into a form. Repeat a bunch of times.

AI couldn't do it. The sites had captchas, email verification, multi-step flows. We tried browser automation and it broke immediately. We needed a person.

So we thought: what if our AI agent could just hire one?

Users would ask Claude to "set up all my integrations," and Claude would call our provisioning tool. Then nothing. Users waited 45 seconds staring at a spinner while our server created API keys, configured webhooks, and set up OAuth clients. Most users gave up after 15 seconds, thinking it failed.

Then someone asked Claude to "clean up old bundles," and Claude dutifully deleted everything from the last 6 months. Because we let it.

We needed streaming for long-running work, chunking for large operations, and approval gates for anything scary. Here's what works.