Remix.run Logo
Garlef 5 hours ago

> It’s hard to use external services

I think it's interesting to add what they use it for and why its hard.

What they use it for:

- It's about automated testing against third party services.

- It's not about replicating the product for end users

Why using external services is hard/problematic

- Performance: They want to have super fast feedback cycles in the agentic loop: In-Memory tests. So they let the AI write full in-memory simulations of (for example) the slack api that are behaviorally equivalent for their use cases.

- Feasiblity: The sandboxes offered by these services usually have performance limits (= number of requests per month, etc) that would easily be exhausted if attached to a test harness that runs every other minute in an automated BDD loop.