| ▲ | orphea 8 hours ago | ||||||||||||||||
It looks like it's just for logging, why does it need to block? | |||||||||||||||||
| ▲ | jflynn2 7 hours ago | parent [-] | ||||||||||||||||
Better question - why would you call an LLM (expensive in compute terms) for something that a regex can do (cheap in compute terms) Regex is going to be something like 10,000 times quicker than the quickest LLM call, multiply that by billions of prompts | |||||||||||||||||
| |||||||||||||||||