Remix.run Logo
▲ jmathai 2 hours ago

For my latest app, I didn’t use any analytics software or package. Instead, I had the app save events as jsonl files on the server. I used Claude artifacts to create a custom report from that data. That was just a python file which now sits on a server next to those data files, giving me a live dashboard of very customized insights.

I don’t see myself ever using an off-the-shelf analytics package again.

▲lifeisloving an hour ago | parent [-]

You realize the hallucination rates are still circa 2-10%. So 1/10 times you're getting straight up incorrect reports..

▲maest an hour ago | parent | next [-]

The report is generated by a python script

▲jgalt212 44 minutes ago | parent [-]

Don't do that. You'll use too few tokens if your script is reusable.

▲nitroedge 25 minutes ago | parent | prev [-]

Still? Or are you quoting 2023 stats? You mean Claude is incorrect once every ten times I ask it something?