How are you handling memory? That's what makes it "not work" for most people.

Yes memory is a key part. I’m using sqlite and markdown files. Sqlite is so it can easily search its conversation and thoughts by time and full text search. I actually always put the last 5 hours of so I’d conversation into the context. Markdown is for more standard agent instructions, skills, and lessons