| ▲ | onlyrealcuzzo 6 hours ago | ||||||||||||||||||||||||||||||||||||||||
> SQLite is surprisingly performant for single node applications even when comparing to Postgres. In the context of SQLite being understood to be a quite excellent piece of software - shouldn't we expect it to be? In the context of a single-node, Postgres is overkill. It should not be expected to be competitive with SQLite. This is almost like benchmarking an in-memory HashMap to Redis and being surprised that it performs well in ideal conditions. | |||||||||||||||||||||||||||||||||||||||||
| ▲ | shukantpal 6 hours ago | parent [-] | ||||||||||||||||||||||||||||||||||||||||
Yes, agreed on SQLite/Postgres. But I'm going to benchmark RocksDB next and see what the performance characteristics are. I suspect the LSM tree storage engine of RocksDB might perform better since agents are so write heavy when running highly concurrent workloads. After all, you are streaming LLM tokens into disk and fanning them out to subscribed clients. | |||||||||||||||||||||||||||||||||||||||||
| |||||||||||||||||||||||||||||||||||||||||