Why hasn't something like this existed before?

This is because we don’t typically associate Kafka consumption side with a push model, so we often overlook many useful patterns.