If it's command-line based, maybe stream based on lines, or even better, sentences rather than received tokens.