this sounds really cool! would love to hear more about it. I've been hacking something like this together by hand. Send me a message!