On Linux you should look into GStreamer and dmabuf.