I constantly have to work around the slowness of matplotlib when creating animated sequences for my scientific work (even with the Agg back end)
How many points are you working with usually?