Accessibility suffers with that approach.
It doesn't just suffer it's impossible unless you recreate the whole thing with actual HTML behind the <canvas> rendered version.