iirc you can insert pages into a PDF or annotate directly on the page.

I do, but that's not what I'm looking for. If you annotate a PDF directly you then have to detangle your notes from the PDF on export. It is very different from having a document open that you can scroll/flip through and taking notes in their own space at the same time.