So what happens with optimistic local operations that become invalid after replay of canonical operations? Are they just thrown away as well?

That's right, they become part of the replay and rejected using the same path, otherwise things like cycles might still happen. Rejected ops do stay part of the log though, so there's always ways to build time travel/version history or conflict UIs on top when needed.