Ctrl+A conflicts with readline's "go to the start of line" (unless you're using vim key bindings in your shell, which I find uncomfortable).

I've been using Ctrl+Q, it replaces an almost completely useless key combo (flow control if I'm not mistaken), and is easy to press.

Just use double Ctrl+A to pass it down:

    bind C-a send-prefix