How would this work?

    (defmacro hi-macro ()
      (eval-when-compile
        (message "hi you")))

    (hi-mac

Edit: OK. As per the mailing list. I guess it is a feature then.

    (let ((fooo (eval-when-compile (progn (message "hi you")))))
      foo ;; <---- C-M-i here
      )