I do something similar. I leave up and down arrows alone, but have ctrl+p and ctrl+n behave as you describe.