I think this is all under the assumption that your goal is to make the project as successful as possible. If that's true, then if people think you should step down, you should. BUT can that happen? If you're trying to maximise project success, how can you also be so bad that people want you to step down? If you're not contributing but good-hearted, then you should select someone to run it day to day, but retain ultimate power in case that person turns out worse than you.