Sorry, isn't this dead simple?

Maintain a list of identity hashes. When someone goes to vote, deny them if they're already in the list . Otherwise, add their hash to the list then allow a vote to be cast.

This makes the secrecy aspect problematic. You can't have zero trust in authority, verifiability and resistance to sabotage all at once.