Something is going horribly wrong. I don't know what it is (without your code I don't know), have you profiled where it's going wrong? There's no way a game for 2004 would be that slow.

If you want help, I've done some similar work, you could pop it up on a github repo or something. What is the game?