In fact the Muslims initially prayed towards Jerusalem (as did the Jews then and today) until revelation specifically turned them towards Mecca:

> "So turn your face toward al-Masjid al-Haram (the Sacred Mosque in Mecca). And wherever you are, turn your faces toward it..."

Quran 2:144