He actually lived in Berlin for a few years before he died. But you're right, he spent most of his life in Prague. However, his native language was German.
Certainly an interesting man. I highly recommend checking some of his work (ie. The Metamorphosis).