There's one in Tokyo near Jimbocho station called "Jazz BIGBOY" that I quite enjoyed. It looked like it was run entirely by one elderly gentleman.

Jimbocho also has a lot of used book stores, I highly recommend checking the area out.