What you imagine is called a rocket stove mass heater, and it has other names too. Works wonderfully well.

We saw stoves/fireplaces like this in a bunch of taverns in Slovenia. Huge hulking tiled cubes around the center of the building that just radiated a pleasant heat from every square inch of the surface. I imagine it was quite efficient, with just a very low fire burning to keep it in equilibrium.