For 10k you can buy a used dual socket Intel or amd based rackmount server with a terabyte of ram, and run models on cpu only at a reasonable speed. Same server would have been 4-5k a couple years ago before ram price rise.

Or buy one on eBay with 512GB that has half its slots populated and then buy the matching 512GB kit to add.

Which CPU gen are you suggesting, is there any writeup on such setup where <10K (not incl. power bill) cpu only rig is giving usable token speeds on latest SoTA open weights models?

In my experience with rig half that cost, entire exercise of running coding models locally has been a huge disappointment.

Cost/Value when compared to cloud services is just not there, but I see the merit for those who value privacy over quality of output and want a backup of huge condensed corpus of data within their control.

Kudos to OP though, They had clear goals and they achieved it.