I can’t wait to get home and try this on my Pi. Past few months, I’ve been building a fully local agent [0] that runs inference entirely on a Raspberry Pi, and I’ve been extensively testing a plethora of small, open models as part of my studies. This is an incredibly exciting field, and I hope it gains more attention as we shift away from massive, centralized AI platforms and toward improving the performance of local models.

For anyone interested in a comparative review of different models that can run on a Pi, here’s a great article [1] I came across while working on my project.

[0] https://github.com/syxanash/maxheadbox

[1] https://www.stratosphereips.org/blog/2025/6/5/how-well-do-ll...