| ▲ | netdur 4 hours ago | |
had a good run with Gemma 4 E2B Unsloth 4Q: https://youtube.com/shorts/XLsAnz5aAAI The E4B model doesn’t fit on my phone TPU, so it swaps to RAM, the QAT version means more accuracy, good! | ||
| ▲ | prism56 21 minutes ago | parent [-] | |
How do you know it swaps to ram vs on the TPU? Would be interested in testing this on my pixel. | ||