When you say "can upload any model to it" are you talking LLM models? Surely there is a limit eg. parameters

Yeah, anything that fits into memory, which on that FPGA is very limited. It was built for fun rather than production.