> The model weights and inference code need to be contained within 25KB of user-space memory

Wouldn’t it be era-appropriate to allow relying on banked memory? You’d still need to hold the inference code, but you could effectively stream(ing page) the weights as you compute on them.

▲

striking 4 hours ago | parent [-]

From a look at https://en.wikipedia.org/wiki/BBC_Micro#Specifications I think the 6502 versions of the beeb didn't have banked RAM so to keep it loadable from tape the limits might be as stated.

But with substantial additional effort, maybe some banked ROMs could be added..?

	▲	froh an hour ago \| parent [-]
		the banking was done via an external ram controller whose bank control register was mapped to some (unbanked) controller address.