Pretty sure this is wrong, requests are batched and size can affect the output, also gpus are highly parallel, there can be many race conditions.

Yup. Floating point math turns race conditions into numerical errors, reintroducing non-determinism regardless of inputs used.