Pretty sure you want it to do it the first way in all cases (not just with GPUs)!

It really depends on if you're dealing with an async stream or a single async result as the input to the next function. If a is an access token needed to access resource b, you cannot access a and b at the same time. You have to serialize your operations.