Async always confused me as to when a function would actually create a new thread or not.

Why? Asynchrony has nothing to do with multiple threads. In fact you can have async with only a single thread!