> The best way to program GPUs is face up to the reality that they are not the same machine as the CPU, write your kernels in separate files, and launch them manually

Isn't that how CUDA code is normally written?

▲

jacobgorm 10 hours ago | parent [-]

No. CUDA allows you to write all the code in a single file, and uses a preprocessor to split it back out and pass it through separate compilers, one for host and one for device.

	▲	compiler-guy 10 hours ago \| parent [-]
		This true, but you can write the two separately if you want. The disadvantages of writing them together are listed in the various parent posts. But some code authors really like the convenience of having the two in the same file.