Remix.run Logo
▲ sjdh76 4 hours ago

Yup. There are so many layers the majority doesnt interact with, so they focus on what they know. The current stack has probably 10-12 layers. And NVIDIA touches more layers than anyone else.

1. Physical infrastructure - power, cooling, network fabric, chip fabrication

2. Chips

3. Low level sw - CUDA/ROCm/Metal/XLA etc

4. Kernels - cuBLAS, cuDNN, FlashAttention, FlashInfer, Triton, llama.cpp

5. Kernel gen/optimization - MLIR, TVM, TensorRT

6. ML frameworks pytorch, jax, tensorslow

7. Models - Llama, Qwen, Claude, GPT, Gemini

8. More tuning - vLLM, SGLang, TensorRT-LLM, DeepSpeed, Megatron-LM

9. API/SDK/Platform

10. Apps/Agents/Pipelines/Orchestration etc