| ▲ | sjdh76 4 hours ago | |
Yup. There are so many layers the majority doesnt interact with, so they focus on what they know. The current stack has probably 10-12 layers. And NVIDIA touches more layers than anyone else. 1. Physical infrastructure - power, cooling, network fabric, chip fabrication 2. Chips 3. Low level sw - CUDA/ROCm/Metal/XLA etc 4. Kernels - cuBLAS, cuDNN, FlashAttention, FlashInfer, Triton, llama.cpp 5. Kernel gen/optimization - MLIR, TVM, TensorRT 6. ML frameworks pytorch, jax, tensorslow 7. Models - Llama, Qwen, Claude, GPT, Gemini 8. More tuning - vLLM, SGLang, TensorRT-LLM, DeepSpeed, Megatron-LM 9. API/SDK/Platform 10. Apps/Agents/Pipelines/Orchestration etc | ||