VulkanForge – 14 MB Vulkan LLM engine that runs native FP8 models on AMD (Rust)

	▲	VulkanForge – 14 MB Vulkan LLM engine that runs native FP8 models on AMD (Rust)(github.com)
		3 points by maeddesg 9 hours ago