Remix.run Logo
om8 18 minutes ago

Could've been better if GGUF implemented QTIP format. GGUF representation is a major limitation for llama.cpp quantization performance

edflsafoiewq 13 minutes ago | parent [-]

They use their own llama fork anyway, so that shouldn't matter.