| ▲ | Philpax 2 hours ago | |||||||||||||
I regret that the projection models ended up separate, and I too would have preferred for them to be in a single file. I'm not entirely sure why that ended up happening, but it very much runs counter to the single-file ethos I had in mind when I designed GGUF. Hoping that someone will shepherd the cause of merging the two; I think I'm too out of the loop to do it this time around :-) | ||||||||||||||
| ▲ | intothemild 40 minutes ago | parent [-] | |||||||||||||
Well considering right now MTP support is being developed, there was a conversation in that that seemed to throw around the idea of separating the MTP model out of the main GGUF, like with Mmproj. This was rejected. Which I'm happy for. So given that decision, I don't think it's unreasonable to think that they might be open to including Mmproj files in the GGUF. Only issue I can think of is, which one? BF16, F16? Etc | ||||||||||||||
| ||||||||||||||