Where is the mmproj.gguf?
#1
by
scruffynerf - opened
You need matching mmproj to use vision
Thank you for the heads up! I'll be reposting this model with significantly better hybrids in this collection in the very near future:
https://huggingface.co/collections/magiccodingman/magic-quant
The method used for this MXFP4 Hybrid collection is going to be out dated very soon and vastly surpassed. I have an evolution codebase that finds optimal quant hybrids. And I didn't even add code to properly get the mmproj. Sorry about that! But now this is on my radar and I'll be sure to fix that very soon and the newly updated version I'll be posting will be much better and include this :) Thankyou.
magiccodingman changed discussion status to
closed