SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch. - huawei-csl/MACaQ. You signed in with another tab or window. You signed out in another tab or window. You switched accounts on another tab or window.