Lythri-7B-A4B-Q4_0_8-GGUF
This repository contains the Q48 quantization of Lythri-7B-A4B. Q48 is a mixed-precision quantization proposed in the Lythri technical...
This repository contains the Q48 quantization of Lythri-7B-A4B. Q48 is a mixed-precision quantization proposed in the Lythri technical...