Ornith-1.0-35B-AutoRound-W4A16-Tuning
This model is a int4 weight-only quantization with group_size 128 and symmetric quantization of deepreinforce-ai/Ornith-1.0-35B generated by TUNING....
This model is a int4 weight-only quantization with group_size 128 and symmetric quantization of deepreinforce-ai/Ornith-1.0-35B generated by TUNING....