Apertus-8B-2509-4bit-ASINQ
This repository contains the official 4-bit quantized version of the Apertus-8B-2509 model using the calibrated version of SINQ...
This repository contains the official 4-bit quantized version of the Apertus-8B-2509 model using the calibrated version of SINQ...
This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel. Модальности:Генерация текста Области применения:Следование инструкциям...
— Model Architecture: Qwen3ForCausalLM — Input: Text — Output: Text — Model Optimizations: — Weight quantization: INT4 —...
— bits: 4 — dynamic: null — groupsize: 32 — descact: true — staticgroups: false — sym: true...
— bits: 4 — dynamic: null — groupsize: 32 — descact: true — staticgroups: false — sym: true...
If you run into errors on a multi GPU machine, I’ve found that setting CUDAVISIBLEDEVICES=0 helps. Llama-3.1-Nemotron-70B-Instruct is...
4-bit GPTQ (W4A16) quantization of deepseek-ai/DeepSeek-V4-Flash-0731, produced with GPTQModel. This is the V1 release (first calibration run). A...
An 8.9M-parameter question-answering model that runs entirely offline on an ESP32-S3 microcontroller, answering espresso questions a piece at...
Canonical one-package weights for 4× DGX Spark. Repo id: drowzeys/keys-latest-GLM-5.2-Quantrio-INT4-INT8-Mixed-Abliterated-DFlash > Gated access. Safety refusals have been removed....
Pre-converted weights for colibrì — a pure-C engine that runs huge MoE models on consumer hardware by keeping...