Safetensors · GGUF · 💬 On-Device Chat · Blog · Code Boole-1.7B is a 1-bit language model derived from Qwen3-1.7B, intended for English-language inference in non-thinking mode. This GGUF export runs with llama.cpp on CPU or CUDA. The figure uses the 247.1 MB packed source weights; this GGUF is 292.1 MB because it stores the embedding and output matrices separately. See the main model card for evaluation settings. The boole-demo repository builds the pinned llama.cpp runtime. For CPU, build with GGMLCUDA=0 bash scripts/setupllamacpp.sh and use -ngl 0`. Open the server URL printed in the terminal.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: precision-numerics
Теги: gguf, qwen3, 1-bit, quantized, llama-cpp, en, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 501
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
