Converted to BF16 using converthftogguf.py, then quantized using llama-quantize` from llama.cpp. Did not use an imatrix for any of these runs, something I want to explore for future model uploads. llama.cpp handles the -00001-of-0000X split automatically, so you do not need to merge the shards manually. See the original model card for details on capabilities, benchmarks, and license.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: Alittlehammmer
Теги: gguf, quantized, llama.cpp, agentic-coding, endpoints_compatible, conversational
Лайков: 4 | Загрузок: 22
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
