GGUF files of orcarouter/LFM3-1.7B-abliterated for llama.cpp. Nothing here was trained or abliterated. The BF16 file is a format conversion of that repo’s safetensors. Q80 and Q4KM are standard llama.cpp quants of that BF16 file. They are not the Liquid AI QAD Q40 quant. — Liquid AI made LFM3-1.7B and the LFM Open License v1.0 in LICENSE. — OrcaRouter published the abliterated weights at orcarouter/LFM3-1.7B-abliterated. — llama.cpp b12040, commit 00ef13664, did the safetensors to GGUF conversion and the quants. LFM3 needs llama.cpp b11960 (v0.8.0) or newer. The safetensors were converted to GGUF. Q80 and Q4K_M were quantized from that BF16 GGUF. No tensor was finetuned. Context length is 262144. The source chat template is stored in the GGUF, including tool calls. Those sampler values come from the source model card. Use a context size that fits the GPU. The weights were trained for 262144 tokens.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: adolan
Теги: gguf, lfm3, llama.cpp, abliterated, quantized, en, ar, zh
Лайков: 3 | Загрузок: 862
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
