— Model creator: Multimodal Art Projection — Original model: OpenCodeInterpreter DS 6.7B This repo contains State Of The Art quantized GGUF format model files for OpenCodeInterpreter DS 6.7B. Quantization was done with an importance matrix that was trained for ~1M tokens (256 batches of 4096 tokens) of answers from the CodeFeedback-Filtered-Instruction dataset. Everything has been reconverted and quantized with a new importance matrix using llama.cpp from April 29th 2024 onwards, as of commit f4ab2a4 to ensure correct pre-tokenization. The new GGUFs will work with older llama.cpp, but this may not generate correct prompt tokens, please use a recent build to ensure the best possible results! These quantised GGUFv3 files are compatible with llama.cpp from February 27th 2024 onwards, as of commit 0becb22 They are also compatible with many third party UIs and libraries provided they are built using a recent llama.cpp. GGMLTYPEIQ1S — 1-bit quantization in super-blocks with an importance matrix applied, effectively using 1.56 bits per weight (bpw) GGMLTYPEIQ1M — 1-bit quantization in super-blocks with an importance matrix applied, effectively using 1.75 bpw GGMLTYPEIQ2XXS — 2-bit…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат
Задача: Генерация текста
Автор: CISCai
Теги: gguf, code, en, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 1,588
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
