QuantFactory/instinct-GGUF

This is quantized version of continuedev/instinct created using llama.cpp This repo contains the model weights for Continue’s state-of-the-art open Next Edit model, Instinct. Robustly fine-tuned from Qwen2.5-Coder-7B on our dataset of real-world code edits, Instinct intelligently predicts your next move to keep you in flow. Ollama: We’ve released a Q4KM GGUF quantization of Instinct for efficient local inference. Try it with Continue’s Ollama integration, or just run ollama run nate/instinct. You can also serve the model using either of the below options, then connect it with Continue. SGLang: python3 -m sglang.launchserver —model-path continuedev/instinct —load-format safetensors vLLM: vllm serve continuedev/instinct —served-model-name instinct —load-format safetensors`

Модальности:
Генерация текста

Области применения:
Диалог / чат

Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, endpoints_compatible, conversational
Лайков: 4  |  Загрузок: 170

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.