Extensive testing has been carried out to create this LLM for OpenZero and other agentic software. 1 billion tokens used in tests gpt 5.6 codex to ensure this LLM is high quality! 10 LMM’s were tested this LLM is the final result as it passed all agentic tests, high effort went into this LLM !OpenZero Ministral 8B Runtime Agent A local GGUF for llama.cpp, based on Ministral 3 8B Instruct, packaged for OpenZero / Agent Zero workflows involving coding, research, structured tool use, privacy-aware operation and evidence-bounded answers. The release contains one verified Q5KM model for practical CPU deployment. > Provenance: upstream model weights are unchanged. This is a runtime-template edition, not a weight fine-tune and not a cross-model merge. hf download shafire/OpenZero-Ministral3-8B-Runtime-Agent-GGUF OpenZero-Ministral3-8B-Runtime-Agent-Q5KM.gguf —local-dir . llama-cli -m OpenZero-Ministral3-8B-Runtime-Agent-Q5KM.gguf -c 4096 -n 512 -ngl 0 For constrained RAM, start with -c 2048. GPU offload can be enabled by increasing -ngl where supported. — Preserved the official upstream weights exactly. — Patched and embedded the standalone chat_template.jinja as a GGUF runtime…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат Вызов функций (Tool use)
Задача: Генерация текста
Автор: shafire
Теги: gguf, llama-cpp, ministral, openzero, agent-zero, local-ai, agentic, tool-use
Лайков: 3 | Загрузок: 138
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
