Mistral Code Architect 7B is a highly specialized, locally fine-tuned large language model designed for advanced software development, deep debugging, and cybersecurity analysis. It has been trained to act as an autonomous coding assistant that provides robust, production-ready code and reasoning traces. — Architecture: Mistral 7B (Quantized to GGUF q4km) — Base Model: unsloth/mistral-7b-instruct-v0.3-bnb-4bit — Context Length: 4096 tokens — Training Framework: Unsloth (QLoRA) — Training Hardware: NVIDIA RTX 5070 (12 GB VRAM) — Language Support: Dynamic (Optimized for English and German) The model was fine-tuned using a curated mix of approximately 25,000 high-quality coding and security samples. The training pipeline heavily utilized packing (packing=True) to maximize context efficiency during the QLoRA fine-tuning process. The dataset mixture includes: — CodeFeedback: Filtered instruction-following for robust code generation. — WebDev-Arena: Preference-based web development queries (React, Next.js, Backend). — CyberGym & Security-Code: Specialized datasets focusing on vulnerability detection, memory safety, and secure patching strategies. — IFEval: To strictly adhere to system…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат
Задача: Генерация текста
Автор: Lautloserspieler
Теги: gguf, coding, security, mistral, unsloth, qlora, en, de
Лайков: 3 | Загрузок: 21
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
