Devstral Small 2507 is a powerful choice for local inference, achieving SOTA open source results at just 24B parameters. However, Roblox gamedev and Luau programming are generally not well represented in LLM training data. This model fine tunes Devstral on a corpus of permissively licensed Luau code and Roblox documentation, improving the model’s Luau programming capabilities. Additionally, the jinja chat template contains a default system prompt that steers the model’s Luau capabilities even further. — Developed by: Zack Williams (boatbomber) — Funded by: Torpedo Software LLC — License: Apache 2.0 — Finetuned from model: unsloth/Devstral-Small-2507 — Repository: https://huggingface.co/mistralai/Devstral-Small-2507 — Blog: https://mistral.ai/news/devstral-2507 1. https://huggingface.co/datasets/TorpedoSoftware/the-luau-stack 25.917M lines of real Luau code, 0.452B tokens. Format: Lua {file_content} 1. https://huggingface.co/datasets/TorpedoSoftware/roblox-info-dump 19.6K pages of multilingual Roblox documentation, 0.149B tokens. Format: md {content} Trained a LoRA adapter (r=64) at full precision on two epochs of the dataset for a total of 54,630 steps and 43.40 E FLOPs. Then…
Модальности:
Генерация текста
Области применения:
Генерация кода Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: TorpedoSoftware
Теги: gguf, mistral, roblox, luau, code, sft, trl, unsloth
Лайков: 4 | Загрузок: 402
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
