This modelcard is for tinymistral-v2-pycoder-instruct, a python-specific code generation model on top of Locutusque/TinyMistral-248M-v2-Instruct. This instruct model follows the original in using ChatML format. An empty prompt will return various information from the base model, but using the instruct format will deliver python code of varying quality. Model is in active development, base model is in active development, and all should be treated with caution. — Developed by: [Locutusque and M4ai] — Funded by: [Lint from a corner pocket] — Shared by: jtatman — Model type: MistralForCausalLM — License: [MIT] — **Finetuned from model Locutusque/TinyMistral-248M-v2 Probably could be fine tuned with a more comprehensive dataset. Experiments are in progress. user Write a function for multiplying two numbers, from variables ‘a’ and ‘b’. assistant Custom formatted existing python data from: — jtatman/python-code-dataset-500k — jtatman/python-github-code-instruct-filtered-5k — jtatman/pilepythoninstruct_format — Training regime: fp16, merge of parameter fine-tune adapters when necessary and helpful. — epoch: 4.87 — globalstep: 220 — learningrate: 0.00006713780918727916 — loss: 2.3736
Модальности:
Генерация текста
Области применения:
Генерация кода Следование инструкциям
Задача: Генерация текста
Автор: jtatman
Теги: mistral, code, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 26
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
