We have a free Google Colab Tesla T4 notebook for Mistral (7B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Mistralv0.3(7B)-Conversational.ipynb All notebooks are beginner friendly! Add your dataset, click «Run All», and you’ll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face. — This Llama 3.2 conversational notebook-Conversational.ipynb) is useful for ShareGPT ChatML / Vicuna templates. — This text completion notebook-TextCompletion.ipynb) is for raw text. This DPO notebook replicates Zephyr. — Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster. Mistral Small 3 ( 2501 ) sets a new benchmark in the «small» Large Language Models category below 70B, boasting 24B parameters and achieving state-of-the-art capabilities comparable to larger models! This model is an instruction-fine-tuned version of the base model: Mistral-Small-24B-Base-2501. Mistral Small can be deployed locally and is exceptionally «knowledge-dense», fitting in a single RTX 4090 or a 32GB RAM MacBook once quantized. Perfect for: — Fast response conversational agents. — Low latency function calling. — Subject matter…
Модальности:
Генерация текста
Области применения:
Следование инструкциям
Задача: Генерация текста
Автор: unsloth
Теги: mistral, unsloth, mistral-instruct, instruct, en, text-generation-inference, endpoints_compatible, 4-bit
Лайков: 3 | Загрузок: 280
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
