Dynamic 4-bit: Unsloth’s Dynamic 4-bit Quants selectively avoids quantizing certain parameters, greatly increase accuracy than standard 4-bit.See our full collection of Unsloth quants on Hugging Face here. We have a free Google Colab Tesla T4 notebook for Llama 3.2 (3B) here: https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Llama3.1_(8B)-Alpaca.ipynb unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit For more details on the model, please go to Meta’s original model card All notebooks are beginner friendly! Add your dataset, click «Run All», and you’ll get a 2x faster finetuned model which can be exported to GGUF, vLLM or uploaded to Hugging Face. — This Llama 3.2 conversational notebook-Conversational.ipynb) is useful for ShareGPT ChatML / Vicuna templates. — This text completion notebook-TextCompletion.ipynb) is for raw text. This DPO notebook replicates Zephyr. — Kaggle has 2x T4s, but we use 1. Due to overhead, 1x T4 is 5x faster. A huge thank you to the Meta and Llama team for creating and releasing these models. The Meta Llama 3.2 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction-tuned generative…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: unsloth
Теги: llama, llama-3, meta, facebook, unsloth, conversational, en, text-generation-inference
Лайков: 4 | Загрузок: 27,310
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
