— Llama-3.2-3B-Instruct.Q80.gguf — Llama-3.2-3B-Instruct.Q4KM.gguf` — Base Model: unsloth/Meta-Llama-3.2-3B-Instruct-bnb-4bit — Original LoRA Model: samunder12/llama-3.2-3b-roleplay-lora — Fine-tuning Method: PEFT (LoRA) with Unsloth’s performance optimizations. — LoRA Rank (r): 64 — Format: GGUF — Quantization: Q4KM , Q80 — contextwindow 4096 Llama-3.2-3B-smallShiroroleplay-gguf is a fine-tuned version of Llama 3.2 3B Instruct, specifically crafted to be a master of high-concept, witty immersive , and darkly , intense creative writing. This isn’t your average storyteller. Trained on a curated dataset of absurd and imaginative scenarios—from sentient taxidermy raccoons to cryptid dating apps—this model excels at generating unique characters, crafting engaging scenes, and building fantastical worlds with a distinct, cynical voice. If you need a creative partner to brainstorm the bizarre, this is the model for you. This model was fine-tuned using the Unsloth library for peak performance and memory efficiency. Provided files: LoRA adapter for use with the base model. GGUF (q4km) version for easy inference on local machines with llama.cpp, LM Studio, Ollama, etc. This model is…
Модальности:
Генерация текста
Области применения:
Следование инструкциям Диалог / чат
Задача: Генерация текста
Автор: samunder12
Теги: gguf, llama, roleplay, rp, character, peft, unsloth, llama-3.2
Лайков: 4 | Загрузок: 1,162
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
