A decensored version of Daemontatox/Llama-Opus-Z8, made using Heretic v1.1.0 Model Name: Daemontatox/Llama-Opus-Z8 Base Model: allura-forge/Llama-3.3-8B-Instruct Model Type: Causal Language Model (Instruction-Tuned) Architecture: Llama 3.3 (8B parameters) Fine-tuning Methods: Supervised Fine-Tuning (SFT) + Group Relative Policy Optimization (GRPO) License: Llama 3.3 Community License Llama-Opus-Z8 is a fine-tuned version of the Llama 3.3 8B Instruct model, enhanced through a This model leverages the extracted Llama 3.3 8B weights (originally accessible only via Meta’s Llama API) and applies advanced alignment techniques for improved reasoning and instruction-following capabilities. The base model (allura-forge/Llama-3.3-8B-Instruct) represents Llama 3.3 8B Instruct weights extracted from Meta’s Llama API. While initially configured with 8K context, the model supports extension to 128K context through appropriate RoPE scaling configuration. Stage 1: Supervised Fine-Tuning (SFT) — High-quality instruction-following datasets — Supervised learning to…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: ChiKoi7
Теги: llama, text-generation-inference, unsloth, Uncensored, Heretic, conversational, en, endpoints_compatible
Лайков: 3 | Загрузок: 25
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
