marknchan/qwen3-4b-structured-output-lora

This repository provides a LoRA adapter fine-tuned from Qwen/Qwen3-4B-Instruct-2507 using QLoRA (4-bit, Unsloth). This repository contains LoRA adapter weights only. The base model must be loaded separately. This adapter is trained to improve structured output accuracy (JSON / YAML / XML / TOML / CSV). Loss is applied only to the final assistant output, while intermediate reasoning (Chain-of-Thought) is masked. — Base model: Qwen/Qwen3-4B-Instruct-2507 — Method: QLoRA (4-bit) — Max sequence length: 640 — Epochs: 1 — Learning rate: 1e-05 — LoRA: r=48, alpha=128 Dataset License: MIT License. This dataset is used and distributed under the terms of the MIT License. Compliance: Users must comply with the MIT license (including copyright notice) and the base model’s original terms of use.

Модальности:
Генерация текста

Задача: Генерация текста
Автор: marknchan
Теги: peft, qlora, lora, structured-output, en
Лайков: 3  |  Загрузок: 22

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.