This is the full-precision fused model for Bharat-Tiny-LLM — the LoRA adapter merged into the base Qwen2.5-1.5B weights, in PyTorch float16. Use this repo when you want to: — run inference on CPU / CUDA with transformers, — fine-tune further, or — produce your own quantized builds (GGUF, MLX, etc.). > ⚠️ Generation config matters. The base Qwen2.5-1.5B emits garbled out-of-script tokens > at high temperature. Always use temperature ≈ 0.3 + repetitionpenalty ≥ 1.25 + > norepeatngramsize = 3. The bharat-tiny-llm > PyPI package applies these for you. — 🤗 Edge model (MLX): https://huggingface.co/eulogik/Bharat-Tiny-LLM — 🤗 GGUF (llama.cpp): https://huggingface.co/eulogik/Bharat-Tiny-LLM-GGUF — 🚀 Demo: https://huggingface.co/spaces/eulogik/bharat-tiny-llm-v3-demo — 💻 Source: https://github.com/eulogik/Bharat-Tiny-LLM — 📦 PyPI: https://pypi.org/project/bharat-tiny-llm/ — 🏢 Built by eulogik Apache-2.0 (base Qwen2.5-1.5B weights Apache-2.0; LoRA adapter Apache-2.0).
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: eulogik
Теги: qwen2, hinglish, hindi, indian-languages, fused, fp16, qwen, bharat
Лайков: 3 | Загрузок: 99
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
