— Developed by: KillerShoaib — License: apache-2.0 — Finetuned from model : unsloth/llama-3-8b-bnb-4bit — Datset used for fine-tuning : iamshnoo/alpaca-cleaned-bengali — LoRA Adapters only — KillerShoaib/llama-3-8b-bangla-lora — GGUF q4km — KillerShoaib/llama-3-8b-bangla-GGUF-Q4KM Llama 3 8 billion model was finetuned using unsloth package on a cleaned Bangla alpaca dataset. After that the model was quantized in 4-bit. The model is finetuned for 2 epoch on a single T4 GPU. — The model can comprehend the Bangla language, including its semantic nuances — Given context model can answer the question based on the context — Model is unable to do creative or complex work. i.e: creating a poem or solving a math problem in Bangla — Since the size of the dataset was small, the model lacks lot of general knowledge in Bangla — Google Colab — Llama-3 8b Bangla Inference Script — Github Repo — Llama-3 Bangla
Модальности:
Генерация текста
Задача: Генерация текста
Автор: KillerShoaib
Теги: llama, text-generation-inference, unsloth, trl, bn, 4-bit, bitsandbytes
Лайков: 3 | Загрузок: 22
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
