> krē-ə plural crias. : a baby llama, alpaca, vicuña, or guanaco. or what ChatGPT suggests, «Crafting a Rapid prototype of an Intelligent llm App using open source resources». The initial objective of the CRIA project is to develop a comprehensive end-to-end chatbot system, starting from the instruction-tuning of a large language model and extending to its deployment on the web using frameworks such as Next.js. Specifically, we have fine-tuned the llama-2-7b-chat-hf model with QLoRA (4-bit precision) using the mlabonne/CodeLlama-2-20k dataset. This fine-tuned model serves as the backbone for the CRIA chat platform. — davzoku/cria-llama2-7b-v1.3: Merged Model — davzoku/cria-llama2-7b-v1.3-GGML: Quantized Merged Model — davzoku/cria-llama2-7b-v1.3_peft: PEFT adapter It was trained on a Google Colab notebook with a T4 GPU and high RAM. The following bitsandbytes quantization config was used during training: — loadin8bit: False — loadin4bit: True — llmint8threshold: 6.0 — llmint8skipmodules: None — llmint8enablefp32cpuoffload: False — llmint8hasfp16weight: False — bnb4bitquanttype: nf4 — bnb4bitusedoublequant: False — bnb4bitcomputedtype: float16 — mlabonne for his article and…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: davzoku
Теги: llama, llama-2, en, text-generation-inference
Лайков: 2 | Загрузок: 61
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
