This is a meta-llama/Meta-Llama-3-8B-Instruct model that finetuned on Japanese conversation dataset. To use the model with the transformers library on a machine with GPUs, first make sure you have the transformers library installed. Also make sure you are providing your huggingface token to the pipeline if the model is lying in a private repo. — Either leave token=True in the pipeline and login to hugginface_hub by running You can print a sample prompt after applying chat template to see how it is feed to the tokenizer: You may also construct the pipeline from the loaded model and tokenizer yourself and consider the preprocessing steps: You can load the models using quantization by specifying or . Also, sharding on multiple GPUs is possible by setting . This model was trained using H2O LLM Studio and with the configuration in cfg.yaml. Visit H2O LLM Studio to learn how to train your own large language models. Please read this disclaimer carefully before using the large language model provided in this repository. Your use of the model signifies your agreement to the following terms and conditions. — Biases and Offensiveness: The large language model is trained on a diverse range…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: haqishen
Теги: llama, gpt, llm, large language model, h2o-llmstudio, conversational, en, ja
Лайков: 3 | Загрузок: 76
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
