thevox/en-nb-7b-direct - Каталог нейросетей
Генерация текста

thevox/en-nb-7b-direct

Добавлено:

English to Norwegian translation model, to rival DeepL natural translations. This model was trained using H2O LLM Studio. — Base model: mistralai/Mistral-7B-v0.1 Trained in 4-Bit with Lora (R=128) for 2 epochs. Perplexity on validation: 1.245 To use the model with the transformers library on a machine with GPUs, first make sure you have the transformers library installed. Also make sure you are providing your huggingface token to the pipeline if the model is lying in a private repo. — Either leave token=True in the pipeline and login to hugginface_hub by running You can print a sample prompt after the preprocessing step to see how it is feed to the tokenizer: Alternatively, you can download h2oaipipeline.py, store it alongside your notebook, and construct the pipeline yourself from the loaded model and tokenizer. If the model and the tokenizer are fully supported in the transformers package, this will allow you to set trustremotecode=False`. You may also construct the pipeline from the loaded model and tokenizer yourself and consider the preprocessing steps: You can load the models using quantization by specifying or . Also, sharding on multiple GPUs is possible by setting . This…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: thevox
Теги: mistral, gpt, llm, large language model, h2o-llmstudio, en, no, nb
Лайков: 2  |  Загрузок: 1

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.