Build LlamaCPP Refer to https://github.com/ggerganov/llama.cpp/blob/master/docs/build.md on how to build. Compute Infrastructure This model can be served with a GPU containing at least 8GB of VRAM. 1.5 Pints is a Large Language Model that significantly advances the efficiency of LLM training by emphasizing data quality over quantity. Our pre-training corpus is a meticulously curated dataset of 57 billion tokens, thus making pre-training more accessible and environmentally-friendly. MTBench MTBench is a popular evaluation harness that uses strong LLMs like GPT-4 to act as judges and assess the quality of the models’ responses./ The 16K context window version of 1.5-Pints can be found here. Architecture Llama 2 Autoregressive Model with 2K Context Window and Mistral tokenizer. The model uses Float32 precision. Context Lengths 1.5-Pints comes in 2 context lengths — 16k (16,384) and 2k (2,048). Prompt template This model has been finetuned and preference-optimized using the ChatML template. Direct Use This model is meant to be an efficient and fine-tunable helpful assistant. It is designed to excel in user assistance and reasoning, and rely less on internal knowledge and factuals.…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: pints-ai
Теги: gguf, llama, en, model-index, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 204
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
