Quantized GGUF model files for stablelm-2-1_6b from stabilityai Stable LM 2 1.6B is a 1.6 billion parameter decoder-only language model pre-trained on 2 trillion tokens of diverse multilingual and code datasets for two epochs. Get started generating text with Stable LM 2 1.6B by using the following code snippet: Developed by: Stability AI Model type: Stable LM 2 1.6B models are auto-regressive language models based on the transformer decoder architecture. Language(s): English Library: GPT-NeoX License: Stability AI Non-Commercial Research Community License. If you’d like to use this model for commercial products or purposes, please contact us here to learn more. Contact: For questions and comments about the model, please email lm@stability.ai The model is a decoder-only transformer similar to the LLaMA (Touvron et al., 2023) architecture with the following modifications: Position Embeddings: Rotary Position Embeddings (Su et al., 2021) applied to the first 25% of head embedding dimensions for improved throughput following Black et al. (2022). Normalization: LayerNorm (Ba et al., 2016) with learned bias terms as opposed to RMSNorm (Zhang & Sennrich, 2019). Biases: We remove…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: afrideva
Теги: gguf, causal-lm, ggml, quantized, q2_k, q3_k_m, q4_k_m, q5_k_m
Лайков: 3 | Загрузок: 476
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
