0. TL;DR 1. Model Details 2. Training Details 3. Usage 4. Evaluation 5. Citation — Developed by: https://www.tii.ae — Model type: Causal decoder-only — Architecture: Hybrid Transformers + Mamba architecture — Language(s) (NLP): English — Number of Parameters: 90M — License: Falcon-LLM License For more details about the training protocol of this model, please refer to the Falcon-H1-Tiny technical blogpost. Currently to use this model you can either rely on Hugging Face transformers, vLLM, sglang, llama.cpp, ollama or mlx library. Refer to the snippet below to run H1 models using 🤗 transformers: You can find all GGUF files compatible with llama.cpp under [our official collection]() — an example setup could be: For vLLM, simply start a server by executing the command below: For detailed evaluation of Falcon-H1-Tiny series, please refer to our technical blogpost — View our release blogpost. — Feel free to join our discord server if you have any questions or to interact with our researchers and developers. If the Falcon-H1-Tiny family of models were helpful to your work, feel free to give us a cite.
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: tiiuae
Теги: falcon_h1, falcon-h1, edge, conversational, endpoints_compatible
Лайков: 4 | Загрузок: 273
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
