The language model LLama-3-8B-Tele is a Transformer with 8 billion parameters, specialized in telecommunications. It is based on Meta LLama-3-8B and was continutally pretrained on Tele-Data, a large-scale dataset of approximately 2.5 billion tokens of telecommunications material, including articles, standards, and general web content related to the telecommunications domain. When assessed against telecommunications benchmarks such as Tele-Eval, LLama-3-8B-Tele outperforms LLama-3-8B by several percentage points. Additionally, LLama-3-8B-Tele matches LLama-3-8B across benchmarks related to common sense, language understanding, and logical reasoning. Thus, this adaptation was achieved with minimal compromise in performance on the original version. LLama-3-8B-Tele is a base model best suited for fine-tuning on applications related to telecommunications. It has not been fine-tuned to follow instructions and operates solely within a text completion framework. An example of this completion can be found below: The instruct version of this model can be found by following the link LLama-3-8B-Tele-it. Below we share some code snippets on how to get quickly started with running the model.…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: AliMaatouk
Теги: llama, nlp, en
Лайков: 3 | Загрузок: 30
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
