CastIronMind/Stentor-Big - Каталог нейросетей
Генерация текста

CastIronMind/Stentor-Big

Добавлено:
CastIronMind/Stentor-Big

Stentor-Big is a direct expansion of the original Stentor-30M model developed by Kai Izumoto (StentorLabs). The architecture was scaled up from 30M to 142M parameters by increasing the hidden size, number of layers, and intermediate dimensions while preserving the pre-trained weights where possible. This approach allows the model to retain the linguistic foundations learned by its smaller counterpart while gaining additional capacity through new randomly initialized layers. Stentor-Big is a compact language model with 142 million parameters, built upon the Llama architecture. It is the result of a three-stage continual pre-training process designed to combine broad linguistic competence, narrative coherence, and structured academic style. The model is intended as a strong base for further fine‑tuning or direct use in educational text generation, creative writing assistance, and prototyping of small‑scale language applications. Developed by: stas122 Model type: Causal language model (LlamaForCausalLM) Language: English Parameters: 142,639,104 (142.6M) Context length: 512 tokens License: Apache 2.0 (the original base model Stentor‑30M is also Apache 2.0) The architecture follows the…

Модальности:
Генерация текста


Задача: Генерация текста
Автор: CastIronMind
Теги: llama, causal-lm, small-language-model, slm, 142m, educational, fanfiction, academic
Лайков: 4  |  Загрузок: 28

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.