PicoStories-853K is an ultra-compact, «pico-sized» language model based on the Mistral architecture, trained from scratch by Pico-Kittens. It is designed for minimal-resource environments where standard LLMs cannot operate. Developed by: Pico-Kittens Model type: Mistral-based Language Model Training Status: Trained from scratch (Not a fine-tune) Parameters: 853,120 Language(s): English License: apache-2.0 PicoStories-853K is a specialized model for short-form narrative generation. At the 853,120 parameter scale, the model exhibits the following characteristics: Syntax: Capable of maintaining basic English sentence structures and punctuation. Narrative Flow: Follows a story-like progression, though logic can become surreal or abstract as the generation length increases. Vocabulary: Demonstrates «creative» word usage (e.g., «spenty fedful») when navigating low-probability token sequences. Coherence: Best suited for short, single-paragraph generations. PicoStories-853K: > Once upon a time there was an old man who lived in a big house with his family. His parents had a very special toy and he loved it so much that everyone loved him. > > One day, the old man’s family decided…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: PicoKittens
Теги: mistral, pico-sized, small language model, en
Лайков: 3 | Загрузок: 98
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
