Particle 2.0 is a compact (~100M) chat model trained from scratch. It uses the same architecture as Particle 1.0. This release is a further train plus a supervised fine-tune on a new dataset mix. Training data is not published. The model is trained from random initialization. It is not a fine-tune of Llama, SmolLM, or any other public checkpoint. Continued training and a supervised fine-tune on a new dataset mix. The mix is not published. Research, evaluation, and small demos. Suitable for studying from-scratch training at ~100M scale. Not intended as a production assistant, a source of facts, or a coding model. — Small capacity: weak on reasoning, long context, and tools — Can hallucinate or contradict itself — English-centric — No preference tuning
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: prathamkode
Теги: llama, particle, conversational, en, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 152
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
