PLaMo-13B-Instruct-NC is a noncommercial instruct fine-tuned model built upon the 8192 context length version of PLaMo-13B text generation model. PLaMo-13B-Instruct-NC is fine-tuned using multiple publicly available Japanese datasets. This model is released under CC-BY-NC-4.0. — Model size: 13B — Trained tokens: 1.5T tokens (English: 1.32T tokens, Japanese: 0.18T tokens) — Tokenizer: sentencepiece tokenizer trained on a subset of the pretraining datasets. — Context length: 8192 — Developed by: Preferred Networks, Inc — Model type: Causal decoder-only — Language(s): Japanese and English — License: CC-BY-NC-4.0 — Stanford Alpaca (Japanese translation) — databricks-dolly-15k (Japanese translation) — Anthropic HH-RLHF (Japanese translation, subset) — OpenAssistant Conversations Dataset (Japanese translation, oasst1) — Wikinews subset of Izumi-lab llm-japanese-dataset PLaMo-13B-Instruct-NC is a new technology that carries risks with use. Testing conducted to date has been in English and Japanese, and has not covered, nor could it cover all scenarios. For these reasons, as with all LLMs, PLaMo-13B-Instruct-NC’s potential outputs cannot be predicted in advance, and the model may in some…
Модальности:
Генерация текста
Области применения:
Диалог / чат Следование инструкциям
Задача: Генерация текста
Автор: pfnet
Теги: plamo, conversational, custom_code, en, ja
Лайков: 3 | Загрузок: 115
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
