matatonic/OlympicCoder-32B-6.5bpw-h8-exl2

OlympicCoder-32B is a code mode that achieves very strong performance on competitive coding benchmarks such as LiveCodeBench andthe 2024 International Olympiad in Informatics. — Model type: A 32B parameter model fine-tuned on a decontaminated version of the codeforces dataset. — Language(s) (NLP): Primarily English — License: apache-2.0 — Finetuned from model: Qwen/Qwen2.5-Coder-32B-Instruct Here’s how you can run the model using the pipeline() function from 🤗 Transformers: The following hyperparameters were used during training on 16 H100 nodes: — dataset: open-r1/codeforces-cotsdecontaminated — learningrate: 4.0e-5 — trainbatchsize: 1 — seed: 42 — packing: false — distributedtype: fsdp — numdevices: 128 — gradientaccumulationsteps: 1 — totaltrain

Модальности:
Генерация текста

Области применения:
Диалог / чат Генерация кода

Задача: Генерация текста
Автор: matatonic
Теги: qwen2, conversational, en, exl2
Лайков: 3  |  Загрузок: 10

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.