This model is a fine-tuned version of microsoft/phi-2 on the WhiteRabbit Cybersecurity dataset. It achieves the following results on the evaluation set: — Loss: 0.5347 system You are Bunny, a helpful AI cyber researcher. Answer the Question in a logical, step-by-step manner that makes the reasoning process clear. Carefully analyze the question to identify the core issue or problem to be solved. user {prompt} assistant The following hyperparameters were used during training: — learningrate: 0.0002 — trainbatchsize: 2 — evalbatchsize: 2 — seed: 42 — gradientaccumulationsteps: 8 — totaltrainbatchsize: 16 — optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-05 — lrschedulertype: cosine — lrschedulerwarmupsteps: 100 — numepochs: 5 — PEFT 0.8.1.dev0 — Transformers 4.37.0 — Pytorch 2.1.2+cu121 — Datasets 2.16.1 — Tokenizers 0.15.0
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: justinj92
Теги: gguf, phi, axolotl, generated_from_trainer, conversational, custom_code, text-generation-inference, endpoints_compatible
Лайков: 3 | Загрузок: 84
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
