LH-Tech-AI/htmLLM-124M

With this LLM, we wanted to see, how well tiny LLMs with just 124 million parameters can perform on coding tasks. This model is also a bit finetuned using html_alpaca directly in the pretraining. If you want to try it, you can use htmllm.ipynb in the HF model files and download the model weight from this HF model. All code can be accessed via the file htmllmv2124m.ipynb in this HF model. The final base model checkpoint can be downloaded here in the files list as ckpt.pt. — Andrej Karpathy and his nanoGPT code — Kaggle for the free GPU hours for training on the T4 — You all for your support on my reddit.

Модальности:
Генерация текста

Области применения:
Генерация кода

Задача: Генерация текста
Автор: LH-Tech-AI
Теги: gpt2, code, coding, small, tiny, en
Лайков: 4  |  Загрузок: 20

Открыть на HuggingFace →

Описание основано на материалах HuggingFace. Перевод выполнен автоматически.