 This is quantized version of lemon07r/Gemma-2-Ataraxy-9B created using llama.cpp Huge thanks to @mradermacher and @bartowski for making these GGUF quants available to us. Bartowski quants (imatrix): bartowski/Gemma-2-Ataraxy-9B-GGUF Mradermacher quants (static): mradermacher/Gemma-2-Ataraxy-9B-GGUF Mradermacher quants (imatrix): mradermacher/Gemma-2-Ataraxy-9B-i1-GGUF I think bartowski and mradermacher use different calibration data for imatrix quants, or maybe you prefer static quants. Pick your poison :). EXL2 quants from CameronRedmore: CameronRedmore/Gemma-2-Ataraxy-9B-exl2 That’s right, much to everyone’s surprise (mine included) this model has topped eqbench.com’s creative writing benchmark. Big thanks to _sqrkl for taking the time to bother benchmarking this model and adding it ot his leaderboard, and @nbeerbower for entertaining my suggestions for his amazing gutenberg tunes. I will be hosting this model in Q8_0 quant, with 4k context using…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: QuantFactory
Теги: gguf, endpoints_compatible, conversational
Лайков: 3 | Загрузок: 631
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
