Exllamav3 quantizations of Qwen/Qwen3-235B-A22B-Thinking-2507 2.10 bpw h6 59.287 GiB 2.80 bpw h6 78.295 GiB 3.60 bpw h6 100.116 GiB 4.25 bpw h6 117.803 GiB The 2.10 bpw quant will fit in three 24 GB cards with 45k of context. The 2.80 bpw quant will fit in four 24 GB cards with 57k of context. The 3.60 bpw quant will fit in five 24 GB cards with 57k of context. The 4.25 bpw quant will fit in six 24 GB cards with 73k of context.
Модальности:
Генерация текста
Задача: Генерация текста
Автор: MikeRoz
Теги: exllamav3, exl3
Лайков: 4 | Загрузок: 1
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.