> ⚠️ THIS MODEL IS UNCENSORED — USE IT RESPONSIBLY ⚠️ > > This model has no content filters or safety guardrails. By using this model, you accept full responsibility for its output. Do NOT use for illegal, harmful, or unethical purposes. GRTEAM does not endorse or take responsibility for any content generated by this model. ⚡ 51 tokens/second on NVIDIA Jetson AGX Orin 64GB — No Reasoning Mode with Multi-Token Prediction 🇬🇷 Built in Greece by GRTEAM — Proud Greek engineering pushing edge AI to its limits! 🙏 Special Kudos to darkc0de — Creator of XORTRON, the awesome fine-tune that powers this model. > 💡 51 t/s on edge hardware — This is achieved by disabling the reasoning/thinking mode and leveraging Qwen 3.6’s built-in MTP heads for speculative decoding. No separate draft model needed — the MTP heads are embedded in the same GGUF file. — Base Architecture: Qwen3-35B-A3B (MoE — Mixture of Experts) — Active Parameters: ~3B per token (A3B = Active 3 Billion) — Total Parameters: ~35B — Quantization: Q5KM (5-bit, K-quants, Medium) — File Size: ~25.6 GB — Format: GGUF (llama.cpp compatible) — MTP Heads: Built-in Multi-Token Prediction heads (no separate draft model needed) MTP is a…
Модальности:
Генерация текста
Области применения:
Диалог / чат Мультиязычность
Задача: Генерация текста
Автор: grteam
Теги: gguf, qwen, qwen3.6, xortron, mtp, multi-token-prediction, speculative-decoding, nvidia-jetson
Лайков: 3 | Загрузок: 46
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
