This repo contains GPTQ model files for zai-org/GLM-4.7-Flash. (Pending PR into upstream). https://github.com/FayeSpica/vllm/tree/glmflashfix For local deployment, GLM-4.7-Flash supports inference frameworks including vLLM and SGLang. Comprehensive deployment instructions are available in the official Github repository. vLLM and SGLang only support GLM-4.7-Flash on their main branches. 👋 Join our Discord community. 📖 Check out the GLM-4.7 technical blog, technical report(GLM-4.5). 📍 Use GLM-4.7-Flash API services on Z.ai API Platform. 👉 One click to GLM-4.7. GLM-4.7-Flash is a 30B-A3B MoE model. As the strongest model in the 30B class, GLM-4.7-Flash offers a new option for lightweight deployment that balances performance and efficiency. For multi-turn agentic tasks (τ²-Bench and Terminal Bench 2), please turn on Preserved Thinking mode. For τ^2-Bench evaluation, we added an additional prompt to the Retail and Telecom user interaction to avoid failure modes caused by users ending the interaction incorrectly. For the Airline domain, we applied the domain fixes as proposed in the Claude Opus 4.5 release report. If you find our work useful in your research, please consider citing…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: FayeQuant
Теги: glm4_moe_lite, conversational, en, zh, endpoints_compatible, 4-bit, gptq
Лайков: 4 | Загрузок: 675
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
