GGUF layer package for running Qwen3.6-27B-UD-Q4KXL across a local Mesh LLM cluster. This package is derived from unsloth/Qwen3.6-27B-MTP-GGUF and keeps the original GGUF distribution split into per-layer artifacts for distributed inference. — Local and private inference with Mesh LLM. — Multi-machine serving when the full GGUF is too large for one host. — OpenAI-compatible chat/completions workflows through Mesh LLM’s local API. For upstream architecture details, chat template guidance, sampling recommendations, license terms, and benchmark notes, see the source model card: unsloth/Qwen3.6-27B-MTP-GGUF. Generated by the Mesh LLM HF Jobs splitter from mesh-llm ref main. Each artifact is checksummed as it is written, uploaded to this repository, and removed from the job workspace before the next artifact is produced. — Source model: unsloth/Qwen3.6-27B-MTP-GGUF — Mesh LLM website: meshllm.cloud — Mesh LLM: github.com/Mesh-LLM/mesh-llm — Discord: discord.gg/rs6fmc63eN — Package catalog: meshllm/catalog — Package format: layer-package-repos.md
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: meshllm
Теги: mesh-llm, gguf, layer-package, skippy, distributed-inference, local-inference, openai-compatible, endpoints_compatible
Лайков: 4 | Загрузок: 3,654
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
