Nemotron-3.5-Bolt-E4B-Artemis-FP8
Tested with vLLM 0.32.0rc1 (a development build). Every result below was measured with thinking off; BFCL-v3 ran at...
Tested with vLLM 0.32.0rc1 (a development build). Every result below was measured with thinking off; BFCL-v3 ran at...
🤗 Hugging Face | 🤖 ModelScope | 🐙 Vercel Ling-3.0-flash-Sante-fp8 is the FP8-quantized release of Ling-3.0-flash-Sante,...
inclusionAI/Ling-3.1-flash の公式FP8を出発点に、SGLang専用のNVFP4保存版を作り、そこへweights-only abliteration (T24) を焼き込み、さらにNEXTN 3-stepのMTP draftを同梱した保存版です。 通常のHugging Face量子化モデルではありません。vLLM/Transformers/GGUFでそのまま動く形式でもありません。 固定SGLang image・TP4/EP4・同梱patch・記載のGPU世代を維持した場合のみ再現できます。 draft/ は本体の model.wordembeddings / lmhead を共有する前提で、model.layers.72. だけを持ちます。量子化configは取り除いてあります(unquant...
GGUF, Safetensors, and MLX quantized formats of tencent/Hy-Memory-30B-A3B for local memory operations and agent execution. Tencent’s Hy-Memory-30B-A3B is...
A 27B model that texts like a person and still does the work, in FP8 for 32 to...
This is UkisAI’s Swift 1.5 Qwen3.8-Flash-Next AutoRound W4A16 checkpoint, repackaged to match the layout of albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE. That layout...
FP4-quantized build of orcarouter/Qwen3.8-27B-Uncensored (BF16), preserving the abliteration edits byte-for-byte — this is a quantization of the uncensored...
👋 Присоединяйтесь к сообществу WeChat или Discord. 📖 Ознакомьтесь с блогом GLM-5.3-Flash и техническим отчетом GLM-5. 📍 Используйте...
FP8 quantization of amalia-llm/AMALIA-9B-0626-DPO, the European Portuguese language model, for serving with vLLM. To the best of our...
An abliterated (refusal-ablated) build of deepseek-ai/DeepSeek-V4-Flash-0731. Produced by a forward-only, closed-form weight edit — no training, no fine-tuning,...