Hy3-oQ2e-MTPLX-streaming
2-bit Hunyuan 3.0 (295B-A21B MoE) for Apple Silicon, packaged for SSD-streamed serving with MTPLX. Weights stream from SSD...
2-bit Hunyuan 3.0 (295B-A21B MoE) for Apple Silicon, packaged for SSD-streamed serving with MTPLX. Weights stream from SSD...
A 295B-A21B MoE served on one 128 GB DGX Spark at 2.9 bits per parameter, through stock vLLM...
This repository contains a 4-bit RTN-quantized version of the Tencent Hy3 Mixture-of-Experts model. Hy3 is a 295B-parameter MoE...
INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED...
INVALID LANGUAGE PAIR SPECIFIED. EXAMPLE: LANGPAIR=EN|IT USING 2 LETTER ISO OR RFC3066 LIKE ZH-CN. ALMOST ALL LANGUAGES SUPPORTED...
An MLX port of tencent/Hy3 (Tencent Hunyuan 3, hyv3`), a 295B-parameter Mixture-of-Experts model (21B active, 192 experts top-8,...
UXBench-GRM is a Pointwise Generative Reward Model trained to predict real user satisfaction with AI assistant responses. It...
This repository contains GGUF conversions and quantizations of Tencent’s tencent/Hy-MT2-30B-A3B translation model for llama.cpp-compatible inference. SHA256 sidecar files...
Tencent Hy3-preview — 102 GB on disk (down from ~557 GB BF16 source) — mixed-bit JANGTQK quantization on...
A 33%-expert-pruned version of Tencent Hunyuan Hy3 (295B / A21B), compressed with REAP (Router-weighted Expert Activation Pruning) —...