Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm
A 295B-A21B MoE served on one 128 GB DGX Spark at 2.9 bits per parameter, through stock vLLM...
A 295B-A21B MoE served on one 128 GB DGX Spark at 2.9 bits per parameter, through stock vLLM...
Обучите LLM с нуля с параметром 1,38B, Pretrain+SFT+RL (GRPO/GSM8K) на одном RTX 5090 (32 ГБ). Перенесено из наночата...