> [!NOTE] > Quantized, repackaged variants of google/gemma-3-1b-it > precompiled (AOT) for the Google Tensor Edge TPU NPU across Pixel generations. > Packaged as .litertlm bundles for LiteRT-LM. > G3/G4 = int4 per-channel + Hadamard · G5/G6 = int8. > (This repo was previously named Gemma3-1B-IT-Tensor-G4-NPU.) > [!IMPORTANT] > Community build — not an official Google release. Built and maintained by @xThr45hx; not > affiliated with or endorsed by Google. > [!NOTE] > Why int8 on G5/G6? On a retail Tensor G6 (santafea0) every int4 variant we compiled with > the Tensor SDK v2.1 runs on the NPU but produces word salad. That covers int4 + Hadamard, plain > per-channel int4, mixed int8-head + int4-body, blockwise-64 int4, and several compiler-option > combinations (8 builds in total). The same graph quantized to int8 is coherent on the NPU. > The int4 path on G6 is not yet working with the current compiler, and that is not a quant-recipe > problem we could fix on our side. G5 uses the same int8 recipe as G6. Google’s own G5/G6 > Gemma 3 1B bundles are also int8. > > The earlier int4 G5/G6 bundles in this repo have been removed**. The G6 one failed warmup on a > retail Pixel 11 (it was…
Модальности:
Генерация текста
Области применения:
Диалог / чат
Задача: Генерация текста
Автор: litert-community
Теги: litert-lm, litertlm, gemma3, chat, npu, edge-tpu, tensor-npu, tensor-g3
Лайков: 3 | Загрузок: 2,195
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
