A community conversion of Google Gemma 4 E2B IT, targeting local language-model inference on RK3588-based Orange Pi hardware. Read the original blog draft: Tuning Gemma on the RK3588’s NPU for a local agent for the project history, numerical debugging, and benchmark comparisons. This release contains a hardware-targeted RKLLM artifact. It requires a compatible Rockchip RKLLM runtime and NPU driver; it cannot be loaded directly as a Transformers checkpoint, GGUF model, or generic RKNN vision model. September 22 update: the model now contains the benchmarked ctx16384opt0rebuild variant, published under the same download filename. Its SHA-256 starts with 9fced5f4; the initial upload started with d91331e5 and contained a different model of the same size. Use the checksum to identify your copy. The previous revision remains in repository history. The original conversion log is unavailable, so the exact build invocation, original upstream revision, and optimization level have not been independently recovered. A separate artifact named opt1 has the same full hash as this rebuild; the variant’s name alone is not evidence of its optimization level. The local project includes a text-only…
Модальности:
Генерация текста
Задача: Генерация текста
Автор: ndneighbor
Теги: rkllm, gemma4, rk3588, orangepi, quantized, edge-ai
Лайков: 3 | Загрузок: 132
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.