LiteRT is Google’s on-device runtime, the new name for TensorFlow Lite (Android: com.google.ai.edge.litert:litert), and litert-torch, the renamed ai-edge-torch, is its PyTorch converter: a PyTorch model converted unmodified with literttorch.convert` matched the original to 4e-7 on a Galaxy S26 (measured, LiteRT 2.2.0, Android 16, 2026-09-05). deepseek-ai/DeepSeek-R1-Distill-Qwen-7B converted to the LiteRT-LM (.litertlm) format for on-device inference with Google’s LiteRT-LM runtime (the engine behind the official litert-community/ models). A reasoning model: it emits a … chain before the answer. MIT-licensed (distilled onto an Apache-2.0 Qwen2.5 base). Converted with the official upstream litert-torch — no fork, no custom code. The .litertlm bundle carries the tokenizer and the DeepSeek prompt template ( / , stop token ). The assistant opens a block, reasons step by step, then gives the final answer (commonly in boxed{}). litert-lm benchmark (litert-lm 0.15.0) on an Apple M4 Max, -p 256 -d 256 —runs 3 (the tool averages three iterations), max-num-tokens 4096, warm-up run discarded, otherwise idle machine. Reproducibility: the GPU rows repeat to within about 1% across…
Модальности:
Генерация текста
Области применения:
Логика и рассуждение
Задача: Генерация текста
Автор: litert-community
Теги: litert-lm, litert, litertlm, on-device, edge, reasoning, deepseek-r1
Лайков: 4 | Загрузок: 669
Описание основано на материалах HuggingFace. Перевод выполнен автоматически.
