---
title: "On-Device"
description: "2 posts about On-Device, summarised, each linking to the original."
---

# On-Device
> 2 posts about On-Device, summarised, each linking to the original.

## Articles

### [BotPsy: On-Device Personal Assistant with a Sub-Billion-Parameter Agentic Language Model](https://yomu.fyi/post/botpsy-on-device-personal-assistant-with-a-sub-billion-parameter-agent.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Milan Gritta, Jihye Back, JinUk, Cho, ohjoon kwon, Patrik Lambert, Mathias Buus, Amril Nurman
- Published: Nov 11, 2026
- Type: Announcement

Tether AI Research introduces BotPsy, a 0.8B-parameter model designed for on-device function calling and agentic workflows, built on Qwen3.5-0.8B. It achieves state-of-the-art tool-use and agentic performance for its size, outperforming every model up to 1.2B parameters on five of six benchmarks, including beating Qwen3.5-2B-Think on BFCL v4, ACEBench, τ-bench, ToolSandbox, and BrowseComp-Plus. BotPsy roughly doubles the agentic capability of its base model, with BFCL v4 rising from 23.4 to 44.0 and τ-bench from 23.2 to 51.5. It demonstrates improved safety, with unsafe responses dropping from 36% to 21% in automated red-teaming, and more efficient reasoning, using about 3× fewer reasoning tokens on GPQA Diamond than its base model. The model is released with open weights under Apache 2.0 for research and educational use in bf16, Q8, and Q4 precisions.


### [On-Device Speech Recognition and Text-to-Speech in Google AI Edge Gallery](https://yomu.fyi/post/on-device-speech-recognition-and-text-to-speech-in-google-ai-edge-gall.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Google AI Edge Team, Android ML Team
- Published: Nov 10, 2026
- Type: Announcement

Google AI Edge Gallery now includes on-device Automatic Speech Recognition (ASR) and Text-to-Speech (TTS), enabling offline voice interactions on phones and wearables. ML Kit for Android delivers multilingual ASR across 100+ languages at 10x real-time speed with 8-9% Word Error Rate on FLEURS, and a diffusion TTS that begins speaking in ~100 ms, synthesizes 24 kHz audio at up to 50x real-time speed, and cuts power by over 50%. For cross-platform apps, MediaPipe Tasks and LiteRT support open-weight models like Parakeet-TDT 0.6B, PocketTTS 100M, Kokoro-82M, and Phonon 31M, packaged as single .litertlm files. These models run alongside on-device small language models like Gemini Nano and Gemma 4, powering the XR Language Teacher showcase with bilingual TTS code-switching and voice-enabled AI Chat with sentence-synchronized playback. All building blocks, including ML Kit APIs, MediaPipe Tasks, and LiteRT model bundles, are available today for developers to integrate into their own apps.
