AI at Zero Token Cost: Local-First Browser AI and Prompt API
Build AI features with no per-token bill. In this 40-minute workshop, explore local-first browser AI with the Angular reference app Nano Cinema, using live demos and hands-on exercises. The wider material covers when to use local, cloud or hybrid AI; capability detection and the Gemini Nano model download lifecycle; Prompt API sessions, streaming, structured output, context management and image input; and built-in APIs for summarization, translation, language detection and writing. The exact topics covered in this session depend on the time available. Zero token cost is not zero cost: on-device AI has trade-offs in download size, disk space, memory, battery, model size and fallbacks. Requirements: Bring your own laptop with Windows 10+, macOS 13+, Linux, or ChromeOS on a Chromebook Plus. Install Chrome Stable 157+, Node.js 24.15+ (or 22.22.3+), pnpm 11 and git. Intermediate level: knowledge of TypeScript and one component framework; no machine-learning experience is needed. No AI service accounts or API keys are required. For Chrome’s on-device foundation models, check Chrome’s hardware requirements: at least 22 GB of free storage; a GPU with more than 4 GB VRAM, or at least 16 GB RAM and four CPU cores; and an unmetered connection for the initial model download.
Speakers: Julia Rapczyńska
Explore the event schedule.