On-device AI
Running a model on the user's own phone, laptop or car rather than in a data centre.
Also: edge AI, local model
Running models on the device means answers arrive without a network connection, data stays local and the provider pays nothing for servers. The limits are memory, battery and heat, so on-device models are small and heavily quantised. Google's Gemini Nano runs on Pixel and some Samsung phones, Apple Intelligence uses an on-device model of about three billion parameters alongside larger server models, and laptops sold as AI PCs include neural processing units for the purpose. Tools such as llama.cpp let enthusiasts run open models locally.