Running Qwen 3 on a five-year-old Android phone with LiteRT-LM (what I measured)
by Phoenix Labs dev.to
3 min read
I ship Phoenix Local AI, a private AI chat app for Android. You can connect it to a cloud model, but the point is that it can run a model on the phone itself, in airplane mode, with nothing leaving the device. The on-device engine is LiteRT-LM, Google's runtime for .litertlm model files, called from Flutter. Getting it to answer at all was one job. Getting it to answer at a speed a person will wa…
Topics AI in Flutter apps
More like this
- Article 2 min read
Building AI-Powered Mobile Apps: Lessons from Shipping 4 Live Flutter Apps to Google Play
by Rabia Aziz
Hi DEV community! 👋 I'm Rabia Aziz, a cross-platform mobile app engineer specializing in Flutter, Dart, Supabase, and Firebase. Over the past year, I’ve taken 4 production mobile applications from in...
Read on dev.to - Article 4 min read
Flutter + NVIDIA Edge AI: Model Versioning and Runtime Capability Negotiation
by vmodal_ai
This advanced tutorial treats Flutter as the operator-facing presentation layer while wearable SDKs, Jetson services, ROS 2 nodes, and NVIDIA-accelerated inference handle device-specific or compute-he...
Read on dev.to 
Article 11 min readBuilding Local LLMs Using Dart FFI And llama.cpp: Beyond Wrapper Packages
by GeekyAnts India Pvt Ltd
Build local LLMs in Flutter with Dart FFI and llama.cpp, and see how native bridges, GGUF models, memory management, and token streaming enable private, on-device AI. Introduction When I first explore...
Read on dev.to- Article 4 min read
Several AIs, one app: the rules I wrote because they all remember things wrong
by Cesare Bramante
I built a native app with several AIs. The most useful thing I wrote in the whole project wasn't code. It was a short list of rules about not trusting their memory. In the last episode I told how most...
Read on dev.to
