Flutter Edge AI
On-device AI for Flutter on Android, iOS, Web, macOS, Windows and Linux. Run any
model a registered engine runs, or the model the operating system already ships,
with text, vision, audio, function calling, embeddings, RAG and speech. No
server, no cloud.
Website ·
Docs ·
Models ·
Codelabs ·
pub.dev
The core package is small: it installs models and hands them to engines. Every
runtime, store and feature is a separate opt-in package, so an app ships only
what it uses. Start with the core README
or Getting started .
Packages
Package
What it does
Docs
flutter_edge_ai
Core: model installation, the engine registry, sessions and chat. Required by every package except diagnostics and genkit_hybrid.
pub.dev · site
Engines
flutter_edge_ai_litertlm
LiteRT-LM (.litertlm) through dart:ffi on the five native platforms plus web; CPU, GPU and NPU; the LiteRT embedding backend.
pub.dev · site
flutter_edge_ai_mediapipe
MediaPipe (.task) on Android, iOS and web. Google's LLM Inference API is maintenance-only; new apps should use .litertlm.
pub.dev · site
flutter_edge_ai_llama
llama.cpp (.gguf) through llamadart on Android, iOS, macOS, Windows, Linux and web; native LoRA.
pub.dev · site
flutter_edge_ai_onnx
ONNX Runtime: GenAI inference and embeddings natively, Transformers.js and onnxruntime-web on web.
pub.dev · site
flutter_edge_ai_builtin_ai
The OS model, nothing to download: Gemini Nano (Android), Apple Foundation Models (iOS, macOS), Windows AI Foundry, the browser Prompt API.
pub.dev · site
Embeddings and RAG
flutter_edge_ai_embeddings
Embedding tokenizers (Gemma SentencePiece, BERT WordPiece) for .tflite and .onnx embedders.
pub.dev · site
flutter_edge_ai_rag
On-device RAG: RagIndex, embedding profiles, filters and the vector-store contract.
pub.dev · site
flutter_edge_ai_sqlite
SQLite (sqlite-vec) vector store on every platform, web included.
pub.dev · site
flutter_edge_ai_qdrant
Qdrant Edge vector store on native platforms.
pub.dev · site
Speech, agents, diagnostics
flutter_edge_ai_speech
Speech-to-text, text-to-speech and the VoiceSession voice loop.
pub.dev · site
flutter_edge_ai_agent
Agent skills (SKILL.md) the model picks and runs: text, JS, native intents and MCP tools.
pub.dev · site
flutter_edge_ai_diagnostics
Process memory diagnostics on Android, iOS, macOS, Linux and Windows.
pub.dev · site
Genkit
genkit_flutter_edge_ai
Genkit Dart plugin: on-device models and embedders as Genkit models.
pub.dev · site
genkit_hybrid
Hybrid routing for Genkit: on-device and cloud models behind one routing policy. Depends only on genkit.
pub.dev · site
Which package you need for which task, and how they fit together:
Packages and
Capabilities .
Maintainers
Everyone else who has contributed, and more about each maintainer:
flutteredge.ai/contributors .
Repository
More: Migration guide ·
Desktop support ·
Contributing .
The family shipped as flutter_gemma* up to core 1.11.4; those names stay
published as they are.
License
MIT — see LICENSE .