flutter_gemma
एंड्रॉइड, आईओएस, वेब और डेस्कटॉप पर स्थानीय रूप से गेमा और अन्य LLM को चलाने के लिए एक फ्लटर प्लगइन। मल्टीमॉडल विज़न, ऑडियो, फंक्शन कॉलिंग, थिंकिंग मोड, GPU त्वरण, टेक्स्ट एम्बेडिंग और डिवाइस-आधारित RAG का समर्थन करता है।
Flutter प्लगइन एक Flutter एप्लिकेशन से डिवाइस पर स्थानीय रूप से Gemma AI मॉडल चलाने की अनुमति देता है।
यह अंग्रेज़ी मूल स्नैपशॉट है। नवीनतम सामग्री GitHub पर देखें।
On-device AI for Flutter on Android, iOS, Web, macOS, Windows and Linux. Run any model a registered engine runs, or the model the operating system already ships, with text, vision, audio, function calling, embeddings, RAG and speech. No server, no cloud.
Website · Docs · Models · Codelabs · pub.dev
The core package is small: it installs models and hands them to engines. Every runtime, store and feature is a separate opt-in package, so an app ships only what it uses. Start with the core README or Getting started.
| Package | What it does | Docs |
|---|---|---|
flutter_edge_ai |
Core: model installation, the engine registry, sessions and chat. Required by every package except diagnostics and genkit_hybrid. |
pub.dev · site |
| Engines | ||
flutter_edge_ai_litertlm |
LiteRT-LM (.litertlm) through dart:ffi on the five native platforms plus web; CPU, GPU and NPU; the LiteRT embedding backend. |
pub.dev · site |
flutter_edge_ai_mediapipe |
MediaPipe (.task) on Android, iOS and web. Google's LLM Inference API is maintenance-only; new apps should use .litertlm. |
pub.dev · site |
flutter_edge_ai_llama |
llama.cpp (.gguf) through llamadart on Android, iOS, macOS, Windows, Linux and web; native LoRA. |
pub.dev · site |
flutter_edge_ai_onnx |
ONNX Runtime: GenAI inference and embeddings natively, Transformers.js and onnxruntime-web on web. | pub.dev · site |
flutter_edge_ai_builtin_ai |
The OS model, nothing to download: Gemini Nano (Android), Apple Foundation Models (iOS, macOS), Windows AI Foundry, the browser Prompt API. | pub.dev · site |
| Embeddings and RAG | ||
flutter_edge_ai_embeddings |
Embedding tokenizers (Gemma SentencePiece, BERT WordPiece) for .tflite and .onnx embedders. |
pub.dev · site |
flutter_edge_ai_rag |
On-device RAG: RagIndex, embedding profiles, filters and the vector-store contract. |
pub.dev · site |
flutter_edge_ai_sqlite |
SQLite (sqlite-vec) vector store on every platform, web included. |
pub.dev · site |
flutter_edge_ai_qdrant |
Qdrant Edge vector store on native platforms. | pub.dev · site |
| Speech, agents, diagnostics | ||
flutter_edge_ai_speech |
Speech-to-text, text-to-speech and the VoiceSession voice loop. |
pub.dev · site |
flutter_edge_ai_agent |
Agent skills (SKILL.md) the model picks and runs: text, JS, native intents and MCP tools. |
pub.dev · site |
flutter_edge_ai_diagnostics |
Process memory diagnostics on Android, iOS, macOS, Linux and Windows. | pub.dev · site |
| Genkit | ||
genkit_flutter_edge_ai |
Genkit Dart plugin: on-device models and embedders as Genkit models. | pub.dev · site |
genkit_hybrid |
Hybrid routing for Genkit: on-device and cloud models behind one routing policy. Depends only on genkit. |
pub.dev · site |
Which package you need for which task, and how they fit together: Packages and Capabilities.
| Maintainer | Looks after |
|---|---|
| Sasha Denisov (@DenisovAV) | Lead maintainer: the core API, the engines, the native builds and every release |
| Jhin Lee (@leehack) | flutter_edge_ai_llama |
| Francesco Vezzani (@kekko7072) | flutter_edge_ai_builtin_ai |
| Samarthsinh Vala (@samarthsinh2660) | flutter_edge_ai_diagnostics |
| Daisuke Majima (@john-rocky) | The Hugging Face integration: installing a model straight from its repository |
Everyone else who has contributed, and more about each maintainer: flutteredge.ai/contributors.
packages/ — every package above, as one Dart pub workspace.
The example app with its integration tests is
packages/flutter_edge_ai/example.codelabs/ — the step-by-step apps behind the
codelabs.website/ — the source of flutteredge.ai.More: Migration guide ·
Desktop support ·
Contributing.
The family shipped as flutter_gemma* up to core 1.11.4; those names stay
published as they are.
MIT — see LICENSE.
एंड्रॉइड, आईओएस, वेब और डेस्कटॉप पर स्थानीय रूप से गेमा और अन्य LLM को चलाने के लिए एक फ्लटर प्लगइन। मल्टीमॉडल विज़न, ऑडियो, फंक्शन कॉलिंग, थिंकिंग मोड, GPU त्वरण, टेक्स्ट एम्बेडिंग और डिवाइस-आधारित RAG का समर्थन करता है।
LiteRT-LM (.litertlm) flutter_gemma के लिए डिवाइस-पर निष्कर्ष इंजन है, dart:ffi (5 नेटिव प्लेटफॉर्म) + वेब के माध्यम से। वैकल्पिक InferenceEngineProvider का उपयोग करें। साथ ही LiteRT C API एम्बेडिंग बैकएंड (LiteRtEmbeddi [...]
निर्भरता सूची 1 आइटम
^7.0.0उपयोग के अनुसार छाँटें, गतिविधि की तुलना करें और अपनाने से पहले मूल प्रोजेक्ट की आवश्यकताएँ जाँचें।
“A repository is the most basic element of GitHub.”
GitHub Docs — About repositories ↗