搜索插件、代码仓与 APP 分类

插件详情v1.8.6

flutter_gemma_litertlm

LiteRT-LM (.litertlm) 是用于 flutter_gemma 的本地推理引擎,通过 dart:ffi(5 个原生平台)+ web 实现。可选择性地使用 InferenceEngineProvider。同时提供 LiteRT C API 嵌入式后端(LiteRtEmbeddi [...]

AndroidiOSLinuxmacOSWebWindows
近 30 天下载
3万
喜欢数
0
Pub 分数
130

安装插件

flutter pub add flutter_gemma_litertlm

插件介绍

基于插件公开信息、社区数据与项目使用情况整理的选型参考。

一个轻量级的本地推理引擎,用于FlutterGemma,基于Dart:ffi,支持五个原生平台和Web。通过可选的提供者集成,利用LiteRT C API嵌入后端实现高效的本地大语言模型推理。专为低延迟、注重隐私的生成式AI应用设计,可在设备上直接运行,无需依赖云服务。该包简化了在Android、iOS、Linux、macOS、Windows和Web环境中的部署。

适合场景

  • 设备端语言模型推理
  • 保护隐私的聊天应用
  • 离线AI驱动的应用程序
  • 用于大语言模型的边缘计算
  • 轻量级 LLM 移动端和桌面端部署

主要特点

  • 原生平台支持(5+ 平台)
  • 通过 Dart:ffi 实现 Web 兼容性
  • 选择性启用 InferenceEngineProvider
  • LiteRT C API 嵌入式后端
  • 最小的运行时开销
  • 跨平台一致性

适合对象

  • 开发离线大语言模型应用的开发者
  • 需要数据隐私的应用程序
  • 移动和桌面AI原型
  • 资源有限的边缘AI项目
  • 使用 Flutter 进行生成式 AI 的团队

使用建议

  • 需要原生代码编译
  • 仅限与 LiteRT 兼容的模型
  • Web 支持依赖于 WASM 的可用性
  • 性能因设备硬件而异
  • 无内置的模型管理或缓存

原始 README

以下为关联源码仓库的 README 原文快照,最新内容请访问源码仓库。

Flutter Edge AI

pub package License: MIT

On-device AI for Flutter on Android, iOS, Web, macOS, Windows and Linux. Run any model a registered engine runs, or the model the operating system already ships, with text, vision, audio, function calling, embeddings, RAG and speech. No server, no cloud.

Website · Docs · Models · Codelabs · pub.dev

The core package is small: it installs models and hands them to engines. Every runtime, store and feature is a separate opt-in package, so an app ships only what it uses. Start with the core README or Getting started.

Packages

Package What it does Docs
flutter_edge_ai Core: model installation, the engine registry, sessions and chat. Required by every package except diagnostics and genkit_hybrid. pub.dev · site
Engines
flutter_edge_ai_litertlm LiteRT-LM (.litertlm) through dart:ffi on the five native platforms plus web; CPU, GPU and NPU; the LiteRT embedding backend. pub.dev · site
flutter_edge_ai_mediapipe MediaPipe (.task) on Android, iOS and web. Google's LLM Inference API is maintenance-only; new apps should use .litertlm. pub.dev · site
flutter_edge_ai_llama llama.cpp (.gguf) through llamadart on Android, iOS, macOS, Windows, Linux and web; native LoRA. pub.dev · site
flutter_edge_ai_onnx ONNX Runtime: GenAI inference and embeddings natively, Transformers.js and onnxruntime-web on web. pub.dev · site
flutter_edge_ai_builtin_ai The OS model, nothing to download: Gemini Nano (Android), Apple Foundation Models (iOS, macOS), Windows AI Foundry, the browser Prompt API. pub.dev · site
Embeddings and RAG
flutter_edge_ai_embeddings Embedding tokenizers (Gemma SentencePiece, BERT WordPiece) for .tflite and .onnx embedders. pub.dev · site
flutter_edge_ai_rag On-device RAG: RagIndex, embedding profiles, filters and the vector-store contract. pub.dev · site
flutter_edge_ai_sqlite SQLite (sqlite-vec) vector store on every platform, web included. pub.dev · site
flutter_edge_ai_qdrant Qdrant Edge vector store on native platforms. pub.dev · site
Speech, agents, diagnostics
flutter_edge_ai_speech Speech-to-text, text-to-speech and the VoiceSession voice loop. pub.dev · site
flutter_edge_ai_agent Agent skills (SKILL.md) the model picks and runs: text, JS, native intents and MCP tools. pub.dev · site
flutter_edge_ai_diagnostics Process memory diagnostics on Android, iOS, macOS, Linux and Windows. pub.dev · site
Genkit
genkit_flutter_edge_ai Genkit Dart plugin: on-device models and embedders as Genkit models. pub.dev · site
genkit_hybrid Hybrid routing for Genkit: on-device and cloud models behind one routing policy. Depends only on genkit. pub.dev · site

Which package you need for which task, and how they fit together: Packages and Capabilities.

Maintainers

Maintainer Looks after
Sasha Denisov (@DenisovAV) Lead maintainer: the core API, the engines, the native builds and every release
Jhin Lee (@leehack) flutter_edge_ai_llama
Francesco Vezzani (@kekko7072) flutter_edge_ai_builtin_ai
Samarthsinh Vala (@samarthsinh2660) flutter_edge_ai_diagnostics
Daisuke Majima (@john-rocky) The Hugging Face integration: installing a model straight from its repository

Everyone else who has contributed, and more about each maintainer: flutteredge.ai/contributors.

Repository

More: Migration guide · Desktop support · Contributing. The family shipped as flutter_gemma* up to core 1.11.4; those names stay published as they are.

License

MIT — see LICENSE.

所属分类

依赖

依赖清单 7 项

源码仓库

使用此插件的项目

暂无相关数据。

所在榜单