onnxruntime
Flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.
A flutter plugin for OnnxRuntime provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.
English project snapshot. Visit GitHub for the latest content.
Flutter plugin for OnnxRuntime via dart:ffi provides an easy, flexible, and fast Dart API to integrate Onnx models in flutter apps across mobile and desktop platforms.
| Platform | Android | iOS | Linux | macOS | Windows |
|---|---|---|---|---|---|
| Compatibility | API level 21+ | * | * | * | * |
| Architecture | arm32/arm64 | * | * | * | * |
In your flutter project add the dependency:
dependencies:
...
onnxruntime: x.y.z
import 'package:onnxruntime/onnxruntime.dart';
OrtEnv.instance.init();
final sessionOptions = OrtSessionOptions();
const assetFileName = 'assets/models/test.onnx';
final rawAssetFile = await rootBundle.load(assetFileName);
final bytes = rawAssetFile.buffer.asUint8List();
final session = OrtSession.fromBuffer(bytes, sessionOptions!);
final shape = [1, 2, 3];
final inputOrt = OrtValueTensor.createTensorWithDataList(data, shape);
final inputs = {'input': inputOrt};
final runOptions = OrtRunOptions();
final outputs = await _session?.runAsync(runOptions, inputs);
inputOrt.release();
runOptions.release();
outputs?.forEach((element) {
element?.release();
});
OrtEnv.instance.release();
Dependency list 5 items
{"sdk":"flutter"}^2.0.1^7.2.11{"sdk":"flutter"}^2.0.0Start with your use case, compare repository activity, and check the original project before adopting it.
“A repository is the most basic element of GitHub.”
GitHub Docs — About repositories ↗