パッケージ、リポジトリ、アプリカテゴリを検索

パッケージ詳細v0.2.9

dialogflow_grpc

gRPC を使用した Dialogflow CX、V2、V2beta 向けの Flutter パッケージ。Dialogflow API との高速な統合と、オーディオストリーミングの可能性も。

30日間ダウンロード
96
いいね数
32
Pub ポイント
60

パッケージをインストール

flutter pub add dialogflow_grpc

パッケージ概要

公開情報に基づく選定ガイドです。参考としてご利用ください。

Dialogflow CX、V2、およびV2beta APIとの高速gRPCベースの統合を可能にするFlutterパッケージです。リアルタイム音声ストリーミングをサポートしており、音声対応チャットボットやインタラクティブアプリに最適です。gRPCを通じて低遅延通信と効率的なデータ処理を提供し、RESTよりもパフォーマンスが向上します。ライブ音声入出力付きの高度な会話インターフェースを開発する開発者にとって特に有用です。

用途

  • リアルタイム音声チャットボット
  • チャットアプリケーションにおけるオーディオストリーミング
  • 高性能なDialogflowの統合
  • インタラクティブなカスタマーサポートボット
  • 音声制御アプリの機能
  • マルチターン会話システム

主な機能

  • gRPCベースのAPI通信
  • Dialogflow CX、V2、および V2beta のサポート
  • リアルタイムオーディオストリーミング
  • 低遅延応答
  • サービスアカウントによるセキュアな認証
  • クロスプラットフォーム互換性

適している対象

  • 音声対応アプリを開発する開発者
  • 高性能なDialogflow統合が必要なチーム
  • オーディオ入出力が必要なアプリケーション
  • Dialogflow を使用するチャットボット開発者
  • リアルタイム相互作用を備えたモバイルアプリ

注意事項

  • gRPC のセットアップと構成が必要です
  • サービスアカウントの資格情報が必要です
  • Dialogflow 固有の使用事例に限定
  • 追加のオーディオ処理が必要になる場合があります
  • プラットフォーム固有のオーディオ権限が必要です
  • 単純なRESTオンリーのワークフローには適していません

元の README

関連するソースリポジトリの README 原文のスナップショットです。最新の内容はリポジトリをご覧ください。

License

Auto-generated Flutter Dialogflow library for detecting intents using gRPC. A faster integration with the Dialogflow API and also the possibility to do audio streaming. Built by Google Developer Advocate for Dialogflow, Lee Boonstra

Disclaimer: This package is made by Google developer advocate Lee Boonstra. This is not an official Google package. This package is provided as-is, without warranty or representation for any use or purpose. Feel free to improve this package, and contribute.

gRPC protos have been generated from:

  • git clone https://github.com/googleapis/googleapis
  • git clone https://github.com/protocolbuffers/protobuf

Docs:

Usage

Before making use of this package, enable the Dialogflow API in the Google Cloud console.

gcloud services enable dialogflow.googleapis.com

Afterwards, download a service account JSON file which has Dialogflow Integration access rights, and store this in your project. (e.g. assets/credentials.json)

Example

Edit the pubspec.yaml file with the dialogflow_grpc dependency. And point to your service account (e.g. assets/credentials.json)

...
dependencies:
  dialogflow_grpc: any

...
# The following section is specific to Flutter.
flutter:

  # The following line ensures that the Material Icons font is
  # included with your application, so that you can use the icons in
  # the material Icons class.
  uses-material-design: true
  assets:
    - assets/credentials.json

Import this package in your code. Load your service account, and create a DialogflowGrpc instance:

import 'package:dialogflow_grpc/v2beta1.dart';
import 'package:dialogflow_grpc/generated/google/cloud/dialogflow/v2beta1/session.pb.dart';
import 'package:dialogflow_grpc/dialogflow_auth.dart';

final serviceAccount = ServiceAccount.fromString(
    '${(await rootBundle.loadString('assets/credentials.json'))}');

DialogflowGrpc dialogflow = DialogflowGrpc.viaServiceAccount(serviceAccount);

CAUTION: When working with production apps Storing the service account in a client asset folder (or even in a secure key client keychain) can be dangerous if it’s not handled well. First of all, you will need to be very careful with your service accounts. Which read and access rights will you give your components? When you give admin rights to Google Cloud’s compute engine, you can imagine that attackers could hack and decompile your app. When they get access to your compute engine, they could drive you into costs by for example, mining bitcoins for them. Now, even when you don’t give compute access rights to your Google Cloud service accounts, you still won’t expose your keys. Even though for Dialogflow, it only gives you access to your chatbot within your project, it might be possible for attackers to read PII data from the chat history if your end-users were sharing PII data in the chat. That can be a huge problem. On top of that, it’s not so easy to change service account keys in applications, as you don’t want the app to stop working for current users. So how can you serve service accounts and keys secure in mobile clients? By, for example, building a mechanism to rotate (a second set of) keys. Like working with JSON Web Tokens (JWT), an Internet proposed standard for creating data with optional signature and optional encryption whose payload holds JSON that asserts some number of claims. The tokens are signed either using a private secret or a public/private key. Or you can run (parts) of your integration on a server.

Example: DetectIntent

Detecting an intent based on a text input:

    var data = await dialogflow.detectIntent(text, 'en-US');
    print(data.queryResult.fulfillmentText);

Example: StreamingDetectIntent

Detecting an intent based on an audio stream:

    var biasList = SpeechContextV2Beta1(
      phrases: [
        'Dialogflow CX',
        'Dialogflow Essentials',
        'Action Builder',
        'HIPAA'
      ],
      boost: 20.0
    );

    var config = InputConfigV2beta1(
        encoding: 'AUDIO_ENCODING_LINEAR_16',
        languageCode: 'en-US',
        sampleRateHertz: 8000,
        singleUtterance: false,
        speechContexts: [biasList]
    );
    
    // import 'dart:io' show Platform;
    // On iOS
    if (Platform.isIOS) {
      config = InputConfigV2beta1(
          encoding: 'AUDIO_ENCODING_LINEAR_16',
          languageCode: 'en-US',
          sampleRateHertz: 16000,
          singleUtterance: false,
          speechContexts: [biasList]
      );
    }

    // Make the streamingDetectIntent call, with the InputConfig and the audioStream
    final responseStream = dialogflow.streamingDetectIntent(config, _audioStream);
    responseStream.listen((data) {
        print(data);
    });

Example: Making use of generated code

Use imports such as:

import 'package:dialogflow_grpc/generated/google/cloud/dialogflow/v2beta1/session.pb.dart';

Official API documentation: https://cloud.google.com/dialogflow/es/docs/reference/rpc

Example: Tests

Make sure you have a service account: assets/credentials.json

flutter test test/v2_test.dart
flutter test test/v2beta1_test.dart

Environments

MacOS

https://flutter.dev/desktop In order to run dialogflow_grpc in your MacOS app, enable internet. Edit the .entitlements files in your macos/Runner/ folder.

<key>com.apple.security.network.client</key>
<true/>
Android

In order to build the example for Android devices; the audio recorder library sound_stream requires a minSdk of at least 21. So let's change this in android/app/build.gradle in the defaultConfig block. Also, don't forget to go into the virtual device settings and enable your microphone.

defaultConfig {
   applicationId "com.myname.flutter_dialogflow_agent"
   minSdkVersion 21
   targetSdkVersion 30
   versionCode flutterVersionCode.toInteger()
   versionName flutterVersionName
}
iOS

In order to build the example for iOS devices, you will need to give permissions to the microphone. Add this to the ios/Runner/Info.plist file.

<key>NSMicrophoneUsageDescription</key>
<string>Need microphone access for uploading videos</string>

Developer Website: https://www.leeboonstra.dev

TODO
  • [x] Support DetectIntent TextInput
  • [x] Add streamingDetectIntent support
  • [x] Working app example audio streaming / chat app
  • [x] Get the session from the service account
  • [x] Support for V2Beta1, (Knowledge Base Connectors, SpeechContext)
  • [x] Test Cases
  • [x] Windows, Linux, MacOS support
  • [ ] Share demo Dialogflow Agent
  • [ ] Codelab working audio streaming app
  • [ ] Support DetectIntent with Events
  • [ ] Support for CX
screenshot

カテゴリー

依存関係

依存関係一覧 5 件

ソースリポジトリ

このパッケージを使用しているプロジェクト

データはまだありません。