搜索插件、代码仓与 APP 分类

coast_audio 封面
插件详情v1.0.0

coast_audio

一个用 Dart 编写的跨平台音频库,使用 FFI。您可以播放、录制和处理音频,并支持托管内存。

AndroidiOSmacOSWindowsLinux
近 30 天下载
89
喜欢数
28
Pub 分数
150

安装插件

flutter pub add coast_audio

插件介绍

基于插件公开信息、社区数据与项目使用情况整理的选型参考。

Coast Audio 是一个跨平台的音频库,专为 Flutter 构建,使用 Dart 和 FFI 实现高性能的音频播放、录制和处理。它提供托管内存管理,防止内存泄漏,并简化跨平台的资源管理。专为需要低级别音频控制但又不想处理原生代码复杂性的开发者设计,支持 Android、iOS、macOS、Windows 和 Linux。该库可实现音频的实时操作,并能无缝集成到需要高级音频功能的 Flutter 应用中。

适合场景

  • 实时音频播放
  • 音频录制和流媒体
  • 音频信号处理
  • 跨平台音频应用
  • 实时音效

主要特点

  • 基于 FFI 的性能
  • 托管内存支持
  • 跨平台兼容性
  • 低延迟音频处理
  • 用于音频操作的简单 API

适合对象

  • Flutter 开发人员构建音频应用
  • 需要实时音频处理的应用程序
  • 开发者避免使用原生平台代码
  • 针对多个操作系统的项目
  • 以音频为重点的游戏或音乐应用

使用建议

  • 需要了解 FFI 和系统级音频概念
  • 某些平台可能需要额外的设置
  • 与其他成熟库相比,文档有限
  • 平台特定的异常情况可能性
  • 不适合无需处理的简单音频播放

原始 README

以下为关联源码仓库的 README 原文快照,最新内容请访问源码仓库。

coast_audio

codecov

logo_banner.png

demo.gif

coast_audio is a high performance audio processing library written in Dart.
This package aims to provide low-level audio functionalities with no Flutter dependency.

Features

  • Audio Buffer Management
  • Ring Buffer Management
  • Audio Node Graph System
    • Decoder Node
    • Mixer Node
    • Function Node
    • Volume Node
  • Encoding and Decoding mechanism
    • Wav Audio Encoder/Decoder
  • Wave Generation
    • Sine
    • Triangle
    • Square
    • Sawtooth
  • Audio Device I/O
    • Playback
    • Capture
  • Audio Format Management and Conversion

Supported Platforms

Android iOS macOS Windows Linux Web
✅ ✅ ✅ ⚠️ ✅ ❌
  • Windows is not tested but it should work if the native library is compiled correctly.

How It Works

coast_audio is built on top of dart:ffi.
Thus, it can be used in any Dart environment that supports FFI.

Some of the functionalities are implemented in native code which uses miniaudio.
This repository contains pre-built binaries for each supported platform.

Installation

Add the following to your pubspec.yaml:

coast_audio: ^1.0.0
Android
  1. Create a new directory android/src/main/jniLibs in your project.
  2. Copy the {ABI}/libcoast_audio.so file from the native/prebuilt/android directory to the jniLibs directory.
macOS/iOS

Add the following to your Podfile:

target 'Runner' do
  ...
  pod 'CoastAudio', :git => 'https://github.com/SKKbySSK/coast_audio.git', :tag => '1.0.0'
end

Open the AppDelegate.swift file and add the following import and CoastAudioSymbolKeeper.keep() call:

import CoastAudio // 1. Add import

@UIApplicationMain
@objc class AppDelegate: FlutterAppDelegate {
  override func application(
    _ application: UIApplication,
    didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?
  ) -> Bool {
    CoastAudioSymbolKeeper.keep() // 2. Add this line to prevent native symbols from being stripped (You can place this anywhere inside your iOS/macOS code)
    GeneratedPluginRegistrant.register(with: self)
    return super.application(application, didFinishLaunchingWithOptions: launchOptions)
  }
}

Linux
  1. Copy the {ARCH}/libcoast_audio.so file from the native/prebuilt/linux directory to the linux/libs directory in your project.
  2. Add the following to your linux/CMakeLists.txt:
install(FILES "linux/libs/${CMAKE_SYSTEM_PROCESSOR}/libcoast_audio.so" DESTINATION "${INSTALL_BUNDLE_LIB_DIR}" COMPONENT Runtime)
Windows

TODO

There is no pre-built native library for Windows yet.
You need to build it manually.

Usage

Generate Sine Wave

coast_audio provides various audio nodes to generate/process audio data easily.
This example code generates a 440hz sine wave by using FunctionNode.

// define the audio format with 48khz sample rate and stereo channels.
final format = AudioFormat(sampleRate: 48000, channels: 1, sampleFormat: SampleFormat.int16);

// create a sine wave function node with 440hz frequency.
final functionNode = FunctionNode(
  function: const SineFunction(),
  frequency: 440,
);

AllocatedAudioFrames(length: 1024, format: format).acquireBuffer((buffer) {
  // read the audio data from the function node to the buffer.
  functionNode.outputBus.read(buffer);

  // floatList contains sine wave audio data.
  final floatList = buffer.asFloat32ListView();
});
Generate Wav File

You can use WavAudioEncoder to encode audio data.

// define the audio format with 48khz sample rate and stereo channels.
final format = AudioFormat(sampleRate: 48000, channels: 1, sampleFormat: SampleFormat.int16);

// create a sine wave function node with 440hz frequency.
final functionNode = FunctionNode(
  function: const SineFunction(),
  frequency: 440,
);

final fileOutput = AudioFileDataSource(
  file: File('output.wav'),
  mode: FileMode.write,
);

// create a wav audio encoder.
final encoder = WavAudioEncoder(dataSource: fileOutput, inputFormat: format);

encoder.start();

final duration = AudioTime(10);
AllocatedAudioFrames(length: duration.computeFrames(format), format: format).acquireBuffer((buffer) {
  // read the audio data from the function node to the buffer.
  final result = functionNode.outputBus.read(buffer);

  // encode the audio data to the wav file.
  encoder.encode(buffer.limit(result.frameCount));
});

encoder.finalize();
Mixing Audio with Audio Node Graph System

AudioNode can be connected to other nodes to build an audio graph.
This example code demonstrates how to mix two sine waves and write to a wav file.

const format = AudioFormat(sampleRate: 48000, channels: 1);
final mixerNode = MixerNode(format: format);

// Initialize sine wave nodes and connect them to mixer's input
for (final freq in [264.0, 330.0, 396.0]) {
  final sineNode = FunctionNode(function: const SineFunction(), format: format, frequency: freq);
  final mixerInputBus = mixerNode.appendInputBus();
  sineNode.outputBus.connect(mixerInputBus);
}

AllocatedAudioFrames(length: 1024, format: format).bufferFrames.acquireBuffer((buffer) {
  // read the audio data from the function node to the buffer.
  functionNode.outputBus.read(buffer);

  // floatList contains mixed sine wave audio data.
  final floatList = buffer.asFloat32ListView();
});
Play, record and loopback

coast_audio provides AudioDevice class to handle audio device I/O.
Please see the following examples:

Q&A

Can I use this package in Flutter?

Yes, you can use coast_audio in Flutter.

Most of coast_audio operation is synchronous and it may block the Flutter's main isolate.
So, it is recommended to use coast_audio in a separate isolate.

Please see the example app implementation for more details.

Can I use coast_audio in web?

In short, no,
You should use dart:web_audio instead.
But it may become available if the FFI is supported on the Web platform.

所属分类

依赖

依赖清单 3 项

源码仓库

使用此插件的项目