Overview
Marionette Flutter enables AI agents to interact with Flutter apps through the MCP protocol, allowing tools like Claude, Copilot, and Cursor to perform actions such as tapping, scrolling, typing, and capturing screenshots. It extends Flutter applications with capabilities for automated testing and AI-driven UI interaction, enhancing development workflows. The package integrates seamlessly across multiple platforms including Android, iOS, Web, macOS, Windows, and Linux. Designed for developers leveraging LLMs in app testing or automation, it bridges the gap between AI agents and native app behaviors.
Use cases
- Automated UI testing with AI agents
- AI-powered app exploration and debugging
- Integration with Copilot and Claude for app interaction
- Real-time screenshot capture during testing
- Cross-platform app interaction via MCP
Key features
- MCP protocol support for AI agent communication
- Support for tap, scroll, type, and screenshot actions
- Multi-platform compatibility (Android, iOS, Web, macOS, Windows, Linux)
- Seamless integration with LLM-powered development tools
- Lightweight Flutter extensions for agent interaction
Suitable for
- Developers using AI agents for testing
- Teams implementing AI-driven UI automation
- Flutter projects requiring advanced test orchestration
- Integrators working with Copilot, Claude, or Cursor
- Projects focused on generative AI in app development
Considerations
- Requires compatible AI agent with MCP support
- May need additional setup for secure agent access
- Limited to platforms where MCP is supported
- Depends on external AI tooling for full functionality
- Not intended for production user interactions