ndroid

chatbot

chatgpt

facebook

flutter

gguf

large-language-models

llama

llama-cpp

llama2

Mobile-Artificial-Intelligence/maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

前往 github 下载
Mobile-Artificial-Intelligence/maid
logo

Maid - Mobile Artificial Intelligence Distribution

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama models remotely. The goal of Maid is to create a platform for AI that can be used freely on any device.

Cloning

Maid utilises git submodules extensively. To clone the repository, use the following command:

git clone --recursive https://github.com/Mobile-Artificial-Intelligence/maid.git

Installing Build Dependencies

To install the dependencies on fedora based systems, use the following command:

sudo dnf install -y cmake ninja-build pkg-config gtk3-devel vulkan-devel

To install the bdependencies on debian based systems, use the following command:

sudo apt-get install -y cmake ninja-build pkg-config libgtk-3-dev libvulkan-dev

Platform Support

Windows, Linux, Android.
Releases page.
MacOS and IOS Releases not available at this time.

Supported API’s

Parameter Local Ollama OpenAI MistralAI
model Y Y Y Y
seed Y Y Y Y
temperature Y Y Y Y
responseFormat N Y Y N
numKeep N Y N N
numPredict N Y N N
topK Y Y N N
topP Y Y Y Y
tfsZ Y Y N N
typicalP Y Y N N
repeatLastN Y Y N N
repeatPenalty Y Y N N
presencePenalty Y Y Y N
frequencyPenalty Y Y Y N
stop N Y Y N
mirostat Y Y N N
mirostatTau Y Y N N
mirostatEta Y Y N N
penalizeNewline Y Y N N
numa N Y N N
numCtx Y Y N N
numBatch Y Y N N
numGqa N Y N N
numGpu N Y N N
mainGpu Y Y N N
lowVram N Y N N
f16KV N Y N N
logitsAll Y Y N N
vocabOnly Y Y N N
useMmap Y Y N N
useMlock Y Y N N
embeddingOnly Y Y N N
ropeFrequencyBase Y Y N N
ropeFrequencyScale Y Y N N
numThread Y Y N N
maxTokens N N Y Y
n N N Y N
logitBias Y N Y N
functions N N Y N
functionCall N N Y N
user N N Y N
safeMode N N N Y

Help Wanted

  • Write code comments
  • Documentation
  • Testing and Building on MacOS and IOS
  • Spreading the word

Special Thanks and Related Projects

Testing

Android version tested on a Oneplus 10 Pro 11gb phone.
Also tested on Fedora Linux, Windows 11.
Tested with calypso 3b, orcamini 3b, llama 2 7B-Chat, llama 7B and many more.

与 Mobile-Artificial-Intelligence/maid 相关优秀项目推荐下载