Library of all 'local ai' projects specially ggml family. From local LLM to local Music Generation. So you can run everywhere!
I'm a big fan of running on-premise AI on every device I have at hand. From PCs and phones to smart watches, Arduino and ESP32 :)
And for such tasks, a huge and gramomatic python is often indispensable.
So I have collected for you a collection of all the projects built on the wonderful ggml lib for all platforms.
Feel free to supplement and send me pull requests about new tools and other cool stuff!
- llama.cpp LLM inference in C/C++ (LLMs, Compute Vision)
- stable-diffusion.cpp Diffusion model inference in C/C++ (Image, Video, Editing)
- whisper.cpp Port of OpenAI Whisper model in C/C++ (SpeachToText, voice activity detection)
- TTS.cpp TTS inference in C/C++ (TextToSpeach)
- qwen3-tts.cpp Qwen3 TTS model (TextToSpeach)
- bark.cpp Sono bark speach model (TextToSpeach)
- acestep.cpp ACE-Step 1.5 Music generation (Music generation)
- bert.cpp Google BERT sentence analyzing (sentences)
- vit.cpp Inference Vision Transformer (ViT) in C/C++ (More Vision)
- minigpt4.cpp Port of MiniGPT4 in C++ (GPT LLMs)
- clip.cpp Port of OpenAI CLIP model (semantic image search, image labeling)
- demucs.cpp Separate music to bass, brums, vocal (music separation)
- umx.cpp Music Demuxing implementation (Music demuxing)
- rwkv.cpp RWKV language model
- voxtral.cpp Mistral Voxtral ASR model (SpeachToText)
- sam.cpp Meta Segment Anything Model in pure C/C++ (Segmets)
- dinov2.cpp DINOv2 visual models in C/C++ (image/pixel visual tasks)
- pocketpal Brings language models directly to your phone. (LLM, Vision)
- AI Gallery Google gallery that showcases on-device ML/GenAI (ML, LLM, Vision, TTS, Interaction)
- Stable-Diffusion-Android Stable Diffusion AI client app for Android (Gen Image, Edit)
- local-dream Run Stable Diffusion on Android Devices with Snapdragon NPU acceleration (Gen Image, Edit)
- ImageToolbox AI transforms for images and other usefull tools (rmbg, denoise, upsace, enhace, colorize, enhance, ...)