ai-setup
Cactus – Ollama for Smartphones
Run LLMs locally on iOS and Android with an OpenAI-compatible API layer, custom quantization kernels, and zero-copy edge-cloud handoff.
#ai-setup#mobile#llm-inference
Tag
2 posts tagged #edge-ai
Browse 2 posts tagged Edge AI, including practical setup notes, reviews, comparisons, and workflow patterns for engineers working with AI tools.
Run LLMs locally on iOS and Android with an OpenAI-compatible API layer, custom quantization kernels, and zero-copy edge-cloud handoff.
Open-source edge AI engine that runs local LLMs on iOS, Android, and wearables using custom quantization, CPU/GPU kernels, and an OpenAI-compatible API.