ai-setup
TensorSharp - Local LLM Inference in C# .NET
Run GGUF models on your own hardware with a native .NET inference engine. CLI, web UI, and Ollama/OpenAI-compatible APIs on Windows, macOS, Linux.
#dotnet#gguf#local-inference
Tag
2 posts tagged #gguf
Browse 2 posts tagged Gguf, including practical setup notes, reviews, comparisons, and workflow patterns for engineers working with AI tools.
Run GGUF models on your own hardware with a native .NET inference engine. CLI, web UI, and Ollama/OpenAI-compatible APIs on Windows, macOS, Linux.
Sipp is an open-source WebGPU runtime for running GGUF AI models directly in the browser with no server calls. Built with Rust and C++, it delivers 3x faster inference than comparable approaches with zero dependencies.