Use your locally running AI models to assist you in your web browsing

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

A generalized information-seeking agent system with Large Language Models (LLMs).

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

Run MemGPT-AutoGEN-Local LLM Together

Privacy focused AI powered meeting notes using locally hosted Small Language Models

A flexible, AI powered C2 framework built with operators in mind

A nifty little library for working with Ollama in Elixir.

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

The PyVisionAI Official Repo

MVP of an idea using multiple local LLM models to simulate and play D&D

Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand

Fenix Ai Trading Bot with LangGraph and ollama and multipe providers

A Cli, a webUI, and a MCP server for the Z-Image-Turbo text-to-image generation model (Tongyi-MAI/Z-Image-Turbo base model as well as quantized models)

The easiest & fastest way to run LLMs in your home lab

Native desktop app for Windows, MacOS and Linux. Easily run Large Language Models locally, no complex setups required. Inspired by OpenWebUI's simplicity for LLM use.

Unified management and routing for llama.cpp, MLX and vLLM models with web dashboard.

Open-source AI IDE powered by local & cloud LLMs. A privacy-first alternative to Cursor.