Search Results for "localai"

...No GPU is required. Runs ggml, GPTQ, onnx, TF compatible models: llama, gpt4all, rwkv, whisper, vicuna, koala, gpt4all-j, cerebras, falcon, dolly, starcoder, and many others. LocalAI is a drop-in replacement REST API that’s compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs (and not only) locally or on-prem with consumer-grade hardware, supporting multiple model families that are compatible with the ggml format. Does not require GPU.

Askimo is an open-source, privacy-first AI desktop application designed to help users work with multiple AI models from a single, consistent interface. It supports popular AI providers such as OpenAI, Anthropic (Claude), Gemini, Ollama, LocalAI, Docker AI, LM Studio, and X AI, allowing users to switch models easily without vendor lock-in. A core feature of Askimo is Retrieval-Augmented Generation (RAG). Users can connect the app to local files, documents, and project folders so the AI can answer questions using their own knowledge base. All indexing, search, and history storage happen locally, ensuring sensitive data stays on the user’s machine. ...