ChatGLM3 is ZhipuAI & Tsinghua KEG’s third-gen conversational model suite centered on the 6B-parameter ChatGLM3-6B. It keeps the series’ smooth dialog and low deployment cost while adding native tool use (function calling), a built-in code interpreter, and agent-style workflows. The family includes base and long-context variants (8K/32K/128K). The repo ships Python APIs, CLI and web demos (Gradio/Streamlit), an OpenAI-format API server, and a compact fine-tuning kit. Quantization (4/8-bit), CPU/MPS support, and accelerator backends (TensorRT-LLM, OpenVINO, chatglm.cpp) enable lightweight local or edge deployment.
Features
- Multi-turn chat with native tools: Function Call, Code Interpreter, agent tasks.
- Long-context models: 8K, 32K, and 128K sequence lengths.
- Easy local deployment: INT4/INT8 quantization, CPU & Apple MPS support.
- Turnkey demos: CLI, Gradio/Streamlit web UIs, OpenAI-style REST server.
- Accelerator integrations: TensorRT-LLM, OpenVINO, chatglm.cpp, multi-GPU.
- Fine-tuning kit: LoRA/QLoRA/PTuning examples and scripts.
Project Samples
Categories
Large Language Models (LLM)License
Apache License V2.0Follow ChatGLM3
You Might Also Like
MongoDB Atlas runs apps anywhere
MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of ChatGLM3!