OpenHub Nav
ipex-llm logo

ipex-llm

Llm Open Source

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete

★ 8,853 Stars ⑂ 1,433 Forks License: Apache License 2.0
Download Latest Release Official Website ↗ GitHub Repository ↗

About ipex-llm

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

Supported Platforms

Open Source Web Cross-Platform

Related in Llm

hermes-agent

hermes-agent

The agent that grows with you

 AutoGPT

AutoGPT

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

 firecrawl

firecrawl

The web data API to search, scrape, and interact at scale. 🔥

 ollama

ollama

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

 dify

dify

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without reb

 open-webui

open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)