Skip to content
Parameters 7BApache-2.0Estimated

Qwen2.5 7B Instruct

中文理解明显更好的 7B 级模型,8GB 显存能跑。

Official source:https://github.com/QwenLM/Qwen2.5阿里云通义千问(Qwen)You are leaving AIWorksWell for 阿里云通义千问(Qwen). That site is not under our control; its content, privacy and security are its own responsibility. Please judge for yourself.

What hardware it needs

Estimated
Parameters
7B
Architecture
Dense
Context
128K
License
Apache-2.0
Min VRAM
6G
RAM (CPU-only)
8G
Download size
—G

Requirements by quantisation

The same model at different quantisations is a different download — the most common misjudgement in local AI.

Suggested quantisationSizeMin VRAMQuality
F1628G32GOriginal precision
Q8_014.8G17GPractically lossless
Q6_K11.5G13GNear lossless
Q5_K_M9.9G11GVery good
Q4_K_M★8.5G10GBest value for most people
Q3_K_M7G8GNoticeable loss
Q2_K5.3G6.5GLast resort only

Method:显存为 Q4_K_M 档参考

Your device

A plain-language profile of every model you can run yourself: parameter count, hardware it needs, which quantisation fits. No rankings, no prices — just what it takes to run.

Save your device profile once and this page will tell you whether it runs on your machine.Add your device·No account? Try a one-off check

Install prompt

Copy it, paste it into your AI (Claude Code, Codex, ChatGPT…), and it installs and verifies for you.

43 lines
我需要你帮我在我的机器上安装并运行一个软件。

【软件信息】
名称:Qwen2.5 7B Instruct
用途:中文理解明显更好的 7B 级模型,8GB 显存能跑。
官方来源:https://github.com/QwenLM/Qwen2.5
许可:Apache-2.0
Scroll inside the box with your mouse wheel — copying still gives you the full prompt1178 chars

Copy → paste into your own AI → it installs for you

About this entry

它是什么

Qwen2.5 7B Instruct 是阿里云通义千问的 7B 级对话模型,中文能力比多数西方模型明显更好,许可是 Apache-2.0,对商业使用最宽松。来源:https://github.com/QwenLM/Qwen2.5https://github.com/QwenLM/Qwen2.5

怎么用起来

Qwen2.5 7B Instruct 装上推理工具后按名字拉取,选 Q4_K_M 量化版本即可在 8GB 显存上跑。来源:https://github.com/QwenLM/Qwen2.5https://github.com/QwenLM/Qwen2.5

以上坑来自 https://github.com/QwenLM/Qwen2.5https://github.com/QwenLM/Qwen2.5 与官方文档。

来源与署名

Mentioned from:https://github.com/QwenLM/Qwen2.5https://github.com/QwenLM/Qwen2.5 · 原作者 阿里云通义千问(Qwen)(Apache-2.0)。