docs:ai:common:unsloth

unsloth

文档:https://docs.unsloth.ai/

所有模型:https://docs.unsloth.ai/get-started/all-our-models

推荐以下模型:

  • Qwen3-30B-A3B无思考版:Qwen3-30B-A3B-Instruct-2507-Q4_K_M.gguf,18G
  • Qwen3-30B-A3B无思考版:Qwen3-30B-A3B-Instruct-2507-Q8_0.gguf,32G
  • Qwen3-Coder无思考版:Qwen3-Coder-30B-A3B-Instruct-Q4_K_M.gguf,18G
  • Qwen3-Coder无思考版:Qwen3-Coder-30B-A3B-Instruct-Q8_0.gguf,32G
  • Qwen3-14B:Qwen3-14B-Q4_K_M.gguf,9G
  • Qwen3-14B:Qwen3-14B-Q8_0.gguf,15G
  • DeepSeek-R1-0528-Qwen3-8B-Q4_K_M.gguf,5G
  • DeepSeek-R1-0528-Qwen3-8B-Q8_0.gguf,8G
  • DeepSeek-R1-Distill-Qwen-14B-Q4_K_M.gguf,8G
  • DeepSeek-R1-Distill-Qwen-14B-Q8_0.gguf,15G
  • docs/ai/common/unsloth.txt
  • 最后更改: 2025/12/21 17:32
  • ossdate