关于ollama 在mac的部署问题

news/2024/9/23 7:01:58 标签: macos

安装

官网链接

直接按需求下载即可

默认模型下载地址

macOS: ~/.ollama/models
Linux: /usr/share/ollama/.ollama/models
Windows: C:\Users<username>.ollama\models

根据需要的平台设置相应的环境变量： OLLAMA_MODELS
如Mac 设置～/.zshrc

export  OLLAMA_MODELS = "/your_path/"

接着运行命令 ollama run qwen2:7b
可以开始本地大模型了

path_helper: ndk.path.save: Permission denied
(base) chendongming@chendongmingdeMac-mini ~ % ollama run qwen2:7b
pulling manifest 
pulling 43f7a214e532... 100% ▕██████████████████████████████████████████████████████████▏ 4.4 GB                         
pulling 77c91b422cc9... 100% ▕██████████████████████████████████████████████████████████▏ 1.4 KB                         
pulling c156170b718e... 100% ▕██████████████████████████████████████████████████████████▏  11 KB                         
pulling f02dd72bb242... 100% ▕██████████████████████████████████████████████████████████▏   59 B                         
pulling 75357d685f23... 100% ▕██████████████████████████████████████████████████████████▏   28 B                         
pulling 648f809ced2b... 100% ▕██████████████████████████████████████████████████████████▏  485 B                         
verifying sha256 digest 
writing manifest 
success 
>>> hello
Hello! How can I help you today? Is there something specific you would like to know or discuss? I'm here to answer 
any questions you might have, whether they're about general knowledge, specific topics, or just need advice on 
certain issues. Feel free to ask anything you'd like.