当前位置：首页 > news >正文

SCNet超算平台DCU异构环境的Ollama启动服务后无法转发公网的问题解决

news 2025/11/9 7:40:34

问题

SCNet超算平台DCU异构Ollama，可以启动qwen、deepseek-r1等大模型，但是启动服务后无法转发公网。无法转发公网，那么就没法使用api调用大模型，只能在命令行里使用一下，很受限制。

SCNet超算平台启动Ollama的方法参见：https://skywalk.blog.csdn.net/article/details/149727610

具体问题是：点击“配置转发”后，键入11434端口，显示服务未启动，但是netstat 显示已经启动了，只不过是监听127.0.0.1:11434端口

netstat -an
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address           Foreign Address         State      
tcp        0      0 127.0.0.1:11434         0.0.0.0:*               LISTEN     
tcp        0      0 127.0.0.1:59824         0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN     
tcp        0      0 0.0.0.0:8888            0.0.0.0:*               LISTEN

解决问题

做了很多尝试，比如换系统，换模型等，折腾了一通，都没有搞定。突然想到，是不是没有绑定到0.0.0.0导致的？

于是在启动ollama serve前，先设定了环境变量OLLAMA_HOST=0.0.0.0

export OLLAMA_HOST=0.0.0.0

再启动ollama

ollama serve

这时候就侦听到0.0.0.0了

tcp6       0      0 :::11434                :::*                    LISTEN

再去设置转发，发现SCNet服务器已经成功转发服务。

问题解决！

困扰我很久的一个问题解决了，真高兴！

测试一下

curl https://c-1982767703556689922.ksai.scnet.cn:58043/api/generate -d '{ "model":"
deepseek-r1:32b", "prompt": "hello？"}'

不错，32b的速度还可以

curl https://c-1982767703556689922.ksai.scnet.cn:58043/api/generate -d '{ "model":"
deepseek-r1:32b", "prompt": "hello？"}'
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:30.814483838Z","response":"\u003cthink\u003e","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:30.877011558Z","response":"\n\n","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:30.941175238Z","response":"\u003c/think\u003e","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.004792689Z","response":"\n\n","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.068464879Z","response":"Hello","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.132073969Z","response":"!","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.19578553Z","response":" How","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.262070871Z","response":" can","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.326046942Z","response":" I","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.390118722Z","response":" assist","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.453499712Z","response":" you","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.525891647Z","response":" today","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.596185501Z","response":"?","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.731741755Z","response":" 😊","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:31.795224795Z","response":"","done":true,"done_reason":"stop","context":[151644,14990,11319,151645,151648,271,151649,198,198,9707,0,2585,646,358,7789,498,3351,30,26525,232],"total_duration":1167781216,"load_duration":67338932,"prompt_eval_count":5,"prompt_eval_duration":63000000,"eval_count":16,"eval_duration":1035000000}
skywalk@fb5:~/work/autocoder_kotti $ curl https://c-1982767703556689922.ksai.scnet.cn:58043/api/generate -d '{ "model":"deepseek-r1:32b", "prompt": "kotti这个项目怎么样"}'
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.526113974Z","response":"\u003cthink\u003e","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.592920496Z","response":"\n","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.662203839Z","response":"嗯","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.733237033Z","response":"，","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.800235705Z","response":"我现在","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.867197487Z","response":"想","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:54.932095908Z","response":"了解一下","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:55.00007674Z","response":"K","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:55.071078544Z","response":"otti","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:55.136592725Z","response":"这个","done":false}
{"model":"deepseek-r1:32b","created_at":"2025-11-07T11:21:55.200129916Z","response":"项目","done":false}