移动端设备能部署的llm

mlc-llm

内置RedPajama

hf示例模型 TheBloke/Mistral-7B-Instruct-v0.2-GGUF

https://github.com/mlc-ai/mlc-llm/tree/main

llama.cpp

https://github.com/ggml-org/llama.cpp

reference

---

MLC-LLM：大模型如何部署到浏览器 / 手机？完整流程复现

https://blog.csdn.net/sinat_28461591/article/details/147140479