mlc-llm
内置RedPajama
hf示例模型 TheBloke/Mistral-7B-Instruct-v0.2-GGUF
https://github.com/mlc-ai/mlc-llm/tree/main
llama.cpp
https://github.com/ggml-org/llama.cpp
reference
---
MLC-LLM:大模型如何部署到浏览器 / 手机?完整流程复现
https://blog.csdn.net/sinat_28461591/article/details/147140479