github-clones
/
gpt_academic
mirror of https://github.com/binary-husky/gpt_academic.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gpt_academic/request_llms
History
qingxu fu f7f6db831b 处理模型兼容的一些细节 2023-11-11 22:35:06 +08:00
..
README.md rename folder 2023-10-28 17:44:17 +08:00
bridge_all.py 处理模型兼容的一些细节 2023-11-11 22:35:06 +08:00
bridge_chatglm.py 修复本地模型在windows上的兼容性 2023-11-11 17:58:17 +08:00
bridge_chatglm3.py 修复本地模型在windows上的兼容性 2023-11-11 17:58:17 +08:00
bridge_chatglmft.py change get_conf 2023-10-29 00:34:40 +08:00
bridge_chatglmonnx.py 修复本地模型在windows上的兼容性 2023-11-11 17:58:17 +08:00
bridge_chatgpt.py 修复本地模型在Windows下的加载BUG 2023-11-11 21:11:55 +08:00
bridge_chatgpt_website.py 修复本地模型在Windows下的加载BUG 2023-11-11 21:11:55 +08:00
bridge_claude.py 修复本地模型在Windows下的加载BUG 2023-11-11 21:11:55 +08:00
bridge_internlm.py 修复本地模型在Windows下的加载BUG 2023-11-11 21:11:55 +08:00
bridge_jittorllms_llama.py change get_conf 2023-10-29 00:34:40 +08:00
bridge_jittorllms_pangualpha.py change get_conf 2023-10-29 00:34:40 +08:00
bridge_jittorllms_rwkv.py change get_conf 2023-10-29 00:34:40 +08:00
bridge_llama2.py 修复本地模型在windows上的兼容性 2023-11-11 17:58:17 +08:00
bridge_moss.py 接入新模型 2023-10-28 19:23:43 +08:00
bridge_newbingfree.py change get_conf 2023-10-29 00:34:40 +08:00
bridge_qianfan.py Merge branch 'frontier' 2023-11-07 11:40:27 +08:00
bridge_qwen.py 修复本地模型在Windows下的加载BUG 2023-11-11 21:11:55 +08:00
bridge_spark.py 修复get_conf接口 2023-10-30 11:10:05 +08:00
bridge_stackclaude.py 修复get_conf接口 2023-10-30 11:10:05 +08:00
bridge_tgui.py rename folder 2023-10-28 17:44:17 +08:00
bridge_zhipu.py change get_conf 2023-10-29 00:34:40 +08:00
chatglmoonx.py rename folder 2023-10-28 17:44:17 +08:00
com_sparkapi.py rename folder 2023-10-28 17:44:17 +08:00
com_zhipuapi.py 接入新模型 2023-10-28 19:23:43 +08:00
edge_gpt_free.py rename folder 2023-10-28 17:44:17 +08:00
key_manager.py change get_conf 2023-10-29 00:34:40 +08:00
local_llm_class.py Merge branch 'frontier' into master_autogen 2023-11-11 22:03:20 +08:00
queued_pipe.py 解除本地模型的若干并发问题 2023-10-31 20:37:07 +08:00
requirements_chatglm.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_chatglm_onnx.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_jittorllms.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_moss.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_newbing.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_qwen.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_slackclaude.txt rename folder 2023-10-28 17:44:17 +08:00

README.md

如何使用其他大语言模型

ChatGLM

  • 安装依赖 pip install -r request_llms/requirements_chatglm.txt
  • 修改配置，在config.py中将LLM_MODEL的值改为"chatglm"
LLM_MODEL = "chatglm"
  • 运行！
`python main.py`

Claude-Stack

Newbing

  • 使用cookie editor获取cookie（json）
  • 把cookie（json）加入config.py （NEWBING_COOKIES）

Moss

  • 使用docker-compose

RWKV

  • 使用docker-compose

LLAMA

  • 使用docker-compose

盘古

  • 使用docker-compose

Text-Generation-UI (TGUI，调试中，暂不可用)

1. 部署TGUI

# 1 下载模型
git clone https://github.com/oobabooga/text-generation-webui.git
# 2 这个仓库的最新代码有问题，回滚到几周之前
git reset --hard fcda3f87767e642d1c0411776e549e1d3894843d
# 3 切换路径
cd text-generation-webui
# 4 安装text-generation的额外依赖
pip install accelerate bitsandbytes flexgen gradio llamacpp markdown numpy peft requests rwkv safetensors sentencepiece tqdm datasets git+https://github.com/huggingface/transformers
# 5 下载模型
python download-model.py facebook/galactica-1.3b
# 其他可选如 facebook/opt-1.3b
#           facebook/galactica-1.3b
#           facebook/galactica-6.7b
#           facebook/galactica-120b
#           facebook/pygmalion-1.3b 等
# 详情见 https://github.com/oobabooga/text-generation-webui

# 6 启动text-generation
python server.py --cpu --listen --listen-port 7865 --model facebook_galactica-1.3b

2. 修改config.py

# LLM_MODEL格式:   tgui:[模型]@[ws地址]:[ws端口] ,   端口要和上面给定的端口一致
LLM_MODEL = "tgui:galactica-1.3b@localhost:7860"

3. 运行！

cd chatgpt-academic
python main.py