github-clones
/
gpt_academic
mirror of https://github.com/binary-husky/gpt_academic.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
gpt_academic/request_llms
History
YIQI JIANG f60a12f8b4
Add o1 and o1-2024-12-17 model support (#2090) 
* Add o1 and o1-2024-12-17 model support

* patch api key selection

---------

Co-authored-by: 蒋翌琪 <jiangyiqi99@jiangyiqideMacBook-Pro.local>
Co-authored-by: binary-husky <qingxu.fu@outlook.com>
 		2024-12-19 22:32:57 +08:00
..
embed_models add milvus vector store 2024-09-08 15:19:03 +00:00
README.md re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
bridge_all.py Add o1 and o1-2024-12-17 model support (#2090) 2024-12-19 22:32:57 +08:00
bridge_chatglm.py merge frontier branch (#1620) 2024-03-11 17:26:09 +08:00
bridge_chatglm3.py Add ChatGLM4 local deployment support and refactor ChatGLM bridge's path configuration (#2062) 2024-12-07 23:43:51 +08:00
bridge_chatglm4.py Add ChatGLM4 local deployment support and refactor ChatGLM bridge's path configuration (#2062) 2024-12-07 23:43:51 +08:00
bridge_chatglmft.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_chatglmonnx.py merge frontier branch (#1620) 2024-03-11 17:26:09 +08:00
bridge_chatgpt.py explicitly declare default value 2024-10-15 06:41:12 +00:00
bridge_chatgpt_vision.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_claude.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_cohere.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_deepseekcoder.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_google_gemini.py Add Support for Gemini 1.5 Pro & Gemini 1.5 Flash (#1926) 2024-08-12 21:44:24 +08:00
bridge_internlm.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_jittorllms_llama.py Version 3.74: Merge latest updates on dev branch (frontier) (#1621) 2024-04-08 11:49:30 +08:00
bridge_jittorllms_pangualpha.py Version 3.74: Merge latest updates on dev branch (frontier) (#1621) 2024-04-08 11:49:30 +08:00
bridge_jittorllms_rwkv.py Version 3.74: Merge latest updates on dev branch (frontier) (#1621) 2024-04-08 11:49:30 +08:00
bridge_llama2.py change some open fn encoding to utf-8 2024-11-19 15:53:50 +00:00
bridge_moonshot.py change some open fn encoding to utf-8 2024-11-19 15:53:50 +00:00
bridge_moss.py Version 3.74: Merge latest updates on dev branch (frontier) (#1621) 2024-04-08 11:49:30 +08:00
bridge_newbingfree.py format source code 2024-01-13 18:04:09 +08:00
bridge_ollama.py ollama patch 2024-12-18 23:05:55 +08:00
bridge_openrouter.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_qianfan.py 添加对ERNIE-Speed和ERNIE-Lite模型的支持 (#1821) 2024-05-24 00:16:26 +08:00
bridge_qwen.py revise qwen 2024-07-02 14:22:45 +00:00
bridge_qwen_local.py merge frontier branch (#1620) 2024-03-11 17:26:09 +08:00
bridge_skylark2.py dos2unix 2024-05-14 12:02:40 +08:00
bridge_spark.py Version 3.74: Merge latest updates on dev branch (frontier) (#1621) 2024-04-08 11:49:30 +08:00
bridge_stackclaude.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_taichu.py taichu model fix 2024-06-06 09:35:05 +00:00
bridge_tgui.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
bridge_zhipu.py version 3.75 (#1702) 2024-04-30 20:37:41 +08:00
chatglmoonx.py merge frontier branch (#1620) 2024-03-11 17:26:09 +08:00
com_google.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
com_qwenapi.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
com_skylark2api.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
com_sparkapi.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
com_taichu.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
com_zhipuglm.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
edge_gpt_free.py format source code 2024-01-13 18:04:09 +08:00
key_manager.py merge frontier branch (#1620) 2024-03-11 17:26:09 +08:00
local_llm_class.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
oai_std_model_template.py Merge Latest Frontier (#1991) 2024-10-05 17:09:18 +08:00
queued_pipe.py 解除本地模型的若干并发问题 2023-10-31 20:37:07 +08:00
requirements_chatglm.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
requirements_chatglm4.txt Add ChatGLM4 local deployment support and refactor ChatGLM bridge's path configuration (#2062) 2024-12-07 23:43:51 +08:00
requirements_chatglm_onnx.txt 修复protobuf版本错误 2023-12-14 11:00:55 +08:00
requirements_jittorllms.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
requirements_moss.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
requirements_newbing.txt rename folder 2023-10-28 17:44:17 +08:00
requirements_qwen.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
requirements_qwen_local.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00
requirements_slackclaude.txt re-format code to with pre-commit 2023-12-31 19:30:32 +08:00

README.md

P.S. 如果您按照以下步骤成功接入了新的大模型，欢迎发Pull Requests（如果您在自己接入新模型的过程中遇到困难，欢迎加README底部QQ群联系群主）

如何接入其他本地大语言模型

  1. 复制request_llms/bridge_llama2.py，重命名为你喜欢的名字

  2. 修改load_model_and_tokenizer方法，加载你的模型和分词器（去该模型官网找demo，复制粘贴即可）

  3. 修改llm_stream_generator方法，定义推理模型（去该模型官网找demo，复制粘贴即可）

  4. 命令行测试

    • 修改tests/test_llms.py（聪慧如您，只需要看一眼该文件就明白怎么修改了）
    • 运行python tests/test_llms.py

  5. 测试通过后，在request_llms/bridge_all.py中做最后的修改，把你的模型完全接入到框架中（聪慧如您，只需要看一眼该文件就明白怎么修改了）

  6. 修改LLM_MODEL配置，然后运行python main.py，测试最后的效果

如何接入其他在线大语言模型

  1. 复制request_llms/bridge_zhipu.py，重命名为你喜欢的名字

  2. 修改predict_no_ui_long_connection

  3. 修改predict

  4. 命令行测试

    • 修改tests/test_llms.py（聪慧如您，只需要看一眼该文件就明白怎么修改了）
    • 运行python tests/test_llms.py

  5. 测试通过后，在request_llms/bridge_all.py中做最后的修改，把你的模型完全接入到框架中（聪慧如您，只需要看一眼该文件就明白怎么修改了）

  6. 修改LLM_MODEL配置，然后运行python main.py，测试最后的效果