2 Commits

Author	SHA1	Message	Date
binary-husky	d7dd586f09	introduce unified base class for local llm models	2023-08-07 00:57:52 +08:00
ValeriaWong	c0c337988f	feat(chatglm_int8_onnx):纯CPU推理，最多仅需8GB内存，推理速度未测评，token数有限，暂时还不能流式输出 #1008	2023-08-01 00:48:57 +08:00