README.md

ComfyUI-QianFan-LLM

ComfyUI nodes utilizing LLM models on QianFan Platform （百度智能云千帆大模型平台）

NOTICE: This Project is WIP, send issue if you want some missing features

Pre-requisites

1. Clone into custom_nodes folder of ComfyUI
2. Install SDK(s) by running python -m pip install -U -r requirements.txt
3. Run ComfyUI first, and then edit config.yaml to fill in your own credentials
   1. AppBuilder Credentials
   2. QianFan Credentials

Modules

appbuilder （千帆AppBuilder）

Document: 千帆AppBuilder-SDK

Implemented: DialogSummary, PlayGround

DialogSummary

Inputs:

• model: selection of use model
• dialog: the dialog string to be summerized

Hint: only some of the models would response with pure JSON format that can be parsed, choose wisely

PlayGround

Inputs:

• model: selection of use model
• prompt_template: use in str.format to fill in params
• params: yaml format, parse into dict and send to str.format

qianfan （千帆大模型平台）

Document: 千帆大模型平台-SDK

Implemented: Chat, Completion

Chat

Document: 千帆大模型平台-SDK

Inputs:

• model: selection of use model
• current message: yaml format, list of dicts, role and content are required
• endpoint: optional, only activate when model set to ENDPOINT
• history messages: optional, yaml format, like current message

actually will concatenate history messages and current message, then send to model

Completion

Document: 千帆大模型平台-SDK

Inputs:

• model: selection of use model
• prompt: prompt text
• endpoint: optional, only activate when model set to ENDPOINT