[FEAT]: Flowise APi

[SerenityNrrd]

What would you like to see?

Do you have a Template to create a Custom Endpoint for your AnythingLLM ? I want to create a way to use Flowise API https://docs.flowiseai.com/using-flowise/api - and have it work with your AnyhtingLLM framework. ?

[timothycarambat]

Are you using streaming? I presume you are using the Generic OpenAI connector for chatting?

[SerenityNrrd]

yes, I am trying to use the generic openAI connector for now but i would love to make a custom connector so we dont have to do this weird convertion.

[timothycarambat]

But your end goal is basically just to connect to some Flowise process endpoint to process a chat, correct?

[SerenityNrrd]

Yes, Specially I would like to use Anything as the front end for Flowise and then use a few different flows as Models.

[SerenityNrrd]

Basicially I can get the response out.. but no matter what I try i can't get AnythingLLM to show the response from Flowise.

[SerenityNrrd]

Are you using streaming? I presume you are using the Generic OpenAI connector for chatting?

Thanks to this Question i was able to Figure out my issue and got it working.

[timothycarambat]

I think issue for an integration with flowise still makes sense though

[SerenityNrrd]

I think issue for an integration with flowise still makes sense though

I completely agree I searched for hours there is no real frontend GUI offering it yet besides the simple embed it offers. (hence why i was trying to figure it out myself). Flowise allows anyone to make Complete Flows that would take hours to try to implement on a coding end. My use case is to be able to assign a few different Flows as "Models" so that Clients can Choose what Function or Information path they want to follow. for instance . Choose Fee Calcuation and it will Do any Fee Calcuations and focus on that or if they want to Ask questions about a Certain Chapter.. it would specialize in that chapter. and since Flowise now offers Agents and Flows like that the possiblity is pretty endless what you could build with it.. and yet it lacks a good frontend with user control and Various other things.

[nickp27]

Are you using streaming? I presume you are using the Generic OpenAI connector for chatting?

Thanks to this Question i was able to Figure out my issue and got it working.

What was the solution? Do you mind sharing? There doesn't seem to be an obvious guide for converting an Flowise endpoint to an openai compatible endpoint.

[SerenityNrrd]

Are you using streaming? I presume you are using the Generic OpenAI connector for chatting?

Thanks to this Question i was able to Figure out my issue and got it working.

What was the solution? Do you mind sharing? There doesn't seem to be an obvious guide for converting an Flowise endpoint to an openai compatible endpoint.

I shared the python script that i wrote in the discord. https://discord.com/channels/1114740394715004990/1248104856732827658 but mainly the solution was to create a middlewear server that just takes the OPENAI compatible input run the Flowise api and convert it back to openai. but it seems to be working on the lowest level but hopefully eventually we will get a full use solution in the near future.