dspy and langfuse integration

[xucailiang]

Langfuse is a good prompt management project.
I would like to know if dspy has plans to support langfuse.
and I have written some code for this and am currently verifying them
Thank you all🙏

[lebsral]

Are you suggesting something like saving the compiled optimized json programs that DSPy creates to langfuse? (at your prompt management). Or something else? Can you give some more details of what you see happening?

[xucailiang]

Are you suggesting something like saving the compiled optimized json programs that DSPy creates to langfuse? (at your prompt management). Or something else? Can you give some more details of what you see happening?

Yes, after the dspy optimization prompt, I hope to be able to easily observe what changes have been made. In this way, we can do some comparisons and cost statistics.

Of course, we can also use a similar method inspect_history, but it would be better if there is a more intuitive management page to observe.

Thank you for your reply.

[denisergashbaev]

That´s a good suggestion. On my side, I would want DSPy integration with Langfuse. That is, I want to see the calls that DSPy makes to LLM, grouped into traces and spans.

I see there was a PR for this: #200

[xucailiang]

That´s a good suggestion. On my side, I would want DSPy integration with Langfuse. That is, I want to see the calls that DSPy makes to LLM, grouped into traces and spans.

I see there was a PR for this: #200

I also noticed this PR, unfortunately，it was submitted on Oct 31, 2023, and has not been merged yet, dspy and langfuse have been updated for many versions.

So far, I have completed part of the code for chat_request and completions_request， If necessary, I will submit these changes and try to connect langfuse elsewhere.

[arnavsinghvi11]

Feel free to build on #200 @xucailiang (will need to be updated with latest DSPy and/or Langfuse changes) or open a new PR for this integration!

[xucailiang]

Feel free to build on #200 @xucailiang (will need to be updated with latest DSPy and/or Langfuse changes) or open a new PR for this integration!

As you said, I have submitted the relevant code, PR thank you everyone🙏

[Aaryaveerkrishna23]

Langfuse is a good prompt management project. I would like to know if dspy has plans to support langfuse. and I have written some code for this and am currently verifying them Thank you all🙏

Hi , @xucailiang I was still not able to see any traces of my azure model's cost on locally hosted langfuse dashboard

[xucailiang]

Langfuse is a good prompt management project. I would like to know if dspy has plans to support langfuse. and I have written some code for this and am currently verifying them Thank you all🙏

Hi , @xucailiang I was still not able to see any traces of my azure model's cost on locally hosted langfuse dashboard

hi，The PR for integrating langfuse is under review by @arnavsinghvi11 and we are all looking forward to this feature!