Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

community[patch]: Support for specifying api url for firecrawl document loader #6488

Merged
merged 5 commits into from
Aug 12, 2024

Conversation

wahpiangle
Copy link
Contributor

@wahpiangle wahpiangle commented Aug 10, 2024

Fixes #6489

JS Version of langchain-ai/langchain/pull/24747

This PR would provide support for users to use self-hosted instances of Firecrawl.

The FirecrawlApp class already has support to pass this argument. See https://github.com/mendableai/firecrawl/blob/main/apps/js-sdk/firecrawl/src/index.ts#L9

Copy link

vercel bot commented Aug 10, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
langchainjs-api-refs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Aug 12, 2024 11:11am
langchainjs-docs ✅ Ready (Inspect) Visit Preview Aug 12, 2024 11:11am

@dosubot dosubot bot added size:S This PR changes 10-29 lines, ignoring generated files. auto:improvement Medium size change to existing code to handle new use-cases labels Aug 10, 2024
@@ -56,6 +62,7 @@ export class FireCrawlLoader extends BaseDocumentLoader {
super();
const {
apiKey = getEnvironmentVariable("FIRECRAWL_API_KEY"),
apiUrl = "https://api.firecrawl.dev",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's just leave this unset by default? Then we can only need to pass it to the underlying SDK if it is overridden?

Copy link
Collaborator

@jacoblee93 jacoblee93 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's remove the default value so that if the official SDK changes no update will be needed here

@jacoblee93 jacoblee93 changed the title Community:Support for specifying api url for firecrawl document loader community[patch]: Support for specifying api url for firecrawl document loader Aug 12, 2024
@jacoblee93 jacoblee93 merged commit 3ff65cb into langchain-ai:main Aug 12, 2024
33 checks passed
@jacoblee93
Copy link
Collaborator

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto:improvement Medium size change to existing code to handle new use-cases size:S This PR changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add support for specifying api url for FirecrawlLoader
2 participants