Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Inject full files if max tokens is enough #1232

Merged
merged 2 commits into from
Jul 26, 2024
Merged

Inject full files if max tokens is enough #1232

merged 2 commits into from
Jul 26, 2024

Conversation

Josh-XT
Copy link
Owner

@Josh-XT Josh-XT commented Jul 26, 2024

  • Added a check for max tokens during prompt injection against the total tokens of uploaded files to determine if only memories should be injected or if a full file should be injected.
  • Changed default max tokens for OpenAI provider to 128k
  • Changed default Claude model to claude-3-5-sonnet-20240620

@Josh-XT Josh-XT marked this pull request as ready for review July 26, 2024 11:48
@Josh-XT Josh-XT merged commit 15cb76d into main Jul 26, 2024
8 checks passed
@Josh-XT Josh-XT deleted the inject-full-files branch July 26, 2024 11:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant