Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[KV Cache Interface] Text Generation & Decoder Engine Implementation #1089
[KV Cache Interface] Text Generation & Decoder Engine Implementation #1089
Changes from all commits
48ac0ac
cf7f2b9
832630a
9958c83
e6d2b03
7f9935b
b1cf01b
0a3f48d
add4625
22d2746
7f1651d
b85746d
aadc608
58bc2b0
d538444
e19676b
7908b74
4bc3472
c07f7ed
fb77838
2097463
5eb10a9
9213f29
d9af004
476f25d
fab44e4
d454e2f
1613e25
b61055c
6ee25fc
5d3004b
ace6fa5
388586d
afd0139
30eeda7
5882b56
4bbe33d
afa5746
e2bb78c
2299009
2935b77
b89b156
dc3d61b
a294265
af97f2b
c117788
4ad5f49
9e816bb
f97467f
6be8d87
e2f088d
9fc6c64
a610faf
347d1fb
e11027c
a950910
c1d02dc
711cdfb
e602662
06b5246
5d59d23
765a5f7
15586a4
4d35779
775c648
54aec69
25cdd38
830a85e
388e7ab
3970a7a
7cdf939
950c653
ea82e99
016cac1
c6efccd
a19cf2e
c59da37
6d40c03
741f452
7b27abe
db6b54b
b3fb3b8
47c0c4b
76e332d
4791ed3
8c5734b
6c5daab
812408c
952abda
2ff4987
725a210
108596e
f6a9baf
b25886a
53d7b70
0b0f74a
4d6860a
d68f045
759dc93
3e1d32f
4c39d7f
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing