Skip to content

Commit

Permalink
[Fix] Remove erronous LIB.kv_cache input when using external kv cache…
Browse files Browse the repository at this point in the history
… management (#1337)

* initial commit

* initial commit

* cleanup

* cleanup2
  • Loading branch information
dbogunowicz committed Nov 13, 2023
1 parent 8844739 commit 0ed595f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/deepsparse/transformers/engines/nl_decoder_engine.py
Original file line number Diff line number Diff line change
Expand Up @@ -175,7 +175,7 @@ def run(
else:
# run the engine assuming external kv cache
# management.
return self.engine.run(inputs, val_inp, kv_cache)
return self.engine.run(inputs, val_inp)

def __call__(
self,
Expand Down

0 comments on commit 0ed595f

Please sign in to comment.