Skip to content

Commit

Permalink
comments and lint
Browse files Browse the repository at this point in the history
  • Loading branch information
horheynm committed Jan 5, 2024
1 parent a797562 commit 93222fe
Showing 1 changed file with 7 additions and 4 deletions.
11 changes: 7 additions & 4 deletions src/deepsparse/benchmark/benchmark_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -349,7 +349,7 @@ def benchmark_model(
disable_kv_cache_overrides: bool = False,
) -> Dict:
"""
Run benchamrk of a given model on a given engine
Benchmark a model on a given engine
:param model_path: Path or stub to the model
:param batch_size: Batch size, Defaults to 1.
Expand All @@ -362,11 +362,14 @@ def benchmark_model(
:param sequence_length: Sequence length for text-gen. Defaults to None.
:param input_ids_length: Length of the input ids. Defaults to 1.
:param thread_pinning: The hardware to pin for threading. Defaults to "core".
:param engine: The type of engine to use. Defaults to our proprietary DEEPSPARSE_ENGINE.
:param internal_kv_cache: Runs the benchmark with or w/o the kv cache. Defaults to True.
:param engine: The type of engine to use. Defaults to our proprietary
DEEPSPARSE_ENGINE.
:param internal_kv_cache: Runs the benchmark with or w/o the kv cache.
Defaults to True.
:param quiet: Verbose option if set to False. Defaults to False.
:param export_path: Path to save the results. Defaults to None.
:param disable_kv_cache_overrides: Option to override the kv cache. Defaults to False.
:param disable_kv_cache_overrides: Option to override the kv cache.
Defaults to False.
:returns: Dictionary of benchmarked metrics
"""
Expand Down

0 comments on commit 93222fe

Please sign in to comment.