Skip to content

Commit

Permalink
specify smoothquant device (#1830)
Browse files Browse the repository at this point in the history
  • Loading branch information
Satrat authored and bfineran committed Nov 16, 2023
1 parent 5e76668 commit 7b6ac03
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/sparseml/modifiers/smoothquant/pytorch.py
Original file line number Diff line number Diff line change
Expand Up @@ -127,6 +127,7 @@ def _calibrate(self, model: ModifiableModelPyTorch, calibration_dataloader: List
calibration_dataloader,
self.num_calibration_steps,
self.calibration_function,
self.device_,
)

# remove the hooks now that we are done calibrating
Expand Down

0 comments on commit 7b6ac03

Please sign in to comment.