Skip to content

Commit

Permalink
Update run_generation_cpu_woq.py (#1537)
Browse files Browse the repository at this point in the history
Signed-off-by: Wang, Chang <chang1.wang@intel.com>
  • Loading branch information
changwangss authored May 9, 2024
1 parent 2434c64 commit fd3ee5c
Showing 1 changed file with 6 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -163,7 +163,12 @@
parser.add_argument("--use_neural_speed", action="store_true")
# =======================================
args = parser.parse_args()
args.scheme = "asym" if args.scheme is None and args.woq_algo == "AutoRound" else "sym"
# woq AutoRound algo expects the default scheme is asym, others are sym.
if args.scheme is None:
if args.woq_algo == "AutoRound":
args.scheme = "asym"
else:
args.scheme = "sym"

config = AutoConfig.from_pretrained(
args.model,
Expand Down

0 comments on commit fd3ee5c

Please sign in to comment.