-
Notifications
You must be signed in to change notification settings - Fork 84
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
int8 optimizations #1973
int8 optimizations #1973
Conversation
Codecov Report
@@ Coverage Diff @@
## develop #1973 +/- ##
===========================================
+ Coverage 91.37% 91.40% +0.03%
===========================================
Files 422 422
Lines 15652 15645 -7
===========================================
- Hits 14302 14301 -1
+ Misses 1350 1344 -6
|
This build is OK for merge ✅ |
🔴torchvision-inceptionv3_1: FAILED: MIGraphX is not within tolerance - check verbose output🔴cadene-dpn92_1: FAILED: MIGraphX is not within tolerance - check verbose output🔴slim-inceptionv4_1: FAILED: MIGraphX is not within tolerance - check verbose output |
test/rewrite_quantization_test.cpp
Outdated
@@ -70,6 +74,8 @@ TEST_CASE(quantizelinear) | |||
EXPECT(eval(p1) == eval(p2)); | |||
EXPECT(any_of(*p1.get_main_module(), &is_quantizelinear)); | |||
EXPECT(none_of(*p2.get_main_module(), &is_quantizelinear)); | |||
// ensure clip literals created in quantized program are scalar | |||
EXPECT(any_of(*p2.get_main_module(), &is_scalar)); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should probably check the inputs to clip are scalars.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
updated test, please take a look
…MIGraphX into qdot_clip_opts
@@ -37,6 +37,17 @@ | |||
|
|||
bool is_quantizelinear(migraphx::instruction& ins) { return ins.name() == "quantizelinear"; } | |||
bool is_dequantizelinear(migraphx::instruction& ins) { return ins.name() == "dequantizelinear"; } | |||
bool is_clip_scalar(migraphx::instruction& ins) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This can be const
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should all of them be changed to const?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Ah yea they should probably all be const
.
rewrite_quantization.cpp
, literals generated for clip operator are now scalarssimplify_algebra.cpp
, updated matcher to check for quant_dot operators