coredump when build with CXXFLAG -Wp,-D_GLIBCXX_ASSERTIONS

[samchugit]

coredump when build and test sentencepiece 0.1.99 with CXXFLAG -Wp,-D_GLIBCXX_ASSERTIONS

This is when it crashed.

This is gdb back trace.

I wonder if this line will access out of bounds of the vector.

sentencepiece/src/unigram_model_trainer.cc

Line 236 in 3863f76

const char32 *begin = &array[offset];

[taku910]

Thank you for the report. Wil fix it in the next release.

[taku910]

Fixed in v0.2.0

[Henry-ZHR]

I still face coredump with v0.2.0.

Seems the same place?

[Henry-ZHR]

@taku910