Audit and fix endianness issues

[qwandor]

I suspect that this crate currently assumes little-endian byte order in a bunch of places, and will break on big-endian architectures. We should go through and make the endianness explicit so that it will work on either. (I plan on doing so, this is just to keep track of it.)