build(deps): update ecc dependencies for zcashd 5.6.0, and create legacy state format compatibility layer

[oxarbitrage]

Motivation

Update ecc dependencies.

Close #6859

Depends-On: #7158

Solution

Create legacy code ion order to keep serialization the same as it was.

Review

@teor2345 and @conradoplg . There was already a lot of discussion about the options, solutions, etc.

Reviewer Checklist

• Will the PR name make sense to users?
  • Does it need extra CHANGELOG info? (new features, breaking changes, large changes)
• Are the PR labels correct?
• Does the code do what the ticket and PR says?
  • Does it change concurrent code, unsafe code, or consensus rules?
• How do you know it works? Does it have tests?

Follow Up Work

[oxarbitrage]

I was able to make some progress by using some of the read/write functions from librustzcash::zcash_primitives::merke_tree @conradoplg pointed me too.

There are several things pending, some of them are:

• There are no functions in the library to deal with sprout.
• The library has read_frontier_v0 and read_frontier_v1 but only write_frontier_v1. It is not totally clear what to use n each case but it seems read_frontier_v0 should be used in sapling.
• Checking the output of the following serialization tests:

Sapling:

$ cargo test sapling_note_commitment_tree_serialization -- --nocapture
    Finished test [unoptimized + debuginfo] target(s) in 3.17s
     Running unittests src/lib.rs (target/debug/deps/tower_batch_control-c2bd02070ca729ce)

...

running 1 test

The application panicked (crashed).
Message:  assertion failed: `(left == right)`
  left: `"0102000000000000007c3ea01a6e3a3d90cf59cd789e467044b5cd78eb2c84cc6816f960746d0e036c000162324ff2c329e99193a74d28a585a3c167a93bf41a255135529c913bd9b1e666ddaa1ab86de5c153993414f34ba97e9674c459dfadde112b89eeeafa0e5a204c"`,
 right: `"0102007c3ea01a6e3a3d90cf59cd789e467044b5cd78eb2c84cc6816f960746d0e036c0162324ff2c329e99193a74d28a585a3c167a93bf41a255135529c913bd9b1e66601ddaa1ab86de5c153993414f34ba97e9674c459dfadde112b89eeeafa0e5a204c"`
Location: zebra-state/src/service/finalized_state/tests/vectors.rs:41

...

Orchard:

$ cargo test orchard_note_commitment_tree_serialization -- --nocapture
...

     Running unittests src/lib.rs (target/debug/deps/zebra_state-a7a295af75b2f260)

running 1 test

The application panicked (crashed).
Message:  assertion failed: `(left == right)`
  left: `"010200000000000000ee9488053a30c596b43014105d3477e6f578c89240d1d1ee1743b77bb6adc40a0001a34b69a4e4d9ccf954d46e5da1004d361a5497f511aeb4d481d23c0be1778133a0be6dab19bc2c65d8299258c16e14d48ec4d4959568c6412aa85763c222a702"`,
 right: `"010200ee9488053a30c596b43014105d3477e6f578c89240d1d1ee1743b77bb6adc40a01a34b69a4e4d9ccf954d46e5da1004d361a5497f511aeb4d481d23c0be177813301a0be6dab19bc2c65d8299258c16e14d48ec4d4959568c6412aa85763c222a702"`
Location: zebra-state/src/service/finalized_state/tests/vectors.rs:90
...

Shows that the serialization is a bit longer. This seems to be because the Position is now a u64 field.

Will post more details as i discover them.

[conradoplg]

Looks great, thanks!

[mpguerra]

Let's try to wrap up this PR so we can unblock the following work. If there is any other work that would be nice to have, let's create separate PRs for it

[teor2345]

I moved the remaining dependency updates to ticket #6638, which is now a release blocker