Hermes not working on Penumbra testnet 73

[conorsch]

Overview

We released a new chain, penumbra-testnet-deimos-7, yesterday, 2024-04-25. Today I attempted to configure Hermes to relay between deimos-7 as the Osmosis testnet, following the docs in https://github.com/penumbra-zone/penumbra/wiki/Updating-Hermes.

After setting it up, I made an IBC withdrawal, but Hermes failed to handle the tx, panicking on an unimplemented todo:

hermes logs

Apr 26 22:55:45 hermes hermes[1922251]: 2024-04-26T22:55:45.747152Z DEBUG ThreadId(01) scan.chain{chain=penumbra-testnet-deimos-7}:scan.client{client=07-tendermint-0}:scan.connection{connection=connection-0}: computed permission permission=Allow
Apr 26 22:55:45 hermes hermes[1922251]: 2024-04-26T22:55:45.747197Z DEBUG ThreadId(01) scan.chain{chain=penumbra-testnet-deimos-7}:scan.client{client=07-tendermint-0}:scan.connection{connection=connection-0}: computed permission for client and counterparty client permission=Allow
Apr 26 22:55:46 hermes hermes[1922251]: 2024-04-26T22:55:46.714827Z  INFO ThreadId(01) scan.chain{chain=osmo-test-5}: scanning chain...
Apr 26 22:55:46 hermes hermes[1922251]: 2024-04-26T22:55:46.714902Z  INFO ThreadId(01) scan.chain{chain=osmo-test-5}: scanning chain for all clients, connections and channels
Apr 26 22:55:46 hermes hermes[1922251]: 2024-04-26T22:55:46.714906Z  INFO ThreadId(01) scan.chain{chain=osmo-test-5}: scanning all clients...
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426066Z  INFO ThreadId(01) scanned chains:
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426107Z  INFO ThreadId(01) # Chain: penumbra-testnet-deimos-7
Apr 26 22:56:47 hermes hermes[1922251]:   - Client: 07-tendermint-0
Apr 26 22:56:47 hermes hermes[1922251]:     * Connection: connection-0
Apr 26 22:56:47 hermes hermes[1922251]:       | State: OPEN
Apr 26 22:56:47 hermes hermes[1922251]:       | Counterparty state: OPEN
Apr 26 22:56:47 hermes hermes[1922251]:       + Channel: channel-0
Apr 26 22:56:47 hermes hermes[1922251]:         | Port: transfer
Apr 26 22:56:47 hermes hermes[1922251]:         | State: OPEN
Apr 26 22:56:47 hermes hermes[1922251]:         | Counterparty: channel-7766
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426171Z  INFO ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}: connection is OPEN, state on destination chain is OPEN chain=penumbra-testnet-deimos-7 connection=connection-0 counterparty_chain=osmo-test-5
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426179Z  INFO ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}: connection is already open, not spawning Connection worker chain=penumbra-testnet-deimos-7 connection=connection-0
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426189Z  INFO ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}: no connection workers were spawn chain=penumbra-testnet-deimos-7 connection=connection-0
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.426196Z  INFO ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}:channel{channel=channel-0}: channel is OPEN, state on destination chain is OPEN chain=penumbra-testnet-deimos-7 counterparty_chain=osmo-test-5 channel=channel-0
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.939121Z DEBUG ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}:channel{channel=channel-0}:worker.client.refresh{client=07-tendermint-0 src_chain=osmo-test-5 dst_chain=penumbra-testnet-deimos-7}: spawning task
Apr 26 22:56:47 hermes hermes[1922251]: 2024-04-26T22:56:47.939205Z  INFO ThreadId(01) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}:channel{channel=channel-0}: spawned client worker: client::osmo-test-5->penumbra-testnet-deimos-7:07-tendermint-0
Apr 26 22:56:48 hermes hermes[1922251]: thread 'main' panicked at crates/relayer/src/config.rs:785:40:
Apr 26 22:56:48 hermes hermes[1922251]: not yet implemented
Apr 26 22:56:48 hermes hermes[1922251]: note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Apr 26 22:56:54 hermes hermes[1922251]: 2024-04-26T22:56:54.131440Z DEBUG ThreadId(19) spawn:chain{chain=penumbra-testnet-deimos-7}:client{client=07-tendermint-0}:connection{connection=connection-0}:channel{channel=channel-0}:worker.client.refresh{client=07-tendermint-0 src_chain=osmo-test-5 dst_chain=penumbra-testnet-deimos-7}: task terminated

The referenced line crates/relayer/src/config.rs:785 is

hermes/crates/relayer/src/config.rs

Line 785 in 7252b23

Self::Penumbra(_config) => todo!(),

, and I've confirmed that the Hermes instance in running on 7252b23, the exact same commit.

[conorsch]

Some more context: the previous instance of Hermes was running on commit 97804c8, which looks to be right before merge of #23. I tried reverting to that commit, and notably panic didn't happen on subsequent withdrawals, but I'm still not seeing them processed.