Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Exclude Epoch Boundary from Health Check #105

Closed
wants to merge 5 commits into from
Closed

Exclude Epoch Boundary from Health Check #105

Changes from 1 commit
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
83f0450
Exclude Epoch Boundary from Health Check
jedleggett Jan 29, 2024
298e22c
feedback
jedleggett Jan 29, 2024
f6998bc
handle possible slot padding
jedleggett Jan 30, 2024
f60203d
ignore edge cases
jedleggett Jan 31, 2024
8058f31
Merge branch 'master' into jl/epoch_boundary_health
jedleggett Feb 5, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
25 changes: 15 additions & 10 deletions relayer/src/health_manager.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,23 +42,28 @@ impl HealthManager {
let mut slot_sender_max_len = 0usize;
let channel_len_tick = tick(Duration::from_secs(5));
let check_and_metrics_tick = tick(missing_slot_unhealthy_threshold / 2);
let mut outside_epoch_boundary = true;

while !exit.load(Ordering::Relaxed) {
select! {
recv(check_and_metrics_tick) -> _ => {
let new_health_state =
match last_update.elapsed() <= missing_slot_unhealthy_threshold {
true => HealthState::Healthy,
false => HealthState::Unhealthy,
};
*health_state.write().unwrap() = new_health_state;
datapoint_info!(
"relayer-health-state",
("health_state", new_health_state, i64)
);
if outside_epoch_boundary {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you move the check of outside_epoch_boundary into the match statement/if/else for health state? may be helpful to continue emitting data points during that time

let new_health_state =
match last_update.elapsed() <= missing_slot_unhealthy_threshold {
true => HealthState::Healthy,
false => HealthState::Unhealthy,
};
*health_state.write().unwrap() = new_health_state;
datapoint_info!(
"relayer-health-state",
("health_state", new_health_state, i64)
);
}
}
recv(slot_receiver) -> maybe_slot => {
let slot = maybe_slot.expect("error receiving slot, exiting");
// Don't perform health updates within +/- ~30 sec of epoch boundary
jedleggett marked this conversation as resolved.
Show resolved Hide resolved
outside_epoch_boundary = (75..=431_925).contains(&(slot % 432_000));
jedleggett marked this conversation as resolved.
Show resolved Hide resolved
jedleggett marked this conversation as resolved.
Show resolved Hide resolved
slot_sender.send(slot).expect("error forwarding slot, exiting");
last_update = Instant::now();
}
Expand Down