Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug 1866469 - Exclude use_counters from GLAM ETL #4603

Merged
merged 4 commits into from
Nov 24, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions script/glam/generate_glean_sql
Original file line number Diff line number Diff line change
Expand Up @@ -60,9 +60,12 @@ function write_clients_daily_aggregates {

# e.g. baseline_v1
local tables;
# we're excluding use_counters because they are not supported in GLAM
# and generated query is too big to run
tables=$(
bq ls "$qualified" \
| grep TABLE \
| grep -v use_counters \
| awk '{print $1}'
)
# generate all of the schemas in parallel
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,31 +9,31 @@
last_reported_device_model: model-2
last_reported_channel: release
activated: true
install_source: com.android.vending
channel: release
install_source: com.android.vending
metadata:
install_source__source_ping: metrics
install_source__source_ping_datetime: 2023-01-01T00:00:00
min_metrics_ping_submission_date: 2023-01-01
reported_metrics_ping: true
reported_first_session_ping: false
reported_baseline_ping: true
min_metrics_ping_submission_date: 2023-01-01
install_source__source_ping_datetime: '2023-01-01T00:00:00'
install_source__source_ping: metrics
- client_id: client-2
sample_id: 50
first_seen_date: 2022-12-25
submission_date: 2022-12-25
device_model: model-2
last_reported_device_model: model-2
adjust_network: Organic
last_reported_adjust_network: Organic
last_reported_device_model: model-2
activated: false
metadata:
adjust_network__source_ping: metrics
adjust_network__source_ping_datetime: 2023-01-01T00:00:00
reported_metrics_ping: true
reported_first_session_ping: false
reported_baseline_ping: false
min_metrics_ping_submission_date: 2023-01-01
adjust_network__source_ping: metrics
adjust_network__source_ping_datetime: '2023-01-01T00:00:00'
- client_id: client-3
sample_id: 50
adjust_network: Organic
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -30,18 +30,18 @@
adjust_network__source_ping_datetime: '2023-05-02T00:00:00'
- client_id: client-3
sample_id: 70
install_source: com.android.vending
first_seen_date: 2023-05-01
submission_date: 2023-05-02
first_run_date: 2023-05-01
last_reported_date: 2023-05-02
last_reported_channel: release
channel: release
activated: false
install_source: com.android.vending
metadata:
install_source__source_ping_datetime: 2023-05-02T00:00:00
min_metrics_ping_submission_date: 2023-05-02
reported_first_session_ping: false
reported_metrics_ping: true
reported_baseline_ping: true
install_source__source_ping: metrics
install_source__source_ping_datetime: '2023-05-02T00:00:00'
min_metrics_ping_submission_date: 2023-05-02
Original file line number Diff line number Diff line change
Expand Up @@ -31,20 +31,20 @@
- client_id: client-3
sample_id: 70
first_seen_date: 2023-05-01
install_source: com.android.vending
submission_date: 2023-05-02
first_run_date: 2023-05-01
last_reported_date: 2023-05-02
last_reported_channel: release
adjust_network: Untrusted Devices
channel: release
activated: false
install_source: com.android.vending
metadata:
reported_first_session_ping: true
reported_metrics_ping: true
reported_baseline_ping: true
install_source__source_ping: metrics
install_source__source_ping_datetime: '2023-05-02T00:00:00'
install_source__source_ping_datetime: 2023-05-02T00:00:00
min_metrics_ping_submission_date: 2023-05-02
min_first_session_ping_submission_date: 2023-05-02
min_first_session_ping_run_date: 2023-05-01
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -9,16 +9,16 @@
last_reported_country: CA
sample_id: 54
activated: false
adjust_network: 'Organic'
last_reported_adjust_network: 'Organic'
adjust_network: Organic
last_reported_adjust_network: Organic
channel: release
metadata:
adjust_network__source_ping: metrics
adjust_network__source_ping_datetime: 2023-01-01T00:00:00
min_metrics_ping_submission_date: 2023-01-01
reported_first_session_ping: false
reported_metrics_ping: true
reported_baseline_ping: true
min_metrics_ping_submission_date: 2023-01-01
adjust_network__source_ping_datetime: '2023-01-01T00:00:00'
adjust_network__source_ping: metrics
- client_id: client-2
install_source: 'Test Install Source'
sample_id: 40
Expand Down