Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

towards v1.7: new CMS datasets, CLIC hit-based datasets, TF backward-compat optimizations #285

Merged
merged 48 commits into from
Jan 31, 2024
Merged

towards v1.7: new CMS datasets, CLIC hit-based datasets, TF backward-compat optimizations #285

merged 48 commits into from
Jan 31, 2024

Conversation

jpata
Copy link
Owner

@jpata jpata commented Dec 18, 2023 •
edited
Loading

  • update CMS dataset to v1.7.0
    • contains cluster shape variables
  • update CLIC hit-based dataset to v1.7.0
    • new track variables
  • fix recent awkward bug in the data loading pipeline: bug when updating from uproot 5.0.12 -> 5.2.1 #286
  • TF backward compatibility fixes:
    • update optimize state save/load to work with both tf 2.14 and tf 2.12, needed for LUMI/AMD because LUMI currently supports TF 2.12 as the latest version.

Best training of parameters/cms-gen.yaml after 10 epochs:
https://www.comet.com/jpata/particleflow-tf/59ee208875b1494184721a73d70393c9
jet_res
met_res

jpata and others added 30 commits December 18, 2023 14:56
@jpata
up
80f5cb3
@jpata
format
216f63c
@jpata
up
1d05bbd
@jpata
training with cms 2.0.0
6a4e745
@jpata
up
11e39ca
@jpata
up
5693301
@jpata
Merge branch 'main' into cms_data_v2
72c4352
@jpata
fix postprocessing for new uproot
7b0f658
@jpata
track memory usage of pandora
5bda955
@jpata
up
8f29d5c
@jpata
fix
8d046db
@jpata
up
4e693c2
@jpata
readd dim decrease options
bdd61dd
@jpata
optimizer save/restore
448e795
up
63ee6a5
@jpata
hypertune
e7996c7
@jpata
up
8c5f096
@jpata
Merge branch 'cms_data_v2' of github.com:jpata/particleflow into cms_…
95217fe 
…data_v2
up
d6b0df6
Merge branch 'cms_data_v2' of https://github.com/jpata/particleflow i…
c0d0440 
…nto cms_data_v2
@jpata
up
5771aaf
@jpata
update track feats
6481533
@jpata
up
264f78c
@jpata
up
f62854a
@jpata
up
86b1495
@jpata
up
c527941
up
d7f9cf2
Merge branch 'cms_data_v2' of https://github.com/jpata/particleflow i…
41a832d 
…nto cms_data_v2
@jpata
up
57eb0d4
@jpata
Merge branch 'cms_data_v2' of github.com:jpata/particleflow into cms_…
69f3d28 
…data_v2
@jpata jpata changed the title CMS new dataset v2.0.0 New CMS dataset, TF optimizations Jan 25, 2024
@jpata jpata changed the title New CMS dataset, TF optimizations v1.7: new CMS datasets, CLIC hit-based datasets, TF backward-compat optimizations Jan 29, 2024
@jpata jpata changed the title v1.7: new CMS datasets, CLIC hit-based datasets, TF backward-compat optimizations towards v1.7: new CMS datasets, CLIC hit-based datasets, TF backward-compat optimizations Jan 30, 2024
@jpata jpata merged commit d335cd3 into main Jan 31, 2024
10 checks passed
@jpata jpata mentioned this pull request Jan 31, 2024
Closed
@jpata jpata mentioned this pull request Feb 18, 2024
Closed
@jpata jpata deleted the cms_data_v2 branch March 22, 2024 19:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jpata