Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Constrain HE TP depth sums to use only 11 bits #23117

Merged

Conversation

christopheralanwest
Copy link
Contributor

Quick summary:

This PR fixes an edge case in the emulation of HCAL TPs in the upgraded HE. Potentially these changes could have an effect on 2018 MC workflows in the PR comparison tests, but likely statistics are too low in these tests to see an effect.

Detailed summary:

TP ET mismatches have been seen in the TP correlation plot of the online DQM:

http://cmsonline.cern.ch/cms-elog/1038548

The mismatches only occur for TPs from the 10-degree segmentation region of HE. In this region, the physical segmentation of HE is 10 degrees but, for the convenience of the trigger, the uHTR divides the energy into two TPs to mimic 5-degree segmentation. The computation of TPs proceeds as follows:

input (linearization) LUT -> summing of depths -> (divide-by-two) -> summing of time slices -> compression LUT

where the divide-by-two is only relevant in the 10-degree segmentation region.

The firmware has the following widths:

  • input LUT 8->10 bits
  • summing of depths 10->11 bits
  • summing of timeslices 11->11 bits
  • compression 11->8 bits

The emulation uses the same LSB as the uHTR in the summing of the depths, but currently does not constrain the sum to be less than the firmware's 11-bit maximum of 0x7FF. This results in the emulated TP ET being larger than the data TP ET. In the 5-degree segmentation region, this would automatically result in a saturated TP. In contrast, in the 10-degree segmentation region, the divide-by-two reduces the ET so that it may fall in the region 64 < ET < 128 GeV, which does not necessarily result in a saturated TP after the sum of the two samples.

Constraining the depth sum to only 11 bits in the emulation resolves the discrepancies, as shown in the table below. These plots use run 315420 of the JetHT dataset. Though the HcalNZS dataset is normally used for TP emulation tests to avoid spurious mismatches between data and emulation as a result of zero suppression, the statistics are too low for this comparison because of the additional prescale of 4096 for NZS events. In these plots, the variable "soi" indicates the compressed ET in the sample of interest, and is equal to 2*ET with the current compression scheme. The features in abs(ieta)=21-28 disappear. There are additional mismatches at abs(ieta)=15-16 for reasons associated with zero-suppression, which are purely an artifact of using zero-suppressed data in the TP emulation, and are not relevant for this PR.

Before change After change
soi_emul_vs_soi_run315420_before_fix soi_emul_vs_soi_run315420
et_vs_ieta_run315420_before_fix et_vs_ieta_run315420

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

A new Pull Request was created by @christopheralanwest for master.

It involves the following packages:

SimCalorimetry/HcalTrigPrimAlgos

@nsmith-, @rekovic, @cmsbuild, @thomreis can you please review it and eventually sign? Thanks.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@thomreis
Copy link
Contributor

thomreis commented May 2, 2018

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/27761/console Started: 2018/05/02 22:03

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 2, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23117/27761/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-23117/250202.181_TTbar_13UP18+TTbar_13UP18+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 6 differences found in the comparisons
  • DQMHistoTests: Total files compared: 30
  • DQMHistoTests: Total histograms compared: 2721257
  • DQMHistoTests: Total failures: 2254
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2718820
  • DQMHistoTests: Total skipped: 183
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 29 files compared)
  • Checked 124 log files, 14 edm output root files, 30 DQM output files

@christopheralanwest
Copy link
Contributor Author

I don't understand what went wrong in the comparison tests. The discrepancies are entirely in tracking histograms, and appear to be virtually identical to those seen in the comparison tests for PR #23115, which uses the same comparison baseline. No such discrepancies are seen in the comparison tests for the backport of this PR.

@christopheralanwest
Copy link
Contributor Author

The unexpected discrepancies in tracking/vertexing/PV histograms of the comparison test are presumably a consequence of the problem described in #23105, and are unrelated to this PR.

@abdoulline
Copy link

@thomreis Could you, please, take a look and eventually approve this important fix?

@thomreis
Copy link
Contributor

thomreis commented May 8, 2018

+1

So the FW sets the sum value to 0x7ff if the sum is larger than what fits in 11 bits if I understand this correctly? It does not just cut away the bits above the 11th?

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23117/27862/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 30
  • DQMHistoTests: Total histograms compared: 2713614
  • DQMHistoTests: Total failures: 2222
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2711209
  • DQMHistoTests: Total skipped: 183
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 29 files compared)
  • Checked 124 log files, 14 edm output root files, 30 DQM output files

@christopheralanwest
Copy link
Contributor Author

@fabiocos All of the changes in the comparison tests are in tracking/vertexing histograms. These differences appear to be completely spurious, as this PR only makes a simple change to the HCAL trigger primitive emulation.

@fabiocos
Copy link
Contributor

fabiocos commented May 8, 2018

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/27871/console Started: 2018/05/08 22:26

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented May 8, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23117/27871/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 6 differences found in the comparisons
  • DQMHistoTests: Total files compared: 30
  • DQMHistoTests: Total histograms compared: 2713614
  • DQMHistoTests: Total failures: 2127
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2711304
  • DQMHistoTests: Total skipped: 183
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 29 files compared)
  • Checked 124 log files, 14 edm output root files, 30 DQM output files

@fabiocos
Copy link
Contributor

fabiocos commented May 9, 2018

+1

@cmsbuild cmsbuild merged commit eac3e0c into cms-sw:master May 9, 2018
@christopheralanwest christopheralanwest deleted the hcal-tp-11bit-depth-sum branch August 21, 2019 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants