Skip to content

Adding scripts for ATLAS HEPMC Open Data handling - #259

Open
zlmarshall wants to merge 22 commits into
cernopendata:masterfrom
zlmarshall:atlas_hepmc_2025
Open

Adding scripts for ATLAS HEPMC Open Data handling#259
zlmarshall wants to merge 22 commits into
cernopendata:masterfrom
zlmarshall:atlas_hepmc_2025

Conversation

@zlmarshall

@zlmarshall zlmarshall commented Apr 21, 2025

Copy link
Copy Markdown
Contributor

This is the first iteration on scripts required for handling of the new ATLAS event generation open data in HEPMC format. The README explains all the different scripts and files included here (or should).

A few samples have been transferred to CERN already to establish the functionality of all the scripts. Everything seems to be ok so far.

The key outstanding item (needed before anything can actually go onto the Open Data Portal) is the record ID and DOI list for all the various records that will be created. Otherwise this should be just about ready to go, at least to the QA portal for checking.

@zlmarshall

zlmarshall commented May 5, 2025

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

Thank you for the DOIs and record IDs in
cernopendata/opendata.cern.ch#3737

I've updated the script here to make use of them, and tried to build a little infrastructure so that we don't screw up the assignment or get things mixed up in the future. I've tested a bit, and things seem to be working so far.

I think this means we're ready for a test deployment on the QA instance. This is going to feel like a LOT of infrastructure for just two records, but I am hoping that all this setup means we will be able to scale from 2 to 200 without any problems.

The nominal plan (I hope you agree!) would be to get this up on the QA instance, check things over, then to actually release it onto the normal portal. We'd then let phenomenologists look at it and see how to use it, and assuming everything is kosher we would then go ahead and release the next (larger) batch.

Thanks again,
Zach

@tiborsimko tiborsimko mentioned this pull request May 19, 2025
Open
tiborsimko
tiborsimko reviewed May 19, 2025
View reviewed changes
Comment thread atlas-2025-odfr-hepmc/create_file_metadata.py Outdated
Comment thread atlas-2025-odfr-hepmc/make_od_hepmc_json.py
@zlmarshall

zlmarshall commented Jun 5, 2025

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

Thank you for the test deployment! I've pushed a very minor update to the text that would be nice to have in. The only other thing I'd like if possible is for the empty "Files and Indexes" block to be removed from the meta-record at https://opendata-qa.cern.ch/record/160000 . After that, I think you're all clear to press the button and make these public!

Thanks again,
Zach

@tiborsimko tiborsimko mentioned this pull request Jun 10, 2025
Closed
@zlmarshall

zlmarshall commented Oct 2, 2025

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

I think this one's now ready for you to take a look at. You can run make_od_hepmc_json.py to generate all the files, as usual. I'm using the metadata file stashed on eos now. There are a LOT of json files generated here, and you'll see a familiar structure, I think. There are also quite a few warnings spit out by that script, which will be reduced as we get the remaining files transferred to CERN (there are still a modest number of datasets to go, because one of our grid sites is down for a long stretch). That grid site is expected to be down for so long that my inclination would be to 'just' release this to the portal and then add files once they become available (it would only be adding, no removal and no modification, which I think we agreed was ok).

Please let me know in case you spot an issues, of course!

Thanks,
Zach

@zlmarshall

zlmarshall commented Oct 29, 2025

Copy link
Copy Markdown
Contributor Author

Unfortunately, we've identified a bug affecting a large number of these samples. Please hold off on merging this until we can come back with a plan of attack.

@zlmarshall

zlmarshall commented Jun 12, 2026

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

It feels like it's been 100 years, but I think this one is finally all ready to go, with the full ~800 TB of samples for release!

Please have a look when you have an opportunity, and let me know if you identify any further issues.

Best,
Zach

@zlmarshall

zlmarshall commented Aug 19, 2026

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

Just a reminder of this one, which has been waiting for a bit more than two months now.

Best,
Zach

@Soap2G

Soap2G commented Sep 16, 2026

Copy link
Copy Markdown

Hi @tiborsimko, as mentioned yesterday, could we look into the resolution of this PR?
I quickly went through it again, and it looks good to me!

Thanks,
Giovanni.

Soap2G
Soap2G approved these changes Sep 16, 2026
View reviewed changes

@Soap2G Soap2G left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

zlmarshall and others added 19 commits September 20, 2026 11:49
@zlmarshall @tiborsimko
Adding scripts for ATLAS HEPMC Open Data handling
d8463d2 
This is the first iteration on scripts required for handling of the new
ATLAS event generation open data in HEPMC format. The README explains
all the different scripts and files included here (or should).

A few samples have been transferred to CERN already to establish the
functionality of all the scripts. Everything seems to be ok so far.

The key outstanding item (needed before anything can actually go onto
the Open Data Portal) is the record ID and DOI list for all the various
records that will be created. Otherwise this should be just about ready
to go, at least to the QA portal for checking.
@zlmarshall @tiborsimko
Preferring MC16 to MC15 metadata
ef140e8 
Connected to ATLAS internal discussion in
https://its.cern.ch/jira/browse/CENTRPAGE-569

For now, I think this is doing the correct thing
@zlmarshall @tiborsimko
Fixing production spreadsheet header after csv move
79d223e
@zlmarshall @tiborsimko
Adding a few features and samples
4ec9d2e 
- Adding late-requested exotics datasets as an explicit list of
  datasets, so the various parsing scripts had to be updated accordingly
- Updating production sheet and metadata requests accordingly
- Sorting keywords in metadata (looks nicer)
- Updating sample rules to appropriately handle the new exotics samples
@zlmarshall @tiborsimko
Adding script for building js file from metadata csv
638117c 
This js file then goes into the ATLAS open data website to document the
metadata. Including it here so that everything is in one place. Because
it is really just a copy of the csv with a header and footer, not trying
to include the output here as well (just unnecessary extra files)
@zlmarshall @tiborsimko
Final updates for first release of a test page
c0c408c 
This sets the remaining infrastructure up. I believe it is sufficient
for the first release of a test record page. Once more production is
done, we can release more of the records.
@zlmarshall @tiborsimko
Comments from Tibor (thanks)
4761920
@zlmarshall @tiborsimko
Little textual update before the release
e16c752
@zlmarshall @tiborsimko
Updating file names to match names on disk
56418a7
@zlmarshall @tiborsimko
Updating description with update notes (ha) and adding a build full m…
7fe71da 
…d script
@tiborsimko
chore(atlas-2025-odfr-hepmc): ignore generated test outputs
557bdfd
@tiborsimko
feat(atlas-2025-odfr-hepmc): add file index generation script
5bf7143
@tiborsimko
feat(utils): add script to update distribution and usage metadata
d9fb34e
@zlmarshall @tiborsimko
Suggested changes from Tibor to the description to format it much mor…
5b6147c 
…e nicely
@zlmarshall @tiborsimko
Major script update in preparation for major release
fa583d8
@zlmarshall @tiborsimko
Updates for scaling up of transfers and samples
7811462
@zlmarshall @tiborsimko
Working off the file on eos
2078bd4
@zlmarshall @tiborsimko
Adjusting for eos output file location and extra exotics samples
9476fbe
@zlmarshall @tiborsimko
Final updates for release
b42ead9 
Samples all transferred, scripts updated and tested; I believe we are
now ready to merge this beast and release the records on the Open Data
Portal!
@tiborsimko

tiborsimko commented Sep 20, 2026

Copy link
Copy Markdown
Member

Just a reminder of this one, which has been waiting for a bit more than two months now.

Hi @zlmarshall @Soap2G

Sorry for the late action on this, but as you have been using the new upload technique to push new records to the CERN Open Data portal, I think this was not really blocking?

I have now rebased this branch on top of the latest master, added my EOS file information enrichment scripts of old when we have been doing the first release, and then taken your latest updates on top of my edits, and pushed the whole thing to your branch. This now represents well the upload work history.

Two questions remain before merging:

(1) Can I again rebase and squash all this branch into reasonable logical commits, as we usually do? A first commit from Zach preparing the base release, then commit my EOS file helpers, then the second commit from Zach as the follow-up release cleanup and improvements. (Example of such rebase: #258.) This will give us a clean commit history going like:

  • feat(atlas-2025-odfr-hepmc): prepare initial HEPMC release
  • feat(atlas-2025-odfr-hepmc): add file index generation script
  • feat(utils): add script to update distribution and usage metadata
  • feat(atlas-2025-odfr-hepmc): expand datasets and finalise release

(2) Am I right that you have used the new way of publishing these records on the CERN Open Data portal via direct JSON file upload already? If yes, then the database became the single-source-of-truth already, and we don't have to verify the EOS file index creation or rerun the JSON record generation. Basically, these scripts will be "archived" here after merge, and we don't check their outputs anymore and don't store their outputs in the opendata.cern.ch directory as fixtures anymore either. (This is to nicely avoid any confusion between the "old way" and "new way" of uploading open data records.)

Please let me know if this is OK, and I rebase, squash and merged as suggested.

@zlmarshall

zlmarshall commented Sep 20, 2026

Copy link
Copy Markdown
Contributor Author

Hi @tiborsimko ,

Yes, this PR has been blocking this release; we would not be pinging you for months if it were not.

Rebasing and squashing is just fine with me.

No, we have not uploaded this record via the new system. I have only done small releases through the new system, not multi-page releases. If the notion is now that everything should go via the new system, I will in the future focus on that and making sure it is sufficient also for these kinds of releases.

Thanks,
Zach

@tiborsimko

tiborsimko commented Sep 22, 2026

Copy link
Copy Markdown
Member

@zlmarshall I have pushed some small fixes on top and I have rerun the scripts taking root://eospublic.cern.ch//eos/opendata/atlas/upload/evgen_metadata/od_hepmc_file_mapping.json into inputs and I'm seeing that some generated records have zero files attached:

$ rg '"files": \[\]' records
records/atlas-hepmc-13p6tev-sm-other-top+x-alternative.json:45:    "files": [],
records/atlas-hepmc-13p6tev-sm-wt-nominal.json:45:    "files": [],
records/atlas-hepmc-13p6tev-sm-single-top+higgs.json:45:    "files": [],
records/atlas-hepmc-13p6tev-sm-ttbar-+-bbbar.json:45:    "files": [],
records/atlas-hepmc-13tev-bsm-vector-like-leptons.json:41:    "files": [],
records/atlas-hepmc-13p6tev-sm-w+higgs.json:45:    "files": [],
records/atlas-hepmc-13p6tev-sm-z+higgs.json:45:    "files": [],
records/atlas-hepmc-13p6tev-other-sm.json:45:    "files": [],

Would you know why?

Also, the last_record_creation.json file is changed by re-running the script, see below. Is that OK?

diff --git a/atlas-2025-odfr-hepmc/last_record_creation.json b/atlas-2025-odfr-hepmc/last_record_creation.json
index e38b50d0..077c7a65 100644
--- a/atlas-2025-odfr-hepmc/last_record_creation.json
+++ b/atlas-2025-odfr-hepmc/last_record_creation.json
@@ -1,16 +1,17 @@
 {
   "records": {
     "13p6tev-alternative-sm-w-boson": [
-      "mc23_13p6TeV.603375.PhPy8EG_A14NNPDF23_VBF_Wplustaunu_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603376.PhPy8EG_A14NNPDF23_VBF_Wplusmunu_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603377.PhPy8EG_A14NNPDF23_VBF_Wplusenu_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603378.PhPy8EG_A14NNPDF23_VBF_Wminustaunu_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603379.PhPy8EG_A14NNPDF23_VBF_Wminusmunu_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603380.PhPy8EG_A14NNPDF23_VBF_Wminusenu_v2.evgen.HEPMC.e8549_e8622"
+      "mc23_13p6TeV.601183.PhPy8EG_AZNLO_Wplusenu.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601184.PhPy8EG_AZNLO_Wplusmunu.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601185.PhPy8EG_AZNLO_Wplustaunu.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601186.PhPy8EG_AZNLO_Wminusenu.evgen.HEPMC.e8514_e8601",
+      "mc23_13p6TeV.601187.PhPy8EG_AZNLO_Wminusmunu.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601188.PhPy8EG_AZNLO_Wminustaunu.evgen.HEPMC.e8514_e8528_e8596"
     ],
     "13p6tev-alternative-sm-z-boson": [
-      "mc23_13p6TeV.603373.PhPy8EG_A14NNPDF23_VBF_Zee_v2.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.603374.PhPy8EG_A14NNPDF23_VBF_Ztautau_v2.evgen.HEPMC.e8549_e8622"
+      "mc23_13p6TeV.601189.PhPy8EG_AZNLO_Zee.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601190.PhPy8EG_AZNLO_Zmumu.evgen.HEPMC.e8514_e8528_e8596",
+      "mc23_13p6TeV.601191.PhPy8EG_AZNLO_Ztautau.evgen.HEPMC.e8514_e8528_e8596"
     ],
     "13p6tev-bsm-2-jet-hidden-valley": [
       "mc23_13p6TeV.801932.Py8EG_Zprime2EJs_Ld40_rho80_pi20_Zp600_l50.evgen.HEPMC.e8532_e8528_e8596",
@@ -78,7 +79,6 @@
       "mc23_13p6TeV.802251.Py8EG_EmergingJ_ModelD_2000_5_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
       "mc23_13p6TeV.802253.Py8EG_EmergingJ_ModelD_2000_75_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
       "mc23_13p6TeV.802285.Py8EG_EmergingJ_ModelC_2000_1_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
-      "mc23_13p6TeV.802287.Py8EG_EmergingJ_ModelC_2000_5_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
       "mc23_13p6TeV.802288.Py8EG_EmergingJ_ModelC_2000_20_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
       "mc23_13p6TeV.802289.Py8EG_EmergingJ_ModelC_2000_75_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
       "mc23_13p6TeV.802290.Py8EG_EmergingJ_ModelC_2000_150_4jetFilter.evgen.HEPMC.e8531_e8528_e8596",
@@ -94,7 +94,6 @@
     ],
     "13p6tev-bsm-charged-higgs-seesaw": [
       "mc23_13p6TeV.542687.MGPy8EG_A14NNPDF23LO_TypeII500.evgen.HEPMC.e8557_e8528_e8596",
-      "mc23_13p6TeV.542688.MGPy8EG_A14NNPDF23LO_TypeII600.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.542689.MGPy8EG_A14NNPDF23LO_TypeII700.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.542690.MGPy8EG_A14NNPDF23LO_TypeII800.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.542691.MGPy8EG_A14NNPDF23LO_TypeII900.evgen.HEPMC.e8557_e8528_e8596",
@@ -523,7 +522,6 @@
       "mc23_13p6TeV.602464.PhH7EG_NLO_LQ_S43_ResProd_lam31_2500_3p5.evgen.HEPMC.e8544_e8528_e8596",
       "mc23_13p6TeV.602465.PhH7EG_NLO_LQ_S43_ResProd_lam31_3000_0p5.evgen.HEPMC.e8544_e8528_e8596",
       "mc23_13p6TeV.602466.PhH7EG_NLO_LQ_S43_ResProd_lam31_3000_1p5.evgen.HEPMC.e8544_e8528_e8596",
-      "mc23_13p6TeV.602467.PhH7EG_NLO_LQ_S43_ResProd_lam31_3000_2p5.evgen.HEPMC.e8544_e8528_e8596",
       "mc23_13p6TeV.602468.PhH7EG_NLO_LQ_S43_ResProd_lam31_3000_3p5.evgen.HEPMC.e8544_e8528_e8596",
       "mc23_13p6TeV.602469.PhH7EG_NLO_LQ_S43_ResProd_lam31_3500_0p5.evgen.HEPMC.e8544_e8528_e8596",
       "mc23_13p6TeV.602470.PhH7EG_NLO_LQ_S43_ResProd_lam31_3500_1p5.evgen.HEPMC.e8544_e8528_e8596",
@@ -537,7 +535,6 @@
       "mc23_13p6TeV.558345.MGPy8EG_U1_Pair_min_bL33_1p0_gU_1p0_M2000.evgen.HEPMC.e8549_e8528_e8596",
       "mc23_13p6TeV.558346.MGPy8EG_U1_Pair_min_bL33_1p0_gU_0p5_M2000.evgen.HEPMC.e8549_e8528_e8596",
       "mc23_13p6TeV.558347.MGPy8EG_U1_Pair_min_bL33_1p0_gU_0p5_M3000.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.558348.MGPy8EG_U1_Pair_min_bL33_1p0_gU_1p0_M3000.evgen.HEPMC.e8549_e8528_e8596",
       "mc23_13p6TeV.558349.MGPy8EG_U1_Pair_min_bL33_1p0_gU_1p5_M3000.evgen.HEPMC.e8549_e8528_e8596",
       "mc23_13p6TeV.558350.MGPy8EG_U1_Pair_min_bL33_1p0_gU_2p0_M3000.evgen.HEPMC.e8549_e8528_e8596",
       "mc23_13p6TeV.558351.MGPy8EG_U1_Pair_min_bR33_1p0_gU_1p0_M2000.evgen.HEPMC.e8549_e8528_e8596",
@@ -554,7 +551,6 @@
       "mc23_13p6TeV.604039.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_0p1_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604040.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_0p3_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604041.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_0p3_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
-      "mc23_13p6TeV.604042.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_0p5_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604043.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_0p5_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604044.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_1p0_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604045.PhH7EG_NLO_LQ_S43_DYSP_lam11_1500_1p0_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
@@ -562,7 +558,6 @@
       "mc23_13p6TeV.604047.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_0p1_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604048.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_0p3_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604049.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_0p3_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
-      "mc23_13p6TeV.604050.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_0p5_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604051.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_0p5_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604052.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_1p0_100SL600.evgen.HEPMC.e8548_e8528_e8596",
       "mc23_13p6TeV.604053.PhH7EG_NLO_LQ_S43_DYSP_lam11_2000_1p0_600SL14000.evgen.HEPMC.e8548_e8528_e8596",
@@ -801,7 +796,6 @@
       "mc23_13p6TeV.801869.Py8EG_A14NNPDF23LO_Zp_ee_ZeroWidth3000.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.801870.Py8EG_A14NNPDF23LO_Zp_ee_ZeroWidth5000.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.801871.Py8EG_A14NNPDF23LO_Zp_ee_ZeroWidth8000.evgen.HEPMC.e8551_e8528_e8596",
-      "mc23_13p6TeV.801975.Py8EG_A14NNPDF23LO_Zprime_NoInt_tautau_SSM5000.evgen.HEPMC.e8543_e8528_e8596",
       "mc23_13p6TeV.801976.Py8EG_A14NNPDF23LO_Zprime_NoInt_tautau_SSM3000.evgen.HEPMC.e8543_e8596",
       "mc23_13p6TeV.802201.Py8EG_A14NNPDF23LO_Zprime_ee_E6Chi2000.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.802202.Py8EG_A14NNPDF23LO_Zprime_ee_E6Chi3000.evgen.HEPMC.e8551_e8528_e8596",
@@ -831,12 +825,6 @@
       "mc23_13p6TeV.513135.MGPy8EG_Wmunu_FxFx3jHT2bias_SW_105M_BFilter.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.513136.MGPy8EG_Wmunu_FxFx3jHT2bias_SW_105M_CFilterBVeto.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.513137.MGPy8EG_Wmunu_FxFx3jHT2bias_SW_105M_CVetoBVeto.evgen.HEPMC.e8514_e8596",
-      "mc23_13p6TeV.601183.PhPy8EG_AZNLO_Wplusenu.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601184.PhPy8EG_AZNLO_Wplusmunu.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601185.PhPy8EG_AZNLO_Wplustaunu.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601186.PhPy8EG_AZNLO_Wminusenu.evgen.HEPMC.e8514_e8601",
-      "mc23_13p6TeV.601187.PhPy8EG_AZNLO_Wminusmunu.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601188.PhPy8EG_AZNLO_Wminustaunu.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700777.Sh_2214_Wenu_maxHTpTV2_BFilter.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.700778.Sh_2214_Wenu_maxHTpTV2_CFilterBVeto.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700779.Sh_2214_Wenu_maxHTpTV2_CVetoBVeto.evgen.HEPMC.e8514_e8601",
@@ -855,11 +843,7 @@
       "mc23_13p6TeV.700882.Sh_2214_Wmunu_mW_105_ECMS_CVetoBVeto.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700883.Sh_2214_Wtaunu_mW_105_ECMS_BFilter.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700884.Sh_2214_Wtaunu_mW_105_ECMS_CFilterBVeto.evgen.HEPMC.e8514_e8596",
-      "mc23_13p6TeV.700885.Sh_2214_Wtaunu_mW_105_ECMS_CVetoBVeto.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.700983.Sh_22_Wenu2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.700984.Sh_22_Wmunu2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.700985.Sh_22_Wtaunu2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.701288.Sh_pTW140_Wqqgamma.evgen.HEPMC.e8582_e8622"
+      "mc23_13p6TeV.700885.Sh_2214_Wtaunu_mW_105_ECMS_CVetoBVeto.evgen.HEPMC.e8514_e8528_e8596"
     ],
     "13p6tev-nominal-sm-z-boson": [
       "mc23_13p6TeV.513105.MGPy8EG_Zee_FxFx3jHT2bias_SW_BFilter.evgen.HEPMC.e8514_e8596",
@@ -886,9 +870,6 @@
       "mc23_13p6TeV.513129.MGPy8EG_Ztautau_FxFx3jHT2bias_SW_10M40_BFilter.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.513130.MGPy8EG_Ztautau_FxFx3jHT2bias_SW_10M40_CFiltBVeto.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.513131.MGPy8EG_Ztautau_FxFx3jHT2bias_SW_10M40_CVetoBVeto.evgen.HEPMC.e8514_e8596",
-      "mc23_13p6TeV.601189.PhPy8EG_AZNLO_Zee.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601190.PhPy8EG_AZNLO_Zmumu.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601191.PhPy8EG_AZNLO_Ztautau.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700786.Sh_2214_Zee_maxHTpTV2_BFilter.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700787.Sh_2214_Zee_maxHTpTV2_CFilterBVeto.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700788.Sh_2214_Zee_maxHTpTV2_CVetoBVeto.evgen.HEPMC.e8514_e8528_e8596",
@@ -918,27 +899,18 @@
       "mc23_13p6TeV.700901.Sh_2214_Ztt_maxHTpTV2_Mll10_40_BFilter.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.700902.Sh_2214_Ztt_maxHTpTV2_Mll10_40_CFilterBVeto.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.700903.Sh_2214_Ztt_maxHTpTV2_Mll10_40_CVetoBVeto.evgen.HEPMC.e8514_e8601",
-      "mc23_13p6TeV.700947.Sh_22_Znunu2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
       "mc23_13p6TeV.700972.Sh_2214_Zmm2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.700973.Sh_2214_Zmm2jets_105M_Min_N_TChannel.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.700981.Sh_22_Zee2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.700982.Sh_22_Ztt2jets_Min_N_TChannel.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.701286.Sh_pTZ100_Zbbgamma.evgen.HEPMC.e8582_e8622",
-      "mc23_13p6TeV.701287.Sh_pTZ100_Zqqgamma.evgen.HEPMC.e8582_e8622"
+      "mc23_13p6TeV.700973.Sh_2214_Zmm2jets_105M_Min_N_TChannel.evgen.HEPMC.e8549_e8528_e8596"
     ],
     "13p6tev-other-bsm-higgs-samples": [
       "mc23_13p6TeV.525154.MGPy8EG_NNPDF30_mh2400_wh25_hbsm4tops_stchan.evgen.HEPMC.e8532_e8528_e8596",
       "mc23_13p6TeV.525155.MGPy8EG_NNPDF30_mh21000_wh230_hbsm4tops_stchan.evgen.HEPMC.e8532_e8528_e8596",
       "mc23_13p6TeV.525156.MGPy8EG_NNPDF30_mh22000_wh2100_hbsm4tops_stchan.evgen.HEPMC.e8532_e8528_e8596"
     ],
-    "13p6tev-other-sm": [
-      "mc23_13p6TeV.701247.Sh_22_yyy_01NLO.evgen.HEPMC.e8582_e8622",
-      "mc23_13p6TeV.701248.Sh_22_yyyy.evgen.HEPMC.e8582_e8622"
-    ],
+    "13p6tev-other-sm": [],
     "13p6tev-sm-4-top": [
       "mc23_13p6TeV.523243.aMCPy8EG_SM4topsNLO.evgen.HEPMC.e8559_e8528_e8596",
       "mc23_13p6TeV.510203.MGPy8EG_A14NNPDF30_SM4topsLOInclusive_run3.evgen.HEPMC.e8559_e8528_e8596",
-      "mc23_13p6TeV.526034.aMCH7EG_SM4topsNLO.evgen.HEPMC.e8566_e8622",
       "mc23_13p6TeV.700712.Sh_2214_tttt_muQHT2.evgen.HEPMC.e8557_e8528_e8596"
     ],
     "13p6tev-sm-di-jet-alternative": [
@@ -975,16 +947,7 @@
       "mc23_13p6TeV.830157.H7EG_H72NNPDF30NLO_jetjet_Cluster_dipole_JZ6.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.830158.H7EG_H72NNPDF30NLO_jetjet_Cluster_dipole_JZ7.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.830159.H7EG_H72NNPDF30NLO_jetjet_Cluster_dipole_JZ8.evgen.HEPMC.e8551_e8528_e8596",
-      "mc23_13p6TeV.830160.H7EG_H72NNPDF30NLO_jetjet_Cluster_dipole_JZ9plus.evgen.HEPMC.e8551_e8528_e8596",
-      "mc23_13p6TeV.830187.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ1.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830188.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ2.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830189.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ3.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830190.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ4.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830191.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ5.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830192.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ6.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830193.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ7.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830194.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ8.evgen.HEPMC.e8551_e8622",
-      "mc23_13p6TeV.830195.H7EG_H72NNPDF30NLO_jetjet_Lund_JZ9plus.evgen.HEPMC.e8551_e8622"
+      "mc23_13p6TeV.830160.H7EG_H72NNPDF30NLO_jetjet_Cluster_dipole_JZ9plus.evgen.HEPMC.e8551_e8528_e8596"
     ],
     "13p6tev-sm-di-jet-nominal": [
       "mc23_13p6TeV.801165.Py8EG_A14NNPDF23LO_jj_JZ0.evgen.HEPMC.e8514_e8528_e8596",
@@ -1015,7 +978,6 @@
       "mc23_13p6TeV.601706.PhPy8EG_dijet_JZ7.evgen.HEPMC.e8551_e8596",
       "mc23_13p6TeV.601707.PhPy8EG_dijet_JZ8incl.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.601707.PhPy8EG_dijet_JZ8incl.evgen.HEPMC.e8551_e8596",
-      "mc23_13p6TeV.700816.Sh_2214_jj_JZ1.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700817.Sh_2214_jj_JZ2.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700818.Sh_2214_jj_JZ3.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700819.Sh_2214_jj_JZ4.evgen.HEPMC.e8514_e8528_e8596",
@@ -1037,115 +999,20 @@
     "13p6tev-sm-di-photon": [
       "mc23_13p6TeV.700978.Sh_2214_Diphoton_myy_0_50.evgen.HEPMC.e8537_e8596",
       "mc23_13p6TeV.700979.Sh_2214_Diphoton_myy_50_90.evgen.HEPMC.e8537_e8528_e8596",
-      "mc23_13p6TeV.700980.Sh_2214_Diphoton_myy_90_175.evgen.HEPMC.e8537_e8528_e8596",
-      "mc23_13p6TeV.701289.Sh_Diphoton_myy_175_2000.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.701290.Sh_Diphoton_myy_2000_eCM.evgen.HEPMC.e8577_e8622"
+      "mc23_13p6TeV.700980.Sh_2214_Diphoton_myy_90_175.evgen.HEPMC.e8537_e8528_e8596"
     ],
     "13p6tev-sm-other-higgs": [
-      "mc23_13p6TeV.601482.PhPy8EG_PDF4LHC21_VBFH125_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601483.PhPy8EG_PDF4LHC21_WmH125J_Wincl_MINLO_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601484.PhPy8EG_PDF4LHC21_WpH125J_Wincl_MINLO_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601500.PhPy8EG_PDF4LHC21_VBFH125_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601505.PhPy8EG_PDF4LHC21_inclusive_ttH125_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601507.PhPy8EG_PDF4LHC21_VBFH125_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601512.PhPy8EG_PDF4LHC21_inclusive_ttH125_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601522.PhPy8EG_PDF4LHC21_ggZH125_Zincl_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601523.PhPy8EG_PDF4LHC21_ZH125J_Zincl_MINLO_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601583.PhPy8EG_PDF4LHC21_VBFH125_ZZ4lep_tauFilt.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.601584.PhPy8EG_PDF4LHC21_WpH125J_Wincl_ZZ4lep_tauFilt.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.601585.PhPy8EG_PDF4LHC21_WmH125J_Wincl_ZZ4lep_tauFilt.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.601597.PhPy8EG_PDF4LHC21_VBFH125_bb.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.601599.PhPy8EG_PDF4LHC21_VBFH125_WWlvlv.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.601600.PhPy8_PDF4LHC21_ggH125_kt200_MiNLO_bb.evgen.HEPMC.e8537_e8622",
-      "mc23_13p6TeV.601601.PhPy8EG_PDF4LHC21_VBFH125_etau_filt.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601602.PhPy8EG_PDF4LHC21_VBFH125_mutau_filt.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601608.PhPy8EG_PDF4LHC21_ttH125_etau_filt.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601609.PhPy8EG_PDF4LHC21_ttH125_mutau_filt.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.601634.PhPy8EG_PDF4LHC21_4FS_A14NNPDF_bbH_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601710.PhPy8EG_PDF4LHC21_4FS_A14NNPDF_bbH_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.602421.PhPy8EG_PDF4LHC21_ggH_NNLOPS_gammagamma.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.602422.PhPy8EG_PDF4LHC21_ttH125_tincl_gammagamma_1file.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.602632.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_WWlvlv.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.602685.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_ZZ4lep_taufilt.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.603293.PhPy8EG_NNPDF30_gg4l_noHiggs_m4l_70_3000.evgen.HEPMC.e8601_e8622",
-      "mc23_13p6TeV.603325.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.603327.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.603329.PhPy8EG_PDF4LHC21_4FS_A14NNPDF_bbH_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.603414.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_tautauh30h20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603415.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_tautaulp15hm20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603416.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_tautaulm15hp20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603417.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_tautaul13l7.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603422.PhPy8EG_NNPDF23_A14_VBFH125_tautauh30h20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603423.PhPy8EG_NNPDF23_A14_VBFH125_tautaulp15hm20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603424.PhPy8EG_NNPDF23_A14_VBFH125_tautaulm15hp20.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603425.PhPy8EG_NNPDF23_A14_VBFH125_tautaul13l7.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603907.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_etau_filt.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603908.PhPy8EG_NNPDF23_A14_ggH125_NNLOPS_mutau_filt.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.604017.PhPy8EG_NNPDF23_A14_bbH125_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.604263.PhPy8EG_Hto4l_NNLOPS_nnlo_30_ggH125_ZZ4l.evgen.HEPMC.e8601_e8622",
       "mc23_13p6TeV.604304.PhPy8EG_PDF4LHC21_qqZH125J_Zincl_Hincl_MINLO.evgen.HEPMC.e8549_e8596",
       "mc23_13p6TeV.604305.PhPy8EG_PDF4LHC21_WmH125J_Zincl_Hincl_MINLO.evgen.HEPMC.e8549_e8596",
-      "mc23_13p6TeV.604306.PhPy8EG_PDF4LHC21_WpH125J_Zincl_Hincl_MINLO.evgen.HEPMC.e8549_e8596",
-      "mc23_13p6TeV.605941.PhPy8EG_Hto4l_VBFH125_HZZ_4l_notau.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605944.PhPy8EG_Hto4l_ZH125J_Zincl_MINLO_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605945.PhPy8EG_Hto4l_ggZH125_Zincl_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605946.PhPy8EG_Hto4l_inclusive_ttH125_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605947.PhPy8EG_Hto4l_4FS_bbH125_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605986.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_Hee.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.605987.PhPy8EG_PDF4LHC21_ggH125_NNLOPS_Hemu.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.605988.PhPy8EG_PDF4LHC21_VBFH125_Hee.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.605989.PhPy8EG_PDF4LHC21_VBFH125_Hemu.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.605999.PhPy8EG_NNPDF30_gg4l_m4l_70_3000.evgen.HEPMC.e8615_e8622",
-      "mc23_13p6TeV.604311.PhH7EG_PDF4LHC21_WmH125J_Wincl_MINLO_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604312.PhH7EG_PDF4LHC21_WpH125J_Wincl_MINLO_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604313.PhH7EG_PDF4LHC21_ZH125_Zincl_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604314.PhH7EG_PDF4LHC21_4FS_A14NNPDF_bbH_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604315.PhH7EG_PDF4LHC21_ggH125_NNLOPS_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604316.PhH7EG_PDF4LHC21_ggZH125_Zincl_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604317.PhH7EG_PDF4LHC21_ttH125_tincl_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604318.PhH7EG_PDF4LHC21_VBFH125_Hgammagamma.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604359.PhH7EG_PDF4LHC21_ggH125_NNLOPS_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604360.PhH7EG_PDF4LHC21_VBFH125_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604361.PhH7EG_PDF4LHC21_WpH125J_Wincl_MINLO_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604362.PhH7EG_PDF4LHC21_WmH125J_Wincl_MINLO_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604365.PhH7EG_PDF4LHC21_inclusive_ttH125_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604366.PhH7EG_PDF4LHC21_4FS_A14NNPDF_bbH_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604367.PhH7EG_PDF4LHC21_ggH125_NNLOPS_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604368.PhH7EG_PDF4LHC21_VBFH125_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604369.PhH7EG_PDF4LHC21_WpH125J_Wincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604370.PhH7EG_PDF4LHC21_WmH125J_Wincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604373.PhH7EG_PDF4LHC21_inclusive_ttH125_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604374.PhH7EG_PDF4LHC21_4FS_A14NNPDF_bbH_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604393.PhH7EG_NNPDF23_A14_ggH125_NNLOPS_tautauh30h20_fx.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604394.PhH7EG_NNPDF23_A14_ggH125_NNLOPS_tautaul13l7_fx.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604395.PhH7EG_NNPDF23_A14_ggH125_NNLOPS_tautaulm15hp20_fx.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604396.PhH7EG_NNPDF23_A14_ggH125_NNLOPS_tautaulp15hm20_fx.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604397.PhH7EG_NNPDF23_A14_VBFH125_tautauh30h20_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604398.PhH7EG_NNPDF23_A14_VBFH125_tautaul13l7_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604399.PhH7EG_NNPDF23_A14_VBFH125_tautaulm15hp20_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604400.PhH7EG_NNPDF23_A14_VBFH125_tautaulp15hm20_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604401.PhH7EG_NNPDF23_A14_WmH125J_Winc_tautau_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604402.PhH7EG_NNPDF23_A14_WpH125J_Winc_tautau_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604403.PhH7EG_NNPDF23_A14_ZH125J_Zinc_tautau_fixed.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.545868.MGaMCPy8EG_ggH_FxFx_SM_ZZ.evgen.HEPMC.e8612_e8622"
-    ],
-    "13p6tev-sm-other-top+x-alternative": [
-      "mc23_13p6TeV.546899.MGPy8EG_NNPDF31luxqed_A14_tttwp_LO_QCD_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.546900.MGPy8EG_NNPDF31luxqed_A14_tttwm_LO_QCD_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.546901.MGPy8EG_NNPDF31luxqed_A14_tttwp_LO_QCD_EW_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.546902.MGPy8EG_NNPDF31luxqed_A14_tttwm_LO_QCD_EW_dil.evgen.HEPMC.e8577_e8622"
+      "mc23_13p6TeV.604306.PhPy8EG_PDF4LHC21_WpH125J_Zincl_Hincl_MINLO.evgen.HEPMC.e8549_e8596"
     ],
+    "13p6tev-sm-other-top+x-alternative": [],
     "13p6tev-sm-other-top+x-nominal": [
       "mc23_13p6TeV.525955.aMCPy8EG_tWZ_Ztoll_DR1.evgen.HEPMC.e8558_e8528_e8596",
-      "mc23_13p6TeV.542861.aMCPy8EG_DR_NNPDF31luxqed_A14_tttjp_NLO_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.542862.aMCPy8EG_DR_NNPDF31luxqed_A14_tttjm_NLO_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.542863.aMCPy8EG_DR_NNPDF31luxqed_A14_tttwp_NLO_dil.evgen.HEPMC.e8577_e8622",
-      "mc23_13p6TeV.542864.aMCPy8EG_DR_NNPDF31luxqed_A14_tttwm_NLO_dil.evgen.HEPMC.e8577_e8622",
       "mc23_13p6TeV.545023.aMCPy8EG_tty_prod.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.545024.MGPy8EG_tty_dec.evgen.HEPMC.e8557_e8601",
       "mc23_13p6TeV.545025.aMCH7EG_tty_prod.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.545026.MGH7EG_tty_dec.evgen.HEPMC.e8557_e8528_e8596",
-      "mc23_13p6TeV.561979.aMCPy8EG_tWZ_Znunu_DR1.evgen.HEPMC.e8613_e8622",
       "mc23_13p6TeV.601350.PhPy8EG_tqb_lep_antitop.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.601351.PhPy8EG_tqb_lep_top.evgen.HEPMC.e8514_e8528_e8596"
     ],
@@ -1153,23 +1020,7 @@
       "mc23_13p6TeV.545795.aMCPy8EG_tWZ_Ztoll_DR1_4lfilt.evgen.HEPMC.e8551_e8528_e8596"
     ],
     "13p6tev-sm-other-top+x-systematic-variations": [
-      "mc23_13p6TeV.525954.aMCH7EG_tWZ_Ztoll_DR1.evgen.HEPMC.e8558_e8528_e8596",
-      "mc23_13p6TeV.601487.PhPy8EG_A14_tchan_pThard1_lep_antitop.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.601487.PhPy8EG_A14_tchan_pThard1_lep_antitop.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601489.PhPy8EG_A14_tchan_pThard1_lep_top.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.601489.PhPy8EG_A14_tchan_pThard1_lep_top.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602846.PhH7EG_NNPDF30NLO_ttWm_EW.evgen.HEPMC.e8591_e8622",
-      "mc23_13p6TeV.602847.PhH7EG_NNPDF30NLO_ttWp_EW.evgen.HEPMC.e8591_e8622",
-      "mc23_13p6TeV.602848.PhH7EG_NNPDF30NLO_ttWm_QCD.evgen.HEPMC.e8591_e8622",
-      "mc23_13p6TeV.602849.PhH7EG_NNPDF30NLO_ttWp_QCD.evgen.HEPMC.e8591_e8622",
-      "mc23_13p6TeV.602886.PhPy8EG_A14_NNPDF23_ttWm_EW.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602887.PhPy8EG_A14_NNPDF23_ttWp_EW.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602888.PhPy8EG_A14_NNPDF23_ttWm_QCD.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602889.PhPy8EG_A14_NNPDF23_ttWp_QCD.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602969.PhH7EG_H7UE_72_tchan_lept_antitop.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602969.PhH7EG_H7UE_72_tchan_lept_antitop.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602970.PhH7EG_H7UE_72_tchan_lept_top.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602970.PhH7EG_H7UE_72_tchan_lept_top.evgen.HEPMC.e8558_e8622"
+      "mc23_13p6TeV.525954.aMCH7EG_tWZ_Ztoll_DR1.evgen.HEPMC.e8558_e8528_e8596"
     ],
     "13p6tev-sm-photon+di-neutrino": [
       "mc23_13p6TeV.700776.Sh_2214_nunugamma.evgen.HEPMC.e8514_e8528_e8596",
@@ -1180,7 +1031,6 @@
     ],
     "13p6tev-sm-photon+electron": [
       "mc23_13p6TeV.700770.Sh_2214_eegamma.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.700773.Sh_2214_enugamma.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.701131.Sh_2214_enugamma_MUQ20.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.701132.Sh_2214_enugamma_MUQ05.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.701133.Sh_2214_enugamma_CKKW30.evgen.HEPMC.e8514_e8596",
@@ -1266,21 +1116,9 @@
     ],
     "13p6tev-sm-s-channel-single-top": [
       "mc23_13p6TeV.601348.PhPy8EG_tb_lep_antitop.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601349.PhPy8EG_tb_lep_top.evgen.HEPMC.e8514_e8601",
-      "mc23_13p6TeV.602971.PhH7EG_H7UE_72_schan_lept_antitop.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602971.PhH7EG_H7UE_72_schan_lept_antitop.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602972.PhH7EG_H7UE_72_schan_lept_top.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602972.PhH7EG_H7UE_72_schan_lept_top.evgen.HEPMC.e8558_e8622"
-    ],
-    "13p6tev-sm-single-top+higgs": [
-      "mc23_13p6TeV.545634.aMCPy8EG_tHjb125_4fl_ZZ4l.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.545635.aMCPy8EG_tHjb125_4fl_mumu.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.545637.aMCPy8EG_tWH125_ZZ4l.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.545638.aMCPy8EG_tWH125_mumu.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.545639.aMCPy8EG_tWH125_gammagamma.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.546585.MGPy8EG_tHjb125_4FS_NNPDF23_A14_tautau.evgen.HEPMC.e8557_e8622",
-      "mc23_13p6TeV.546586.MGPy8EG_tWH125_5FS_NNPDF23_A14_tautau.evgen.HEPMC.e8557_e8622"
+      "mc23_13p6TeV.601349.PhPy8EG_tb_lep_top.evgen.HEPMC.e8514_e8601"
     ],
+    "13p6tev-sm-single-top+higgs": [],
     "13p6tev-sm-tri-boson": [
       "mc23_13p6TeV.701000.Sh_2214_lllljj.evgen.HEPMC.e8543_e8528_e8596",
       "mc23_13p6TeV.701005.Sh_2214_lllvjj.evgen.HEPMC.e8543_e8528_e8596",
@@ -1292,11 +1130,9 @@
       "mc23_13p6TeV.701238.Sh_22_WZZ_5l1v_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701239.Sh_22_WZZ_3l3v_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701240.Sh_22_ZZZ_6l0v_EW6.evgen.HEPMC.e8585_e8586_e8596",
-      "mc23_13p6TeV.701241.Sh_22_ZZZ_4l2v_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701242.Sh_22_ZZZ_2l4v_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701243.Sh_22_WpWpWm_lvlvjj_ss_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701244.Sh_22_WpWmWm_lvlvjj_ss_EW6.evgen.HEPMC.e8585_e8586_e8596",
-      "mc23_13p6TeV.701245.Sh_22_WpWpWm_lvlvjj_os_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701246.Sh_22_WpWmWm_lvlvjj_os_EW6.evgen.HEPMC.e8585_e8586_e8596",
       "mc23_13p6TeV.701001.Sh_2214_lllljj_MUQ20.evgen.HEPMC.e8543_e8596",
       "mc23_13p6TeV.701002.Sh_2214_lllljj_MUQ05.evgen.HEPMC.e8543_e8596",
@@ -1318,28 +1154,10 @@
     "13p6tev-sm-ttbar+higgs": [
       "mc23_13p6TeV.602637.PhPy8EG_PDF4LHC21_ttH125_dilep.evgen.HEPMC.e8549_e8601",
       "mc23_13p6TeV.602638.PhPy8EG_PDF4LHC21_ttH125_semilep.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.603419.PhPy8EG_NNPDF23_A14_ttH125_allhad_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603420.PhPy8EG_NNPDF23_A14_ttH125_dilep_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603421.PhPy8EG_NNPDF23_A14_ttH125_semilep_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.604224.PhPy8EG_PDF4LHC21_allHad_ttH125_HTop.evgen.HEPMC.e8579_e8601",
       "mc23_13p6TeV.602635.PhH7EG_PDF4LHC21_ttH125_dilep.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.602636.PhH7EG_PDF4LHC21_ttH125_semilep.evgen.HEPMC.e8549_e8528_e8596",
-      "mc23_13p6TeV.602852.PhPy8EG_PDF4LHC21_ttH125_pThard1_dilep.evgen.HEPMC.e8555_e8622",
-      "mc23_13p6TeV.602853.PhPy8EG_PDF4LHC21_ttH125_pThard1_semilep.evgen.HEPMC.e8555_e8622"
-    ],
-    "13p6tev-sm-ttbar-+-bbbar": [
-      "mc23_13p6TeV.601226.PhPy8_A14_NNPDF31_ttbb_4FS_bzd5_dilep.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.601227.PhPy8_A14_NNPDF31_ttbb_4FS_bzd5_ljets.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.601228.PhPy8EG_A14_NNPDF31_ttbb_4FS_pTdef1_allhad.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.601668.PhH7_ttbb_NNPDF30_4FS_bzd5_allhad.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.603004.PhPy8EG_A14_NNPDF31_ttbb_4FS_pTdef1_pThard1_allhad.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.603191.PhPy8_A14_NNPDF31_ttbb_4FS_pTdef1_pThard1_dilep.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.603193.PhPy8_A14_NNPDF31_ttbb_4FS_pTdef1_pThard1_ljets.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.603872.PhPy8EG_A14_NNPDF31_ttbb_4FS_pTdef1_dipRec_ljets.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.603873.PhPy8EG_A14_NNPDF31_ttbb_4FS_pTdef1_dipRec_dilep.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.603905.PhH7_ttbb_NNPDF30_4FS_bzd5_ljets.evgen.HEPMC.e8590_e8622",
-      "mc23_13p6TeV.603906.PhH7_ttbb_NNPDF30_4FS_bzd5_dilep.evgen.HEPMC.e8590_e8622"
+      "mc23_13p6TeV.602636.PhH7EG_PDF4LHC21_ttH125_semilep.evgen.HEPMC.e8549_e8528_e8596"
     ],
+    "13p6tev-sm-ttbar-+-bbbar": [],
     "13p6tev-sm-ttbar-+-di-photon": [
       "mc23_13p6TeV.542859.MGPy8EG_ttgammagamma_allhad_LO.evgen.HEPMC.e8551_e8586_e8596",
       "mc23_13p6TeV.542860.MGPy8EG_ttgammagamma_nonallhad_LO.evgen.HEPMC.e8551_e8586_e8596"
@@ -1357,26 +1175,15 @@
     "13p6tev-sm-ttbar-alternative": [
       "mc23_13p6TeV.700807.Sh_2214_ttbar_AllHadronic_maxHTavrgTopPT.evgen.HEPMC.e8562_e8596",
       "mc23_13p6TeV.700808.Sh_2214_ttbar_dilepton_maxHTavrgTopPT.evgen.HEPMC.e8562_e8528_e8596",
-      "mc23_13p6TeV.700809.Sh_2214_ttbar_SingleLeptonM_maxHTavrgTopPT.evgen.HEPMC.e8562_e8528_e8596",
-      "mc23_13p6TeV.700810.Sh_2214_ttbar_SingleLeptonP_maxHTavrgTopPT.evgen.HEPMC.e8562_e8622"
+      "mc23_13p6TeV.700809.Sh_2214_ttbar_SingleLeptonM_maxHTavrgTopPT.evgen.HEPMC.e8562_e8528_e8596"
     ],
     "13p6tev-sm-ttbar-nominal": [
       "mc23_13p6TeV.601229.PhPy8EG_A14_ttbar_hdamp258p75_SingleLep.evgen.HEPMC.e8514_e8601",
       "mc23_13p6TeV.601230.PhPy8EG_A14_ttbar_hdamp258p75_dil.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601237.PhPy8EG_A14_ttbar_hdamp258p75_allhad.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.603852.PhPy8EG_A14_ttbar_hdamp258p75_bsf200_5c_1k_SL.evgen.HEPMC.e8582_e8622",
-      "mc23_13p6TeV.603853.PhPy8EG_A14_ttbar_hdamp258p75_bsf200_1k_1k5_SL.evgen.HEPMC.e8582_e8622",
-      "mc23_13p6TeV.603854.PhPy8EG_A14_ttbar_hdamp258p75_bsf200_1k5_inf_SL.evgen.HEPMC.e8582_e8622",
-      "mc23_13p6TeV.604986.PhPy8EG_A14_ttbar_hdamp258p75_0_5c_SL.evgen.HEPMC.e8582_e8622"
+      "mc23_13p6TeV.601237.PhPy8EG_A14_ttbar_hdamp258p75_allhad.evgen.HEPMC.e8514_e8528_e8596"
     ],
     "13p6tev-sm-ttbar-specialised": [
       "mc23_13p6TeV.601656.PhPy8EG_A14_ttbar_hdamp258p75_4lMfilt.evgen.HEPMC.e8532_e8528_e8596",
-      "mc23_13p6TeV.603988.PhPy8EG_showerVars_ttbar_DiLep.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.603989.PhPy8EG_showerVars_ttbar_SingleLep.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604259.PhPy8EG_A14_ttbar_mtop_172p00_1L.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604260.PhPy8EG_A14_ttbar_mtop_173p00_1L.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604261.PhPy8EG_A14_ttbar_mtop_172p00_2L.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604262.PhPy8EG_A14_ttbar_mtop_173p00_2L.evgen.HEPMC.e8599_e8622",
       "mc23_13p6TeV.604468.PhPy8EG_A14_ttbar_hdamp258p75_ATLCR0_singleLep.evgen.HEPMC.e8589_e8528_e8596",
       "mc23_13p6TeV.604469.PhPy8EG_A14_ttbar_hdamp258p75_ATLCR0_dil.evgen.HEPMC.e8589_e8528_e8596",
       "mc23_13p6TeV.604470.PhPy8EG_A14_ttbar_hdamp258p75_ATLCR1_singleLep.evgen.HEPMC.e8589_e8528_e8596",
@@ -1397,9 +1204,6 @@
       "mc23_13p6TeV.601399.PhPy8EG_A14_ttbar_hdamp517p5_dil.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.601414.PhH7EG_A14_ttbar_hdamp258p75_Single_Lep.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.601415.PhH7EG_A14_ttbar_hdamp258p75_Dilep.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.601491.PhPy8EG_A14_ttbar_pThard1_dil.evgen.HEPMC.e8612_e8622",
-      "mc23_13p6TeV.601495.PhPy8EG_A14_ttbar_pThard1_allhad.evgen.HEPMC.e8612_e8622",
-      "mc23_13p6TeV.601497.PhPy8EG_A14_ttbar_pThard1_singlelep.evgen.HEPMC.e8612_e8622",
       "mc23_13p6TeV.604482.PhPy8EG_A14_ttbar_hdamp258p75_recToTop_singleLep.evgen.HEPMC.e8589_e8528_e8596",
       "mc23_13p6TeV.604483.PhPy8EG_A14_ttbar_hdamp258p75_recoilToTop_dil.evgen.HEPMC.e8589_e8528_e8596"
     ],
@@ -1423,9 +1227,6 @@
       "mc23_13p6TeV.522032.aMCPy8EG_NNPDF30NLO_A14N23LO_tttautau_run3.evgen.HEPMC.e8558_e8528_e8596",
       "mc23_13p6TeV.522036.aMCPy8EG_NNPDF30NLO_A14N23LO_ttZqq_run3.evgen.HEPMC.e8558_e8601",
       "mc23_13p6TeV.522040.aMCPy8EG_NNPDF30NLO_A14N23LO_ttZnunu_run3.evgen.HEPMC.e8558_e8528_e8596",
-      "mc23_13p6TeV.701274.Sh_22_ttll_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701275.Sh_22_ttll_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701276.Sh_22_ttll_4LFilter.evgen.HEPMC.e8532_e8622",
       "mc23_13p6TeV.522023.aMCH7EG_NNPDF30NLO_H723UE_ttee_run3.evgen.HEPMC.e8558_e8528_e8596",
       "mc23_13p6TeV.522025.aMCPy8EG_NNPDF30NLO_A14N23LO_ttee_A14Var3cDown_r3.evgen.HEPMC.e8558_e8528_e8596",
       "mc23_13p6TeV.522026.aMCPy8EG_NNPDF30NLO_A14N23LO_ttee_A14Var3cUp_run3.evgen.HEPMC.e8558_e8528_e8596",
@@ -1441,29 +1242,12 @@
       "mc23_13p6TeV.522039.aMCH7EG_NNPDF30NLO_H723UE_ttZnunu_run3.evgen.HEPMC.e8558_e8528_e8596",
       "mc23_13p6TeV.522041.aMCPy8EG_NNPDF30NLO_A14N23LO_ttZnunu_A14Var3cDor3.evgen.HEPMC.e8558_e8528_e8596",
       "mc23_13p6TeV.522042.aMCPy8EG_NNPDF30NLO_A14N23LO_ttZnunu_A14Var3cUpr3.evgen.HEPMC.e8558_e8528_e8596",
-      "mc23_13p6TeV.701265.Sh_22_ttll_Lund_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701266.Sh_22_ttll_Lund_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701267.Sh_22_ttll_Lund_4LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701268.Sh_22_ttll_muQ4_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701269.Sh_22_ttll_muQ4_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701270.Sh_22_ttll_muQ4_4LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701271.Sh_22_ttll_muQ025_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701272.Sh_22_ttll_muQ025_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701273.Sh_22_ttll_muQ025_4LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701277.Sh_22_ttll_Qcut20_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701278.Sh_22_ttll_Qcut20_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701279.Sh_22_ttll_Qcut20_4LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701280.Sh_22_ttll_Qcut40_2LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701281.Sh_22_ttll_Qcut40_3LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.701282.Sh_22_ttll_Qcut40_4LFilter.evgen.HEPMC.e8532_e8622",
-      "mc23_13p6TeV.542858.MGPy8EG_ttll_SMEFTsim.evgen.HEPMC.e8599_e8622",
       "mc23_13p6TeV.545790.aMCPy8EG_NNPDF30NLO_A14N23LO_ttee_4lfilt.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.545791.aMCPy8EG_NNPDF30NLO_A14N23LO_ttmumu_4lfilt.evgen.HEPMC.e8551_e8528_e8596"
     ],
     "13p6tev-sm-tz": [
       "mc23_13p6TeV.545027.aMCPy8EG_tllq_4FS_HT6.evgen.HEPMC.e8564_e8528_e8596",
       "mc23_13p6TeV.545028.aMCPy8EG_tbarllq_4FS_HT6.evgen.HEPMC.e8564_e8528_e8596",
-      "mc23_13p6TeV.525668.aMCH7EG_tllq_4FS_HT6.evgen.HEPMC.e8577_e8528_e8596",
       "mc23_13p6TeV.525669.aMCH7EG_tbarllq_4FS_HT6.evgen.HEPMC.e8577_e8528_e8596",
       "mc23_13p6TeV.545031.aMCPy8EG_tllq_4FS_HT6_A14Var3cDown.evgen.HEPMC.e8564_e8528_e8596",
       "mc23_13p6TeV.545032.aMCPy8EG_tbarllq_4FS_HT6_A14Var3cDown.evgen.HEPMC.e8564_e8528_e8596",
@@ -1550,7 +1334,6 @@
       "mc23_13p6TeV.701065.Sh_vvvv.evgen.HEPMC.e8582_e8528_e8596"
     ],
     "13p6tev-sm-vv-(diboson)-other": [
-      "mc23_13p6TeV.700977.Sh_22_llvv_os_ZZonly.evgen.HEPMC.e8582_e8622",
       "mc23_13p6TeV.701070.Sh_2214_llll_lowMllPtComplement.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.701075.Sh_2214_lllv_lowMllPtComplement.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.701080.Sh_2214_llvv_lowMllPtComplement.evgen.HEPMC.e8557_e8528_e8596",
@@ -1559,9 +1342,7 @@
     ],
     "13p6tev-sm-vv-(diboson)-systematic-variation": [
       "mc23_13p6TeV.701041.Sh_llll_MUQ20.evgen.HEPMC.e8582_e8586_e8596",
-      "mc23_13p6TeV.701042.Sh_llll_MUQ05.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701043.Sh_llll_CKKW30.evgen.HEPMC.e8582_e8586_e8596",
-      "mc23_13p6TeV.701044.Sh_llll_CKKW15.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701046.Sh_lllv_MUQ20.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701047.Sh_lllv_MUQ05.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701048.Sh_lllv_CKKW30.evgen.HEPMC.e8582_e8586_e8596",
@@ -1578,7 +1359,6 @@
       "mc23_13p6TeV.701062.Sh_lvvv_MUQ05.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701063.Sh_lvvv_CKKW30.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701064.Sh_lvvv_CKKW15.evgen.HEPMC.e8582_e8586_e8596",
-      "mc23_13p6TeV.701066.Sh_vvvv_MUQ20.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701067.Sh_vvvv_MUQ05.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701068.Sh_vvvv_CKKW30.evgen.HEPMC.e8582_e8586_e8596",
       "mc23_13p6TeV.701069.Sh_vvvv_CKKW15.evgen.HEPMC.e8582_e8586_e8596",
@@ -1603,56 +1383,9 @@
       "mc23_13p6TeV.701193.Sh_2214_llll_m4l300_CKKW30.evgen.HEPMC.e8543_e8596",
       "mc23_13p6TeV.701194.Sh_2214_llll_m4l300_CKKW15.evgen.HEPMC.e8543_e8596"
     ],
-    "13p6tev-sm-w+higgs": [
-      "mc23_13p6TeV.601501.PhPy8EG_PDF4LHC21_WpH125J_Wincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601502.PhPy8EG_PDF4LHC21_WmH125J_Wincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601510.PhPy8EG_PDF4LHC21_WpH125J_Wincl_MINLO_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601511.PhPy8EG_PDF4LHC21_WmH125J_Wincl_MINLO_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601612.PhPy8EG_PDF4LHC21_WpH125J_Winc_MINLO_etau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601613.PhPy8EG_PDF4LHC21_WpH125J_Winc_MINLO_mutau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601614.PhPy8EG_PDF4LHC21_WmH125J_Winc_MINLO_etau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601615.PhPy8EG_PDF4LHC21_WmH125J_Winc_MINLO_mutau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.602523.PhPy8EG_PDF4LHC21_WmH125J_Wincl_MINLO_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602524.PhPy8EG_PDF4LHC21_WmH125J_Wincl_MINLO_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602525.PhPy8EG_PDF4LHC21_WpH125J_Wincl_MINLO_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602526.PhPy8EG_PDF4LHC21_WpH125J_Wincl_MINLO_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603331.PhPy8EG_A14_WmH125_lvbb_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603332.PhPy8EG_A14_WpH125_lvbb_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603426.PhPy8EG_NNPDF23_A14_WmH125J_Winc_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603427.PhPy8EG_NNPDF23_A14_WpH125J_Winc_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603510.PhPy8EG_PDF4LHC21_WmH125_Wlep_VpTbias_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603511.PhPy8EG_PDF4LHC21_WmH125_Wlep_VpTbias_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603512.PhPy8EG_PDF4LHC21_WpH125_Wlep_VpTbias_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603513.PhPy8EG_PDF4LHC21_WpH125_Wlep_VpTbias_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603713.PhPy8EG_A14_WmH125_lvcc_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603714.PhPy8EG_A14_WpH125_lvcc_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.604307.PhPy8EG_PDF4LHC21_A14_WpH125qqbb.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604308.PhPy8EG_PDF4LHC21_A14_WmH125qqbb.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.605942.PhPy8EG_Hto4l_WpH125J_Wincl_MINLO_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.605943.PhPy8EG_Hto4l_WmH125J_Wincl_MINLO_HZZ_4l.evgen.HEPMC.e8602_e8622",
-      "mc23_13p6TeV.604511.PhH7EG_PDF4LHC21_WpH125J_Wincl_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604512.PhH7EG_PDF4LHC21_WpH125J_Wincl_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604513.PhH7EG_PDF4LHC21_WpH125J_Wincl_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604514.PhH7EG_PDF4LHC21_WmH125J_Wincl_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604515.PhH7EG_PDF4LHC21_WmH125J_Wincl_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604516.PhH7EG_PDF4LHC21_WmH125J_Wincl_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604523.PhH7EG_PDF4LHC21_WpH125_Wlep_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604524.PhH7EG_PDF4LHC21_WpH125_Wlep_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604525.PhH7EG_PDF4LHC21_WpH125_Wlep_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604526.PhH7EG_PDF4LHC21_WmH125_Wlep_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604527.PhH7EG_PDF4LHC21_WmH125_Wlep_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604528.PhH7EG_PDF4LHC21_WmH125_Wlep_HWW_WWlvlv.evgen.HEPMC.e8588_e8622"
-    ],
+    "13p6tev-sm-w+higgs": [],
     "13p6tev-sm-wt-nominal": [],
     "13p6tev-sm-wt-others": [
-      "mc23_13p6TeV.602036.PhPy8EG_tW_dyn_DR_mtop_172p00_dil_antitop.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602037.PhPy8EG_tW_dyn_DR_mtop_172p00_dil_top.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602038.PhPy8EG_tW_dyn_DR_mtop_172p00_inclusive_antitop.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602039.PhPy8EG_tW_dyn_DR_mtop_172p00_inclusive_top.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602048.PhPy8EG_tW_dyn_DR_mtop_173p00_dil_antitop.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602049.PhPy8EG_tW_dyn_DR_mtop_173p00_dil_top.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602050.PhPy8EG_tW_dyn_DR_mtop_173p00_inclusive_antitop.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.602051.PhPy8EG_tW_dyn_DR_mtop_173p00_inclusive_top.evgen.HEPMC.e8599_e8622",
       "mc23_13p6TeV.602989.PhPy8EG_tW_dyn_DR_mtop_171p50_dil_antitop.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.602990.PhPy8EG_tW_dyn_DR_mtop_171p50_dil_top.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.602991.PhPy8EG_tW_dyn_DR_mtop_171p50_inclusive_antitop.evgen.HEPMC.e8551_e8528_e8596",
@@ -1674,15 +1407,7 @@
       "mc23_13p6TeV.602235.PhH7EG_tW_dyn_DR_incl_top.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.602236.PhH7EG_tW_dyn_DR_incl_antitop.evgen.HEPMC.e8551_e8528_e8596",
       "mc23_13p6TeV.602237.PhH7EG_tW_dyn_DR_dil_top.evgen.HEPMC.e8551_e8528_e8596",
-      "mc23_13p6TeV.602238.PhH7EG_tW_dyn_DR_dil_antitop.evgen.HEPMC.e8551_e8528_e8596",
-      "mc23_13p6TeV.602973.PhPy8EG_tW_DR_dyn_pThard1_incl_top_fixLS.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602973.PhPy8EG_tW_DR_dyn_pThard1_incl_top_fixLS.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602974.PhPy8EG_tW_DR_dyn_pThard1_incl_antitop_fixLS.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602974.PhPy8EG_tW_DR_dyn_pThard1_incl_antitop_fixLS.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602975.PhPy8EG_tW_DR_dyn_pThard1_dil_top_fixLS.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602975.PhPy8EG_tW_DR_dyn_pThard1_dil_top_fixLS.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.602976.PhPy8EG_tW_DR_dyn_pThard1_dil_antitop_fixLS.evgen.HEPMC.e8549_e8622",
-      "mc23_13p6TeV.602976.PhPy8EG_tW_DR_dyn_pThard1_dil_antitop_fixLS.evgen.HEPMC.e8558_e8622"
+      "mc23_13p6TeV.602238.PhH7EG_tW_dyn_DR_dil_antitop.evgen.HEPMC.e8551_e8528_e8596"
     ],
     "13p6tev-sm-ww-diboson": [
       "mc23_13p6TeV.701125.Sh_2214_WlvWqq.evgen.HEPMC.e8543_e8528_e8596",
@@ -1715,53 +1440,7 @@
       "mc23_13p6TeV.701124.Sh_2214_WlvZbb_CKKW15.evgen.HEPMC.e8543_e8528_e8596",
       "mc23_13p6TeV.603771.PhPy8EG_WZlllv_mll4.evgen.HEPMC.e8551_e8528_e8596"
     ],
-    "13p6tev-sm-z+higgs": [
-      "mc23_13p6TeV.601503.PhPy8EG_PDF4LHC21_ZH125J_Zincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601504.PhPy8EG_PDF4LHC21_ggZH125_Zincl_HZZ_4l_notau.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601508.PhPy8EG_PDF4LHC21_ZH125J_Zincl_MINLO_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601509.PhPy8EG_PDF4LHC21_ggZH125_Zincl_Hmumu.evgen.HEPMC.e8558_e8622",
-      "mc23_13p6TeV.601586.PhPy8EG_PDF4LHC21_ZH125J_Zincl_ZZ4lep_tauFilt.evgen.HEPMC.e8589_e8622",
-      "mc23_13p6TeV.601610.PhPy8EG_PDF4LHC21_ZH125J_Zinc_MINLO_etau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.601611.PhPy8EG_PDF4LHC21_ZH125J_Zinc_MINLO_mutau.evgen.HEPMC.e8543_e8622",
-      "mc23_13p6TeV.602521.PhPy8EG_PDF4LHC21_ggZH125_Zincl_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602522.PhPy8EG_PDF4LHC21_ggZH125_Zincl_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602527.PhPy8EG_PDF4LHC21_ZH125J_Zincl_MINLO_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.602528.PhPy8EG_PDF4LHC21_ZH125J_Zincl_MINLO_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603333.PhPy8EG_A14_qqZllH125bb_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603334.PhPy8EG_A14_qqZvvH125bb_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603335.PhPy8EG_A14_ggZllH125bb.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603336.PhPy8EG_A14_ggZvvH125bb.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603418.PhPy8EG_NNPDF23_A14_ggZH125_Zinc_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603428.PhPy8EG_NNPDF23_A14_ZH125J_Zinc_tautau.evgen.HEPMC.e8559_e8622",
-      "mc23_13p6TeV.603508.PhPy8EG_PDF4LHC21_ggZllH125_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603509.PhPy8EG_PDF4LHC21_ggZllH125_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603514.PhPy8EG_PDF4LHC21_qqZllH125_VpTbias_HWW_WWlvlv.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603515.PhPy8EG_PDF4LHC21_qqZllH125_VpTbias_HWW_WWlvqq.evgen.HEPMC.e8566_e8622",
-      "mc23_13p6TeV.603715.PhPy8EG_A14_qqZllH125cc_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603716.PhPy8EG_A14_qqZvvH125cc_VpT.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603717.PhPy8EG_A14_ggZllH125cc.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603718.PhPy8EG_A14_ggZvvH125cc.evgen.HEPMC.e8544_e8622",
-      "mc23_13p6TeV.603866.PhPy8EG_PDF4LHC21_ggZllH125_HInv.evgen.HEPMC.e8575_e8622",
-      "mc23_13p6TeV.603867.PhPy8EG_PDF4LHC21_qqZllH125_VpTbias_HInv.evgen.HEPMC.e8575_e8622",
-      "mc23_13p6TeV.604309.PhPy8EG_A14_ggZH125.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604310.PhPy8EG_PDF4LHC21_A14_qqZH125.evgen.HEPMC.e8599_e8622",
-      "mc23_13p6TeV.604363.PhH7EG_PDF4LHC21_ZH125J_Zincl_MINLO_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604364.PhH7EG_PDF4LHC21_ggZH125_Zincl_Hmumu.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604371.PhH7EG_PDF4LHC21_ZH125J_Zincl_MINLO_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604372.PhH7EG_PDF4LHC21_ggZH125_Zincl_HZZ_4l_notau.evgen.HEPMC.e8587_e8622",
-      "mc23_13p6TeV.604508.PhH7EG_PDF4LHC21_ZH125J_Zincl_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604509.PhH7EG_PDF4LHC21_ZH125J_Zincl_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604510.PhH7EG_PDF4LHC21_ZH125J_Zincl_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604517.PhH7EG_PDF4LHC21_ggZH125_Zincl_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604518.PhH7EG_PDF4LHC21_ggZH125_Zincl_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604519.PhH7EG_PDF4LHC21_ggZH125_Zincl_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604520.PhH7EG_PDF4LHC21_qqZllH125_VpTbias_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604521.PhH7EG_PDF4LHC21_qqZllH125_VpTbias_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604522.PhH7EG_PDF4LHC21_qqZllH125_VpTbias_HWW_WWlvlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604529.PhH7EG_PDF4LHC21_ggZllH125_HWW_HWW_WWqqlv.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604530.PhH7EG_PDF4LHC21_ggZllH125_HWW_HWW_WWlvqq.evgen.HEPMC.e8588_e8622",
-      "mc23_13p6TeV.604531.PhH7EG_PDF4LHC21_ggZllH125_HWW_HWW_WWlvlv.evgen.HEPMC.e8588_e8622"
-    ],
+    "13p6tev-sm-z+higgs": [],
     "13p6tev-sm-z-to-neutrinos": [
       "mc23_13p6TeV.513114.MGPy8EG_Znunu_FxFx3jHT2bias_SW_pTvv70_BFilter.evgen.HEPMC.e8514_e8596",
       "mc23_13p6TeV.513115.MGPy8EG_Znunu_FxFx3jHT2bias_SW_pTvv70_CFilterBVeto.evgen.HEPMC.e8514_e8596",
@@ -1807,8 +1486,7 @@
       "mc23_13p6TeV.700845.Sh_2214_Wqq_ptW_200_ECMS_CKKW30.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700846.Sh_2214_Wqq_ptW_200_ECMS_CSSKIN.evgen.HEPMC.e8514_e8528_e8596",
       "mc23_13p6TeV.700847.Sh_2214_Wqq_ptW_200_ECMS_QSF025.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.700848.Sh_2214_Wqq_ptW_200_ECMS_QSF4.evgen.HEPMC.e8514_e8528_e8596",
-      "mc23_13p6TeV.700861.Sh_2214_Wqq_ptW_200_ECMS_Lund.evgen.HEPMC.e8514_e8528_e8596"
+      "mc23_13p6TeV.700848.Sh_2214_Wqq_ptW_200_ECMS_QSF4.evgen.HEPMC.e8514_e8528_e8596"
     ],
     "13p6tev-systematic-variation-sm-z-boson": [
       "mc23_13p6TeV.700850.Sh_2214_Zqq_ptZ_200_ECMS_CKKW15.evgen.HEPMC.e8514_e8596",
@@ -1839,7 +1517,6 @@
       "mc23_13p6TeV.546620.aMCPy8EG_tqllprod_lequ3LH_ctmumu_had.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.546621.aMCPy8EG_tqllprod_lqM_utee_had.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.546622.aMCPy8EG_tqllprod_lequ3LH_utee_had.evgen.HEPMC.e8557_e8528_e8596",
-      "mc23_13p6TeV.546623.aMCPy8EG_tqllprod_lqM_ctee_had.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.546624.aMCPy8EG_tqllprod_lequ3LH_ctee_had.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.546625.aMCPy8EG_tqllprod_lqM_uttautau_incl.evgen.HEPMC.e8557_e8528_e8596",
       "mc23_13p6TeV.546626.aMCPy8EG_tqllprod_lequ3LH_uttautau_incl.evgen.HEPMC.e8557_e8528_e8596",
@@ -1963,7 +1640,6 @@
     ],
     "13tev-bsm-other-seesaw": [
       "mc16_13TeV.543723.MGPy8EG_A14N23LO_typeIIISeesaw_2l_M500.evgen.HEPMC.e8555_e8601",
-      "mc16_13TeV.543724.MGPy8EG_A14N23LO_typeIIISeesaw_2l_M600.evgen.HEPMC.e8555_e8601",
       "mc16_13TeV.543725.MGPy8EG_A14N23LO_typeIIISeesaw_2l_M700.evgen.HEPMC.e8555_e8455_e8596",
       "mc16_13TeV.543726.MGPy8EG_A14N23LO_typeIIISeesaw_2l_M800.evgen.HEPMC.e8555_e8601",
       "mc16_13TeV.543727.MGPy8EG_A14N23LO_typeIIISeesaw_2l_M900.evgen.HEPMC.e8555_e8601",
@@ -1989,7 +1665,6 @@
       "mc16_13TeV.543747.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M700.evgen.HEPMC.e8555_e8455_e8596",
       "mc16_13TeV.543748.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M800.evgen.HEPMC.e8555_e8455_e8596",
       "mc16_13TeV.543749.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M900.evgen.HEPMC.e8555_e8601",
-      "mc16_13TeV.543750.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M1000.evgen.HEPMC.e8555_e8601",
       "mc16_13TeV.543751.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M1100.evgen.HEPMC.e8555_e8601",
       "mc16_13TeV.543752.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M1200.evgen.HEPMC.e8555_e8601",
       "mc16_13TeV.543753.MGPy8EG_A14N23LO_typeIIISeesaw_4l_M1300.evgen.HEPMC.e8555_e8455_e8596",
@@ -2008,7 +1683,6 @@
       "mc16_13TeV.525164.aMCPy8EG_sgluonpair_noallhad_m900.evgen.HEPMC.e8435_e7400_e8596",
       "mc16_13TeV.525165.aMCPy8EG_sgluonpair_noallhad_m1000.evgen.HEPMC.e8435_e7400_e8596",
       "mc16_13TeV.525166.aMCPy8EG_sgluonpair_noallhad_m1100.evgen.HEPMC.e8435_e7400_e8596",
-      "mc16_13TeV.525167.aMCPy8EG_sgluonpair_noallhad_m1200.evgen.HEPMC.e8435_e7400_e8596",
       "mc16_13TeV.525168.aMCPy8EG_sgluonpair_noallhad_m1300.evgen.HEPMC.e8435_e7400_e8596",
       "mc16_13TeV.525169.aMCPy8EG_sgluonpair_noallhad_m1400.evgen.HEPMC.e8435_e7400_e8596",
       "mc16_13TeV.525170.aMCPy8EG_sgluonpair_noallhad_m1500.evgen.HEPMC.e8435_e7400_e8596",
@@ -2080,63 +1754,7 @@
       "mc16_13TeV.802409.Py8EG_SVJLschan_rinv3_4500.evgen.HEPMC.e8531_e8601",
       "mc16_13TeV.802410.Py8EG_SVJLschan_rinv7_4500.evgen.HEPMC.e8531_e8601"
     ],
-    "13tev-bsm-vector-like-leptons": [
-      "mc16_13TeV.512071.MGPy8EG_NNPDF31_MVLL150_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512072.MGPy8EG_NNPDF31_MVLL200_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512073.MGPy8EG_NNPDF31_MVLL300_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512074.MGPy8EG_NNPDF31_MVLL400_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512075.MGPy8EG_NNPDF31_MVLL500_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512076.MGPy8EG_NNPDF31_MVLL600_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512077.MGPy8EG_NNPDF31_MVLL700_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512078.MGPy8EG_NNPDF31_MVLL800_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512079.MGPy8EG_NNPDF31_MVLL900_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512080.MGPy8EG_NNPDF31_MVLL1000_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512081.MGPy8EG_NNPDF31_MVLL1100_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512082.MGPy8EG_NNPDF31_MVLL1200_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512083.MGPy8EG_NNPDF31_MVLL1300_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512084.MGPy8EG_NNPDF31_MVLL150_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512085.MGPy8EG_NNPDF31_MVLL200_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512086.MGPy8EG_NNPDF31_MVLL300_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512087.MGPy8EG_NNPDF31_MVLL400_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512088.MGPy8EG_NNPDF31_MVLL500_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512089.MGPy8EG_NNPDF31_MVLL600_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512090.MGPy8EG_NNPDF31_MVLL700_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512091.MGPy8EG_NNPDF31_MVLL800_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512092.MGPy8EG_NNPDF31_MVLL900_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512093.MGPy8EG_NNPDF31_MVLL1000_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512094.MGPy8EG_NNPDF31_MVLL1100_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512095.MGPy8EG_NNPDF31_MVLL1200_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512096.MGPy8EG_NNPDF31_MVLL1300_el_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512097.MGPy8EG_NNPDF31_MVLL150_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512098.MGPy8EG_NNPDF31_MVLL200_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512099.MGPy8EG_NNPDF31_MVLL300_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512100.MGPy8EG_NNPDF31_MVLL400_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512101.MGPy8EG_NNPDF31_MVLL500_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512102.MGPy8EG_NNPDF31_MVLL600_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512103.MGPy8EG_NNPDF31_MVLL700_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512104.MGPy8EG_NNPDF31_MVLL800_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512105.MGPy8EG_NNPDF31_MVLL900_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512106.MGPy8EG_NNPDF31_MVLL1000_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512107.MGPy8EG_NNPDF31_MVLL1100_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512108.MGPy8EG_NNPDF31_MVLL1200_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512109.MGPy8EG_NNPDF31_MVLL1300_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512110.MGPy8EG_NNPDF31_MVLL150_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512111.MGPy8EG_NNPDF31_MVLL200_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512112.MGPy8EG_NNPDF31_MVLL300_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512113.MGPy8EG_NNPDF31_MVLL400_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512114.MGPy8EG_NNPDF31_MVLL500_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512116.MGPy8EG_NNPDF31_MVLL700_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512117.MGPy8EG_NNPDF31_MVLL800_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512118.MGPy8EG_NNPDF31_MVLL900_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512119.MGPy8EG_NNPDF31_MVLL1000_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512120.MGPy8EG_NNPDF31_MVLL1100_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512121.MGPy8EG_NNPDF31_MVLL1200_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.512122.MGPy8EG_NNPDF31_MVLL1300_mu_singlet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.523766.MGPy8EG_NNPDF31_MVLL1400_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.523767.MGPy8EG_NNPDF31_MVLL1600_el_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.523768.MGPy8EG_NNPDF31_MVLL1400_mu_doublet.evgen.HEPMC.e8412_e7400_e8622",
-      "mc16_13TeV.523769.MGPy8EG_NNPDF31_MVLL1600_mu_doublet.evgen.HEPMC.e8412_e7400_e8622"
-    ],
+    "13tev-bsm-vector-like-leptons": [],
     "13tev-exclusive-production": [
       "mc16_13TeV.344237.Pythia8EvtGen_CT14QED_gmgm2H2gmgm_750GeV_NW.evgen.HEPMC.e5117_e8601",
       "mc16_13TeV.344238.Pythia8EvtGen_CT14QED_gmgm2H2gmgm_750GeV_W45GeV.evgen.HEPMC.e5117_e8601",
@@ -2172,9 +1790,7 @@
       "mc16_13TeV.429867.Pythia8EvtGen_Monash_NNPDF23LO_minbias_inelastic_low.evgen.HEPMC.e7726_e8601",
       "mc16_13TeV.429868.Pythia8EvtGen_Monash_NNPDF23LO_minbias_inelastic_high.evgen.HEPMC.e7726_e8601",
       "mc16_13TeV.429869.Epos_minbias_inelastic_low.evgen.HEPMC.e7705_e8601",
-      "mc16_13TeV.429870.Epos_minbias_inelastic_high.evgen.HEPMC.e7705_e8601",
-      "mc16_13TeV.800028.Py8EG_A3NNPDF23LO_minbias_inelastic_low.evgen.HEPMC.e7793_e8622",
-      "mc16_13TeV.800029.Py8EG_A3NNPDF23LO_minbias_inelastic_high.evgen.HEPMC.e7793_e8622"
+      "mc16_13TeV.429870.Epos_minbias_inelastic_high.evgen.HEPMC.e7705_e8601"
     ],
     "13tev-other-bsm-samples": [
       "mc16_13TeV.344008.Pythia8EvtGen_A14NNPDF23LO_1Hard1BremDP40.evgen.HEPMC.e4893_e8601",
@@ -2248,19 +1864,6 @@
       "mc16_13TeV.800035.Py8EG_A14N23LO_jetjet_JZ7WithSW_mufilt.evgen.HEPMC.e7876_e7400_e8596"
     ],
     "13tev-sm-photon+di-electron": [
-      "mc16_13TeV.345887.Sherpa_222_NNPDF30NNLO_eegamma_M_110_175.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345888.Sherpa_222_NNPDF30NNLO_eegamma_M_175_250.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345889.Sherpa_222_NNPDF30NNLO_eegamma_M_250_400.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345890.Sherpa_222_NNPDF30NNLO_eegamma_M_400_1000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345891.Sherpa_222_NNPDF30NNLO_eegamma_M_1000_2000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345892.Sherpa_222_NNPDF30NNLO_eegamma_M_2000_3000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345893.Sherpa_222_NNPDF30NNLO_eegamma_M_3000_E_CMS.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.346196.Sherpa_222_NNPDF30NNLO_eegamma_M_95_110.evgen.HEPMC.e7343_e5984_e8618",
-      "mc16_13TeV.364500.Sherpa_222_NNPDF30NNLO_eegamma_pty_7_15.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364501.Sherpa_222_NNPDF30NNLO_eegamma_pty_15_35.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364502.Sherpa_222_NNPDF30NNLO_eegamma_pty_35_70.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364503.Sherpa_222_NNPDF30NNLO_eegamma_pty_70_140.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364504.Sherpa_222_NNPDF30NNLO_eegamma_pty_140_E_CMS.evgen.HEPMC.e5928_e8622",
       "mc16_13TeV.301535.Sherpa_CT10_eegammaPt10_35.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301899.Sherpa_CT10_eegammaPt35_70.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301900.Sherpa_CT10_eegammaPt70_140.evgen.HEPMC.e3952_e8602",
@@ -2272,26 +1875,10 @@
       "mc16_13TeV.343838.Sherpa_CT10_eegammaM1000_1500.evgen.HEPMC.e4838_e8602",
       "mc16_13TeV.343839.Sherpa_CT10_eegammaM1500_2000.evgen.HEPMC.e4838_e8602",
       "mc16_13TeV.343840.Sherpa_CT10_eegammaM2000_2500.evgen.HEPMC.e4838_e8602",
-      "mc16_13TeV.343841.Sherpa_CT10_eegammaM2500_3000.evgen.HEPMC.e4838_e8622",
       "mc16_13TeV.343842.Sherpa_CT10_eegammaM3000.evgen.HEPMC.e4838_e8602",
-      "mc16_13TeV.344285.Sherpa_CT10_eegammaM110_175.evgen.HEPMC.e5162_e8602",
-      "mc16_13TeV.700018.Sh_228_eegamma_pty7_ptV90.evgen.HEPMC.e7947_e8622"
+      "mc16_13TeV.344285.Sherpa_CT10_eegammaM110_175.evgen.HEPMC.e5162_e8602"
     ],
     "13tev-sm-photon+di-muon": [
-      "mc16_13TeV.345894.Sherpa_222_NNPDF30NNLO_mumugamma_M_110_175.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345895.Sherpa_222_NNPDF30NNLO_mumugamma_M_175_250.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345896.Sherpa_222_NNPDF30NNLO_mumugamma_M_250_400.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345897.Sherpa_222_NNPDF30NNLO_mumugamma_M_400_1000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345898.Sherpa_222_NNPDF30NNLO_mumugamma_M_1000_2000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345899.Sherpa_222_NNPDF30NNLO_mumugamma_M_2000_3000.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.345900.Sherpa_222_NNPDF30NNLO_mumugamma_M_3000_E_CMS.evgen.HEPMC.e6585_e5984_e8618",
-      "mc16_13TeV.346197.Sherpa_222_NNPDF30NNLO_mumugamma_M_95_110.evgen.HEPMC.e7343_e5984_e8618",
-      "mc16_13TeV.364505.Sherpa_222_NNPDF30NNLO_mumugamma_pty_7_15.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364506.Sherpa_222_NNPDF30NNLO_mumugamma_pty_15_35.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364506.Sherpa_222_NNPDF30NNLO_mumugamma_pty_15_35.evgen.HEPMC.e5988_e8622",
-      "mc16_13TeV.364507.Sherpa_222_NNPDF30NNLO_mumugamma_pty_35_70.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364508.Sherpa_222_NNPDF30NNLO_mumugamma_pty_70_140.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364509.Sherpa_222_NNPDF30NNLO_mumugamma_pty_140_E_CMS.evgen.HEPMC.e5928_e8622",
       "mc16_13TeV.301536.Sherpa_CT10_mumugammaPt10_35.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301902.Sherpa_CT10_mumugammaPt35_70.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301903.Sherpa_CT10_mumugammaPt70_140.evgen.HEPMC.e3952_e8602",
@@ -2305,22 +1892,14 @@
       "mc16_13TeV.343849.Sherpa_CT10_mumugammaM2000_2500.evgen.HEPMC.e4838_e8602",
       "mc16_13TeV.343850.Sherpa_CT10_mumugammaM2500_3000.evgen.HEPMC.e4838_e8602",
       "mc16_13TeV.343851.Sherpa_CT10_mumugammaM3000.evgen.HEPMC.e4838_e8602",
-      "mc16_13TeV.344286.Sherpa_CT10_mumugammaM110_175.evgen.HEPMC.e5162_e8602",
-      "mc16_13TeV.700019.Sh_228_mmgamma_pty7_ptV90.evgen.HEPMC.e7947_e8622"
+      "mc16_13TeV.344286.Sherpa_CT10_mumugammaM110_175.evgen.HEPMC.e5162_e8602"
     ],
     "13tev-sm-photon+di-tau": [
-      "mc16_13TeV.364510.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_7_15.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364511.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_15_35.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364512.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_35_70.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364513.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_70_140.evgen.HEPMC.e5928_e8622",
-      "mc16_13TeV.364513.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_70_140.evgen.HEPMC.e5982_e8622",
-      "mc16_13TeV.364514.Sherpa_222_NNPDF30NNLO_tautaugamma_pty_140_E_CMS.evgen.HEPMC.e5928_e8622",
       "mc16_13TeV.301905.Sherpa_CT10_tautaugammaPt35_70.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301906.Sherpa_CT10_tautaugammaPt70_140.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.301907.Sherpa_CT10_tautaugammaPt140.evgen.HEPMC.e3952_e8602",
       "mc16_13TeV.304776.Sherpa_CT10_tautaugammaPt10_35.evgen.HEPMC.e4687_e8602",
-      "mc16_13TeV.343243.Sherpa_CT10_tautaugammaPt10_35.evgen.HEPMC.e4759_e8602",
-      "mc16_13TeV.700020.Sh_228_ttgamma_pty7_ptV90.evgen.HEPMC.e7947_e8622"
+      "mc16_13TeV.343243.Sherpa_CT10_tautaugammaPt10_35.evgen.HEPMC.e4759_e8602"
     ],
     "13tev-sm-t-channel-single-top": [
       "mc16_13TeV.410616.PowhegPythia8EvtGen_A14_singletop_tchan_had_top.evgen.HEPMC.e6838_e5984_e8596",
@@ -2340,16 +1919,6 @@
       "mc16_13TeV.410217.aMcAtNloHerwigppEvtGen_UEEE5_CTEQ6L1_CT10ME_260000_tWZDR.evgen.HEPMC.e4851_e8601"
     ],
     "13tev-sm-v(->qq)+photon": [
-      "mc16_13TeV.305435.Sherpa_CT10_WqqGammaPt140_280.evgen.HEPMC.e5037_e8622",
-      "mc16_13TeV.305436.Sherpa_CT10_WqqGammaPt280_500.evgen.HEPMC.e5037_e8622",
-      "mc16_13TeV.305437.Sherpa_CT10_WqqGammaPt500_1000.evgen.HEPMC.e5037_e8622",
-      "mc16_13TeV.305438.Sherpa_CT10_WqqGammaPt1000_2000.evgen.HEPMC.e5037_e8622",
-      "mc16_13TeV.305439.Sherpa_CT10_WqqGammaPt2000_inf.evgen.HEPMC.e5037_e8622",
-      "mc16_13TeV.305440.Sherpa_CT10_ZqqGammaPt140_280.evgen.HEPMC.e5020_e8622",
-      "mc16_13TeV.305441.Sherpa_CT10_ZqqGammaPt280_500.evgen.HEPMC.e5020_e8622",
-      "mc16_13TeV.305442.Sherpa_CT10_ZqqGammaPt500_1000.evgen.HEPMC.e5020_e8622",
-      "mc16_13TeV.305443.Sherpa_CT10_ZqqGammaPt1000_2000.evgen.HEPMC.e5020_e8622",
-      "mc16_13TeV.305444.Sherpa_CT10_ZqqGammaPt2000_inf.evgen.HEPMC.e5020_e8622",
       "mc16_13TeV.364413.MadGraphPythia8EvtGen_WqqgammaNp0123_DP140_280.evgen.HEPMC.e5969_e5984_e8596",
       "mc16_13TeV.364414.MadGraphPythia8EvtGen_WqqgammaNp0123_DP280_500.evgen.HEPMC.e5969_e5984_e8596",
       "mc16_13TeV.364415.MadGraphPythia8EvtGen_WqqgammaNp0123_DP500_1000.evgen.HEPMC.e5969_e5984_e8596",
@@ -2362,62 +1931,12 @@
       "mc16_13TeV.364422.MadGraphPythia8EvtGen_ZqqgammaNp0123_DP2000_inf.evgen.HEPMC.e5969_e5984_e8596"
     ],
     "13tev-sm-wt-sherpa": [
-      "mc16_13TeV.413014.Sherpa_226_NNPDF30NNLO_singleTop_tW_dilep.evgen.HEPMC.e7458_e8622",
       "mc16_13TeV.413015.Sherpa_226_NNPDF30NNLO_singleAntiTop_tW_dilep.evgen.HEPMC.e7458_e8601",
       "mc16_13TeV.413016.Sherpa_226_NNPDF30NNLO_singleTop_tW_Wlep_thad.evgen.HEPMC.e7458_e8601",
       "mc16_13TeV.413017.Sherpa_226_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad.evgen.HEPMC.e7458_e8601",
-      "mc16_13TeV.413018.Sherpa_226_NNPDF30NNLO_singleTop_tW_Whad_tlep.evgen.HEPMC.e7458_e8622",
       "mc16_13TeV.413019.Sherpa_226_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep.evgen.HEPMC.e7458_e8601",
       "mc16_13TeV.413020.Sherpa_226_NNPDF30NNLO_singleTop_tW_allhad.evgen.HEPMC.e7458_e8601",
-      "mc16_13TeV.413021.Sherpa_226_NNPDF30NNLO_singleAntiTop_tW_allhad.evgen.HEPMC.e7458_e8601",
-      "mc16_13TeV.413029.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413030.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413031.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413032.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413033.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413034.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413035.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413036.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_nom.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413041.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413042.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413043.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413044.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413045.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413046.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413047.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413048.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_CSS_KIN_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413053.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413054.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413055.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413056.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413057.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413058.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413059.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413060.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_CSS_EVO_0.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413065.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413066.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413067.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413068.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413069.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413070.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413071.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413072.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_QSF_0p5.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413077.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413078.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413079.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413080.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413081.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413082.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413083.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413084.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_QSF_2.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413089.Sherpa_227_NNPDF30NNLO_singleTop_tW_dilep_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413090.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_dilep_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413091.Sherpa_227_NNPDF30NNLO_singleTop_tW_Wlep_thad_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413092.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Wlep_thad_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413093.Sherpa_227_NNPDF30NNLO_singleTop_tW_Whad_tlep_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413094.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_Whad_tlep_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413095.Sherpa_227_NNPDF30NNLO_singleTop_tW_allhad_Lund.evgen.HEPMC.e7723_e8622",
-      "mc16_13TeV.413096.Sherpa_227_NNPDF30NNLO_singleAntiTop_tW_allhad_Lund.evgen.HEPMC.e7723_e8622"
+      "mc16_13TeV.413021.Sherpa_226_NNPDF30NNLO_singleAntiTop_tW_allhad.evgen.HEPMC.e7458_e8601"
     ],
     "13tev-special-ttbar-j/psi": [
       "mc16_13TeV.411125.PhH7EG_H7UE_tt_mtop169p00_nonallhad_AntiB2Jpsimumu.evgen.HEPMC.e6943_e8601",
@@ -2464,22 +1983,7 @@
       "mc16_13TeV.501716.MGPy8EG_Wenu_FxFx_3jets_HT2bias_ForceDplusD0.evgen.HEPMC.e8382_e8601",
       "mc16_13TeV.501717.MGPy8EG_Wmunu_FxFx_3jets_HT2bias_ForceDplusD0.evgen.HEPMC.e8382_e7400_e8596",
       "mc16_13TeV.501718.MGPy8EG_Wenu_FxFx_3jets_HT2bias_SMT.evgen.HEPMC.e8382_e8601",
-      "mc16_13TeV.501719.MGPy8EG_Wmunu_FxFx_3jets_HT2bias_SMT.evgen.HEPMC.e8382_e8601",
-      "mc16_13TeV.700366.ShEG_2211_Wenu_01NLO_unbiased_ForcedD0Dplus.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700367.ShEG_2211_Wmunu_01NLO_unbiased_ForcedD0Dplus.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700368.ShEG_2211_Wtaunu_01NLO_unbiased_ForcedD0Dplus.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700409.ShEG_2211_Wenu_01NLO_unbiased_SMT.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700410.ShEG_2211_Wmunu_01NLO_unbiased_SMT.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700411.ShEG_2211_Wtaunu_01NLO_unbiased_SMT.evgen.HEPMC.e8338_e8622",
-      "mc16_13TeV.700443.Sh_2211_Wenu_mW_120_ECMS_BFilter.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700444.Sh_2211_Wenu_mW_120_ECMS_CFilterBVeto.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700445.Sh_2211_Wenu_mW_120_ECMS_CVetoBVeto.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700446.Sh_2211_Wmunu_mW_120_ECMS_BFilter.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700447.Sh_2211_Wmunu_mW_120_ECMS_CFilterBVeto.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700448.Sh_2211_Wmunu_mW_120_ECMS_CVetoBVeto.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700449.Sh_2211_Wtaunu_mW_120_ECMS_BFilter.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700450.Sh_2211_Wtaunu_mW_120_ECMS_CFilterBVeto.evgen.HEPMC.e8351_e8622",
-      "mc16_13TeV.700451.Sh_2211_Wtaunu_mW_120_ECMS_CVetoBVeto.evgen.HEPMC.e8351_e8622"
+      "mc16_13TeV.501719.MGPy8EG_Wmunu_FxFx_3jets_HT2bias_SMT.evgen.HEPMC.e8382_e8601"
     ],
     "Summary_13TeV": []
   }

@zlmarshall

zlmarshall commented Oct 5, 2026

Copy link
Copy Markdown
Contributor Author

Thank you for looking into this, @tiborsimko !

I had completely forgotten to update /eos/opendata/atlas/upload/evgen_metadata/od_hepmc_file_mapping.json; that's now done. The changes to the last record file look fine to me after that update (it's a much shorter list of changes).

After that update, there's only one record that's empty, which is the Wt nominal dataset. I've looked into why that it, and it appears that the samples have been deleted in the meantime. That shouldn't be possible... but here we are. I've asked for a reproduction with some urgency. Maybe we could skip that one for the moment and try to release all the rest (or include that one with an extra note that updates are coming imminently)?

Thanks,
Zach

@tiborsimko
fix(atlas-2025-odfr-hepmc): correct index.txt file size and checksum
3ee888e 
The `index.txt` file entries in generated records were using the size
and checksum of the corresponding `index.json` file. Compute them from
the `index.txt` file itself.
@tiborsimko

tiborsimko commented Oct 6, 2026

Copy link
Copy Markdown
Member

I had completely forgotten to update /eos/opendata/atlas/upload/evgen_metadata/od_hepmc_file_mapping.json; that's now done.

@zlmarshall Thanks, I have regenerated the records and I saw some troubles. I'll post some findings below, prepared with the help of a general-knowledge AI (so lacking ATLAS knowledge!). Please let me know what you think and I could take care of updating the scripts.

1. Shared file indexes

Some records reference the same file index twice, and part of their files cannot be reached from the record.

Cause. For 22 DSIDs, HEPMC_datasets.txt contains two productions with different evgen e-tags, for example:

mc23_13p6TeV.601700.PhPy8EG_dijet_JZ1.evgen.HEPMC.e8514_e8601
mc23_13p6TeV.601700.PhPy8EG_dijet_JZ1.evgen.HEPMC.e8551_e8596

make_od_hepmc_json.py names the per-dataset file list MC_<DSID>_<energy>_<short>_hepmc_filelist.json, without the e-tag, so the second production overwrites the first. The record then lists the same index twice, and number_files, number_events and size count both productions, but the index lists the files of only one of them. This affects 8 records and 23,942 files, most of them in 13p6tev-sm-di-jet-systematic-variation (17,732 files). The affected DSIDs are 601700–601707, 601487, 601489, 602969–602976, 363749, 364506, 364513 and 410215. In each case, both e-tags come from the central pages, in the same EVNT_list_*.txt category.

Separately, the four ALP datasets 509022, 509024, 509025 and 509028 appear twice in HEPMC_datasets.txt, because they are duplicated in EVNT_exotics.data. As a result, 13tev-bsm-axion-like-particles counts 32 files twice.

Proposed fix.

  • Add the full tag suffix to file list and index names, e.g. mc23_13p6TeV_MC_601700_13p6tev_PhPy8EG_dijet_JZ1_e8514_e8601_hepmc_file_index.json. Each rucio dataset then gets its own index. With the current record selection, this gives 2,308 indexes instead of 2,286, with no collisions left.
  • Ignore repeated lines when reading HEPMC_datasets.txt, and remove the four duplicate lines.
  • Make make_od_hepmc_json.py fail if two datasets would ever write the same file list again.

This renames all index files generated for this release. The index files I uploaded to EOS from the September run would be replaced; they need to be anyway, because the updated file mapping changed many of them. The 114 index files of the already published record 160002 (the 57 Drell-Yan datasets) stay untouched. I would upload and check the new indexes first, then update the records, and only then remove the superseded untagged indexes.

Questions.

  1. For each of these 22 DSIDs, should both productions be released? If only one should remain, which full dataset name should we keep? The fix above keeps both as separate indexes, so it does not decide this either way.
  2. Is it OK to put the e-tags into the index file names?
  3. Should the duplicate ALP lines also be removed from EVNT_exotics.data, or should that file stay as received from the exotics conveners?
  4. check_for_HEPMC_datasets.py compares dataset names without their tags when deciding what was "already processed". In a later run, a new production of an already listed DSID would therefore be skipped. Is that intended?

@tiborsimko

tiborsimko commented Oct 6, 2026

Copy link
Copy Markdown
Member

2. AZNLO samples

When I rerun make_od_hepmc_json.py, the only remaining difference in last_record_creation.json against the committed version is that the nine 13.6 TeV Powheg AZNLO W/Z samples move from the Nominal records to the Alternative ones:

  • mc23_13p6TeV.601183–601188 (PhPy8EG_AZNLO_W*): 13p6tev-nominal-sm-w-boson → 13p6tev-alternative-sm-w-boson
  • mc23_13p6TeV.601189–601191 (PhPy8EG_AZNLO_Z*): 13p6tev-nominal-sm-z-boson → 13p6tev-alternative-sm-z-boson

You wrote that this shorter diff looked fine; but I would like to double check that the move is not accidental:

  • EVNT_metadata.csv tags these DSIDs Baseline at 13.6 TeV but Alternative at 13 TeV. The central-pages lists agree.
  • Since fa583d8d, keyword_sorting.py stores only the DSID, without the energy (previously it stored full EVNT names). od_hepmc_sample_map.json therefore lists each of these DSIDs under both records.
  • make_od_hepmc_json.py puts each HEPMC dataset into the first record that matches. Since b42ead93 added sort_keys=True, records come in alphabetical order, so "Alternative" wins. Before that commit the order varied from run to run. The committed last_record_creation.json is consistent with an order in which "Nominal" came first.

DSIDs 700892–700894 (Sh_2214_Ztautau_mZ_105_ECMS_*; Baseline at 13.6 TeV, Specialised at 13 TeV) depend on the same ordering. They land correctly in Nominal Z only because "Nominal" sorts before "Specialised".

Proposed fix. Store the energy together with the DSID in the sample map (e.g. 13p6TeV.601183), match on both, and stop with an error if a dataset matches more than one record. I simulated this on the current inputs. Exactly 12 datasets change record: the nine 13.6 TeV AZNLO samples go back to Nominal, as in the committed version, and the 13 TeV versions of 700892–700894 go to Specialised Z instead of Nominal Z. Every input dataset keeps exactly one category assignment. This does not address the separate omission of 13 TeV records, which I describe in another comment.

Questions.

  1. Should the 13.6 TeV AZNLO samples be in the Nominal records, as their 13.6 TeV metadata says and as the committed version had them?
  2. Is it OK to make the sample map energy-aware in this way?

@tiborsimko

tiborsimko commented Oct 6, 2026

Copy link
Copy Markdown
Member

3. Missing record 160002

I noticed that the already published record 160002, atlas-hepmc-13tev-specialised-sm-z-boson, is no longer generated when I rerun the scripts. We published it as the illustration sample in opendata.cern.ch before, though. Is its omission from the current generation intentional?

I found two reasons why it cannot currently be regenerated with its published content:

  • b42ead93 removed its 57 datasets from EVNT_list_Specialised.txt, EVNT_metadata.csv and HEPMC_datasets.txt. They are also absent from the current file mapping.
  • make_od_hepmc_json.py builds a category's 13 TeV record only if it has no 13.6 TeV samples (if hepmc13p6: … elif hepmc13: …). Specialised SM Z-boson now has 13.6 TeV samples, so restoring the missing inputs alone would still not generate 160002.

Conversely, changing only the elif would regenerate 160002 under the same DOI with a different set of 13 TeV datasets, omitting the 57 published ones. We should avoid replacing its published content that way.

For context, enabling all the omitted 13 TeV records would add about 3.45 million files and 476 TB to the release, according to the current mapping. That is a substantial expansion, and I can see why excluding some of those samples might be intentional. We can address 160002 separately without committing to that broader release.

How would you like to handle 160002?

  1. Should we restore its inputs, including the Specialised classification and file metadata, and generate its 13 TeV record alongside the 13.6 TeV one, as an explicit exception for this category only? Should it contain just the 57 published datasets, or also the rest of its category? With the energy-aware assignment fix described in the AZNLO comment, the latter would add 51 datasets (86,139 files, about 4.5 TB). Either way, we would check that all 2,671 published files remain, with the same URIs, sizes and checksums.
  2. Alternatively, should we deliberately keep 160002 unchanged as published, outside the generation, and include it explicitly in the summary links and totals?
  3. If the original publication was a mistake, should we discuss explicitly withdrawing the record? Omitting it from generation does not withdraw the existing portal record.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tiborsimko tiborsimko tiborsimko left review comments
@Soap2G Soap2G Soap2G approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@zlmarshall @Soap2G @tiborsimko