Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Adding FCC-hh v05 production code #218

Open
wants to merge 44 commits into
base: master
Choose a base branch
from

Conversation

bistapf
Copy link

@bistapf bistapf commented Sep 13, 2024

This PR adds all the code and config used for the v05 (and an intital tester version of v06) productions of FCC-hh samples. Specifically:

  • The respective production tags and new samples are added to the param_FCChh.py. A customised key4hep release was used for the v05 production, as specified in the config. Test version for v06 currently relies on nightlies, will be made official and updated once edm4hep v1 is included in a key4hep release. The new, different FCC-hh Delphes cards for scenario I and II necessitate some changes of names in the further input files to read, these are added to the respective run scripts as well, hopefully not interfering with the FCC-ee code.
  • Option --edm4hep_output_config to run with a different output configuration file than the default hardcoded path is added to send_lhep8 and send_p8.
  • Code to retrieve and propagate the event generator weights/sum of weights for the metadata is added in checker_yaml.py. The event weight is stored in the EventHeader collection of edm4hep files produced with k4SimDelphes v00-05 or later. An optional flag can be set in the param config in order to use the proper sum of weights. If this is not set the behaviour should be unchanged to before.
  • MadGraph configuration files for additional samples generated for the FCC-hh analyses are added in mg5/examples.

Resolved WIP items:

  • Some FCC-hh specific instructions are added in FCChh_Instructions/Readme.md. -> Removed, will remain on frozen production branch for fcc_v05
  • An additional param_FCChh_scenarioII.py is used to accomodate the differences between using scenario I vs scenario II in a quick and not so nice way. -> From v06 FCC-hh production will switch to using the detector flag properly instead. Legacy code for the v05 production with two params remains on frozen production branch for fcc_v05, but the changes made here should also be backwards compatible. Main difference is the file system structure: with detector tag scenarios I and II are put in subfolders of the production tag directory, while for v05 they were separate top level directories.
  • Some additional production tags for processing some events with pile-up overlay are included, those however do not constitute a proper official production and don't need to be tracked by the events database e.g. -> Removed, will remain on frozen production branch for fcc_v05
  • The script to run LHE event generation in MadGraph, submitMG.sh is updated to run on centos7 and use an older version to be compatible with previous productions that were extended upon. This is already outdated by now again, should be adapted to EL9. -> Option --centos7 is added for running LHE production with MG standalone, to support legcay running of this production for now. Looking into switching to Dirac submission with better official support for this usecase.

Birgit Stapf and others added 30 commits September 13, 2024 11:30
…oftware stack it causes runtime errors from python, as the latter setsup python 3 and the LCG release python 2.7
bin/run.py Outdated Show resolved Hide resolved
bin/run.py Outdated Show resolved Hide resolved
@bistapf bistapf marked this pull request as ready for review September 27, 2024 10:51
bin/submitMG.sh Outdated
@@ -22,13 +33,17 @@ cd job
echo "copying madgraph tarball ..."
#cp -r /eos/experiment/fcc/hh/utils/generators/MG5_aMC_v2.6.1.tar.gz .
#cp -r /eos/experiment/fcc/hh/utils/generators/MG5_aMC_v2.6.7.tar.gz .
cp -r /eos/experiment/fcc/hh/utils/generators/MG5_aMC_v2.8.2.tar.gz .
# cp -r /eos/experiment/fcc/hh/utils/generators/MG5_aMC_v2.8.2.tar.gz .
cp -r /afs/cern.ch/work/b/bistapf/MG5_aMC_v2.5.5.tar.gz .
Copy link
Contributor

@kjvbrt kjvbrt Oct 2, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I copied MG5_aMC_v2.5.5.tar.gz to /eos/experiment/fcc/hh/utils/generators so it is in some global space. Also, can you not use -r --- you are copying just one file.

bin/run.py Show resolved Hide resolved
bin/send_lhe.py Outdated Show resolved Hide resolved
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants