Self-Supervised Learning Strategies for Jet Physics

Abstract: We extend the re-simulation-based self-supervised learning approach to learning representations of hadronic jets in colliders by exploiting the Markov property of the standard simulation chain. Instead of masking, cropping, or other forms of data augmentation, this approach simulates pairs of events where the initial portion of the simulation is shared, but the subsequent stages of the simulation evolve independently. When paired with a contrastive loss function, this naturally leads to representations that capture the physics in the initial stages of the simulation. In particular, we force the hard scattering and parton shower to be shared and let the hadronization and interaction with the detector evolve independently. We then evaluate the utility of these representations on downstream tasks.