Reconfigurable Computing Challenge: Transformer for Jet Tagging on Versal AI Engines

  • 2026-06-16 04:22:06
  • Gram Koski, Sean Lipps, Zhenghua Ma, G. Abarajithan, Ryan Kastner
  • 0

Abstract

Transformer-based models achieve strong performance for jet tagging at the CERN LHC, but deploying them in low-latency, resource-constrained trigger systems is challenging. We present an initial implementation of a quantized, integer-only transformer for jet tagging on the AMD Versal AI Engine (AIE), mapping dense and multi-head attention (MHA) layers to AIE tiles. The main contribution is a reusable software framework that represents transformer layers as composable AIE building blocks and automatically generates the corresponding Vitis graph code from a high-level Python model description. This framework provides a foundation for future research and is released as open-source software at https://github.com/KastnerRG/particle_transformer_aie.

 

Quick Read (beta)

loading the full paper ...