Abstract
Neuro-Symbolic AI (NSAI) is an emerging paradigm that integrates neuralnetworks with symbolic reasoning to enhance the transparency, reasoningcapabilities, and data efficiency of AI systems. Recent NSAI systems havegained traction due to their exceptional performance in reasoning tasks andhuman-AI collaborative scenarios. Despite these algorithmic advancements,executing NSAI tasks on existing hardware (e.g., CPUs, GPUs, TPUs) remainschallenging, due to their heterogeneous computing kernels, high memoryintensity, and unique memory access patterns. Moreover, current NSAI algorithmsexhibit significant variation in operation types and scales, making themincompatible with existing ML accelerators. These challenges highlight the needfor a versatile and flexible acceleration framework tailored to NSAI workloads.In this paper, we propose NSFlow, an FPGA-based acceleration framework designedto achieve high efficiency, scalability, and versatility across NSAI systems.NSFlow features a design architecture generator that identifies workload datadependencies and creates optimized dataflow architectures, as well as areconfigurable array with flexible compute units, re-organizable memory, andmixed-precision capabilities. Evaluating across NSAI workloads, NSFlow achieves31x speedup over Jetson TX2, more than 2x over GPU, 8x speedup over TPU-likesystolic array, and more than 3x over Xilinx DPU. NSFlow also demonstratesenhanced scalability, with only 4x runtime increase when symbolic workloadsscale by 150x. To the best of our knowledge, NSFlow is the first framework toenable real-time generalizable NSAI algorithms acceleration, demonstrating apromising solution for next-generation cognitive systems.