Abstract
Hierarchical text classification (HTC) assigns documents to multiple levelsof a pre-defined taxonomy. Automated patent subject classification representsone of the hardest HTC scenarios because of domain knowledge difficulty and ahuge number of labels. Prior approaches only output a flat label set, whichoffers little insight into the reason behind predictions. Therefore, we proposeReasoning for Hierarchical Classification (RHC), a novel framework thatreformulates HTC as a step-by-step reasoning task to sequentially deducehierarchical labels. RHC trains large language models (LLMs) in two stages: acold-start stage that aligns outputs with chain-of-thought (CoT) reasoningformat and a reinforcement learning (RL) stage to enhance multi-step reasoningability. RHC demonstrates four advantages in our experiments. (1)Effectiveness: RHC surpasses previous baselines and outperforms the supervisedfine-tuning counterparts by approximately 3% in accuracy and macro F1. (2)Explainability: RHC produces natural-language justifications before predictionto facilitate human inspection. (3) Scalability: RHC scales favorably withmodel size with larger gains compared to standard fine-tuning. (4)Applicability: Beyond patents, we further demonstrate that RHC achievesstate-of-the-art performance on other widely used HTC benchmarks, whichhighlights its broad applicability.