Abstract
PaECTER is an open-source document-level encoder specific for patents. Wefine-tune BERT for Patents with examiner-added citation information to generatenumerical representations for patent documents. PaECTER performs better insimilarity tasks than current state-of-the-art models used in the patentdomain. More specifically, our model outperforms the patent specificpre-trained language model (BERT for Patents) and general-purpose textembedding models (e.g., E5, GTE, and BGE) on our patent citation predictiontest dataset on different rank evaluation metrics. PaECTER predicts at leastone most similar patent at a rank of 1.32 on average when compared against 25irrelevant patents. Numerical representations generated by PaECTER from patenttext can be used for downstream tasks such as classification, tracing knowledgeflows, or semantic similarity search. Semantic similarity search is especiallyrelevant in the context of prior art search for both inventors and patentexaminers.