Abstract
In this paper, we describe and benchmark a competitor-discovery componentused within an agentic AI system for fast drug asset due diligence. Acompetitor-discovery AI agent, given an indication, retrieves all drugscomprising the competitive landscape of that indication and extracts canonicalattributes for these drugs. The competitor definition is investor-specific, anddata is paywalled/licensed, fragmented across registries, ontology-mismatchedby indication, alias-heavy for drug names, multimodal, and rapidly changing.Although considered the best tool for this problem, the current LLM-based AIsystems aren't capable of reliably retrieving all competing drug names, andthere is no accepted public benchmark for this task. To address the lack ofevaluation, we use LLM-based agents to transform five years of multi-modal,unstructured diligence memos from a private biotech VC fund into a structuredevaluation corpus mapping indications to competitor drugs with normalizedattributes. We also introduce a competitor validating LLM-as-a-judge agent thatfilters out false positives from the list of predicted competitors to maximizeprecision and suppress hallucinations. On this benchmark, ourcompetitor-discovery agent achieves 83% recall, exceeding OpenAI Deep Research(65%) and Perplexity Labs (60%). The system is deployed in production withenterprise users; in a case study with a biotech VC investment fund, analystturnaround time dropped from 2.5 days to $\sim$3 hours ($\sim$20x) for thecompetitive analysis.