Abstract
Generative AI, especially through large language models (LLMs), istransforming how technical knowledge can be accessed, reused, and extended.PETSc, a widely used numerical library for high-performance scientificcomputing, has accumulated a rich but fragmented knowledge base over its threedecades of development, spanning source code, documentation, mailing lists,GitLab issues, Discord conversations, technical papers, and more. Much of thisknowledge remains informal and inaccessible to users and new developers. Toactivate and utilize this knowledge base more effectively, the PETSc team hasbegun building an LLM-powered system that combines PETSc content with customLLM tools -- including retrieval-augmented generation (RAG), rerankingalgorithms, and chatbots -- to assist users, support developers, and proposeupdates to formal documentation. This paper presents initial experiencesdesigning and evaluating these tools, focusing on system architecture, usingRAG and reranking for PETSc-specific information, evaluation methodologies forvarious LLMs and embedding models, and user interface design. Leveraging theArgonne Leadership Computing Facility resources, we analyze how LLM responsescan enhance the development and use of numerical software, with an initialfocus on scalable Krylov solvers. Our goal is to establish an extensibleframework for knowledge-centered AI in scientific software, enabling scalablesupport, enriched documentation, and enhanced workflows for research anddevelopment. We conclude by outlining directions for expanding this system intoa robust, evolving platform that advances software ecosystems to acceleratescientific discovery.