Abstract
This paper introduces a vision of confidential prompting: securing userprompts from untrusted, cloud-hosted large language model (LLM) provider whilepreserving model confidentiality, output invariance, and compute efficiency. Asa first step toward this vision, we present Obfuscated Secure PartitionedDecoding (OSPD), a system built on two key innovations. First, SecurePartitioned Decoding (SPD) isolates user prompts within per-user processesresiding in a confidential virtual machine (CVM) on the cloud, which areinaccessible for the cloud LLM while allowing it to generate tokensefficiently. Second, Prompt Obfuscation (PO) introduces a novel cryptographictechnique that enhances SPD resilience against advanced prompt reconstructionattacks. Together, these innovations ensure OSPD protects both prompt and modelconfidentiality while maintaining service functionality. OSPD enablespractical, privacy-preserving cloud-hosted LLM inference for sensitiveapplications, such as processing personal data, clinical records, and financialdocuments.