Abstract
We present a deep reinforcement learning-based artificial intelligence agentthat could provide optimized development plans given a basic description of thereservoir and rock/fluid properties with minimal computational cost. Thisartificial intelligence agent, comprising of a convolutional neural network,provides a mapping from a given state of the reservoir model, constraints, andeconomic condition to the optimal decision (drill/do not drill and welllocation) to be taken in the next stage of the defined sequential fielddevelopment planning process. The state of the reservoir model is defined usingparameters that appear in the governing equations of the two-phase flow. Afeedback loop training process referred to as deep reinforcement learning isused to train an artificial intelligence agent with such a capability. Thetraining entails millions of flow simulations with varying reservoir modeldescriptions (structural, rock and fluid properties), operational constraints,and economic conditions. The parameters that define the reservoir model,operational constraints, and economic conditions are randomly sampled from adefined range of applicability. Several algorithmic treatments are introducedto enhance the training of the artificial intelligence agent. After appropriatetraining, the artificial intelligence agent provides an optimized fielddevelopment plan instantly for new scenarios within the defined range ofapplicability. This approach has advantages over traditional optimizationalgorithms (e.g., particle swarm optimization, genetic algorithm) that aregenerally used to find a solution for a specific field development scenario andtypically not generalizable to different scenarios.