US 12,012,826 B2
Field development planning based on deep reinforcement learning
Vishakh Hegde, Menlo Park, CA (US); and Joseph Matthew Chalupsky, Abingdon (GB)
Assigned to SCHLUMBERGER TECHNOLOGY CORPORATION, Sugar Land, TX (US)
Appl. No. 17/596,302
Filed by Schlumberger Technology Corporation, Sugar Land, TX (US)
PCT Filed Jun. 21, 2019, PCT No. PCT/US2019/038489
§ 371(c)(1), (2) Date Dec. 7, 2021,
PCT Pub. No. WO2020/256738, PCT Pub. Date Dec. 24, 2020.
Prior Publication US 2022/0220828 A1, Jul. 14, 2022
Int. Cl. G06Q 10/0631 (2023.01); E21B 41/00 (2006.01); G06Q 10/04 (2023.01); G06Q 50/08 (2012.01)
CPC E21B 41/00 (2013.01) [G06Q 10/04 (2013.01); G06Q 10/0631 (2013.01); G06Q 10/06313 (2013.01); G06Q 50/08 (2013.01); E21B 2200/20 (2020.05)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
determining a field development action associated with field development planning for an oilfield, wherein the field development action is associated with selecting a position for a wellbore of the oilfield, and wherein determining the field development action is based on a field development policy for the oilfield;
predicting an oil and gas recovery of the oilfield based on simulating the field development action for the oilfield at an initial state of the oilfield;
generating a simulated experience record that includes the predicted oil and gas recovery, the field development action, the initial state of the oilfield, and a simulated resulting state;
storing the simulated experience record in an experience buffer, wherein the experience buffer stores a plurality of previously generated experience records;
generating an updated field development policy by providing the simulated experience record and the plurality of previously generated experience records stored in the experience buffer to a policy gradient neural network configured to process field development actions and associated oil and gas recoveries to determine field development policy updates;
selecting an updated field development action associated with the field development planning for the oilfield based on the updated field development policy; and
displaying information representing the updated field development action.