US 12,283,003 B2
Remote assistance using augmented reality
Abdulrahman Althobaiti, Thuwal (SA); Fadl Abdellatif, Thuwal (SA); and Sahejad Patel, Thuwal (SA)
Assigned to Saudi Arabian Oil Company, Dhahran (SA)
Filed by Saudi Arabian Oil Company, Dhahran (SA)
Filed on Apr. 6, 2022, as Appl. No. 17/714,704.
Prior Publication US 2023/0326143 A1, Oct. 12, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 19/20 (2011.01); G06V 20/20 (2022.01); G06V 20/64 (2022.01); H04N 21/2187 (2011.01); H04N 21/4788 (2011.01)
CPC G06T 19/006 (2013.01) [G06T 19/003 (2013.01); G06T 19/20 (2013.01); G06V 20/20 (2022.01); G06V 20/64 (2022.01); H04N 21/2187 (2013.01); H04N 21/4788 (2013.01); G06T 2219/024 (2013.01)] 12 Claims
OG exemplary drawing
 
1. A method to be performed by a local device, the method comprising:
receiving a plurality of three-dimensional (3D) models each corresponding to one of a
plurality of assembly parts of a physical object, the plurality of assembly parts present within a field of view of the local device;
displaying, on a display device of the local device, an augmented reality (AR) overlay over a live video, the AR overlay comprising the plurality 3D models;
providing the plurality 3D models to a remote device for display on the remote device;
receiving, from the remote device, instructions for assembling the plurality of assembly parts into the physical object, the instructions comprising a visual indicator describing a step for assembling the physical object; and
modifying, based on the received instructions, the AR overlay displayed on the display device to display the visual indicator for assembling the plurality of assembly parts into the physical object, wherein the visual indicator comprises at least one of: a text, a graphical indicator, or a user-generated drawing.