US 12,283,136 B2
Digital twin generation and logging for a vehicle
Michael J. Browne, Untersiggenthal (CH); Andre Lutz, Erzhausen (DE); Hilna Sahle, Darmstadt (DE); Andreas Godehart, Dreieichenhain (DE); and Mirza Maznikar, Shtip (MK)
Assigned to The Boeing Company, Chicago, IL (US)
Filed by THE BOEING COMPANY, Chicago, IL (US)
Filed on Nov. 16, 2021, as Appl. No. 17/527,824.
Prior Publication US 2023/0154240 A1, May 18, 2023
Int. Cl. G07C 5/00 (2006.01); G06F 30/15 (2020.01); G06K 9/00 (2022.01); G06N 20/00 (2019.01); G06V 20/59 (2022.01); G07C 5/08 (2006.01)
CPC G07C 5/006 (2013.01) [G06F 30/15 (2020.01); G06N 20/00 (2019.01); G06V 20/59 (2022.01); G07C 5/008 (2013.01); G07C 5/085 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method, comprising:
receiving a model of an interior of a vehicle, the model defining locations of components in the interior of the vehicle and component identifiers;
capturing images of the interior of a vehicle using one or more cameras;
identifying components in the images using a machine learning (ML) model;
mapping the components identified by the ML model to the components in the model to generate a digital twin of the vehicle, wherein the digital twin correlates the components identified by the ML model to the component identifiers from the model;
receiving, from a wirelessly-connected user device, an image of the interior of the vehicle depicting a first component needing maintenance;
receiving, from the user device, information describing a location of the user device in the interior of the vehicle;
mapping, based on the location of the user device, the first component needing maintenance to a component identifier derived from the digital twin;
displaying, on the user device, a GUI asking the user device to confirm the first component needing maintenance depicted in the image; and
dispatching maintenance to fix the first component needing maintenance using the component identifier.