US 12,450,910 B2
Method and system for process monitoring
Yang Chen, Westlake Village, CA (US); Deepak Khosla, Camarillo, CA (US); Brandon Michael Courter, Indianapolis, IN (US); Shane Edward Arthur, Kirkland, WA (US); Jeremy Daniel Howe, Everett, WA (US); and Anders Eirik Heussy, Seattle, WA (US)
Assigned to The Boeing Company, Arlington, VA (US)
Filed by The Boeing Company, Arlington, VA (US)
Filed on Jun. 13, 2023, as Appl. No. 18/334,012.
Prior Publication US 2024/0420471 A1, Dec. 19, 2024
Int. Cl. G06V 20/52 (2022.01); G06T 7/20 (2017.01); G06V 10/25 (2022.01); G06V 20/40 (2022.01)
CPC G06V 20/52 (2022.01) [G06T 7/20 (2013.01); G06V 10/25 (2022.01); G06V 20/44 (2022.01); G06V 2201/07 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method of monitoring an assembly process, the method comprising:
generating an event model for each of a plurality of objects by:
receiving at least one training image sequence having a plurality of occurrences of the assembly process illustrating each of the plurality of objects,
identifying a presence of each of the plurality of objects in the at least one training image sequence, and
generating the event model corresponding to each of the plurality of objects based on a statistical prediction for when the object should appear in the training image sequence;
obtaining the event model for each of the plurality of objects in the assembly process, wherein the event model for each of the plurality of objects includes a predetermined time frame for a change in presence to occur;
collecting an image sequence of the assembly process for monitoring;
identifying if a change in presence for each of the plurality of objects occurred with a detector model;
reviewing the event model for each of the plurality of objects to determine if the predetermined time frame lapsed without the change in presence of a corresponding one of the plurality of objects being identified; and
issuing an alert if the predetermined time frame lapsed without the presence of the corresponding one of the plurality of objects being identified.