US 11,961,292 B2
Computer-implemented method for assisting a user in interacting with an electronic relay for electric power distribution grids
Stefano Carrara, Cene (IT); Roberto Conca, Dalmine (IT); and Davide Personeni, Treviolo (IT)
Assigned to ABB S.p.A., Milan (IT)
Filed by ABB S.p.A., Milan (IT)
Filed on Jan. 21, 2022, as Appl. No. 17/580,915.
Claims priority of application No. 21152722 (EP), filed on Jan. 21, 2021.
Prior Publication US 2022/0230433 A1, Jul. 21, 2022
Int. Cl. G06T 11/00 (2006.01); G06V 10/74 (2022.01); G06V 20/20 (2022.01); G08B 5/36 (2006.01); G09B 19/00 (2006.01); H02J 3/00 (2006.01); H04N 23/60 (2023.01); H04N 23/63 (2023.01)
CPC G06V 20/20 (2022.01) [G06T 11/00 (2013.01); G06V 10/74 (2022.01); G08B 5/36 (2013.01); G09B 19/003 (2013.01); H02J 3/00 (2013.01); H04N 23/63 (2023.01); H04N 23/635 (2023.01); H04N 23/64 (2023.01)] 11 Claims
OG exemplary drawing
 
1. A method for assisting a user in interacting with an electronic relay for electric power distribution grids, said electronic relay having a user-interface panel including one or more user-interface components configured to allow the user to interact with said electronic relay, wherein said method comprises:
activating a camera of a mobile computerized device;
showing images of said user-interface panel on a display of said mobile computerized device, said images being captured by said camera while the user frames said user-interface panel using said mobile computerized device;
processing said images to identify said user-interface components and physical features of said user-interface panel, the identification of said user-interface components and the physical features including a comparison of said images with predefined models of user-interface panels;
based on the identification of said user-interface components and the physical features, showing first augmented reality features on said display, said first augmented reality features being configured to assist the user in framing said user-interface panel using said mobile computerized device, said first augmented reality features being shown superimposed to said images on said display;
based on the identification of the user-interface components and the physical features of the user-interface panel, sampling one or more image portions of said user-interface panel captured during an observation time interval, in which the user frames said user-interface panel using said mobile computerized device;
processing the sampled image portions of said user-interface panel to identify one or more light signals emitted by one or more of said user-interface components of said user-interface panel, the identification of said light signals including a detection of sequences of light pulses emitted by said user-interface components and a comparison of the detected sequences of light pulses with predefined sequences of light pulses that can be emitted by said user-interface components; and
based on the identification of said light signals, showing on said display, first information describing the identified light signals emitted by said user-interface components.