US 12,254,665 B2
System and method to detect LEDs and their states in an AR context
Fritz Ebner, Pittsford, NY (US); Kevin Summers, Richardson, TX (US); and Ashish Tisgaonkar, Rochester, NY (US)
Assigned to CareAR Holdings LLC, Norwalk, CT (US)
Filed by CareAR Holdings LLC, Norwalk, CT (US)
Filed on May 31, 2022, as Appl. No. 17/804,730.
Prior Publication US 2023/0386170 A1, Nov. 30, 2023
Int. Cl. G06V 10/60 (2022.01); G06V 10/44 (2022.01); G06V 20/20 (2022.01)
CPC G06V 10/60 (2022.01) [G06V 10/443 (2022.01); G06V 20/20 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A system to detect LEDs and their states in an AR context, comprising:
a mobile device having a camera;
the camera configured to take a video of a monitored device having a plurality of LEDs, the video having at least two frames;
a computer in data communication with said mobile device;
the computer configured to receive said video;
the computer configured to process said video to determine a plurality of feature points in each frame;
a database in data communication with said computer;
the database configured to store a plurality of reference images with reference feature points and reference zones;
the computer configured to match at least some of the plurality of feature points with at least some of the plurality of reference feature points to compute a homography matrix;
the computer configured to transform the at least two frames into a transformed image using the homography matrix;
the computer configured to process zones of the transformed image based on the reference zones to determine the state of each of the plurality of LEDs by comparing a value of the image in the zone with a reference value; and
the mobile device configured to display the state of each of the plurality of LEDs.