US 11,677,688 B2
Augmented reality for internet connectivity installation
Samuel Didear, Portland, OR (US); Koji Kanao, Brooklyn, NY (US); Robert J. Pera, Seattle, WA (US); Heqing Huang, Brooklyn, NY (US); and Michael Anderson, Glenview, IL (US)
Assigned to Ubiquiti Inc., New York, NY (US)
Filed by Ubiquiti Inc., New York, NY (US)
Filed on Sep. 11, 2020, as Appl. No. 17/19,184.
Claims priority of provisional application 62/900,403, filed on Sep. 13, 2019.
Prior Publication US 2021/0083992 A1, Mar. 18, 2021
Int. Cl. H04L 49/00 (2022.01); G06K 19/06 (2006.01); G06T 19/00 (2011.01); H04L 12/46 (2006.01); G06V 20/20 (2022.01); H04L 43/0811 (2022.01); H04L 67/75 (2022.01); H04L 45/64 (2022.01); H04L 45/02 (2022.01); G06T 15/00 (2011.01)
CPC H04L 49/70 (2013.01) [G06K 19/06028 (2013.01); G06T 15/005 (2013.01); G06T 19/006 (2013.01); G06V 20/20 (2022.01); H04L 12/4641 (2013.01); H04L 43/0811 (2013.01); H04L 45/02 (2013.01); H04L 45/64 (2013.01); H04L 67/75 (2022.05)] 23 Claims
OG exemplary drawing
 
1. A method of displaying a network device with augmented reality using a mobile device, the method comprising:
receiving an identifying code from the network device by the mobile device;
displaying captured camera images of the network device on a display of the mobile device, the images including a plurality of ports of the network device;
retrieving information associated with a connectivity state of each of the plurality of ports using the identifying code, wherein the retrieved information includes a database of identities of devices coupled to each of the plurality of ports and a library of virtual objects corresponding to the coupled devices;
determining, based on the retrieved database, identities of the devices coupled to each of the plurality of ports;
determining a spatial relationship of the mobile device with respect to the one or more ports using the identifying code;
overlaying one or more virtual ports over the network device on the images, wherein the virtual ports include information about the connectivity state of the network device in the one or more virtual ports; and
displaying icons of the coupled devices adjacent to the virtual ports, wherein the icons are displayed based on the determined identities of the devices coupled to each of the plurality of ports.