US 11,922,580 B2
Floorplan generation based on room scanning
Feng Tang, Cupertino, CA (US); Afshin Dehghan, Sunnyvale, CA (US); Kai Kang, San Jose, CA (US); Yang Yang, Sunnyvale, CA (US); Yikang Liao, Sunnyvale, CA (US); and Guangyu Zhao, Bejing (CN)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jan. 12, 2021, as Appl. No. 17/146,604.
Claims priority of provisional application 62/962,485, filed on Jan. 17, 2020.
Prior Publication US 2021/0225081 A1, Jul. 22, 2021
Int. Cl. G06T 19/00 (2011.01); G06F 18/21 (2023.01); G06F 18/214 (2023.01); G06F 18/24 (2023.01); G06N 3/045 (2023.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); G06T 11/00 (2006.01); G06T 15/20 (2011.01); G06T 19/20 (2011.01); G06V 10/22 (2022.01); G06V 20/00 (2022.01); G06V 20/10 (2022.01); G06V 20/64 (2022.01); G06V 30/262 (2022.01); H04N 7/18 (2006.01)
CPC G06T 19/00 (2013.01) [G06F 18/21 (2023.01); G06F 18/2148 (2023.01); G06F 18/217 (2023.01); G06F 18/24 (2023.01); G06N 3/045 (2023.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); G06T 11/00 (2013.01); G06T 15/205 (2013.01); G06T 19/003 (2013.01); G06T 19/20 (2013.01); G06V 10/22 (2022.01); G06V 20/10 (2022.01); G06V 20/36 (2022.01); G06V 20/64 (2022.01); G06V 30/274 (2022.01); H04N 7/183 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2210/04 (2013.01); G06T 2210/12 (2013.01); G06T 2210/56 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at an electronic device having a processor:
obtaining a three-dimensional (3D) representation of a physical environment that was generated based on depth data and light intensity image data;
determining 3D positions of wall structures based on the 3D representation;
determining 3D positions of 3D bounding boxes corresponding to objects in the physical environment;
generating a floorplan based on:
the 3D positions of the wall structures; and
the 3D positions of the 3D bounding boxes corresponding to the objects; and
providing the floorplan for display.