US 11,715,265 B2
Floorplan generation based on room scanning
Feng Tang, Cupertino, CA (US); Afshin Dehghan, Sunnyvale, CA (US); Kai Kang, San Jose, CA (US); Yang Yang, Sunnyvale, CA (US); Yikang Liao, Sunnyvale, CA (US); and Guangyu Zhao, Bejing (CN)
Assigned to Apple Inc., Cupertino, CA (US)
Filed by Apple Inc., Cupertino, CA (US)
Filed on Jan. 14, 2021, as Appl. No. 17/148,682.
Claims priority of provisional application 62/962,485, filed on Jan. 17, 2020.
Prior Publication US 2021/0225090 A1, Jul. 22, 2021
Int. Cl. G06T 7/00 (2017.01); G06T 19/00 (2011.01); G06T 7/73 (2017.01); G06T 7/50 (2017.01); G06T 11/00 (2006.01); H04N 7/18 (2006.01); G06T 15/20 (2011.01); G06T 19/20 (2011.01); G06V 10/22 (2022.01); G06V 20/10 (2022.01); G06V 20/00 (2022.01); G06V 30/262 (2022.01); G06F 18/21 (2023.01); G06F 18/24 (2023.01); G06F 18/214 (2023.01); G06N 3/045 (2023.01); G06V 20/64 (2022.01)
CPC G06T 19/00 (2013.01) [G06F 18/21 (2023.01); G06F 18/217 (2023.01); G06F 18/2148 (2023.01); G06F 18/24 (2023.01); G06N 3/045 (2023.01); G06T 7/50 (2017.01); G06T 7/73 (2017.01); G06T 11/00 (2013.01); G06T 15/205 (2013.01); G06T 19/003 (2013.01); G06T 19/20 (2013.01); G06V 10/22 (2022.01); G06V 20/10 (2022.01); G06V 20/36 (2022.01); G06V 20/64 (2022.01); G06V 30/274 (2022.01); H04N 7/183 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01); G06T 2210/04 (2013.01); G06T 2210/12 (2013.01); G06T 2210/56 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
at an electronic device having a processor:
obtaining three-dimensional (3D) semantic data of a physical environment that was generated based on depth data and light intensity image data obtained during a scanning process;
encoding the 3D semantic data into 3D semantic layers;
segmenting the 3D semantic data to separate the 3D semantic layers to provide two-dimensional (2D) semantic representations representing each of multiple horizontal layers of the physical environment; and
providing a floorplan based on generating an edge map using the 2D semantic representations, the floorplan providing a view of the physical environment.