US 12,307,788 B2
Sensor fusion for autonomous machine applications using machine learning
Minwoo Park, Saratoga, CA (US); Junghyun Kwon, Santa Clara, CA (US); Mehmet K. Kocamaz, San Jose, CA (US); Hae-Jong Seo, Campbell, CA (US); Berta Rodriguez Hervas, San Francisco, CA (US); and Tae Eun Choe, Belmont, CA (US)
Assigned to NVIDIA Corporation, Santa Clara, CA (US)
Filed by NVIDIA Corporation, Santa Clara, CA (US)
Filed on May 1, 2023, as Appl. No. 18/309,878.
Application 18/309,878 is a continuation of application No. 17/353,231, filed on Jun. 21, 2021, granted, now 11,688,181.
Claims priority of provisional application 63/043,794, filed on Jun. 25, 2020.
Claims priority of provisional application 63/047,205, filed on Jul. 1, 2020.
Prior Publication US 2023/0282005 A1, Sep. 7, 2023
Int. Cl. G06T 7/292 (2017.01); B60W 60/00 (2020.01); G06V 20/56 (2022.01); G06V 20/58 (2022.01)
CPC G06V 20/588 (2022.01) [B60W 60/00272 (2020.02); G06T 7/292 (2017.01); G06V 20/58 (2022.01); B60W 2554/4029 (2020.02); B60W 2554/4044 (2020.02); B60W 2556/35 (2020.02); G06T 2207/20081 (2013.01); G06T 2207/20084 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method comprising:
receiving first data representative of a first output, the first data obtained based at least on one or more first neural networks processing first sensor data obtained using one or more first sensors associated with a first field of view or a first sensory field;
receiving second data representative of a second output, the second data obtained based at least on one or more second neural networks processing second sensor data obtained using one or more second sensors associated with a second field of view or a second sensory field;
generating, based at least on one or more third neural networks processing the first data and the second data, third data representative of a fused output associated with the first output and the second output, the fused output associated with at least a portion of the first field of view or first sensory field and at least a portion of the second field of view or second sensory field; and
performing, based at least on the fused output, one or more operations associated with a machine.