US 11,989,947 B2
Perception system with attention module for processing visual data
Shuqing Zeng, Sterling Heights, MI (US); Jordan B. Chipka, Commerce Township, MI (US); and Thanura R. Elvitigala, Frisco, TX (US)
Assigned to GM Global Technology Operations LLC, Detroit, MI (US)
Filed by GM GLOBAL TECHNOLOGY OPERATIONS LLC, Detroit, MI (US)
Filed on Jul. 6, 2021, as Appl. No. 17/367,847.
Prior Publication US 2023/0010239 A1, Jan. 12, 2023
Int. Cl. G06V 20/58 (2022.01); B60R 11/04 (2006.01); G06N 3/08 (2023.01); G06T 3/40 (2006.01); G06V 10/25 (2022.01)
CPC G06V 20/58 (2022.01) [B60R 11/04 (2013.01); G06N 3/08 (2013.01); G06T 3/40 (2013.01); G06V 10/25 (2022.01)] 19 Claims
OG exemplary drawing
 
1. A perception system adapted to receive visual data from a camera, the perception system comprising:
a controller having a processor and tangible, non-transitory memory on which instructions are recorded;
a subsampling module, an object detection module and an attention module each selectively executable by the controller;
wherein execution of the instructions by the processor causes the controller to:
sample an input image from the visual data to generate a rescaled whole image frame, via the subsampling module;
extract feature data from the rescaled whole image frame, via the object detection module;
identify a region of interest in the rescaled whole image frame based at least partially on an output of the attention module;
generate a first image based on the rescaled whole image frame and a second image based on the region of interest, the second image having a higher resolution than the first image; and
wherein the region of interest defines a center, the controller being adapted to select the center from an area of potential centers based on the output of the attention module.