US 12,223,620 B2
Systems, methods, and media for eulerian single-photon computer vision
Mohit Gupta, Middleton, WI (US); and Shantanu Gupta, Madison, WI (US)
Assigned to WISCONSIN ALUMNI RESEARCH FOUNDATION, Madison, WI (US)
Filed by Wisconsin Alumni Research Foundation, Madison, WI (US)
Filed on May 1, 2023, as Appl. No. 18/310,399.
Prior Publication US 2024/0370974 A1, Nov. 7, 2024
Int. Cl. G06T 5/20 (2006.01); G06T 5/70 (2024.01); G06T 7/13 (2017.01); G06T 7/246 (2017.01); H04N 25/76 (2023.01)
CPC G06T 5/20 (2013.01) [G06T 5/70 (2024.01); G06T 7/13 (2017.01); G06T 7/248 (2017.01); H04N 25/76 (2023.01); G06T 2207/10016 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A system for facilitating single-photon computer vision tasks, comprising:
an image sensor comprising a plurality of detectors configured to detect arrival of individual photons, the plurality of detectors arranged in an array;
at least one processor that is programmed to:
cause the image sensor to generate a sequence of images representing a scene, each of the images comprising a plurality of pixels;
perform, for each of a plurality of three dimensional filters, a convolution between the three dimensional filter and a plurality of frames,
wherein each of the plurality of frames is based on one or more of the images of the sequence of images;
generate, for each of the plurality of frames, a plurality of filter bank responses each corresponding to a three dimensional filter of the plurality of three dimensional filters; and
perform a computer vision process based on the plurality of filter responses.