US 12,219,120 B1
Smart sensor and its system for autonomous system
Achyut Kumar Dutta, Sunnyvale, CA (US)
Assigned to Banpil Photonics, Inc., Santa Clara, CA (US)
Filed by Achyut Kumar Dutta, Sunnyvale, CA (US)
Filed on Jul. 9, 2022, as Appl. No. 17/861,203.
Application 17/861,203 is a continuation of application No. 17/079,469, filed on Oct. 24, 2020, granted, now 11,412,203.
Application 17/861,203 is a continuation of application No. 15/814,271, filed on Nov. 15, 2017, granted, now 10,841,563.
Claims priority of provisional application 62/579,518, filed on Oct. 31, 2017.
Claims priority of provisional application 62/572,547, filed on Oct. 15, 2017.
Int. Cl. H04N 13/254 (2018.01); H04N 13/204 (2018.01); H04N 13/271 (2018.01); B25J 9/16 (2006.01); G05D 1/00 (2006.01)
CPC H04N 13/254 (2018.05) [H04N 13/204 (2018.05); H04N 13/271 (2018.05); B25J 9/163 (2013.01); B25J 9/1697 (2013.01); G05D 1/0088 (2013.01); H04N 2213/001 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A sensor comprising:
a stack of at least partially overlapping two or more substrates comprising:
at least one photodetector on each substrate, wherein each photodetector is configured to detect a same or different types of radiation, with at least one photodetector optimized for visible light on an one substrate, and at least one photodetector on a different substrate optimized for non-visible radiation selected from the group consisting of infrared or ultraviolet wavelengths, enabling multi-modal sensing across the at least partially overlapping two or more substrates;
wherein the photodetectors on the at least partially overlapping two or more substrates receives the same and/or different radiation or multiple radiations and provides a signal or multiple signals corresponding to the detected radiation;
wherein each substrate of the at least partially overlapping two or more substrates is in close proximity with at least one substrate of the at least partially overlapping two or more substrates, allowing for real-time or pseudo-real-time multi-wavelength data fusion by integrating the signals from the different photodetector, each specialized for its respective radiation type, to generate a combined multi-modal output for further processing;
wherein each substrate performs independent yet complementary roles in the detection of different radiation types, enabling the system to detect and process a broader range of spectral data, and;
at least one signal processing unit that receives the signal and/or multiple signals and provides a distance of an object and an image information of the object, the distance, a 3-dimentional image information of the object, the 3-dimentional image information and the image information of the object, or any combination thereof.