US 11,656,759 B2
Semitransparent tactile surface sensor and a method of sensing an interaction with an object using the semitransparent tactile surface sensor
Francois Hogan, St-Jean-sur-Richelieu (CA); Michael Jenkin, Toronto (CA); Gregory Lewis Dudek, Westmount (CA); Yogesh Girdhar, Falmouth, MA (US); Sahand Rezaei-Shoshtari, Montreal (CA); and David Meger, Montreal (CA)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Dec. 31, 2020, as Appl. No. 17/139,642.
Claims priority of provisional application 63/075,534, filed on Sep. 8, 2020.
Claims priority of provisional application 63/037,566, filed on Jun. 10, 2020.
Prior Publication US 2021/0389872 A1, Dec. 16, 2021
Int. Cl. G06F 3/04883 (2022.01); G06N 20/20 (2019.01); G06F 3/041 (2006.01)
CPC G06F 3/04883 (2013.01) [G06F 3/04164 (2019.05); G06N 20/20 (2019.01)] 19 Claims
OG exemplary drawing
 
1. A method of sensing an interaction with an object using a semitransparent tactile surface (STS) sensor including an image sensor and a semitransparent membrane, the method comprising:
capturing, by the image sensor, a stream of images;
separating the stream of images into a visual stream comprising light traveling through the semitransparent membrane and a tactile stream comprising light reflecting off of the semitransparent membrane; and
processing the visual stream and tactile stream through a multimodal deep neural network.