US 12,029,971 B2
Hybrid pixel dynamic vision sensor tracking using IR and ambient light (or depth sensor)
Xiaoyong Ye, South San Francisco, CA (US); and Yuichiro Nakamura, Redwood City, CA (US)
Assigned to SONY INTERACTIVE ENTERTAINMENT LLC, San Mateo, CA (US)
Filed by Sony Interactive Entertainment Inc., Tokyo (JP)
Filed on Jun. 10, 2022, as Appl. No. 17/837,945.
Prior Publication US 2023/0398433 A1, Dec. 14, 2023
Int. Cl. A63F 13/211 (2014.01); A63F 13/213 (2014.01); G06F 3/03 (2006.01)
CPC A63F 13/213 (2014.09) [G06F 3/0325 (2013.01); A63F 13/211 (2014.09); A63F 2300/105 (2013.01); A63F 2300/1087 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A tracking system, comprising
a processor;
a dynamic vision sensor (DVS) operably coupled to the processor, the DVS having an array of light-sensitive elements in a known configuration, wherein the dynamic vision sensor is configured to output signals corresponding to two or more events at two or more corresponding light-sensitive elements in the array in response to changes in light output from two or more light sources in a known configuration with respect to each other and with respect to a controller body, wherein the output signals include information corresponding to times of the two or more events and locations of the two or more corresponding light-sensitive elements in the array; and
one or more filters configured to selectively transmit one or more wavelength or one or more polarization of light from the two or more light sources to one or more of the light-sensitive elements in the array and to selectively block one or more other wavelength or one or more other polarization of light from reaching one or more of the light-sensitive elements in the array, wherein the one or more filters are further configured to selectively block the one or more wavelength or one or more polarization of light from the two or more light sources from reaching one or more of the light-sensitive elements in the array and to selectively transmit the one or more other wavelength or one or more other polarization light to one or more of the light-sensitive elements in the array,
wherein the processor is configured to determine a position and orientation of the controller from the times of the two or more events, the locations of the two or more corresponding light-sensitive elements in the array, the known configuration of the two or more light sources with respect to each other and with respect to the controller body,
wherein the processor is further configured to determine a position and orientation of one or more objects from signals generated by two or more light-sensitive elements resulting from the one or more other wavelength or one or more other polarization of light reaching the two or more light-sensitive elements.