US 12,315,055 B2
Information processing apparatus and information processing method for processing sound of real environment for displaying virtual experience
Tomohiko Gotoh, Tokyo (JP)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Appl. No. 17/925,899
Filed by SONY GROUP CORPORATION, Tokyo (JP)
PCT Filed May 21, 2021, PCT No. PCT/JP2021/019329
§ 371(c)(1), (2) Date Nov. 17, 2022,
PCT Pub. No. WO2021/241431, PCT Pub. Date Dec. 2, 2021.
Claims priority of application No. 2020-093841 (JP), filed on May 29, 2020.
Prior Publication US 2023/0186542 A1, Jun. 15, 2023
Int. Cl. G06T 13/20 (2011.01); G06F 3/16 (2006.01); A63F 13/215 (2014.01); A63F 13/52 (2014.01)
CPC G06T 13/205 (2013.01) [G06F 3/165 (2013.01); A63F 13/215 (2014.09); A63F 13/52 (2014.09)] 17 Claims
OG exemplary drawing
 
1. An information processing apparatus, comprising:
a microphone array configured to detect a sound in a real space around a user,
wherein the microphone array includes at least three microphones having a fixed positional relationship; and
a central processing unit (CPU) configured to:
detect a footstep of the user based on the detected sound;
generate, as environmental information of the real space, ground surface information indicating a material of a ground surface in the real space,
wherein the generation of the ground surface information is based on the detected footstep of the user;
control display of a virtual object in a virtual space,
wherein the virtual space is based on the real space; and
control an operation of the virtual object in the virtual space based on the environmental information.