US 11,943,519 B2
Information processing device, information processing method, and program
Kazuyuki Arimatsu, Tokyo (JP); and Hideki Mori, Tokyo (JP)
Assigned to SONY INTERACTIVE ENTERTAINMENT INC., Tokyo (JP)
Appl. No. 17/617,728
Filed by SONY INTERACTIVE ENTERTAINMENT INC., Tokyo (JP)
PCT Filed Jul. 1, 2019, PCT No. PCT/JP2019/026183
§ 371(c)(1), (2) Date Dec. 9, 2021,
PCT Pub. No. WO2021/001911, PCT Pub. Date Jan. 7, 2021.
Prior Publication US 2022/0294935 A1, Sep. 15, 2022
Int. Cl. H04N 23/50 (2023.01); G06F 3/044 (2006.01)
CPC H04N 23/50 (2023.01) [G06F 3/044 (2013.01)] 6 Claims
OG exemplary drawing
 
1. An information processing device coupled to a device that is operated by a user with a hand of the user and on a surface of which a plurality of sensors that each output information associated with a spatial positional relation with a surface of the hand of the user are arranged, the information processing device comprising:
processing circuitry configured to
receive the output from each of the sensors included in the device;
generate an image in which an image element having been drawn with a pixel value determined on a basis of a value represented by the output from each of the sensors is arranged at a position corresponding to a position at which each of the sensors is arranged, on a mapping space obtained by plane-unfolding at least a portion that constitutes the surface of the device and on which the sensors are arranged; and
upon receipt of input of the generated image, estimate information associated with a position of each of joints of the hand of the user who operates the device and that outputs the estimated information as coordinate information in a three-dimensional space whose origin is placed on a point that moves with the device,
wherein the processing circuitry for estimating the information associated with a position of each of the joints is further configured to use a result of machine learning that, in a same space as a space of the input image, estimates a position closest to each of the joints of the hand of the user who operates the device and a distance from the position to each of the joints.