US 12,067,806 B2
System for correcting user movement
Eduard Oks, Redmond, WA (US); Ridge Carpenter, Seattle, WA (US); Lamarr Smith, Seattle, WA (US); Claire McGowan, Seattle, WA (US); Elizabeth Reisman, Seattle, WA (US); Ianir Ideses, Raanana (IL); Eli Alshan, Kfar-Saba (IL); Mark Kliger, Modi'in-Maccabim-Re'ut (IL); Matan Goldman, Redmond, WA (US); Liza Potikha, Tel Aviv (IL); Ido Yerushalmy, Tel-Aviv (IL); Dotan Kaufman, Netanya (IL); Guy Adam, Tel Aviv (IL); Omer Meir, Redmond, WA (US); Lior Fritz, Seattle, WA (US); Imry Kissos, Redmond, WA (US); Georgy Melamed, Ramat Gan (IL); Eran Borenstein, Zichron Yaakov (IL); Sharon Alpert, Rehovot (IL); and Noam Sorek, Zichron Yaakov (IL)
Assigned to AMAZON TECHNOLOGIES, INC., Seattle, WA (US)
Filed by AMAZON TECHNOLOGIES, INC., Seattle, WA (US)
Filed on Feb. 16, 2021, as Appl. No. 17/176,479.
Prior Publication US 2022/0261574 A1, Aug. 18, 2022
Int. Cl. G06K 9/00 (2022.01); G06N 20/00 (2019.01); G06T 7/70 (2017.01); G06V 40/20 (2022.01)
CPC G06V 40/23 (2022.01) [G06N 20/00 (2019.01); G06T 7/70 (2017.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
one or more memories storing computer-executable instructions; and
one or more hardware processors to execute the computer-executable instructions to:
cause a user device to present instructions to perform a plurality of movements;
acquire, using a camera of the user device, video data that represents a user within a field of view of the camera performing the plurality of movements;
determine pose data based on the video data, wherein the pose data is indicative of one or more positions of the user during performance of the plurality of movements;
determine correspondence between the pose data and movement data, wherein the movement data associates poses of users with errors in movement of the users;
determine, based on the correspondence between the pose data and the movement data, one or more errors associated with the pose data;
determine correspondence between the one or more errors and score data, wherein the score data associates errors with score values;
determine, based on the correspondence between the one or more errors and the score data, one or more score values associated with the pose data;
determine, based on the one or more score values, at least one score indicative of a characteristic of movement of the user;
determine correspondence between the one or more errors and activity data, wherein the activity data associates errors with activities to improve movements;
determine, based on the correspondence between the one or more errors and the activity data, at least one activity to improve the characteristic of movement of the user; and
cause the user device to present an output indicative of the at least one score and the at least one activity.