US 11,961,601 B1
Adaptive user interface for determining errors in performance of activities
Imry Kissos, Redmond, WA (US); Joel Wilson Brown, Seattle, WA (US); Ilia Vitsnudel, Even Yehuda (IL); Omer Meir, Seattle, WA (US); Lior Fritz, Seattle, WA (US); Matan Goldman, Redmond, WA (US); and Eduard Oks, Redmond, WA (US)
Assigned to AMAZON TECHNOLOGIES, INC., Seattle, WA (US)
Filed by AMAZON TECHNOLOGIES, INC., Seattle, WA (US)
Filed on Jul. 2, 2020, as Appl. No. 16/919,870.
Int. Cl. G16H 20/30 (2018.01); A63B 24/00 (2006.01); A63B 71/06 (2006.01); G06T 19/20 (2011.01); G06V 20/40 (2022.01); G06V 40/20 (2022.01); G09B 19/00 (2006.01)
CPC G16H 20/30 (2018.01) [A63B 24/0006 (2013.01); A63B 71/0622 (2013.01); G06T 19/20 (2013.01); G06V 20/40 (2022.01); G06V 40/23 (2022.01); G09B 19/003 (2013.01); A63B 2024/0009 (2013.01); A63B 2024/0068 (2013.01); A63B 2024/0096 (2013.01); A63B 2071/0647 (2013.01); A63B 2220/806 (2013.01); A63B 2220/833 (2013.01); A63B 2220/836 (2013.01); G06T 2200/24 (2013.01); G06T 2219/2016 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system comprising:
an output device;
one or more memories storing computer-executable instructions; and
one or more hardware processors to execute the computer-executable instructions to:
acquire first video data representing a user performing an activity;
determine a first pose of the user based on the first video data;
generate an avatar representing the first pose of the user;
access activity data that indicates a second pose and a third pose, wherein the second pose and the third pose are indicative of correct performance of the activity;
determine a first difference between the first pose and the second pose;
determine, based on the activity data, that the first difference is associated with presentation of output during performance of the activity;
determine, based on the activity data, a first instruction associated with the first difference;
determine a first portion of the avatar associated with the first difference;
present, using the output device, first output that includes the first portion of the avatar at a first time during performance of the activity and excludes a second portion of the avatar, wherein the activity data associates the first difference with the first time;
present, using the output device, the first instruction at the first time;
acquire second video data representing the user performing the activity;
determine a fourth pose of the user based on the second video data;
determine a second difference between the third pose and the fourth pose;
determine, based on the activity data, that the second difference is associated with presentation of output after cessation of the activity;
determine, based on the activity data, a second instruction associated with the second difference;
determine a third portion of the avatar associated with the second difference;
determine cessation of the activity;
present, using the output device, second output that includes the third portion of the avatar at a second time subsequent to the cessation of the activity and excludes a fourth portion of the avatar, wherein the activity data associates the second difference with the second time; and
present, using the output device, the second instruction at the second time.