US 11,951,357 B1
Platform for visual tracking of user fitness
Karina Levitian, Austin, TX (US); Sunil Ramesh, Cupertino, CA (US); Michael Cutter, Golden, CO (US); and Preethi Parasseri Narayanan, Cupertino, CA (US)
Assigned to Roku, Inc., San Jose, CA (US)
Filed by Roku, Inc., San Jose, CA (US)
Filed on Nov. 30, 2022, as Appl. No. 18/071,870.
Int. Cl. A63B 24/00 (2006.01); A63B 71/06 (2006.01); G06T 7/292 (2017.01); G06T 13/40 (2011.01); G06T 13/80 (2011.01)
CPC A63B 24/0075 (2013.01) [A63B 71/0622 (2013.01); G06T 7/292 (2017.01); G06T 13/40 (2013.01); G06T 13/80 (2013.01); A63B 2024/0068 (2013.01); A63B 2024/0096 (2013.01); A63B 2071/0625 (2013.01); A63B 2071/0647 (2013.01); A63B 2220/05 (2013.01); A63B 2220/17 (2013.01); A63B 2220/40 (2013.01); A63B 2220/806 (2013.01); A63B 2220/836 (2013.01); A63B 2225/20 (2013.01); A63B 2225/74 (2020.08); A63B 2230/06 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/30196 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A computing system comprising a processor and a non-transitory computer-readable medium having stored thereon program instructions that upon execution by the processor causes performance of a set of acts comprising:
receiving, from one or more cameras in a viewing environment of a content-presentation device, video of a user performing a fitness exercise in the viewing environment;
using the received video and a skeletal detection model to estimate skeletal movement of the user;
generating a synthetic video representing the user moving according to the estimated skeletal movement;
based on a comparison of the estimated skeletal movement with predefined reference skeletal movement representing desired skeletal movement for the fitness exercise, and while the user is performing the fitness exercise, continually calculating a metric representing a difference between the estimated skeletal movement and the reference skeletal movement;
causing the content-presentation device to concurrently display the generated synthetic video, a reference video representing the reference skeletal movement, and an indication of the metric;
determining, by the computing system, an occurrence in which the calculated metric falls below a predefined threshold of the computing system; and
responsive to determining, by the computing system, the occurrence in which the calculated metric falls below the predefined threshold of the computing system, the computing system responsively causing a decrease of an audio volume level associated with the received video, thereby decreasing a volume level of audio being output via at least one sound speaker associated with the computing system.