US 12,087,093 B2
Electronic device and a related method for detecting and counting an action
Sangxia Huang, Lund (SE); and David Strömbäck, Lund (SE)
Assigned to SONY GROUP CORPORATION, Tokyo (JP)
Filed by Sony Group Corporation, Tokyo (JP)
Filed on Jun. 16, 2021, as Appl. No. 17/349,853.
Claims priority of application No. 2050907-1 (SE), filed on Jul. 17, 2020.
Prior Publication US 2022/0019778 A1, Jan. 20, 2022
Int. Cl. G06V 40/20 (2022.01); A63B 24/00 (2006.01); G06F 18/21 (2023.01); G06F 18/24 (2023.01); G06N 20/00 (2019.01)
CPC G06V 40/20 (2022.01) [A63B 24/0062 (2013.01); G06F 18/21 (2023.01); G06F 18/24 (2023.01); G06N 20/00 (2019.01); A63B 2220/05 (2013.01); A63B 2220/17 (2013.01)] 22 Claims
OG exemplary drawing
 
15. A method, performed by an electronic device, for counting an action, wherein the action comprises one or more sub-actions, the method comprising:
obtaining sensor data;
generating, based on the sensor data, a set of features associated with a frame,
determining, based on the set, using an action detection model, whether the frame corresponds to a sub-action, wherein determinations for a number of consecutive frames above a threshold number of consecutive frames as corresponding to the sub-action are performed before determining whether the frame corresponds to the sub-action, wherein the action detection model is based on a machine-learning scheme,
applying a nondeterministic finite automaton, NFA, scheme to the determined sub-action for the frame, wherein the NFA scheme has a set of states associated with corresponding sub-actions and is configured to output one or more action classes;
performing, using the NFA scheme, a state transition from a state associated with the sub-action to another state associated with another sub-action;
determining, using the NFA scheme, an action class;
detecting the action based on the action class; and
incrementing an action counter based on the detected action.