| CPC A63B 24/0003 (2013.01) [A63B 24/0062 (2013.01); A63B 69/3623 (2013.01); G06T 7/70 (2017.01); G06V 10/82 (2022.01); G06V 40/28 (2022.01); A63B 2102/32 (2015.10); A63B 2220/05 (2013.01); A63B 2220/807 (2013.01); G06T 2207/20084 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30221 (2013.01)] | 8 Claims |
|
1. A method performed in a mobile device for estimating information on a golf swing, the mobile device comprising a camera, a screen, a memory storing an artificial neural network model, and one or more processors, and the method comprising the steps of:
by the one or more processors, acquiring a photographed image of a user's golf swing captured by the camera, and detecting at least one joint of the user from the photographed image using the artificial neural network model;
by the one or more processors, estimating information on the user's golf swing with reference to a position of the at least one detected joint separately for each partial motion constituting the golf swing; and
by the one or more processors, displaying the estimated information on the user's golf swing for each partial motion on the screen of the mobile device,
wherein the artificial neural network model includes a plurality of kernels applied with respect to a depth or point of at least one layer included in convolution layers,
wherein in the estimating step, information on a golf club is estimated with reference to the position of the at least one detected joint, and the information on the user's golf swing is estimated with further reference to the estimated information on the golf club,
wherein in the estimating step, a partial motion to which the photographed image corresponds is determined with reference to the position of the at least one detected joint, and at least one frame corresponding to the determined partial motion is extracted from the photographed image,
wherein storage of the acquired photographed image in the memory is started when a posture of the user estimated with reference to the position of the at least one detected joint satisfies a predetermined storage start condition, and the storage of the acquired photographed image in the memory is ended when a posture of the user estimated with reference to the position of the at least one detected joint satisfies a predetermined storage end condition,
wherein at least one of the storage start condition and the storage end condition is displayed on the screen of the mobile device in the form of guide lines, and
wherein in response to a number of frames corresponding to a specific partial motion being not less than a number of frames necessary in estimating the information on the user's golf swing, other frames than a predetermined number of frames preceding a frame in which a partial motion following the specific partial motion is started, among the frames corresponding to the specific partial motion, are cut out from the stored image in the memory.
|