| CPC A63B 24/0075 (2013.01) [A63B 24/0062 (2013.01); A63B 2024/0078 (2013.01); A63B 2230/62 (2013.01)] | 1 Claim |
|
1. An exercise rehabilitation system using a smart mirror, the exercise rehabilitation system comprising:
a rehabilitation exercise motion information database, in which rehabilitation exercise motion information is pre-stored;
a user rehabilitation progress information database, in which user rehabilitation progress information is cumulatively stored in real time;
a smart mirror device having a display panel that displays rehabilitation exercise coaching information, a touch panel attached to a front surface of the display panel to receive a user's touch input, and a half mirror attached to a front surface of the touch panel to allow the user to view a rehabilitation exercise of the user with naked eyes; and
an artificial intelligence (AI) rehabilitation exercise coaching control module that selects the rehabilitation exercise motion information pre-stored in the rehabilitation exercise motion information database on the basis of the user rehabilitation progress information cumulatively stored in the user rehabilitation progress information database using an AI engine, and controls to display the selected rehabilitation exercise motion information and corresponding rehabilitation exercise coaching information on the display panel of the smart mirror device in real time,
the exercise rehabilitation system further comprising:
a time of flight (TOF)/stereo camera that generates a 3D image by imaging a user present in front of the smart mirror device;
a joint recognition module that recognizes a joint in the 3D image generated by the TOF/stereo camera module;
a shoulder height tracking module that tracks a shoulder height of the user according to movement of the user by using the joint recognized by the joint recognition module;
a hand direction tracking module that tracks a hand direction of the user according to the movement of the user by using the joint recognized by the joint recognition module;
an elbow height tracking module that tracks an elbow height of the user according to the movement of the user by using the joint recognized by the joint recognition module;
an arm angle tracking module that tracks an arm angle of the user according to the movement of the user by using the joint recognized by the joint recognition module;
a knee height tracking module that tracks a knee height of the user according to a knee height of the user by using the joint recognized by the joint recognition module;
a leg angle tracking module that tracks a leg angle of the user according to the knee height of the user by using the joint recognized by the joint recognition module;
a waist height tracking module that tracks a waist height of the user according to the knee height of the user by using the joint recognized by the joint recognition module;
an ankle height tracking module that tracks an ankle height of the user according to the knee height of the user by using the joint recognized by the joint recognition module;
a neck height tracking module that tracks a neck height of the user according to the knee height of the user by using the joint recognized by the joint recognition module;
a motion recognition module that recognize a motion of the user by using the shoulder height tracked by the shoulder height tracking module, the hand direction tracked by the hand direction tracking module, the elbow height tracked by the elbow height tracking module, the arm angle tracked by the arm angle tracking module, the knee height tracked by the knee height tracking module, the leg angle tracked by the leg angle tracking module, the waist height tracked by the waist height tracking module, the ankle height tracked by the ankle height tracking module, and the neck height tracked by the neck height tracking module; and
an AI rehabilitation exercise evaluation module that evaluates, in real time, the rehabilitation exercise of the user by detecting a motion recognized by the motion recognition module by comparing the rehabilitation exercise motion information and the corresponding rehabilitation exercise coaching information controlled by the AI rehabilitation exercise coaching control module using the AI engine,
the exercise rehabilitation system further comprising:
a microphone that receives an input of a user voice;
a speaker that outputs an AI chatting voice; and
an AI voice chatbot module that performs an AI voice chatbot by performing control to recognize the user voice received by the microphone and output an AI voice through the speaker using the AI engine,
wherein the AI voice chatbot module is configured to
perform control to output, as a voice, a real-time evaluation result of the AI rehabilitation exercise evaluation module through the speaker, detect a body state felt by the user during the rehabilitation exercise through the user voice recognized by the AI voice chatbot module, and feed the detected body state back to the AI rehabilitation exercise evaluation module,
the exercise rehabilitation system further comprising:
a user information database, in which user information is registered;
a user face recognition module that recognizes a user face using the 3D image generated by the TOF/stereo camera module;
a user information registration module that registers the user information in the user information database using the user face recognized by the user face recognition module; and
a user identification module that identifies the user by comparing the user face recognized by the user face recognition module and the user information pre-registered in the user information database;
wherein the AI rehabilitation exercise coaching module is configured to
control rehabilitation exercise coaching according to the user identified by the user identification module,
the exercise rehabilitation system further comprising:
a user position/distance detection module that detects a distance and position of the user relative to the smart mirror device using the 3D image generated by the TOF/stereo camera module;
a user mirror image estimation module that estimates a user mirror image on the half mirror on the basis of the position and distance detected by the user position/distance detection module;
a user 3D image simulation module that uses the 3D image generated by the TOF/stereo camera module to simulate and display a user 3D image on the display panel;
a mirror image/3D image synchronization module that synchronizes the user 3D image displayed on the display panel by the user 3D image simulation module with the user mirror image on the half mirror estimated by the user mirror image estimation module;
a user mirror image-based rehabilitation motion guide module that guides a rehabilitation motion by reflecting the rehabilitation exercise motion information controlled by the AI rehabilitation exercise coaching control module in the user 3D image displayed by the mirror image/3D image synchronization module; and
a smart mirror device automatic rotation driving module that automatically rotates the smart mirror device to a horizontal screen state or vertical screen state according to a posture of the user mirror image on the half mirror estimated by the user mirror image estimation module,
wherein the rehabilitation exercise motion information includes an image, video, and action information about a rehabilitation exercise motion for body rehabilitation of the user,
the user rehabilitation progress information includes a record and rehabilitation progress state related to the rehabilitation exercise of the user and a degree of recovery by rehabilitation, and
a rehabilitation exercise selection command, rehabilitation exercise stop command, or rehabilitation exercise history check command is input to the AI rehabilitation exercise coaching control module through a touch input to the touch panel.
|