US 11,756,298 B2
Analysis and feedback system for personal care routines
Kelsey Norwood, Scotch Plains, NJ (US); and Elisabeth Araujo, New York, NY (US)
Assigned to L'OREAL, Paris (FR)
Filed by L'Oreal, Paris (FR)
Filed on Aug. 12, 2021, as Appl. No. 17/401,193.
Application 17/401,193 is a continuation of application No. 16/228,263, filed on Dec. 20, 2018, granted, now 11,093,749.
Prior Publication US 2021/0374417 A1, Dec. 2, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G09B 19/00 (2006.01); G06K 7/14 (2006.01); G06V 20/40 (2022.01); G06K 7/10 (2006.01); H04N 7/18 (2006.01); G06V 40/20 (2022.01)
CPC G06V 20/41 (2022.01) [G06K 7/10722 (2013.01); G06K 7/1413 (2013.01); G06K 7/1417 (2013.01); G06V 40/20 (2022.01); G09B 19/00 (2013.01); H04N 7/183 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A non-transitory computer-readable medium having stored thereon instructions configured to, when executed by one or more computing devices of a computer system, cause the computer system to perform steps comprising:
obtaining digital video data of a plurality of physical consumer products being used in a personal care routine;
obtaining and decoding encoded product information that identifies the physical consumer products being used;
analyzing the digital video data using object recognition and gesture recognition;
detecting physical acts of using the plurality of physical consumer products in the personal care routine based at least in part on the analysis of the digital video data;
determining a recommended change to the personal care routine based at least in part on the decoded product information;
generating customized personal care routine data comprising the recommended change to the personal care routine; and
transmitting the customized personal care routine data to a client computer system, thereby causing the customized personal care routine data to be presented in a user interface of the client computer system.