US 12,216,962 B2
Automatic quantitative food intake tracking
Wen Li, Foster City, CA (US); John Rumsfeld, San Francisco, CA (US); Charles Liam Goudge, Menlo Park, CA (US); and Freddy Abnousi, Menlo Park, CA (US)
Assigned to Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed by Meta Platforms Technologies, LLC, Menlo Park, CA (US)
Filed on Jul. 19, 2022, as Appl. No. 17/867,863.
Prior Publication US 2024/0028294 A1, Jan. 25, 2024
Int. Cl. G06F 3/16 (2006.01); G10L 15/22 (2006.01); G10L 15/30 (2013.01)
CPC G06F 3/167 (2013.01) [G10L 15/22 (2013.01); G10L 15/30 (2013.01); G10L 2015/223 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method for quantitatively tracking food intake using smart glasses, the method comprising:
capturing at least one image of food, and motion data indicative of motion by a user of the smart glasses;
identifying a type of the food by performing object recognition on the at least one image of food;
determining a volume of the food by performing volume estimation on the at least one image of food;
obtaining nutritional data associated with the type of the food and the volume of the food;
generating nutritional performance data by comparing the nutritional data to a nutritional benchmark for the user;
identifying a plurality of hand-to-mouth motions by the user by analyzing the motion data;
identifying a plurality of chewing motions by the user using the smart glasses;
calculating a weighted average of a number of the plurality of hand-to-mouth motions and a number of the plurality of chewing motions, wherein calculating the weighted average includes weighing the number of the plurality of hand-to-mouth motions more heavily than the number of the plurality of chewing motions;
generating food intake frequency data by comparing the weighted average of the number of the plurality of hand-to-mouth motions and the number of the plurality of chewing motions to baseline metrics; and
displaying the nutritional performance data and the food intake frequency data to the user on the smart glasses.