US 12,394,205 B1
System and method for food service consumption tracking
Fengmin Gong, Los Altos Hills, CA (US); Jun Du, Cupertino, CA (US); and Samir Virmani, San Jose, CA (US)
Assigned to Foodfx Inc, San Jose, CA (US)
Filed by Foodfx Inc, San Jose, CA (US)
Filed on Jan. 3, 2023, as Appl. No. 18/092,768.
Int. Cl. G06K 9/00 (2022.01); G06T 7/11 (2017.01); G06T 7/50 (2017.01); G06V 20/52 (2022.01); G06V 20/68 (2022.01)
CPC G06V 20/52 (2022.01) [G06T 7/11 (2017.01); G06T 7/50 (2017.01); G06V 20/68 (2022.01); G06T 2207/10024 (2013.01); G06T 2207/10028 (2013.01)] 20 Claims
OG exemplary drawing
 
12. A computer-implemented method, comprising:
receiving an image of a food station captured by an RGB camera monitoring the food station, wherein the food station comprises a plurality of food containers;
determining a plurality of bounding boxes for the plurality of food containers based on the image;
receiving an overall point cloud of the food station captured by a depth camera monitoring the food station;
cropping a point cloud for each of the plurality of food containers from the overall point cloud based on the plurality of bounding boxes;
for each of the plurality of food containers, determining a volume of remaining food in the food container based on the point cloud of the food container; and
obtaining food consumption information for the plurality of food containers by tracking volume changes of the remaining food in the plurality of food containers.