US 12,063,948 B2
Method and system for foodservice with instant feedback
Fengmin Gong, Los Altos Hills, CA (US); Weijun Zhang, San Jose, CA (US); Min Fan, Bellevue, WA (US); and Jun Du, Cupertino, CA (US)
Assigned to SkoopMagic, Inc., Cupertino, CA (US)
Filed by SKOOPIN INC., San Jose, CA (US)
Filed on Nov. 9, 2021, as Appl. No. 17/522,728.
Prior Publication US 2023/0145313 A1, May 11, 2023
Int. Cl. A23L 33/00 (2016.01); G06F 18/214 (2023.01); G06F 18/25 (2023.01); G06N 20/20 (2019.01); H04L 67/306 (2022.01); H04L 67/50 (2022.01)
CPC A23L 33/30 (2016.08) [G06F 18/214 (2023.01); G06F 18/251 (2023.01); G06N 20/20 (2019.01); H04L 67/306 (2013.01); H04L 67/535 (2022.05)] 18 Claims
OG exemplary drawing
 
1. A system for foodservice, comprising:
a frame having a plurality of weight sensors distributed at corners of the frame, wherein the frame is configured to receive a food container comprising a plurality of compartments;
one or more cameras comprising one or more of the following: a depth sensor, a time of flight (ToF) camera, or a Light Detection and Ranging (LiDAR) camera, wherein the one or more cameras are directed to the food container to monitor the food container; and
one or more processors coupled to the plurality of weight sensors and the one or more cameras, the one or more processors being configured to:
receive one or more images from the one or more cameras capturing the food container;
determine, using a first machine learning model based on the one or more images, a user action comprising the user taking food from a first compartment of the plurality of compartments;
receive a plurality of pieces of weight sensor data from the plurality of weight sensors coupled to the frame;
determine, using a second machine learning model based on the plurality of pieces of weight sensor data, a second compartment of the plurality of compartments from which the user has taken food and a weight of the food taken by the user;
obtain food information of food stored in each of the plurality of compartments in the food container; and
in response to the first compartment being the same as the second compartment, display the weight of the food taken by the user and the food information of the food stored in the first compartment on a first display panel.