US 12,064,697 B2
Crowd-sourced data collection and labelling using gaming mechanics for machine learning model training
Kevin Yu, Hong Kong (CN); Simone Rebaudengo, Hong Kong (CN); Nick Pittom, Hong Kong (CN); Kang Zhang, Hong Kong (CN); and Matt Au, Hong Kong (CN)
Assigned to SideChef Group Limited, Hong Kong (CN)
Filed by SideChef Group Limited, Hong Kong (CN)
Filed on Jun. 12, 2023, as Appl. No. 18/208,458.
Application 18/208,458 is a division of application No. 16/817,358, filed on Mar. 12, 2020, granted, now 11,712,633.
Application 16/817,358 is a continuation of application No. PCT/CN2019/122166, filed on Nov. 29, 2019.
Prior Publication US 2023/0321550 A1, Oct. 12, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. A63F 13/825 (2014.01); A63F 13/58 (2014.01); G06F 18/214 (2023.01); G06N 20/00 (2019.01); G06T 19/00 (2011.01); G06V 10/778 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/70 (2022.01); G06V 20/68 (2022.01)
CPC A63F 13/825 (2014.09) [A63F 13/58 (2014.09); G06F 18/2155 (2023.01); G06N 20/00 (2019.01); G06T 19/006 (2013.01); G06V 10/7784 (2022.01); G06V 10/7788 (2022.01); G06V 20/10 (2022.01); G06V 20/20 (2022.01); G06V 20/70 (2022.01); A63F 2300/65 (2013.01); A63F 2300/695 (2013.01); G06V 20/68 (2022.01)] 17 Claims
OG exemplary drawing
 
1. A game system, comprising:
a processor; and
a memory coupled with the processor to store instructions, which when executed by the processor, cause the processor to perform operations of animating a virtual character in an augmented reality environment on a client device, the operations comprising:
receiving, from an augmented reality environment in a gamified application executing on a mobile device, a photo of a food item captured by a user of the mobile device using a camera installed thereon and information indicating that the food item has been fed to the virtual character displayed in the augmented reality environment, wherein the virtual character is mapped to an evolution path customized based on one or more attributes of the user of the mobile device, wherein a customized evolution path defines an ordered sequence of food items;
in response to the photo of the food item, associating the food item with the virtual character in a data store;
evolving the virtual character along the evolution path to a particular stage for an award, including
modifying one or more animated behaviors of the virtual character, and
counting towards a number of required food items for the evolution path selected for the virtual character;
generating an indication for a reward upon a completion of the evolution path;
generating, by a machine learning model executing in a cloud environment, classification information for the food item represented by the photo, wherein the classification information includes a classification label for the photo, and a set of attributes for the food item;
sending the classification information to the mobile device for display in the augmented reality environment thereon;
receiving, from the mobile device, verified information, wherein the verified information includes an indication for associating the photo with the virtual character, a verified classification label, a set of verified attributes; and
storing the photo and the verified information into the data store in the cloud environment.