US 12,243,181 B2
Method and system for creating an annotated object model for a new real-world object
Mathias Franzius, Offenbach (DE); Chao Wang, Offenbach (DE); and Yufeng Jin, Offenbach (DE)
Assigned to Honda Research Institute Europe GmbH, Offenbach/Main (DE)
Filed by Honda Research Institute Europe GmbH, Offenbach/Main (DE)
Filed on Mar. 31, 2023, as Appl. No. 18/129,085.
Prior Publication US 2024/0331321 A1, Oct. 3, 2024
Int. Cl. G06T 7/11 (2017.01); G06F 3/01 (2006.01); G06T 19/00 (2011.01); G06T 19/20 (2011.01); G10L 15/22 (2006.01)
CPC G06T 19/20 (2013.01) [G06F 3/013 (2013.01); G06F 3/016 (2013.01); G06T 7/11 (2017.01); G06T 19/006 (2013.01); G10L 15/22 (2013.01); G06T 2210/21 (2013.01); G06T 2219/004 (2013.01); G06T 2219/2021 (2013.01); G10L 2015/223 (2013.01)] 17 Claims
OG exemplary drawing
 
1. A method for creating an annotated object model of a real world object, the method comprising the following method steps:
providing an initial object model for an object for which an annotated object model is to be created,
predicting properties of the object by generating object properties for the initial object model by morphing a template model onto the initial object model and transferring properties known for the template model as predicted properties for the initial object model,
wherein the properties and the predicted properties include at least one of a designation of parts of the object, a segmentation of the object defining different parts of the object, affordances of the object that comprise at least one of graspable, place-able, and removable, relations between object parts of the object, appearance properties of the object including at least one of a color, material properties of the object comprising at least one of wood, steel, and glass, and relations between multiple objects,
visualizing a representation of the object based on the initial object model wherein the predicted properties of the object are displayed associated with the representation,
obtaining selection information based on at least one of a user gesture, user pointing operation, user speech input, and user gaze perceived by a user perception device,
determining a portion of the object corresponding to the selection information,
receiving property information from a user input,
associating the input property information with the corresponding portion of the object.