US 12,407,911 B2
Image processing apparatus and method with capture direction recommendations
Mitsuru Nakazawa, Tokyo (JP); and Takashi Tomooka, Tokyo (JP)
Assigned to Rakuten Group, Inc., Tokyo (JP)
Filed by Rakuten Group, Inc., Tokyo (JP)
Filed on Dec. 23, 2022, as Appl. No. 18/088,044.
Claims priority of application No. 2021-211600 (JP), filed on Dec. 24, 2021.
Prior Publication US 2023/0209171 A1, Jun. 29, 2023
Int. Cl. H04N 23/60 (2023.01); G06Q 30/0601 (2023.01); G06T 11/60 (2006.01); G06V 10/40 (2022.01)
CPC H04N 23/60 (2023.01) [G06Q 30/0631 (2013.01); G06T 11/60 (2013.01); G06V 10/40 (2022.01)] 10 Claims
OG exemplary drawing
 
1. An image processing apparatus comprising:
at least one memory configured to store program code;
at least one processor configured to operate as instructed by the program code, the program code including:
receiving code configured to cause at least one of the at least one processor to receive a captured image of a target object;
recognizing code configured to cause at least one of the at least one processor to perform recognition of the target object by extracting feature points of the target object on a basis of the captured image;
recommending code configured to cause at least one of the at least one processor to provide recommendation regarding an imaging direction on a basis of a type of the target object, and on a basis of an imaging direction previously used for the type of the target object in a predetermined trade history;
instruction code configured to cause at least one of the at least one processor to provide an instruction on a specific direction to capture an image of the target object, on a basis of a result of the recognition and a result of the recommendation;
display code configured to cause at least one of the at least one processor to cause a display to display a 3D virtual surrounding body including the feature points of the target object in such a manner as to superimpose the 3D virtual surrounding body on the target object on a basis of the result of the recognition and to display, in a highlighted manner, a region of the 3D virtual surrounding body corresponding to the imaging direction based on the instruction; and
object setting code configured to cause at least one of the at least one processor to divide a surface of the 3D virtual surrounding body into a plurality of surface objects to create a mesh, and obtain surface object information regarding coordinates for the surface objects,
wherein the recommendation is based in part on the surface object information.