US 11,893,693 B2
Systems and methods for generating digital media based on object feature points
Jonathan Wade, Ottawa (CA); Juho Mikko Haapoja, Toronto (CA); Stephan Leroux, East Gwillimbury (CA); and Daniel Beauchamp, Toronto (CA)
Assigned to SHOPIFY INC.
Filed by SHOPIFY INC., Ottawa (CA)
Filed on Jun. 14, 2021, as Appl. No. 17/346,448.
Prior Publication US 2022/0398809 A1, Dec. 15, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 17/00 (2006.01); G06T 13/20 (2011.01); G06Q 30/0601 (2023.01); G06F 16/44 (2019.01); G06N 20/00 (2019.01); G06F 3/04842 (2022.01); G11B 27/10 (2006.01)
CPC G06T 19/00 (2013.01) [G06F 16/44 (2019.01); G06N 20/00 (2019.01); G06Q 30/0643 (2013.01); G06T 13/20 (2013.01); G06T 17/00 (2013.01); G06F 3/04842 (2013.01); G06Q 30/0633 (2013.01); G06T 2200/24 (2013.01); G06T 2219/004 (2013.01); G11B 27/10 (2013.01)] 26 Claims
OG exemplary drawing
 
1. A computer-implemented method comprising:
receiving, from a merchant device, a request for digital media depicting an object;
obtaining a three-dimensional (3D) model corresponding to the object;
obtaining data pertaining to one or more feature points of the object, the one or more feature points corresponding to respective views of the 3D model, wherein the one or more feature points include a feature point corresponding to a particular location or region of the object, the feature point associated with a coordinate on a virtual surface of the 3D model in a virtual coordinate system, and wherein a vector within the virtual coordinate system is oriented in a direction towards the coordinate to define a viewpoint relative to the 3D model for rendering a view, oriented along the vector, of the particular location or region of the object including the virtual surface of the 3D model at the coordinate, wherein the viewpoint relative to the 3D model defined by the vector is determined based on both: (i) previous online user views of the object obtained by user manipulations of the 3D model corresponding to the object including a last render of the 3D model of the object presented to a user before the user added the object to their shopping cart in an online store, and (ii) input received via the merchant device; and
generating the digital media based on the 3D model and the one or more feature points, the digital media including renders of the 3D model depicting the one or more feature points, the renders including a rendered view of the viewpoint oriented along the vector to depict the particular location or region of the object, including to depict the virtual surface of the 3D model at the coordinate.