US 12,423,513 B2
Method for generating prototype using screen images and system implementing the same
Soo Kim, Wanju-gun (KR)
Assigned to STUDIO XID KOREA, INC., Seoul (KR)
Filed by STUDIO XID KOREA, INC., Seoul (KR)
Filed on May 7, 2024, as Appl. No. 18/656,815.
Claims priority of application No. 10-2024-0006128 (KR), filed on Jan. 15, 2024; and application No. 10-2024-0032930 (KR), filed on Mar. 8, 2024.
Prior Publication US 2025/0232112 A1, Jul. 17, 2025
Int. Cl. G06F 17/00 (2019.01); G06F 3/0481 (2022.01); G06F 40/186 (2020.01); G06V 10/764 (2022.01); G06V 20/62 (2022.01)
CPC G06F 40/186 (2020.01) [G06F 3/0481 (2013.01); G06V 10/764 (2022.01); G06V 20/62 (2022.01); G06V 2201/10 (2022.01)] 18 Claims
OG exemplary drawing
 
1. A method for generating a prototype by using a screen image, performed by a computing system, the method comprising:
acquiring screen image data including meta data for each of a plurality of objects included in the screen image;
selecting a first template interaction corresponding to the screen image among a plurality of predefined template interactions based on a result of analyzing the meta data, wherein each of the plurality of predefined template interactions includes a plurality of template objects, and a trigger and a response applied to each of the plurality of template objects; and
automatically generating a prototype corresponding to the screen image by using the selected first template interaction and the screen image,
wherein the meta data includes information on hierarchical structure of each of the plurality of objects,
wherein selecting a first template interaction corresponding to the screen image comprises:
inputting, to an AI-based object determination model, information on the hierarchical structure included in the meta data and the screen image; and
selecting the first template interaction corresponding to the screen image among the plurality of predefined template interactions based on determination result on the each object included in the screen image output from the AI-based object determination model, and
wherein the information on hierarchical structure of each of the plurality of objects includes information input by a user of the computing system.