US 12,271,582 B2
Intelligent drawing method and system for human machine interaction HMI design prototype
Qichao Zhao, Beijing (CN); and Ran Yang, Beijing (CN)
Assigned to KINGFAR INTERNATIONAL INC., Beijing (CN); and NANJING KINGFAR HEALTH TECHNOLOGY INC., Nanjing (CN)
Filed by KINGFAR INTERNATIONAL INC., Beijing (CN); and NANJING KINGFAR HEALTH TECHNOLOGY INC., Nanjing (CN)
Filed on Dec. 27, 2022, as Appl. No. 18/088,920.
Claims priority of application No. 202211115495.3 (CN), filed on Sep. 14, 2022.
Prior Publication US 2024/0086049 A1, Mar. 14, 2024
Int. Cl. G06F 40/117 (2020.01); G06F 3/0483 (2013.01); G06F 3/04845 (2022.01); G06F 3/0488 (2022.01); G06F 40/134 (2020.01); G06F 3/0485 (2022.01)
CPC G06F 3/04845 (2013.01) [G06F 3/0483 (2013.01); G06F 3/0488 (2013.01); G06F 40/117 (2020.01); G06F 40/134 (2020.01); G06F 3/0485 (2013.01)] 11 Claims
OG exemplary drawing
 
1. An intelligent drawing method for human machine interaction (HMI) design prototype, comprising:
importing an HMI design prototype to be tested in a human machine interaction assessment system, wherein the human machine interaction assessment system supports two manners to draw a prototype drawing area, the two manners comprise an automatic recognition drawing mode and a custom drawing mode, and an HMI prototype page is designed to comprise a plurality of content blocks;
obtaining a hypertext markup language (HTML) script of a page of the HMI design prototype, and displaying the HMI prototype page on a display interface;
automatically recognizing the plurality of content blocks on the HMI prototype page by reading codes of the HMI prototype page in the automatic recognition drawing mode, monitoring a block selection operation of an experimenter on the display interface, recognizing a corresponding content block as an interaction area to monitor interaction data between an experimenter and the HMI design prototype based on a position of the block selection operation, automatically marking the recognized content block as the interaction area, and adding the recognized content block in a drawing area list;
automatically detecting an interaction operation of a subject in a process of the subject testing the HMI design prototype, automatically associating the interaction operation with a corresponding content block, and saving association data in a backend database, wherein the human machine interaction assessment system records an action time and a coordinate position when a position of the interaction operation is matched with a content block in the drawing area list, and an operation principle of the automatic recognition drawing mode comprises:
importing the HMI design prototype in the human machine interaction assessment system;
obtaining a prototype code by a provided uniform resource locator (URL) or a local storage path of the page using the human machine interaction assessment system;
dividing code content blocks, comprising:
automatically compiling the prototype code to recognize content blocks of the prototype code, and
displaying the content blocks on a screen of the human machine interaction assessment system according to block properties, wherein the block properties are selected from block identification (ID), drawing area size, drawing area position, or drawing area color;
specifying a specific content block as a drawing area, comprising:
monitoring a movement of a touch object on the HMI prototype page via the human machine interaction assessment system, when the touch object is slid on the HMI prototype page, automatically recognizing a position of the touch object and projecting the touch object to a corresponding content block based on the position via the human machine interaction assessment system, highlighting the content block, and when the human machine interaction assessment system detects a selection operation of the highlighted content block by the experimenter, recording the selected content block as the drawing area; and
adding the selected content block in the drawing area list by the human machine interaction assessment system correspondingly; and
editing the drawing area; and
detecting a recognition drawing scope selected on the display interface in the custom drawing mode, marking the recognition drawing scope and adding the recognition drawing scope in the drawing area list.