US 12,307,212 B2
Method for providing remote service capable of multilingual input and server performing the same
Jeong Moon Kim, Seoul (KR); Chul Oh Park, Incheon (KR); and Min Chul Kim, Seoul (KR)
Assigned to ERmind Co., Ltd., Seoul (KR)
Filed by ERmind Co., Ltd., Seoul (KR)
Filed on May 12, 2021, as Appl. No. 17/319,054.
Claims priority of application No. 10-2021-0037469 (KR), filed on Mar. 23, 2021.
Prior Publication US 2022/0309253 A1, Sep. 29, 2022
Int. Cl. G06F 40/58 (2020.01); G06F 3/14 (2006.01); G06F 9/451 (2018.01)
CPC G06F 40/58 (2020.01) 7 Claims
OG exemplary drawing
 
1. A method for providing a remote service capable of multi- language input, the method being performed by a processor of a service providing server and comprising:
providing a remote service screen rendered in accordance with a request of a user terminal, the remote service screen being a screen for any one application or web page having a source code;
detecting each of a plurality of areas in the remote service screen in which a virtual input window can be inserted and in which text can be displayed, by analyzing the source code of the remote service screen;
inserting a guide text for searching in a virtual input window corresponding to the any one of the plurality of areas;
receiving a text from the user terminal in real time without receiving a user input of any one of searching, transmitting, or confirming, the received text being acquired from a physical input device connected to the user terminal or from a display device of the user terminal, the received text being provided as a video in the virtual input window;
receiving, from the user terminal, selection information about an area of the virtual input window where the text is to be displayed, the selection information indicating one of the plurality of areas in which text can be displayed;
generating, in response to the received text and selection information, an input object composed of video in real time, the input object including
the text received from the user terminal in real time,
an image of an area corresponding to the selection information and the text, and
a real-time image for a partial area of the remote service screen displayed on the user terminal; and
providing the remote service screen to the user terminal by inserting the input object composed of video into the area of the virtual input window where the text is to be displayed,
wherein the guide text for searching is generated for each of the detected plurality of areas where the virtual input window can by inserted and is determined based on the source code of a corresponding one of the detected plurality of areas, and
wherein the guide text of the corresponding one of the detected plurality of areas is inserted into the area of the virtual input window and serves as a prompt to assist a search performed by user of the user terminal.