US 12,366,955 B2
Recognition system for recognizing multiple inputs of gestures, handwriting symbols and virtual keys on touch screen
Jianming Zhuang, Singapore (SG)
Assigned to SUNIA PTE. LTD., Singapore (SG)
Filed by Jianming Zhuang, Singapore (SG)
Filed on Oct. 30, 2023, as Appl. No. 18/384,890.
Prior Publication US 2025/0138722 A1, May 1, 2025
Int. Cl. G06F 3/041 (2006.01); G06F 3/0354 (2013.01); G06F 3/0488 (2022.01); G06F 3/04883 (2022.01); G06F 3/04886 (2022.01); G06F 18/214 (2023.01); G06F 40/10 (2020.01); G06F 40/166 (2020.01); G06F 40/232 (2020.01); G06V 10/764 (2022.01); G06V 30/148 (2022.01); G06V 30/164 (2022.01); G06V 30/262 (2022.01); G06V 30/30 (2022.01); G06V 30/32 (2022.01); G06V 30/40 (2022.01); G06V 30/413 (2022.01); G10L 13/08 (2013.01); G06N 3/082 (2023.01); G06V 30/166 (2022.01)
CPC G06F 3/04883 (2013.01) [G06F 3/03545 (2013.01); G06F 3/0418 (2013.01); G06F 3/0488 (2013.01); G06F 3/04886 (2013.01); G06F 18/214 (2023.01); G06F 40/10 (2020.01); G06F 40/166 (2020.01); G06F 40/232 (2020.01); G06V 10/764 (2022.01); G06V 30/153 (2022.01); G06V 30/164 (2022.01); G06V 30/262 (2022.01); G06V 30/30 (2022.01); G06V 30/387 (2022.01); G06V 30/40 (2022.01); G06V 30/413 (2022.01); G10L 13/08 (2013.01); G06F 2203/04104 (2013.01); G06F 2203/04803 (2013.01); G06F 2203/04808 (2013.01); G06N 3/082 (2013.01); G06V 30/166 (2022.01)] 11 Claims
OG exemplary drawing
 
1. A recognition system for recognizing multiple inputs of gestures, handwriting symbols and virtual keys on a touch screen comprising:
the touch screen serving to receive a touch action of a user for generating a plurality of touch signals; the touch screen being a touch panel of an electronic device;
a touch IC connected to the touch screen; the touch IC serving to receive the touch signals from the touch screen and to convert the touch signals to a touch data frame which has a 2D (two-dimensional) structure formed by a plurality of touch data items;
a processor set connected to the touch IC and an OS (Operating System); the processor set serving to receive the touch data frame from the touch IC and to perform a touch data processing on the touch data frame; the touch data processing being performed by using a processing directly executed by the OS and a processing of AI (artificial intelligence) recognizing;
wherein in the touch data processing, when the touch data frame corresponds to a plurality of specific inputs and a number of the specific inputs is less than a predetermined number, the touch data frame is viewed as a data frame which is capable of being directly processed by the OS and is outputted to the OS for processing; when the touch data frame corresponds to the specific inputs and the number of the specific inputs is larger than or equal to the predetermined number, the touch data frame is viewed as a data frame which is not capable of being directly processed by the OS and is outputted to an AI (artificial intelligence) recognition module for recognizing the touch data frame; the AI recognition module is connected to the processor set; an AI recognizing result outputted by the AI recognition module is outputted to the processor set; when the AI recognizing result is corresponded to a plurality of specific key inputs, the processor set performs a grammar correction on the specific key inputs and a result of the grammar correction on the specific key inputs is outputted to the OS for processing; when the AI recognizing result is corresponded to at least one specific handwriting symbol including a character string or a mathematical expression, the processor set performs a symbol correction on the at least one specific handwriting symbol and a result of the symbol correction on the at least one specific handwriting symbol is outputted to the OS for processing; when the AI recognizing result is corresponded to a specific operation gesture, the processor set outputs the specific operation gesture to the OS for processing;
wherein in the touch data processing, the touch IC serves to perform an initial processing; the initial processing is that the touch IC receives the touch signals from the touch screen and converts the touch signals to the touch data frame;
a preprocess unit connected to the touch IC; wherein in the touch data processing, the preprocess unit serves to receive the touch data frame and to perform a noise filtering, a normalization and a data splitting on the touch data frame; and
the touch screen serving to display a virtual keyboard or a part of the virtual keyboard for being viewed by the user and receiving the touch action of the user.