US 11,687,618 B2
System and method for processing text handwriting in a free handwriting mode
Alain Chateigner, Nantes (FR)
Assigned to MyScript, Nantes (FR)
Filed by MyScript, Nantes (FR)
Filed on Dec. 16, 2019, as Appl. No. 16/715,977.
Claims priority of application No. 19181519 (EP), filed on Jun. 20, 2019.
Prior Publication US 2020/0401796 A1, Dec. 24, 2020
Int. Cl. G06F 17/00 (2019.01); G06F 18/00 (2023.01); G06F 40/106 (2020.01); G06F 40/151 (2020.01); G06V 30/32 (2022.01)
CPC G06F 18/00 (2023.01) [G06F 40/106 (2020.01); G06F 40/151 (2020.01); G06V 30/347 (2022.01); G06V 30/36 (2022.01); G06F 2218/12 (2023.01)] 16 Claims
OG exemplary drawing
 
1. A method for processing text handwriting on a computing device, the computing device comprising a processor, a memory and at least one non-transitory computer readable medium for processing text handwriting under control of the processor, the method comprising:
detecting, with an input surface, a plurality of input strokes of digital ink handwritten in a free handwriting format without any handwriting constraint;
displaying said plurality of input strokes on a display device handwritten in said free handwriting format;
classifying each input stroke as text or non-text, said classifying comprising detecting as text at least one text block of handwritten text from said plurality of input strokes handwritten in the free handwriting format;
performing text recognition on said at least one text block, said text recognition comprising:
extracting text lines of handwritten text from said at least one text block of handwritten text; and
generating model data representative of the handwritten text associating each stroke of said at least one text block with a character, a word and a text line of said at least one text block; and
normalizing each text line of the recognized handwritten text from the free handwriting format into a structured format to comply with a document pattern comprising a line pattern, wherein said document pattern defines handwriting constraints that constrain the handwritten text, said normalization comprising for each text line of handwritten text:
computing for said text line a respective transform function to transform said text line into the structured format such that said text line of handwritten text is arranged according to guidelines defined by said line pattern;
applying the respective transform function to the text line to transform each stroke of said text line into the structured format;
blocking any text recognition on said at least one text block resulting from applying the respective transform function to said text line; and
updating the model data of said text line based on the respective transform function, said updating comprising updating in the model data correlations between the strokes, characters, words, and text lines of the handwritten text.