US 12,406,519 B1
Techniques for extracting links and connectivity from schematic diagrams
Marc-André Gardner, Quebec (CA); Simon Savary, Quebec (CA); Evan Rausch-Larouche, Quebec (CA); Raphaël Melancon, Quebec (CA); and Karl-Alexandre Jahjah, Quebec (CA)
Assigned to Bentley Systems, Incorporated, Exton, PA (US)
Filed by Bentley Systems, Incorporated, Exton, PA (US)
Filed on Jul. 29, 2022, as Appl. No. 17/877,560.
Int. Cl. G06K 9/00 (2022.01); G06V 30/19 (2022.01); G06V 30/414 (2022.01); G06V 30/422 (2022.01)
CPC G06V 30/422 (2022.01) [G06V 30/19167 (2022.01); G06V 30/414 (2022.01)] 23 Claims
OG exemplary drawing
 
1. A method for extracting links and connectivity from a schematic diagram in an image-only format, comprising:
producing, using a first machine learning (ML) model executing on one or more computing devices, a first set of predictions about positions of link segments in the schematic diagram;
producing, using a second ML model executing on the one or more computing devices, a second set of predictions about starting and stopping points of link segments in the schematic diagram;
performing an optimization, by a signal processing module executing on the one or more computing devices, to combine the first set of predictions about the positions of link segments and the second set of predictions about starting and stopping points of link segments to produce a description of links and connectivity they provide between symbols in the schematic diagram, wherein the optimization associates portions of link segments with starting and stopping points, applies a cost to each possible association, and selects a set of associations that provides a globally optimal cost minimum; and
outputting the description of links and connectivity in a machine-readable format.