US 11,893,088 B2
Method and apparatus for creating high-fidelity, synthetic imagery for artificial intelligence model training and inference in security and screening applications
Eric M. Fiterman, Reedsville, PA (US)
Assigned to Cignal LLC, Reedsville, PA (US)
Filed by Cignal LLC, Reedsville, PA (US)
Filed on May 14, 2021, as Appl. No. 17/320,792.
Claims priority of provisional application 63/024,709, filed on May 14, 2020.
Prior Publication US 2022/0076061 A1, Mar. 10, 2022
Int. Cl. G06F 18/28 (2023.01); G06F 18/214 (2023.01); G06F 18/21 (2023.01)
CPC G06F 18/28 (2023.01) [G06F 18/214 (2023.01); G06F 18/2178 (2023.01)] 15 Claims
OG exemplary drawing
 
1. An apparatus for generating synthetic imagery for training artificial intelligence models for security and screening applications, comprising:
at least one processor;
at least one non-transient computer memory;
an object library stored on said at least one non-transient computer memory including a pre-defined catalog of items selected from a group consisting of electronics, weapons, explosives, incendiaries, drugs and narcotics, luggage, backpacks, boxes, enclosures, vehicles, human figures, and other arbitrary items of interest;
a data management module stored on said at least one non-transient computer memory and containing computer readable instructions executable by said at least one processor for loading and saving data files representing arbitrary shapes, objects, and geometries, and converting said data files into optimized data structures;
a materials library stored on said at least one non-transient computer memory including a pre-defined catalog of physical materials and associated scan properties for different electromagnetic energies;
a scene management module for selection of objects from said pre-defined catalog of items, virtually placing into interior volumes of said objects one or more other items from said pre-defined catalog of items and/or one or more of said physical materials, and generating a plurality of three-dimensional scenes comprising one or more said objects with interior items and/or interior materials, said plurality of three-dimensional scenes each comprising a collection of objects, materials and configuration parameters governing a simulation, including object position, internal composition of said objects, and motion, and scan properties for objects and materials in the scene, the module stored on said at least one non-transient computer memory and containing computer instructions executable by said at least one processor for storing compressed representations of objects, materials and properties into scene data configured to be uncompressed and loaded at run-time during simulation;
an electromagnetic radiation simulator stored on said at least one non-transient computer memory and containing computer readable instructions executable by said at least one processor for generating synthetic imagery for a particular scene using said associated scan properties, said electromagnetic radiation simulator configured to image said materials in said interior volumes of said objects;
a data generation module stored on said at least one non-transient computer memory and containing computer readable instructions executable by said at least one processor for converting collected data and measurements from virtual imaging sensors into various 2D and 3D image output formats, wherein the data generation module includes capabilities for post data processing to achieve specific image quality objectives; and
a display interface module stored on said at least one non-transient computer memory and containing computer readable instructions executable by said at least one processor for creating, displaying, and interacting with 3D scenes composed of arbitrary shapes, objects, paths, points, and geometries based on user entries.