US 12,293,301 B2
Systems and methods for developing a knowledge base comprised of multi-modal data from myriad sources
Oscar David Corredor Ortega, Bogota (CO); Henry Forsyth Keenan, San Juan, PR (US); Andrés Felipe Valencia Duque, Pereira (CO); Juan David Martínez Castillo, Cartago (CO); Alejandro Dominguez Rosales, Bogota (CO); Andrés Pérez Buriticá, Bogota (CO); and Jose Martinez, San Juan, PR (US)
Assigned to Red Atlas Inc., San Juan, PR (US)
Filed by RED ATLAS INC., San Juan, PR (US)
Filed on Jul. 3, 2024, as Appl. No. 18/763,705.
Claims priority of provisional application 63/511,773, filed on Jul. 3, 2023.
Prior Publication US 2025/0013888 A1, Jan. 9, 2025
Int. Cl. G06N 5/022 (2023.01); G06N 5/04 (2023.01)
CPC G06N 5/022 (2013.01) [G06N 5/04 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for building a knowledge base, the system comprising a processor and a non-transitory computer readable medium storing instructions such that when the instructions are executed by the processor, the system is configured to:
receive, at an ingestion engine, multi-modal data from one or more sources, wherein the multi-modal data includes text and images;
analyze, by a feature extraction engine using language model parameters, the multi-modal data associated with the text;
identify, based on the analysis of the text by the feature extraction engine using a large language model associated with the language model parameters, a first set of features;
analyze, by the feature extraction engine using image parameters, the multi-modal data associated with the images;
identify, based on the analysis of the images by the feature extraction engine using an image model associated with the image parameters, a second set of features;
store as features in a database the first set of features and the second set of features;
receive a search query for searching the features stored in the database;
identify, based on the search query via natural language processing, search features;
query the database, based on the search features, to generate search results;
generate, based on the search results, a standardized graphical user interface, wherein the standardized graphical user interface includes one or more of the search results and a legend including at least one of the search features; and
cause presentation, via an electronic display device, of the standardized graphical user interface.