CPC G06T 19/006 (2013.01) [G06F 8/433 (2013.01); G06F 16/24544 (2019.01); G06F 16/2468 (2019.01); G06N 7/01 (2023.01)] | 15 Claims |
1. A system for generating data-enriching augmented reality (AR) applications from a domain-specific language, the system comprising:
a data store; and
an AR application generating module configured to generate an AR application using a domain-specific language (DSL) and a fuzzy join operation, wherein the AR application is configured to augment real-world data with supplementary data from a remote data source, in an AR environment, wherein the real-world data comprises a plurality of modalities and the AR function comprises a plurality of embedding functions where each embedding function of the plurality of embedding functions corresponds to a different modality of the plurality of modalities and , wherein the plurality of modalities corresponding to the plurality of embedding functions comprise a transcription modality, an image modality, a speech modality, and a geolocation modality, and
wherein the AR application is configured to augment real-world data with supplementary data from the remote data source comprises the AR application configured to:
express the real-world data as an embedding vector of a fixed dimension;
determine at least one embedding vector of a plurality of embedding vectors that is similar to the embedding vector of the real-world data using a nearest neighbor search executed over the plurality of embedding vectors, wherein each embedding vector of the plurality of embedding vectors expresses the supplementary data from the remote source and is of the fixed dimension; and
perform the fuzzy join operation of the embedding vector of the real-world data and the at least one embedding vector of the plurality of embedding vectors to augment the real-world data with supplementary data from the remote data source.
|