US 12,114,003 B2
System and method for managing encoded information in a real-time screen-to-camera communication environment
Shrinivas Kudekar, Roswell, GA (US); and Ivan Klimek, Ganovce (SK)
Assigned to Shrinivas Kudekar, Roswell, GA (US)
Filed by Shrinivas Kudekar, Roswell, GA (US)
Filed on May 23, 2023, as Appl. No. 18/321,829.
Claims priority of provisional application 63/368,634, filed on Jul. 15, 2022.
Prior Publication US 2024/0022752 A1, Jan. 18, 2024
Int. Cl. H04N 19/467 (2014.01); H04N 9/64 (2023.01); H04N 19/136 (2014.01); H04N 19/172 (2014.01); H04N 19/182 (2014.01); H04N 19/184 (2014.01); H04N 19/186 (2014.01); H04N 19/85 (2014.01); G06K 19/06 (2006.01); G06Q 30/0251 (2023.01)
CPC H04N 19/467 (2014.11) [H04N 9/64 (2013.01); H04N 19/136 (2014.11); H04N 19/172 (2014.11); H04N 19/182 (2014.11); H04N 19/184 (2014.11); H04N 19/186 (2014.11); H04N 19/85 (2014.11); G06K 19/06028 (2013.01); G06Q 30/0261 (2013.01)] 24 Claims
OG exemplary drawing
 
1. A computer-implemented system for managing encoded information in a real-time screen-to-camera communication environment, the computer-implemented system comprising:
one or more hardware processors; and
a memory coupled to the one or more hardware processors, wherein the memory comprises a plurality of modules in form of programmable instructions executable by the one or more hardware processors, wherein the plurality of modules comprises:
an information encoding module, wherein the information encoding module comprises:
a character converting submodule configured to convert information into a pre-defined number of characters;
a symbol generating submodule configured to generate at least one of one or more data symbols, one or more pilot symbols, and one or more scannable barcodes corresponding to the pre-defined number of characters, wherein the one or more data symbols are generated in one or more shapes;
a symbol embedding submodule configured to embed, for a pre-defined duration of media content, the generated at least one of the one or more data symbols, the one or more pilot symbols, and the one or more scannable barcodes in each of one or more frames of the media content, wherein the one or more data symbols are embedded as at least one of a grid and a fixed pattern on each of the one or more frames, and the one or more pilot symbols are embedded as a column of at least one of discrete pilot symbols and a single continuous column of a color on each of the one or more frames;
a pixel modulating submodule configured to adaptively modulate, over at least one of a color channel and a luminance channel, a lightness channel, an intensity channel, one or more pixels and a boundary in each of the one or more frames for the pre-defined duration, for the embedded one or more data symbols and the one or more pilot symbols; and
a frame displaying submodule configured to adaptively display, each pixel, on a screen associated with a display device, at least one of the scannable barcodes and the modulated one or more pixels, and the boundary in each of the one or more frames for the pre-defined duration, based on a luminance of each of one or more regions in each of one or more frames, wherein the one or more frames are adaptively displayed as one or more temporal-complementary frames (TCF); and
an information decoding module, wherein the information decoding module comprises:
a content receiving submodule configured to receive recorded content corresponding to the media content, recorded through a camera associated with a user device;
a frame detecting submodule configured to detect the one or more frames from the recorded content, wherein the detected one or more frames are converted into a color space;
a symbol detecting submodule configured to detect at least one of the one or more data symbols, the one or more pilot symbols, and the one or more scannable barcodes in the detected the one or more frames;
a symbol extracting submodule configured to extract the one or more data symbols from the one or more frames based on at least one of the grid and the fixed pattern, wherein the one or more data symbols are extracted based on a position of the column of the one or more pilot symbols in each of the one or more frames;
a bit value detecting submodule configured to detect one or more bit values of each data symbol, by analyzing a color difference between each of the one or more frames and a shape of the one or more data symbols, wherein the color difference of the one or more data symbols and the one or more pilot symbols is cumulatively accumulated over the one or more frames for an energy accumulation to analyze the color difference between each of the one or more frames and the one or more shapes of the one or more data symbols;
an information generating submodule configured to generate the information based on at least one of the detected bit values of the one or more frames and the detected one or more scannable barcodes; and
an information outputting submodule configured to output the generated information through at least one of displaying on a display of the user device and transmitting the information to one or more digital delivery destination platforms, wherein outputting the generated information comprises displaying at least one of one or more products, one or more recommendations, one or more services, and relevant information regarding the media content to a user of the user device for interacting with the information in a unobtrusive mode.