US 12,411,809 B2
Virtual file system for transactional data access and management
Fady Sedrak, Santa Clara, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Jul. 5, 2023, as Appl. No. 18/218,307.
Prior Publication US 2025/0013610 A1, Jan. 9, 2025
Int. Cl. G06F 16/17 (2019.01); G06F 16/11 (2019.01); G06F 16/14 (2019.01); G06F 16/188 (2019.01)
CPC G06F 16/1734 (2019.01) [G06F 16/128 (2019.01); G06F 16/148 (2019.01); G06F 16/188 (2019.01)] 15 Claims
OG exemplary drawing
 
1. A method for managing metadata in a data lakehouse, the data lakehouse including each of a data lake layer and a data warehouse layer, the method comprising:
receiving, by one or more processors, a data change to data in a data repository of the data lake layer, wherein the data repository is configured to store a combination of structured, semi-structured and unstructured data in a repository layer, and store metadata of the data in the data repository in a metadata layer of the data repository;
updating, by the one or more processors, a metadata catalog included in the data warehouse layer to reflect the data change, wherein the metadata catalog includes a structured format of the metadata of the data in the data repository;
receiving, by the one or more processors, a user request to access requested data stored in the repository layer of the data repository of the data lake layer, wherein the requested data is associated with metadata of the data change; and
transmitting, by the one or more processors, a request to the metadata catalog for the metadata of the data change;
receiving, by the one or more processors, the metadata of the data change from the metadata catalog; and
transmitting, by the one or more processors, a virtual file containing the received metadata of the data change, wherein the virtual file is in a data storage format that is compatible with one or more data analysis tools.