US 10,891,069 B2
Creating local copies of data stored in online data repositories
Waqas Ashraf, Ocean, NJ (US); Jing Zhang, Freehold, NJ (US); and Balashankar Sundar, Bangalore (IN)
Assigned to Commvault Systems, Inc., Tinton Falls, NJ (US)
Filed by Commvault Systems, Inc., Tinton Falls, NJ (US)
Filed on Mar. 20, 2018, as Appl. No. 15/927,018.
Claims priority of provisional application 62/477,140, filed on Mar. 27, 2017.
Prior Publication US 2018/0275881 A1, Sep. 27, 2018
Int. Cl. G06F 3/06 (2006.01); G06F 9/54 (2006.01); G06F 16/93 (2019.01); G06F 11/20 (2006.01); G06F 11/14 (2006.01)
CPC G06F 3/065 (2013.01) [G06F 3/061 (2013.01); G06F 3/067 (2013.01); G06F 9/547 (2013.01); G06F 3/0643 (2013.01); G06F 11/1451 (2013.01); G06F 11/1453 (2013.01); G06F 11/1458 (2013.01); G06F 11/2094 (2013.01); G06F 16/93 (2019.01)] 14 Claims
OG exemplary drawing
 
1. A method, performed by a data agent of an information management system, for performing on-premises storage of data contained in an online repository, the method comprising:
retrieving data stored in an online repository by performing a representational state transfer-conforming (RESTful) application programming interface (API) call to obtain the data stored in the online repository,
wherein performing the RESTful API call results in a compressed copy of the data being transferred to an on-premises site,
wherein the compressed copy of the data includes one or more compressed files for each data library of the online repository and a metadata manifest file for each data library;
parsing each of the one or more compressed files to extract a current version of a data file for every data object within each of the data libraries, and a corresponding metadata file for every data object within each of the data libraries;
retrieving data stored in the online repository by performing a client-side object model (CSOM) API call to obtain any previous versions of the data objects within each of the data libraries;
for each data object having at least a current version and one previous version, normalizing a format of the corresponding metadata files to a format associated with the current version of the data object;
generating a combined metadata file that includes metadata from each of the metadata files associated with the data objects within each of the data libraries; and
transferring the data files for the data objects within each of the data libraries and the combined metadata file to a media agent for storage to an on-premises secondary storage device of the information management system.