US 11,755,427 B2
Fast recovery and replication of key-value stores
Qingda Lu, Bellevue, WA (US); Rui Wang, Redmond, WA (US); Zhu Pang, Bellevue, WA (US); Shuo Chen, Bellevue, WA (US); and Jiesheng Wu, Redmond, WA (US)
Assigned to Alibaba Singapore Holding Private Limited, Singapore (SG)
Filed by Alibaba Singapore Holding Private Limited, Singapore (SG)
Filed on Jun. 1, 2021, as Appl. No. 17/335,728.
Prior Publication US 2022/0382651 A1, Dec. 1, 2022
Int. Cl. G06F 16/23 (2019.01); G06F 11/14 (2006.01); G06F 16/27 (2019.01)
CPC G06F 11/1469 (2013.01) [G06F 11/1471 (2013.01); G06F 16/2322 (2019.01); G06F 16/2379 (2019.01); G06F 16/27 (2019.01); G06F 2201/80 (2013.01); G06F 2201/82 (2013.01); G06F 2201/84 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by a key-value engine, the method comprising:
reading a metadata log to locate a latest system checkpoint;
loading a page mapping table from the latest system checkpoint;
replaying to apply changes to the page mapping table from a system transaction log starting from a system transaction replay starting point;
obtaining user transaction replay starting information from a latest user checkpoint log record, the user transaction replay starting information comprising a minimum uncommitted user transaction timestamp and a user transaction replay starting point, wherein the minimum uncommented user transaction timestamp is a minimum user transaction timestamp among user transaction timestamps that are associated with all uncommitted user transactions, and the user transaction replay starting point is a starting position from which corresponding data of the system transaction loci is recovered during a restart recovery; and
replaying a user transaction log starting from the user transaction replay starting point, while skipping user transactions having a timestamp smaller than the minimum uncommitted user transaction timestamp.