US 12,327,032 B2
Data processing method, apparatus, device and medium based on distributed storage
Qucheng Liu, Shenzhen (CN); Maocai Li, Shenzhen (CN); Zongyou Wang, Shenzhen (CN); Hu Lan, Shenzhen (CN); Kaiban Zhou, Shenzhen (CN); Li Kong, Shenzhen (CN); Pan Liu, Shenzhen (CN); Gengliang Zhu, Shenzhen (CN); and Yifang Shi, Shenzhen (CN)
Assigned to TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed by TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED, Shenzhen (CN)
Filed on Nov. 23, 2022, as Appl. No. 17/993,838.
Application 17/993,838 is a continuation of application No. PCT/CN2022/074853, filed on Jan. 29, 2022.
Claims priority of application No. 202110188344.X (CN), filed on Feb. 19, 2021.
Prior Publication US 2023/0098190 A1, Mar. 30, 2023
Int. Cl. G06F 3/06 (2006.01)
CPC G06F 3/064 (2013.01) [G06F 3/0656 (2013.01); G06F 3/067 (2013.01); G06F 3/0604 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A data processing method based on distributed storage, which is executed by a block chain node, and the method comprising:
detecting, in response to writing first block data of a first block into a local cache and a local storage, a first block processing space of a storage buffer pool associated with the local cache to obtain a first space detection result, the storage buffer pool comprising N block data to be stored, N being a non-negative integer, wherein the storage buffer pool and the local cache are both included in a storage layer of the block chain node;
writing, in response to the first space detection result indicating that a number of block data to be stored in the first block processing space does not reach a buffer block processing threshold of the first block processing space, the first block data into the storage buffer pool based on the N block data to be stored;
detecting a second block processing space of a storage processing pool associated with the storage buffer pool to obtain a second space detection result, the storage processing pool being configured to store M block data to be fed back associated with a distributed database, M being a non-negative integer, wherein the M block data to be fed back in the storage processing pool are block data that are currently being stored in the distributed database, but have not received stored feedback information returned by the distributed database; and
determining, in response to the second space detection result indicating that a number of block data to be fed back in the second block processing space does not reach a feedback block processing threshold of the second block processing space, block data to be merged in the storage buffer pool based on the number of the block data to be fed back and the feedback block processing threshold, performing overlap detection on the block data to be merged and the M block data to be fed back to determine data that are not overlapped as retained data, and writing the retained data into the distributed database.