US 12,355,934 B2
Multi-viewpoint image processing system and method thereof
Minglei Chu, Beijing (CN); Xin Duan, Beijing (CN); Shuo Zhang, Beijing (CN); Yan Sun, Beijing (CN); Tiankuo Shi, Beijing (CN); Wei Sun, Beijing (CN); Kuanjun Peng, Beijing (CN); Xue Dong, Beijing (CN); and Jiantao Liu, Beijing (CN)
Assigned to BOE Technology Group Co., Ltd., Beijing (CN)
Appl. No. 17/765,454
Filed by BOE Technology Group Co., Ltd., Beijing (CN)
PCT Filed May 28, 2021, PCT No. PCT/CN2021/096720
§ 371(c)(1), (2) Date Mar. 31, 2022,
PCT Pub. No. WO2022/246791, PCT Pub. Date Dec. 1, 2022.
Prior Publication US 2024/0114118 A1, Apr. 4, 2024
Int. Cl. H04N 13/161 (2018.01); H04N 13/15 (2018.01); H04N 13/194 (2018.01); H04N 13/282 (2018.01); H04N 13/302 (2018.01)
CPC H04N 13/161 (2018.05) [H04N 13/15 (2018.05); H04N 13/194 (2018.05); H04N 13/282 (2018.05); H04N 13/302 (2018.05)] 13 Claims
OG exemplary drawing
 
1. A multi-viewpoint image processing system, comprising: a processing apparatus and a display apparatus, wherein the processing apparatus comprises an acquisition module and an encoding module,
the acquisition module is configured to acquire K viewpoint images, wherein a viewpoint image comprises M rows and N columns of pixels, K is a positive integer greater than or equal to 2, and M and N are positive integers greater than or equal to 1;
the encoding module is configured to receive the K viewpoint images, encode the K viewpoint images to generate a plurality of encoded images, and send the plurality of encoded images to the display apparatus;
the display apparatus is configured to receive the plurality of encoded images and obtain M pieces of display information according to the plurality of encoded images, an i-th piece of display information comprising i-th rows of pixel points of the K viewpoint images, i=1, 2, . . . , M; and perform stereoscopic display according to the M pieces of display information; and
the processing apparatus is arranged in the display apparatus, or the processing apparatus and the display apparatus are arranged separately,
the display apparatus comprises a decoding module and a display module, wherein
the decoding module is configured to receive the plurality of encoded images and obtain the M pieces of display information according to the plurality of encoded images; and
the display module is configured to receive the M pieces of display information and perform stereoscopic display according to the M pieces of display information,
wherein the decoding module is configured to obtain the i-th rows of pixels of the K viewpoint images according to the first viewpoint image and the K−1 second viewpoint images; and obtain the M pieces of display information according to first rows of pixels to M-th rows of pixels of the K viewpoint images; and
the display module is configured to display the i-th rows of the K viewpoint images according to the i-th piece of display information,
wherein the encoding module is configured to select an m-th viewpoint image from the K viewpoint images as a first viewpoint image, and take all viewpoint images except the m-th viewpoint image as second viewpoint images, a quantity of the second viewpoint images being K−1, 1≤m≤K; obtain K−1 first images according to the first viewpoint image and the K−1 second viewpoint images, wherein a k-th first image is obtained according to the first viewpoint image and a k-th second viewpoint image, k=1, 2, . . . , K−1; obtain K−1 encoded images according to the first viewpoint image, the K−1 second viewpoint images, and the K−1 first images, wherein a k-th encoded image is obtained according to the first viewpoint image, the k-th second viewpoint image, and the k-th first image; and send the K−1 encoded images and the first viewpoint image, the first images and the encoded images each comprising M rows and N columns of pixels, or
the encoding module is configured to extract sequentially an i-th row of pixels of each of the viewpoint images to form M second images, each of the second images comprising K rows and N columns of pixels, and an n-th row of pixels of an i-th second image being an i-th row of pixels of an n-th viewpoint image, n=1, 2, . . . , K; and encode the M second images to generate M encoded images.