US 11,792,392 B2
Video encoding and decoding acceleration utilizing IMU sensor data for cloud virtual reality
Juhyung Son, Gyeonggi-do (KR); Fathan Adi Pranaya, Gyeonggi-do (KR); Jinsam Kwak, Gyeonggi-do (KR); and Jihoon Yun, Seoul (KR)
Assigned to WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC., Gyeonggi-do (KR); and FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY, Seoul (KR)
Filed by WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC., Gyeonggi-do (KR); and FOUNDATION FOR RESEARCH AND BUSINESS, SEOUL NATIONAL UNIVERSITY OF SCIENCE AND TECHNOLOGY, Seoul (KR)
Filed on Apr. 9, 2022, as Appl. No. 17/717,073.
Application 17/717,073 is a continuation of application No. 17/504,479, filed on Oct. 18, 2021, granted, now 11,546,582.
Application 17/504,479 is a continuation of application No. PCT/KR2020/011875, filed on Sep. 3, 2020.
Claims priority of application No. 10-2019-0109782 (KR), filed on Sep. 4, 2019.
Prior Publication US 2022/0232209 A1, Jul. 21, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 19/105 (2014.01); H04N 19/103 (2014.01); H04N 19/167 (2014.01); H04N 19/176 (2014.01); H04N 19/52 (2014.01); H04N 19/597 (2014.01); H04N 19/40 (2014.01); H04N 19/70 (2014.01); H04N 13/332 (2018.01); G06F 3/01 (2006.01)
CPC H04N 19/105 (2014.11) [H04N 19/103 (2014.11); H04N 19/167 (2014.11); H04N 19/176 (2014.11); H04N 19/52 (2014.11); H04N 19/597 (2014.11); G06F 3/012 (2013.01); H04N 13/332 (2018.05); H04N 19/40 (2014.11); H04N 19/70 (2014.11)] 16 Claims
OG exemplary drawing
 
1. An encoding acceleration method of cloud VR (virtual reality) video, the method comprising:
obtaining a center point of a current frame as an identifier of the current frame, wherein the center point is determined according to a sensor data of IMU (Inertial Measurement Unit);
constructing one or more reference frame candidates for encoding of the current frame based on the center point of the current frame;
selecting a specific reference frame among the one or more reference frame candidates based on the sensor data of IMU;
selecting a prediction mode for encoding the current frame based on information included in the specific reference frame; and
encoding the current frame based on the selected prediction mode,
wherein the IMU includes at least one of accelerometers, gyroscopes, and magnetometers.