US 12,148,120 B2
Frame reprojection for virtual reality and augmented reality
Mikhail Mironov, Markham (CA); Gennadiy Kolesnik, Markham (CA); and Pavel Siniavine, Markham (CA)
Assigned to ATI Technologies ULC, Markham (CA)
Filed by ATI Technologies ULC, Markham (CA)
Filed on Dec. 18, 2019, as Appl. No. 16/719,354.
Prior Publication US 2021/0192681 A1, Jun. 24, 2021
Int. Cl. G06T 3/18 (2024.01); G06F 3/01 (2006.01); G06T 3/10 (2024.01); G06T 5/80 (2024.01)
CPC G06T 3/18 (2024.01) [G06F 3/011 (2013.01); G06T 3/10 (2024.01); G06T 5/80 (2024.01); G06T 2207/10016 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A client device for use in processing reality technology content, the client device comprising:
memory configured to store data; and
a processor in communication with the memory and configured to:
receive, from a server device via network communication channel, a video stream comprising encoded video frames and motion vector information,
decode the encoded video frames to form decoded video frames,
select a selected reprojection from a group of reprojections based on a comparison of a velocity of a rotational motion of a head mounted display to a threshold velocity and whether or not an animation is present in the decoded video frames, wherein the group of the reprojections comprises at least:
time warping the decoded video frames,
space warping the decoded video frames using the motion vector information, and
time warping the decoded video frames and space warping the decoded video frames;
form warped video frames by applying the selected reprojection to the decoded video frames, and
display the warped video frames.