US 12,243,184 B2
Virtual lens simulation for video and photo cropping
David A. Newman, Del Mar, CA (US); Joshua Edward Bodinet, San Diego, CA (US); Otto Kenneth Sievert, Oceanside, CA (US); and Timothy MacMillan, La Honda, CA (US)
Assigned to GoPro, Inc., San Mateo, CA (US)
Filed by GoPro, Inc., San Mateo, CA (US)
Filed on Jun. 23, 2023, as Appl. No. 18/340,611.
Application 18/340,611 is a continuation of application No. 17/513,415, filed on Oct. 28, 2021, granted, now 11,688,034.
Application 17/513,415 is a continuation of application No. 17/075,943, filed on Oct. 21, 2020, granted, now 11,164,282, issued on Nov. 2, 2021.
Application 17/075,943 is a continuation of application No. 16/884,962, filed on May 27, 2020, granted, now 10,817,977, issued on Oct. 27, 2020.
Application 16/884,962 is a continuation of application No. 16/713,839, filed on Dec. 13, 2019, granted, now 10,679,323, issued on Jun. 9, 2020.
Application 16/713,839 is a continuation of application No. 16/535,940, filed on Aug. 8, 2019, granted, now 10,529,052, issued on Jan. 7, 2020.
Application 16/535,940 is a continuation of application No. 16/229,512, filed on Dec. 21, 2018, granted, now 10,395,338, issued on Aug. 27, 2019.
Application 16/229,512 is a continuation of application No. 15/157,207, filed on May 17, 2016, granted, now 10,186,012, issued on Jan. 22, 2019.
Claims priority of provisional application 62/164,409, filed on May 20, 2015.
Prior Publication US 2023/0334616 A1, Oct. 19, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. G06T 3/047 (2024.01); G06T 3/00 (2006.01); G06T 3/40 (2006.01); G06T 5/80 (2024.01)
CPC G06T 3/047 (2024.01) [G06T 3/00 (2013.01); G06T 3/40 (2013.01); G06T 5/80 (2024.01); G06T 2207/10004 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20021 (2013.01); G06T 2210/22 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A system for simulating image distortion of a virtual lens in a video, the system comprising:
one or more processors; and
a non-transitory computer-readable storage medium storing instructions that when executed cause the one or more processors to perform steps including:
accessing input images, the input images including fields of view of a scene, the input images depicting the scene with an input lens distortion centered in the fields of view;
selecting reduced fields of view of the scene smaller than the fields of view of the input images, the reduced fields of view including lens distortion effects as a function of the input lens distortion centered in the fields of view of the input images, positions of the reduced fields of view within the fields of view of the input images, and size of the reduced fields of view; and
generating video frames of an output video based on the lens distortion effects in the reduced fields of view and a desired lens distortion, the video frames of the output video including portions of the input images within the reduced fields of view, wherein generation of the video frames includes remapping of the input lens distortion centered in the fields of view of the input images to the desired lens distortion centered in the reduced fields of view to transform the lens distortion effects present in the reduced fields of view to the desired lens distortion, wherein the output video has consistent frame-to-frame lens characteristics.