US 12,010,440 B2
Optical image stabilization movement to create a super-resolution image of a scene
Yi Hung Chen, Taipei (TW); Chia-Kai Liang, San Jose, CA (US); Bartlomiej Maciej Wronski, San Francisco, CA (US); Peyman Milanfar, Menlo Park, CA (US); and Ignacio Garcia Dorado, Mountain View, CA (US)
Assigned to Google LLC, Mountain View, CA (US)
Filed by Google LLC, Mountain View, CA (US)
Filed on Mar. 15, 2023, as Appl. No. 18/184,179.
Application 18/184,179 is a continuation of application No. 17/263,743, granted, now 11,611,697, previously published as PCT/US2019/045334, filed on Aug. 6, 2019.
Claims priority of provisional application 62/716,346, filed on Aug. 8, 2018.
Prior Publication US 2023/0224596 A1, Jul. 13, 2023
This patent is subject to a terminal disclaimer.
Int. Cl. H04N 23/951 (2023.01); G06T 3/4069 (2024.01); H04N 23/68 (2023.01)
CPC H04N 23/951 (2023.01) [G06T 3/4069 (2013.01); H04N 23/6811 (2023.01); H04N 23/6812 (2023.01); H04N 23/685 (2023.01); H04N 23/687 (2023.01)] 20 Claims
OG exemplary drawing
 
1. A method to create a super-resolution image of a scene, the method performed by a user device and comprising:
detecting that the user device has entered a viewfinder mode;
introducing, based on detecting that the user device has entered the viewfinder mode and through an optical image stabilization system, movement to one or more components of a camera system;
capturing respective and multiple frames of an image of the scene, the respective and multiple frames of the image of the scene having respective, sub-pixel offsets of the image of the scene across the multiple frames as a result of the introduced movement to the one or more components of the camera system;
performing, based on the respective, sub-pixel offsets of the image of the scene across the multiple frames, super-resolution computations; and
creating, based on the super-resolution computations, the super-resolution image of the scene.