US 12,445,725 B1
Image stabilization for a multi-sensor camera
Shimon Pertsel, Mountain View, CA (US); Moshe Doron, San Francisco, CA (US); and Didier LeGall, Los Altos, CA (US)
Assigned to Ambarella International LP, Santa Clara, CA (US)
Filed by Ambarella International LP, Santa Clara, CA (US)
Filed on Oct. 7, 2021, as Appl. No. 17/495,858.
Application 15/978,708 is a division of application No. 15/070,281, filed on Mar. 15, 2016, abandoned.
Application 17/495,858 is a continuation of application No. 15/978,708, filed on May 14, 2018, abandoned.
Int. Cl. H04N 5/265 (2006.01); H04N 5/91 (2006.01); H04N 23/45 (2023.01); H04N 23/68 (2023.01)
CPC H04N 23/683 (2023.01) [H04N 5/265 (2013.01); H04N 5/91 (2013.01); H04N 23/45 (2023.01)] 19 Claims
OG exemplary drawing
 
1. An apparatus comprising:
a plurality of capture devices each configured to generate a video signal in response to pixel data captured, wherein one of said capture devices generates vibration information in response to a movement of said capture devices detected while said pixel data is captured; and
a processor configured to (i) receive (A) said video signals from at least two of said capture devices and (B) said vibration information from at least one of said capture devices, (ii) process said pixel data in said video signals arranged as video frames, (iii) perform a video stitching operation on said video frames, (iv) generate a stitched video based on said video stitching operation and (v) calculate image stabilization data for said stitched video in response to (A) said stitched video and (B) said vibration information, wherein
(a) said pixel data from one of said video signals is used by said processor to perform image stabilization for said video frames from another of said video signals based on said image stabilization data,
(b) said vibration information is stored separately from said video signals and communicated with said stitched video,
(c) said image stabilization occurs by rotating said stitched video after said video stitching operation in response to said image stabilization data, and
(d) said stitched video and said image stabilization data are communicated to a playback device remotely located from said apparatus to enable said playback device to perform said image stabilization on said stitched video to compensate in real-time during playback of said stitched video for said movement of said capture devices that occurred before said playback.