US 12,136,200 B2
Method and system for replacing scene text in a video sequence
Vijay Kumar Baikampady Gopalkrishna, Santa Clara, CA (US); and Raja Bala, Pittsford, NY (US)
Assigned to CareAR Holdings LLC, Norwalk, CT (US)
Filed by CareAR Holdings LLC, Norwalk, CT (US)
Filed on Jun. 30, 2021, as Appl. No. 17/363,293.
Prior Publication US 2023/0005108 A1, Jan. 5, 2023
Int. Cl. G06T 5/77 (2024.01); G06T 5/73 (2024.01); G06T 7/194 (2017.01); G06T 7/30 (2017.01); G06V 20/62 (2022.01); H04N 5/272 (2006.01); G06V 30/10 (2022.01)
CPC G06T 5/77 (2024.01) [G06T 5/73 (2024.01); G06T 7/194 (2017.01); G06T 7/30 (2017.01); G06V 20/63 (2022.01); H04N 5/272 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20081 (2013.01); G06T 2207/20201 (2013.01); G06T 2207/30168 (2013.01); G06V 30/10 (2022.01)] 21 Claims
OG exemplary drawing
 
1. A digital image frame editing method comprising, by a processor:
receiving a video comprising a sequence of digital image frames;
processing the digital image frames to define a region of interest (ROI) that contains original text in each of the digital image frames;
using the ROIs of the digital image frames to select a reference frame from the sequence of digital image frames;
replacing the original text in the ROI of the reference frame with replacement text by inserting a modified reference frame ROI in the reference frame;
selecting a target frame from the sequence of digital image frames, wherein the target frame is a digital image frame of the video that is different from the reference frame;
determining a transform function between the ROI of the reference frame and the ROI of the target frame;
using the transform function to transform the modified reference frame ROI to a modified target frame ROI in which the original text is replaced with the replacement text; and
inserting the modified target frame ROI into the target frame to produce a modified target frame in the sequence of digital image frames.