US 12,217,470 B2
System and method for automatic video reconstruction with dynamic point of interest
Muchlisin Adi Saputra, Jakarta (ID); Shah Dehan Lazuardi, Jakarta (ID); Billy Gunawan, Jakarta (ID); Irfan Yunus Pramono, Jakarta (ID); Soma Wiraga Saniscara, Jakarta (ID); and Junaidillah Fadlil, Jakarta (ID)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Mar. 18, 2022, as Appl. No. 17/698,309.
Application 17/698,309 is a continuation of application No. PCT/KR2021/019960, filed on Dec. 27, 2021.
Claims priority of application No. P00202010669 (ID), filed on Dec. 28, 2020.
Prior Publication US 2022/0207851 A1, Jun. 30, 2022
Int. Cl. G06V 10/20 (2022.01); G06V 10/22 (2022.01); G06V 20/40 (2022.01); G10L 15/26 (2006.01)
CPC G06V 10/235 (2022.01) [G06V 10/255 (2022.01); G06V 20/41 (2022.01); G06V 20/46 (2022.01); G06V 20/49 (2022.01); G10L 15/26 (2013.01)] 15 Claims
OG exemplary drawing
 
1. A method of automatically generating video reconstruction, the method comprising:
dividing a first video into a plurality of first frames;
determining a first object of interest in the plurality of first frames based on a user selection on a user interface or based on an intent recognition module using a natural language processing, wherein the user interface provides a preview of objects present in the plurality of first frames, and wherein the intent recognition module processes a text to determine whether an intent of the text is selecting to focus on a particular object or selecting an unwanted object;
converting the plurality of first frames into a plurality of second frames based on the first object of interest; and
reconstructing the first video into a second video based on the plurality of second frames,
wherein, in a case of determining the first object of interest based on the intent recognition module, the converting the plurality of first frames comprises:
extracting at least one of a point of interest or a line of interest for the first object of interest included in a first frame of the plurality of first frames; and
if the intent of the text is selecting the unwanted object, deleting the first object of interest from the plurality of first frames to obtain the plurality of second frames not including the first object of interest; or
if the intent of the text is selecting to focus on the particular object, reconstructing the first frame based on the at least one of the point of interest or the line of interest to obtain the plurality of second frames including the first object of interest.