US 11,989,978 B2
Method of detecting user interaction and electronic device supporting the same
Jeongwook Park, Paju-si (KR); Myeonghyeon Hwang, Paju-si (KR); Suhyoung Lim, Paju-si (KR); Jungwoo Choi, Seoul (KR); and Youngsun Seo, Seoul (KR)
Assigned to WOONGJIN THINKBIG CO., LTD., Paju-si (KR); and ARTYGENSPACE CO., LTD., Seoul (KR)
Filed by WOONGJIN THINKBIG CO., LTD., Paju-si (KR); and ARTYGENSPACE CO., LTD., Seoul (KR)
Filed on Dec. 27, 2022, as Appl. No. 18/146,632.
Claims priority of application No. 10-2021-0193214 (KR), filed on Dec. 30, 2021.
Prior Publication US 2023/0215218 A1, Jul. 6, 2023
Int. Cl. G06F 3/042 (2006.01); G06F 3/01 (2006.01); G06T 7/62 (2017.01); G06V 10/20 (2022.01); G06V 20/20 (2022.01); G06V 40/20 (2022.01)
CPC G06V 40/28 (2022.01) [G06F 3/011 (2013.01); G06F 3/042 (2013.01); G06T 7/62 (2017.01); G06V 10/255 (2022.01); G06V 20/20 (2022.01); G06V 2201/131 (2022.01)] 14 Claims
OG exemplary drawing
 
1. A method of detecting a user interaction by an electronic device, the method comprising:
acquiring, by a processor of the electronic device, through a camera, a first image of a real document in which at least one first area is printed, the first image including a plurality of frames sequentially acquired though the camera;
based on at least a part of the at least one first area of the real document being hidden by an input tool, determining, by the processor, that an area of at least one object corresponding to the at least one first area is changed within the plurality of frames, the at least one object respectively representing the at least one first area in the plurality of frame; and
based on determining that the area of the at least one object is changed, performing, by the processor, a function of the electronic device corresponding to the at least one object,
wherein based on at least the part of the at least one first area of the real document being hidden, the area of the at least one object which has existed in a first frame disappears in a second frame next to the first frame or a size of the area of the at least one object is reduced in a portion of the plurality of frames, the first frame and the second frame being included in the plurality of frames,
wherein based on determining that an area of a first object included in the at least one object is changed, a first function of the electronic device corresponding to the first object is performed, and
wherein based on determining that an area of a second object included in the at least one object is changed, a second function of the electronic device corresponding to the second object is performed, the second object being different from the first object, the second function being different from the first function.