US 11,862,154 B2
Electronic device and controlling method thereof
Young-chul Sohn, Seoul (KR); Gyu-tae Park, Seoul (KR); Ki-beom Lee, Seoul (KR); and Jong-ryul Lee, Seoul (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Jun. 5, 2020, as Appl. No. 16/893,643.
Application 16/893,643 is a continuation of application No. 15/803,051, filed on Nov. 3, 2017, granted, now 10,679,618.
Claims priority of application No. 10-2016-0145742 (KR), filed on Nov. 3, 2016; and application No. 10-2017-0106127 (KR), filed on Aug. 22, 2017.
Prior Publication US 2020/0302928 A1, Sep. 24, 2020
This patent is subject to a terminal disclaimer.
Int. Cl. G10L 15/22 (2006.01); G06F 3/16 (2006.01); G10L 15/18 (2013.01); H04N 21/422 (2011.01); G10L 17/22 (2013.01); H04L 12/28 (2006.01); H04N 21/439 (2011.01); H04N 21/44 (2011.01); H04N 21/41 (2011.01); H04N 21/4223 (2011.01); G10L 15/08 (2006.01)
CPC G10L 15/22 (2013.01) [G06F 3/167 (2013.01); G10L 15/18 (2013.01); G10L 17/22 (2013.01); H04L 12/28 (2013.01); H04N 21/4131 (2013.01); H04N 21/4223 (2013.01); H04N 21/42203 (2013.01); H04N 21/4394 (2013.01); H04N 21/44008 (2013.01); G10L 2015/088 (2013.01); G10L 2015/223 (2013.01)] 16 Claims
OG exemplary drawing
 
1. A controlling method of an electronic device, the method comprising:
acquiring voice information and image information for setting a condition and an action to be executed according to the condition, the voice information being obtained from a user voice corresponding to a single voice input, the image information being obtained via a camera;
identifying an event that is to be detected according to the condition and a function to be executed according to the action based on the voice information and the image information, and storing the event and the function;
identifying at least one external sensor, distinct from the camera, to detect the event;
based on the at least one external sensor being identified, transmitting control information requesting detection of the event to the at least one external sensor; and
based on receiving a result of detection of the event from the at least one external sensor, performing an operation for executing the function according to the action.