US 11,934,624 B2
Electronic apparatus, control method thereof, and computer readable recording medium for providing a control command to an external apparatus
Byuksun Kim, Suwon-si (KR); Kyoungjae Park, Suwon-si (KR); and Jinwuk Choi, Suwon-si (KR)
Assigned to Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed by SAMSUNG ELECTRONICS CO., LTD., Suwon-si (KR)
Filed on Dec. 13, 2018, as Appl. No. 16/219,611.
Claims priority of application No. 10-2017-0174751 (KR), filed on Dec. 19, 2017.
Prior Publication US 2019/0187873 A1, Jun. 20, 2019
Int. Cl. G06F 3/04812 (2022.01); G06F 3/038 (2013.01); G06F 3/0482 (2013.01); G06F 3/04842 (2022.01); G06F 3/04883 (2022.01); G06F 3/16 (2006.01); G08C 17/02 (2006.01); G08C 19/28 (2006.01); H04N 21/422 (2011.01); H04N 21/436 (2011.01); H04N 21/443 (2011.01)
CPC G06F 3/04812 (2013.01) [G06F 3/038 (2013.01); G06F 3/0482 (2013.01); G06F 3/04842 (2013.01); G06F 3/04883 (2013.01); G06F 3/167 (2013.01); G08C 17/02 (2013.01); G08C 19/28 (2013.01); H04N 21/42203 (2013.01); H04N 21/42204 (2013.01); H04N 21/43615 (2013.01); H04N 21/4438 (2013.01)] 13 Claims
OG exemplary drawing
 
1. An electronic apparatus comprising:
a communicator comprising communication circuitry configured to receive image signals from a plurality of external apparatuses;
an input receiver comprising input receiving circuitry configured to receive a user input;
a display; and
a processor configured to control the electronic apparatus to:
receive, from each of a plurality of external apparatuses connected to the electronic apparatus, screen information output by the plurality of external apparatuses;
obtain at least one of a logo or a manufacturer name, corresponding the each of the plurality of external apparatuses by applying an artificial intelligence system;
obtain information identifying the plurality of external apparatuses connected to the electronic apparatus based on the obtained at least one of the logo or the manufacturer name, wherein the information identifying at least one of the plurality of external apparatuses is identified;
control the display to display a first screen including first content received from a first external apparatus of the plurality of external apparatuses in a first portion of the first screen, a plurality of objects corresponding to the plurality of external apparatuses connected to the electronic apparatus in a second portion of the first screen, and a list, set based on user's using history of the plurality of external apparatuses, including a plurality of predetermined operation commands executable at one or more of the plurality of external apparatuses connected to the electronic apparatus in a third portion of the first screen,
during the display of the first screen, receive a first user input to execute a first application among a plurality of applications executable by the plurality of external apparatuses connected to the electronic apparatus;
in response to receiving the first user input, extract information regarding one or more applications that can be provided by each of the plurality of external apparatuses based on the screen information received from the plurality of external apparatuses, identify an external apparatus including the first application, from among the plurality of external apparatuses, based on the extracted information, and select a first object, from among the plurality of displayed objects corresponding to the plurality of external apparatuses, corresponding to the identified external apparatus including the first application;
in response to selecting the first object corresponding to the identified external apparatus, controlling the display to display a second screen including a plurality of application objects corresponding to a plurality of applications included in the identified external apparatus based on an image signal received from the identified external apparatus;
analyze the second screen provided by the identified external apparatus;
determine arrangements of applications included in the second screen and types of applications provided by the identified external apparatus;
identify a current position of a cursor on the second screen;
identify a first application object where the cursor is positioned from among the plurality of application objects in the second screen;
identify a second application object corresponding to the first application from among the plurality of application objects included in the second screen;
generate a first control signal to move the cursor from the first application object to the second application object based on the determined arrangements and the determined types of applications;
control the communicator to transmit the first control signal to the identified external apparatus;
receive an image signal obtained after the transmitted first control signal is executed from the identified external apparatus;
display a third screen including a plurality of application objects and the cursor which is moved from first application object to the second application object;
when an application object where the cursor is currently positioned after the first control signal is transmitted is the second application object, generate a second control signal to execute the first application corresponding to the second application object where the cursor is currently positioned; and
control the communicator to transmit the second control signal to the identified external apparatus,
wherein the selecting the identified external apparatus and the control signal including the plurality of control signals for the cursor are provided in response to the first user input without receiving additional user inputs for selecting the first application.