US 12,236,057 B2
Audio playback and screen display method and device therefor
Ikhee Choi, Suwon-si (KR); Bongje Cho, Suwon-si (KR); Eunji Choi, Suwon-si (KR); and Yeunwook Lim, Suwon-si (KR)
Assigned to SAMSUNG ELECTRONICS CO., LTD., Gyeonggi-Do (KR)
Filed by Samsung Electronics Co., Ltd., Suwon-si (KR)
Filed on Feb. 6, 2023, as Appl. No. 18/164,644.
Application 18/164,644 is a continuation of application No. PCT/KR2021/009426, filed on Jul. 21, 2021.
Claims priority of application No. 10-2020-0097638 (KR), filed on Aug. 4, 2020.
Prior Publication US 2023/0244351 A1, Aug. 3, 2023
Int. Cl. G06F 3/0481 (2022.01); G06F 3/0488 (2022.01); G06F 3/16 (2006.01)
CPC G06F 3/0481 (2013.01) [G06F 3/0488 (2013.01); G06F 3/162 (2013.01)] 16 Claims
OG exemplary drawing
 
11. A method for operating an electronic device, the method comprising:
displaying a first execution screen of an application;
acquiring an input for playing audio data of the application while the first execution screen is displayed;
outputting audio corresponding to the audio data through a speaker in response to the acquisition of the input;
determining whether a handwriting associated with the outputted audio exists while outputting the audio, wherein the handwriting associated with the outputted audio is a handwriting previously input through an input area of the first execution screen corresponding to the application and previously mapped to a playback point-in-time of the outputted audio;
determining whether the handwriting is displayed in the first execution screen, based on the determination that the handwriting associated with the outputted audio exists;
determining whether an image displayed in the first execution screen is associated with the handwriting; and
performing scroll on the first execution screen, when the handwriting is not displayed in the first execution screen, such that the handwriting is displayed through the first execution screen while the audio is outputted,
wherein the image is fixed in an area in the first execution screen and the scroll is performed with regard to the handwriting when the image is associated with the handwriting, and the scroll is performed with regard to the handwriting and the image when the image is not associated with the handwriting, and
wherein while the handwriting associated with the outputted audio does not exist, the audio is output without displaying the handwriting.