US 12,231,736 B2
Bullet-screen comment display
Jun Liu, Shanghai (CN); Yicheng Zhu, Shanghai (CN); Jingping Zhao, Shanghai (CN); and Yu Zhou, Shanghai (CN)
Assigned to SHANGHAI BILIBILI TECHNOLOGY CO., LTD., Shanghai (CN)
Filed by SHANGHAI BILIBILI TECHNOLOGY CO., LTD., Shanghai (CN)
Filed on Oct. 9, 2023, as Appl. No. 18/483,482.
Claims priority of application No. 202211313615.0 (CN), filed on Oct. 25, 2022.
Prior Publication US 2024/0137619 A1, Apr. 25, 2024
Prior Publication US 2024/0236436 A9, Jul. 11, 2024
Int. Cl. H04N 21/4788 (2011.01); G06V 10/25 (2022.01); H04N 21/2187 (2011.01); H04N 21/2343 (2011.01); H04N 21/2743 (2011.01)
CPC H04N 21/4788 (2013.01) [G06V 10/25 (2022.01); H04N 21/2187 (2013.01); H04N 21/234363 (2013.01); H04N 21/2743 (2013.01); G06V 2201/07 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method, applied to a client, comprising:
detecting a target object in an original frame image of a video at a first preset frequency in a process of playing the video, and when the target object is detected, outputting a display area of the target object in the original frame image;
generating a mask image corresponding to the original frame image based on the display area;
obtaining a bullet-screen comment display area corresponding to the original frame image; and
in response to there being an overlapping area between the bullet-screen comment display area and the display area of the target object in the original frame image, combining the mask image and a bullet-screen comment displayed in the bullet-screen comment display area into a video picture with a non-obstructive bullet-screen comment, and displaying the video picture with a non-obstructive bullet-screen comment at a bullet-screen comment layer, wherein a bullet-screen comment comprised in the video picture with a non-obstructive bullet-screen comment does not block the target object.
 
9. A bullet-screen comment display system, wherein the bullet-screen comment display system comprises an online streamer terminal, a plurality of clients installed on an audience terminal, a video server, and a bullet-screen comment server, and the audience terminal is a terminal device of an audience user who views, in a live room of an online streamer, live streaming performed by the online streamer by using the online streamer terminal;
the online streamer terminal is configured to upload a live video of the online streamer to the video server;
the video server is configured to forward the live video to the audience terminal of the audience user who views the live video in the live room of the online streamer;
the bullet-screen comment server is configured to: store a bullet-screen comment sent by the audience user, and forward the stored bullet-screen comment to each client for display by each client; and
each client is configured to: detect a target object in an original frame image of the live video at a first preset frequency in a process of playing the live video, and when the target object is detected, output a display area of the target object in the original frame image; generate a mask image corresponding to the original frame image based on the display area; obtain a bullet-screen comment display area corresponding to the original frame image; and in response to there being an overlapping area between the bullet-screen comment display area and the display area of the target object in the original frame image, combine the mask image and a bullet-screen comment displayed in the bullet-screen comment display area into a video picture with a non-obstructive bullet-screen comment, and display the video picture with a non-obstructive bullet-screen comment at a bullet-screen comment layer, wherein a bullet-screen comment comprised in the video picture with a non-obstructive bullet-screen comment does not block the target object.
 
15. A non-transitory computer-readable storage medium, wherein the computer-readable storage medium stores computer-readable instructions, and when the computer-readable instructions are executed by a processor, the processor performs operations comprising:
detecting a target object in an original frame image of a video at a first preset frequency in a process of playing the video, and when the target object is detected, outputting a display area of the target object in the original frame image;
generating a mask image corresponding to the original frame image based on the display area;
obtaining a bullet-screen comment display area corresponding to the original frame image; and
in response to there being an overlapping area between the bullet-screen comment display area and the display area of the target object in the original frame image, combining the mask image and a bullet-screen comment displayed in the bullet-screen comment display area into a video picture with a non-obstructive bullet-screen comment, and displaying the video picture with a non-obstructive bullet-screen comment at a bullet-screen comment layer, wherein a bullet-screen comment comprised in the video picture with a non-obstructive bullet-screen comment does not block the target object.