	US 12,307,610 B2
	Content server and method supporting low-latency content streaming
Junhwan Jang, Goyang-si (KR); Woochool Park, Incheon (KR); Jinwook Yang, Uijeongbu-si (KR); Minsu Choi, Seoul (KR); Junsuk Lee, Seoul (KR); and Bonjae Koo, Suwon-si (KR)
Assigned to KOREA ELECTRONICS TECHNOLOGY INSTITUTE, Seongnam-si (KR)
Filed by KOREA ELECTRONICS TECHNOLOGY INSTITUTE, Seongnam-si (KR)
Filed on Dec. 7, 2022, as Appl. No. 18/062,819.
Application 18/062,819 is a continuation of application No. PCT/KR2020/017664, filed on Dec. 4, 2020.
Claims priority of application No. 10-2020-0166229 (KR), filed on Dec. 2, 2020.
Prior Publication US 2023/0100111 A1, Mar. 30, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 7/70 (2017.01); G06T 19/20 (2011.01); G06V 10/44 (2022.01); G06V 10/74 (2022.01); G06V 20/40 (2022.01)

CPC G06T 19/006 (2013.01) [G06T 7/70 (2017.01); G06T 19/20 (2013.01); G06V 10/44 (2022.01); G06V 10/761 (2022.01); G06V 20/49 (2022.01); G06T 2219/2004 (2013.01)]

8 Claims

1. A content server supporting low-latency content streaming, comprising:

a communication interface configured to establish a connection with a user terminal and communicate data with the user terminal; and

a controller configured to:

calculate coordinates for a location of a user and camera pose and create a three-dimensional (3D) space by using terminal data including an image received from the user terminal upon detecting access of the user terminal;

position an object in the created 3D space;

render a video reproduced from a viewpoint of the user as a two-dimensional (2D) video;

generate server data by segmenting the rendered 2D video; and

transmit the generated server data to the user terminal,

wherein the connection between the user terminal and the content server are configured to be established using a web-socket-based asynchronous connection scheme such that the connection is not released unless the content server or the user terminal terminates the connection,

wherein the content server is configured to perform the role of an edge server to the user terminal and is configured to be selected among content servers to be closest to the user terminal, and

wherein the controller is further configured to:

detect the access of the user terminal based on an application or browser being executed in the user terminal accessing a service list page;

provide a service list of currently provided services to the user terminal in response to detecting the access of the user terminal;

initiate a video streaming service to the user terminal in response to detecting the user terminal selecting any content from the service list;

detect feature points in a video by using the received image;

calculate information of at least one of a point-to-point distance, a camera-to-camera distance, or an angle by using the detected feature points;

repeatedly measure a distance to an object by performing triangulation based on the calculated information;

calculate coordinates for the position of the user and camera pose by using the measured information; and

segment the 2D video by using moving picture experts group-dynamic adaptive streaming over hypertext transfer protocol (HTTP) (MPEG-DASH), which is a media segmentation standard.