US 12,148,104 B2
System, apparatus and method for providing adaptive AR streaming service
Hwang Jun Song, Pohang-si (KR); and Hyun Min Noh, Incheon (KR)
Assigned to POSTECH RESEARCH AND BUSINESS DEVELOPMENT FOUNDATION, Pohang-si (KR)
Filed by POSTECH Research and Business Development Foundation, Pohang-si (KR)
Filed on Apr. 27, 2022, as Appl. No. 17/731,063.
Claims priority of application No. 10-2021-0171168 (KR), filed on Dec. 2, 2021.
Prior Publication US 2023/0177779 A1, Jun. 8, 2023
Int. Cl. G06T 19/00 (2011.01); G06T 7/73 (2017.01); G06T 19/20 (2011.01); H04L 65/65 (2022.01); H04L 65/80 (2022.01)
CPC G06T 19/006 (2013.01) [G06T 7/73 (2017.01); G06T 19/20 (2013.01); H04L 65/65 (2022.05); H04L 65/80 (2013.01); G06T 2207/30204 (2013.01); G06T 2210/36 (2013.01); G06T 2219/2016 (2013.01)] 11 Claims
OG exemplary drawing
 
1. A system for providing an adaptive augmented reality (AR) streaming service, comprising:
a mobile AR device that includes an AR object composed of a plurality of progressive mesh chunks, is configured to communicate with a cloud AR server where a meta file containing property information of the AR object and progressive mesh chunks is stored, and is configured to implement augmented reality,
the mobile AR device comprises:
a marker detector configured to detect a marker to identify a marker identification (ID), coordinates, and a corresponding uniform resource locator (URL) of the AR object and request a meta file to the cloud AR server to identify properties of the AR object based on the URL;
a network monitor configured to collect network status and estimate available throughput;
a chunk scheduler configured to receive the meta file from the cloud AR server, select a chunk to improve quality of a visual perception of a user based on the available throughput, and request the selected chunk to the cloud AR server; and
an object renderer configured to receive the chunk from the cloud AR server and render an AR object matching the received chunk,
wherein a processor of the mobile AR device is configured to measure a level of detail (LOD) quality of angles at which the AR object is projected onto a camera, receive quality information from the cloud AR server about rotation angles that reduce an amount of quality information according to the rotation angles of the AR object through downsampling and singular value decomposition (SVD), and perform chunk scheduling or rendering according to quality according to the rotation angle of the AR object projected onto a screen of the mobile AR device.