US 11,989,342 B2
Virtual tourism client, server, system and acquisition device
Yongzhong Zhang, Beijing (CN)
Assigned to BOE Technology Group Co., Ltd., Beijing (CN)
Filed by BOE Technology Group Co., Ltd., Beijing (CN)
Filed on Jun. 24, 2022, as Appl. No. 17/848,411.
Application 17/848,411 is a continuation in part of application No. 16/908,759, filed on Jun. 23, 2020, granted, now 11,565,190.
Claims priority of application No. 201910938062.X (CN), filed on Sep. 30, 2019.
Prior Publication US 2022/0317766 A1, Oct. 6, 2022
Int. Cl. G06F 3/01 (2006.01); A63G 31/16 (2006.01); G06T 3/4053 (2024.01); G06T 7/246 (2017.01); H04N 23/698 (2023.01); A47C 1/02 (2006.01); G06F 1/16 (2006.01); G06Q 50/10 (2012.01)
CPC G06F 3/012 (2013.01) [A63G 31/16 (2013.01); G06F 3/013 (2013.01); G06T 3/4053 (2013.01); G06T 7/248 (2017.01); H04N 23/698 (2023.01); A47C 1/02 (2013.01); G06F 1/163 (2013.01); G06Q 50/10 (2013.01)] 13 Claims
OG exemplary drawing
 
1. A virtual tourism client device, comprising a detector and a head display, wherein:
the detector is configured to detect a change of a viewing direction of a user in real time and generate viewing direction information of the user according to the change of the viewing direction, wherein the change of the viewing direction is a change of a current viewing direction of the user with respect to a reference viewing direction;
the head display is configured to obtain a part of video image data corresponding to the viewing direction information of the user from panoramic video image data with an image reference direction and play the part of the video image data;
the detector comprises a head image obtaining device configured to obtain a head image, and the virtual tourism client device further comprises a head deviation calculator configured to calculate a head deflection angle according to the head image obtained by the head image obtaining device by using a computer vision technology;
the head deviation calculator being configured to calculate the head deflection angle according to the head image obtained by the head image obtaining device by using the computer vision technology comprises:
the head deviation calculator being configured to: obtain a same target feature in two frames of images by using a target tracking algorithm, calculate a head rotation angle according to a horizontal displacement of the target feature, calculate a head pitch angle according to a vertical displacement of the target feature, and obtain a head swing angle according to an included angle between a connecting line of two target features in a first frame of image and a connecting line of the two target features in a second frame of image; or
the head deviation calculator being configured to: obtain a same target feature in two frames of images by using a target tracking algorithm, perform motion prediction of the target feature, calculate a head rotation angle according to a horizontal displacement and a predicted horizontal displacement of the target feature, calculate a head pitch angle according to a vertical displacement and a predicted vertical displacement of the target feature, and obtain a head swing angle according to an included angle between a connecting line of two target features in a first frame of image and a connecting line of the two target features in a second frame of image.