US 11,998,819 B2
Virtual environment construction apparatus, video presentation apparatus, model learning apparatus, optimal depth decision apparatus, methods for the same, and program
Kosuke Takahashi, Yokosuka (JP); Dan Mikami, Yokosuka (JP); Mariko Isogawa, Yokosuka (JP); Akira Kojima, Yokosuka (JP); Hideaki Kimata, Yokosuka (JP); and Ayumi Matsumoto, Yokosuka (JP)
Assigned to NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Chiyoda-ku (JP)
Filed by NIPPON TELEGRAPH AND TELEPHONE CORPORATION, Chiyoda-ku (JP)
Filed on Jun. 21, 2022, as Appl. No. 17/845,010.
Application 17/845,010 is a continuation of application No. 17/078,418, filed on Oct. 23, 2020, granted, now 11,395,947.
Application 17/078,418 is a continuation of application No. 16/070,382, granted, now 10,850,177, previously published as PCT/JP2017/002665, filed on Jan. 26, 2017.
Claims priority of application No. 2016-014487 (JP), filed on Jan. 28, 2016; application No. 2016-014488 (JP), filed on Jan. 28, 2016; application No. 2016-107729 (JP), filed on May 30, 2016; application No. 2016-107730 (JP), filed on May 30, 2016; application No. 2016-171420 (JP), filed on Sep. 2, 2016; and application No. 2016-212800 (JP), filed on Oct. 31, 2016.
Prior Publication US 2022/0314092 A1, Oct. 6, 2022
Int. Cl. G06T 19/00 (2011.01); A63B 69/00 (2006.01); G06F 17/18 (2006.01)
CPC A63B 69/0002 (2013.01) [G06F 17/18 (2013.01); G06T 19/00 (2013.01); G06T 19/006 (2013.01); A63B 2069/0006 (2013.01); A63B 2069/0008 (2013.01)] 9 Claims
OG exemplary drawing
 
1. A virtual reality system that includes a virtual environment construction apparatus that constructs a virtual environment to be used for generating a video based on a real environment in which a plurality of objects are present, the virtual reality system comprising:
the virtual environment construction apparatus which includes circuitry configured to
for at least one of the plurality of objects as a target object, decide a model construction method indicating whether a model of the object is constructed with computer graphics (CG) or with a live-action video based on at least one of a sensing difficulty level and a CG drawing difficulty level of the target object,
measure a state of the target object in the real environment,
construct an environment model for drawing in the virtual environment in accordance with the model construction method for a static object which does not involve temporal change, and
construct a model for drawing in the virtual environment in accordance with the model construction method for a dynamic object which involves temporal change, and synthesizes the model with the environment model; and
a virtual reality head mounted display which presents a video to the user based on the synthesized model constructed by the virtual environment construction apparatus.