CPC G06T 7/80 (2017.01) [G06F 3/012 (2013.01); G06T 7/20 (2013.01); G06T 7/50 (2017.01); G06T 15/20 (2013.01); H04N 17/002 (2013.01); H04N 23/661 (2023.01); H04N 23/90 (2023.01); G06T 2207/10028 (2013.01); G06T 2207/30244 (2013.01)] | 16 Claims |
14. A processing method for a processor system for processing image data from a camera in a physical space to render a virtual object in a 3D virtual environment, the virtual object representing an object in the physical space,
the processor system arranged to communicate via a network to a server system, the camera having a camera pose in the physical space and a second device having a second pose in the physical space, the second pose being different from the camera pose, wherein the second device comprises at least one of
a head mounted display;
a user interaction device for sensing a movement of a user in the physical space;
wherein the method comprises:
obtaining image data of the physical space from the camera;
obtaining second data of the second device, wherein the second data is data regarding the position or orientation of the second device in the physical space comprising at least one of
a displacement distance of the second device;
a displacement direction of the second device;
a rotation angle of the second device;
a rotation direction of the second device;
sending the image data, the second data and a calibration command to the server system;
receiving calibration data according to the calibration command from the server system, the calibration data being indicative of the camera pose and the second pose; and
generating 3D object data of the object by processing the image data based on the calibration data, the 3D object data being provided for rendering the virtual object in the 3D virtual environment.
|
16. A processing method for a server system for processing image data from a camera in a physical space for rendering a virtual object in a 3D virtual environment, the virtual object representing an object in the physical space,
the server system arranged to communicate via a network to a processor system, wherein the method comprises:
receiving image data of the physical space obtained by the camera, second data of a second device in the physical space and a calibration command from the processor system, wherein the second device comprises at least one of
a head mounted display;
a user interaction device for sensing a movement of a user in the physical space;
and wherein the second data is data regarding the position or orientation of the second device in the physical space comprising at least one of
a displacement distance of the second device;
a displacement direction of the second device;
a rotation angle of the second device;
a rotation direction of the second device;
processing the image data and the second data according to the calibration command to generate calibration data indicative of the camera pose and the second pose; and
sending the calibration data to the processor system.
|