US 12,229,041 B2
Tool for mobile app development and testing using a physical mobile device
Benjamin Poynter, New York, NY (US); and David E. Rodriguez, Harrison, NJ (US)
Assigned to Sphere Entertainment Group, LLC, New York, NY (US)
Filed by Sphere Entertainment Group, LLC, New York, NY (US)
Filed on May 7, 2021, as Appl. No. 17/314,193.
Prior Publication US 2022/0358027 A1, Nov. 10, 2022
Int. Cl. G06F 11/36 (2006.01); G06F 3/01 (2006.01); G06T 7/11 (2017.01); G06T 15/20 (2011.01); H04W 88/02 (2009.01)
CPC G06F 11/3664 (2013.01) [G06F 3/011 (2013.01); G06F 11/3688 (2013.01); G06T 7/11 (2017.01); G06T 15/20 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/20132 (2013.01); H04W 88/02 (2013.01)] 21 Claims
OG exemplary drawing
 
1. A system for mobile application testing, comprising:
a virtual reality (VR) simulator device comprising:
a non-transitory computer-readable device having instructions stored thereon; and
at least one computing device executing the instructions and configured by the instructions to:
receive at least captured data inputs and outputs from a remote application resident on a physical mobile device during the mobile application testing, wherein the received data inputs and outputs of the physical mobile device are converted into a network stream by a mobile application plugin configured to listen for and communicate physical, simulated and virtual data points associated with the physical mobile device, wherein the data points include audio, video, camera, or sensor data of the physical mobile device;
simulate a real-world environment;
generate a virtual visualization of the physical mobile device;
capture, based on accessing a configuration look-up table of the physical mobile device, at least one of video or audio of a virtual scene in the simulated real-world environment with at least one of a virtual camera or a virtual microphone from a position of the virtual visualization of the physical mobile device, wherein the virtual camera or the virtual microphone are positioned in the virtual visualization of the physical mobile device at respective locations found on the physical mobile device;
render a VR simulation to recreate a real-world testing environment based at least partially on combining the network stream of the captured data inputs and outputs, the virtual visualization of the physical mobile device, the simulated real-world environment, and the captured video or audio of the virtual scene; and
communicate the VR simulation to a VR headset during the mobile application testing.