US 12,033,245 B2
System and method for mixed reality
Amir Sheffer, Haifa (IL); Ayelet Mashiah, Haifa (IL); Ofer Livneh, Haifa (IL); and Yoav Ophir, Haifa (IL)
Assigned to ELBIT SYSTEMS LTD., Haifa (IL)
Filed by ELBIT SYSTEMS LTD., Haifa (IL)
Filed on Aug. 29, 2023, as Appl. No. 18/457,367.
Application 18/457,367 is a continuation of application No. 17/741,482, filed on May 11, 2022, granted, now 11,783,515.
Application 17/741,482 is a continuation of application No. PCT/IL2020/051179, filed on Nov. 5, 2020.
Claims priority of application No. 270754 (IL), filed on Nov. 18, 2019; and application No. 270755 (IL), filed on Nov. 18, 2019.
Prior Publication US 2023/0401759 A1, Dec. 14, 2023
Int. Cl. G06T 11/00 (2006.01)
CPC G06T 11/00 (2013.01) 18 Claims
OG exemplary drawing
 
1. A mixed reality system, comprising:
a sensor configured to acquire readings of real-world data, and display, on an output device, a real-world visualization of the real-world data based on the readings to a user, wherein the sensor has one or more parameters affecting the real-world visualization; and
a processing circuitry configured to:
obtain (a) information of one or more virtual entities located within an area from which the readings are acquired, the information defining, for each of the virtual entities, one or more simulated physical properties, and (b) values of one or more situational parameters indicative of a state of the sensor during acquisition of the readings, wherein the values of the one or more situational parameters are readings of one or more situational sensors, sensing the state of the sensor and its surroundings during acquisition of the readings;
determine, for at least one given virtual entity of the virtual entities, a virtual entity visualization of the given virtual entity, the virtual entity visualization determined by manipulating a simulated reading of the simulated physical properties based on (a) the parameters affecting the real-world visualization, and (b) the values of the situational parameters, wherein the virtual entity visualization of the given virtual entity is perceived closer to a third visualization of the given virtual entity had it been a real-world entity having physical properties identical to the simulated physical properties than an alternative visualization of the given virtual entity determined without manipulating the simulated reading of the simulated physical properties based on the parameters affecting the readings of the sensor; and
display the virtual entity visualizations in combination with the real-world visualization, thereby enabling a user viewing the output device to view the virtual entity visualizations and the real-world visualization.