US 12,002,170 B2
Cross reality system with buffering for localization accuracy
Ali Shahrokni, San Jose, CA (US); Keng-Sheng Lin, Mountain View, CA (US); Xuan Zhao, San Jose, CA (US); Christian Ivan Robert Moore, Cupertino, CA (US); and Ashwin Swaminathan, Dublin, CA (US)
Assigned to Magic Leap, Inc., Plantation, FL (US)
Filed by Magic Leap, Inc., Plantation, FL (US)
Filed on Aug. 24, 2022, as Appl. No. 17/894,336.
Application 17/894,336 is a division of application No. 17/185,706, filed on Feb. 25, 2021, granted, now 11,557,099.
Claims priority of provisional application 62/981,961, filed on Feb. 26, 2020.
Prior Publication US 2022/0406024 A1, Dec. 22, 2022
Int. Cl. G06T 19/00 (2011.01); G06T 7/70 (2017.01); H04L 67/131 (2022.01)
CPC G06T 19/006 (2013.01) [G06T 7/70 (2017.01); H04L 67/131 (2022.05)] 14 Claims
OG exemplary drawing
 
1. An electronic device for rendering virtual content with dynamic buffering in a cross reality environment, comprising:
a sensor that captures image information about a three-dimensional (3D) environment, the image information comprising a plurality of images;
a processor that executes computer executable instructions, wherein the computer executable instructions comprise instructions, when executed by the processor, cause the processor to perform a set of acts, the set of acts comprising:
generating a local coordinate frame for representing an object or a portion thereof in the 3D environment;
determining a first set of features from the image information of the 3D environment;
forwarding the first set of features expressed in the local coordinate frame to a localization service on a remote server; and
receiving, from the localization service, at least one transform that localizes the local coordinate frame to a separate coordinate frame of a canonical map of a shareable world model,
wherein the set of acts further comprises sending a request for localization to the localization service based at least in part upon first cross entropy for the first set of features and second cross entropy for a second set of features that has been transmitted to the localization service.