US 12,031,300 B2
High-accuracy augmented reality display for construction machines
Darrin Hurd, Christchurch (NZ); and Stuart Ralston, Christchurch (NZ)
Assigned to Trimble Inc., Sunnyvale, CA (US)
Filed by Trimble Inc., Sunnyvale, CA (US)
Filed on Nov. 5, 2020, as Appl. No. 17/090,653.
Prior Publication US 2022/0136214 A1, May 5, 2022
Int. Cl. B60K 35/00 (2024.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); B60K 35/60 (2024.01); B60K 35/65 (2024.01); E02F 9/26 (2006.01)
CPC E02F 9/261 (2013.01) [B60K 35/00 (2013.01); E02F 9/264 (2013.01); B60K 35/23 (2024.01); B60K 35/28 (2024.01); B60K 35/60 (2024.01); B60K 35/65 (2024.01); B60K 2360/166 (2024.01); B60K 2360/168 (2024.01); B60K 2360/169 (2024.01); B60K 2360/177 (2024.01); B60K 2360/179 (2024.01); B60K 2360/21 (2024.01); B60K 2360/31 (2024.01); B60K 2360/334 (2024.01); B60K 2360/741 (2024.01); B60K 2360/785 (2024.01)] 17 Claims
OG exemplary drawing
 
8. A system for displaying augmented reality (AR) elements on a display system of a construction machine, the system comprising:
one or more processors; and
a computer-readable medium comprising instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:
detecting a position of the construction machine in a world reference frame;
detecting an orientation of the construction machine;
detecting a position of an operator of the construction machine in a machine reference frame;
determining a position of the operator in the world reference frame based on the position of the operator in the machine reference frame, the position of the construction machine in the world reference frame, and the orientation of the construction machine;
generating the AR elements based on the position of the operator in the world reference frame and a position of the display system in the world reference frame, wherein the AR elements include:
an implement virtual element corresponding to a position of an implement of the construction machine, the implement virtual element being aligned with a bottom edge of the implement from the operator's perspective;
a design virtual element corresponding to a design to be carried out by the operator using the construction machine;
a world virtual element corresponding to a surface of a ground below the position of the implement; and
a relationship virtual element indicating a direction or a distance between the implement virtual element and either the design virtual element or the world virtual element, wherein the relationship virtual element is positioned between the implement virtual element and either the design virtual element or the world virtual element; and
displaying the AR elements on the display system.