US 12,325,982 B2
Construction site orchestration using dynamic computer vision
Karoliina Torttila, Helsinki (FI); Jim Coleman, Longmont, CO (US); Robert Banfield, Riverview, FL (US); and Vishakaraj Shanmugavel, Denver, CO (US)
Assigned to Trimble Inc., Westminster, CO (US)
Filed by Trimble Inc., Westminster, CO (US)
Filed on Nov. 2, 2022, as Appl. No. 17/979,460.
Prior Publication US 2024/0141624 A1, May 2, 2024
Int. Cl. G06T 7/70 (2017.01); E02F 9/20 (2006.01); E02F 9/26 (2006.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/56 (2022.01)
CPC E02F 9/264 (2013.01) [E02F 9/205 (2013.01); E02F 9/261 (2013.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/56 (2022.01)] 20 Claims
OG exemplary drawing
 
1. A method for orchestrating activities at an earthmoving site, the method comprising:
capturing, by an image capturing device removably fixed to a mobile earthmoving machine, a stream of images recorded as captured digital data, wherein a field of view of the image capturing device overlaps with a working range of an attachment coupled to the mobile earthmoving machine;
selecting, by the image capturing device, a first subset of images from the stream of images captured during a first time period;
generating, by a first trained algorithm existing in a memory of the image capturing device, and using the first subset of images, a probability that the first subset of images depicts a first action of a plurality of actions performable by the mobile earthmoving machine;
determining, by the image capturing device based on the probability, that the mobile earthmoving machine was performing the first action during the first time period;
selecting, by the image capturing device, and in response to determining that the mobile earthmoving machine was performing the first action during the first time period, an image from the first subset of images; and
transmitting, by the image capturing device, the image and a first indication that the mobile earthmoving machine was performing the first action during the first time period to a remote server system through a network.