US 12,280,870 B2
Method(s) and system(s) for enabling augmented reality scouting of an agricultural field
Elliott Grant, Woodside, CA (US); Zhiqiang Yuan, San Jose, CA (US); and Bodi Yuan, Sunnyvale, CA (US)
Assigned to Deere & Company, Moline, IL (US)
Filed by Deere & Company, Moline, IL (US)
Filed on Apr. 11, 2022, as Appl. No. 17/717,845.
Prior Publication US 2023/0320250 A1, Oct. 12, 2023
Int. Cl. B64C 39/02 (2023.01); A01B 79/00 (2006.01); A01B 79/02 (2006.01); B64U 101/30 (2023.01); G02B 27/01 (2006.01); G06N 5/04 (2023.01); G06T 19/00 (2011.01); G06V 10/25 (2022.01); G06V 20/10 (2022.01); G06V 20/17 (2022.01); G06V 20/20 (2022.01)
CPC B64C 39/024 (2013.01) [A01B 79/005 (2013.01); A01B 79/02 (2013.01); G02B 27/0101 (2013.01); G02B 27/017 (2013.01); G06N 5/04 (2013.01); G06T 19/006 (2013.01); G06V 10/25 (2022.01); G06V 20/17 (2022.01); G06V 20/188 (2022.01); G06V 20/20 (2022.01); B64U 2101/30 (2023.01); B64U 2201/10 (2023.01); G02B 2027/014 (2013.01); G02B 2027/0141 (2013.01); G06T 2219/004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A method implemented by one or more processors, the method comprising:
receiving, at a mobile computing device of a user, a stream of vision data, the stream of vision data being generated by one or more vision components of a wearable computing device of the user;
processing, at the mobile computing device, and using one or more inference machine learning models, the stream of vision data to generate a stream of agricultural annotations with respect to an area of interest of an agricultural field that is captured in the stream of vision data, the stream of agricultural annotations to include a label and a predicted measure indicative of a likelihood that the area of interest includes an item corresponding to the label, wherein the item corresponds to the label when the predicted measure surpasses a predicted measure threshold;
transmitting, to the wearable computing device, the stream of agricultural annotations, wherein transmitting the stream of agricultural annotations to the wearable computing device causes the wearable computing device to provide, for presentation to the user via a head mounted display (HMD) of the wearable computing device, the stream of agricultural annotations with respect to the area of interest; and
transmitting, to the wearable computing device, a prompt to the user to reduce a current distance between the area of interest and the wearable computing device, wherein transmitting the prompt to the wearable computing device causes the wearable computing device to provide, for presentation to the user via the HMD of the wearable computing device, the prompt, and wherein the prompt is based on the predicted measure associated with a given agricultural annotation included in the stream of agricultural annotations.