CPC G07F 17/3211 (2013.01) [A63F 3/00157 (2013.01); G06F 18/213 (2023.01); G06F 18/214 (2023.01); G06F 18/24323 (2023.01); G06F 18/25 (2023.01); G06F 18/251 (2023.01); G06F 18/253 (2023.01); G06T 7/194 (2017.01); G06T 7/50 (2017.01); G06T 7/60 (2013.01); G06V 10/141 (2022.01); G06V 10/44 (2022.01); G06V 10/462 (2022.01); G06V 10/50 (2022.01); G06V 10/56 (2022.01); G06V 10/764 (2022.01); G06V 10/774 (2022.01); G06V 20/52 (2022.01); G07F 17/322 (2013.01); G07F 17/3227 (2013.01); G07F 17/3237 (2013.01); G07F 17/3239 (2013.01); G07F 17/3241 (2013.01); G07F 17/3288 (2013.01); A63F 2003/00164 (2013.01); G06F 2218/00 (2023.01); G06F 2218/12 (2023.01); G06V 20/64 (2022.01)] | 20 Claims |
1. A device for monitoring chip placement activities comprising:
a camera or sensor capturing image data corresponding to one or more chips positioned in at least one chip placement area;
a processor configured to segment the captured image data into one or more regions of interest, and to classify each region of interest of the one or more regions of interest based on an analysis of a corresponding representative histogram generated based on the captured image data corresponding to the respective region of interest;
the processor further configured to identify one or more classifications for the one or more regions of interest positioned along a row or column for each row or column of the one or more regions of interest in the captured image data, each classification of the one or more classifications mapped to a corresponding row or column and recorded in a data structure and the one or more classifications, in aggregate, establishing a vector representation of the one or more chips in the at least one chip placement area;
the processor further configured to determine one or more quantities of one or more chip types of the one or more chips in the at least one chip placement area by processing the vector representation based at least on a comparison with physical characteristics of the one or more chip types;
a data storage configured to maintain an output data structure storing one or more data fields representative of the determined one or more quantities of the one or more chip types of the one or more chips in the at least one chip placement area; and
wherein the captured image data is captured across a plurality of channels including at least a depth information channel, a red channel, a green channel, and a blue channel; and
wherein each representative histogram is an aggregated histogram generated from combining histograms generated for at least two channels of the plurality of the channels, the at least two channels of the plurality of channels including the depth information channel and at least one of the red channel, the green channel, and the blue channel.
|