US 12,010,430 B2
Automated application of drift correction to sample studied under electron microscope
Franklin Stampley Walden, II, Raleigh, NC (US); John Damiano, Jr., Holly Springs, NC (US); David P. Nackashi, Raleigh, NC (US); Daniel Stephen Gardiner, Wake Forest, NC (US); Mark Uebel, Morrisville, NC (US); Alan Philip Franks, Durham, NC (US); and Benjamin Jacobs, Apex, NC (US)
Assigned to Protochips, Inc., Morrisville, NC (US)
Filed by Protochips, Inc., Morrisville, NC (US)
Filed on Aug. 25, 2022, as Appl. No. 17/822,237.
Application 17/822,237 is a continuation of application No. 17/545,651, filed on Dec. 8, 2021, granted, now 11,477,388.
Application 17/545,651 is a continuation of application No. 17/210,702, filed on Mar. 24, 2021, granted, now 11,399,138, issued on Jul. 26, 2022.
Application 17/210,702 is a continuation of application No. 16/951,297, filed on Nov. 18, 2020, granted, now 10,986,279, issued on Apr. 20, 2021.
Application 16/951,297 is a continuation of application No. PCT/US2020/045937, filed on Aug. 12, 2020.
Claims priority of provisional application 62/888,309, filed on Aug. 16, 2019.
Prior Publication US 2022/0408024 A1, Dec. 22, 2022
Int. Cl. G06K 9/32 (2006.01); G06T 7/215 (2017.01); G06T 7/33 (2017.01); H04N 23/695 (2023.01)
CPC H04N 23/695 (2023.01) [G06T 7/215 (2017.01); G06T 7/337 (2017.01); G06T 2207/10061 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A control system configured for tracking a sample under observation during an experimental session in an electron microscope, the control system comprising:
a memory; and
a processor;
wherein the processor of the control system is configured for:
tracking movement of the sample under observation as the sample changes during the experimental session,
wherein the movement of the sample is tracked within a region of interest positioned within a field of view of the electron microscope,
wherein the movement of the sample is tracked by comparing a live image of the sample against a template image of the region of interest;
determining a drift vector of the sample based on the tracked movement, wherein the drift vector includes an X-direction component and a Y-direction component;
adjusting the region of interest to correct for drift of the sample during the experimental session using the determined drift vector; and
morphing the template image to approximate the live image of the sample under observation using image filters.