US 11,887,312 B2
Fiducial marker patterns, their automatic detection in images, and applications thereof
Mark Fiala, Edmonton (CA)
Assigned to Millennium Three Technologies, Inc.
Filed by Millennium Three Technologies, Inc., Edmonton (CA)
Filed on Aug. 17, 2021, as Appl. No. 17/404,514.
Application 16/694,387 is a division of application No. 15/312,657, granted, now 10,504,231, issued on Dec. 10, 2019, previously published as PCT/CA2015/000329, filed on May 21, 2015.
Application 17/404,514 is a continuation of application No. 16/787,546, filed on Feb. 11, 2020, granted, now 11,100,649, issued on Aug. 24, 2021.
Application 16/787,546 is a continuation of application No. 16/694,387, filed on Nov. 25, 2019, granted, now 10,929,980.
Claims priority of provisional application 62/043,412, filed on Aug. 29, 2014.
Claims priority of provisional application 62/001,071, filed on May 21, 2014.
Prior Publication US 2021/0383551 A1, Dec. 9, 2021
Int. Cl. G06T 7/13 (2017.01); G06T 7/246 (2017.01); A63F 13/65 (2014.01); A63F 13/213 (2014.01); G02B 27/01 (2006.01); G02B 27/00 (2006.01); G06T 7/277 (2017.01); G06T 7/73 (2017.01); G06F 30/20 (2020.01); G06V 20/20 (2022.01); A63F 13/25 (2014.01); G06F 30/00 (2020.01)
CPC G06T 7/13 (2017.01) [A63F 13/213 (2014.09); A63F 13/25 (2014.09); A63F 13/65 (2014.09); G02B 27/0093 (2013.01); G02B 27/017 (2013.01); G02B 27/0172 (2013.01); G06F 30/20 (2020.01); G06T 7/246 (2017.01); G06T 7/277 (2017.01); G06T 7/75 (2017.01); G06V 20/20 (2022.01); A63F 2300/8076 (2013.01); G02B 2027/014 (2013.01); G02B 2027/0138 (2013.01); G02B 2027/0187 (2013.01); G06F 30/00 (2020.01); G06T 2207/20076 (2013.01); G06T 2207/30204 (2013.01); G06T 2207/30208 (2013.01)] 23 Claims
OG exemplary drawing
 
1. An augmented reality system comprised of:
capture means for capturing at least one video or still image, said capture means having a display screen;
fiducial marker patterns located on one or more objects within view of the capture means;
recognition means for recognizing said fiducial markers in the at least one video or still image;
calculation means for calculating a mathematical transform between the display screen of the capture means and arbitrary world coordinates of the fiducial marker patterns; graphic drawing means for placing overlay drawings and graphics on the display screen;
transmission means for transmitting the at least one video or still image to a remote location; and
receiver means for receiving other overlay drawings and graphics from the remote location;
wherein the mathematical transform is a ‘homography’ matrix, ‘projection matrix’, or a representation of euclidean rotation and translation.