US 11,911,709 B2
Toy construction system for augmented reality
Siddharth Muthyala, Billund (DK); Harm Jan Van Beek, HA Rotterdam (NL); Nicolas David Alain Guyon, St. Barthelemy d'Anjou (FR); Frantz Lasorne, Nantes (FR); and Mikkel Holm Jensen, Aarhus (DK)
Assigned to LEGO A/S, Billund (DK)
Filed by LEGO A/S, Billund (DK)
Filed on Apr. 22, 2021, as Appl. No. 17/237,222.
Application 17/237,222 is a continuation of application No. 16/738,610, filed on Jan. 9, 2020, granted, now 11,014,014.
Application 16/738,610 is a continuation of application No. 15/793,417, filed on Oct. 25, 2017, granted, now 10,549,209, issued on Feb. 4, 2020.
Application 15/793,417 is a continuation of application No. 14/119,556, granted, now 9,827,507, issued on Nov. 28, 2017, previously published as PCT/EP2012/059469, filed on May 22, 2012.
Claims priority of application No. PA 2011 70254 (DK), filed on May 23, 2011.
Prior Publication US 2022/0105440 A1, Apr. 7, 2022
This patent is subject to a terminal disclaimer.
Int. Cl. A63H 33/04 (2006.01); G06T 19/00 (2011.01); A63F 9/24 (2006.01); A63F 13/65 (2014.01); A63F 13/69 (2014.01)
CPC A63H 33/042 (2013.01) [G06T 19/00 (2013.01); A63F 13/65 (2014.09); A63F 13/69 (2014.09); A63F 2009/246 (2013.01); A63F 2250/287 (2013.01)] 14 Claims
OG exemplary drawing
 
1. A toy construction system comprising toy construction elements, the toy construction system comprising:
at least one marker construction element comprising a coupling mechanism for releasably interconnecting the at least one marker construction elements with at least one of the toy construction elements and each having a visual appearance recognisable by an image processor, and
a data processing system comprising a camera, image processor, and display, wherein the data processing system is adapted to:
capture an image of a toy construction model constructed from the toy construction elements, the toy construction elements comprising a coupling mechanism for releasably interconnecting the toy construction elements, wherein at least a first toy construction element of the toy construction model is interpreted by the data processing system as a virtual button;
process the captured image to detect a presence of the at least one marker construction element within the captured image responsive to a user connecting the at least one marker construction element to the toy construction model;
trigger a virtual action responsive to the detected at least one marker construction element being connected to the first toy construction element; and
display a composite image comprising the captured image having superimposed a generated computer-generated image.