US 12,456,270 B2
Systems and methods of providing virtual activities
Robert Biehl, Darmstadt (DE); Arno Mittelbach, Rossdorf (DE); Markus Schlattmann, Griesheim (DE); and Thomas Bader, Pfungstadt (DE)
Assigned to KORRO AI LIMITED, London (GB)
Appl. No. 18/549,422
Filed by Korro AI Limited, London (GB)
PCT Filed Mar. 7, 2022, PCT No. PCT/IL2022/050248
§ 371(c)(1), (2) Date Sep. 7, 2023,
PCT Pub. No. WO2022/190085, PCT Pub. Date Sep. 15, 2022.
Claims priority of provisional application 63/157,788, filed on Mar. 7, 2021.
Prior Publication US 2024/0161427 A1, May 16, 2024
Int. Cl. G06T 19/00 (2011.01); A63F 13/56 (2014.01); A63F 13/577 (2014.01); G06T 19/20 (2011.01)
CPC G06T 19/006 (2013.01) [A63F 13/56 (2014.09); A63F 13/577 (2014.09); G06T 19/20 (2013.01); G06T 2219/2004 (2013.01)] 20 Claims
OG exemplary drawing
 
1. A non-transitory computer readable medium comprising instructions that, when executed by one or more processing circuitries, cause the one or more processing circuitries to perform a method comprising:
obtaining images of a physical area acquired by an imaging device, wherein the physical area comprises a plurality of physical elements,
wherein at least one given physical element of the plurality of physical elements is movable by a user performing an activity within the physical area, generating a virtual activity world representative of the physical area, the generating comprising:
using at least part of the images to map the given physical element to the virtual activity world,
using at least part of the images to map a surface of a physical element of the physical area to the virtual activity world,
adding to the virtual activity world one or more virtual objects which overlay the surface in the virtual activity world,
using the virtual activity world to detect an interaction between:
the given physical element mapped to the virtual activity world, and
a given virtual object overlaying the surface in the virtual activity world,
responsive to a detected interaction, determining an outcome of the interaction, and
applying a change in the virtual activity world corresponding to the outcome, and
displaying a representation of the virtual activity world on a display device.