US 11,989,896 B2
Depth measurement through display
Patrick Schindler, Ludwigshafen (DE); Benjamin Rein, Ludwigshafen (DE); Christian Bonsignore, Ludwigshafen (DE); Michael Eberspach, Ludwigshafen (DE); and Peter Schillen, Ludwigshafen (DE)
Assigned to TRINAMIX GMBH, Ludwigshafen am Rhein (DE)
Appl. No. 17/756,552
Filed by TRINAMIX GMBH, Ludwigshafen am Rhein (DE)
PCT Filed Nov. 26, 2020, PCT No. PCT/EP2020/083468
§ 371(c)(1), (2) Date May 26, 2022,
PCT Pub. No. WO2021/105265, PCT Pub. Date Jun. 3, 2021.
Claims priority of application No. 19211927 (EP), filed on Nov. 27, 2019.
Prior Publication US 2022/0398759 A1, Dec. 15, 2022
Int. Cl. G06T 7/521 (2017.01); G01B 11/22 (2006.01); G01B 11/25 (2006.01); G06V 10/141 (2022.01); G06V 10/145 (2022.01); G06V 10/147 (2022.01); G06V 10/94 (2022.01); G06V 20/64 (2022.01)
CPC G06T 7/521 (2017.01) [G01B 11/22 (2013.01); G01B 11/2513 (2013.01); G06V 10/141 (2022.01); G06V 10/145 (2022.01); G06V 10/147 (2022.01); G06V 10/94 (2022.01); G06V 20/647 (2022.01)] 27 Claims
OG exemplary drawing
 
1. A display device comprising
at least one illumination source configured for projecting at least one illumination pattern comprising a plurality of illumination features on at least one scene;
at least one optical sensor having at least one light sensitive area, wherein the at least one optical sensor is configured for determining at least one first image comprising a plurality of reflection features generated by the at least one scene in response to illumination by the illumination features; and
at least one translucent display configured for displaying information, wherein the at least one illumination source and the at least one optical sensor are placed in a direction of propagation of the at least one illumination pattern in front of the at least one translucent display;
at least one evaluation device, wherein the at least one evaluation device is configured for evaluating the at least one first image, wherein evaluating the at least one first image comprises identifying reflection features of the at least one first image and sorting the identified reflection features with respect to brightness, wherein each of the reflection features comprises at least one beam profile, wherein the at least one evaluation device is configured for determining at least one longitudinal coordinate ZDPR for each of the reflection features by analysis of the at least one beam profile,
wherein the at least one evaluation device is configured for unambiguously matching the reflection features with corresponding illumination features by using the at least one longitudinal coordinate ZDPR, wherein the matching is performed with decreasing brightness of the reflection features starting with a brightest reflection feature, wherein the at least one evaluation device is configured for classifying a reflection feature being matched with an illumination feature as a real feature and for classifying a reflection feature not being matched with an illumination feature as a false feature, wherein the at least one evaluation device is configured for rejecting the false feature and for generating a depth map for the real feature by using the at least one longitudinal coordinate ZDPR.