US 12,282,608 B2
User interface, control method thereof, and vehicle having user interface
Danghee Park, Seoul (KR); Sukmin Choi, Hwaseong-si (KR); Sunwook Kim, Asan-si (KR); Juhee Park, Seongnam-si (KR); Jangryul Rim, Suwon-si (KR); Sehyun Chang, Suwon-si (KR); and Hongmin Kim, Cheonan-si (KR)
Assigned to Hyundai Motor Company, Seoul (KR); and Kia Corporation, Seoul (KR)
Filed by HYUNDAI MOTOR COMPANY, Seoul (KR); and KIA CORPORATION, Seoul (KR)
Filed on Aug. 28, 2023, as Appl. No. 18/238,761.
Claims priority of application No. 10-2022-0190228 (KR), filed on Dec. 30, 2022.
Prior Publication US 2024/0220024 A1, Jul. 4, 2024
Int. Cl. G09G 3/00 (2006.01); G06F 3/01 (2006.01); G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06V 10/44 (2022.01); G06V 20/59 (2022.01); G06V 40/20 (2022.01)
CPC G06F 3/017 (2013.01) [G06F 3/011 (2013.01); G06T 7/246 (2017.01); G06T 7/73 (2017.01); G06V 10/44 (2022.01); G06V 20/593 (2022.01); G06V 40/28 (2022.01); G09G 3/002 (2013.01); G06T 2207/30196 (2013.01); G06T 2207/30268 (2013.01); G09G 2354/00 (2013.01); G09G 2380/10 (2013.01)] 19 Claims
OG exemplary drawing
 
1. A method of controlling a user interface, the method comprising:
detecting, by a controller, an occupant from an image input from a camera;
estimating, by the controller, a skeleton of the occupant;
estimating, by the controller, a relative position of a finger of the occupant based on the estimated skeleton;
determining, by the controller, a projection position based on the relative position of the finger;
projecting, by the controller, a projection image on the projection position via an image projector operatively connected to the controller, and playing the projection image; and,
comparing the relative position of the occupant's finger with a position of at least one application command area in a projection plane on which the projection image is projected, to determine an application command selected by the occupant,
wherein the projection image is projected to float inside a vehicle.