US 11,921,924 B2
Assistive device for non-visually discerning a three-dimensional (3D) real-world area surrounding a user
Alex Hamid Mani, LaJolla, CA (US); and Ahmadreza Rofougaran, Newport Beach, CA (US)
Filed by Alex Hamid Mani, LaJolla, CA (US); and Ahmadreza Rofougaran, Newport Beach, CA (US)
Filed on Sep. 29, 2020, as Appl. No. 17/037,408.
Application 17/037,408 is a continuation of application No. 16/526,061, filed on Jul. 30, 2019, granted, now 10,831,311.
Application 16/526,061 is a continuation of application No. 15/709,793, filed on Sep. 20, 2017, granted, now 10,503,310, issued on Dec. 10, 2019.
Prior Publication US 2021/0026452 A1, Jan. 28, 2021
This patent is subject to a terminal disclaimer.
Int. Cl. G06F 3/01 (2006.01); G06F 3/0346 (2013.01); G06F 3/041 (2006.01); G08B 6/00 (2006.01)
CPC G06F 3/016 (2013.01) [G06F 3/011 (2013.01); G06F 3/017 (2013.01); G06F 3/0346 (2013.01); G06F 3/0416 (2013.01); G08B 6/00 (2013.01)] 21 Claims
OG exemplary drawing
 
1. An assistive device, comprising:
a haptic feedback interface comprising a plurality of haptic elements and a plurality of defined regions;
a first circuitry configured to:
receive sensor data of a three-dimensional (3D) real-world area from a plurality of different types of sensors that are communicatively coupled to the assistive device,
wherein the sensor data is associated with a first proximity range of the assistive device, and
wherein the first proximity range corresponds to a template map of the 3D real-world area;
acquire weather conditions from one or more group of sensors from the plurality of different types of sensors;
assign a weigh value to each group of sensors of the one or more group of sensors based on accuracy of the sensor data detected in the acquired weather conditions;
process first sensor data received from a first group of sensors of the plurality of different types of sensors and second sensor data received from a second group of sensors of the plurality of different types of sensors based on the weigh value assigned to each of the first group of sensors and the second group of sensors, wherein in one or more of the weather conditions when the first sensor data is below a threshold value, a higher weigh value is assigned to the second sensor data as compared to the first sensor data;
a second circuitry configured to:
establish a mapping of a plurality of objects within the first proximity range to at least one haptic element of the plurality of haptic elements in each of the plurality of defined regions of the haptic feedback interface, wherein the mapping of the plurality of objects within the first proximity range is established based on the processing of the first sensor data received from the first group of sensors and the second sensor data received from the second group of sensors; and
adjust sizes of the plurality of objects to map the plurality of objects to the at least one haptic element in a corresponding defined region of the plurality of defined regions, wherein the sizes of the plurality of objects are adjusted based on a scaling factor determined based on a surface area of the corresponding defined region; and
a haptic feedback generator configured to generate a touch-discernible feedback on the haptic feedback interface for each of the plurality of defined regions based on the established mapping,
wherein the haptic feedback generator is further configured to generate a first touch-discernible feedback on a first defined region of the haptic feedback interface, wherein the first defined region corresponds to a front view from a perspective of a user,
wherein the haptic feedback generator further configured to generate a second touch-discernible feedback on a second defined region of the haptic feedback interface, wherein the second defined region corresponds to a rear view from the perspective of the user,
wherein each of the first touch-discernible feedback and the second touch-discernible feedback comprises at least one touch-discernible cue to discern a 3D arrangement of each object of the plurality of objects with respect to a position of the user of the assistive device, and
wherein the at least one touch-discernible cue for the 3D arrangement of each object of the plurality of objects comprises at least one protrusion that extends from a surface of the haptic feedback interface.