US 12,440,387 B2
Assistive smart glasses for visual impairment, and system and control method thereof
Kwok Hing Lo, Hong Kong (HK); Kai Wing Siu, Hong Kong (HK); and Wai Man Lau, Hong Kong (HK)
Assigned to InnoSpire Technology Limited, Hong Kong (HK)
Appl. No. 18/005,873
Filed by InnoSpire Technology Limited, Hong Kong (HK)
PCT Filed Nov. 16, 2021, PCT No. PCT/CN2021/130925
§ 371(c)(1), (2) Date Jan. 18, 2023,
PCT Pub. No. WO2022/116812, PCT Pub. Date Jun. 9, 2022.
Claims priority of application No. 202011385491.8 (CN), filed on Dec. 1, 2020.
Prior Publication US 2023/0270593 A1, Aug. 31, 2023
Int. Cl. A61F 9/08 (2006.01); G02C 11/00 (2006.01); G06N 3/0464 (2023.01); G06N 3/08 (2023.01)
CPC A61F 9/08 (2013.01) [G02C 11/10 (2013.01); G06N 3/0464 (2023.01); G06N 3/08 (2013.01)] 6 Claims
OG exemplary drawing
 
1. An assistive smart glasses system for visual impairment, comprising a assistive smart glasses for visual impairment, and further comprising a mobile terminal, a server, and a service terminal, wherein
the assistive smart glasses for visual impairment comprises a glasses body, wherein a microprocessor, a bone conduction headphone, a wireless communication module, a CCD optical module, a DSP image processing module, a camera lens, a memory module, a power supply module, a rechargeable battery, and an 110 data port are integrated in the glasses body; the camera lens is disposed at a front end of the glasses body; the CCD optical module converts an optical image captured by the camera lens into high-resolution compression data and sends the high-resolution compression data to the DSP image processing module; the microprocessor is electrically connected to the bone conduction headphone, the wireless communication module, and the DSP image processing module via the I/O data port; the memory module and the power supply module are electrically connected to the microprocessor; and the rechargeable battery is electrically connected to the power supply module;
the assistive smart glasses are configured to be communicatively connected to the mobile terminal through a wireless communication module, capture an image of a view in front of a visually impaired user in real time, send the image to the mobile terminal, and output information returned by the mobile terminal through the bone conduction headphone;
the mobile terminal is configured to preprocess in real time the image sent by the assistive smart glasses, keep comparing the preprocessed image with digital target default values, and send a result to the assistive smart glasses in response to similarity reaching a threshold; or in response to no similarity reaching the threshold in the comparison or a user choosing to enter a manual mode, upload the current image to the server and send information returned by the server to the assistive smart glasses;
the server is configured to assign the image uploaded by the mobile terminal to the service terminal, and return a recognition result uploaded by the service terminal to the corresponding mobile terminal; or connect the assistive smart glasses and the service terminal in real time through a network; and
the service terminal is configured to be used by a corresponding volunteer to receive the image uploaded by the mobile terminal via the service terminal and then send a manual recognition result provided by the volunteer to the server; or to be communicatively connected to the assistive smart glasses, so as to enable direct real-time communication between the volunteer and the visually impaired user and provide manual assistance for the visually impaired user in real time.