US 12,223,159 B2
Method to describe a screen capture using AI for the visually impaired
Juan Fernando Mejia Velez, Redmond, WA (US); and Stephanie Marie Anderl, Bothell, WA (US)
Filed by MICROSOFT TECHNOLOGY LICENSING, LLC, Redmond, WA (US)
Filed on Jan. 18, 2023, as Appl. No. 18/098,541.
Prior Publication US 2024/0241622 A1, Jul. 18, 2024
Int. Cl. G06F 3/0484 (2022.01); G06F 3/16 (2006.01); G06F 9/451 (2018.01)
CPC G06F 3/0484 (2013.01) [G06F 3/167 (2013.01); G06F 9/451 (2018.02)] 13 Claims
OG exemplary drawing
 
1. A method implemented by a computing system for generating an accessible image-based screen capture, the method comprising:
selecting a screen capture type and determining a screen capture area;
temporarily applying the screen capture type to a user display according to the screen capture area;
identifying an object included in the screen capture area;
obtaining application metadata corresponding to the object;
generating a screen capture description of the object based on the application metadata corresponding to the object;
narrating the screen capture description of the object; and
generating an image-based screen capture that comprises the object by applying the screen capture type according to the screen capture area and embedding the application metadata into the image-based screen capture.