US 12,148,067 B2
Graphical user interface visual accessiblity violation detection and alerting
Brian Daniel Meersma, Princeton Junction, NJ (US); and Omar Simon Francisco Prieto Chacon, Everett, WA (US)
Assigned to Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed by Microsoft Technology Licensing, LLC, Redmond, WA (US)
Filed on May 13, 2022, as Appl. No. 17/743,916.
Prior Publication US 2023/0368434 A1, Nov. 16, 2023
Int. Cl. G06T 11/00 (2006.01); G06F 3/0481 (2022.01); G06F 9/451 (2018.01)
CPC G06T 11/001 (2013.01) [G06F 3/0481 (2013.01); G06F 9/451 (2018.02)] 16 Claims
OG exemplary drawing
 
1. A system for detecting a visual accessibility violation (VAV), comprising:
a processor; and
a computer-readable medium in communication with the processor, the computer-readable medium comprising instructions that, when executed by the processor, cause the processor to control the device system to perform:
transmitting, from a host to a plurality of client devices via a communication network, theming data including a first color theme specifying one or more colors for one or more visual elements of a graphical user interface (GUI), the one or more colors including a first color specified for a first visual element of the GUI, wherein each of the plurality of client devices is configured to perform:
rendering, based on the theming data transmitted from the host, the GUI showing (1) the first visual element having the first color specified by the first color theme and (2) a second visual element having a second color;
determining, from the rendered GUI, whether the first and second colors respectively used for the first and second visual elements of the GUI violate a visual accessibility rule; and
in response to determining that the first and second colors respectively used for the first and second visual elements of the GUI violate the visual accessibility rule, generating a VAV report indicating an occurrence of the VAV;
providing, to an artificial intelligence (AI) engine, the VAV report from each of the plurality of client devices, the AI engine trained to identify a bug in the first color theme that causes the VAV at the plurality of client devices and debug the theming data transmitted to the plurality of client devices, the debugged theming data including a second color theme prohibiting the first color from being used for the first visual element of the GUI; and
extracting, from the AI engine, the debugged theming data including the second color theme and providing, to the host, the debugged theming data, the host configured to transmit the debugged theming data to the plurality of client devices.