AI will soon deliver code that will pass automatic testing by default – Bogdan on Digital Accessibility (A11y)

Microsoft's A11y LLM Eval project benchmarks AI models on accessibility by testing generated code with automatic tools. Results show color contrast failures remain most common, likely because AI learns from existing poor code rather than calculating ratios. The benchmark reveals automatic testing has limited capability and only checks static code patterns. Model Context Protocol (MCP) tools can help AI generate better accessible code by checking contrast ratios before delivery. However, passing automatic tests doesn't guarantee actual accessibility or usability—human knowledge remains essential throughout design, development, content creation, and testing stages.