Why Silktide Index scoring changed in 2023
This page explains the January 2023 edition of the Silktide Index, which moved some websites' scores a lot. It is history. For how scores are calculated today, see V4 and V5 scores, and for the most recent change, What changed in the November 2026 Index.
Until then the Index had been using a testing engine from late 2020. With WCAG 2.2 being added to our tests, we switched it to our newest engine. That meant more consistent and more accurate results, and for some websites large changes in score.
New WCAG 2.2 checks
We added nine new checks for 2.2. Four of them are fully automated and counted toward Index scores:
- Controls clearly indicate when they are selected (2.4.11, level AA).
- Focus is not fully obscured (2.4.12, level AA).
- Focus is not partly obscured (2.4.13, level AAA).
- Interactive components are far enough apart (2.5.8, level AA).
WCAG 2.2 moved scores by about 5%, so most websites saw only a slight adjustment from it.
We also began to test one WCAG 2.1 criterion, 2.5.5, "Aim for large interactive controls". It is a level AAA check that few websites fully meet, and it carries a low weight.
First-time visits
The earlier Index always tried to dismiss common cookie banners and pop-ups before testing. To test for WCAG 2.2, we need to experience a website before anything is closed, so we began testing one extra page, the "first-time visit": the homepage before anything is clicked or closed. You may see it as an extra copy of the homepage. Every other page is still tested after we close any pop-ups or cookie banners we can.
PDFs weighted by number
Before 2023, the Index calculated a PDF score that made up about 15% of a website's accessibility score. That could be counter-intuitive:
- A website with one inaccessible PDF had a PDF score of 0% and lost the whole 15%.
- A website with 100 PDFs, 50 of them inaccessible, had a PDF score of 50% and lost 7.5%.
So a website with more problems could score higher. From 2023, a PDF carries 30% of the weight of an HTML page, so the number of PDFs counts. PDFs still count toward the V4 score today. See V4 and V5 scores.
Newer technologies
Over the two years before, we updated our checks to read technologies that were new or previously impossible to test, including text and background colors added with CSS pseudo-elements, styles added by component frameworks such as Styled-Components and Emotion, and behavior attached with JavaScript event handlers. Hundreds of smaller changes were made as well.
Different pages tested
The Index tests a sample of each website's pages, so how it chooses them affects scores. We changed the algorithm in 2023, and in our own tests it picked more appropriate pages. A different selection of pages and PDFs can change a score a lot. See How does the Silktide Index choose which pages to sample?.
Cookie banners and keyboard checks
Many banners and pop-ups stop a keyboard-only user from seeing what they have selected. Two of the new WCAG 2.2 checks (2.4.12 and 2.4.13) look for this. If a cookie banner cannot be dismissed, we can only experience each page through the banner, as someone pressing Tab and trapped inside a pop-up would, so a score could depend on our ability to dismiss a banner. This affected only the keyboard accessibility checks. We trained the engine to recognize most banners and keep improving it.
Related
- Silktide Index - everything the Index covers.
- V4 and V5 scores - how scores are calculated today.
- Why is my website marked as not tested? - what can stop a website being scored.