Parsoid/Parser Unification/Pixel Diff Testing Stats

In order to compare rendering fidelity between Parsoid and core parser, we are going to be doing pixel diff testing on a subset of pages from various wikis and monitor progress. Initially, we are starting small (~25K pages across ~20 wikis) and eventually we will expand the test set. In these initial stages, we are likely going to get a number of false positives as we iron out wrinkles in the testing infrastructure.

Known issues and testing-related workarounds

• Test timeouts: If there differences between core parser rendering and Parsoid rendering on a page is large, the diffing algorithm (uprightdiff) might take too long or too much memory in which case the test run on that page will not complete since the tests are given a fixed time to complete (~5 mins). That is the reason you see < 100% test completion rate. As we fix sources of diffs, this test completion rate should naturally improve since there are fewer diffs and the diffing algorithm is likely to run to completion.
• Unstyled Parsoid output: Parsoid's output is unstyled. The testing infrastructure loads the vector skin styles and applies it to the output. While this is now mostly working, there may still be areas where the right styles may not apply because of HTML structure differences between Parsoid and legacy HTML. For example, this is the case with HTML output for media. Legacy parser will soon be updated to emit Parsoid-compatible HTML structures for media and this will eliminate some of these CSS diffs we currently see in these visualdiff test runs.
• Known Cite CSS diffs: Parsoid generates identical HTML for refs and references across all wikis and relies on CSS to generate varied styling across wikis. On the core parser side, the core Cite extension actually generates varied output for different wikis and is not CSS-based. Parsoid's approach is better suited for editing clients, but we haven't yet done the work of identifying the precise CSS needed to emulate the output on all wikis. This work is captured on Phabricator. Pixel-diff testing will let us isolate these differences and fix up the CSS.
• Known missing JS modules in Parsoid output: The testing infrastructure attempts to expand all collapsed content on pages before comparing output. Parsoid's output is currently uncollapsed by default (because of missing JS modules in Parsoid's output) and while some JS scripts attempt to expand collapsed sections, this is error-prone currently and doesn't capture all collapsed content and so we get large false positive differences when the collapsed state is different in the two screenshots.
• Other workarounds / issues:
  • span wrappers around various pieces of content (entities, display-space for frwiki, nowiki, template content text nodes for about-id continuity) cause minor pixel-level discrepancies in rendering which human readers won't notice but which introduce a lot of noise in visualdiffing. This seems to be something new that has been showing up since Sep 2021 after some library upgrades on the server.
  • <section> wrappers need to be removed from Parsoid output for some CSS query selectors to apply.
  • Cite errors are handled different in Parsoid & core
  • jsconfig vars added by extensions are added all at once in legacy parser and one tag at a time in Parsoid and this leads to the last tag-instance overwriting everything else in Parsoid.
  • enwiki:World Flags has a number of {{compact TOC|..}} uses which generates a HTML structure identical to auto-generated table of contents and so in visual diff testing, when we suppress TOCs, all of these get suppressed causing visual diffs.
  • On enwiki:Podgorica, there is an extra space before [citation needed] in Parsoid HTML but not in legacy HTML. Parsoid's output matches what is seen in source (to many noteworthy events. {{Citation needed|date=March 2017}} -- see the space after the period there). So, not sure why this is being stripped in legacy parser output.
  • Support for Special:Prefixindex is missing in Parsoid
  • sol state in extensions. Parsoid treats content in extensions as having SOL state. But, legacy parser doesn't. It transfers document sol state to extensions affects how <ref>* x</ref> and <ref>\n*x</ref> is parsed. Former is not a list in legacy, but latter is. Both are lists in Parsoid.

As we resolve these and other issues in the coming months, we will remove them from this list.

Aggregate results for the entire test set across all wikis

Date	Test Id	% completed	% vertical-shift-only-or-no-diffs	% pixel-perfect rendering	Notes
Jan 6, 2022	1.38.0-wmf.16	99.85	88.78	42.15	arwiki results have taken a dip - needs investigation
Dec 16, 2021	1.38.0-wmf.13	99.86	89.22	41.91	Regression from previous train fixed
Dec 10, 2021	1.38.0-wmf.12	99.82	86.56	36.81	Regression from CSS related work in core. Fixed in https://gerrit.wikimedia.org/r/c/mediawiki/core/+/745916 which has rolled out in wmf.13 and will improve results in the next test run.
Nov 18, 2021	1.38.0-wmf.9	99.85	89.17	41.76
Nov 4, 2021	1.38.0-wmf.7	99.86	89.15	41.34
Oct 28, 2021	1.38.0-wmf.6	99.85	88.96	40.96
Oct 21, 2021	1.38.0-wmf.5	99.85	88.97	40.97
Oct 14, 2021	1.38.0-wmf.4	99.86	88.95	40.82
Oct 8, 2021	1.38.0-wmf.3	99.84	88.69	40.26
Oct 1, 2021	1.38.0-wmf.2	99.84	88.91	39.22	This test run also includes a few Cite CSS tweaks for dewiki & kowiki. The tests ran on a new server with better performance. That is the reason for the reduction in crashing pages.
Sep 28, 2021	diffscoring-tweak	99.58	88.64	39.11	Tweak the scoring algorithm to treat any diffs that are 99.99% or more identical as pixel perfect since they tend to imperceptible to the humans. This just builds on the previous span stripping tweaks to hide noise introduce since Sep 10th. Also includes a fix to eliminate a regression on arwiki due to div.catlinks moving outside div.mw-body-content (got rid of a hack-fix introduced about 6 weeks back to have an arwiki JS modeule apply to Parsoid HTML).
Sep 26, 2021	more-span-stripping	99.62	88.69	28.55	Strip additional spans around nowikis, displayspace (impacts frwiki significant), and placeholder content
Sep 18, 2021	1.38.0-wmf.1	99.58	88.37	24.79	This included a Parsoid fix to mark more effectively-empty paragraphs with mw-empty-elt class that lets them be hidden in rendering. This also reduces visualdiffs with core parser output. The visualdiff improvements will likely reflect in later weeks as the caches slowly purge.
Sep 11, 2021	strip-entity-spans	99.55	88.33	24.65	Strip spans around entities and template content to mitigate the rendering impact and noise.
Sep 10,2021	1.37.0-wmf.23	99.46	85.34	12.93	Something (uninvestigated) broke on the test server which caused us to reinstall several libraries needed by Chrome. This in turn seems to have made the rendering sensitive to span wrappers that Parsoid adds in several places. The impacts aren't visible to the human eye but add a lot of minor noise in testing and cause a number of tests results with 0 score to now report a score of 1, but which causes them all to drop out of the pixel-perfect-rendering category. The drop from ~36% to ~13% here is pretty significant.
Sep 3, 2021	puppeteer-bump	99.53	88.43	35.46	Bump puppeteer version from 5.x to 9.x. This upgrades the version of Chrome from 88.x to 91.x
Sep 3, 2021	1.37.0-wmf.21	99.6	88.68	34.97	Several Cite CSS fixes + some minor bug fixes in Parsoid.
Aug 26, 2021	1.37.0-wmf.20	99.53	89.02	28.15	T288715 is probably the most significant fix to Parsoid HTML which lead the noticeable test result improvements.
Aug 18, 2021	more_rl_and_css_fixes	99.60	88.74	27.02	Additional fixes: Remove <section> wrappers from Parsoid ouput - enables JS & CSS to apply better (because of query selectors that have specific assumptions about HTML structure) Add additional resourceloader state/config to Parsoid output based on available info in <head> Add a #catlinks dummy div to end of Parsoid output to let arwiki's site JS module to apply Fix a minor CSS issue with hewiki ref output Add additional Cite CSS style for svwiki
Aug 14, 2021	rl_and_css_fixes	99.55	86.67	25.45	Several fixes to ensure (a) the right style modules are loaded and in the proper order (b) the right js modules are loaded and take effect on Parsoid page (c) turn off ext.gadget.* modules in legacy parser output since those aren't accessible to Parsoid's rendering yet. Notably, this run gets rid of the hack introduced in the 'rl_modules_hack_2' test run by leveraging Parsoid's new output where applicable resource modules are exposed in Parsoid's output in the <head>.
Jan 8, 2021	1.36.0-wmf.25	99.61	82.92	17.73	The regressions are mostly testing noise. No significant code or infrastructure changes since last run.
Dec 31, 2020	parsoid_workarounds	99.60	83.01	17.83	Three workarounds for Parsoid gaps / bugs that are yet to be fixed: Missing self-links in Parsoid output Parsoid's gallery output doesn't p-wrap captions Kartographer maps suppressed to eliminate noisy diffs from JS modules not applying correctly on Parsoid output. Kartographer extensions needs to retargeted for Parsoid so some of this is known.
Dec 26, 2020	vd_and_css_tweaks	99.61	80.63	16.55	Several CSS and visual diff infrastructure fixes. Improved results on arwiki, itwiki, svwiki, and frwiki.
Dec 18, 2020	rl_modules_hack_2	99.55	79.00	15.54	Replace the <head> element in Parsoid output with the <head> element from core parser output to mimic the effect of having Parsoid get the right resource modules. It needed a few additional tweaks. Overall, the difference between the 1.36.0-wmf.18 run and this test run represents the expected rendering improvements from fixing ResourceModule gaps in Parsoid.
Dec 17, 2020	1.36.0-wmf.22	99.55	75.96	14.75
Dec 16, 2020	vd_tweaks	99.55	76.08	14.73	Tweaks to the visual diff infrastructure to improve behavior of rl_modules hacks. This test run also purges results / pages from the database which have been deleted from the wikis.
Dec 10, 2020	1.36.0-wmf.21	99.55	75.86	14.59	zhwiki regressions fixed. But, enwiki saw a bunch of regressions
Dec 7, 2020	1.36.0-wmf.20	99.55	75.78	14.62	Notable regression on zhwiki because of this patch - this will be fixed in wmf.21.
Nov 29, 2020	rl_modules_hack	99.51	75.88	14.62	Two changes: Parsoid doesn't add JS modules to the HTML. In this test run, the visual diff infrastructure is hacked to add some basic defaults. Fix some post-processing that ensures ruwiki content has colllapsible content expanded in both Parsoid & core content.
Nov 24, 2020	1.36.0-wmf.18	99.39	71.76	14.71
Nov 10, 2020	1.36.0-wmf.16	99.39	71.62	14.51
Oct 22, 2020	1.36.0-wmf.14	99.43	71.82	14.81
Oct 15, 2020	1.36.0-wmf.13	99.44	71.75	14.97
Oct 13, 2020	cite_css_fixes	99.45	71.79	15.02	Visualdiff Cite CSS fixes ( Commit )
Sep 29, 2020	body post-processing fix	99.41	70.60	15.11	Visualdiff code fixes to ensure no content is dropped from core output ( Commit + followups )
Sep 26, 2020	1.36.0-wmf.10 + CSS fixes	99.41	70.07	15.08	Visualdiff code fixes to ensure stylesheets apply in the right order + some CSS fixes ( Commit ).
Sep 24, 2020	1.36.0-wmf.10	98.95	69.22	14.55	nlwiki continued to see a big improvement (now at ~92% vertical-shift-only diffs) because of an edit to an nl infobox (see below).
Sep 17, 2020	1.36.0-wmf.9	98.94	67.41	14.07	nlwiki saw a huge improvement (see per-wiki stats below). Caused by an edit to a nlwiki infobox. This edit happened partway through this test run.
Sep 10, 2020	1.36.0-wmf.8	98.95	65.67	13.66	T178927 fixed
Aug 27, 2020	1.36.0-wmf.6	98.98	65.55	13.59
Aug 20, 2020	1.36.0-wmf.5	98.98	65.14	13.32
Aug 13, 2020	1.36.0-wmf.4	98.97	65.14	13.06
Aug 6 & 7, 2020	1.36.0-wmf.3	99.04	64.69	12.46	This had a Parsoid fix to ensure RTL styles are loaded for RTL wikis. After the run completed (on Aug 6), arwiki & hewiki results were reset, a visualdiff config fix was added (to purge cache before we loaded pages to ensure latest Parsoid output was used), and tests rerun on arwiki & hewiki pages (Aug 7).
Aug 5, 2020	1.36.0-wmf.2 + vector-useskinversion-1	99.05	64.51	12.45	This fixes the issue with the previous run by ensuring we always fetch legacy vector CSS. So, this is effectively the 1.36.0-wmf2 run.
Aug 3, 2020	1.36.0-wmf.2	99.07	64.31	12.48	There have been a number of regressions on hewiki pages. It turns out this is because of Desktop Refresh! hewiki pages are being loaded with new CSS whereas Parsoid content is being styled with legacy vector CSS. Need to figure out how to match up skin CSS.
July 24, 2020	init_with_css_fixes	99.02	64.37	12.30	Based on the previous run, this includes a number of Cite CSS fixes and enables all Cite output. So, this is just like the init run but with additional CSS fixes. Relative to 'init' run, the overall diff score improved by 16% across the test set. This can effectively be considered the new baseline metric.
July 24, 2020	no_refs	99.17	67.26	18.40	Suppress all Cite extension output (but images and galleries are enabled again). Relative to 'init' run, the overall diff score improved by 27% across the test set. Looking at aggregate stats across wikis in the test set, looks like jawiki, eswiki, frwiki, plwiki, svwiki improved a lot. This just indicates that Cite CSS styles for these wikis are probably out of date and need a refresh.
July 23, 2020	no_img_or_gallery	98.91	63.36	12.19	Suppress all images and galleries. This is to isolate differences arising out of different media output between Parsoid & core parser and associated CSS. The overall diff score improved by by 12% across the test set. Looking at aggregate stats across wikis in the test set, looks like enwikivoyage pages improved the most.
July 23, 2020	init	98.81	60.45	11.09	Initial baseline run

More detailed per-wiki & per-category stats across test runs

Stats for arwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.30	53.83	4.18	428	232	18
1.38.0-wmf.7	99.30	53.83	4.41	428	232	19
1.38.0-wmf.6	99.30	45.94	2.78	428	198	12
1.38.0-wmf.5	99.30	45.94	2.78	428	198	12
1.38.0-wmf.4	99.30	45.94	2.78	428	198	12
1.38.0-wmf.3	99.30	45.48	2.78	428	196	12
1.38.0-wmf.2	99.30	43.39	2.78	428	187	12
diffscoring-tweak	99.30	37.35	2.78	428	161	12
more-span-stripping	99.07	41.53	2.09	427	179	9
1.38.0-wmf.1	99.07	40.14	2.09	427	173	9
strip-entity-spans	99.07	42.00	2.09	427	181	9
1.37.0-wmf.23	97.45	41.76	0.93	420	180	4
puppeteer-bump	99.07	38.75	1.86	427	167	8
1.37.0-wmf.21	98.38	38.98	1.86	424	168	8
1.37.0-wmf.20	98.84	38.05	1.86	426	164	8
more_rl_and_css_fixes	99.07	38.28	1.86	427	165	8
rl_and_css_fixes	99.07	25.52	1.39	427	110	6
survey_and_other_css_tweaks	95.36	23.67	2.09	411	102	9
1.36.0-wmf.27	94.43	22.51	2.09	407	97	9
1.36.0-wmf.26	96.06	23.20	1.86	414	100	8
1.36.0-wmf.25	96.29	26.45	1.86	415	114	8
parsoid_workarounds	96.52	26.45	1.86	416	114	8
vd_and_css_tweaks	96.52	23.43	1.86	416	101	8
rl_modules_hack_2	96.29	20.65	1.86	415	89	8
1.36.0-wmf.22	96.29	20.65	1.86	415	89	8
vd_tweaks	96.29	20.65	1.86	415	89	8
1.36.0-wmf.21	96.29	20.65	1.86	415	89	8
1.36.0-wmf.20	96.29	20.65	1.86	415	89	8
rl_modules_hack	96.29	21.11	1.86	415	91	8
1.36.0-wmf.18	96.29	20.42	1.86	415	88	8
1.36.0-wmf.16	96.29	20.42	1.86	415	88	8
1.36.0-wmf.14	96.52	21.11	1.86	416	91	8
1.36.0-wmf.13	96.52	20.88	1.86	416	90	8
cite_css_fixes	96.75	20.88	1.86	417	90	8
body_postprocessing_fix	96.52	21.58	2.09	416	93	9
1.36.0-wmf.10_and_CSS_fixes	96.06	1.86	1.62	414	8	7
1.36.0-wmf.10	71.46	0.70	0.00	308	3	0
1.36.0-wmf.9	71.93	0.70	0.00	310	3	0
1.36.0-wmf.8	72.16	0.70	0.00	311	3	0
1.36.0-wmf.6	72.62	0.70	0.00	313	3	0
1.36.0-wmf.5	72.16	0.70	0.00	311	3	0
1.36.0-wmf.4	72.16	0.70	0.00	311	3	0
1.36.0-wmf.3	74.25	0.70	0.00	320	3	0
vector-useskinversion-1	75.64	0.70	0.00	326	3	0
1.36.0-wmf.2	75.87	0.70	0.00	327	3	0
init_with_css_fixes	75.87	0.70	0.00	327	3	0
no_refs	74.25	0.70	0.00	320	3	0
no_img_or_gallery	73.78	0.70	0.00	318	3	0
init	75.87	0.70	0.00	327	3	0

Stats for dewiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.94	93.67	60.19	1642	1539	989
1.38.0-wmf.7	99.94	93.61	59.77	1642	1538	982
1.38.0-wmf.6	99.94	93.37	58.37	1642	1534	959
1.38.0-wmf.5	99.94	93.37	58.31	1642	1534	958
1.38.0-wmf.4	99.94	93.37	58.25	1642	1534	957
1.38.0-wmf.3	99.94	93.55	58.00	1642	1537	953
1.38.0-wmf.2	99.94	93.49	57.76	1642	1536	949
diffscoring-tweak	99.88	93.18	57.52	1641	1531	945
more-span-stripping	99.88	93.06	42.06	1641	1529	691
1.38.0-wmf.1	99.76	93.00	39.38	1639	1528	647
strip-entity-spans	99.76	93.18	39.38	1639	1531	647
1.37.0-wmf.23	99.88	84.54	11.87	1641	1389	195
puppeteer-bump	99.76	93.06	24.16	1639	1529	397
1.37.0-wmf.21	99.70	93.37	24.28	1638	1534	399
1.37.0-wmf.20	99.88	95.01	24.95	1641	1561	410
more_rl_and_css_fixes	99.76	95.01	24.95	1639	1561	410
rl_and_css_fixes	99.51	94.34	25.20	1635	1550	414
survey_and_other_css_tweaks	99.57	86.00	23.37	1636	1413	384
1.36.0-wmf.27	99.63	85.94	23.13	1637	1412	380
1.36.0-wmf.26	99.57	85.58	23.31	1636	1406	383
1.36.0-wmf.25	99.63	85.58	23.37	1637	1406	384
parsoid_workarounds	99.70	85.70	23.37	1638	1408	384
vd_and_css_tweaks	99.70	81.86	21.36	1638	1345	351
rl_modules_hack_2	99.63	81.56	21.36	1637	1340	351
1.36.0-wmf.22	99.63	80.04	19.29	1637	1315	317
vd_tweaks	99.63	79.98	19.23	1637	1314	316
1.36.0-wmf.21	99.63	79.98	19.29	1637	1314	317
1.36.0-wmf.20	99.70	80.22	19.29	1638	1318	317
rl_modules_hack	99.63	80.40	19.35	1637	1321	318
1.36.0-wmf.18	99.33	78.09	19.35	1632	1283	318
1.36.0-wmf.16	99.39	78.09	19.42	1633	1283	319
1.36.0-wmf.14	99.33	78.15	19.35	1632	1284	318
1.36.0-wmf.13	99.33	77.91	19.35	1632	1280	318
cite_css_fixes	99.33	77.97	19.35	1632	1281	318
body_postprocessing_fix	99.33	77.78	19.29	1632	1278	317
1.36.0-wmf.10_and_CSS_fixes	99.33	77.48	19.29	1632	1273	317
1.36.0-wmf.10	99.33	77.18	19.23	1632	1268	316
1.36.0-wmf.9	99.33	77.36	19.17	1632	1271	315
1.36.0-wmf.8	99.33	77.24	19.05	1632	1269	313
1.36.0-wmf.6	99.33	77.12	18.93	1632	1267	311
1.36.0-wmf.5	99.33	76.63	18.81	1632	1259	309
1.36.0-wmf.4	99.33	76.08	18.44	1632	1250	303
1.36.0-wmf.3	99.39	75.59	18.08	1633	1242	297
vector-useskinversion-1	99.39	74.92	17.83	1633	1231	293
1.36.0-wmf.2	99.39	75.53	18.02	1633	1241	296
init_with_css_fixes	99.27	74.32	17.59	1631	1221	289
no_refs	99.33	74.62	42.85	1632	1226	704
no_img_or_gallery	99.57	80.34	18.14	1636	1320	298
init	99.39	74.25	17.59	1633	1220	289

Stats for enwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.82	91.98	31.19	7094	6537	2217
1.38.0-wmf.7	99.83	92.04	31.31	7095	6541	2225
1.38.0-wmf.6	99.82	92.04	30.98	7094	6541	2202
1.38.0-wmf.5	99.82	91.98	31.10	7094	6537	2210
1.38.0-wmf.4	99.80	91.92	30.80	7093	6533	2189
1.38.0-wmf.3	99.80	91.60	29.52	7093	6510	2098
1.38.0-wmf.2	99.80	91.88	29.62	7093	6530	2105
diffscoring-tweak	99.39	91.54	29.25	7064	6506	2079
more-span-stripping	99.42	91.42	20.06	7066	6497	1426
1.38.0-wmf.1	99.41	91.30	19.25	7065	6489	1368
strip-entity-spans	99.32	91.16	19.05	7059	6479	1354
1.37.0-wmf.23	99.31	88.97	12.34	7058	6323	877
puppeteer-bump	99.25	91.61	41.30	7054	6511	2935
1.37.0-wmf.21	99.54	92.06	40.57	7074	6543	2883
1.37.0-wmf.20	99.30	93.06	38.46	7057	6614	2733
more_rl_and_css_fixes	99.55	92.06	37.16	7075	6543	2641
rl_and_css_fixes	99.41	92.85	34.98	7065	6599	2486
survey_and_other_css_tweaks	99.68	90.05	18.59	7084	6400	1321
1.36.0-wmf.27	99.69	90.02	18.60	7085	6398	1322
1.36.0-wmf.26	99.69	90.39	18.64	7085	6424	1325
1.36.0-wmf.25	99.70	90.43	18.46	7086	6427	1312
parsoid_workarounds	99.68	90.71	18.78	7084	6447	1335
vd_and_css_tweaks	99.70	88.77	18.53	7086	6309	1317
rl_modules_hack_2	99.70	88.79	18.46	7086	6310	1312
1.36.0-wmf.22	99.70	86.01	18.35	7086	6113	1304
vd_tweaks	99.70	86.08	18.32	7086	6118	1302
1.36.0-wmf.21	99.70	85.75	18.28	7086	6094	1299
1.36.0-wmf.20	99.70	86.44	18.49	7086	6143	1314
rl_modules_hack	99.68	86.18	18.49	7084	6125	1314
1.36.0-wmf.18	99.48	80.84	19.18	7070	5745	1363
1.36.0-wmf.16	99.47	80.89	18.78	7069	5749	1335
1.36.0-wmf.14	99.49	81.15	19.50	7071	5767	1386
1.36.0-wmf.13	99.51	81.07	19.98	7072	5762	1420
cite_css_fixes	99.49	81.23	20.08	7071	5773	1427
body_postprocessing_fix	99.41	81.31	20.44	7065	5779	1453
1.36.0-wmf.10_and_CSS_fixes	99.47	81.17	20.51	7069	5769	1458
1.36.0-wmf.10	99.45	81.09	20.47	7068	5763	1455
1.36.0-wmf.9	99.42	81.27	20.46	7066	5776	1454
1.36.0-wmf.8	99.44	81.19	20.42	7067	5770	1451
1.36.0-wmf.6	99.48	81.10	20.35	7070	5764	1446
1.36.0-wmf.5	99.48	80.61	20.29	7070	5729	1442
1.36.0-wmf.4	99.52	81.22	20.32	7073	5772	1444
1.36.0-wmf.3	99.54	81.10	20.15	7074	5764	1432
vector-useskinversion-1	99.54	81.10	20.22	7074	5764	1437
1.36.0-wmf.2	99.52	81.02	20.28	7073	5758	1441
init_with_css_fixes	99.52	81.07	20.32	7073	5762	1444
no_refs	99.68	80.70	26.68	7084	5735	1896
no_img_or_gallery	99.56	82.30	23.08	7076	5849	1640
init	99.54	80.79	20.37	7074	5742	1448

Stats for enwikisource

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	88.89	51.85	108	96	56
1.38.0-wmf.7	100.00	87.96	51.85	108	95	56
1.38.0-wmf.6	100.00	88.89	51.85	108	96	56
1.38.0-wmf.5	100.00	88.89	51.85	108	96	56
1.38.0-wmf.4	100.00	88.89	51.85	108	96	56
1.38.0-wmf.3	100.00	87.96	51.85	108	95	56
1.38.0-wmf.2	100.00	88.89	51.85	108	96	56
diffscoring-tweak	100.00	88.89	51.85	108	96	56
more-span-stripping	100.00	87.96	51.85	108	95	56
1.38.0-wmf.1	100.00	87.96	51.85	108	95	56
strip-entity-spans	100.00	88.89	51.85	108	96	56
1.37.0-wmf.23	100.00	88.89	43.52	108	96	47
puppeteer-bump	100.00	87.04	34.26	108	94	37
1.37.0-wmf.21	100.00	86.11	28.70	108	93	31
1.37.0-wmf.20	100.00	87.04	25.00	108	94	27
more_rl_and_css_fixes	99.07	87.96	22.22	107	95	24
rl_and_css_fixes	100.00	88.89	23.15	108	96	25
survey_and_other_css_tweaks	100.00	25.93	0.00	108	28	0
1.36.0-wmf.27	100.00	28.70	0.00	108	31	0
1.36.0-wmf.26	100.00	22.22	0.00	108	24	0
1.36.0-wmf.25	100.00	22.22	0.00	108	24	0
parsoid_workarounds	100.00	21.30	0.00	108	23	0
vd_and_css_tweaks	100.00	21.30	0.00	108	23	0
rl_modules_hack_2	100.00	21.30	0.00	108	23	0
1.36.0-wmf.22	98.15	14.81	0.00	106	16	0
vd_tweaks	97.22	14.81	0.00	105	16	0
1.36.0-wmf.21	98.15	28.70	2.78	106	31	3
1.36.0-wmf.20	98.15	28.70	2.78	106	31	3
rl_modules_hack	98.15	28.70	2.78	106	31	3
1.36.0-wmf.18	98.15	26.85	1.85	106	29	2
1.36.0-wmf.16	98.15	26.85	1.85	106	29	2
1.36.0-wmf.14	99.07	26.85	1.85	107	29	2
1.36.0-wmf.13	98.15	26.85	1.85	106	29	2
cite_css_fixes	98.15	26.85	1.85	106	29	2
body_postprocessing_fix	98.15	26.85	1.85	106	29	2
1.36.0-wmf.10_and_CSS_fixes	98.15	9.26	0.93	106	10	1
1.36.0-wmf.10	98.15	9.26	0.93	106	10	1
1.36.0-wmf.9	98.15	9.26	0.93	106	10	1
1.36.0-wmf.8	98.15	9.26	0.93	106	10	1
1.36.0-wmf.6	98.15	9.26	0.93	106	10	1
1.36.0-wmf.5	98.15	9.26	0.93	106	10	1
1.36.0-wmf.4	98.15	9.26	0.93	106	10	1
1.36.0-wmf.3	98.15	9.26	0.93	106	10	1
vector-useskinversion-1	98.15	22.22	0.93	106	24	1
1.36.0-wmf.2	98.15	22.22	0.93	106	24	1
init_with_css_fixes	98.15	22.22	0.93	106	24	1
no_refs	98.15	22.22	0.93	106	24	1
no_img_or_gallery	98.15	23.15	0.93	106	25	1
init	98.15	22.22	0.93	106	24	1

Stats for enwikivoyage

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	47.75	18.02	111	53	20
1.38.0-wmf.7	100.00	47.75	18.02	111	53	20
1.38.0-wmf.6	100.00	46.85	14.41	111	52	16
1.38.0-wmf.5	100.00	47.75	14.41	111	53	16
1.38.0-wmf.4	100.00	47.75	13.51	111	53	15
1.38.0-wmf.3	100.00	47.75	13.51	111	53	15
1.38.0-wmf.2	100.00	48.65	13.51	111	54	15
diffscoring-tweak	100.00	48.65	13.51	111	54	15
more-span-stripping	100.00	48.65	11.71	111	54	13
1.38.0-wmf.1	100.00	48.65	11.71	111	54	13
strip-entity-spans	100.00	47.75	11.71	111	53	13
1.37.0-wmf.23	100.00	40.54	2.70	111	45	3
puppeteer-bump	97.30	49.55	12.61	108	55	14
1.37.0-wmf.21	100.00	49.55	12.61	111	55	14
1.37.0-wmf.20	100.00	49.55	11.71	111	55	13
more_rl_and_css_fixes	100.00	49.55	11.71	111	55	13
rl_and_css_fixes	100.00	48.65	11.71	111	54	13
survey_and_other_css_tweaks	100.00	46.85	13.51	111	52	15
1.36.0-wmf.27	100.00	45.95	13.51	111	51	15
1.36.0-wmf.26	100.00	45.95	13.51	111	51	15
1.36.0-wmf.25	100.00	45.95	13.51	111	51	15
parsoid_workarounds	100.00	45.95	13.51	111	51	15
vd_and_css_tweaks	100.00	24.32	11.71	111	27	13
rl_modules_hack_2	99.10	24.32	11.71	110	27	13
1.36.0-wmf.22	99.10	24.32	6.31	110	27	7
vd_tweaks	99.10	24.32	6.31	110	27	7
1.36.0-wmf.21	99.10	24.32	6.31	110	27	7
1.36.0-wmf.20	99.10	24.32	6.31	110	27	7
rl_modules_hack	99.10	24.32	6.31	110	27	7
1.36.0-wmf.18	100.00	24.32	6.31	111	27	7
1.36.0-wmf.16	100.00	23.42	6.31	111	26	7
1.36.0-wmf.14	100.00	23.42	6.31	111	26	7
1.36.0-wmf.13	100.00	23.42	6.31	111	26	7
cite_css_fixes	100.00	23.42	6.31	111	26	7
body_postprocessing_fix	100.00	22.52	6.31	111	25	7
1.36.0-wmf.10_and_CSS_fixes	100.00	21.62	6.31	111	24	7
1.36.0-wmf.10	99.10	21.62	6.31	110	24	7
1.36.0-wmf.9	100.00	20.72	6.31	111	23	7
1.36.0-wmf.8	100.00	18.92	4.50	111	21	5
1.36.0-wmf.6	100.00	23.42	6.31	111	26	7
1.36.0-wmf.5	100.00	23.42	6.31	111	26	7
1.36.0-wmf.4	100.00	23.42	6.31	111	26	7
1.36.0-wmf.3	100.00	23.42	6.31	111	26	7
vector-useskinversion-1	100.00	23.42	6.31	111	26	7
1.36.0-wmf.2	100.00	23.42	6.31	111	26	7
init_with_css_fixes	100.00	23.42	6.31	111	26	7
no_refs	100.00	23.42	6.31	111	26	7
no_img_or_gallery	100.00	41.44	8.11	111	46	9
init	100.00	23.42	6.31	111	26	7

Stats for enwiktionary

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	87.27	72.73	110	96	80
1.38.0-wmf.7	100.00	87.27	73.64	110	96	81
1.38.0-wmf.6	100.00	87.27	73.64	110	96	81
1.38.0-wmf.5	100.00	87.27	73.64	110	96	81
1.38.0-wmf.4	100.00	87.27	73.64	110	96	81
1.38.0-wmf.3	100.00	87.27	73.64	110	96	81
1.38.0-wmf.2	100.00	88.18	74.55	110	97	82
diffscoring-tweak	100.00	88.18	74.55	110	97	82
more-span-stripping	100.00	88.18	73.64	110	97	81
1.38.0-wmf.1	100.00	88.18	73.64	110	97	81
strip-entity-spans	100.00	88.18	73.64	110	97	81
1.37.0-wmf.23	100.00	88.18	50.91	110	97	56
puppeteer-bump	100.00	89.09	60.91	110	98	67
1.37.0-wmf.21	100.00	89.09	60.91	110	98	67
1.37.0-wmf.20	100.00	88.18	57.27	110	97	63
more_rl_and_css_fixes	100.00	88.18	57.27	110	97	63
rl_and_css_fixes	100.00	88.18	57.27	110	97	63
survey_and_other_css_tweaks	100.00	88.18	58.18	110	97	64
1.36.0-wmf.27	100.00	88.18	58.18	110	97	64
1.36.0-wmf.26	100.00	88.18	58.18	110	97	64
1.36.0-wmf.25	100.00	88.18	58.18	110	97	64
parsoid_workarounds	100.00	88.18	58.18	110	97	64
vd_and_css_tweaks	100.00	88.18	57.27	110	97	63
rl_modules_hack_2	100.00	88.18	58.18	110	97	64
1.36.0-wmf.22	100.00	86.36	58.18	110	95	64
vd_tweaks	100.00	86.36	58.18	110	95	64
1.36.0-wmf.21	100.00	86.36	58.18	110	95	64
1.36.0-wmf.20	100.00	86.36	58.18	110	95	64
rl_modules_hack	100.00	86.36	58.18	110	95	64
1.36.0-wmf.18	100.00	87.27	58.18	110	96	64
1.36.0-wmf.16	100.00	87.27	58.18	110	96	64
1.36.0-wmf.14	100.00	87.27	58.18	110	96	64
1.36.0-wmf.13	100.00	87.27	60.91	110	96	67
cite_css_fixes	100.00	87.27	60.91	110	96	67
body_postprocessing_fix	100.00	87.27	60.00	110	96	66
1.36.0-wmf.10_and_CSS_fixes	100.00	87.27	60.00	110	96	66
1.36.0-wmf.10	100.00	87.27	58.18	110	96	64
1.36.0-wmf.9	100.00	86.36	49.09	110	95	54
1.36.0-wmf.8	100.00	82.73	46.36	110	91	51
1.36.0-wmf.6	100.00	88.18	50.00	110	97	55
1.36.0-wmf.5	100.00	87.27	43.64	110	96	48
1.36.0-wmf.4	100.00	88.18	36.36	110	97	40
1.36.0-wmf.3	100.00	87.27	20.91	110	96	23
vector-useskinversion-1	100.00	87.27	20.91	110	96	23
1.36.0-wmf.2	100.00	87.27	20.91	110	96	23
init_with_css_fixes	100.00	86.36	20.91	110	95	23
no_refs	100.00	86.36	20.91	110	95	23
no_img_or_gallery	100.00	87.27	20.91	110	96	23
init	100.00	86.36	20.91	110	95	23

Stats for eswiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	91.92	50.11	2179	2003	1092
1.38.0-wmf.7	99.95	92.06	50.30	2178	2006	1096
1.38.0-wmf.6	99.95	92.01	49.93	2178	2005	1088
1.38.0-wmf.5	99.95	91.74	49.75	2178	1999	1084
1.38.0-wmf.4	99.95	92.06	49.98	2178	2006	1089
1.38.0-wmf.3	99.95	90.45	48.55	2178	1971	1058
1.38.0-wmf.2	99.95	92.38	39.74	2178	2013	866
diffscoring-tweak	99.72	91.97	35.15	2173	2004	766
more-span-stripping	99.91	92.20	25.33	2177	2009	552
1.38.0-wmf.1	99.86	92.20	22.90	2176	2009	499
strip-entity-spans	99.86	91.97	22.85	2176	2004	498
1.37.0-wmf.23	99.63	91.65	13.58	2171	1997	296
puppeteer-bump	99.91	90.78	22.44	2177	1978	489
1.37.0-wmf.21	99.82	91.14	22.21	2175	1986	484
1.37.0-wmf.20	99.86	91.05	4.18	2176	1984	91
more_rl_and_css_fixes	99.72	90.50	2.75	2173	1972	60
rl_and_css_fixes	99.72	90.64	2.75	2173	1975	60
survey_and_other_css_tweaks	99.72	79.12	2.85	2173	1724	62
1.36.0-wmf.27	99.68	78.89	2.85	2172	1719	62
1.36.0-wmf.26	99.68	79.07	2.80	2172	1723	61
1.36.0-wmf.25	99.63	78.57	2.80	2171	1712	61
parsoid_workarounds	99.68	78.89	2.80	2172	1719	61
vd_and_css_tweaks	99.77	78.38	2.80	2174	1708	61
rl_modules_hack_2	99.77	77.93	2.80	2174	1698	61
1.36.0-wmf.22	99.72	77.42	2.11	2173	1687	46
vd_tweaks	99.72	78.16	2.16	2173	1703	47
1.36.0-wmf.21	99.86	77.79	2.25	2176	1695	49
1.36.0-wmf.20	99.77	77.51	2.25	2174	1689	49
rl_modules_hack	99.72	77.01	2.34	2173	1678	51
1.36.0-wmf.18	99.72	74.16	2.25	2173	1616	49
1.36.0-wmf.16	99.72	73.66	2.20	2173	1605	48
1.36.0-wmf.14	99.72	73.61	2.34	2173	1604	51
1.36.0-wmf.13	99.77	73.70	2.43	2174	1606	53
cite_css_fixes	99.82	73.66	2.48	2175	1605	54
body_postprocessing_fix	99.63	60.26	2.11	2171	1313	46
1.36.0-wmf.10_and_CSS_fixes	99.63	60.21	2.07	2171	1312	45
1.36.0-wmf.10	99.63	58.19	2.07	2171	1268	45
1.36.0-wmf.9	99.45	58.01	2.02	2167	1264	44
1.36.0-wmf.8	99.63	58.05	1.97	2171	1265	43
1.36.0-wmf.6	99.54	58.05	1.70	2169	1265	37
1.36.0-wmf.5	99.50	57.82	1.47	2168	1260	32
1.36.0-wmf.4	99.45	57.69	1.33	2167	1257	29
1.36.0-wmf.3	99.45	57.60	1.01	2167	1255	22
vector-useskinversion-1	99.45	57.55	1.01	2167	1254	22
1.36.0-wmf.2	99.54	57.69	1.01	2169	1257	22
init_with_css_fixes	99.36	57.64	1.01	2165	1256	22
no_refs	99.86	69.85	1.24	2176	1522	27
no_img_or_gallery	98.76	63.74	0.92	2152	1389	20
init	98.35	54.80	1.01	2143	1194	22

Stats for frwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.82	88.06	47.37	2166	1911	1028
1.38.0-wmf.7	99.86	88.11	47.56	2167	1912	1032
1.38.0-wmf.6	99.82	88.06	47.19	2166	1911	1024
1.38.0-wmf.5	99.82	88.06	47.74	2166	1911	1036
1.38.0-wmf.4	99.86	88.11	47.79	2167	1912	1037
1.38.0-wmf.3	99.82	88.02	48.02	2166	1910	1042
1.38.0-wmf.2	99.82	88.06	47.00	2166	1911	1020
diffscoring-tweak	99.54	88.06	50.88	2160	1911	1104
more-span-stripping	99.59	88.11	35.53	2161	1912	771
1.38.0-wmf.1	99.49	85.67	7.93	2159	1859	172
strip-entity-spans	99.45	85.67	7.00	2158	1859	152
1.37.0-wmf.23	99.54	85.02	3.69	2160	1845	80
puppeteer-bump	99.59	86.73	35.39	2161	1882	768
1.37.0-wmf.21	99.49	86.96	37.65	2159	1887	817
1.37.0-wmf.20	99.35	86.59	24.06	2156	1879	522
more_rl_and_css_fixes	99.63	87.00	21.52	2162	1888	467
rl_and_css_fixes	99.59	75.25	14.52	2161	1633	315
survey_and_other_css_tweaks	99.54	65.67	11.01	2160	1425	239
1.36.0-wmf.27	99.59	65.67	11.06	2161	1425	240
1.36.0-wmf.26	99.63	65.81	11.06	2162	1428	240
1.36.0-wmf.25	99.63	66.27	11.20	2162	1438	243
parsoid_workarounds	99.59	66.36	11.11	2161	1440	241
vd_and_css_tweaks	99.59	63.55	10.78	2161	1379	234
rl_modules_hack_2	99.35	47.70	2.49	2156	1035	54
1.36.0-wmf.22	99.35	47.60	2.53	2156	1033	55
vd_tweaks	99.31	47.65	2.49	2155	1034	54
1.36.0-wmf.21	99.40	47.60	2.53	2157	1033	55
1.36.0-wmf.20	99.35	47.51	2.53	2156	1031	55
rl_modules_hack	99.35	47.74	2.53	2156	1036	55
1.36.0-wmf.18	99.22	46.08	2.44	2153	1000	53
1.36.0-wmf.16	99.22	45.99	2.49	2153	998	54
1.36.0-wmf.14	99.22	46.04	2.49	2153	999	54
1.36.0-wmf.13	99.22	45.90	2.49	2153	996	54
cite_css_fixes	99.22	45.99	2.49	2153	998	54
body_postprocessing_fix	99.22	46.18	2.44	2153	1002	53
1.36.0-wmf.10_and_CSS_fixes	99.22	46.04	2.40	2153	999	52
1.36.0-wmf.10	99.17	44.70	1.38	2152	970	30
1.36.0-wmf.9	99.12	44.52	1.34	2151	966	29
1.36.0-wmf.8	99.17	44.65	1.38	2152	969	30
1.36.0-wmf.6	99.12	44.88	1.43	2151	974	31
1.36.0-wmf.5	99.12	44.84	1.43	2151	973	31
1.36.0-wmf.4	99.12	45.07	1.38	2151	978	30
1.36.0-wmf.3	99.22	45.16	1.38	2153	980	30
vector-useskinversion-1	99.17	45.07	1.38	2152	978	30
1.36.0-wmf.2	99.17	45.12	1.34	2152	979	29
init_with_css_fixes	99.17	44.93	1.38	2152	975	30
no_refs	99.31	51.94	2.81	2155	1127	61
no_img_or_gallery	98.43	46.91	1.38	2136	1018	30
init	98.16	41.94	1.34	2130	910	29

Stats for hewiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	77.32	45.80	441	341	202
1.38.0-wmf.7	100.00	78.00	46.94	441	344	207
1.38.0-wmf.6	100.00	78.46	46.94	441	346	207
1.38.0-wmf.5	100.00	78.23	46.71	441	345	206
1.38.0-wmf.4	100.00	78.68	46.94	441	347	207
1.38.0-wmf.3	100.00	78.00	43.54	441	344	192
1.38.0-wmf.2	100.00	78.46	45.80	441	346	202
diffscoring-tweak	99.77	78.46	46.26	440	346	204
more-span-stripping	99.77	78.46	40.36	440	346	178
1.38.0-wmf.1	99.77	78.23	39.46	440	345	174
strip-entity-spans	100.00	78.68	39.91	441	347	176
1.37.0-wmf.23	99.77	78.91	22.90	440	348	101
puppeteer-bump	99.77	78.46	39.91	440	346	176
1.37.0-wmf.21	100.00	77.78	40.59	441	343	179
1.37.0-wmf.20	99.77	82.77	29.93	440	365	132
more_rl_and_css_fixes	99.77	82.99	22.90	440	366	101
rl_and_css_fixes	99.77	62.36	10.66	440	275	47
survey_and_other_css_tweaks	99.77	64.63	9.07	440	285	40
1.36.0-wmf.27	99.77	63.95	9.75	440	282	43
1.36.0-wmf.26	99.55	63.72	9.75	439	281	43
1.36.0-wmf.25	99.55	63.95	9.75	439	282	43
parsoid_workarounds	99.77	63.95	9.75	440	282	43
vd_and_css_tweaks	99.77	61.68	9.07	440	272	40
rl_modules_hack_2	99.77	61.68	7.94	440	272	35
1.36.0-wmf.22	99.77	43.99	3.63	440	194	16
vd_tweaks	99.77	43.99	3.63	440	194	16
1.36.0-wmf.21	99.55	43.99	3.63	439	194	16
1.36.0-wmf.20	99.55	44.44	3.63	439	196	16
rl_modules_hack	99.77	44.44	3.85	440	196	17
1.36.0-wmf.18	99.55	44.44	3.85	439	196	17
1.36.0-wmf.16	99.55	44.67	3.85	439	197	17
1.36.0-wmf.14	99.77	45.80	4.08	440	202	18
1.36.0-wmf.13	99.77	45.80	3.85	440	202	17
cite_css_fixes	99.77	45.80	3.85	440	202	17
body_postprocessing_fix	99.77	46.71	4.31	440	206	19
1.36.0-wmf.10_and_CSS_fixes	99.77	46.49	4.31	440	205	19
1.36.0-wmf.10	99.55	27.21	0.68	439	120	3
1.36.0-wmf.9	99.55	27.44	0.68	439	121	3
1.36.0-wmf.8	99.55	27.66	0.68	439	122	3
1.36.0-wmf.6	99.55	27.21	0.68	439	120	3
1.36.0-wmf.5	99.32	25.62	0.68	438	113	3
1.36.0-wmf.4	99.09	25.40	0.68	437	112	3
1.36.0-wmf.3	99.32	22.00	0.45	438	97	2
vector-useskinversion-1	98.64	15.42	0.45	435	68	2
1.36.0-wmf.2	100.00	0.00	0.00	441	0	0
init_with_css_fixes	98.41	15.19	0.68	434	67	3
no_refs	98.64	23.36	1.13	435	103	5
no_img_or_gallery	99.55	18.59	0.91	439	82	4
init	98.64	15.19	0.68	435	67	3

Stats for hiwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	82.78	45.93	209	173	96
1.38.0-wmf.7	100.00	82.30	45.45	209	172	95
1.38.0-wmf.6	100.00	82.30	44.98	209	172	94
1.38.0-wmf.5	100.00	82.30	44.50	209	172	93
1.38.0-wmf.4	100.00	81.82	44.50	209	171	93
1.38.0-wmf.3	100.00	82.30	45.45	209	172	95
1.38.0-wmf.2	100.00	81.34	44.50	209	170	93
diffscoring-tweak	100.00	81.34	44.98	209	170	94
more-span-stripping	100.00	81.34	37.80	209	170	79
1.38.0-wmf.1	100.00	81.82	33.97	209	171	71
strip-entity-spans	100.00	80.86	33.01	209	169	69
1.37.0-wmf.23	100.00	80.38	26.79	209	168	56
puppeteer-bump	100.00	82.30	42.11	209	172	88
1.37.0-wmf.21	100.00	82.78	41.15	209	173	86
1.37.0-wmf.20	99.52	83.73	44.02	208	175	92
more_rl_and_css_fixes	100.00	83.25	44.50	209	174	93
rl_and_css_fixes	100.00	82.78	44.50	209	173	93
survey_and_other_css_tweaks	100.00	83.25	37.80	209	174	79
1.36.0-wmf.27	100.00	83.73	37.80	209	175	79
1.36.0-wmf.26	100.00	82.78	37.80	209	173	79
1.36.0-wmf.25	100.00	83.25	38.28	209	174	80
parsoid_workarounds	100.00	83.25	38.28	209	174	80
vd_and_css_tweaks	100.00	82.30	32.54	209	172	68
rl_modules_hack_2	100.00	81.82	31.10	209	171	65
1.36.0-wmf.22	100.00	81.34	30.14	209	170	63
vd_tweaks	100.00	81.34	30.14	209	170	63
1.36.0-wmf.21	100.00	81.34	30.14	209	170	63
1.36.0-wmf.20	100.00	81.82	30.14	209	171	63
rl_modules_hack	100.00	81.34	30.14	209	170	63
1.36.0-wmf.18	100.00	80.38	32.06	209	168	67
1.36.0-wmf.16	100.00	79.90	32.54	209	167	68
1.36.0-wmf.14	100.00	80.86	32.54	209	169	68
1.36.0-wmf.13	100.00	81.34	32.54	209	170	68
cite_css_fixes	100.00	80.86	32.54	209	169	68
body_postprocessing_fix	100.00	80.38	32.54	209	168	68
1.36.0-wmf.10_and_CSS_fixes	100.00	80.86	32.06	209	169	67
1.36.0-wmf.10	100.00	81.34	16.27	209	170	34
1.36.0-wmf.9	100.00	80.86	16.27	209	169	34
1.36.0-wmf.8	100.00	80.38	15.79	209	168	33
1.36.0-wmf.6	100.00	79.43	15.31	209	166	32
1.36.0-wmf.5	100.00	79.43	14.35	209	166	30
1.36.0-wmf.4	100.00	80.38	13.88	209	168	29
1.36.0-wmf.3	100.00	77.51	5.74	209	162	12
vector-useskinversion-1	100.00	77.03	5.74	209	161	12
1.36.0-wmf.2	100.00	76.08	5.74	209	159	12
init_with_css_fixes	100.00	76.08	5.74	209	159	12
no_refs	100.00	78.95	26.79	209	165	56
no_img_or_gallery	100.00	82.30	6.70	209	172	14
init	100.00	77.03	5.74	209	161	12

Stats for iswiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	87.27	54.55	110	96	60
1.38.0-wmf.7	100.00	87.27	53.64	110	96	59
1.38.0-wmf.6	100.00	87.27	53.64	110	96	59
1.38.0-wmf.5	100.00	87.27	44.55	110	96	49
1.38.0-wmf.4	100.00	87.27	44.55	110	96	49
1.38.0-wmf.3	100.00	87.27	44.55	110	96	49
1.38.0-wmf.2	100.00	87.27	46.36	110	96	51
diffscoring-tweak	100.00	87.27	44.55	110	96	49
more-span-stripping	100.00	87.27	38.18	110	96	42
1.38.0-wmf.1	100.00	87.27	38.18	110	96	42
strip-entity-spans	100.00	87.27	39.09	110	96	43
1.37.0-wmf.23	100.00	85.45	32.73	110	94	36
puppeteer-bump	100.00	86.36	43.64	110	95	48
1.37.0-wmf.21	100.00	85.45	42.73	110	94	47
1.37.0-wmf.20	100.00	85.45	48.18	110	94	53
more_rl_and_css_fixes	100.00	85.45	48.18	110	94	53
rl_and_css_fixes	100.00	85.45	49.09	110	94	54
survey_and_other_css_tweaks	100.00	94.55	46.36	110	104	51
1.36.0-wmf.27	100.00	94.55	46.36	110	104	51
1.36.0-wmf.26	100.00	94.55	46.36	110	104	51
1.36.0-wmf.25	100.00	94.55	49.09	110	104	54
parsoid_workarounds	100.00	94.55	49.09	110	104	54
vd_and_css_tweaks	100.00	91.82	47.27	110	101	52
rl_modules_hack_2	100.00	91.82	47.27	110	101	52
1.36.0-wmf.22	100.00	83.64	40.91	110	92	45
vd_tweaks	100.00	83.64	40.91	110	92	45
1.36.0-wmf.21	100.00	83.64	40.91	110	92	45
1.36.0-wmf.20	100.00	83.64	40.91	110	92	45
rl_modules_hack	100.00	83.64	40.91	110	92	45
1.36.0-wmf.18	100.00	81.82	41.82	110	90	46
1.36.0-wmf.16	100.00	81.82	40.91	110	90	45
1.36.0-wmf.14	100.00	81.82	40.91	110	90	45
1.36.0-wmf.13	100.00	81.82	40.91	110	90	45
cite_css_fixes	100.00	81.82	40.91	110	90	45
body_postprocessing_fix	100.00	77.27	40.00	110	85	44
1.36.0-wmf.10_and_CSS_fixes	100.00	76.36	39.09	110	84	43
1.36.0-wmf.10	100.00	75.45	39.09	110	83	43
1.36.0-wmf.9	100.00	74.55	38.18	110	82	42
1.36.0-wmf.8	100.00	72.73	37.27	110	80	41
1.36.0-wmf.6	100.00	71.82	34.55	110	79	38
1.36.0-wmf.5	100.00	65.45	29.09	110	72	32
1.36.0-wmf.4	100.00	60.91	26.36	110	67	29
1.36.0-wmf.3	100.00	55.45	20.91	110	61	23
vector-useskinversion-1	100.00	55.45	20.91	110	61	23
1.36.0-wmf.2	100.00	55.45	20.91	110	61	23
init_with_css_fixes	100.00	54.55	20.91	110	60	23
no_refs	100.00	56.36	23.64	110	62	26
no_img_or_gallery	100.00	56.36	20.00	110	62	22
init	100.00	54.55	20.91	110	60	23

Stats for itwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.94	91.09	54.09	1637	1492	886
1.38.0-wmf.7	99.94	91.15	53.97	1637	1493	884
1.38.0-wmf.6	99.94	91.33	53.85	1637	1496	882
1.38.0-wmf.5	99.94	91.21	53.36	1637	1494	874
1.38.0-wmf.4	99.94	91.21	53.36	1637	1494	874
1.38.0-wmf.3	99.88	91.21	53.91	1636	1494	883
1.38.0-wmf.2	99.88	91.21	53.91	1636	1494	883
diffscoring-tweak	99.88	91.03	53.91	1636	1491	883
more-span-stripping	99.82	91.09	46.03	1635	1492	754
1.38.0-wmf.1	99.82	91.15	44.26	1635	1493	725
strip-entity-spans	99.82	90.96	43.89	1635	1490	719
1.37.0-wmf.23	99.82	90.35	11.66	1635	1480	191
puppeteer-bump	99.76	93.53	50.06	1634	1532	820
1.37.0-wmf.21	99.82	93.65	49.51	1635	1534	811
1.37.0-wmf.20	99.82	92.98	31.44	1635	1523	515
more_rl_and_css_fixes	99.63	93.10	30.40	1632	1525	498
rl_and_css_fixes	99.69	92.92	30.59	1633	1522	501
survey_and_other_css_tweaks	99.82	83.33	18.93	1635	1365	310
1.36.0-wmf.27	99.82	83.21	18.99	1635	1363	311
1.36.0-wmf.26	99.76	83.39	18.99	1634	1366	311
1.36.0-wmf.25	99.82	83.27	18.99	1635	1364	311
parsoid_workarounds	99.82	83.09	18.74	1635	1361	307
vd_and_css_tweaks	99.76	78.69	18.56	1634	1289	304
rl_modules_hack_2	99.82	76.92	15.69	1635	1260	257
1.36.0-wmf.22	99.82	77.17	15.69	1635	1264	257
vd_tweaks	99.82	76.98	15.69	1635	1261	257
1.36.0-wmf.21	99.82	76.98	15.69	1635	1261	257
1.36.0-wmf.20	99.82	76.92	15.69	1635	1260	257
rl_modules_hack	99.82	76.86	15.69	1635	1259	257
1.36.0-wmf.18	99.69	78.57	15.87	1633	1287	260
1.36.0-wmf.16	99.69	78.69	14.96	1633	1289	245
1.36.0-wmf.14	99.76	78.45	15.87	1634	1285	260
1.36.0-wmf.13	99.76	78.57	15.93	1634	1287	261
cite_css_fixes	99.76	78.39	15.93	1634	1284	261
body_postprocessing_fix	99.76	78.39	16.00	1634	1284	262
1.36.0-wmf.10_and_CSS_fixes	99.76	78.39	16.00	1634	1284	262
1.36.0-wmf.10	99.76	78.27	16.00	1634	1282	262
1.36.0-wmf.9	99.76	78.57	16.00	1634	1287	262
1.36.0-wmf.8	99.76	78.27	15.81	1634	1282	259
1.36.0-wmf.6	99.76	78.33	15.81	1634	1283	259
1.36.0-wmf.5	99.76	78.27	15.69	1634	1282	257
1.36.0-wmf.4	99.76	78.27	15.57	1634	1282	255
1.36.0-wmf.3	99.76	78.21	15.45	1634	1281	253
vector-useskinversion-1	99.76	78.21	15.51	1634	1281	254
1.36.0-wmf.2	99.76	78.21	15.38	1634	1281	252
init_with_css_fixes	99.76	77.90	13.49	1634	1276	221
no_refs	99.82	78.88	17.89	1635	1292	293
no_img_or_gallery	99.94	79.00	16.12	1637	1294	264
init	99.76	77.66	13.00	1634	1272	213

Stats for jawiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.79	93.66	55.21	929	872	514
1.38.0-wmf.7	99.79	91.84	47.58	929	855	443
1.38.0-wmf.6	99.79	91.51	47.37	929	852	441
1.38.0-wmf.5	99.79	91.62	46.94	929	853	437
1.38.0-wmf.4	99.79	91.62	46.94	929	853	437
1.38.0-wmf.3	99.79	91.73	47.26	929	854	440
1.38.0-wmf.2	99.79	91.62	46.62	929	853	434
diffscoring-tweak	99.25	91.51	46.94	924	852	437
more-span-stripping	99.36	91.84	27.18	925	855	253
1.38.0-wmf.1	99.36	91.73	26.64	925	854	248
strip-entity-spans	99.36	91.51	26.64	925	852	248
1.37.0-wmf.23	99.25	60.90	12.78	924	567	119
puppeteer-bump	99.36	91.84	17.51	925	855	163
1.37.0-wmf.21	99.57	91.84	17.94	927	855	167
1.37.0-wmf.20	99.57	94.09	18.58	927	876	173
more_rl_and_css_fixes	99.57	94.09	18.05	927	876	168
rl_and_css_fixes	99.03	93.13	18.05	922	867	168
survey_and_other_css_tweaks	99.68	94.09	16.97	928	876	158
1.36.0-wmf.27	99.68	94.20	17.08	928	877	159
1.36.0-wmf.26	99.68	94.31	17.40	928	878	162
1.36.0-wmf.25	99.68	94.31	17.51	928	878	163
parsoid_workarounds	99.68	94.09	17.62	928	876	164
vd_and_css_tweaks	99.68	90.23	13.96	928	840	130
rl_modules_hack_2	99.68	90.12	13.96	928	839	130
1.36.0-wmf.22	99.68	87.97	13.00	928	819	121
vd_tweaks	99.68	87.97	12.89	928	819	120
1.36.0-wmf.21	99.68	88.18	12.78	928	821	119
1.36.0-wmf.20	99.68	88.18	12.57	928	821	117
rl_modules_hack	99.68	88.18	12.67	928	821	118
1.36.0-wmf.18	99.68	88.08	12.24	928	820	114
1.36.0-wmf.16	99.89	88.83	13.00	930	827	121
1.36.0-wmf.14	99.89	88.61	12.78	930	825	119
1.36.0-wmf.13	99.89	88.61	12.78	930	825	119
cite_css_fixes	99.89	88.61	13.00	930	825	121
body_postprocessing_fix	99.89	88.40	12.67	930	823	118
1.36.0-wmf.10_and_CSS_fixes	99.89	88.51	12.78	930	824	119
1.36.0-wmf.10	99.89	88.18	12.35	930	821	115
1.36.0-wmf.9	99.89	88.72	12.46	930	826	116
1.36.0-wmf.8	99.89	88.51	12.35	930	824	115
1.36.0-wmf.6	99.89	88.08	12.67	930	820	118
1.36.0-wmf.5	99.89	87.43	12.78	930	814	119
1.36.0-wmf.4	99.89	85.93	12.14	930	800	113
1.36.0-wmf.3	99.89	84.21	10.31	930	784	96
vector-useskinversion-1	99.89	84.21	10.31	930	784	96
1.36.0-wmf.2	99.89	84.10	10.31	930	783	96
init_with_css_fixes	99.89	83.57	10.10	930	778	94
no_refs	100.00	83.57	25.03	931	778	233
no_img_or_gallery	99.89	84.00	10.42	930	782	97
init	99.68	83.57	9.99	928	778	93

Stats for kaawiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	91.84	60.20	98	90	59
1.38.0-wmf.7	100.00	91.84	60.20	98	90	59
1.38.0-wmf.6	100.00	91.84	60.20	98	90	59
1.38.0-wmf.5	100.00	91.84	60.20	98	90	59
1.38.0-wmf.4	100.00	91.84	60.20	98	90	59
1.38.0-wmf.3	100.00	91.84	60.20	98	90	59
1.38.0-wmf.2	100.00	91.84	59.18	98	90	58
diffscoring-tweak	100.00	91.84	59.18	98	90	58
more-span-stripping	100.00	91.84	55.10	98	90	54
1.38.0-wmf.1	100.00	91.84	51.02	98	90	50
strip-entity-spans	100.00	91.84	51.02	98	90	50
1.37.0-wmf.23	100.00	91.84	45.92	98	90	45
puppeteer-bump	100.00	91.84	56.12	98	90	55
1.37.0-wmf.21	100.00	91.84	56.12	98	90	55
1.37.0-wmf.20	100.00	91.84	55.10	98	90	54
more_rl_and_css_fixes	100.00	91.84	55.10	98	90	54
rl_and_css_fixes	100.00	90.82	54.08	98	89	53
survey_and_other_css_tweaks	100.00	98.98	75.51	98	97	74
1.36.0-wmf.27	100.00	98.98	75.51	98	97	74
1.36.0-wmf.26	100.00	98.98	75.51	98	97	74
1.36.0-wmf.25	100.00	98.98	75.51	98	97	74
parsoid_workarounds	100.00	98.98	75.51	98	97	74
vd_and_css_tweaks	100.00	95.92	64.29	98	94	63
rl_modules_hack_2	100.00	95.92	64.29	98	94	63
1.36.0-wmf.22	100.00	91.84	55.10	98	90	54
vd_tweaks	100.00	91.84	55.10	98	90	54
1.36.0-wmf.21	100.00	91.84	55.10	98	90	54
1.36.0-wmf.20	100.00	91.84	55.10	98	90	54
rl_modules_hack	100.00	91.84	55.10	98	90	54
1.36.0-wmf.18	100.00	89.80	54.08	98	88	53
1.36.0-wmf.16	100.00	89.80	54.08	98	88	53
1.36.0-wmf.14	100.00	89.80	54.08	98	88	53
1.36.0-wmf.13	100.00	89.80	53.06	98	88	52
cite_css_fixes	100.00	89.80	53.06	98	88	52
body_postprocessing_fix	100.00	87.76	53.06	98	86	52
1.36.0-wmf.10_and_CSS_fixes	100.00	86.73	52.04	98	85	51
1.36.0-wmf.10	100.00	84.69	52.04	98	83	51
1.36.0-wmf.9	100.00	84.69	50.00	98	83	49
1.36.0-wmf.8	100.00	84.69	47.96	98	83	47
1.36.0-wmf.6	100.00	81.63	43.88	98	80	43
1.36.0-wmf.5	100.00	78.57	38.78	98	77	38
1.36.0-wmf.4	100.00	78.57	32.65	98	77	32
1.36.0-wmf.3	100.00	72.45	23.47	98	71	23
vector-useskinversion-1	100.00	72.45	23.47	98	71	23
1.36.0-wmf.2	100.00	72.45	23.47	98	71	23
init_with_css_fixes	100.00	70.41	22.45	98	69	22
no_refs	100.00	70.41	22.45	98	69	22
no_img_or_gallery	100.00	73.47	23.47	98	72	23
init	100.00	70.41	22.45	98	69	22

Stats for kowiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	92.48	63.91	133	123	85
1.38.0-wmf.7	100.00	92.48	64.66	133	123	86
1.38.0-wmf.6	100.00	92.48	64.66	133	123	86
1.38.0-wmf.5	100.00	92.48	63.16	133	123	84
1.38.0-wmf.4	100.00	92.48	61.65	133	123	82
1.38.0-wmf.3	100.00	91.73	62.41	133	122	83
1.38.0-wmf.2	100.00	91.73	57.89	133	122	77
diffscoring-tweak	100.00	91.73	55.64	133	122	74
more-span-stripping	100.00	91.73	47.37	133	122	63
1.38.0-wmf.1	100.00	90.98	40.60	133	121	54
strip-entity-spans	99.25	90.23	41.35	132	120	55
1.37.0-wmf.23	99.25	89.47	38.35	132	119	51
puppeteer-bump	100.00	90.23	54.89	133	120	73
1.37.0-wmf.21	100.00	88.72	51.13	133	118	68
1.37.0-wmf.20	99.25	88.72	50.38	132	118	67
more_rl_and_css_fixes	100.00	88.72	50.38	133	118	67
rl_and_css_fixes	100.00	88.72	52.63	133	118	70
survey_and_other_css_tweaks	99.25	90.23	28.57	132	120	38
1.36.0-wmf.27	99.25	89.47	28.57	132	119	38
1.36.0-wmf.26	99.25	90.98	29.32	132	121	39
1.36.0-wmf.25	100.00	90.98	30.08	133	121	40
parsoid_workarounds	100.00	90.98	27.82	133	121	37
vd_and_css_tweaks	100.00	90.98	27.82	133	121	37
rl_modules_hack_2	99.25	90.98	27.82	132	121	37
1.36.0-wmf.22	100.00	90.98	25.56	133	121	34
vd_tweaks	100.00	90.98	25.56	133	121	34
1.36.0-wmf.21	100.00	90.98	27.82	133	121	37
1.36.0-wmf.20	100.00	90.98	27.82	133	121	37
rl_modules_hack	100.00	90.98	27.07	133	121	36
1.36.0-wmf.18	100.00	87.22	27.07	133	116	36
1.36.0-wmf.16	100.00	87.97	27.07	133	117	36
1.36.0-wmf.14	100.00	87.22	26.32	133	116	35
1.36.0-wmf.13	100.00	87.22	26.32	133	116	35
cite_css_fixes	100.00	87.22	26.32	133	116	35
body_postprocessing_fix	100.00	86.47	26.32	133	115	35
1.36.0-wmf.10_and_CSS_fixes	100.00	87.22	26.32	133	116	35
1.36.0-wmf.10	100.00	81.95	6.77	133	109	9
1.36.0-wmf.9	100.00	80.45	6.77	133	107	9
1.36.0-wmf.8	100.00	79.70	6.77	133	106	9
1.36.0-wmf.6	100.00	80.45	6.77	133	107	9
1.36.0-wmf.5	100.00	79.70	6.77	133	106	9
1.36.0-wmf.4	100.00	79.70	6.77	133	106	9
1.36.0-wmf.3	100.00	79.70	6.77	133	106	9
vector-useskinversion-1	100.00	79.70	6.77	133	106	9
1.36.0-wmf.2	100.00	79.70	6.77	133	106	9
init_with_css_fixes	100.00	78.95	6.02	133	105	8
no_refs	100.00	81.95	6.77	133	109	9
no_img_or_gallery	100.00	77.44	6.77	133	103	9
init	100.00	78.20	6.02	133	104	8

Stats for nlwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	97.09	34.06	1098	1066	374
1.38.0-wmf.7	100.00	97.27	34.15	1098	1068	375
1.38.0-wmf.6	100.00	97.27	33.97	1098	1068	373
1.38.0-wmf.5	100.00	97.27	33.88	1098	1068	372
1.38.0-wmf.4	100.00	97.27	33.15	1098	1068	364
1.38.0-wmf.3	100.00	97.18	31.69	1098	1067	348
1.38.0-wmf.2	100.00	97.09	30.97	1098	1066	340
diffscoring-tweak	100.00	96.99	31.79	1098	1065	349
more-span-stripping	100.00	97.09	24.41	1098	1066	268
1.38.0-wmf.1	100.00	97.09	24.04	1098	1066	264
strip-entity-spans	100.00	97.09	23.86	1098	1066	262
1.37.0-wmf.23	100.00	97.09	13.66	1098	1066	150
puppeteer-bump	100.00	96.99	34.97	1098	1065	384
1.37.0-wmf.21	100.00	96.99	34.88	1098	1065	383
1.37.0-wmf.20	100.00	97.18	31.06	1098	1067	341
more_rl_and_css_fixes	100.00	97.18	30.78	1098	1067	338
rl_and_css_fixes	100.00	97.18	31.06	1098	1067	341
survey_and_other_css_tweaks	100.00	97.36	28.69	1098	1069	315
1.36.0-wmf.27	100.00	97.45	28.78	1098	1070	316
1.36.0-wmf.26	100.00	97.45	29.33	1098	1070	322
1.36.0-wmf.25	100.00	97.54	29.60	1098	1071	325
parsoid_workarounds	100.00	97.36	29.78	1098	1069	327
vd_and_css_tweaks	100.00	95.08	23.86	1098	1044	262
rl_modules_hack_2	100.00	95.17	23.86	1098	1045	262
1.36.0-wmf.22	100.00	93.17	21.86	1098	1023	240
vd_tweaks	100.00	93.35	21.86	1098	1025	240
1.36.0-wmf.21	100.00	93.44	21.86	1098	1026	240
1.36.0-wmf.20	100.00	93.44	21.86	1098	1026	240
rl_modules_hack	100.00	93.44	22.22	1098	1026	244
1.36.0-wmf.18	100.00	92.26	21.22	1098	1013	233
1.36.0-wmf.16	100.00	92.35	21.13	1098	1014	232
1.36.0-wmf.14	100.00	92.44	21.22	1098	1015	233
1.36.0-wmf.13	100.00	92.35	21.22	1098	1014	233
cite_css_fixes	100.00	92.17	21.13	1098	1012	232
body_postprocessing_fix	100.00	92.35	21.86	1098	1014	240
1.36.0-wmf.10_and_CSS_fixes	100.00	92.17	21.86	1098	1012	240
1.36.0-wmf.10	100.00	92.08	21.77	1098	1011	239
1.36.0-wmf.9	100.00	51.28	13.57	1098	563	149
1.36.0-wmf.8	100.00	15.12	7.56	1098	166	83
1.36.0-wmf.6	100.00	14.85	7.10	1098	163	78
1.36.0-wmf.5	100.00	14.12	6.10	1098	155	67
1.36.0-wmf.4	100.00	13.30	4.55	1098	146	50
1.36.0-wmf.3	100.00	12.84	4.37	1098	141	48
vector-useskinversion-1	100.00	12.75	4.37	1098	140	48
1.36.0-wmf.2	100.00	12.75	4.28	1098	140	47
init_with_css_fixes	100.00	12.75	4.28	1098	140	47
no_refs	100.00	12.84	4.92	1098	141	54
no_img_or_gallery	100.00	13.48	4.37	1098	148	48
init	100.00	12.75	4.28	1098	140	47

Stats for plwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.73	95.18	71.88	1096	1046	790
1.38.0-wmf.7	99.73	94.81	70.34	1096	1042	773
1.38.0-wmf.6	99.73	94.63	69.70	1096	1040	766
1.38.0-wmf.5	99.73	95.72	72.07	1096	1052	792
1.38.0-wmf.4	99.73	95.91	71.61	1096	1054	787
1.38.0-wmf.3	99.73	95.91	71.43	1096	1054	785
1.38.0-wmf.2	99.73	95.45	70.15	1096	1049	771
diffscoring-tweak	99.73	95.27	70.06	1096	1047	770
more-span-stripping	99.73	95.18	49.32	1096	1046	542
1.38.0-wmf.1	99.73	95.27	48.32	1096	1047	531
strip-entity-spans	99.73	95.27	48.41	1096	1047	532
1.37.0-wmf.23	99.64	94.18	18.56	1095	1035	204
puppeteer-bump	99.73	94.90	65.24	1096	1043	717
1.37.0-wmf.21	99.82	95.27	62.33	1097	1047	685
1.37.0-wmf.20	99.73	90.08	41.13	1096	990	452
more_rl_and_css_fixes	99.82	91.08	39.76	1097	1001	437
rl_and_css_fixes	99.73	82.44	36.31	1096	906	399
survey_and_other_css_tweaks	99.64	91.08	36.85	1095	1001	405
1.36.0-wmf.27	99.64	91.17	37.12	1095	1002	408
1.36.0-wmf.26	99.64	91.36	37.31	1095	1004	410
1.36.0-wmf.25	99.64	91.54	37.31	1095	1006	410
parsoid_workarounds	99.64	91.54	37.31	1095	1006	410
vd_and_css_tweaks	99.64	88.81	30.94	1095	976	340
rl_modules_hack_2	99.64	88.81	30.85	1095	976	339
1.36.0-wmf.22	99.64	73.34	26.84	1095	806	295
vd_tweaks	99.64	73.43	26.75	1095	807	294
1.36.0-wmf.21	99.64	73.34	27.30	1095	806	300
1.36.0-wmf.20	99.64	73.70	27.39	1095	810	301
rl_modules_hack	99.64	73.70	27.57	1095	810	303
1.36.0-wmf.18	99.27	68.15	26.11	1091	749	287
1.36.0-wmf.16	99.18	68.24	26.48	1090	750	291
1.36.0-wmf.14	99.45	67.97	26.21	1093	747	288
1.36.0-wmf.13	99.36	67.70	26.21	1092	744	288
cite_css_fixes	99.36	67.61	26.30	1092	743	289
body_postprocessing_fix	99.45	67.61	26.75	1093	743	294
1.36.0-wmf.10_and_CSS_fixes	99.45	67.52	26.57	1093	742	292
1.36.0-wmf.10	99.45	66.15	25.39	1093	727	279
1.36.0-wmf.9	99.45	65.97	25.11	1093	725	276
1.36.0-wmf.8	99.36	66.06	25.20	1092	726	277
1.36.0-wmf.6	99.45	66.33	25.20	1093	729	277
1.36.0-wmf.5	99.45	65.70	24.29	1093	722	267
1.36.0-wmf.4	99.36	65.70	24.29	1092	722	267
1.36.0-wmf.3	99.45	65.15	23.57	1093	716	259
vector-useskinversion-1	99.45	65.06	23.48	1093	715	258
1.36.0-wmf.2	99.45	65.06	23.38	1093	715	257
init_with_css_fixes	99.45	64.51	23.20	1093	709	255
no_refs	99.73	67.70	28.03	1096	744	308
no_img_or_gallery	99.09	43.95	12.74	1089	483	140
init	99.00	39.58	12.65	1088	435	139

Stats for ruwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.95	90.89	33.24	2183	1985	726
1.38.0-wmf.7	99.95	90.84	32.69	2183	1984	714
1.38.0-wmf.6	99.95	90.61	32.83	2183	1979	717
1.38.0-wmf.5	99.91	90.57	32.37	2182	1978	707
1.38.0-wmf.4	99.95	90.52	32.65	2183	1977	713
1.38.0-wmf.3	99.91	90.52	32.55	2182	1977	711
1.38.0-wmf.2	99.91	90.52	31.87	2182	1977	696
diffscoring-tweak	99.77	90.75	32.01	2179	1982	699
more-span-stripping	99.82	90.57	21.29	2180	1978	465
1.38.0-wmf.1	99.68	90.11	18.22	2177	1968	398
strip-entity-spans	99.68	90.29	18.54	2177	1972	405
1.37.0-wmf.23	99.63	88.83	9.11	2176	1940	199
puppeteer-bump	99.73	90.02	33.75	2178	1966	737
1.37.0-wmf.21	99.68	90.02	31.41	2177	1966	686
1.37.0-wmf.20	99.73	91.35	25.78	2178	1995	563
more_rl_and_css_fixes	99.82	91.21	25.18	2180	1992	550
rl_and_css_fixes	99.73	90.71	25.50	2178	1981	557
survey_and_other_css_tweaks	99.82	83.15	19.73	2180	1816	431
1.36.0-wmf.27	99.73	85.85	19.78	2178	1875	432
1.36.0-wmf.26	99.73	85.99	20.42	2178	1878	446
1.36.0-wmf.25	99.82	86.03	20.51	2180	1879	448
parsoid_workarounds	99.82	85.99	20.74	2180	1878	453
vd_and_css_tweaks	99.82	83.24	18.91	2180	1818	413
rl_modules_hack_2	99.77	83.20	18.64	2179	1817	407
1.36.0-wmf.22	99.77	81.46	18.50	2179	1779	404
vd_tweaks	99.77	81.73	18.41	2179	1785	402
1.36.0-wmf.21	99.77	82.97	18.45	2179	1812	403
1.36.0-wmf.20	99.77	82.10	18.54	2179	1793	405
rl_modules_hack	99.77	82.88	18.09	2179	1810	395
1.36.0-wmf.18	99.73	64.88	17.72	2178	1417	387
1.36.0-wmf.16	99.68	63.32	17.17	2177	1383	375
1.36.0-wmf.14	99.68	64.70	17.45	2177	1413	381
1.36.0-wmf.13	99.68	64.61	17.49	2177	1411	382
cite_css_fixes	99.68	64.74	17.63	2177	1414	385
body_postprocessing_fix	99.77	64.56	17.54	2179	1410	383
1.36.0-wmf.10_and_CSS_fixes	99.68	64.29	17.35	2177	1404	379
1.36.0-wmf.10	99.68	64.06	17.17	2177	1399	375
1.36.0-wmf.9	99.68	64.10	16.94	2177	1400	370
1.36.0-wmf.8	99.63	64.10	16.67	2176	1400	364
1.36.0-wmf.6	99.63	63.42	16.62	2176	1385	363
1.36.0-wmf.5	99.77	63.14	16.07	2179	1379	351
1.36.0-wmf.4	99.73	63.10	15.75	2178	1378	344
1.36.0-wmf.3	99.77	62.45	14.33	2179	1364	313
vector-useskinversion-1	99.77	61.90	14.19	2179	1352	310
1.36.0-wmf.2	99.77	62.45	14.47	2179	1364	316
init_with_css_fixes	99.73	62.13	14.15	2178	1357	309
no_refs	99.91	63.00	19.14	2182	1376	418
no_img_or_gallery	99.54	52.47	6.46	2174	1146	141
init	99.54	50.18	6.36	2174	1096	139

Stats for svwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	100.00	92.15	27.74	739	681	205
1.38.0-wmf.7	100.00	92.56	28.01	739	684	207
1.38.0-wmf.6	100.00	92.42	27.74	739	683	205
1.38.0-wmf.5	100.00	92.56	27.33	739	684	202
1.38.0-wmf.4	100.00	91.20	26.25	739	674	194
1.38.0-wmf.3	100.00	91.34	26.52	739	675	196
1.38.0-wmf.2	100.00	92.29	26.25	739	682	194
diffscoring-tweak	100.00	92.15	26.79	739	681	198
more-span-stripping	100.00	92.29	20.43	739	682	151
1.38.0-wmf.1	100.00	92.29	18.67	739	682	138
strip-entity-spans	100.00	91.75	18.67	739	678	138
1.37.0-wmf.23	100.00	89.58	6.36	739	662	47
puppeteer-bump	100.00	92.02	33.83	739	680	250
1.37.0-wmf.21	100.00	92.56	33.69	739	684	249
1.37.0-wmf.20	100.00	94.99	34.24	739	702	253
more_rl_and_css_fixes	100.00	94.72	33.83	739	700	250
rl_and_css_fixes	100.00	89.58	33.96	739	662	251
survey_and_other_css_tweaks	100.00	88.90	15.29	739	657	113
1.36.0-wmf.27	100.00	89.04	15.29	739	658	113
1.36.0-wmf.26	100.00	89.04	14.75	739	658	109
1.36.0-wmf.25	100.00	89.17	15.16	739	659	112
parsoid_workarounds	100.00	89.17	15.29	739	659	113
vd_and_css_tweaks	100.00	88.36	14.61	739	653	108
rl_modules_hack_2	100.00	87.96	12.99	739	650	96
1.36.0-wmf.22	100.00	72.26	12.04	739	534	89
vd_tweaks	99.86	72.26	11.91	738	534	88
1.36.0-wmf.21	99.59	65.09	5.68	736	481	42
1.36.0-wmf.20	99.46	65.09	5.68	735	481	42
rl_modules_hack	99.46	65.09	5.82	735	481	43
1.36.0-wmf.18	99.46	64.55	5.82	735	477	43
1.36.0-wmf.16	99.46	64.82	5.82	735	479	43
1.36.0-wmf.14	99.46	64.82	5.95	735	479	44
1.36.0-wmf.13	99.59	64.55	5.82	736	477	43
cite_css_fixes	99.59	64.68	5.82	736	478	43
body_postprocessing_fix	99.59	64.95	5.82	736	480	43
1.36.0-wmf.10_and_CSS_fixes	99.59	64.68	5.82	736	478	43
1.36.0-wmf.10	99.73	64.82	5.82	737	479	43
1.36.0-wmf.9	99.73	64.68	5.95	737	478	44
1.36.0-wmf.8	99.59	64.41	5.82	736	476	43
1.36.0-wmf.6	99.73	64.01	5.55	737	473	41
1.36.0-wmf.5	99.73	64.14	5.41	737	474	40
1.36.0-wmf.4	99.73	64.01	5.41	737	473	40
1.36.0-wmf.3	99.73	63.73	5.41	737	471	40
vector-useskinversion-1	99.73	63.73	5.41	737	471	40
1.36.0-wmf.2	99.59	63.73	5.41	736	471	40
init_with_css_fixes	99.73	63.33	5.41	737	468	40
no_refs	100.00	70.64	15.43	739	522	114
no_img_or_gallery	99.59	27.74	4.87	736	205	36
init	99.59	27.74	4.74	736	205	35

Stats for viwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	99.91	93.66	57.63	1087	1019	627
1.38.0-wmf.7	100.00	93.75	55.88	1088	1020	608
1.38.0-wmf.6	100.00	93.84	55.33	1088	1021	602
1.38.0-wmf.5	100.00	93.93	55.42	1088	1022	603
1.38.0-wmf.4	100.00	94.03	55.15	1088	1023	600
1.38.0-wmf.3	99.91	94.03	55.42	1087	1023	603
1.38.0-wmf.2	100.00	93.93	55.42	1088	1022	603
diffscoring-tweak	99.63	93.84	55.70	1084	1021	606
more-span-stripping	99.82	93.75	43.01	1086	1020	468
1.38.0-wmf.1	99.72	93.84	42.46	1085	1021	462
strip-entity-spans	99.91	93.75	42.37	1087	1020	461
1.37.0-wmf.23	99.54	90.90	34.01	1083	989	370
puppeteer-bump	99.63	93.57	34.65	1084	1018	377
1.37.0-wmf.21	99.91	94.12	33.73	1087	1024	367
1.37.0-wmf.20	99.63	91.27	25.09	1084	993	273
more_rl_and_css_fixes	99.82	90.90	24.45	1086	989	266
rl_and_css_fixes	99.82	90.99	24.36	1086	990	265
survey_and_other_css_tweaks	99.82	89.80	13.88	1086	977	151
1.36.0-wmf.27	99.72	89.06	12.59	1085	969	137
1.36.0-wmf.26	99.82	89.89	14.06	1086	978	153
1.36.0-wmf.25	99.72	89.34	13.97	1085	972	152
parsoid_workarounds	99.72	89.25	14.06	1085	971	153
vd_and_css_tweaks	99.72	87.78	13.79	1085	955	150
rl_modules_hack_2	99.82	88.51	14.25	1086	963	155
1.36.0-wmf.22	99.72	88.33	13.97	1085	961	152
vd_tweaks	99.82	88.42	14.15	1086	962	154
1.36.0-wmf.21	99.72	88.33	13.97	1085	961	152
1.36.0-wmf.20	99.72	87.96	14.06	1085	957	153
rl_modules_hack	99.82	88.42	14.06	1086	962	153
1.36.0-wmf.18	99.36	85.85	14.80	1081	934	161
1.36.0-wmf.16	99.45	85.75	14.52	1082	933	158
1.36.0-wmf.14	99.54	85.57	14.52	1083	931	158
1.36.0-wmf.13	99.63	85.39	14.43	1084	929	157
cite_css_fixes	99.63	85.29	14.52	1084	928	158
body_postprocessing_fix	99.63	84.93	14.15	1084	924	154
1.36.0-wmf.10_and_CSS_fixes	99.63	85.11	14.15	1084	926	154
1.36.0-wmf.10	99.54	85.11	14.43	1083	926	157
1.36.0-wmf.9	99.54	84.83	14.15	1083	923	154
1.36.0-wmf.8	99.54	84.65	13.24	1083	921	144
1.36.0-wmf.6	99.54	83.92	13.51	1083	913	147
1.36.0-wmf.5	99.54	83.92	13.51	1083	913	147
1.36.0-wmf.4	99.54	83.09	13.05	1083	904	142
1.36.0-wmf.3	99.54	82.26	12.22	1083	895	133
vector-useskinversion-1	99.54	82.26	12.22	1083	895	133
1.36.0-wmf.2	99.54	82.26	12.32	1083	895	134
init_with_css_fixes	99.54	82.63	12.32	1083	899	134
no_refs	99.72	88.14	18.47	1085	959	201
no_img_or_gallery	99.82	83.46	12.59	1086	908	137
init	99.54	82.54	12.41	1083	898	135

Stats for zhwiki

Test Id	% completed	% vertical-shift-only-or-no-diffs	% no-diffs	# completed	# vertical-shift-only-or-no-diffs	# no-diffs
1.38.0-wmf.9	98.93	30.89	1.53	647	202	10
1.38.0-wmf.7	98.93	31.19	1.53	647	204	10
1.38.0-wmf.6	98.78	31.04	1.53	646	203	10
1.38.0-wmf.5	98.93	31.04	1.53	647	203	10
1.38.0-wmf.4	99.08	30.89	1.53	648	202	10
1.38.0-wmf.3	99.08	30.73	1.53	648	201	10
1.38.0-wmf.2	99.08	30.43	1.53	648	199	10
diffscoring-tweak	97.71	30.73	1.53	639	201	10
more-span-stripping	97.71	30.73	1.38	639	201	9
1.38.0-wmf.1	97.86	30.73	1.38	640	201	9
strip-entity-spans	97.40	30.89	1.38	637	202	9
1.37.0-wmf.23	96.48	29.97	1.38	631	196	9
puppeteer-bump	97.55	26.91	1.38	638	176	9
1.37.0-wmf.21	96.94	26.91	1.07	634	176	7
1.37.0-wmf.20	97.40	27.37	1.07	637	179	7
more_rl_and_css_fixes	96.48	27.52	1.07	631	180	7
rl_and_css_fixes	97.86	27.68	1.07	640	181	7
survey_and_other_css_tweaks	96.94	38.69	1.07	634	253	7
1.36.0-wmf.27	97.25	38.69	1.07	636	253	7
1.36.0-wmf.26	97.09	38.99	1.07	635	255	7
1.36.0-wmf.25	97.40	38.84	1.07	637	254	7
parsoid_workarounds	96.94	38.84	1.07	634	254	7
vd_and_css_tweaks	96.94	38.38	1.07	634	251	7
rl_modules_hack_2	97.09	38.07	1.07	635	249	7
1.36.0-wmf.22	96.48	30.28	1.07	631	198	7
vd_tweaks	96.48	30.43	1.07	631	199	7
1.36.0-wmf.21	96.18	29.05	1.07	629	190	7
1.36.0-wmf.20	96.79	26.45	1.07	633	173	7
rl_modules_hack	95.87	29.97	1.07	627	196	7
1.36.0-wmf.18	96.48	30.28	1.07	631	198	7
1.36.0-wmf.16	96.33	29.97	1.07	630	196	7
1.36.0-wmf.14	96.48	30.28	1.22	631	198	8
1.36.0-wmf.13	96.48	30.43	1.22	631	199	8
cite_css_fixes	96.64	30.58	1.22	632	200	8
body_postprocessing_fix	96.33	31.04	1.22	630	203	8
1.36.0-wmf.10_and_CSS_fixes	96.33	31.65	1.22	630	207	8
1.36.0-wmf.10	96.33	31.80	1.22	630	208	8
1.36.0-wmf.9	96.33	31.65	1.22	630	207	8
1.36.0-wmf.8	96.33	31.35	1.22	630	205	8
1.36.0-wmf.6	96.64	31.04	1.22	632	203	8
1.36.0-wmf.5	96.64	30.43	1.22	632	199	8
1.36.0-wmf.4	96.64	30.73	1.07	632	201	7
1.36.0-wmf.3	96.79	29.82	0.92	633	195	6
vector-useskinversion-1	96.64	29.82	0.92	632	195	6
1.36.0-wmf.2	96.64	29.82	0.92	632	195	6
init_with_css_fixes	96.64	29.36	0.92	632	192	6
no_refs	97.09	40.67	2.29	635	266	15
no_img_or_gallery	96.64	29.20	0.92	632	191	6
init	96.64	29.05	0.92	632	190	6