Parsoid/Deployments/T336101 followup

Description of issue

Parsoid included a TOC related change as part of 1.41.0-wmf.7 (Add synthetic TOC if necessary, T92999, T333023). This fix was to make Parsoid compatible with the core parser wrt handing of TOC as part of work to serve all page views via Parsoid. However, as explained in the phab task, we did not account for the fact that the train may be rolled back. We do have a documented process for handling train rollbacks when new Parsoid HTML changes are introduced (but we have never actually exercised it in the past), and unfortunately, we ended up exercising this scenario the one time we overlooked it.

In the time that the new Parsoid had been live on group2 wikis, RESTBase had been populated with Parsoid's new HTML version. But, after rollback, that new HTML was served to VisualEditor and DiscussionTools The net result is that after rollback, Parsoid got requests to convert HTML to wikitext that included the new synthetic TOC marker, but the rolled back Parsoid did not know how to ignore. As a result, many pages edited with VisualEditor or DiscussionTools got a stray __TOC__ (or its localized form) introduced as a dirty diff.

How do we fix this?

We wrote a script to process the recent changes stream for this timeframe (when group2 wikis were rolled back) and examined diffs to see if they had a stray __TOC__ (or its localized form) marker and have dumped that list below. There may be some minor gaps on some wikis, but we think we have captured over 95% of pages that were impacted.

Many thanks to User:Tacsipacsi for filing the bug and providing guidance and feedback in this process - that included useful code reviews on the script to make sure it worked as intended.

Please use this list to fix up the pages appropriately. Once you fix it, please strike out the entry (rather than deleting it maybe?) so that others know not to process it.

False positives

There are likely several false positive reports where talk pages are involved. This is because the page in question likely had discussions of __TOC__ (including possibly reports of the dirty diff), and so all subsequent edits to the page got included in this report below. This is especially the case for a lot of the zhwiki talk page links below.

 Done ar.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision Fixed
2. Diff (may not be latest rev); Edit Current Revision Fixed
3. Diff (may not be latest rev); Edit Current Revision Fixed
4. Diff (may not be latest rev); Edit Current Revision Fixed
5. Diff (may not be latest rev); Edit Current Revision Fixed
6. Diff (may not be latest rev); Edit Current Revision Fixed
7. Diff (may not be latest rev); Edit Current Revision Fixed
8. Diff (may not be latest rev); Edit Current Revision Fixed
9. Diff (may not be latest rev); Edit Current Revision Fixed

 Done az.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision

 Done bg.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision Fixed
2. Diff (may not be latest rev); Edit Current Revision Fixed

 Done bn.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision Fixed
2. Diff (may not be latest rev); Edit Current Revision Fixed

 Done cs.wikipedia.org

Extended content

Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision

 Done dag.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision Fixed

 Done de.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision
2. Diff (may not be latest rev); Edit Current Revision
3. Diff (may not be latest rev); Edit Current Revision
4. Diff (may not be latest rev); Edit Current Revision
5. Diff (may not be latest rev); Edit Current Revision
6. Diff (may not be latest rev); Edit Current Revision
7. Diff (may not be latest rev); Edit Current Revision
8. Diff (may not be latest rev); Edit Current Revision
9. Diff (may not be latest rev); Edit Current Revision
10. Diff (may not be latest rev); Edit Current Revision
11. Diff (may not be latest rev); Edit Current Revision
12. Diff (may not be latest rev); Edit Current Revision
13. Diff (may not be latest rev); Edit Current Revision
14. Diff (may not be latest rev); Edit Current Revision
15. Diff (may not be latest rev); Edit Current Revision
16. Diff (may not be latest rev); Edit Current Revision
17. Diff (may not be latest rev); Edit Current Revision
18. Diff (may not be latest rev); Edit Current Revision
19. Diff (may not be latest rev); Edit Current Revision
20. Diff (may not be latest rev); Edit Current Revision
21. Diff (may not be latest rev); Edit Current Revision
22. Diff (may not be latest rev); Edit Current Revision
23. Diff (may not be latest rev); Edit Current Revision
24. Diff (may not be latest rev); Edit Current Revision
25. Diff (may not be latest rev); Edit Current Revision
26. Diff (may not be latest rev); Edit Current Revision
27. Diff (may not be latest rev); Edit Current Revision
28. Diff (may not be latest rev); Edit Current Revision
29. Diff (may not be latest rev); Edit Current Revision
30. Diff (may not be latest rev); Edit Current Revision
31. Diff (may not be latest rev); Edit Current Revision
32. Diff (may not be latest rev); Edit Current Revision
33. Diff (may not be latest rev); Edit Current Revision
34. Diff (may not be latest rev); Edit Current Revision
35. Diff (may not be latest rev); Edit Current Revision
36. Diff (may not be latest rev); Edit Current Revision
37. Diff (may not be latest rev); Edit Current Revision
38. Diff (may not be latest rev); Edit Current Revision
39. Diff (may not be latest rev); Edit Current Revision
40. Diff (may not be latest rev); Edit Current Revision
41. Diff (may not be latest rev); Edit Current Revision
42. Diff (may not be latest rev); Edit Current Revision
43. Diff (may not be latest rev); Edit Current Revision
44. Diff (may not be latest rev); Edit Current Revision
45. Diff (may not be latest rev); Edit Current Revision
46. Diff (may not be latest rev); Edit Current Revision
47. Diff (may not be latest rev); Edit Current Revision
48. Diff (may not be latest rev); Edit Current Revision
49. Diff (may not be latest rev); Edit Current Revision
50. Diff (may not be latest rev); Edit Current Revision
51. Diff (may not be latest rev); Edit Current Revision
52. Diff (may not be latest rev); Edit Current Revision
53. Diff (may not be latest rev); Edit Current Revision
54. Diff (may not be latest rev); Edit Current Revision
55. Diff (may not be latest rev); Edit Current Revision
56. Diff (may not be latest rev); Edit Current Revision
57. Diff (may not be latest rev); Edit Current Revision
58. Diff (may not be latest rev); Edit Current Revision
59. Diff (may not be latest rev); Edit Current Revision
60. Diff (may not be latest rev); Edit Current Revision
61. Diff (may not be latest rev); Edit Current Revision
62. Diff (may not be latest rev); Edit Current Revision
63. Diff (may not be latest rev); Edit Current Revision
64. Diff (may not be latest rev); Edit Current Revision
65. Diff (may not be latest rev); Edit Current Revision
66. Diff (may not be latest rev); Edit Current Revision
67. Diff (may not be latest rev); Edit Current Revision
68. Diff (may not be latest rev); Edit Current Revision
69. Diff (may not be latest rev); Edit Current Revision

 Done el.wikipedia.org

1. Diff (may not be latest rev); Edit Current Revision
2. Diff (may not be latest rev); Edit Current Revision
3. Diff (may not be latest rev); Edit Current Revision
4. Diff (may not be latest rev); Edit Current Revision
5. Diff (may not be latest rev); Edit Current Revision
6. Diff (may not be latest rev); Edit Current Revision
7. Diff (may not be latest rev); Edit Current Revision

 Done en.wikipedia.org

Extended content

Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev); Edit Current Revision Diff (may not be latest rev);