Parsoid/Deployments

Planned deployments, linked from wikitech:Deployments. For a list of past deployments, look for 'parsoid' in wikitech:Server Admin Log.

For the current train deploy schedule, see MediaWiki 1.39/Roadmap#Schedule for the deployments.

See wikitech:Parsoid#Deploying changes to learn how to deploy a new version of Parsoid.

May 17-19: v0.16.0-a8 as part of 1.39.0-wmf.12

• Remove guard against missing figcaption
• Set a title attribute for files linking to pages
• Revert "Lint captions on inline media without an explicit alt options", T297443
• Hoisting references outside of links, T301293
• Resolve linter test port-fixme, T237463
• Use isset to eliminate warnings
• Cleanup variable naming and documentation for clarity
• Cleanup confusing halign setting
• Don't escape extension tags shadowing html5 tags if found in source, T300436
• Lint html stashed in data-mw of mw:Extension/references, T214994
• Only lint content defined by a specific ref, T301293, T214994
• Prioritize body->html over body->id when diffing refs
• Fix using sort order from data-mw when serializing template params, T304730
• Move escapeNowikiTags to WTSUtils
• Escape dom elements with extension tag names when serializing, T300436

April 26-28:  V0.16.0-a7 as part of 1.39.0-wmf.9

• Use DOMRangeBuilder "top level range" algorithm for nested ranges, T306186

Not deployed separately: v0.16.0-a6

• Lint defined width for framed or manualthumb formats
• Add lint test for multiple media formats defined, T305641
• Drop sizing when serializing frame or manualthumb, T64938
• Manualthumb does not do automatic scaling, T305759, T64938
• Manualthumb is a format, like the others, T305641, T305759
• Stop using ParsoidServices
• Add check for bad files, T75581
• Apply manualthumb consistently across media types, T302114
• Don't rely on the link element to roundtrip the |page= option, T259931

April 12-14:  V0.16.0-a5 as part of 1.39.0-wmf.7

• ParserTests: Don't normalize style attributes
• ParserTests: Bunch of minor tweaks / refactoring
• Test.php: Remove Env references + make a function public
• Run `npm audit fix`
• ParserTests: Add a normalizeWT helper to Test.php
• Followup to 11cde591: Update rt-testing node.js scripts as well
• Remove ServiceWiring and Config from Parsoid extension
• Don't strip mw:IndentPre meta tags till the very end, T305597
• Making Translate extended ranges uneditable - fixing bugs, T305066
• Revert "Adjust whiteline handling around table for extended annotation ranges"
• ParserTests: Extract HTML normalization to the Test.php class
• Lint invalid upright options, T216003
• Drop ip-utils 3.x compatibility, core is on 4.0.0 now
• Making Translate extended ranges uneditable, T305066
• Adjust whiteline handling around table for extended annotation ranges

April 9: v0.15.0-a27 on REL1_38 branch

Cherry-picked changes since v0.15.0-a26:

• Making Translate extended ranges uneditable - fixing bugs, T305066
• Making Translate extended ranges uneditable, T305066
• Followup to 29a92a69: Fix missing unwrap invocation in PWrap
• PWrap: Improve p-wrapping behavior to minimize DOM range expansion
• PWrap: Improve readability by renaming and documenting a helper
• Make the `null` value clearer in PWrap
• Revert "Add temporary ParsoidSiteConfigInit hook", T303029

April 5-7:  V0.16.0-a4 as part of 1.39.0-wmf.6

• Add a class for unwrapping of optional nodes in dom pwrapper
• Additional simplification of PreHandler
• Fix off-by-1 DSR error by cleaning up and simplifying PreHandler, T277415
• Followup to 29a92a69: Fix missing unwrap invocation in PWrap
• PWrap: Improve p-wrapping behavior to minimize DOM range expansion
• Add base constructors for abstract Config types
• PWrap: Improve readability by renaming and documenting a helper
• Make the `null` value clearer in PWrap
• Log extra info if we're unable to get link source when bailing, T302092
• Use in_array instead of array_search, where possible
• Followup of bb14815b: Refine TemplateHandler::convertToString

March 30:  V0.15.0-a26 on REL1_38 branch

Cherry-picked changes since v0.15.0-a25:

• Add a class on the span representing the broken media element, T304010, T270150
• Fix complaint that test did not perform any assertions
• Document known failures testing functionality
• Drawings are derived and therefore always need the thumbnail treatment
• Add html/parsoid sections for svg rendering by page language tests, T208620
• Add baseconfig for ruwiki and refresh existing baseconfigs
• Support rendering SVG based on page language, T208620
• Use the check from RevisionRecord::getContent, T273111

Mar 29-31:  V0.16.0-a3 as part of 1.39.0-wmf.5

• Improve performance of getAutoUrlTerminatingChars
• Add badFile to standalone response, T75581
• Sync mediaParserTests with core
• Document timing metrics we collect

Mar 22-23:  V0.16.0-a2 as part of 1.39.0-wmf.4

• Collect html2wt metrics on non-selser path as well
• Sync parser tests files with core, T295187
• Add a class on the span representing the broken media element, T304010, T270150

Mar 22:  V0.16.0-a1 as part of 1.39.0-wmf.3

• Fix complaint that test did not perform any assertions
• Document known failures testing functionality
• Drawings are derived and therefore always need the thumbnail treatment
• Add html/parsoid sections for svg rendering by page language tests, T208620
• Add baseconfig for ruwiki and refresh existing baseconfigs
• Support rendering SVG based on page language, T208620
• Use the check from RevisionRecord::getContent, T273111

Also, the following patches, which were tagged in v0.15.0-a25 but not released:

• Create abstract marker interface for the PageConfigFactory type
• [take 2] Expose ParserOutput/ContentMetadataCollector via ParsoidExtensionAPI

Unreleased: v0.15.0-a25

This release was tagged in order to allow CI to test patches which moved portions of Parsoid to core.

• Create abstract marker interface for the PageConfigFactory type
• [take 2] Expose ParserOutput/ContentMetadataCollector via ParsoidExtensionAPI

Mar 15-17:  V0.15.0-a24 as part of 1.38.0-wmf.26

• Allow wikimedia/object-factory ^4.0.0
• Env isn't needed to dump diff marks
• Fix dumping diff marks
• Remove seemingly unnecessary template target resolution
• Add a class for the return value of the template expand call
• Construct TemplateEncapsulator earlier and pass it around
• Split template expansion / preprocessing from encapsulation

Mar 8-10:  V0.15.0-a23 as part of 1.38.0-wmf.25

• Rename frame method s/fetchArg/expandArg/
• PreHandler: s/MULTILINE_PRE/SOL_AFTER_PRE to better reflect state
• Run ParserBeforePreprocess hook in DataAccess::preprocessWikitext
• Fix Grammar to not assume that a Token is returned, T303057
• Do not break heading detection on annotations, T296412
• html2wt: Use info level for unactionable Cite logspam caused by CX usage
• DOMDiff: Don't attempt to mark DOM Fragments, T302885
• Remove obsolete comment from parserTests SiteConfig
• Make processExtensionModule consistent for ease of reading
• Fix unsetting native extension tags in parserTests
• AttributeExpander: tokensToString invalidates srcOffsets
• AttributeExpander: Update token attributes/tsr correctly after processing, T299374
• Add mw-file-description class on links to the file description page, T292657
• Followup to df3124f9: Fix bad refactoring
• PreHandler: s/popLastNL/pushLastNL
• PreHandler: Get rid of recursion in onAny handler
• Clean up TemplateHandler::resolveTemplateTarget

Mar 1-3:  V0.15.0-a22 as part of 1.38.0-wmf.24

• Account for strtok boolean return type, T302093
• Change Config/* classes to be abstract classes instead of interfaces, T261161
• Move bulk of template arg expansion to the Frame class
• Add logging of nested annotation tag removals
• Add description links consistently
• Don't repeat request for width if file is missing
• Only define our services if they haven't already been moved to core, T302118
• Move sanitization to when we're actually setting an external link

Feb 22-24:  V0.15.0-a21 as part of 1.38.0-wmf.23

• ContentMetadataCollector: Use PHP constants to store merge strategy strings
• Tweak signature of ContentMetadataCollector::addCategory()
• Revert part of 55da3090: Setting up template args exposes other bugs, T301948, T302007, T301986
• Benchmark read view content stripping, T272331
• Cleanup unnecessary data-parsoid="{}" in parser tests.
• Minor cleanup in TableFixups & WrapSectionsState for future DRYing
• Followup to 50461b53: Fixup code updating transclusion parts, T301524
• Tweak parameters for API requests to add more metadata
• Don't add synthetic magic words to the output
• Move ::appendToHead() into DOMUtils
• Move substTopLevelTemplates logic to Core/

Feb 15-17:  V0.15.0-a20 as part of 1.38.0-wmf.22

• Minor improvements to the ContentMetadataCollector interface
• Move ContentModelHandler back to Core/
• Consolidate some files under src/Wikitext/
• Get rid of the ExtensionContentModelHandler
• Move ContentModelHandler stuff from Core/ to Config/
• SiteConfig handler caching: Use an instance variable vs a static
• Cache extension tag handlers
• Fix old wikitext escaping bug, T277592
• Add preprocessWikitext to ParsoidExtensionAPI
• Introduce Parsoid\Core\Wikitext to hold wikitext concepts / operations
• Don't add synthetic categories from template expansion either
• Ensure frame args are properly set up in the pipeline
• Get rid of unused noDataAccess() mode
• Reorganize code in TemplateHandler::onTemplate for clarity
• Don't add synthetic categories to output HTML
• Get rid of optionalNewlines production from the grammar added in 6f4cd078
• build: Updating dependencies
• Moving Translate annotation declaration to the Translate repository, T295170

Feb 8-10:  V0.15.0-a19 as part of 1.38.0-wmf.21

• Update Parsoid's CoreMetadataCollector to reflect patches made to core
• If we aren't expanding templates don't bother with the template name
• Move convertToString outside of call to encapTokens
• Simplify TemplateHandler::convertAttribsToString
• Assert that we aren't expanding an already expanded token, T300393
• Minor tweak to function name in ParsoidExtensionAPI
• TemplateHandler: Simplify resolveTemplateTarget
• Augment the CompoundTemplateInfo to indicate if it came from a param
• Get rid of retry signal from TokenHandlerResult
• Don't retry AttributeExpansion on templated attribute tokens, T300393
• Minor tweaks to lookupArg
• Set pipeline opts for attribute expander used in TemplateHandler
• Improve output of regression-testing.php script
• Simplify bailTokens

Feb 1-3:  V0.15.0-a18 as part of 1.38.0-wmf.20

• Add temporary ParsoidSiteConfigInit hook
• Allow wikimedia/ip-utils ^4.0.0
• Support lang= option for SVGs, T208620
• Better handling of templated annotation attributes, T299375
• Initialize 'inTemplate' pipeline option always and fix usages, T226437
• ParserPipelineFactory: Remove duplicate call to defaultOptions

Jan 25-27:  V0.15.0-a17 as part of 1.38.0-wmf.19

• WikiLinkHandler: Reprocess incorrect tokens to the right stage, T299185, T299454, T299457
• Use MediaWiki's object factory when instantiating extensions
• Shuttle tokens to the end of the stage

Jan 20:  V0.15.0-a16 to beta

Parsoid v0.15.0-16 was tagged in order to push out CI changes for phab:T240775/gerrit:753824 It should be replaced with a thoroughly tested release build before the next train deploy.

• Simplify DOM class aliases., T240775

Jan 18-20:  V0.15.0-a15 as part of 1.38.0-wmf.18

• Clarify a comment around special case for {{!}}, T299311
• Revert "Remove special case for {{!}} magic word", T299311
• Stop emitting "inline-media-caption" lints, T297443, T299302
• Fix parsing of interlanguage links with spaces, T156308
• WikitextSerializer: Fix production crasher, T299196
• Don't log wt2html metrics for linter requests + other tweaks
• Merge the first two token transform stages

Jan 11-14:  V0.15.0-a14 as part of 1.38.0-wmf.17

Big wt2html changes

• Detect auto-insertion and tag deletion in RemexPipeline, T221145
• Followup to 819630e5: Match handling of mixed-syntax tags
• Followup to 819630e5: Make endTSR behave like tsr on mw:EndTag metas
• Followup to 819630e5: Handle autoInsertedFlags on tokens
• Partially mimic impact of mw:TSRMarker metas on MigrateTrailingNLs

Other notable changes

• Remove special case for {{!}} magic word
• TSP: Process retokenized tokens through TTM stages 1 & 2, T297922
• SiteConfig: Address old FIXME related to computing function synonyms
• TableFixups: Minor perf tweaks and cleanup, T298665
• TableFixups: Log error on reparse failure, don't crash
• Logging: Add pages with wt2html timePerKB > 500 ms to slow-parsoid log
• Add metrics to track time spent linting
• Add strict_type declaration to a number of files missing them
• Resolve a few more stale PORT-FIXMEs + update method docs
• Followup to 78e60013: Eliminate spurious semantic diff reports
• Replace usages of deprecated wfWikiID(), T298059
• Use ParserOptions::newFromAnon instead of ParserOptions::newCanonical
• Remove scrubWikitext as an option, T297298
• Lint captions on inline media without an explicit alt options, T297443

Deployments from previous years

• Parsoid/Deployments/2013
• Parsoid/Deployments/2014
• Parsoid/Deployments/2015
• Parsoid/Deployments/2016
• Parsoid/Deployments/2017
• Parsoid/Deployments/2018
• Parsoid/Deployments/2019
• Parsoid/Deployments/2020
• Parsoid/Deployments/2021