User:Legoktm/parsoid re-parse

• Copy https://git.legoktm.com/legoktm/parsoid-reparse/raw/master/parsoid-reparse/__init__.py to somewhere on terbium, let's say ~/parsoid_reparse.py (This version is old and needs additional patches to be merged)
• Copy ~ssastry/linter-reparse.py on terbium.eqiad.wmnet to somewhere else, say ~/parsoid_reparse.py
• python3 parsoid_reparse.py http://parsoid.discovery.wmnet:8000 --sitematrix --linter-only --skip-closed https://aa.wikipedia.org/w/api.php --start https://ce.wikipedia.org/w/api.php
  • Probably in a screen or via nohup
• If it dies you can use --resume Last_Page_Name in addition with --start.

Additional useful arguments:

• --numthreads N to control number of threads (default is 2)
• --timeout N to set request timeout to N seconds (default is 60)
• --numretries N to set number of request retries to N (default is 3)