Wikimedia Quality and Test Engineering Team/Office Hours/2020
2020-12-21
edit- Attendees: Elena, Željko
2020-12-14
edit- Attendees: Jared, Pita, Elena, Željko
- Elena
- [Cloud VPS alert] spam
- Two blog posts
- Jared
- Pita
- https://phabricator.wikimedia.org/T269009 webdriverio tests for kaios app
- John
- Writing club
2020-12-07
edit- Attendees: Dom, Elena, Harriet, Željko
- Introductions
- Željko
- Learn Docker basics https://phabricator.wikimedia.org/T210412
- Evaluate Microsoft Playwright as replacement for our browser automation https://phabricator.wikimedia.org/T262682
- Outreachy 2020 - 2021 Proposal: Evaluate Microsoft Playwright as replacement for our browser automation https://phabricator.wikimedia.org/T266841
- The OAuth 2.0 Authorization Framework https://tools.ietf.org/html/rfc6749
2020-11-30
edit- Attendees: Željko, Vidhi, Pita, Dom, John
- Dom
- Can we run the selenium tests in another interface language?
- Pita
- Is Zeljko available to help me with a wdio experiment? https://phabricator.wikimedia.org/T269009
- Željko
- Outreachy starting tomorrow
2020-11-23
edit- Attendees: Željko, Elena, Vidhi, Soham, Dom
- Željko
- T210412 Learn Docker basics
- T264762 Write recommendation letter for GSoC students
- T263240 Mentor Outreachy Round 21 intern: Harriet!
- T267928 RFC: Provide mechanism for defining and utilizing configuration sets for local development and browser / API-testing tests
- ET
2020-11-16
edit- Željko
- Write recommendation letter for GSoC students https://phabricator.wikimedia.org/T264762
- selenium-daily-beta-Minerva fails with `waitUntil condition timed out after 10000ms` https://phabricator.wikimedia.org/T267931
- Elena
- Exempla Docent - testing ORES 'articletopic' model https://phabricator.wikimedia.org/phame/post/view/216
2020-11-09
edit- Jared
- T259341 Create a generic NPM package for recording videos of test runs - assigned
- T254495 Use eslint-config-wikimedia 0.17.x in all repositories with Selenium tests - unassigned
- T265656 Use eslint-config-wikimedia 0.17.x in wikibase/termbox - unassigned
2020-11-01
edit- Elena
2020-10-19
edit- Elena
- Jared
- Use eslint-config-wikimedia 0.17.x in wikibase/termbox https://phabricator.wikimedia.org/T265656
- Željko
- selenium-daily-beta-* Jenkins jobs failing https://phabricator.wikimedia.org/T265910
- Create the first test for api/rest_v1/page/mobile-html/Dog https://phabricator.wikimedia.org/T264340
- Mentor Outreachy Round 21 intern https://phabricator.wikimedia.org/T263240
- Outreachy Microtask: Check if '/tests/selenium/log' is included in .gitignore in all repositories with Selenium tests https://phabricator.wikimedia.org/T265463
- Delete sample or skipped Selenium tests https://phabricator.wikimedia.org/T256950
- Implement a sample test in Microsoft Playwright https://phabricator.wikimedia.org/T263612
- Run a sample test in Microsoft Playwright using a CI https://phabricator.wikimedia.org/T265883
- Create a generic NPM package for recording videos of test runs https://phabricator.wikimedia.org/T259341
- Update Selenium documentation to work with WebdriverIO v6 https://phabricator.wikimedia.org/T248221
- Soham
- [Discuss] Should we make use of `engineStrict` since higher versions of node fail `fibres npm package` and also node-gyp - https://stackoverflow.com/questions/29349684/how-can-i-specify-the-required-node-js-version-in-package-json https://phabricator.wikimedia.org/T258562
- https://gerrit.wikimedia.org/r/c/mediawiki/core/+/626048
- https://phabricator.wikimedia.org/T253113
- I'm not sure why we didn't merge this. The only thing I see missing is the task number in the commit message. Is there anything else?
- https://phabricator.wikimedia.org/T256626 Investigate WebdriverIO async mode
- Vidhi
- Upgrade WebdriverIO to the latest version for all repositories https://phabricator.wikimedia.org/T247844
2020-10-12
edit- Elena
- DONE Follow up on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/626458
- an action item: reach Sam for reviewing patches
- Željko
- Writing club https://phabricator.wikimedia.org/T263660
- create draft posts at QTE blog https://phabricator.wikimedia.org/phame/blog/view/21/
- Today is the feast of blessed Carlo Acutis, patron of computer programmers https://en.wikipedia.org/wiki/Carlo_Acutis
- Jared
- No response on email re: wikibase/termbox https://phabricator.wikimedia.org/T254495
- email https://lists.wikimedia.org/pipermail/wikitech-l/2020-September/093898.html
- recent patch https://gerrit.wikimedia.org/r/c/wikibase/termbox/+/622327
- Soham
- mediawiki/core or sandbox?
2020-10-05
edit- Elena
- integration tests https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/core/+/master/tests/
- train
- Do we have a list of easy tasks for testers. No.
- Dom
- Soham
- Setup mediawiki as a Github mirror
- Replicate CI tests for mediawiki core using Github actions/ TravisCI
- https://docs.github.com/en/free-pro-team@latest/actions
- https://docs.travis-ci.com/
- Željko
- Visual Studio Code + Neovim https://filipin.eu/vscode-neovim
- (with Elena, so far) Create a writing club https://phabricator.wikimedia.org/T263660
2020-09-28
edit- Željko
- (with Elena, so far) Create a writing club https://phabricator.wikimedia.org/T263660
- https://phabricator.wikimedia.org/p/Jdub252/
- vscode+neovim
- John
- Bug Reporting Best Practices blog post https://phabricator.wikimedia.org/T258075
- The first Selenium test for CentralNotice https://phabricator.wikimedia.org/T262684
- Dom
- QTE book club - The Quality and Testing Information Model https://phabricator.wikimedia.org/T247666
- Soham
- Implement a sample test in Microsoft Playwright https://phabricator.wikimedia.org/T263612
- Jared
- Use eslint-config-wikimedia 0.16.x in all repositories with Selenium tests
- wikidata/query/gui https://phabricator.wikimedia.org/T254495#6497062
- wikibase/termbox https://lists.wikimedia.org/pipermail/wikitech-l/2020-September/093898.html
- Use eslint-config-wikimedia 0.16.x in all repositories with Selenium tests
2020-09-21
edit- Željko (with Vidhi and Soham)
- Outreachy (Round 21)
- Why do both tasks start with QTE? :)
- T263221 QTE: Selenium Framework Cleanup https://phabricator.wikimedia.org/T263221
- T262682 QTE: Evaluate Microsoft Playwright as replacement for our browser automation https://phabricator.wikimedia.org/T262682
- I'll reach out to WMDE to unblock Vidhi https://lists.wikimedia.org/pipermail/wikitech-l/2020-September/093832.html
- let me know if you think somebody deserves a badge https://phabricator.wikimedia.org/badges/
- Giselle
- Template Wizard Refactoring
- Selenium: Template insertion dialog error test https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/626458
- Selenium: Template insertion death date field test https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/626479
- Template Wizard Refactoring
2020-09-14
edit- Soham
- Outreachy 2021
- Steps ( https://phabricator.wikimedia.org/T262306 )
- Main proposal ( https://phabricator.wikimedia.org/T262682 )
- sent mail to set up a meeting with Cypress folks again this Sunday
- Outreachy 2021
- Vidhi
- Upgrade WebdriverIO to v6 in wdio-wikibase (https://phabricator.wikimedia.org/T261218) blocked on https://github.com/wmde/wdio-wikibase/pull/25
- sent mail to wikitech-l https://lists.wikimedia.org/pipermail/wikitech-l/2020-September/093832.html
- Željko
- Selenium test caught expired certificate
- The certificate for en.wikipedia.beta.wmflabs.org expired on 2020-09-14 https://phabricator.wikimedia.org/T262816
- https://integration.wikimedia.org/ci/job/selenium-daily-beta-MediaWiki/
- The first Selenium test for CentralNotice
- Pita/Soham - Cypress
- Selenium test caught expired certificate
- Giselle
- Template Wizard Refactoring
- Selenium: Template insertion dialog error test https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/626458
- Selenium: Template insertion death date field test https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/626479
- Template Wizard Refactoring
2020-09-07
edit- Dom
- Browserstack tabbing behaviour on Mac is not consistent with physical Mac - makes accessibility testing invalid
- Željko set me up with Saucelabs (thanks!) to see if behaviour is same there
- Browserstack tabbing behaviour on Mac is not consistent with physical Mac - makes accessibility testing invalid
- Vidhi and Soham
2020-08-31
edit- Željko
- https://www.mediawiki.org/wiki/MediaWiki-Docker
- https://phabricator.wikimedia.org/T256239 Create MediaWiki-Docker documentation for all repositories with Selenium tests
- GSoC
- https://www.mediawiki.org/wiki/MediaWiki-Docker
2020-08-24
edit- Any word on this? https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/593868
- Asked Monte for review
- Dom
- Considering Selenium(?) checks for new Watchlist Expiry feature
- Could also test the API (there is a framework already in place)
2020-08-17
edit- No meeting
2020-08-10
edit2020-08-03
edit- No meeting
2020-07-27
edit- Elena
- https://www.browserstack.com/events/breakpoint
- will follow up after organizing my notes
- Jared
- Soham
- won a hackathon!
2020-07-20
edit- John
- https://www.mediawiki.org/wiki/Code_Health_Group/projects/DevEd/Workshops#Recurring/Scheduled_Workshops_2 <- refactoring workshop signup link, if anyone else would be interested in attending!
- Bug reporting best practices - https://docs.google.com/document/d/1JrdxBmyIWOyj6VU6RmHA3wjMY1ZVWOv3NfXNkTqrhHo/edit#heading=h.khhxlhs176ed
- Jared
- Wikibase patch for https://phabricator.wikimedia.org/T254495 -- .eslintrc.json test errors (will share screen)
2020-07-13
edit- Soham
- how to rebase patches without overwhelming CI ;) https://gerrit.wikimedia.org/r/c/mediawiki/extensions/EntitySchema/+/608555/9
- Elena
- questions about Vidhi and Soham blog posts
- Sam Tran Cypress evaluation report - https://github.com/simkawaii/GrowthExperiments_Cypress-WebdriverIO-Comparison; https://phabricator.wikimedia.org/T230729
- (follow up) contact Sam on publishing the report on pahb block
- Dom
- do we have a dashboard with test results for various repositories?
2020-07-06
edit- Željko
- https://phabricator.wikimedia.org/T255858 First evaluation for Soham
- https://phabricator.wikimedia.org/T255857 First evaluation for Vidhi
- https://phabricator.wikimedia.org/T257195 EntitySchema not running Selenium tests in CI
- Soham
- How does CI run Selenium tests for core, extensions and skins
2020-06-29
edit- John
- Is it possible to run the extension Central Notice in a Beta environment? - Yes!
- Let's set up a separate meeting.
- Giselle
- Elena
- Vue.js
2020-06-15
edit- Željko
- Elena and Željko can't meet at the usual time, move to Tuesday/Wednesday?
- Add Elena to selenium-daily-betacommons-MediaWiki e-mail notifications
- https://www.mediawiki.org/wiki/Selenium/How-to/Debug_with_Visual_Studio_Code
- Elena
- https://integration.wikimedia.org/ci/view/Selenium/job/selenium-daily-betacommons-MediaWiki/
- talked to JR about looking into options to look into group like user accounts on crossbrowser testing (or saucelabs)
2020-06-08
edit2020-06-01
edit- Elena
- a follow up - https://phabricator.wikimedia.org/T253049
- Giselle
2020-05-25
edit- Code Review best practices - https://google.github.io/eng-practices/review/reviewer/
- Željko
- GSoC Students: Vidhi, Soham
- Evaluate Appium https://phabricator.wikimedia.org/T251508
- I've wrote some sample tests for the wikipedia apps https://github.com/jpita/workshopValencia
- selenium-daily-betacommons-MediaWiki fails with `internal_api_error_LogicException: [...] Exception caught: Local entity source does not have items.` https://phabricator.wikimedia.org/T253049
- let/const/var https://gerrit.wikimedia.org/r/c/mediawiki/extensions/MobileFrontend/+/598263
- Test Strategy By RiskStorming With TestSphere https://phabricator.wikimedia.org/T252704
- Vidhi
- https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/598198
- Don't use "wikimedia/jquery" in selenium .eslintrc https://phabricator.wikimedia.org/T252878
2020-05-18
edit- Giselle
- https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/592508
- assertVisibleElementCount https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/extensions/TemplateWizard/+/master/tests/selenium/specs/TemplateWizard.js#13
- replace assert.equal with assert.strictEqual https://nodejs.org/api/assert.html#assert_assert_strictequal_actual_expected_message
- fix order of argument: actual, expected
- replace assertVisibleElementCount() with browser.$$(selector) https://webdriver.io/docs/api/browser/$$.html
- Update TemplateWizard form v4 to v6
- Željko
- Test Strategy By RiskStorming With TestSphere https://phabricator.wikimedia.org/T252704
- VS Code https://code.visualstudio.com/
2020-05-11
edit- Elena
- Let's talk about Hackathon
- Automation integration tests coverage metric?
- Željko
- GSoC
- TestSphere
2020-05-04
edit- Elena
- Željko
- https://www.mediawiki.org/wiki/Technical_contributor_onboarding/Resolve_merge_conflict
- GSOC students annonced later today
- Giselle
2020-04-27
edit- Giselle:
- A volunteer interested in security
- A11y testing on GrowthExperiments
- Review TemplateWizard Patch: https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/TemplateWizard/+/592508/
- Elena
- will send Giselle notes on security testing
2020-04-20
edit- Elena
- what to do with https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/GrowthExperiments/+/535896/ "This fails as expected! Looks like axe is working." https://phabricator.wikimedia.org/T232638
- Giselle: fix patch and add details for a11y GrowthExperiments .. since it's been a long time since I submitted it, when I wanted to updated it the automatic merge failed, how should I proceed?
- Template Wizard, add another page object 'define /create template page'
- Željko
- Mentor a Google Summer of Code 2020 student https://phabricator.wikimedia.org/T247833
- Software testing anti-patterns: Selenium https://phabricator.wikimedia.org/T246880
- Selenium workshop https://phabricator.wikimedia.org/T250000
2020-04-06
edit- Giselle
- https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/574515 - Confusion about Sam's comment, how to proceed?
- Elena
SOLVED ** the error: :~/Documents/gerrit/vagrant$ git pull fatal: unable to access 'https://gerrit.wikimedia.org/r/mediawiki/vagrant/': SSL peer handshake failed
- Željko
- Mentor a Google Summer of Code 2020 student https://phabricator.wikimedia.org/T247833
2020-03-30
edit- Željko
- Mentor a Google Summer of Code 2020 student https://phabricator.wikimedia.org/T247833
- review https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/578370
2020-03-23
edit- Željko
- Upgrade webdriverio to version 5 for GrowthExperiments https://phabricator.wikimedia.org/T244763
- Waiting for code review.
- Mentor a Google Summer of Code 2020 student https://phabricator.wikimedia.org/T247833
- A couple of internship projects.
- Upgrade WebdriverIO to the latest version for all repositories https://phabricator.wikimedia.org/T247844
- Looking for more mentors, at least one more.
- Evaluate WebdriverIO replacements for our browser automation framework https://phabricator.wikimedia.org/T247835
- Pita is the second mentor. Looking for more mentors.
- Selenium documentation is easy to use and up to date https://phabricator.wikimedia.org/T246425
- Selenium/How-to/Make the browser visible https://phabricator.wikimedia.org/T247003
- Upgrade webdriverio to version 5 for GrowthExperiments https://phabricator.wikimedia.org/T244763
- Pita
- Cypress tests targeting local mediawiki on CI https://phabricator.wikimedia.org/T248317
- Giselle
- Refactor TemplateWizard Selenium tests https://phabricator.wikimedia.org/T240766
- Do you need help with https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/574515
- Add accessibility check for Homepage https://phabricator.wikimedia.org/T232638
- Did you see https://en.wikipedia.org/wiki/User:Montehurd/accessibility
- Monte said he'll review https://gerrit.wikimedia.org/r/c/mediawiki/extensions/GrowthExperiments/+/535896
- Did you see https://gist.github.com/montehurd/bf9e73100cc28f546b4ec4ae15869e6c (from Monte)
- Refactor TemplateWizard Selenium tests https://phabricator.wikimedia.org/T240766
2020-03-16
edit- Željko
- Upgrade webdriverio to version 5 for GrowthExperiments https://phabricator.wikimedia.org/T244763 - Almost there. It was harder than expected. Works on my machine. Fails in CI. I was able to replicate the last failure locally using mediwiki-docker.
- We're waiting for Security team to reply to Giselle's introduction.
- This is still causing trouble: Main pages of several Beta Cluster wikis redirect to other production wikis https://phabricator.wikimedia.org/T247078
- Dom
- OWASP ZAP https://owasp.org/www-project-zap/
- Example of using an intercepting proxy (mitmproxy): https://phabricator.wikimedia.org/T232232#5583284 (not for security, though)
- Elena - examples of XSS atack testing -
- https://phabricator.wikimedia.org/T120324
- https://phabricator.wikimedia.org/T120291 wikitext in flow titles is parsed (HTML tags like
<tt>
and templates) on echo notifications - How to test a new API feature https://en.wikipedia.beta.wmflabs.org/wiki/Special:ApiSandbox#action=growthsetmentor&format=json&mentee=ET23&mentor=ET10&reason=test%201%20for%20changing%20mentors%20by%20sysop
- Giselle
- https://phabricator.wikimedia.org/T232638 Add accessibility check for Homepage
- Invited Giselle to QTE Office Hours (This month's session: Accessibility and Accessibility Testing - Session leader: Monte)
2020-03-09
edit- (maybe) Dom will have a short presentation about a security tool
- Željko will have an update on the state of the Selenium documentation https://www.mediawiki.org/wiki/Selenium
- the documentation page structure is revised - Get help, Getting Started, How to to, Explanation, and Reference (inspired by https://www.divio.com/blog/documentation/ )
- the new part - https://www.mediawiki.org/wiki/Selenium/Getting_Started/Run_tests_targeting_MediaWiki-Docker
- Tracking task https://phabricator.wikimedia.org/T246425
- https://phabricator.wikimedia.org/T247078 Main pages of several Beta Cluster wikis redirect to other production wikis
- Review Elena's unmerged patches (all in merge conflict) https://gerrit.wikimedia.org/r/q/owner:etonkovidova%2540wikimedia.org+is:open -- it's RSPEC patches-should be abandoned? - yes DONE
- Željko: progress report on https://phabricator.wikimedia.org/T244763
- Running test locally using mw-docker https://www.mediawiki.org/wiki/MediaWiki-Docker/GrowthExperiments
2020-03-02
edit- Željko updated Selenium documentation (roughly at 80%)
- Željko made some progress on, but not much :/ https://phabricator.wikimedia.org/T244763
- (from Kosta - it's interesting to try) https://www.mediawiki.org/wiki/Extension:GrowthExperiments#Quickstart_with_MediaWiki_Docker
- https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/TemplateWizard/+/574515/1/tests/selenium/pageobjects/templatewizard.page.js review
- Giselle will make 2 page objects, each one introduced as its own patch
- accessibility: (from Monte - some research on accessibility testing) https://en.wikipedia.org/wiki/User:Montehurd/accessibility
- security:
- Sonar cloud all projects https://sonarcloud.io/organizations/wmftest/projects
- core https://sonarcloud.io/project/issues?id=mediawiki-core&owaspTop10=a1&resolved=false&types=SECURITY_HOTSPOT
- TODO: Željko to put Giselle in contact with security team
- Elena's unmerged patches (all in merge conflict) https://gerrit.wikimedia.org/r/q/owner:etonkovidova%2540wikimedia.org+is:open
- TODO: review the next time
2020-02-24
editTopics to discuss (please add here whatever you want to bring up during a meeting)
- https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/TemplateWizard/+/566868/ page object patch -- reviewining/discussion of the tests structure and "Cannot merge" conflict on the patch - merge manually locally (creating a new branch) -- Giselle will take a look
- https://phabricator.wikimedia.org/T244763 status? -- Željko will take a look
What was reviewed: - up-to-date documentation on Selenium node.js framework - https://www.mediawiki.org/wiki/Selenium/Node.js and - https://gerrit.wikimedia.org/r/plugins/gitiles/mediawiki/core/+/master/tests/selenium/README.md
- https://phabricator.wikimedia.org/T232638 Add accessibility check for Homepage -- Monte will take a look
2020-02-17
editTopics to discuss (please add here whatever you want to bring up during a meeting)
What was reviewed - https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/TemplateWizard/+/565054/ (TemplateWizard test) was reviewed by Sam. Some follow up is needed on https://gerrit.wikimedia.org/r/c/mediawiki/extensions/TemplateWizard/+/565053/1 to address Sam's comment. - https://phabricator.wikimedia.org/T243123 - failing Login causes automation tests to fail. - good progress is don on https://phabricator.wikimedia.org/T244763 Upgrade webdriverio to version 5 for GrowthExperiments - upcoming events - Book club on Feb 25 - https://www.divio.com/blog/documentation/ - Zeljko talk on Quality and Test Engineering Office Hour (Feb 21/2020) https://phabricator.wikimedia.org/T241234