Wikimedia Quality and Test Engineering Team/Office Hours/2022
2022-11-07
editAttendees: Dom, Elena
Topics:
- Good test data for testing diffs?
2022-10-31
editAttendees: Zeljko, Dom, Stef, Elena, George, Vaughn
Testing Computer Software by Kaner et al meeting
2022-10-24
editAttendees: Elena, Vaughn - (Vaughn time-zone testing ( an insightful dissertation - https://phabricator.wikimedia.org/T316688#8336443 ) - (Elena) wikifunctions testing for (Abstract Wikipedia) - https://wikifunctions.beta.wmflabs.org/wiki/Special:CreateZObject?view=zobject-editor
2022-10-17
editAttendees: Elena, Dom, George, Zeljko, Vaughn
2022-10-10
editAttendees: Jackeline, Zeljko, Dom, Peter, Vaughn
- https://phabricator.wikimedia.org/T318599 Developers/Maintainers graph automation
2022-10-03
editAttendees: Dom, George, Zeljko, Peter, Vaughn
2022-09-26
editAttendees: Zeljko, Dom, Elena Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842
2022-09-19
editAttendees: George, Zeljko, Vaughn
2022-09-12
editAttendees: Elena, George, Zeljko, Vaughn
2022-09-05
editAttendees: Dom, Zeljko, Vaughn Topics:
* New watercooler? * Thursday at around 1400UTC * Selenium on test2wiki * Need to get a test user setup (Dom will try to sort that out) * Discuss with k8s team about running when they deploy * Support for George while Dom is away * It would be useful to get his local docker environment working (he is on Windows) * Book Club * Discussed new times to hold the meeting
2022-08-29
editAttendees: Elena, George, Vaughn, Željko Topics: - Book Club (Monthly on the last Monday) - We are reading Testing Computer Software (Cem Kaner, Jack Falk, Hung Q. Nguyen) - https://phabricator.wikimedia.org/T311842
2022-08-22
editAttendees: Dom, Elena, Zeljko, George Topics:
- Getting Selenium and API tests running on test2wiki (for the test2wiki k8s migration project)
- VisualEditor watchlist accessibility - use-case for accessibility playbook (the accessibility playbook link is here, in case people did not see it: https://docs.google.com/document/d/1QUw-ClLIDxzY3ShDHMGuewn7NR4Z3a4pP2XlUhitr0g/edit)
2022-08-15
editAttendees: Elena, Dom - (ET) QA Abstract Wikipedia Testing Playbook https://docs.google.com/document/d/1mtOoJ0pyYxnDAUiLzkEGfoMguLAmFXa3Z0VW2UK0DS4/edit#heading=h.ldf8bwrxezwh - Prototype for testing thumbor: https://gitlab.wikimedia.org/dwalden/thumbor-testing/-/blob/main/comparison_prototype.sh
2022-08-08
editAttendees: Dom, Elena, Vaughn
2022-08-01
editAttendees: Dom, Elena
2022-07-25
editAttendees: Dom
2022-07-18
editAttendees: Elena, Dom, Vaughn
- ET: mediawiki update on docker
- Do the "git pull", etc. to update the repositories
- docker-compose up -d && docker-compose exec mediawiki composer update && docker-compose exec mediawiki php maintenance/update.php --quick
2022-06-27
editAttendees: Dom, Elena, Zeljko, Vaughn, Derrick
- Presentation on OWASP ZAP (if people still want this)
- https://survey.stackoverflow.co/2022
2022-06-13
editAttendees: Dom, Željko
- How do I run logstash locally?
2022-06-06
editAttendees: Elena, Dom, Zeljko, Vaughn, Peter, Derrick
- BackstopJS Report
- https://pixel.wmcloud.org/desktop/index.html
- https://github.com/nicholasray/pixel
- [betalabs] Non-responsive sticky header appears on Special and Talk pages https://phabricator.wikimedia.org/T309370
- [GOAL] Leverage Automated Visual Regression Testing https://phabricator.wikimedia.org/T302246
- How to setup a wiki farm with CentralAuth locally
2022-05-23
editAttendees: Dom, Elena, Zeljko, Vaughn, Peter
- Draft: Crowd-sourced list of proposed engineering priorities in Wikimedia Foundation engineering https://docs.google.com/document/d/1XY291UC-PJbUWHUEG_lVKM3-lIaT_x2U1bwE4Mr8-s0/edit#
- https://versions.toolforge.org/
- Beta Cluster’s Future https://docs.google.com/document/d/10JwPxx-6AUgLZ46LTCZvLOl4faPAtxrnEI5ZxnsVQ14/edit?usp=sharing
- ET: QA handoff? - thx, Vaughn!
- Please complete your respective team's readiness review for k8s migration https://www.mediawiki.org/wiki/User:DWalden_(WMF)/Test2wiki_k8s_migration#Team_testing_readiness (you should have a slack message from me, if not, you can ignore this)
- Professional development https://office.wikimedia.org/wiki/Staff_handbook/Benefits#Growth
2022-05-16
edit- https://phabricator.wikimedia.org/T302246 - QTE involvment?
2022-05-09
editAttendees: Zeljko, Dom, Elena, Vaughn, Peter Topics:
- Intro to Mediawiki Testing for Ghana Technical Community
- only automation testing?
- do we have some ready to do QA tasks to give Ghana Technical Community to work on?
- Selenium Tests for VisualEditor https://phabricator.wikimedia.org/T296187
- https://www.mediawiki.org/wiki/Technical_contributor_onboarding
- Introductions (new people)
- Meetings (advice to new people)
2022-05-02
editAttendees: Jackeline, Elena, Vaughn, Ezekiel, Željko Topics:
- Accessibility
2022-04-11
editAttendees: Dom, Elena, Zeljko, Vaughn, Derrick, Esther, Jackeline
Topics:
- QTE pairing https://phabricator.wikimedia.org/T300290
- Explore It! https://phabricator.wikimedia.org/T301379
- local development environment
- shared testing environment
2022-04-04
editAttendees: Elena, Dom, Željko
Topics:
- Data³ https://www.mediawiki.org/wiki/Data%C2%B3
- a good overview of Selenium tests by extension: https://integration.wikimedia.org/ci/job/wmf-quibble-selenium-php72-docker/143365/console with the performance checks.
- I experimented with a "low-tech test dashboard" (from Lessons Learned) for IPInfo testwiki deployment testing https://www.mediawiki.org/wiki/User:DWalden_(WMF)/IPInfo/Testwiki_Deployment_Testing_Matrix
- Book club https://phabricator.wikimedia.org/T247665
- Selecting the next book https://app.slack.com/client/T024KLHS4/C01935QKL3S/thread/C01935QKL3S-1648564519.851039
- Should we open it for the entire wmf?
- Office hours
- Should we open it for the entire wmf?
- Any feedback on QTE pairing? https://phabricator.wikimedia.org/T300290
2022-03-28
editAttendees: Željko, Dom, Ezekiel, Derrick, Jackeline
Topics:
- Vagrant: this has been "replaced" by MediaWiki Docker so if there is a problem with following the Get Started guide (https://www.mediawiki.org/wiki/MediaWiki-Vagrant), skip it.
- Ezekiel has come across a few pages on Media Wiki with links to other pages and was wondering why they do not open up in a new browser tab by default.
- Explore It https://phabricator.wikimedia.org/T301379
- QTE reading club https://phabricator.wikimedia.org/T247665
- QTE pairing https://phabricator.wikimedia.org/T300290
- Investigate why Selenium tests are being skipped and get delete page tests running on Beta https://phabricator.wikimedia.org/T303737
- Switch to spec reporter https://phabricator.wikimedia.org/T280331
2022-03-21
editAttendees: Elena, Dom, Esther, Zeljko, Emeka
Topics: ET: SonarClouds provides coverage for unit testing? - https://doc.wikimedia.org/cover/ - https://sonarcloud.io/organizations/wmftest/projects ET: Test documentation? https://www.mediawiki.org/wiki/User:Etonkovidova/GrowthExperiments
2022-03-14
editAttendees: Elena, Dom, Zeljko
Topics: Elena:
- https://github.com/wikimedia/operations-mediawiki-config/blob/master/wmf-config/InitialiseSettings.php - the automation tests were (are) run on test2wiki? 'qa_automation' => [ // For browser tests, T60375 and T63799
2022-03-07
editAttendees: Dom, Elena
Topics: Dom:
- Should we increase Selenium testing coverage?
- e.g. testing deleting pages, looking at revision history
- catch bugs like https://phabricator.wikimedia.org/T303033, https://phabricator.wikimedia.org/T302887
- Or, would it be better via API tests?
- Do we have tools for reliability testing?
- E.g. to simulate multiple users performing the same action at the same time (to catch race-conditions, etc.)
- I wrote my own using python multiprocessing module (https://docs.python.org/3/library/multiprocessing.html ), but not sure if such a thing already exists - https://gitlab.wikimedia.org/dwalden/misc/-/blob/main/delete_page_concurrent.py
- Beta has been unreliable the last few days - https://phabricator.wikimedia.org/T302699
2022-02-28
editAttendees: Dom, Elena, Željko
- Elena: https://phabricator.wikimedia.org/T302489 - the discussion/evaluation of Cypress testing framework for Lang team
2022-02-21
editAttendies: Elena, Željko, Dom
- Dom
- adding this meeting (office hours) to the staff calendar: https://office.wikimedia.org/wiki/ITS/Calendars
- Željko
- T301379 Explore It! -- Reduce Risk and Increase Confidence with Exploratory Testing
- T300290 QTE pairing
- T301697 Investigate synthetic testing
- T280652 Delete tests disabled for more than 1 year
- Elena
- Best Practices Playbook
2022-02-14
editAttendies: Elena, Dom, Ima, Željko
- ET: can we take a look at https://phabricator.wikimedia.org/T301463 ?
- ET: I was really impressed with Chapter 5: Automating Testing (Lessons learned). Especially Lesson 113: "Capture replay fails" - I did not know that the ability to compare the screenshots taken at the certain checkpoints (without programmin) existed 20 years ago.
- QTE pairing https://phabricator.wikimedia.org/T300290
2022-02-07
editAttendees: Elena, Dom, Zeljko
- QTE pairing https://phabricator.wikimedia.org/T300290
- QTE reading club https://phabricator.wikimedia.org/T247665
2022-01-31
editAttendees: Dom, Zeljko, Osama
- Book club today! Lessons Learned in Software Testing https://phabricator.wikimedia.org/T293880
2022-01-24
editAttendees: Elena, Dom, Zeljko, Osama
Dom:
- Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
- Any mistakes you have made and learned from, or anything you just think is good advice
2022-01-17
editAttendees: Dom, Zeljko, Osama
Dom:
- Please add your lessons learned to https://www.mediawiki.org/wiki/Wikimedia_Quality_and_Test_Engineering_Team/Lessons_learned_testing_MediaWiki_and_associated_software
- Any mistakes you have made and learned from, or anything you just think is good advice
Osama
2022-01-10
editAttendees: Dom, Esther, Zeljko, Osama, Soham
- Selenium Tests failing for CLI on Mac https://phabricator.wikimedia.org/T298882
- Outreachy feedback for Osama Tahir https://phabricator.wikimedia.org/T297488
- Refactor MediaWiki Core WebdriverIO tests from sync to async mode https://phabricator.wikimedia.org/T293071