Wikimedia Technology/Annual Plans/FY2019/CDP2: Platform Evolution/CDP Budget Segment 7/Goals
Program Goals and Status for FY18/19
edit- Goal Owner: Corey Floyd
- Program Goals for FY18/19: Empower the Wikimedia Foundation to accomplish its goals of Knowledge Equity and Knowledge as a Service by evolving and investing in our technology stack to improve its flexibility, maintainability, and sustainability
- Annual Plan: Segment 7 - Core Platform
- Primary Goal is Knowledge as a Service/Foundational Strength: Evolve our systems and structures
Note: Segment 8 has been folded into Segment 7 (this page) as of the beginning of Q3 FY18/19
Outcome 2 / Output 2.2
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs
- Modularized RESTBase
Primary team: Services
Goal(s)
edit- Research, document and develop a specification for the storage API. Postponed
- Propose an RFC. To do
Status
editNote: July 2018
- In progress
Note: August 16, 2018
- In progress Spec for the storage API is still in progress.
Note: September 19, 2018
- Postponed This goal has been moved to Q2 work due to other issues having priority.
Outcome 2 / Output 2.3
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs.
- Session Management system
Dependencies on: Core Platform Team
Goal(s)
edit- Define and implement a session management service.
Status
editNote: November 20, 2018
- In progress
Note: December 14, 2018
- The RFC was approved last week and this portion is now Done
Outcome 1 / Output 1.2
editEngineers have a clear understanding of our technology stack and the plan to better scale, maintain and test it
Goal(s)
editDevelop 3-5 year road map.
This roadmap will include major platform goals such as initiatives around APIs, Storage, Parsing and other enabling technology improvements. It will also include short term refactoring work to enable some of those larger changes. The work outlined will be primarily based on the information gathered by the PE team before TechConf and the work done by attendees during TechConf.
Status
editNote: January 17, 2019
- We're working on creating the documentation portal and getting things setup — defining outcomes and breaking them down into outputs.
Note: February 25, 2019
- we are breaking down projects and working on dependency tracking In progress
Note: March 19, 2019
- This is still In progress and in a draft state right now.
Outcome 2 / Output 2.3
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs.
- Session Management system
Dependencies on: Core Platform Team
Goal(s)
editProduction-ize and deploy session management service to unblock multi-DC
Status
editNote: January 17, 2019
- RFC, language selection, and hardware was completed in Q2, this quarter, we are implementing servers and getting things set up.
Note: February 25, 2019
- CI is getting setup and ready to deploy soon, and also working on documentation - so fully In progress
Note: March 19, 2019
- We are still In progress with this and the work for deployment will extend into Q4
Outcome 2 / Output 2.6
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs
Goal(s)
editSpec, plan, and implement MCR page layout enhancement.
Status
editNote: January 17, 2019
- We are currently gathering requirements and writing the product plan.
Note: February 5, 2019
- We are a bit Stalled with this work, but hope to be working on it again in March.
Note: March 19, 2019
- This goal has been Postponed into next fiscal
Outcome 2 / Output 2.5
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs
Goal(s)
editDesign and begin integrating Parsoid into core
Dependencies on: Parsing Team
Status
editNote: January 17, 2019
- We are just now starting development for this.
Note: February 25, 2019
- We are working on this, and is fully In progress with the migration and translating of file and getting things integrated back into core; we hope to get it done by end of this fiscal year.
Note: March 19, 2019
- We'd like to work further on calling Parsoid from MediaWiki, so this is still In progress with the goal of finishing up in Q4.
Outcome 1 / Output 1.2
editEngineers have a clear understanding of our technology stack and the plan to better scale, maintain and test it
Goal(s)
editInitial design of API documentation portal.
Status
editNote: May 29, 2019
- This is In progress and should have a prototype by the end of the quarter.
Note: June 27, 2019
- This is In progress and we'll have a complete definition of done on July 1 (will wrap up by July 15)
Note: July 9, 2019
- This is Partially done and will be completed by July 15, 2019.
Outcome 2 / Output 2.1
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs.
MediaWiki REST API Infrastructure
Dependancies on: Parsing
Goal(s)
editImplement Parsoid API
Status
editNote: May 29, 2019
- This is also In progress and coordination with the Parsoid team. Have an RFC for this work: https://phabricator.wikimedia.org/T221177
Note: June 27, 2019
- This is In progress and we'll have a complete definition of done on July 1 (will wrap up by July 15)
Note: July 9, 2019
- This is Partially done - the REST infra will be merged, we'll add the MW extension and more tests - all to be Done by July 15, 2019.
Outcome 2 / Output 2.2
editModularized RESTBase
Dependancies on: Release Engineering, SRE
Goal(s)
editFinish implementation of RESTBase split
Status
editNote: May 29, 2019
- This is also In progress and should still be done by end of the quarter with the ramping up of traffic to it next FY.
Note: June 27, 2019
- This is now Done
Outcome 2 / Output 2.3
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs.
Dependancies on: SRE
Goal(s)
editDeploy and serve sessions for group 0 wikis
Status
editNote: May 29, 2019
- This is currently Stalled but still hoping to be done by end of quarter; we will do additional coordination with SRE team.
Note: June 27, 2019
- This is In progress and will get deployed to testwiki in the next few days. We'll have a complete definition of done on July 1 (will wrap up by July 15)
Note: July 9, 2019
- This is Partially done - this is deployed and can be considered Done but it is not yet turned on on group 0 wikis. This can take up to 6 weeks to be fully rolled out.
Outcome 2 / Output 2.6
editRefactoring output
Goal(s)
edit- Decouple Permission Manager
- Implement API integration testing infrastructure to run locally
- Finish MCR Storage changes to unblock DBAs Partially done
- Revision Table RFC
- Rank ordering of hooks based on usage
- Implement 2FA in OATHAuth
- Release automation: Generate 1.33 release tarball and announcement
Status
editNote: May 2019
- Decouple Permission Manager Done
- Implement API integration testing infrastructure to run locally is currently Stalled, conversation is ongoing (the MVP is Done)
- Finish MCR Storage changes to unblock DBAs Partially done
- Revision Table RFC Postponed to next FY
- Rank ordering of hooks based on usage Postponed to next FY
- Implement 2FA in OATHAuth is still scheduled to be done this quarter, but slightly delayed due to an unforeseen incident.
- Release automation: Generate 1.33 release tarball and announcement is still In progress to be finished this quarter.
Note: June 27, 2019
- The Revision table RFC is Not done and will be investigated next year. 2FA for OATHAuth is currently Blocked for now.
- The rest is In progress and we'll have a complete definition of done on July 1 (will wrap up by July 15)
Note: July 9, 2019
- 2FA for OATHAuth is currently In progress and should be done by end July, pending security review.
- Release automation: Generate 1.33 release tarball is now Done.
Outcome 2 / Output 2.5
editEngineers are able to access more functionality of the stack using well encapsulated components and well defined APIs
Goal(s)
editIntegrating Parsoid into core
Dependencies on: Parsing Team
Status
editNote: May 2019
- About 75% of this is complete (initial port is Done), and seems to be well on it's way to being completed by end of quarter.
Note: June 27, 2019
- Parsoid is 100% ported now - Done