User:71.202.6.95/$PROGRAM

Wikimedia Performance Portal Project

This is Christy Okpo's project proposal for Wikimedia's Performance portal.

Public URL
Bugzilla report: <https://bugzilla.wikimedia.org/show_bug.cgi?id=70587>
Announcement: <http://www.gossamer-threads.com/lists/wiki/wikitech/517200search_string=FOSS%20Outreach%20Program%20for%20Women%20;#517200>

Name and contact information

Name: Christy Okpo
Email: ecokpo@gmail.com
IRC or IM networks/handle(s): memeht
Resume (optional)
Location: San Francisco, CA, USA
Typical working hours: between 11 am and 2 am PDT (but generally flexible)

Synopsis

This project will evaluate the performance timing data aggregated from the Wikimedia cluster, to select and construct several Key Performance metrics. The currently available data will be grouped, according to their relevance, into several categories including responsiveness, reliability and scaling. Within each group, datapoints will be evaluated and developed into Key Performance metrics. In turn, these metrics will be graphed and visualized using Javascript and available Python libraries. At the end of the Project, a series of charts and visualizations will be available to be ported unto the Wikimedia Performance page <http://performance.wikimedia.org/>

Along the way, glossaries to help readers interpret the data, will be created.

This project will develop a dashboard of metrics that will allow users to, at-a-glance, understand the timing performance of Mediawiki and its ecosystem of services. It will provide a resource for system tuning, quick assesments of production readiness, and troubleshooting sources of performance problems. On a larger scale, it might give insights into ways to improve continued access.

Possible mentors: Ori Livineh

Deliverables

A week before Program starts:

Set up machine, install necessary software, get Administration access (when needed).

Week 1 through Week 5:

Perform meta-research and evaluation of data-set to determine important metrics.
Transform one or more datapoints into Key Performance Metrics (KPM) and Create data glossaries.
Present findings to mentor around Second Week of January.

Week 6 through Week 9: Working in two week sprints,

Iterate over Graphing/Visualization techniques for the selected metrics.
Create Batch Processes to keep metrics updated.
Submit necessary documentation and glosses.

Week 10 through to End:

Work on Porting visualizations to the Mediawiki performance portal.
Determine location for documentation and data glossies.

Participation

I plan to maintain a weekly status and in-progress update, as a User sub-page, including links to any documentation or code created during that period. I plan to check in with my mentor, at least every third/fourth day of the week, or more frequently when help is needed. In addition to the mentor, I will utilize the Mediawiki IRC, wikitech-I and related mailing lists as well as currently available Mediawiki documentation.

In terms of work-style, I work best when I have the chance to get a big-picture view of a task, go off to do in-depth research, and return to ask questions about specific questions related to a task. In a way, I learn best with a mix of reflective and action-oriented mentoring. I like to know why things are done a certain way.

About you

Education completed or in progress: Dec 2012 : Eastern Michgian University : B.Sc in Economics, minor in Mathematics
How did you hear about this program?: I heard about the program at an SF meetup.
Will you have any other time commitments, such as school work, another job, planned vacation, etc., during the duration of the program?: Apart from December 25 & 26, December 31 & January 1st, I will be able to commit solely to this program.
We advise all candidates eligible to Google Summer of Code and FOSS Outreach Program for Women to apply for both programs. Are you planning to apply to both programs and, if so, with what organization(s)?: As I am not currently enrolled in University, I am not eligible for the Google Summer of Code program.

Other information

I deeply identify with the FOSS ethos. Wikimedia and its services have been instrumental in providing the kind of acces that lies at the heart of FOSS.

I use Wikipedia on an hourly basis, and it has proved an immesaurable resource in getting a big picture overview of the subject I am researching.

System Performance is an important ingredient in providing such access, and my hope is that by contributing to this project, I can provide a resource for Wikimedia users/developers to understand and troubleshot any future performance bottlenecks.

Moreover, by curating/analyzing the performance timing datasets for quality and usefulnesss, I hope to contribute to making it accesible for reuse in other Wikimedia projects.

Past experience

Please describe your experience with any other FOSS projects as a user and as a contributor

I am very new to contributing to FOSS projects, but I have used a myriad of FOSS applications for quite some time, most notably VLC Media Player, Soundflower and Apache OpenOffice. I routinely work on audio-editing side-projects, VLC and Soundflower have been an asset on audio-converstion tasks. I have used Open Office - particularly Calc - in my data analysis work.

I have Ubuntu running on several virtual machines, and its ease of use and resources to customize the OS to my needs, is always a joy.

These FOSS Projects and others are what have really engineered my passion for working within the FOSS field.

Please describe any relevant projects that you have worked on previously and what knowledge you gained from working on them (include links)

As part of my ongoing contribution to the Code for San Francisco- Code for America Brigade, I have worked on data transformation scripts, written in Python. This skillset will be handy in creating batch processes, once the data has been grouped, to analyze the performance metrics.

I have approximately two years of professional experience as a Data Analyst, and so I have a strong foundation in Data Analytics and experience working with Python's Analytics Packages (Numpy, Matplotlib) and UNIX scripting.

Some of the relevant Data Analytics projects I have worked on in the past include Analyzing usage patterns on an online sales application using SQL/Excel/Python, creating custom dashboards for team performance analysis using Excel/Unix/Tableau. I will bring this knowledge to bear in evaluating datasets to develop Key Performance Metrics and Visualizations. In particular, my experience will serve as a guie to choosing visualizations that effectively engage viewers.

What project(s) are you interested in (these can be in the same or different organizations)?

I am most interested in working on the Wikimedia Performance Portal project with the Wikimedia Foundation.

Past experience working in open source projects (MediaWiki or otherwise)

I recently started contributing to the Code for San Francisco- Code for America Brigade. Specifically, I am working on a project to aggregate San Francisco service provider data from different City Departments, and transform it into Open Referral specification - an API specification. I am working on the Python scripts that will transform csv and other related data types in Open Referral-compliant JSON files. I have not pushed my code to the github parent repo, as some Schema mapping needs to be completed before I can do so. <https://github.com/sfbrigade/sf-openreferral-transform-scripts/issues>

I am also a member of Double Union - a female only Hackerspace in San Francisco. Although it is not directly an Open Source project, the space really works to promote Open Culture, and in particular, the inclusion of those underepresented in FOSS-related activities. <https://www.doubleunion.org/>