Extensão:gráfico/projeto/atualizações

junho de 2025: Deployment to all wikis complete and Lua transforms now available

The Chart extension is now available on all Wikimedia wikis! Thanks to everyone who has been actively testing it out and suggesting further improvements. We encourage you to continue reporting any ideas you have or issues you encounter on the talk page or at phab:tag/charts.

Data filtering/transformations

It is now possible to use Lua modules to filter and transform tabular data for use in charts on testwiki and testcommons. This can be used for things like selecting a subset of rows or columns from the source data, converting between units, statistical processing, and many other useful transformations. More information on how to use transforms is available at Extension:Chart/Transforms , with an announcement to follow once it's available for use on Commons and other wikis.

What's next

As we enter the final month of the project, our top priority will be addressing any high priority bugs discovered now that charts are widely available. Since the task force working on the project is temporary, we’ll also be transitioning our focus to ensuring a smooth ownership handoff of the extension to the team who will be responsible for maintaining it going forward. In the next update, we’ll provide more details on what to expect for future development and how you can contribute.

maio de 2025: Preparando-se para implantar mais e explorar dados de origem de filtragem/transformação

Nos últimos meses, estamos trabalhando para resolver problemas de exibição e outros erros durante a fase piloto do Wiki (rastreado em phab:T383079). Ainda estamos fechando alguns desses problemas e, quando o fizermos, iremos ampliar a capacidade de gráficos em mais wikis.

Também estamos explorando como filtrar e transformar dados tabulares para usar em gráficos. Mais sobre isso abaixo.

Implantação nas wikis adicionais

O objetivo é ativar os gráficos nas wikis adicionais na próxima semana (a partir de terça, 6 de maio) e aumentar nas semanas seguintes. Uma vez confirmado, um cronograma de implantação mais detalhado, incluindo datas para wikis específicos, será publicado em Extension:Chart/Project e mantido atualizado à medida que o lançamento progride. Se você encontrar problemas usando gráficos na sua wiki, informe na página de conversação ou em phab:tag/charts.

Data filtering/transformations

Uma das principais formas de feedback durante a fase piloto do Wiki foi a incapacidade de filtrar e transformar os dados de um conjunto de dados maior para conseguir usar em vários gráficos diferentes.

Chegamos a uma proposta para permitir que os gráficos apliquem uma transformação nos dados de origem usando o código LUA sandboxed. Na prática, isso pode permitir: selecionar um subconjunto de linhas ou colunas dos dados de origem, converter entre unidades, processamento estatístico e, muitas outras transformações.

Este escrito técnico descreve a motivação para essa abordagem e outras opções consideradas, incluindo exemplos de como essas transformações podem ser usadas em gráficos. Bem, curioso para saber o que você pensa sobre esta proposta. Bem, espero que isso possa fornecer gerenciamento de dados flexível em gráficos de maneira segura e sustentável.

Wikimedia Hackathon

Se você estiver participando da Wikimedia Hackathon e está interessado em trabalhar em um projeto relacionado a gráficos, confira estas tarefas, consideramos bons candidatos, embora haja muitas ótimas ideias não capturadas lá. Você também pode encontrar em User:KFilbert-WMF (também conhecido como User:Aude) que está participando do Hackathon pessoalmente e pode ajudar a responder a perguntas e fornecer suporte.

janeiro de 2025: Melhor visibilidade em gráficos e uso de dados tabulares

Neste mês, começamos a trabalhar para trazer melhor visibilidade aos gráficos globais (phab:T383591) e uso de dados tabulares (phab:T371300). Você pode ver quais as páginas da Wiki os gráficos estão incorporados. Você pode ver quais gráficos usam dados tabulares como fonte. Ambos funcionarão da mesma forma, como o uso de namespace de arquivos é atualmente rastreado no Commons.

Categories for Data namespace pages

Também estão trabalhando para adicionar suporte para categorizar as páginas no espaço para nome de dados (phab:T242596), um recurso solicitado há muito tempo. Isso chama a necessidade de soluções alternativas, como categorizar as páginas de conversa sobre nome de dados. Essas categorias serão definidas nos dados da página, que atualmente não suportam o Wikitext. Por enquanto, isso significa que ferramentas de categoria como Hotcat ou Cat-A-Lot trabalham nestas páginas.

Pilot wiki feedback

Thank you to those who have already provided early feedback about your experience working with charts on the few wikis where it is enabled. Ciente de alguns problemas, notáveis ​​Boaify Strange com arredondamento/truncamento de números, que planejamos abordar nas próximas semanas, em mais wikis. Em seguida, vamos nos concentrar em adicionar suporte à filtragem básica de dados, para tornar o trabalho com dados maiores mais gerenciáveis.

dezembro de 2024: Implantação nas wikis de testes

Os gráficos estão agora disponíveis para mediawiki.org e 3 wikis de teste: hebraico, italiano e sueco. Conforme mencionado na última atualização, essas serão as únicas implantações por enquanto, proporcionarão estabilidade nos feriados e, permite que quaisquer problemas descobertos seja corrigido antes de um lançamento mais amplo.

Early feedback and upcoming improvements

We’ve heard your feedback about some of the challenges of working with the Data namespace and the limitations of tabular data. In the new year, we’ll be exploring ways to improve this, starting with:

• Better discoverability of pages in the Data namespace using categories
• Providing visibility into which wiki pages include a given chart and which charts rely on a given tabular dataset
• Adding support for specifying which fields from a tabular dataset to use for a given chart in the definition

Thanks for continuing to follow along with the project and providing feedback. We’re looking forward to continuing to improve the extension as we roll out to more wikis.

novembro de 2024: Production deployment and security review complete

This month we deployed Charts to production, and it is now enabled on Commons and testwiki. You can see a working version at testwiki:Charts. There are a few design tweaks that will come over the next few weeks, mostly to the styling of the hover tooltip.

We also got confirmation from the Wikimedia Foundation Security team that the extension is considered low risk for rollout to pilot wikis in December. We will be taking action on the recommendations from the security review over the coming months as we scale the rollout.

Pilot wiki deployment

Estamos perto de confirmar os três wikis de teste que terão gráficos primeiro, planejados para a primeira semana de dezembro. Uma vez que implantamos para esses wikis, haverá uma pausa em implantação adicional até 2025. Isso é para fornecer estabilidade nos feriados e abrir espaço para que quaisquer problemas descobertos sejam corrigidos antes do lançamento amplo. Espere ouvir mais sobre isso em breve!

outubro de 2024: Working towards production deployment

Throughout September and October, the team has been working on taking the prototype that is currently deployed in the beta cluster and getting it into a production-ready state. The next major milestone we are working towards is deploying the Chart extension to testwiki and testcommons, which we are aiming to do in November. We are simultaneously working towards a security review, which is an important step for the project given security concerns were the reason the Graph extension was ultimately disabled. Following production deployment and security approval, we will begin rolling out to real wikis.

What to expect

The initial version of the Chart extension released to testwiki and testcommons in production will be fully functional, but not yet feature-complete. We've simplified the prototype to focus on the core workflows of creating and embedding charts, in addition to designing a visually accessible reading experience on mobile and desktop devices. Editors will be able to define basic line, area (stacked), bar, and pie charts on testwiki using tabular data stored on testcommons. Documentation for the extension is now available on the extension page, with a working version on beta.

Once we've deployed to production, we'll be adding more features and functionality. Notably, we want to improve the experience of working with tabular datasets and support more customization of the visual presentation of charts (e.g. customizing the colors). We will also be turning our attention towards supporting editors with migrating legacy graphs to charts.

Deployment to real wikis

Soon after deploying to the test wikis, we are planning to deploy the extension to production Commons and real wikis so that we can collect feedback about real-world use and quickly address any high priority issues. Let us know if you'd like your wiki to be one of the first to receive the new extension.

agosto de 2024: Wikimania recap and beta cluster deployment

Recording of our Wikimania session

• Wikimania recap. Thank you to everyone who joined the Wikimania session, or stopped by to discuss the project at the Product & Tech table. We learned a lot by talking to many of you and seeing the types of graphs you created before and the types of charts you hope to create in the future. Some of the major themes we picked up from our conversations at Wikimania are summarized on Phabricator. The key takeaways are to continue working on the core chart types previously enabled by the most popular graph templates and to look into support for alternative data sources like Wikidata. We're also going to investigate some of the challenges highlighted with using Commons as the centralized storage solution for charts.
• Beta cluster deployment.
  • You can now create charts in beta Commons (example) and embed them into pages on other beta wikis (examples: beta English Wikipedia, beta German Wikipedia)! This gets us closer to deployment on regular wikis later this fall. We will also develop more features, like support for additional chart types and visual customization. Test the charts yourself and let us know of any issues you encounter!
  • Some important functionality is still missing. For example, when you edit a chart definition or data page on beta Commons, and it's used on a page on another beta wiki as a chart, its looks doesn't change. To update the chart rendering, you have to purge the page or make a null edit. We will make it update automatically: T370378.

julho de 2024: Key decisions made: library, chart types, definition storage. Join us at Wikimania

First, we are pleased to share that we have made three key decisions about the project:

1. We have selected a data visualization library. After researching and prototyping a number of options, the final two under consideration were Apache eCharts and Vega (the library previously used for Graphs), with the decision being to use eCharts. However, we're not ruling out using Vega in the future just yet. Go to the FAQ to learn more about eCharts and Vega.
2. We also analyzed the Graph templates/modules usage to determine which types of charts to start prototyping with and what the parameters should be. We will start with line charts. Their parameters should be reusable for other related chart types too. After line charts, we will move on to map-based visualizations, because those are quite different from the other types and might require a different approach.
3. Chart definitions will live on their own .chart pages on Commons, under the Data: namespace. We want to treat charts as a standalone content type, rather than just a part of an article. It will be easy to reuse the same chart across wikis, and beyond Wikimedia platforms by making them available as links. Editors who want to embed charts in an article will be able to do so with a short piece of wikitext, similar to including an image from Commons, all without needing to interact with complex templates. We will build a prototype quickly so that we can start testing our assumptions. Go to the FAQ to read more.

For those attending Wikimania: Chris and Szymon will be hosting a session: "Charts, the successor of Graphs: A secure and extensible tool for data visualization" (add to your favorites). They will speak more about the project and preview an early prototype of the new extension. It will primarily be about how charts will be defined and then embedded within articles. Join us in-person or virtually, and register to Wikimania to add sessions to favorites. For in-person attendees, there will also be a Graphs / Charts table. Anyone who can't attend the session or would like to talk further will be most welcome.

julho de 2024: Start of the project

We are happy to announce that the project officially started on July 1. In the first half of the month, we'll decide how charts will be used and how the underlying service will be architected.

Most importantly, we'll be selecting the data visualization library (T368336). We have included options suggested by volunteers and staff. Vega, previously used for graphs, is one of them. Additional suggestions are welcome, however there are many options out there, and we won't be able to test them all. If you have ideas on what criteria we should consider when evaluating these libraries, write on our talk page!

We will also be shortlisting the priority types of charts. Then, we will pick one to start with (T368478). As part of this, we will analyze existing graph usage and factor in comments from volunteers. This list will change as we learn more about what types of charts are most important for encyclopedic content and what's possible with the library we end up choosing.

Relatedly, we're also exploring what the syntax could look like for defining a chart in wikitext, or if it will even be defined in wikitext at all (T368350). This won't be a final decision, and we want to get a prototype of the service up soon. In addition to thinking about how easy the syntax is to understand and use, we are also thinking about how easy it will be to convert from existing graph definitions.

Once we make these early decisions, we'll set up the infrastructure required to create the first chart type. The plan is to make it available as a prototype so volunteers can start experimenting with it. In the meantime, we welcome questions and comments on the talk page or on Phabricator.

We are also encouraging you to register for Wikimania. We will give a presentation about the project there. Hopefully, we'll build enough to have interesting news to share. Registration is needed for both in-person and remote participation.

Last but not least, we are wondering what tool to use to stay in touch with community members who were involved in discussions about Graph. Would you like to receive notifications about new project updates, or do you prefer a mass message on your talk page? Let us know if you have a strong preference. Thanks!