User talk:ASarabadani (WMF)/Database for developers toolkit/Concepts/Choosing storage technology

Thanos / swift / S3

We do use thanos for a bunch of things (even though it's not currently backed up); its advantages are that it supports the S3 protocol (which I think we should be preferring over the swift protocol, esp. for new deployments), and it handles cross-DC replication for you.

The ms- swift clusters are not replicated.

MOSS (hopefully Q2!) will support S3 and be replicated.

Data Engineering have a new Ceph cluster that might be useful for some wider storage purposes.

MatthewVernon (talk) 08:23, 28 June 2023 (UTC)