Hello!
We will use this thread in the future for real-time updates and discussions on issues encountered during Matrix upgrades and downtime.
Hello!
We will use this thread in the future for real-time updates and discussions on issues encountered during Matrix upgrades and downtime.
Hey all! We are currently investigating a DB issue on Matrix after yesterday’s deployment. We aren’t able to scale up and add more units to our production database and are working with the Data Platform team to find the root cause. No expected downtime yet, but you might experience some slowness on loading chats or federation meanwhile.
We’ve successfully added additional database capacity. You should start to see improvements in federation performance as things stabilize.
Hello,
We haven’t started the upgrade yet due to the database backup taking longer than expected.
Hello,
The database backup is done, and we’ll proceed with the upgrade now.
Hello,
The upgrade has completed successfully.
Hello, we are currently scaling Synapse down for the upgrade. You might experience some instability.
Starting the upgrade now, Synapse will be down during the process.
21:39 UTC - still working. unexpected infrastructure issues.
22:09 UTC - finally up but we still need to scale up so expect some instability, sorry for the inconvenience.
22:20 UTC - Upgrade finished and has completed successfully.
Thanks for setting this up. Having a dedicated thread for real-time updates will be helpful for tracking progress and staying aligned during Matrix upgrades and any related issues. Looking forward to staying updated here.