Matrix down for a few hours?

I haven’t been able to connect to Matrix for the past few hours. However, the status page still shows Matrix as up. What’s going on?

@gschiano @ilvipero Where am I supposed to report this? I forgot.

Also tagging @amandahla in case she’s available.

Hey Merlijn,

I’m on it

1 Like

Problem is fixed:

We got an incident on the synapse environment. This comes from some weird configuration on the underlying service automation that was using a wrong user. We did some cleanup which deleted that user which was in fact currently in use to manage the DB credentials. In parallel we got an incident with a physical host, that led to 2 Synapse workers being restarted and not able to access their DB.

It’s all fixed, since most Canonical is a Winter break, it took longer for resolution.

I’ll work with the team after the break to cleanup the situation as the resolution came from restoring the deleted user.

1 Like

Hey - still with issues.
I am unable to login via our ubuntu.com server.
When I set ubuntu.com as the homeserver the login just hangs there.

-Ouch-

Again today - failure to access Matrix.
Attempting to log in via the ubuntu.com server when SAML authenticating get a 504 Gateway Time-out .

-yukkie-
\

Matrix restored :smiley:
All better now.