Apt updates failing [active incident]

Support and Help
1

Ubuntu Version

Ubuntu 22.04 LTS

Desktop Environment (if applicable)

None (server/headless)

Problem Description

There were reported incidents for archive.ubuntu.com and security.ubuntu.com earlier today, both of which were mark as resolved. I am still however failing to reach these services with apt-get.

https://status.canonical.com/#/incident/KNms6QK9ewuzz-7xUsPsNylV20jEt5kyKsd8A-3ptQEnEK2gZRqHXrw2jkVypDlhkDVkEltGlj2VJvd1mrH-bg%3D%3D

Are there still ongoing issue?

I’m getting “Connection failed” errors like this:

Err:5 http://security.ubuntu.com/ubuntu jammy-updates/main amd64 libatopology2 amd64 1.2.6.1-1ubuntu1.2
  Connection failed [IP: 91.189.92.23 80]
Err:6 http://us.archive.ubuntu.com/ubuntu jammy/main amd64 libfftw3-single3 amd64 3.3.8-2ubuntu8
  Connection failed [IP: 185.125.190.81 80]
Err:7 http://us.archive.ubuntu.com/ubuntu jammy/main amd64 libsamplerate0 amd64 0.2.2-1build1
  Connection failed [IP: 185.125.190.81 80]
Err:8 http://us.archive.ubuntu.com/ubuntu jammy/main amd64 alsa-utils amd64 1.2.6-1ubuntu1
  Connection failed [IP: 91.189.92.24 80]

Relevant System Information

This is on blacksmith runners (https://status.blacksmith.sh/), I initially contacted their support and they pointed me to the Canonical incident page.

What I’ve Tried

Retried multiple times since the outage was reported as resolved.

Possible security.ubuntu.com infrastructure issue — TLS timeouts on specific backend IPs
2

I see an incident has been reopened, I’ll monitor there now.

https://status.canonical.com/#/incident/KNms6QK9ewuzz-7xUsPsNylV20jEt5kyKsd8A-3ptQH84hZXdzn1wKWbH46A9lOVf9gc3h8NDtKS6GZDB47yyQ%3D%3D

3

And it’s been marked as “resolved” again even though it’s still not resolved on my side.

4

Blacksmith is at least acknowledging this on their status page now.

https://status.blacksmith.sh/cmtx0883205f40wn0gg834kz2

5

If I were you, I’d switch to using a mirror. See Redirecting apt sources to address increased load: A Guide to Using Community Mirrors

6

Thanks, I already have for the job that was blocked. I was hoping not to have to change all my workflows though.

Blacksmith is doing mitigation on their end though, so hopefully I can avoid all that.

7

Correct. Blacksmith is unsupported here and that’s completely on their side.

1 Like
8

Thanks, ye I wasn’t expecting support for Blacksmith, that was just where I noticed the issue because it was blocking work and I couldn’t find anywhere else to ask.