Groovy Gorilla (20.10) Release Status Tracking

This page is the canonical tracking document for the upcoming Groovy Gorilla release. It’s a live document. The Ubuntu release team will be updating it as we work on releasing 20.10.

Status

  • 20.10 is released!

Summary

  • proposed-migration block in place
  • We’re DONE!

Current blockers

  • LP: #1899519 - booting linux-generic-lpae armhf kernel under qemu results in relocation out of range, and thus no modules can be loaded (need respin)
  • LP: #1898038 - docker-support/multipass-support broken with system apparmor3 (20.10)
  • LP: #1900436 - Update of tzdata 2020b
  • LP: #1900304 - The “Prepare for shipping to end user” icon is not shown on desktop
  • LP: #1892040 - US keyboard layout even if a non english language is selected in ubiquity-dm
  • update-notifier 3.192.34
  • [s390x] LP: #1899692 - Enabling or disabling a dasd-fba device from the installer, for a zVM, results in a dasdview error
  • livecd-rootfs fix wifi oem config on pi desktop image.
  • LP: #1900718 - Invalid swap file is created on raspberry pi desktop image
  • LP: #1869187 - mokutil ignores timeout parameter
  • LP: #1900865 - NVIDIA drivers aren’t running after fresh groovy install with Secure Boot enabled
  • LP: #1900888 - NVIDIA drivers aren’t installed on latest groovy image when network is disabled
  • LP: #1897934 - The initial sound level is set to zero (mute)

Bugs to watch

  • LP: #1885414 - on flavours ubiquity: bootloader failed on /dev/vda
  • LP: #1893205 - linux-generic-hwe-20.04 transitional to linux-generic does not exist in groovy
  • LP: #1899632 - VMWare “Easy Install” not working in Groovy
  • LP: #1900642 - sssd won’t start (OK to SRU, not release critical)
  • LP: #1899678 - No wifi after installation - does not work with secure boot enabled, dupe of mokutil ignoring timeout parameters

Misc information

Packages for 0-day SRU

  • apt
  • ubuntu-drivers-common
7 Likes

Follow-up actions

  • Look into packaging icu data outside of tzdata instead of inside, so updates can be decoupled.
  • SRU fix for LP: #1892040 (Ubiquity keyboard bug)
  • Try to get release name earlier, so we can open the new series in order to be able to clear out -proposed to make proposed-migration runs go faster. :speedboat:
  • The mirror prober’s output dropped off a cliff after we published - as expected - but took a long time to recover. Is there a way we can make this more efficient? It blocks publishing of the website. (It’d run faster if if the .manifest only had the current series.)

Release checklist

The following list is strictly for ubuntu-release team members, based on the ReleaseProcess document.

Legend:

  • :soon: - Task assigned and worked on
  • :heavy_check_mark: - Task finished
  • :heavy_multiplication_x: - Task skipped or failed

Release minus 14 days:

  1. :heavy_check_mark: [sil2100] NonLanguagePackTranslationDeadline , ensure uploads with updated translations downloaded from Rosetta are done for:
    – ubiquity (debian-installer)
    – ubiquity-slideshow-ubuntu
    – gfxboot-theme-ubuntu
    – yelp, gnome-user-docs and ubuntu-docs
    – DDTP data (package description translations)
  2. :heavy_check_mark: [sil2100] Notify Language Translation Lead (GunnarHj) and the current langpack-o-matic maintainer (sil2100) to coordinate a fresh set of language packs which will be exported, uploaded, and built in time for the release.
  3. :heavy_multiplication_x: [bdmurray] If the new release is an LTS, make sure that hwe-support-status (located in update-manager) is up to date with the current HWE stack info, dates and versions.

Release minus 10 days:

  1. :heavy_check_mark: If any image names have changed since the previous cycle, notify the web team (#web-team on canonical; email: webteam@canonical.com) to check the website downloader code. Ask the web team to review Release Manifest.
  2. :heavy_check_mark: Start off release notes and announce framework. Call for ubuntu-docs and other team participation in content creation of overview and documentation of release bugs.

Release minus 7 days (release candidate week):

  1. :heavy_check_mark: Selectively accept package uploads to resolve targeted bugs
  2. :heavy_check_mark: Go through ReleaseChecklist (again, yes)
  3. :heavy_check_mark: [sil2100] Review list of full iso image names and plans with web team (#web-team on canonical; email: webteam@canonical.com)
  4. :heavy_check_mark: [bdmurray] Disable apport and kerneloops uploads to Launchpad (‘problem_types’: [‘Bug’, ‘Package’], in /etc/apport/crashdb.conf)
    – You can reach out to BrianMurray if in doubt.
  5. Notify Ubuntu, Kubuntu and other flavour contacts to create and update their Upgrade docs at https://help.ubuntu.com/community/RaringUpgrades
  6. :heavy_check_mark:Send out FinalFreeze announcement to ubuntu-devel-announce@lists.ubuntu.com (usually somewhere around 21:00 UTC)

Release minus 6 days:

  1. :heavy_check_mark: Contact the web team to confirm that:
    – website preparations are on-track; this includes preparing http://www.ubuntu.com/getubuntu/download
    – update http://www.ubuntu.com/project/about-ubuntu/derivatives (review flavors and translated languages)
  2. :heavy_check_mark: Post full set of pre-release images with last language pack updates to QA iso tracker to start QA testing.
  3. :heavy_check_mark: Turn off daily builds (unless explicit reason why they need to remain on).

Release minus 3 days:

  1. :heavy_check_mark: Make sure that /etc/issue, /etc/issue.net, /etc/lsb-release, and /etc/os-release are correct
  2. :heavy_check_mark: Modify debian-cd/CONF.sh to set OFFICIAL
  3. :heavy_check_mark: Ensure that the ISO tracker lists the new milestone with the “publish from manifest” flag set.
  4. :heavy_check_mark: Produce a full set of official images
  5. Check the volume labels on ISO’s for all architectures (cdimage/debian-cd/CONF.sh, OFFICIAL variable)
  6. :heavy_check_mark: Clear out the testing grid
  7. :heavy_check_mark: Clear the NBS list.
  8. :heavy_check_mark: Notify Hardware Certification team ( email: hardware-certification@canonical.com ) to begin CertificationTestingProcess (private due to agreements with vendors)
  9. :heavy_check_mark: Notify QA to begin ReleaseValidationProcess
  10. :soon: Prepare the release announcement
    – Notify Flavor Product Managers (Kubuntu, Xubuntu, Lubuntu, Ubuntu Studio, Ubuntu MATE, Ubuntu Budgie, Ubuntu Kylin) to prepare separate release announcements and review/update Release Notes.
    – this should refer to the web page prepared by the teams rather than going into details of changes itself
    – update the page to include any caveats
  11. :heavy_check_mark: Review targeted bugs and take final decisions on what to fix and what to defer
  12. :heavy_check_mark: Apply a “block-all source” hint to proposed-migration; any further changes to -proposed not intended for SRU will need to be unblocked manually XXX this should be in release day, and in “minus 3” there should be a reference to generate-freeze-block instead

Release minus 1 day:

  1. :heavy_check_mark: [sil2100] Pre-publish the CD images: ./publish-image-set --prepublish will print the necessary commands.
  2. :heavy_check_mark: Copy .manifest to .manifest.full, and prune all images from previous releases from the .manifest file to allow timely mirror probing
  3. :heavy_check_mark: Run sync-mirrors on ancientminister to push out the pre-published file structure.
  4. :heavy_check_mark: Begin running the mirror prober hourly on staging.ubuntu.com to monitor the propagation of the images to mirrors
  5. :heavy_check_mark: Review on the staging server the feature walk through on the website (web-team)
  6. :heavy_check_mark: Build and wait for the source images ( cron.source ) to be published by the publisher script.
  7. :heavy_check_mark: Ping CPC using cpc-help keyword in #ubuntu-release to update on current status to see if CPC can start staging cloud images ready for publication.

Release minus 6 hours:

  1. :heavy_check_mark: If there is a previous milestone for this series, move those images from /srv/cdimage.ubuntu.com/www/full to /srv/cdimage.ubuntu.com/old-images/, and notify the sysadmin team that these are available for off-line archival.
  2. :heavy_check_mark: Disable sync-mirrors on ancientminister, best by adding an early exit to the sync-mirrors command.
  3. :heavy_check_mark: Ask #is to disable rsyncd on ancientminister so images don’t get published early
  4. :heavy_check_mark: : Publish the CD images: ./publish-image-set will print the necessary commands.
    – You need to edit cdimage/www/simple/HEADER.html and cdimage/www/simple/.htaccess by hand to drop the mention of “Release Candidate”, since neither publish-release nor publish-image-set is yet smart enough to do the right thing there.
  5. :heavy_multiplication_x: Notify the vanguard in #IS that images are ready to be pushed to s3 to be ready for CloudFront:
    find /srv/cdimage.ubuntu.com/www -name \*20.04\*iso -o -name \*20.04\*xz -o -name \*20.04\*gz | grep -v torrent
  6. :heavy_multiplication_x: Once the s3 copy is done, re-enable sync-mirrors (by removing the temporary early exit) and ask #is to re-enable rsyncd on ancientminister
  7. :heavy_check_mark: XXX Re-enable rsync and sync-mirrors. Run sync-mirrors manually to push out the updated images to cdimage & releases
  8. :heavy_check_mark: Ping CPC using cpc-help keyword in #ubuntu-release to start the process of building and publishing cloud images.
  9. :heavy_check_mark: Copy .manifest to .manifest.full again, pruning all images from previous releases from the .manifest file to allow timely mirror probing
  10. :heavy_check_mark: Ask the #is vanguard to run the mirror prober continuously to verify which mirrors are up to date; output visible here. Take a note of how many mirrors were there before this started.
  11. :heavy_check_mark: Check torrents for proper functionality.
  12. :heavy_check_mark: Confirm that website content is finalized, as further edits will be difficult under load and check with sysadmin that caches will be cleared on time (web-team, IS, release-team).
  13. :heavy_check_mark: Check the mirror prober loop has resulted in at least 60% of the mirrors being restored, so the website can spread the load amongst more mirrors. This list is baked into the Ubuntu website at build time, so notify the web team to (re)build the site.
  14. :heavy_check_mark: Ask a Launchpad engineer to check that we haven’t lost the race on Contents file generation ; Contents generation takes on the order of two hours plus a publisher run, so give it at least that much headroom.

Release minus 1 hour:

  1. :heavy_check_mark: Coordinate with web team for publishing of staging.
  2. :heavy_check_mark: Coordinate with PR team (Sian Aherne) to inform media who are waiting for launch to post their articles.

Release:

  1. :heavy_check_mark: Update the topic on #ubuntu-devel, #canonical, and #ubuntu-release-party and make announcement in #ubuntu-release-announce, and then in #ubuntu-release-party.
  2. :heavy_check_mark: Update the appropriate meta-release files (including raspi/os_list_imagingutility_ubuntu.json) in the bzr branch. Then a member of the changelogs group (BrianMurray, laney, sil2100) updates the meta-release bzr branch on rubay /srv/changelogs.ubuntu.com/meta-release and copies updated files to /srv/changelogs.ubuntu.com/www .
  3. :heavy_check_mark: Switch the development release from its codename to its version in errors/templates/bucket.html in errors
  4. :heavy_check_mark: Notify web team to announce on the website
  5. :heavy_check_mark: Send the release announcement to ubuntu-announce.
  6. :heavy_check_mark: Notify a Launchpad admin to set the status of this distrorelease to CURRENT, and to change any previous CURRENT distrorelease(s) to SUPPORTED.
  7. :heavy_check_mark: Deactivate release milestone in Launchpad.
  8. Post announcement to News & Announcements section (forum admins have posting rights)
  9. :heavy_check_mark: Post announcement to Launchpad (ubuntu-drivers members have posting rights)
  10. :heavy_check_mark: Branch lp:~ubuntu-release/britney/hints-ubuntu/ to lp:~ubuntu-sru/britney/hints-ubuntu- (To ensure it’s available before any 0-day SRUs are uploaded)
  11. Sleep!

Release plus 1 day:

  1. If any changes were made to this document in this run, check whether the changes also apply to AlphaProcess, BetaProcess or ReleaseCandidateProcess .
  2. :heavy_check_mark: Restore the .manifest.full file on releases.ubuntu.com .
  3. :heavy_check_mark: Continue on NewReleaseCycleProcess .
  4. Update Relevant community documentation with references to this new release
    https://help.ubuntu.com/community/ReportingBugs1 Review through the process pages, and update to the release name (e.g. oneiric->precise)
2 Likes

Things identified during release sprint:

  • ICU tzdata is impossible to rebuild, and maybe should be split into a separate source package
  • Ideally it should be possible to build it from tzdata sources
  • tzdata is missing icu tzdata test
  • lightdm-gtk-greeter fails on xubuntu
  • ubuntu-drivers-common fake-devices-wrapper is not enough for efivars
1 Like