Checkbox 7.5.0 stable release

Project Discussion Checkbox
1

Hello all!

A new version of Checkbox is now available as a Debian package (in the Stable PPA ) and as Snaps (in the stable channel)!

We have noticed a regression in the latest version of Checkbox impacting salvages jobs. We have expedited this release to fix it. We have also increased our integration testing coverage to make sure this doesn’t happen again.

This release also brings you a new functionality that was long requested: xFail jobs. You can now mark jobs as expected failures and they will be marked as xfail_pass (if they fail, they are green) and xfail_fail (if they pass, they are red). See the documentation here for more details (link)

Reminder: if you update Checkbox you will not be able to resume testing session that you begun before updating. If this is undesirable to you, consider pinning Checkbox and finishing all sessions that are ongoing with the following command:

# for snaps:
$ sudo snap refresh --hold=forever checkbox checkbox24
# for debs:
$ sudo apt-mark hold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base

Remember to eventually run the following to re-enable automatic updates:

# for snaps
$ sudo snap refresh --unhold checkbox checkbox24
# for debs
$ sudo apt-mark unhold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base

New in this release

  • Support the rpi cm5 with imx219 camera
  • Support i2c read and write specific scenario
  • Add xfail tests support
  • Add jetson platform to the ce oem mipi camera tests
  • Add the test script to trigger and capture cpuidle state
  • A way to handle customized command for flexibility
  • Support buzzer via gpiod
  • Gpiod gpio test for simple and loopback
  • Migrate reboot job definitions to yaml
  • Add level zero testing
  • Adopt checkbox-support interface
  • Add script to generate launcher for odm
  • Add realtime test plans in ce-oem provider

Notable Bugfixes

  • Use available pcr bank for clevis tpm2 encrypt/decrypt tests
  • Fix salvages skipped
  • Remove manifest from resource job
  • Fix wrong include of rs485 auto
  • Always set pythonunbuffered for jobs and snap apps
  • Replace hyphen with underscore before checking if a sibling job’s override field is valid
  • Don’t escape raw value in html reports
  • Use builtin sorted_keys insted of sort by hand
  • Revised resource jobs in ce-oem provider
  • Comment out algif_aead test from test-plan-crypto
  • Migrate to use libnvml to check nvlink status directly
  • Usb dwc3 cleanup add requires
  • Fix ptp4l arg interpolation
  • Remove vesa_drivers_not_in_use dependency from resolution cycle test
  • Fix false positive while check clock from rtc
  • Whitelist sosreport in snap confinement test
  • Add ptp minor version param
1 Like