Hello all!
A new version of Checkbox is now available as a Debian package (in the Stable PPA ) and as Snaps (in the stable channel)!
This is the first release that isolates (and therefore comes without) Checkbox16 support. We will continue to isolate more legacy Checkbox releases only delivering sporadic updates and patches to them.
This release also brings you a shiny new feature: Expected failures. Tests that are marked as expected failure are marked as xfail_passed when they fail and xfail_fail when they pass. This is also reflected in the reporting. You can read more this new feature here (link).
Reminder: if you update Checkbox you will not be able to resume testing session that you begun before updating. If this is undesirable to you, consider pinning Checkbox and finishing all sessions that are ongoing with the following command:
# for snaps:
$ sudo snap refresh --hold=forever checkbox checkbox24
# for debs:
$ sudo apt-mark hold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base
Remember to eventually run the following to re-enable automatic updates:
# for snaps
$ sudo snap refresh --unhold checkbox checkbox24
# for debs
$ sudo apt-mark unhold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base
New in this release
- Migrate storage.py to use path() objects and read json output of lsblk
- Add i.mx93 camera support for ap1302 with shared nxp camera handler
- Collecting the bios settings as an attachment
- Re-implement max resolution test to handle fractional scaling
- Allow environment vairables to override max expected ethernet speed in network.py
- Add amd venice intial cpuid to cpuid.py
- Add nvlink status check support script in checkbox support.
- Add raw uart loopback tests
- Add wwan test for lakeport
- Include the dragonwing tests for core 24 test plan
- Add qualcomm ai ml tests
- Add opencl property validation test case
- Add pure-python hdmi rx (input) test to checkbox-provider-ce-oem
- Expose a normalized chassis in the submission
- Add short test plans for opencl, vulkan, and level zero
- Make checkbox immune to the oom killer
- Disable watchdog around stress-ng automated tests
- Unify video codec structure with the camera naming concept
- Split reboot checks into individual sibling jobs, then split blocker and non-blocker fwts tests
- Add qualcomm cloud ai npu test
- Create oem provider and provider snap
Notable Bugfixes
- Generate a single launcher for manual, automated, and stress test plans
- Calculate average psnr from all frames
- Replace all lsb.xyz with os.xyz
- Use resource_wrapper.sh for tsn-device-ip-match
- Fix optee unittest
- Trim the test provider-ce-oem workflow
- Return exitcode 1 when tpm device is not available
- Stage xtest tas for a tee-supplicant started without a ta dir
- Add logic to bypass calling prime-select
- Fixed dragonwing camera tests
- Heavily simplify the usage of iiotg_tsn.py
- Fixed dragonwing soc filter
- Gate bluetooth-detect job on executables rather than packages
- Fix/xtest ta scope to snap
- Filter out “ps/2 generic mouse” input jobs
- Fixed dragonwing platform resource job
- Remove 26 based cross build
- Grant the execution permission for python scripts in bin folder
- Remove default environment from checkbox-ce-oem
- Fix tpm2 pcrbanks resource failure
- Avoid crashing on none time duration
- Remove “hash” when calling clevis-encrypt
- Revised pipeline for dragonwing video codec tests
- Wrap the resource job to preven any error be thrown
- Adjust the setup order for ov5640 camera
- Skip manual auto session
- Consolidate 26.04 power auto test plans and add amd_pmf
- Add wol test plan to 26.04 manual and update job dependencies
- Move ce-oem monitor test plan from auto to manual