Hello all!
A new version of Checkbox is now available as a Debian package (in the Stable PPA ) and as Snaps (in the stable channel)!
In this release we bring you the new skip reasons, you will now be able to know at a glance (both in the UI and in reporting!) precisely why a job was skipped. This should make it trivial to distinguish skips which you may want to double check (manual skips, dependency skips etc.) from those that you can safely ignore (manifest skips).
Reminder: if you update Checkbox you will not be able to resume testing session that you begun before updating. If this is undesirable to you, consider pinning Checkbox and finishing all sessions that are ongoing with the following command:
# for snaps:
$ sudo snap refresh --hold=forever checkbox checkbox24
# for debs:
$ sudo apt-mark hold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base
Remember to eventually run the following to re-enable automatic updates:
# for snaps
$ sudo snap refresh --unhold checkbox checkbox24
# for debs
$ sudo apt-mark unhold checkbox-ng checkbox-provider-resource checkbox-provider-certification-client checkbox-provider-base
New in this release
- Update c3 api usage
- Pwm simple check
- Cover kernel crash reserved memory in memory/info
- Lxd image check now mirrors behaviour of kvm image check
- Add optee version to support 4.10
- Unit tests and minor fixes for network.py
- Add finish and exit option
- Pretty skip reason in ui and comments
- Hidden manifest entry for ignoring efi testing on the devices that does not have uefi
- Support genio imx258 and ov5640 cameras
- Remove long since deprecated canonical-certification-server launcher
- Add jetson-core test plans to ce-oem-iot-ubuntucore-22 plans
- Add ebbr testing via fwt
- Add socketcan interface presence check
- Baoshan new camera-ov5640
- Hidden manifest entry for machines running experimental jobs
- Add test plan pc-sanity-smoke-test-26-04
- Add project specific test plans into ce-oem
- [checkbox-ce-oem] migrate dragonwing (qcs/snapdragon) test coverage into ce oem
- Add panel backlight ramp monitor test
- Add usb hid wake-up test
- Migrate iiotg provider
- Ce-oem: add renesas-rz drp-ai unit definitions
- Migration jetson project provide to ce-oem
- Migrate genio platform into ce-oem
- Migration xilinx project provide to ce-oem
- Add opengl-cts
- Store resource jobs results in the results section of the json report
- Setup include requires manifest
- Add missing arl cpuid to cpuid.py
- Add(contrib): pc sanity plan without nesting cert-desktop-automated plan
- Split skip outcome into 4 possibilites
- Update cpuid.py with clearwater forest
- Added hidden manifest entry for cold/warm reboot loop tests
- Added clarification to see the groups that are used
- Stress-ng tests bugfixes fix user blacklist
- Core26 checkbox-ce-oem snapcraft.yaml
- Add hsm tests for nxp ele
Notable Bugfixes
- Revise ce oem build flow
- Also export resource results in junit
- Remove manifest in the resource jobs
- Update kernel_taint_test bit 2 message
- Skip windowing system check in 26.04
- More debuggable usageexpectation
- Fix cdrom not detected
- Add manifest support for suspend feature test jobs
- Make shebang rely on env to find python3 instead of hardcoded it
- Add group and order for manual test jobs
- Fixed unused manifest
- Add missing job for 24.04 manual test plan
- Also run setup jobs via run
- Force refresh snapcraft before uploading
- Backward compatible resource-results getter
- Add missing environ
- Clean and bugfix session reset
- Fix pipewire source/sink change detection
- Add missing wording for ce-oem uc20 manual plan
- Add environ section for jobs which use env in test commands
- Read wifi ap info from file if available and group those jobs
- No longer crash if setup jobs fail in local
- Add usb_wakeup_hid to after-suspend manual plan
- Update touchscreen manual test ordering with group
- Fix dependencyduplicateerror during light_sensor_resource when multiple als devices are present
- Fix ptp verify job for ethtool v6.19+
- Revise thermal zone identity and validation
- Added more logging for usb tests
- Update gpu passthrough tests
- Maas check will pass as long as maas is used, regardless of version capture
- Ensure all
bmc_devices are recognized as bmc_network - Use before for jobs that have siblings after suspend
- Fix randr_test.py cannot work on suspend unsupport devices
- Update docking test description
- Merge (flag) siblings creation with normal sibling creation
- Remove python3.5-3.6 check for ce-oem provider
- Don’t assume a non-empty string means nvlink is supported
- Add scan parameters to beacontool
- Ignore gnome-screenshot errors
- Fix: add validations to suspend_trigger
- Add rack mount chassis as non-portable server type
- Avoid re-connecting every ctrl+c
- Change to use new light sensor test cases for 26.04
- Remove 5mp resolution for ov5645
- Fix clocktest false failure on high cpu count systems
- Fix supported_resolutions loop in camera_test.py
- Revised cpufreq scaling test
- Ignore non existing paths in path
- Fixed weird text output
- Add logic for docker resource job to assign the correct command
- Memory issue igpu
- Make graphics render check more flexible
- Retry snap revision info stderr
- Fix sysfs tpm resource
- Miscellanea/screen-pkg-not-public failed on 2604
- Move custom frontend and load all for all jobs
- Translate executable resource to python
- Reset job and category list when _populate_session_state() is called inside mergereports
- Fix bug in the environment resource
- Filter unopenable devpath-derived disk resources
- Use existing job result if session resumed after all jobs have run
- Fix(contrib): libopenscap8 removed from plainbox-provider-pc-sanity
- Remove type hints from ce-oem gst_resources_generator.py
- Fixed the dependency issue of openscap-scanner
- Better snap_test.py logging
- Check if the custom_frontend is non-empty