Ask us anything about Ubuntu Kernels!

Please open a bug on LP against the kernel and we’ll take it from there: https://bugs.launchpad.net/ubuntu/+source/linux/+filebug

Sorry to point this here but Bug #2033735 “No HDMI in Nvidia on-demand mode” : Bugs : linux package : Ubuntu .

Quite unusual since we already are in a (nearly) stable state of Mantic’s kernel and this bug is quite annoying too. It’s odd that I’m the only one subscribing this bug, so maybe I missed something or this bug is hardware-related.

Well, help! :slight_smile:

I recently found this guide https://wiki.ubuntu.com/Kernel/Dev/KernelModuleRebuild that does exactly what I wanted but it doesn’t give the exact module symvers of the original module. Do you happen to know anything that looks like this but will work on the Jammy kernel?

Well, I just followed the guide here https://docs.kernel.org/kbuild/modules.html , simply copied out the specific .c and .h files for the kernel module from the kernel source, build it like a out-of-tree module, and I am able to build a working kernel module that has correct symvers and loads fine, what a surprise.

1 Like

What’s the right repository to add to get the debug symbols of the kernels published under ESM.

http://ddebs.ubuntu.com/ only includes debug symbols for kernels released outside of ESM.
https://esm.ubuntu.com/infra/ubuntu/dists/ includes the packages of the newer kernels (e.g., 4.15.0-216-generic under bionic) but the package lists in that repo don’t contain the debug symbols packages.

By default pro attach ${TOKEN} doesn’t add the debug symbols repository so I am at a loss on where to find them.

So I recently decided to jump ship to Ubuntu 23.10 beta just because of the fact that it has a kernel 6.5 kernel that helps my issues with Starfield not launching (would’ve just gone the PPA route, but it’s close enough to 23.10’s launch date I figured I’ll just jump ship
https://github.com/ValveSoftware/Proton/issues/7064#issuecomment-1745438028

Are there plans on working with Valve and the community working on Proton/Linux gaming to improve the latest supported kernels in Ubuntu to make sure that it works amazing with the latest games without needing to install PPAs? Or adding newer kernels without waiting for a new release, like Pop!_OS? IIRC, I remember the reason why this was never done is because of all the patches you do on Ubuntu, but I think it’s time to revisit that.

Newer kernels tend to resolve a lot of the issues Linux games experience, unless you’re Valve who customized the kernel for gaming purposes.

I debated on posting it here instead, but I figured since the update to the latest kernel solved my problems, I figure I’ll do it here.

Which release version did you choose to do the jump from?

For example, Jammy already has one kernel flavour available on x86 based off 6.5 and soon other flavours will be available too, like the hwe-22.04-edge and cloud kernel edge. Kernel team is currently focusing on resolving last minute regressions in the v6.5 kernel to ensure successful launch of 23.10. Once that is out the door, we will start rolling out more backports.

Unfortunately these are not currently trivially available, please contact Canonical support and they can share those with you on request.

This is largely due to lack of reprepro support for .ddeb files; and I have a plan to re-engineer ESM publishing to auto-rename .ddeb to .deb and publish it correctly. Separately Server team is working on making ESM .ddeb to be available in the dbgsymbols server.

1 Like

Does this mean Canonical support would only be able to provide them for specific kernels so I can’t automate their download whenever a new kernel is published?

For context, I use the debug symbols to properly support eBPF programs that use BTF. For this I have been able to use the debug symbols of the kernel packages to create a BTF file for specific kernel versions.

I’ve sent a message through the Ubuntu website, I hope that’s what you meant by “Canonical support”.

you don’t need debug symbols to use eBPF, because eBPF support is compiled into all of our kernels and should be available to be usable as is, without debug symbols. We had toolchains issues in the past that prevented that but it is expected for eBPF to “just work” without debug symbols. Can you please check if that is the case on i.e. jammy 22.04, and if it is not the case on the ESM kernels, please use ubuntu-bug linux and contact support to escalate fixing that. Or paste the bug number here.

It is expected for eBPF to work on Ubuntu without installing debug symbols.

edit: basically debug symbols are a huge download and ebpf information is tiny, and should be available from normal debs, sans bugs. Also a working example of the things you do with eBPF would be useful, as we can also add this to our certification test suite to ensure it always works and doesn’t regress again.

I may not have been super clear. eBPF is enabled and supported in the kernel, I am trying to create a BTF file so that eBPF programs written with CO-RE in mind can be used instead of only programs that are built specifically only for this kernel. In newer kernels a BTF file exists under /sys/kernel/btf/vmlinux and it is used by BPF loaders to relocate fields that the BPF programs use so that the program can be written once for any kernels and loaded anywhere even if the fields move because the loader will know where the field is at load time for the currently running kernel by using the vmlinux file.

In older kernels (such as 4.15.x) this BTF file does not exist so it needs to be created manually and given to the loader. BTF files can be created using debug symbols of that kernel and pahole once and then used on any machine with that same kernel. That is my goal. This has been working for 4.15.x kernels in Ubuntu 18 until it hit the ESM period because now newer kernels are not published without a license. I signed up for a PRO license so I can still have access to these kernels (that works) but pahole needs the debug symbols when creating the BTF file.

yes, but ideally we don’t want anybody running pahole manually, and we can and should run it during build and ship the relevant btf file with linux-image package straight away. This is a way too common requirement that shouldn’t need everyone to go through dbg package gymnastics.

It’d definitely be ideal if the BTF file was already in the linux image package. It looks like getting a support ticket requires using the paid PRO license, I only have the free PRO license since I only need one machine to create the BTF file so there isn’t a way for me to get the debug symbols packages. I’ll find another way to support running CO-RE ebpf programs in these kernels.

Thanks for the replies, at least now I know my google-fu wasn’t failing me when trying to find a repo for these ESM debug kernel packages.

1 Like

A public ubuntu-bug linux should work too. if you open one asking for BTF for ESM kernels i can escalate it from there. Or use https://bugs.launchpad.net/ubuntu/+source/linux/+filebug/?no-redirect

I came from 23.04.

You’re saying 22.04 already has 6.5 via edge kernel?

Edit: never mind

I’ve created the issue here: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2038685.

Let me know if more information is needed and I can add it. Thanks!

1 Like

What’s this new “linux-laptop” kernel?

That’s the new arm64 laptop kernel. Currently only supports Lenovo X13s.

See https://launchpad.net/~ubuntu-concept/+archive/ubuntu/x13s for more information. All the relevant packages from the Concept PPA will/should show up in Mantic, so there is no need to use that PPA with Mantic.

1 Like

Is Index of /mainline still being maintained? It’s usually updated within days of a kernel release, but as of today, the last update was almost a month ago.

1 Like

@timur-tabi FYI Mainline Kernel update