Auto upgraded from 5.11 to 5.18, can't run any more

LXD Support
1

auto upgraded from 5.11 to 5.11, and now getting following error:
Error: Get “http://unix.socket/1.0”: EOF

sudo cat /var/snap/lxd/common/lxd/logs/lxd.log
time=“2023-09-27T21:43:47+08:00” level=warning msg=" - Couldn’t find the CGroup memory swap accounting, swap limits will be ignored"
time=“2023-09-27T21:43:47+08:00” level=warning msg=“Instance type not operational” driver=qemu err=“KVM support is missing (no /dev/kvm)” type=virtual-machine
time=“2023-09-27T21:43:48+08:00” level=error msg=“Failed loading storage pool” err=“Required tool ‘zpool’ is missing” pool=default
time=“2023-09-27T21:43:48+08:00” level=error msg=“Failed to start the daemon” err=“Failed applying patch “storage_delete_old_snapshot_records”: Failed loading storage pool “default”: Required tool ‘zpool’ is missing”

I installed zpool, but still same error, my environment is Linux Mint 19.3 Tricia

how to proceed? if I can’t run lxd, is there a way to access the contents of the lxd instance? thanks.

2

Are you running with the snap package?

Also what is the output of uname -a on your system?

I suspect the issue is that you dont have the zfs kernel module loaded on your system.

What does lsmod | grep zfs and modinfo zfs | grep version show?

3

uname -a

4.15.0-132-generic #136-Ubuntu SMP Tue Jan 12 14:58:42 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

lsmod | grep zfs

zfs 3411968 3
zunicode 331776 1 zfs
zavl 16384 1 zfs
icp 253952 1 zfs
zcommon 69632 1 zfs
znvpair 77824 2 zfs,zcommon
spl 106496 4 zfs,icp,znvpair,zcommon

modinfo zfs | grep version:

version: 0.7.5-1ubuntu16.10
srcversion: 67FB53EEE2E7A895E7E0074

4

Ah there’s the issue. You need to be running >=ZFS 0.8.

As LXD 5.12 and onwards changed the minimum version, see https://discuss.linuxcontainers.org/t/lxd-5-12-zfs-stopped-working-in-lxd-error-required-tool-zpool-is-missing-when-kernel-zfs-module-version-0-8/16753

5

since lxd is not running in my computer I can’t do an export of instances, is there a way I can copy them to another pc so that I can install the 5.18 lxd? if I do a zpool status now , got:

no pools available

6

Can you upgrade ZFS?

7

just check: apt list --upgradable
do not find zfs in the list

8

Do you have any recent backups of your system?

9

Do you know how that occurred, if your system was auto upgrading you would have upgraded to each LXD release each month, it sounds like something was preventing the upgrade that changed?

10

Ah just seen your post on https://discuss.linuxcontainers.org/t/lxd-5-12-zfs-stopped-working-in-lxd-error-required-tool-zpool-is-missing-when-kernel-zfs-module-version-0-8/16753/13?u=tomp from March 22nd 2023.

Did you try a snap revert now?

11

I did: lxc start fb15 everyday, from time to time I’ll encounter this error and immediately I will do a snap revert lxd.

however in the last seven days, I did not lxc start, maybe the 5.18 got installed. when I do a snap revert now, it says: no revision to revert to.

I did: sudo ls -lsah /var/snap/lxd/common/lxd/storage-pools/default/containers/fb15

the folder is there, but empty content, it might need to be mounted, so i installed zpool, but it shows ‘no pool available’

12

looks like better mount a folder in the host to lxd container as data so that when things like this happen, at least data is safe, now got no way to retrieve.

13

Can you see the ZFS disk image file in /var/snap/lxd/common/lxd/disks/<pool_name>.img?

The instances will be inside there.

You should be able to import the pool manually using:

zpool import -f -d  /var/snap/lxd/common/lxd/disks/<pool_name>.img <pool_name>
14

upgraded kernel version to 5.4.0-150-generic and lxd is working again, thanks

1 Like