Basically , what you did with your live usb, you have to do the same with your installation.
i.e swap in a 32 bit efi loader.
AFAIK, Debian 12 does this automatically,…
“… detect that the underlying UEFI firmware is 32-bit and will install the appropriate version of grub-efi…”
Apparently, Ubuntu doesn’t.