Hey!
One option is to passthrough the USB port. This is easy to do with libvirt in Linux, as described here. Then, using the libvirt interface (I’d personally use virt-manager) pass the USB port directly to the instance.
On the other hand, you will lose access to the USB adapter on the host; I’m not sure if this is what you intend.
HTH!