You don't have to store the vhd file on the ventoy device. You can keep it on an internal partition and boot from that. After that, the ventoy drive doesn't have to stay plugged in