Proxmox PCIe Passthrough

Intel CPU

Edit grub

nano /etc/default/grub

Change this: GRUB_CMDLINE_LINUX_DEFAULT=”quiet”

To this: GRUB_CMDLINE_LINUX_DEFAULT=”quiet intel_iommu=on”

 

Add required kernel modules

nano /etc/modules
vfio
vfio_iommu_type1
vfio_pci
vfio_virqfd

 

IOMMU interrupt remapping

1) Run the “dmesg | grep ecap” command.

2) On the IOMMU lines, the hexadecimal value after “ecap” indicates whether interrupt remapping is supported. If the last character of this value is an 8, 9, a, b, c, d, e, or an f, interrupt remapping is supported. For example, “ecap 1000” indicates there is no interrupt remapping support. “ecap 10207f” indicates interrupt remapping support, as the last character is an “f”.

Interrupt remapping will only be enabled if every IOMMU supports it.

If your system doesn’t support interrupt remapping, you can allow unsafe interrupts with:

echo "options vfio_iommu_type1 allow_unsafe_interrupts=1" > /etc/modprobe.d/iommu_unsafe_interrupts.conf

 

Verify IOMMU isolation

To have pci passthrough working fine, you need dedicated iommu group for your pci devices. You should have something like this:

find /sys/kernel/iommu_groups/ -type l
/sys/kernel/iommu_groups/0/devices/0000:00:00.0
/sys/kernel/iommu_groups/1/devices/0000:00:01.0
/sys/kernel/iommu_groups/1/devices/0000:01:00.0
/sys/kernel/iommu_groups/1/devices/0000:01:00.1
/sys/kernel/iommu_groups/2/devices/0000:00:02.0
/sys/kernel/iommu_groups/3/devices/0000:00:16.0
/sys/kernel/iommu_groups/4/devices/0000:00:1a.0
/sys/kernel/iommu_groups/5/devices/0000:00:1b.0
/sys/kernel/iommu_groups/6/devices/0000:00:1c.0
/sys/kernel/iommu_groups/7/devices/0000:00:1c.5
/sys/kernel/iommu_groups/8/devices/0000:00:1c.6
/sys/kernel/iommu_groups/9/devices/0000:00:1c.7
/sys/kernel/iommu_groups/9/devices/0000:05:00.0
/sys/kernel/iommu_groups/10/devices/0000:00:1d.0
/sys/kernel/iommu_groups/11/devices/0000:00:1f.0
/sys/kernel/iommu_groups/11/devices/0000:00:1f.2
/sys/kernel/iommu_groups/11/devices/0000:00:1f.3
/sys/kernel/iommu_groups/12/devices/0000:02:00.0
/sys/kernel/iommu_groups/12/devices/0000:02:00.1
/sys/kernel/iommu_groups/13/devices/0000:03:00.0
/sys/kernel/iommu_groups/14/devices/0000:04:00.0

 

Determine your PCI card address, and configure your VM

Locate your card using “lspci”.  The address should be in the form of: 01:00.0

Manually edit the node.conf file.  It can be located at: /etc/pve/qemu-server/vmid.conf.

Add this line to the end of the file:

hostpci0: 01:00.0

 

Leave a Reply

Your email address will not be published. Required fields are marked *