Forums

Home / Forums

You need to log in to create posts and topics. Login · Register

OSD crashed and restarted

Pages: 1 2 3 4

BonsaiJoe
53 Posts
May 15, 2018, 10:59 am

root@node03:~# ethtool -i eth3
driver: i40e
version: 1.6.27-k
firmware-version: 5.05 0x80002a9b 1.1313.0
expansion-rom-version:
bus-info: 0000:17:00.1
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: yes
root@node03:~# dmesg | grep firmware
[    1.917413] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.

 

root@node03:~# lspci -v
00:00.0 Host bridge: Intel Corporation Device 2020 (rev 04)
Subsystem: Super Micro Computer Inc Device 0953
Flags: fast devsel
Capabilities: [90] Express Root Port (Slot-), MSI 00
Capabilities: [e0] Power Management version 3
Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
Capabilities: [250] #19
Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

00:04.0 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 300
Memory at 383ffff2c000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.1 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 302
Memory at 383ffff28000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.2 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 300
Memory at 383ffff24000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.3 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 302
Memory at 383ffff20000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.4 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 300
Memory at 383ffff1c000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.5 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 302
Memory at 383ffff18000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.6 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 300
Memory at 383ffff14000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:04.7 System peripheral: Intel Corporation Sky Lake-E CBDMA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CBDMA Registers
Flags: bus master, fast devsel, latency 0, IRQ 302
Memory at 383ffff10000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [80] MSI-X: Enable+ Count=1 Masked-
Capabilities: [90] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3
Kernel driver in use: ioatdma
Kernel modules: ioatdma

00:05.0 System peripheral: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.2 System peripheral: Intel Corporation Device 2025 (rev 04)
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.4 PIC: Intel Corporation Device 2026 (rev 04) (prog-if 20 [IO(X)-APIC])
Subsystem: Intel Corporation Device 2026
Flags: bus master, fast devsel, latency 0
Memory at aa20a000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3

00:08.0 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E Ubox Registers
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:08.1 Performance counters: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E Ubox Registers
Flags: fast devsel

00:08.2 System peripheral: Intel Corporation Sky Lake-E Ubox Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E Ubox Registers
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:11.0 Unassigned class [ff00]: Intel Corporation Device a1ec (rev 08)
Subsystem: Super Micro Computer Inc Device 0953
Flags: bus master, fast devsel, latency 0
Capabilities: [80] Power Management version 3

00:11.1 Unassigned class [ff00]: Intel Corporation Device a1ed (rev 08)
Subsystem: Super Micro Computer Inc Device 0953
Flags: bus master, fast devsel, latency 0
Capabilities: [80] Power Management version 3

00:11.5 SATA controller: Intel Corporation Lewisburg SSATA Controller [AHCI mode] (rev 08) (prog-if 01 [AHCI 1.0])
Subsystem: Super Micro Computer Inc Lewisburg SSATA Controller [AHCI mode]
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 34
Memory at aa206000 (32-bit, non-prefetchable) [size=8K]
Memory at aa209000 (32-bit, non-prefetchable) [size=256]
I/O ports at 3070 [size=8]
I/O ports at 3060 [size=4]
I/O ports at 3020 [size=32]
Memory at aa180000 (32-bit, non-prefetchable) [size=512K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Kernel driver in use: ahci
Kernel modules: ahci

00:14.0 USB controller: Intel Corporation Lewisburg USB 3.0 xHCI Controller (rev 08) (prog-if 30 [XHCI])
Subsystem: Super Micro Computer Inc Lewisburg USB 3.0 xHCI Controller
Flags: bus master, medium devsel, latency 0, IRQ 32
Memory at 383ffff00000 (64-bit, non-prefetchable) [size=64K]
Capabilities: [70] Power Management version 2
Capabilities: [80] MSI: Enable+ Count=1/8 Maskable- 64bit+
Kernel driver in use: xhci_hcd
Kernel modules: xhci_pci

00:14.2 Signal processing controller: Intel Corporation Device a1b1 (rev 08)
Subsystem: Super Micro Computer Inc Device 0953
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at 383ffff33000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-

00:16.0 Communication controller: Intel Corporation Lewisburg CSME: HECI #1 (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg CSME: HECI
Flags: bus master, fast devsel, latency 0, IRQ 308
Memory at 383ffff32000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable+ Count=1/1 Maskable- 64bit+
Kernel driver in use: mei_me
Kernel modules: mei_me

00:16.1 Communication controller: Intel Corporation Lewisburg CSME: HECI #2 (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg CSME: HECI
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at 383ffff31000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:16.4 Communication controller: Intel Corporation Lewisburg CSME: HECI #3 (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg CSME: HECI
Flags: bus master, fast devsel, latency 0, IRQ 11
Memory at 383ffff30000 (64-bit, non-prefetchable) [size=4K]
Capabilities: [50] Power Management version 3
Capabilities: [8c] MSI: Enable- Count=1/1 Maskable- 64bit+

00:17.0 SATA controller: Intel Corporation Lewisburg SATA Controller [AHCI mode] (rev 08) (prog-if 01 [AHCI 1.0])
Subsystem: Super Micro Computer Inc Lewisburg SATA Controller [AHCI mode]
Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 40
Memory at aa204000 (32-bit, non-prefetchable) [size=8K]
Memory at aa208000 (32-bit, non-prefetchable) [size=256]
I/O ports at 3050 [size=8]
I/O ports at 3040 [size=4]
I/O ports at 3000 [size=32]
Memory at aa100000 (32-bit, non-prefetchable) [size=512K]
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [70] Power Management version 3
Capabilities: [a8] SATA HBA v1.0
Kernel driver in use: ahci
Kernel modules: ahci

00:1c.0 PCI bridge: Intel Corporation Lewisburg PCI Express Root Port #1 (rev f8) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 24
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 00001000-00001fff
Memory behind bridge: 90000000-901fffff
Prefetchable memory behind bridge: 0000380000000000-00003800001fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Super Micro Computer Inc Lewisburg PCI Express Root Port
Capabilities: [a0] Power Management version 3
Kernel driver in use: pcieport
Kernel modules: shpchp

00:1c.5 PCI bridge: Intel Corporation Lewisburg PCI Express Root Port #6 (rev f8) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 25
Bus: primary=00, secondary=02, subordinate=03, sec-latency=0
I/O behind bridge: 00002000-00002fff
Memory behind bridge: a9000000-aa0fffff
Capabilities: [40] Express Root Port (Slot+), MSI 00
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Super Micro Computer Inc Lewisburg PCI Express Root Port
Capabilities: [a0] Power Management version 3
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Access Control Services
Capabilities: [220] #19
Kernel driver in use: pcieport
Kernel modules: shpchp

00:1f.0 ISA bridge: Intel Corporation Lewisburg LPC Controller (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg LPC Controller
Flags: bus master, fast devsel, latency 0
Kernel modules: lpc_ich

00:1f.2 Memory controller: Intel Corporation Lewisburg PMC (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg PMC
Flags: bus master, fast devsel, latency 0
Memory at aa200000 (32-bit, non-prefetchable) [size=16K]

00:1f.4 SMBus: Intel Corporation Lewisburg SMBus (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg SMBus
Flags: medium devsel
Memory at 380000200000 (64-bit, non-prefetchable) [disabled] [size=256]
I/O ports at 0780 [size=32]
Kernel modules: i2c_i801

00:1f.5 Serial bus controller [0c80]: Intel Corporation Lewisburg SPI Controller (rev 08)
Subsystem: Super Micro Computer Inc Lewisburg SPI Controller
Flags: fast devsel
Memory at fe010000 (32-bit, non-prefetchable) [size=4K]

02:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 04) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 17
Bus: primary=02, secondary=03, subordinate=03, sec-latency=32
I/O behind bridge: 00002000-00002fff
Memory behind bridge: a9000000-aa0fffff
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [78] Power Management version 3
Capabilities: [80] Express PCI-Express to PCI/PCI-X Bridge, MSI 00
Capabilities: [c0] Subsystem: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge
Capabilities: [100] Virtual Channel
Capabilities: [800] Advanced Error Reporting
Kernel modules: shpchp

03:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) (prog-if 00 [VGA controller])
DeviceName: ASPEED Video AST2500
Subsystem: Super Micro Computer Inc ASPEED Graphics Family
Flags: bus master, medium devsel, latency 0, IRQ 17
Memory at a9000000 (32-bit, non-prefetchable) [size=16M]
Memory at aa000000 (32-bit, non-prefetchable) [size=128K]
I/O ports at 2000 [size=128]
Expansion ROM at <unassigned> [disabled]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/2 Maskable- 64bit+
Kernel driver in use: ast
Kernel modules: ast

16:00.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port 1A (rev 04) (prog-if 00 [Normal decode])
Physical Slot: 1
Flags: bus master, fast devsel, latency 0, IRQ 27
Bus: primary=16, secondary=17, subordinate=17, sec-latency=0
Memory behind bridge: c5d00000-c5efffff
Prefetchable memory behind bridge: 00000000c3800000-00000000c58fffff
Capabilities: [40] Subsystem: Super Micro Computer Inc Sky Lake-E PCI Express Root Port 1A
Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
Capabilities: [90] Express Root Port (Slot+), MSI 00
Capabilities: [e0] Power Management version 3
Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
Capabilities: [110] Access Control Services
Capabilities: [148] Advanced Error Reporting
Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
Capabilities: [250] #19
Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp

16:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port 1C (rev 04) (prog-if 00 [Normal decode])
Physical Slot: 0
Flags: bus master, fast devsel, latency 0, IRQ 28
Bus: primary=16, secondary=18, subordinate=1a, sec-latency=0
Memory behind bridge: c5a00000-c5cfffff
Prefetchable memory behind bridge: 00000000c1000000-00000000c30fffff
Capabilities: [40] Subsystem: Super Micro Computer Inc Sky Lake-E PCI Express Root Port 1C
Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
Capabilities: [90] Express Root Port (Slot+), MSI 00
Capabilities: [e0] Power Management version 3
Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
Capabilities: [110] Access Control Services
Capabilities: [148] Advanced Error Reporting
Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
Capabilities: [250] #19
Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp

16:05.0 System peripheral: Intel Corporation Device 2034 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

16:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

16:05.4 PIC: Intel Corporation Device 2036 (rev 04) (prog-if 20 [IO(X)-APIC])
Subsystem: Intel Corporation Device 2036
Flags: bus master, fast devsel, latency 0
Memory at c5f00000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3

16:08.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:08.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:09.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0a.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0a.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0e.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.4 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.5 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.6 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:0f.7 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:10.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:10.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:1d.0 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:1d.1 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:1d.2 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:1d.3 System peripheral: Intel Corporation Sky Lake-E CHA Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E CHA Registers
Flags: fast devsel

16:1e.0 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.1 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.2 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.3 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.4 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.5 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

16:1e.6 System peripheral: Intel Corporation Sky Lake-E PCU Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E PCU Registers
Flags: fast devsel

17:00.0 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 02)
Subsystem: Super Micro Computer Inc Ethernet Controller X710 for 10GbE SFP+
Flags: bus master, fast devsel, latency 0, IRQ 33
Memory at c5000000 (64-bit, prefetchable) [size=8M]
Memory at c5818000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5e80000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 30-a6-2d-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Capabilities: [1d0] #19
Kernel driver in use: i40e
Kernel modules: i40e

17:00.1 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 02)
Subsystem: Super Micro Computer Inc Ethernet Controller X710 for 10GbE SFP+
Flags: bus master, fast devsel, latency 0, IRQ 33
Memory at c4800000 (64-bit, prefetchable) [size=8M]
Memory at c5810000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5e00000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 30-a6-2d-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Kernel driver in use: i40e
Kernel modules: i40e

17:00.2 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 02)
Subsystem: Super Micro Computer Inc Ethernet Controller X710 for 10GbE SFP+
Flags: bus master, fast devsel, latency 0, IRQ 33
Memory at c4000000 (64-bit, prefetchable) [size=8M]
Memory at c5808000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5d80000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 30-a6-2d-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Kernel driver in use: i40e
Kernel modules: i40e

17:00.3 Ethernet controller: Intel Corporation Ethernet Controller X710 for 10GbE SFP+ (rev 02)
Subsystem: Super Micro Computer Inc Ethernet Controller X710 for 10GbE SFP+
Flags: bus master, fast devsel, latency 0, IRQ 33
Memory at c3800000 (64-bit, prefetchable) [size=8M]
Memory at c5800000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5d00000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 30-a6-2d-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Kernel driver in use: i40e
Kernel modules: i40e

18:00.0 PCI bridge: Intel Corporation Device 37c0 (rev 08) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 29
Memory at c5c00000 (64-bit, non-prefetchable) [size=128K]
Bus: primary=18, secondary=19, subordinate=1a, sec-latency=0
Memory behind bridge: c5b00000-c5bfffff
Prefetchable memory behind bridge: 00000000c1000000-00000000c30fffff
Expansion ROM at c5a00000 [disabled] [size=1M]
Capabilities: [40] Express Upstream Port, MSI 00
Capabilities: [80] Power Management version 3
Capabilities: [88] Subsystem: Device beef:dead
Capabilities: [100] Advanced Error Reporting
Capabilities: [200] #19
Kernel driver in use: pcieport
Kernel modules: shpchp

19:03.0 PCI bridge: Intel Corporation Device 37c5 (rev 08) (prog-if 00 [Normal decode])
Flags: bus master, fast devsel, latency 0, IRQ 29
Bus: primary=19, secondary=1a, subordinate=1a, sec-latency=0
Memory behind bridge: c5b00000-c5bfffff
Prefetchable memory behind bridge: 00000000c1000000-00000000c30fffff
Capabilities: [40] Express Downstream Port (Slot-), MSI 00
Capabilities: [80] Power Management version 3
Capabilities: [88] Subsystem: Device beef:dead
Capabilities: [100] Advanced Error Reporting
Capabilities: [138] Access Control Services
Kernel driver in use: pcieport
Kernel modules: shpchp

1a:00.0 Ethernet controller: Intel Corporation Device 37d2 (rev 08)
DeviceName: Intel LAN X557-AT2 #1
Subsystem: Super Micro Computer Inc Device 37d2
Flags: bus master, fast devsel, latency 0, IRQ 181
Memory at c2000000 (64-bit, prefetchable) [size=16M]
Memory at c3008000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5b80000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 34-c3-0a-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Kernel driver in use: i40e
Kernel modules: i40e

1a:00.1 Ethernet controller: Intel Corporation Device 37d2 (rev 08)
DeviceName: Intel LAN X557-AT2 #2
Subsystem: Super Micro Computer Inc Device 37d2
Flags: bus master, fast devsel, latency 0, IRQ 181
Memory at c1000000 (64-bit, prefetchable) [size=16M]
Memory at c3000000 (64-bit, prefetchable) [size=32K]
Expansion ROM at c5b00000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [70] MSI-X: Enable+ Count=129 Masked-
Capabilities: [a0] Express Endpoint, MSI 00
Capabilities: [e0] Vital Product Data
Capabilities: [100] Advanced Error Reporting
Capabilities: [140] Device Serial Number 34-c3-0a-ff-ff-6b-1f-ac
Capabilities: [150] Alternative Routing-ID Interpretation (ARI)
Capabilities: [160] Single Root I/O Virtualization (SR-IOV)
Capabilities: [1a0] Transaction Processing Hints
Capabilities: [1b0] Access Control Services
Kernel driver in use: i40e
Kernel modules: i40e

64:05.0 System peripheral: Intel Corporation Device 2034 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:05.4 PIC: Intel Corporation Device 2036 (rev 04) (prog-if 20 [IO(X)-APIC])
Subsystem: Intel Corporation Device 2036
Flags: bus master, fast devsel, latency 0
Memory at e0f00000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3

64:08.0 System peripheral: Intel Corporation Device 2066 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:09.0 System peripheral: Intel Corporation Device 2066 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0a.0 System peripheral: Intel Corporation Device 2040 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0a.1 System peripheral: Intel Corporation Device 2041 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0a.2 System peripheral: Intel Corporation Device 2042 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0a.3 System peripheral: Intel Corporation Device 2043 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0a.4 System peripheral: Intel Corporation Device 2044 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0a.5 System peripheral: Intel Corporation Device 2045 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0a.6 System peripheral: Intel Corporation Device 2046 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0a.7 System peripheral: Intel Corporation Device 2047 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0b.0 System peripheral: Intel Corporation Device 2048 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0b.1 System peripheral: Intel Corporation Device 2049 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0b.2 System peripheral: Intel Corporation Device 204a (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0b.3 System peripheral: Intel Corporation Device 204b (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.0 System peripheral: Intel Corporation Device 2040 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.1 System peripheral: Intel Corporation Device 2041 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.2 System peripheral: Intel Corporation Device 2042 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0c.3 System peripheral: Intel Corporation Device 2043 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.4 System peripheral: Intel Corporation Device 2044 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.5 System peripheral: Intel Corporation Device 2045 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0c.6 System peripheral: Intel Corporation Device 2046 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0c.7 System peripheral: Intel Corporation Device 2047 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0d.0 System peripheral: Intel Corporation Device 2048 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0d.1 System peripheral: Intel Corporation Device 2049 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

64:0d.2 System peripheral: Intel Corporation Device 204a (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

64:0d.3 System peripheral: Intel Corporation Device 204b (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b2:02.0 PCI bridge: Intel Corporation Sky Lake-E PCI Express Root Port 1C (rev 04) (prog-if 00 [Normal decode])
Physical Slot: 2
Flags: bus master, fast devsel, latency 0, IRQ 31
Bus: primary=b2, secondary=b3, subordinate=b3, sec-latency=0
I/O behind bridge: 0000f000-0000ffff
Memory behind bridge: fbc00000-fbefffff
Capabilities: [40] Subsystem: Super Micro Computer Inc Sky Lake-E PCI Express Root Port 1C
Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
Capabilities: [90] Express Root Port (Slot+), MSI 00
Capabilities: [e0] Power Management version 3
Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
Capabilities: [110] Access Control Services
Capabilities: [148] Advanced Error Reporting
Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
Capabilities: [250] #19
Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
Kernel driver in use: pcieport
Kernel modules: shpchp

b2:05.0 System peripheral: Intel Corporation Device 2034 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b2:05.2 System peripheral: Intel Corporation Sky Lake-E RAS Configuration Registers (rev 04)
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

b2:05.4 PIC: Intel Corporation Device 2036 (rev 04) (prog-if 20 [IO(X)-APIC])
Subsystem: Intel Corporation Device 2036
Flags: bus master, fast devsel, latency 0
Memory at fbf00000 (32-bit, non-prefetchable) [size=4K]
Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [e0] Power Management version 3

b2:0e.0 Performance counters: Intel Corporation Device 2058 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

b2:0e.1 System peripheral: Intel Corporation Device 2059 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

b2:0f.0 Performance counters: Intel Corporation Device 2058 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

b2:0f.1 System peripheral: Intel Corporation Device 2059 (rev 04)
Subsystem: Intel Corporation Device 0000
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Capabilities: [100] Vendor Specific Information: ID=0001 Rev=0 Len=0f0 <?>

b2:12.0 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers
Flags: fast devsel
Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
Kernel driver in use: skx_uncore

b2:12.1 Performance counters: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers
Flags: fast devsel
Kernel driver in use: skx_uncore

b2:12.2 System peripheral: Intel Corporation Sky Lake-E M3KTI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M3KTI Registers
Flags: fast devsel

b2:15.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers
Flags: fast devsel

b2:16.0 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers
Flags: fast devsel

b2:16.4 System peripheral: Intel Corporation Sky Lake-E M2PCI Registers (rev 04)
Subsystem: Intel Corporation Sky Lake-E M2PCI Registers
Flags: fast devsel

b3:00.0 RAID bus controller: Areca Technology Corp. ARC-188x series PCIe 2.0/3.0 to SAS/SATA 6/12Gb RAID Controller (rev 02)
Subsystem: Areca Technology Corp. ARC-1883 8/12/16/24 Port PCIe 3.0 to SAS/SATA 12Gb RAID Controller
Flags: bus master, fast devsel, latency 0, IRQ 35
I/O ports at f000 [size=256]
Memory at fbe00000 (64-bit, non-prefetchable) [size=64K]
Memory at fbd00000 (64-bit, non-prefetchable) [size=1M]
Expansion ROM at fbc00000 [disabled] [size=1M]
Capabilities: [50] Power Management version 3
Capabilities: [68] Express Endpoint, MSI 00
Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
Capabilities: [c0] MSI-X: Enable+ Count=16 Masked-
Capabilities: [100] Advanced Error Reporting
Capabilities: [1e0] #19
Capabilities: [1c0] Power Budgeting <?>
Capabilities: [190] #16
Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
Kernel driver in use: arcmsr
Kernel modules: arcmsr

#11

admin
2,930 Posts
May 15, 2018, 2:45 pm

Can you try using latest firmware

https://downloadcenter.intel.com/product/82947/Intel-Ethernet-Controller-X710-Series

 

#12

BonsaiJoe
53 Posts
July 9, 2018, 11:56 am

do you have the updated kernel with the Intel nic i40g Driver Version: 2.4.10 ready?
https://downloadcenter.intel.com/download/24411/Intel-Network-Adapter-Driver-for-PCIe-40-Gigabit-Ethernet-Network-Connections-Under-Linux-?product=75021

last night we had again a Network Card reset on the master node. (TX driver issue detected, PF reset issued)

at 5am node3 (master node) went down but this time the OSD´s on the host did not come back after some seconds  and the ISCSI Network on all nodes was not reachable for approx 20 minutes
cause of this all VMware hosts lost the ISCSI Connection (also all paths on the other not affected nodes went down)  in VMware the whole petasan cluster was not accessible for  20 minutes and cause of this  over 40 VM´s crashed (most Linux Server) and we had a lot of work to get everything back to normal.

after rebooting the node3 also the 20 OSD's came back.

any idea why the ISCSI was not responding for 20 minutes ?

thanks for your help,

#13

admin
2,930 Posts
July 9, 2018, 1:32 pm

We do offer commercial support, if you do require it we can send you the support plans we have, it will allow us to look in more detail.

The latest kernel we have is 4.4.126, you can download it from:
https://drive.google.com/open?id=12XrHstPa0LwxYa252WD2bJYwhSuLD4c6
This does have updated i40e which could help, but is not the latest intel link you posted.

Also check you have the latest firmware installed on the nic.

It is indeed strange that 1 node will cause path issues on the other nodes, i just do not see how ceph or the iscsi on the other nodes could be affected...it is not something we have seen before. Maybe external network/switch issues.

Last edited on July 9, 2018, 1:44 pm by admin · #14

BonsaiJoe
53 Posts
July 9, 2018, 10:00 pm

thanks for the updated kernel. Do you know what version of the i40g driver is included ? we this we need at minimum version 2.4.6 cause of the changelog there is a bug called "fix unnecessary PF resets issue" fixed.

https://sourceforge.net/projects/e1000/files/i40e%20stable/2.4.6/

cause of the 20 min ISCSI downtime any idea to figure out the cause off? we really would not stay with keeping in mind that this could happen again.

#15

admin
2,930 Posts
July 11, 2018, 11:29 am

The i40e driver is in active development:
https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/log/drivers/net/ethernet/intel/i40e?h=master
unfortunatley the 4.4.126 kernel does not contain the relevant fixes. Intel only backported a few fixes to the 4.4.x line but not the ones relating to tx resets. We are preparing a new kernel based on 4.12 kernel/SUSE SLE 15 (still beta) which will have the correct patches, i cannot say when it will be ready but should be soon. We may also backport the fixes to 4.4 oursleves if 4.12 gets delayed.

The io freeze should not happen with only 1 node problem, maybe there was an external issue or maybe other nodes had problems as well. If you can duplicate the issue in a test environment that could help us try to duplicate it and look into more detail.

#16

BonsaiJoe
53 Posts
July 16, 2018, 7:33 am

over the weekend we upgraded the kernel to 4.4.126 also we did a apt-get update. The interesting thing is now we have close to 100% more Throughput in the live system on a single job. For example backups run before with 400-500 MB/s after the kernel update we get 800 MB/s  with the same job and no other changes.

until now we did not see any problem with the i40e driver. but we will track this within the next weeks.

thanks again for your help

#17

admin
2,930 Posts
July 16, 2018, 10:07 am

Nice to hear 🙂  we do see improvements but not as much. The apt update, did you also update the ceph packages ? 4.4.126 does not include the relevant i40e tx fixes, will try to backport them soon or use the updated 4.12.x kernel.  Thanks again.

#18

admin
2,930 Posts
July 16, 2018, 1:00 pm

Did you perform  apt-get update not apt-get upgrade...correct ?

If we backport the i40e tx fixes to 4.4.126 as per:

https://sourceforge.net/p/e1000/bugs/590/

mainly the following patches:

https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/commit/drivers/net/ethernet/intel/i40e?id=248de22e638f10bd5bfc7624a357f940f66ba137

https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git/commit/drivers/net/ethernet/intel/i40e?id=0a797db323a6f74da3f43d5460792989da6617f4

We would not be able to test them, would you be able to test this ?

Last edited on July 16, 2018, 1:05 pm by admin · #19

BonsaiJoe
53 Posts
July 17, 2018, 9:39 am

no ofcause we did also a apt-get upgrade (apt-get update only updates the package list)  but as far as i have seen there was no ceph package update looks like you excludet this packages from the package list.

fyi .....tonight we had again a nic reset

root@node01:~# cat /var/log/kern.log | grep i40e
Jul 17 03:23:36 node01 kernel: [206462.406834] i40e 0000:17:00.1: TX driver issue detected, PF reset issued
Jul 17 03:23:36 node01 kernel: [206462.557782] i40e 0000:17:00.1: i40e_ptp_init: PTP not supported on eth3
Jul 17 03:23:36 node01 kernel: [206462.635737] i40e 0000:17:00.1 eth3: speed changed to 0 for port eth3

sure we will be happy to test the patched kernel.

 

#20
Pages: 1 2 3 4