diff mbox series

r8169: regression in connection speed with kernels 6.2+ (interrupt coalescing)

Message ID ff6d9c69c2a09de5baf2f01f25e3faf487278dbb.camel@falix.de (mailing list archive)
State Not Applicable
Delegated to: Netdev Maintainers
Headers show
Series r8169: regression in connection speed with kernels 6.2+ (interrupt coalescing) | expand

Checks

Context Check Description
netdev/tree_selection success Not a local patch

Commit Message

Felix Braun Nov. 3, 2024, 4:08 p.m. UTC
Hi there,

commit 42f66a44d83715bef810a543dfd66008b883a7a5 to Linus' kernel tree ("r8169: enable GRO software interrupt coalescing per default") introduces a speed regression on my hardware. With that commit applied I get net throughput of 10.5 MB/s, without that commit I get around 100 MB/s on my setup.

I've verified that just commenting out the one line in r8169_main.c

```
rtl8169_set_features(dev, dev->features);
```

restores the speed with kernel 6.11.6. Is there perhaps a more elegant way to fix this regression for other people too?

Regards  
Felix

This is my lspci -vvxx output:

```
03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet Controller (rev 15)
DeviceName: Onboard - RTK Ethernet
Subsystem: ASRock Incorporation Motherboard (one of many)
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Interrupt: pin A routed to IRQ 20
IOMMU group: 11
Region 0: I/O ports at e000 [size=256]
Region 2: Memory at a1204000 (64-bit, non-prefetchable) [size=4K]
Region 4: Memory at a1200000 (64-bit, non-prefetchable) [size=16K]
Capabilities: [40] Power Management version 3
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
Address: 0000000000000000  Data: 0000
Capabilities: [70] Express (v2) Endpoint, IntMsgNum 1
DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 10W TEE-IO-
DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
MaxPayload 128 bytes, MaxReadReq 4096 bytes
DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s unlimited, L1 <64us
ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 2.5GT/s, Width x1
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR+
10BitTagComp- 10BitTagReq- OBFF Via message/WAKE#, ExtFmt- EETLPPrefix-
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
FRS- TPHComp- ExtTPHComp-
AtomicOpsCap: 32bit- 64bit- 128bitCAS-
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
AtomicOpsCtl: ReqEn-
IDOReq- IDOCompl- LTR+ EmergencyPowerReductionReq-
10BitTagReq- OBFF Disabled, EETLPPrefixBlk-
LnkCap2: Supported Link Speeds: 2.5GT/s, Crosslink- Retimer- 2Retimers- DRS-
LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
Retimer- 2Retimers- CrosslinkRes: unsupported
Capabilities: [b0] MSI-X: Enable+ Count=4 Masked-
Vector table: BAR=4 offset=00000000
PBA: BAR=4 offset=00000800
Capabilities: [100 v2] Advanced Error Reporting
UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
ECRC- UnsupReq- ACSViol- UncorrIntErr- BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
ECRC- UnsupReq+ ACSViol- UncorrIntErr+ BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+
ECRC- UnsupReq- ACSViol- UncorrIntErr+ BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CorrIntErr- HeaderOF-
CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ CorrIntErr+ HeaderOF-
AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
HeaderLog: 00000000 00000000 00000000 00000000
Capabilities: [140 v1] Virtual Channel
Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
Arb:    Fixed- WRR32- WRR64- WRR128-
Ctrl:   ArbSelect=Fixed
Status: InProgress-
VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
Status: NegoPending- InProgress-
Capabilities: [160 v1] Device Serial Number 39-79-71-c2-85-70-00-00
Capabilities: [170 v1] Latency Tolerance Reporting
Max snoop latency: 3145728ns
Max no snoop latency: 3145728ns
Capabilities: [178 v1] L1 PM Substates
L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
PortCommonModeRestoreTime=150us PortTPowerOnTime=150us
L1SubCtl1: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+
T_CommonMode=0us LTR1.2_Threshold=163840ns
L1SubCtl2: T_PwrOn=150us
Kernel driver in use: r8169
Kernel modules: r8169
00: ec 10 68 81 07 04 10 00 15 00 00 02 10 00 00 00
10: 01 e0 00 00 00 00 00 00 04 40 20 a1 00 00 00 00
20: 04 00 20 a1 00 00 00 00 00 00 00 00 49 18 68 81
30: 00 00 00 00 40 00 00 00 00 00 00 00 ff 01 00 00
```

Comments

Heiner Kallweit Nov. 3, 2024, 10:21 p.m. UTC | #1
On 03.11.2024 17:08, Felix Braun wrote:
> Hi there,
> 
> commit 42f66a44d83715bef810a543dfd66008b883a7a5 to Linus' kernel tree ("r8169: enable GRO software interrupt coalescing per default") introduces a speed regression on my hardware. With that commit applied I get net throughput of 10.5 MB/s, without that commit I get around 100 MB/s on my setup.
> 
Thanks for the report. 6.2 has been out for quite some time, and this is
the first such report. So I don't think there's a general problem.
Can you please provide a full dmesg log and elaborate on the type of traffic
and how you measure the speed? BTW: With 100MB/s you refer to 100MBit/s?

Also interesting would be whether there are any errors or missed packets
in the ethtool -S <if> output.

Instead of commenting out this line you can also adjust the values from userspace:
/sys/class/net/<if>/gro_flush_timeout
/sys/class/net/<if>/napi_defer_hard_irqs
Does increasing the gro_flush_timeout value change something for you?

Somewhat strange is that lspci shows ASPM as disabled in LnkCtl, but
L1 sub-states are enabled in L1SubCtl1. Do you have any downstream kernel code
changes or any specific ASPM settings?

> I've verified that just commenting out the one line in r8169_main.c
> 
> ```
> --- a/drivers/net/ethernet/realtek/r8169_main.c  
> +++ b/drivers/net/ethernet/realtek/r8169_main.c  
> @@ -5505,6 +5505,8 @@ static int rtl_init_one(struct pci_dev *pdev, const struct pci_device_id *ent)  
> dev->hw_features |= NETIF_F_RXALL;  
> dev->hw_features |= NETIF_F_RXFCS;
> 
> dev->pcpu_stat_type = NETDEV_PCPU_STAT_TSTATS;
> 
> - netdev_sw_irq_coalesce_default_on(dev);  
> + //netdev_sq_irq_coalesc_default_on(dev);
> 
> /* configure chip for default features */  
> rtl8169_set_features(dev, dev->features);
> ```
> 
> restores the speed with kernel 6.11.6. Is there perhaps a more elegant way to fix this regression for other people too?
> 
> Regards  
> Felix
> 
> This is my lspci -vvxx output:
> 
> ```
> 03:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8211/8411 PCI Express Gigabit Ethernet Controller (rev 15)
> DeviceName: Onboard - RTK Ethernet
> Subsystem: ASRock Incorporation Motherboard (one of many)
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0, Cache Line Size: 64 bytes
> Interrupt: pin A routed to IRQ 20
> IOMMU group: 11
> Region 0: I/O ports at e000 [size=256]
> Region 2: Memory at a1204000 (64-bit, non-prefetchable) [size=4K]
> Region 4: Memory at a1200000 (64-bit, non-prefetchable) [size=16K]
> Capabilities: [40] Power Management version 3
> Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
> Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
> Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
> Address: 0000000000000000  Data: 0000
> Capabilities: [70] Express (v2) Endpoint, IntMsgNum 1
> DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
> ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 10W TEE-IO-
> DevCtl: CorrErr- NonFatalErr- FatalErr- UnsupReq-
> RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
> MaxPayload 128 bytes, MaxReadReq 4096 bytes
> DevSta: CorrErr- NonFatalErr- FatalErr- UnsupReq- AuxPwr+ TransPend-
> LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s unlimited, L1 <64us
> ClockPM+ Surprise- LLActRep- BwNot- ASPMOptComp+
> LnkCtl: ASPM Disabled; RCB 64 bytes, LnkDisable- CommClk+
> ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
> LnkSta: Speed 2.5GT/s, Width x1
> TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
> DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ NROPrPrP- LTR+
> 10BitTagComp- 10BitTagReq- OBFF Via message/WAKE#, ExtFmt- EETLPPrefix-
> EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
> FRS- TPHComp- ExtTPHComp-
> AtomicOpsCap: 32bit- 64bit- 128bitCAS-
> DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
> AtomicOpsCtl: ReqEn-
> IDOReq- IDOCompl- LTR+ EmergencyPowerReductionReq-
> 10BitTagReq- OBFF Disabled, EETLPPrefixBlk-
> LnkCap2: Supported Link Speeds: 2.5GT/s, Crosslink- Retimer- 2Retimers- DRS-
> LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
> Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
> Compliance Preset/De-emphasis: -6dB de-emphasis, 0dB preshoot
> LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
> EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
> Retimer- 2Retimers- CrosslinkRes: unsupported
> Capabilities: [b0] MSI-X: Enable+ Count=4 Masked-
> Vector table: BAR=4 offset=00000000
> PBA: BAR=4 offset=00000800
> Capabilities: [100 v2] Advanced Error Reporting
> UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
> ECRC- UnsupReq- ACSViol- UncorrIntErr- BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
> PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
> UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP-
> ECRC- UnsupReq+ ACSViol- UncorrIntErr+ BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
> PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
> UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+
> ECRC- UnsupReq- ACSViol- UncorrIntErr+ BlockedTLP- AtomicOpBlocked- TLPBlockedErr-
> PoisonTLPBlocked- DMWrReqBlocked- IDECheck- MisIDETLP- PCRC_CHECK- TLPXlatBlocked-
> CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr- CorrIntErr- HeaderOF-
> CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+ CorrIntErr+ HeaderOF-
> AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
> MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
> HeaderLog: 00000000 00000000 00000000 00000000
> Capabilities: [140 v1] Virtual Channel
> Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
> Arb:    Fixed- WRR32- WRR64- WRR128-
> Ctrl:   ArbSelect=Fixed
> Status: InProgress-
> VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
> Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
> Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
> Status: NegoPending- InProgress-
> Capabilities: [160 v1] Device Serial Number 39-79-71-c2-85-70-00-00
> Capabilities: [170 v1] Latency Tolerance Reporting
> Max snoop latency: 3145728ns
> Max no snoop latency: 3145728ns
> Capabilities: [178 v1] L1 PM Substates
> L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
> PortCommonModeRestoreTime=150us PortTPowerOnTime=150us
> L1SubCtl1: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+
> T_CommonMode=0us LTR1.2_Threshold=163840ns
> L1SubCtl2: T_PwrOn=150us
> Kernel driver in use: r8169
> Kernel modules: r8169
> 00: ec 10 68 81 07 04 10 00 15 00 00 02 10 00 00 00
> 10: 01 e0 00 00 00 00 00 00 04 40 20 a1 00 00 00 00
> 20: 04 00 20 a1 00 00 00 00 00 00 00 00 49 18 68 81
> 30: 00 00 00 00 40 00 00 00 00 00 00 00 ff 01 00 00
> ```
Felix Braun Nov. 4, 2024, 12:47 p.m. UTC | #2
On 03.11.2024 23:21 +0100 Heiner Kallweit wrote:  
> Thanks for the report. 6.2 has been out for quite some time, and this is  
> the first such report. So I don't think there's a general problem.

I switched from 6.1 (stable) to 6.6 (stable) only recently and then I didn't notice the speed degradation for quite some time.

> Can you please provide a full dmesg log and elaborate on the type of traffic  
> and how you measure the speed? BTW: With 100MB/s you refer to 100MBit/s?

Nono, I mean 100MBytes/s ;-) My testcase is transferring a large file over SMB and looking at the transfer speed as reported by KDE. (I'm attaching a full dmsg of a boot of a 6.11.6 kernel with only irq_coalescing commented out otherwise as released.)

> Also interesting would be whether there are any errors or missed packets  
> in the ethtool -S <if> output.

No errors or misses in either patched or unpatched kernel.

> Instead of commenting out this line you can also adjust the values from userspace:  
> /sys/class/net/<if>/gro_flush_timeout  
> /sys/class/net/<if>/napi_defer_hard_irqs  
> Does increasing the gro_flush_timeout value change something for you?

That's cool. I've reverted to unchanged 6.11.6 and if I set napi_defer_hard_irqs to 0 I'm back to 100 MBytes/s. Playing with gro_flush_timeout while napi_defer_hard_irqs is set to 1 does not seem to have any effect on the trasfer speed. Default value is 20000. I have tried some values between 1000 and 200000.

> Somewhat strange is that lspci shows ASPM as disabled in LnkCtl, but  
> L1 sub-states are enabled in L1SubCtl1. Do you have any downstream kernel code  
> changes or any specific ASPM settings?

No. Other than patching the default value for interrupt coalescing, I'm running a vanilla kernel. Maybe it is because I didn't enable ASPM in the kernel configuration?

Thanks for taking this up.

Regards  
Felix
[    0.000000] Linux version 6.11.6 (hazzl@leporello) (gcc (GCC) 14.2.1 20240910, GNU ld (GNU Binutils) 2.43.0) #3 SMP Sun Nov  3 16:22:00 CET 2024
[    0.000000] Command line: initrd=\initramfs-hc.img root=LABEL=ROOT.B mitigations=off retbleed=off rw
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000003dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000003e000-0x000000000003ffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000040000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009e000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000000fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000010000000-0x0000000012150fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000012151000-0x000000006ad08fff] usable
[    0.000000] BIOS-e820: [mem 0x000000006ad09000-0x000000006d5b8fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006d5b9000-0x000000006d5f4fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000006d5f5000-0x000000006d654fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000006d655000-0x000000006dae0fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006dae1000-0x000000006e4e3fff] usable
[    0.000000] BIOS-e820: [mem 0x000000006e4e4000-0x000000006e58ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006e590000-0x000000006ebfffff] usable
[    0.000000] BIOS-e820: [mem 0x000000006ec00000-0x000000007fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000d0000000-0x00000000d0ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000d3709000-0x00000000d3709fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe042000-0x00000000fe044fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe900000-0x00000000fe902fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed01000-0x00000000fed01fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000017fffffff] usable
[    0.000000] Kernel compiled without mitigations, ignoring 'mitigations'; system may still be vulnerable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] e820: update [mem 0x6332e018-0x6333e057] usable ==> usable
[    0.000000] e820: update [mem 0x6331f018-0x6332d057] usable ==> usable
[    0.000000] extended physical RAM map:
[    0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000003dfff] usable
[    0.000000] reserve setup_data: [mem 0x000000000003e000-0x000000000003ffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000000040000-0x000000000009dfff] usable
[    0.000000] reserve setup_data: [mem 0x000000000009e000-0x00000000000fffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000000fffffff] usable
[    0.000000] reserve setup_data: [mem 0x0000000010000000-0x0000000012150fff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000012151000-0x000000006331f017] usable
[    0.000000] reserve setup_data: [mem 0x000000006331f018-0x000000006332d057] usable
[    0.000000] reserve setup_data: [mem 0x000000006332d058-0x000000006332e017] usable
[    0.000000] reserve setup_data: [mem 0x000000006332e018-0x000000006333e057] usable
[    0.000000] reserve setup_data: [mem 0x000000006333e058-0x000000006ad08fff] usable
[    0.000000] reserve setup_data: [mem 0x000000006ad09000-0x000000006d5b8fff] reserved
[    0.000000] reserve setup_data: [mem 0x000000006d5b9000-0x000000006d5f4fff] ACPI data
[    0.000000] reserve setup_data: [mem 0x000000006d5f5000-0x000000006d654fff] ACPI NVS
[    0.000000] reserve setup_data: [mem 0x000000006d655000-0x000000006dae0fff] reserved
[    0.000000] reserve setup_data: [mem 0x000000006dae1000-0x000000006e4e3fff] usable
[    0.000000] reserve setup_data: [mem 0x000000006e4e4000-0x000000006e58ffff] reserved
[    0.000000] reserve setup_data: [mem 0x000000006e590000-0x000000006ebfffff] usable
[    0.000000] reserve setup_data: [mem 0x000000006ec00000-0x000000007fffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000d0000000-0x00000000d0ffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000d3709000-0x00000000d3709fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fe042000-0x00000000fe044fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fe900000-0x00000000fe902fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fed01000-0x00000000fed01fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] reserve setup_data: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000017fffffff] usable
[    0.000000] efi: EFI v2.7 by American Megatrends
[    0.000000] efi: ACPI=0x6d652000 ACPI 2.0=0x6d652014 TPMFinalLog=0x6d620000 SMBIOS=0x6d8f2000 SMBIOS 3.0=0x6d8f1000 MEMATTR=0x675f5018 ESRT=0x67619e18 RNG=0x6d5d7f18 INITRD=0x6671e518 TPMEventLog=0x6d5d6018 
[    0.000000] random: crng init done
[    0.000000] efi: Remove mem45: MMIO range=[0xd0000000-0xd0ffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xd0000000-0xd0ffffff] reserved
[    0.000000] efi: Not removing mem46: MMIO range=[0xd3709000-0xd3709fff] (4KB) from e820 map
[    0.000000] efi: Remove mem47: MMIO range=[0xe0000000-0xefffffff] (256MB) from e820 map
[    0.000000] e820: remove [mem 0xe0000000-0xefffffff] reserved
[    0.000000] efi: Not removing mem48: MMIO range=[0xfe042000-0xfe042fff] (4KB) from e820 map
[    0.000000] efi: Not removing mem49: MMIO range=[0xfe043000-0xfe043fff] (4KB) from e820 map
[    0.000000] efi: Not removing mem50: MMIO range=[0xfe044000-0xfe044fff] (4KB) from e820 map
[    0.000000] efi: Not removing mem51: MMIO range=[0xfe900000-0xfe902fff] (12KB) from e820 map
[    0.000000] efi: Not removing mem52: MMIO range=[0xfec00000-0xfec00fff] (4KB) from e820 map
[    0.000000] efi: Not removing mem53: MMIO range=[0xfed01000-0xfed01fff] (4KB) from e820 map
[    0.000000] efi: Not removing mem54: MMIO range=[0xfee00000-0xfee00fff] (4KB) from e820 map
[    0.000000] efi: Remove mem55: MMIO range=[0xff000000-0xffffffff] (16MB) from e820 map
[    0.000000] e820: remove [mem 0xff000000-0xffffffff] reserved
[    0.000000] SMBIOS 3.2.0 present.
[    0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./J4105-ITX, BIOS P1.60 01/17/2020
[    0.000000] DMI: Memory slots populated: 1/2
[    0.000000] tsc: Detected 1497.600 MHz processor
[    0.000027] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000032] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000049] last_pfn = 0x180000 max_arch_pfn = 0x400000000
[    0.000058] MTRR map: 8 entries (3 fixed + 5 variable; max 23), built from 10 variable MTRRs
[    0.000062] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000126] last_pfn = 0x6ec00 max_arch_pfn = 0x400000000
[    0.000145] esrt: Reserving ESRT space from 0x0000000067619e18 to 0x0000000067619e50.
[    0.000155] e820: update [mem 0x67619000-0x67619fff] usable ==> reserved
[    0.000187] Using GB pages for direct mapping
[    0.001857] Secure boot disabled
[    0.001858] RAMDISK: [mem 0x6333f000-0x64967fff]
[    0.001901] ACPI: Early table checksum verification disabled
[    0.001907] ACPI: RSDP 0x000000006D652014 000024 (v02 ALASKA)
[    0.001915] ACPI: XSDT 0x000000006D651728 0000DC (v01 ALASKA A M I    01072009 AMI  01000013)
[    0.001925] ACPI: FACP 0x000000006D5F2000 000114 (v06 ALASKA A M I    01072009 AMI  00010013)
[    0.001936] ACPI: DSDT 0x000000006D5E5000 00C7B3 (v02 ALASKA A M I    01072009 INTL 20160930)
[    0.001942] ACPI: FACS 0x000000006D654000 000040
[    0.001947] ACPI: FPDT 0x000000006D5E4000 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001953] ACPI: FIDT 0x000000006D5E3000 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.001958] ACPI: MCFG 0x000000006D5F4000 00003C (v01 ALASKA A M I    01072009 MSFT 00000097)
[    0.001964] ACPI: DBG2 0x000000006D5F3000 000072 (v00 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001970] ACPI: DBGP 0x000000006D5E2000 000034 (v01 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001975] ACPI: HPET 0x000000006D5E0000 000038 (v01 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001981] ACPI: LPIT 0x000000006D5DF000 00005C (v01 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001986] ACPI: APIC 0x000000006D5DE000 000084 (v04 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001991] ACPI: NPKT 0x000000006D5DD000 000065 (v01 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.001997] ACPI: SSDT 0x000000006D5D8000 003F72 (v02 INTEL  DptfTab  00000003 BRXT 0100000D)
[    0.002002] ACPI: SSDT 0x000000006D5D1000 0010B3 (v02 INTEL  UsbCTabl 00000003 BRXT 0100000D)
[    0.002008] ACPI: SSDT 0x000000006D5D0000 0009FF (v01 Intel_ Platform 00001000 INTL 20160930)
[    0.002013] ACPI: AAFT 0x000000006D5CF000 0002CE (v01 ALASKA OEMAAFT  01072009 MSFT 00000097)
[    0.002019] ACPI: SSDT 0x000000006D5CE000 0004D5 (v02 PmRef  Cpu0Ist  00003000 INTL 20160930)
[    0.002025] ACPI: SSDT 0x000000006D5CD000 000775 (v02 CpuRef CpuSsdt  00003000 INTL 20160930)
[    0.002030] ACPI: SSDT 0x000000006D5CC000 00035F (v02 PmRef  Cpu0Tst  00003000 INTL 20160930)
[    0.002036] ACPI: SSDT 0x000000006D5CB000 0001E6 (v02 PmRef  ApTst    00003000 INTL 20160930)
[    0.002041] ACPI: SSDT 0x000000006D5C8000 00286F (v02 SaSsdt SaSsdt   00003000 INTL 20160930)
[    0.002046] ACPI: TPM2 0x000000006D5C7000 000034 (v04 ALASKA A M I    00000001 AMI  00000000)
[    0.002052] ACPI: DMAR 0x000000006D5E1000 0000A8 (v01 INTEL  GLK-SOC  00000003 BRXT 0100000D)
[    0.002058] ACPI: WDAT 0x000000006D5C6000 000104 (v01                 00000000      00000000)
[    0.002063] ACPI: WSMT 0x000000006D5DC000 000028 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.002068] ACPI: Reserving FACP table memory at [mem 0x6d5f2000-0x6d5f2113]
[    0.002071] ACPI: Reserving DSDT table memory at [mem 0x6d5e5000-0x6d5f17b2]
[    0.002073] ACPI: Reserving FACS table memory at [mem 0x6d654000-0x6d65403f]
[    0.002075] ACPI: Reserving FPDT table memory at [mem 0x6d5e4000-0x6d5e4043]
[    0.002077] ACPI: Reserving FIDT table memory at [mem 0x6d5e3000-0x6d5e309b]
[    0.002079] ACPI: Reserving MCFG table memory at [mem 0x6d5f4000-0x6d5f403b]
[    0.002081] ACPI: Reserving DBG2 table memory at [mem 0x6d5f3000-0x6d5f3071]
[    0.002082] ACPI: Reserving DBGP table memory at [mem 0x6d5e2000-0x6d5e2033]
[    0.002084] ACPI: Reserving HPET table memory at [mem 0x6d5e0000-0x6d5e0037]
[    0.002086] ACPI: Reserving LPIT table memory at [mem 0x6d5df000-0x6d5df05b]
[    0.002088] ACPI: Reserving APIC table memory at [mem 0x6d5de000-0x6d5de083]
[    0.002090] ACPI: Reserving NPKT table memory at [mem 0x6d5dd000-0x6d5dd064]
[    0.002092] ACPI: Reserving SSDT table memory at [mem 0x6d5d8000-0x6d5dbf71]
[    0.002094] ACPI: Reserving SSDT table memory at [mem 0x6d5d1000-0x6d5d20b2]
[    0.002095] ACPI: Reserving SSDT table memory at [mem 0x6d5d0000-0x6d5d09fe]
[    0.002097] ACPI: Reserving AAFT table memory at [mem 0x6d5cf000-0x6d5cf2cd]
[    0.002099] ACPI: Reserving SSDT table memory at [mem 0x6d5ce000-0x6d5ce4d4]
[    0.002101] ACPI: Reserving SSDT table memory at [mem 0x6d5cd000-0x6d5cd774]
[    0.002103] ACPI: Reserving SSDT table memory at [mem 0x6d5cc000-0x6d5cc35e]
[    0.002105] ACPI: Reserving SSDT table memory at [mem 0x6d5cb000-0x6d5cb1e5]
[    0.002107] ACPI: Reserving SSDT table memory at [mem 0x6d5c8000-0x6d5ca86e]
[    0.002109] ACPI: Reserving TPM2 table memory at [mem 0x6d5c7000-0x6d5c7033]
[    0.002111] ACPI: Reserving DMAR table memory at [mem 0x6d5e1000-0x6d5e10a7]
[    0.002112] ACPI: Reserving WDAT table memory at [mem 0x6d5c6000-0x6d5c6103]
[    0.002114] ACPI: Reserving WSMT table memory at [mem 0x6d5dc000-0x6d5dc027]
[    0.002164] Zone ranges:
[    0.002166]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.002170]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.002173]   Normal   [mem 0x0000000100000000-0x000000017fffffff]
[    0.002177] Movable zone start for each node
[    0.002178] Early memory node ranges
[    0.002179]   node   0: [mem 0x0000000000001000-0x000000000003dfff]
[    0.002182]   node   0: [mem 0x0000000000040000-0x000000000009dfff]
[    0.002184]   node   0: [mem 0x0000000000100000-0x000000000fffffff]
[    0.002186]   node   0: [mem 0x0000000012151000-0x000000006ad08fff]
[    0.002189]   node   0: [mem 0x000000006dae1000-0x000000006e4e3fff]
[    0.002191]   node   0: [mem 0x000000006e590000-0x000000006ebfffff]
[    0.002193]   node   0: [mem 0x0000000100000000-0x000000017fffffff]
[    0.002196] Initmem setup node 0 [mem 0x0000000000001000-0x000000017fffffff]
[    0.002205] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.002210] On node 0, zone DMA: 2 pages in unavailable ranges
[    0.002279] On node 0, zone DMA: 98 pages in unavailable ranges
[    0.009662] On node 0, zone DMA32: 8529 pages in unavailable ranges
[    0.009967] On node 0, zone DMA32: 11736 pages in unavailable ranges
[    0.010001] On node 0, zone DMA32: 172 pages in unavailable ranges
[    0.019040] On node 0, zone Normal: 5120 pages in unavailable ranges
[    0.019065] Reserving Intel graphics memory at [mem 0x70000000-0x7fffffff]
[    0.019316] ACPI: PM-Timer IO Port: 0x408
[    0.019331] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[    0.019335] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[    0.019337] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[    0.019339] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[    0.019373] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-119
[    0.019379] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.019384] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.019391] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.019394] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.019401] TSC deadline timer available
[    0.019414] CPU topo: Max. logical packages:   1
[    0.019415] CPU topo: Max. logical dies:       1
[    0.019417] CPU topo: Max. dies per package:   1
[    0.019427] CPU topo: Max. threads per core:   1
[    0.019429] CPU topo: Num. cores per package:     4
[    0.019431] CPU topo: Num. threads per package:   4
[    0.019432] CPU topo: Allowing 4 present CPUs plus 0 hotplug CPUs
[    0.019474] [mem 0x80000000-0xd3708fff] available for PCI devices
[    0.019481] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.029870] setup_percpu: NR_CPUS:4 nr_cpumask_bits:4 nr_cpu_ids:4 nr_node_ids:1
[    0.030374] percpu: Embedded 68 pages/cpu s153432 r8192 d116904 u524288
[    0.030388] pcpu-alloc: s153432 r8192 d116904 u524288 alloc=1*2097152
[    0.030395] pcpu-alloc: [0] 0 1 2 3 
[    0.030434] Kernel command line: initrd=\initramfs-hc.img root=LABEL=ROOT.B mitigations=off retbleed=off rw
[    0.030573] printk: log_buf_len individual max cpu contribution: 8192 bytes
[    0.030576] printk: log_buf_len total cpu_extra contributions: 24576 bytes
[    0.030578] printk: log_buf_len min size: 32768 bytes
[    0.030771] printk: log_buf_len: 65536 bytes
[    0.030773] printk: early log buf free: 18176(55%)
[    0.031522] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)
[    0.031923] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    0.032014] Built 1 zonelists, mobility grouping on.  Total pages: 957382
[    0.032021] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.032035] software IO TLB: area num 4.
[    0.077386] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.077606] rcu: Hierarchical RCU implementation.
[    0.077610] rcu: RCU calculated value of scheduler-enlistment delay is 10 jiffies.
[    0.077623] NR_IRQS: 4352, nr_irqs: 1024, preallocated irqs: 16
[    0.077942] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.078195] Console: colour dummy device 80x25
[    0.078201] printk: legacy console [tty0] enabled
[    0.078766] ACPI: Core revision 20240322
[    0.079269] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 99544814920 ns
[    0.079367] APIC: Switch to symmetric I/O mode setup
[    0.083698] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.129328] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x159647815e3, max_idle_ns: 440795269835 ns
[    0.129344] Calibrating delay loop (skipped), value calculated using timer frequency.. 2995.20 BogoMIPS (lpj=14976000)
[    0.129404] CPU0: Thermal monitoring enabled (TM1)
[    0.129410] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    0.129516] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.129522] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.129532] process: using mwait in idle threads
[    0.129539] Spectre V2 : User space: Vulnerable
[    0.129544] Speculative Store Bypass: Vulnerable
[    0.129554] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.129560] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.129564] x86/fpu: Supporting XSAVE feature 0x008: 'MPX bounds registers'
[    0.129569] x86/fpu: Supporting XSAVE feature 0x010: 'MPX CSR'
[    0.129574] x86/fpu: xstate_offset[3]:  576, xstate_sizes[3]:   64
[    0.129580] x86/fpu: xstate_offset[4]:  640, xstate_sizes[4]:   64
[    0.129584] x86/fpu: Enabled xstate features 0x1b, context size is 704 bytes, using 'compacted' format.
[    0.134067] Freeing SMP alternatives memory: 40K
[    0.134076] pid_max: default: 32768 minimum: 301
[    0.138105] LSM: initializing lsm=capability,landlock
[    0.138216] landlock: Up and running.
[    0.138260] Mount-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.138279] Mountpoint-cache hash table entries: 8192 (order: 4, 65536 bytes, linear)
[    0.138698] smpboot: CPU0: Intel(R) Celeron(R) J4105 CPU @ 1.50GHz (family: 0x6, model: 0x7a, stepping: 0x1)
[    0.138976] Performance Events: PEBS fmt3+, Goldmont plus events, 32-deep LBR, full-width counters, Intel PMU driver.
[    0.139033] ... version:                4
[    0.139037] ... bit width:              48
[    0.139040] ... generic registers:      4
[    0.139043] ... value mask:             0000ffffffffffff
[    0.139047] ... max period:             00007fffffffffff
[    0.139051] ... fixed-purpose events:   3
[    0.139054] ... event mask:             000000070000000f
[    0.139212] signal: max sigframe size: 2032
[    0.139244] Estimated ratio of average max frequency by base frequency (times 1024): 1706
[    0.139340] rcu: Hierarchical SRCU implementation.
[    0.139340] rcu: 	Max phase no-delay instances is 1000.
[    0.139340] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level
[    0.139340] smp: Bringing up secondary CPUs ...
[    0.139340] smpboot: x86: Booting SMP configuration:
[    0.139340] .... node  #0, CPUs:      #1 #2 #3
[    0.139340] smp: Brought up 1 node, 4 CPUs
[    0.139340] smpboot: Total of 4 processors activated (11980.80 BogoMIPS)
[    0.139456] Memory: 3641552K/3829528K available (14336K kernel code, 679K rwdata, 3348K rodata, 1164K init, 436K bss, 183384K reserved, 0K cma-reserved)
[    0.139995] devtmpfs: initialized
[    0.139995] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.139995] futex hash table entries: 1024 (order: 4, 65536 bytes, linear)
[    0.139995] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    0.139995] thermal_sys: Registered thermal governor 'step_wise'
[    0.139995] thermal_sys: Registered thermal governor 'user_space'
[    0.139995] cpuidle: using governor menu
[    0.140048] PCI: ECAM [mem 0xe0000000-0xefffffff] (base 0xe0000000) for domain 0000 [bus 00-ff]
[    0.140048] PCI: Using configuration type 1 for base access
[    0.140048] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    0.140048] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    0.140048] raid6: skipped pq benchmark and selected sse2x4
[    0.140048] raid6: using ssse3x2 recovery algorithm
[    0.140048] ACPI: Added _OSI(Module Device)
[    0.140048] ACPI: Added _OSI(Processor Device)
[    0.140048] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.140048] ACPI: Added _OSI(Processor Aggregator Device)
[    0.157306] ACPI: 9 ACPI AML tables successfully acquired and loaded
[    0.219899] ACPI: Dynamic OEM Table Load:
[    0.219919] ACPI: SSDT 0xFFFF93C0C01AAE00 000190 (v02 PmRef  Cpu0Cst  00003001 INTL 20160930)
[    0.221088] ACPI: Dynamic OEM Table Load:
[    0.221105] ACPI: SSDT 0xFFFF93C0C01ABC00 0001E6 (v02 PmRef  ApIst    00003000 INTL 20160930)
[    0.222080] ACPI: Dynamic OEM Table Load:
[    0.222095] ACPI: SSDT 0xFFFF93C0C08EA000 0000C9 (v02 PmRef  ApCst    00003000 INTL 20160930)
[    0.224230] ACPI: Interpreter enabled
[    0.224248] ACPI: PM: (supports S0 S5)
[    0.224253] ACPI: Using IOAPIC for interrupt routing
[    0.224380] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.224388] PCI: Using E820 reservations for host bridge windows
[    0.224822] ACPI: Enabled 11 GPEs in block 00 to 7F
[    0.234375] ACPI: \_SB_.PCI0.RP01.PXSX.DRST: New power resource
[    0.234746] ACPI: \_SB_.PCI0.RP02.PXSX.DRST: New power resource
[    0.235106] ACPI: \_SB_.PCI0.RP03.PXSX.DRST: New power resource
[    0.235473] ACPI: \_SB_.PCI0.RP04.PXSX.DRST: New power resource
[    0.235833] ACPI: \_SB_.PCI0.RP05.PXSX.DRST: New power resource
[    0.236240] ACPI: \_SB_.PCI0.RP06.PXSX.DRST: New power resource
[    0.236640] ACPI: \_SB_.PCI0.CNVW.WRST: New power resource
[    0.242263] ACPI: \_TZ_.FN00: New power resource
[    0.243214] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.243231] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3]
[    0.243942] acpi PNP0A08:00: _OSC: platform does not support [PCIeCapability]
[    0.244115] acpi PNP0A08:00: _OSC: not requesting control; platform does not support [PCIeCapability]
[    0.244124] acpi PNP0A08:00: _OSC: OS requested [PME PCIeCapability LTR]
[    0.244130] acpi PNP0A08:00: _OSC: platform willing to grant [PME LTR]
[    0.244136] acpi PNP0A08:00: _OSC: platform retains control of PCIe features (AE_SUPPORT)
[    0.244524] PCI host bridge to bus 0000:00
[    0.244535] pci_bus 0000:00: root bus resource [io  0x0070-0x0077]
[    0.244542] pci_bus 0000:00: root bus resource [io  0x0000-0x006f window]
[    0.244549] pci_bus 0000:00: root bus resource [io  0x0078-0x0cf7 window]
[    0.244555] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.244561] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000fffff window]
[    0.244567] pci_bus 0000:00: root bus resource [mem 0x70000001-0xcfffffff window]
[    0.244573] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xefffffff window]
[    0.244579] pci_bus 0000:00: root bus resource [mem 0xfea00000-0xfeafffff window]
[    0.244585] pci_bus 0000:00: root bus resource [mem 0xfed00000-0xfed003ff window]
[    0.244590] pci_bus 0000:00: root bus resource [mem 0xfed01000-0xfed01fff window]
[    0.244596] pci_bus 0000:00: root bus resource [mem 0xfed03000-0xfed03fff window]
[    0.244602] pci_bus 0000:00: root bus resource [mem 0xfed06000-0xfed06fff window]
[    0.244607] pci_bus 0000:00: root bus resource [mem 0xfed08000-0xfed09fff window]
[    0.244613] pci_bus 0000:00: root bus resource [mem 0xfed80000-0xfedbffff window]
[    0.244619] pci_bus 0000:00: root bus resource [mem 0xfed1c000-0xfed1cfff window]
[    0.244625] pci_bus 0000:00: root bus resource [mem 0xfee00000-0xfeefffff window]
[    0.244631] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.244672] pci 0000:00:00.0: [8086:31f0] type 00 class 0x060000 conventional PCI endpoint
[    0.244836] pci 0000:00:00.1: [8086:318c] type 00 class 0x118000 conventional PCI endpoint
[    0.244869] pci 0000:00:00.1: BAR 0 [mem 0x80000000-0x80007fff 64bit]
[    0.245054] pci 0000:00:02.0: [8086:3185] type 00 class 0x030000 PCIe Root Complex Integrated Endpoint
[    0.245074] pci 0000:00:02.0: BAR 0 [mem 0xa0000000-0xa0ffffff 64bit]
[    0.245087] pci 0000:00:02.0: BAR 2 [mem 0x90000000-0x9fffffff 64bit pref]
[    0.245096] pci 0000:00:02.0: BAR 4 [io  0xf000-0xf03f]
[    0.245127] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.245430] pci 0000:00:0e.0: [8086:3198] type 00 class 0x040300 PCIe Root Complex Integrated Endpoint
[    0.245462] pci 0000:00:0e.0: BAR 0 [mem 0xa1310000-0xa1313fff 64bit]
[    0.245499] pci 0000:00:0e.0: BAR 4 [mem 0xa1000000-0xa10fffff 64bit]
[    0.245576] pci 0000:00:0e.0: PME# supported from D0 D3hot D3cold
[    0.246078] pci 0000:00:0f.0: [8086:319a] type 00 class 0x078000 conventional PCI endpoint
[    0.246117] pci 0000:00:0f.0: BAR 0 [mem 0xa1319000-0xa1319fff 64bit]
[    0.246248] pci 0000:00:0f.0: PME# supported from D3hot
[    0.246382] pci 0000:00:12.0: [8086:31e3] type 00 class 0x010601 conventional PCI endpoint
[    0.246403] pci 0000:00:12.0: BAR 0 [mem 0xa1314000-0xa1315fff]
[    0.246415] pci 0000:00:12.0: BAR 1 [mem 0xa1318000-0xa13180ff]
[    0.246427] pci 0000:00:12.0: BAR 2 [io  0xf090-0xf097]
[    0.246439] pci 0000:00:12.0: BAR 3 [io  0xf080-0xf083]
[    0.246452] pci 0000:00:12.0: BAR 4 [io  0xf060-0xf07f]
[    0.246464] pci 0000:00:12.0: BAR 5 [mem 0xa1317000-0xa13177ff]
[    0.246510] pci 0000:00:12.0: PME# supported from D3hot
[    0.246600] pci 0000:00:13.0: [8086:31d8] type 01 class 0x060400 PCIe Root Port
[    0.246629] pci 0000:00:13.0: PCI bridge to [bus 01]
[    0.246712] pci 0000:00:13.0: PME# supported from D0 D3hot D3cold
[    0.246829] pci 0000:00:13.1: [8086:31d9] type 01 class 0x060400 PCIe Root Port
[    0.246860] pci 0000:00:13.1: PCI bridge to [bus 02]
[    0.246938] pci 0000:00:13.1: PME# supported from D0 D3hot D3cold
[    0.247053] pci 0000:00:13.2: [8086:31da] type 01 class 0x060400 PCIe Root Port
[    0.247084] pci 0000:00:13.2: PCI bridge to [bus 03]
[    0.247092] pci 0000:00:13.2:   bridge window [io  0xe000-0xefff]
[    0.247099] pci 0000:00:13.2:   bridge window [mem 0xa1200000-0xa12fffff]
[    0.247170] pci 0000:00:13.2: PME# supported from D0 D3hot D3cold
[    0.247284] pci 0000:00:13.3: [8086:31db] type 01 class 0x060400 PCIe Root Port
[    0.247314] pci 0000:00:13.3: PCI bridge to [bus 04]
[    0.247322] pci 0000:00:13.3:   bridge window [io  0xd000-0xdfff]
[    0.247329] pci 0000:00:13.3:   bridge window [mem 0xa1100000-0xa11fffff]
[    0.247399] pci 0000:00:13.3: PME# supported from D0 D3hot D3cold
[    0.247536] pci 0000:00:15.0: [8086:31a8] type 00 class 0x0c0330 conventional PCI endpoint
[    0.247564] pci 0000:00:15.0: BAR 0 [mem 0xa1300000-0xa130ffff 64bit]
[    0.247653] pci 0000:00:15.0: PME# supported from D3hot D3cold
[    0.247830] pci 0000:00:1f.0: [8086:31e8] type 00 class 0x060100 conventional PCI endpoint
[    0.248089] pci 0000:00:1f.1: [8086:31d4] type 00 class 0x0c0500 conventional PCI endpoint
[    0.248165] pci 0000:00:1f.1: BAR 0 [mem 0xa1316000-0xa13160ff 64bit]
[    0.248257] pci 0000:00:1f.1: BAR 4 [io  0xf040-0xf05f]
[    0.248458] pci 0000:00:13.0: PCI bridge to [bus 01]
[    0.248508] pci 0000:00:13.1: PCI bridge to [bus 02]
[    0.248582] pci 0000:03:00.0: [10ec:8168] type 00 class 0x020000 PCIe Endpoint
[    0.248610] pci 0000:03:00.0: BAR 0 [io  0xe000-0xe0ff]
[    0.248642] pci 0000:03:00.0: BAR 2 [mem 0xa1204000-0xa1204fff 64bit]
[    0.248665] pci 0000:03:00.0: BAR 4 [mem 0xa1200000-0xa1203fff 64bit]
[    0.248688] pci 0000:03:00.0: Upstream bridge's Max Payload Size set to 128 (was 256, max 256)
[    0.248699] pci 0000:03:00.0: Max Payload Size set to 128 (was 128, max 128)
[    0.248799] pci 0000:03:00.0: supports D1 D2
[    0.248804] pci 0000:03:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.248976] pci 0000:00:13.2: PCI bridge to [bus 03]
[    0.249052] pci 0000:04:00.0: [1b21:0612] type 00 class 0x010601 PCIe Legacy Endpoint
[    0.249088] pci 0000:04:00.0: BAR 0 [io  0xd050-0xd057]
[    0.249102] pci 0000:04:00.0: BAR 1 [io  0xd040-0xd043]
[    0.249116] pci 0000:04:00.0: BAR 2 [io  0xd030-0xd037]
[    0.249131] pci 0000:04:00.0: BAR 3 [io  0xd020-0xd023]
[    0.249146] pci 0000:04:00.0: BAR 4 [io  0xd000-0xd01f]
[    0.249160] pci 0000:04:00.0: BAR 5 [mem 0xa1100000-0xa11001ff]
[    0.249358] pci 0000:00:13.3: PCI bridge to [bus 04]
[    0.249394] pci_bus 0000:00: on NUMA node 0
[    0.250604] ACPI: PCI: Interrupt link LNKA configured for IRQ 3
[    0.250699] ACPI: PCI: Interrupt link LNKB configured for IRQ 4
[    0.250791] ACPI: PCI: Interrupt link LNKC configured for IRQ 5
[    0.250883] ACPI: PCI: Interrupt link LNKD configured for IRQ 6
[    0.250974] ACPI: PCI: Interrupt link LNKE configured for IRQ 7
[    0.251065] ACPI: PCI: Interrupt link LNKF configured for IRQ 9
[    0.251156] ACPI: PCI: Interrupt link LNKG configured for IRQ 10
[    0.251247] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[    0.253371] iommu: Default domain type: Translated
[    0.253371] iommu: DMA domain TLB invalidation policy: lazy mode
[    0.253371] SCSI subsystem initialized
[    0.253371] libata version 3.00 loaded.
[    0.253371] ACPI: bus type USB registered
[    0.253371] usbcore: registered new interface driver usbfs
[    0.253371] usbcore: registered new interface driver hub
[    0.253371] usbcore: registered new device driver usb
[    0.253371] efivars: Registered efivars operations
[    0.253371] PCI: Using ACPI for IRQ routing
[    0.273025] PCI: pci_cache_line_size set to 64 bytes
[    0.273101] resource: Expanded resource Reserved due to conflict with PCI Bus 0000:00
[    0.273109] e820: reserve RAM buffer [mem 0x0003e000-0x0003ffff]
[    0.273116] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
[    0.273118] e820: reserve RAM buffer [mem 0x6331f018-0x63ffffff]
[    0.273121] e820: reserve RAM buffer [mem 0x6332e018-0x63ffffff]
[    0.273124] e820: reserve RAM buffer [mem 0x67619000-0x67ffffff]
[    0.273126] e820: reserve RAM buffer [mem 0x6ad09000-0x6bffffff]
[    0.273128] e820: reserve RAM buffer [mem 0x6e4e4000-0x6fffffff]
[    0.273131] e820: reserve RAM buffer [mem 0x6ec00000-0x6fffffff]
[    0.279386] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[    0.279386] pci 0000:00:02.0: vgaarb: bridge control possible
[    0.279386] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.279386] vgaarb: loaded
[    0.279495] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.279514] hpet0: 8 comparators, 64-bit 19.200000 MHz counter
[    0.281630] clocksource: Switched to clocksource tsc-early
[    0.281900] pnp: PnP ACPI init
[    0.282231] system 00:00: [io  0x0280-0x028f] has been reserved
[    0.282241] system 00:00: [io  0x0290-0x029f] has been reserved
[    0.282247] system 00:00: [io  0x02a0-0x02af] has been reserved
[    0.282782] pnp 00:01: [dma 0 disabled]
[    0.282905] system 00:02: [io  0x0680-0x069f] has been reserved
[    0.282913] system 00:02: [io  0x0400-0x047f] has been reserved
[    0.282919] system 00:02: [io  0x0500-0x05fe] has been reserved
[    0.283430] system 00:03: [mem 0xe0000000-0xefffffff] has been reserved
[    0.283439] system 00:03: [mem 0xfea00000-0xfeafffff] has been reserved
[    0.283445] system 00:03: [mem 0xfed01000-0xfed01fff] has been reserved
[    0.283451] system 00:03: [mem 0xfed03000-0xfed03fff] has been reserved
[    0.283456] system 00:03: [mem 0xfed06000-0xfed06fff] has been reserved
[    0.283462] system 00:03: [mem 0xfed08000-0xfed09fff] has been reserved
[    0.283468] system 00:03: [mem 0xfed80000-0xfedbffff] has been reserved
[    0.283473] system 00:03: [mem 0xfed1c000-0xfed1cfff] has been reserved
[    0.283479] system 00:03: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.284110] pnp: PnP ACPI: found 5 devices
[    0.288610] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.288805] NET: Registered PF_INET protocol family
[    0.288945] IP idents hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.290948] tcp_listen_portaddr_hash hash table entries: 2048 (order: 3, 32768 bytes, linear)
[    0.290966] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    0.290983] TCP established hash table entries: 32768 (order: 6, 262144 bytes, linear)
[    0.291086] TCP bind hash table entries: 32768 (order: 8, 1048576 bytes, linear)
[    0.291304] TCP: Hash tables configured (established 32768 bind 32768)
[    0.291349] UDP hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.291373] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes, linear)
[    0.291443] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    0.291476] pci 0000:00:13.0: PCI bridge to [bus 01]
[    0.291497] pci 0000:00:13.1: PCI bridge to [bus 02]
[    0.291510] pci 0000:00:13.2: PCI bridge to [bus 03]
[    0.291517] pci 0000:00:13.2:   bridge window [io  0xe000-0xefff]
[    0.291526] pci 0000:00:13.2:   bridge window [mem 0xa1200000-0xa12fffff]
[    0.291538] pci 0000:00:13.3: PCI bridge to [bus 04]
[    0.291544] pci 0000:00:13.3:   bridge window [io  0xd000-0xdfff]
[    0.291553] pci 0000:00:13.3:   bridge window [mem 0xa1100000-0xa11fffff]
[    0.291565] pci_bus 0000:00: resource 4 [io  0x0070-0x0077]
[    0.291571] pci_bus 0000:00: resource 5 [io  0x0000-0x006f window]
[    0.291576] pci_bus 0000:00: resource 6 [io  0x0078-0x0cf7 window]
[    0.291582] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.291587] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000fffff window]
[    0.291592] pci_bus 0000:00: resource 9 [mem 0x70000001-0xcfffffff window]
[    0.291598] pci_bus 0000:00: resource 10 [mem 0xe0000000-0xefffffff window]
[    0.291603] pci_bus 0000:00: resource 11 [mem 0xfea00000-0xfeafffff window]
[    0.291609] pci_bus 0000:00: resource 12 [mem 0xfed00000-0xfed003ff window]
[    0.291614] pci_bus 0000:00: resource 13 [mem 0xfed01000-0xfed01fff window]
[    0.291620] pci_bus 0000:00: resource 14 [mem 0xfed03000-0xfed03fff window]
[    0.291625] pci_bus 0000:00: resource 15 [mem 0xfed06000-0xfed06fff window]
[    0.291630] pci_bus 0000:00: resource 16 [mem 0xfed08000-0xfed09fff window]
[    0.291636] pci_bus 0000:00: resource 17 [mem 0xfed80000-0xfedbffff window]
[    0.291641] pci_bus 0000:00: resource 18 [mem 0xfed1c000-0xfed1cfff window]
[    0.291646] pci_bus 0000:00: resource 19 [mem 0xfee00000-0xfeefffff window]
[    0.291652] pci_bus 0000:03: resource 0 [io  0xe000-0xefff]
[    0.291657] pci_bus 0000:03: resource 1 [mem 0xa1200000-0xa12fffff]
[    0.291663] pci_bus 0000:04: resource 0 [io  0xd000-0xdfff]
[    0.291668] pci_bus 0000:04: resource 1 [mem 0xa1100000-0xa11fffff]
[    0.292250] PCI: CLS 64 bytes, default 64
[    0.292285] DMAR: Host address width 39
[    0.292290] DMAR: DRHD base: 0x000000fed64000 flags: 0x0
[    0.292315] DMAR: dmar0: reg_base_addr fed64000 ver 1:0 cap 1c0000c40660462 ecap 9e2ff0505e
[    0.292324] DMAR: DRHD base: 0x000000fed65000 flags: 0x1
[    0.292338] DMAR: dmar1: reg_base_addr fed65000 ver 1:0 cap d2008c40660462 ecap f050da
[    0.292345] Unpacking initramfs...
[    0.292348] DMAR: RMRR base: 0x0000006d557000 end: 0x0000006d576fff
[    0.292359] DMAR: RMRR base: 0x0000006f800000 end: 0x0000007fffffff
[    0.292372] DMAR: No ATSR found
[    0.292375] DMAR: No SATC found
[    0.292379] DMAR: IOMMU feature fl1gp_support inconsistent
[    0.292382] DMAR: IOMMU feature pgsel_inv inconsistent
[    0.292386] DMAR: IOMMU feature nwfs inconsistent
[    0.292389] DMAR: IOMMU feature eafs inconsistent
[    0.292393] DMAR: IOMMU feature prs inconsistent
[    0.292396] DMAR: IOMMU feature nest inconsistent
[    0.292399] DMAR: IOMMU feature mts inconsistent
[    0.292403] DMAR: IOMMU feature sc_support inconsistent
[    0.292406] DMAR: IOMMU feature dev_iotlb_support inconsistent
[    0.292416] DMAR: dmar0: Using Queued invalidation
[    0.292431] DMAR: dmar1: Using Queued invalidation
[    0.292690] pci 0000:00:02.0: Adding to iommu group 0
[    0.296032] pci 0000:00:00.0: Adding to iommu group 1
[    0.296063] pci 0000:00:00.1: Adding to iommu group 1
[    0.296083] pci 0000:00:0e.0: Adding to iommu group 2
[    0.296108] pci 0000:00:0f.0: Adding to iommu group 3
[    0.296128] pci 0000:00:12.0: Adding to iommu group 4
[    0.296149] pci 0000:00:13.0: Adding to iommu group 5
[    0.296170] pci 0000:00:13.1: Adding to iommu group 6
[    0.296191] pci 0000:00:13.2: Adding to iommu group 7
[    0.296214] pci 0000:00:13.3: Adding to iommu group 8
[    0.296237] pci 0000:00:15.0: Adding to iommu group 9
[    0.296265] pci 0000:00:1f.0: Adding to iommu group 10
[    0.296285] pci 0000:00:1f.1: Adding to iommu group 10
[    0.296311] pci 0000:03:00.0: Adding to iommu group 11
[    0.296334] pci 0000:04:00.0: Adding to iommu group 12
[    0.297432] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    0.297450] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.297454] software IO TLB: mapped [mem 0x000000005f31f000-0x000000006331f000] (64MB)
[    0.297617] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[    0.297627] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[    0.297632] RAPL PMU: hw unit of domain package 2^-14 Joules
[    0.297636] RAPL PMU: hw unit of domain dram 2^-14 Joules
[    0.297640] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[    0.301497] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x159647815e3, max_idle_ns: 440795269835 ns
[    0.311281] clocksource: Switched to clocksource tsc
[    0.312618] workingset: timestamp_bits=62 max_order=20 bucket_order=0
[    0.341883] xor: measuring software checksum speed
[    0.342287]    prefetch64-sse  :  8418 MB/sec
[    0.342751]    generic_sse     :  7174 MB/sec
[    0.342755] xor: using function: prefetch64-sse (8418 MB/sec)
[    0.342809] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)
[    0.342817] io scheduler mq-deadline registered
[    0.345208] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    0.345224] ACPI: button: Power Button [PWRB]
[    0.348044] thermal LNXTHERM:00: registered as thermal_zone0
[    0.348055] ACPI: thermal: Thermal Zone [TZ01] (50 C)
[    0.437748] Freeing initrd memory: 22692K
[    0.532061] ACPI: bus type drm_connector registered
[    0.532400] i915 0000:00:02.0: [drm] Found GEMINILAKE (device ID 3185) display version 10.00
[    0.533168] i915 0000:00:02.0: [drm] VT-d active for gfx access
[    0.533180] i915 0000:00:02.0: vgaarb: deactivate vga console
[    0.533265] i915 0000:00:02.0: [drm] Using Transparent Hugepages
[    0.533349] i915 0000:00:02.0: [drm] couldn't get memory information
[    0.533617] i915 0000:00:02.0: vgaarb: VGA decodes changed: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[    0.561473] i915 0000:00:02.0: [drm] Applying Increase DDI Disabled quirk
[    0.562049] i915 0000:00:02.0: Direct firmware load for i915/glk_dmc_ver1_04.bin failed with error -2
[    0.562062] i915 0000:00:02.0: [drm] Failed to load DMC firmware i915/glk_dmc_ver1_04.bin (-ENOENT). Disabling runtime power management.
[    0.562072] i915 0000:00:02.0: [drm] DMC firmware homepage: https://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
[    4.031258] i915 0000:00:02.0: [drm] [ENCODER:147:DDI A/PHY A] failed to retrieve link info, disabling eDP
[    4.034527] [drm] Initialized i915 1.6.0 for 0000:00:02.0 on minor 0
[    4.035994] ACPI: video: Video Device [GFX0] (multi-head: yes  rom: no  post: no)
[    4.036408] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/LNXVIDEO:00/input/input1
[    4.071894] i915 0000:00:02.0: [drm] Cannot find any crtc or sizes
[    4.072748] ahci 0000:00:12.0: version 3.0
[    4.091339] ahci 0000:00:12.0: AHCI vers 0001.0301, 32 command slots, 6 Gbps, SATA mode
[    4.091352] ahci 0000:00:12.0: 2/2 ports implemented (port mask 0x3)
[    4.091358] ahci 0000:00:12.0: flags: 64bit ncq sntf clo only pmp pio slum part deso sadm sds apst 
[    4.091891] scsi host0: ahci
[    4.092289] scsi host1: ahci
[    4.092350] ata1: SATA max UDMA/133 abar m2048@0xa1317000 port 0xa1317100 irq 128 lpm-pol 0
[    4.092360] ata2: SATA max UDMA/133 abar m2048@0xa1317000 port 0xa1317180 irq 128 lpm-pol 0
[    4.092595] ahci 0000:04:00.0: SSS flag set, parallel bus scan disabled
[    4.092631] ahci 0000:04:00.0: AHCI vers 0001.0200, 32 command slots, 6 Gbps, SATA mode
[    4.092639] ahci 0000:04:00.0: 2/2 ports implemented (port mask 0x3)
[    4.092645] ahci 0000:04:00.0: flags: 64bit ncq sntf stag led clo pmp pio slum part ccc 
[    4.093058] scsi host2: ahci
[    4.093325] scsi host3: ahci
[    4.093380] ata3: SATA max UDMA/133 abar m512@0xa1100000 port 0xa1100100 irq 129 lpm-pol 0
[    4.093390] ata4: SATA max UDMA/133 abar m512@0xa1100000 port 0xa1100180 irq 129 lpm-pol 0
[    4.093734] xhci_hcd 0000:00:15.0: xHCI Host Controller
[    4.093824] xhci_hcd 0000:00:15.0: new USB bus registered, assigned bus number 1
[    4.095006] xhci_hcd 0000:00:15.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810
[    4.095240] xhci_hcd 0000:00:15.0: xHCI Host Controller
[    4.095324] xhci_hcd 0000:00:15.0: new USB bus registered, assigned bus number 2
[    4.095334] xhci_hcd 0000:00:15.0: Host supports USB 3.0 SuperSpeed
[    4.095491] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.11
[    4.095504] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.095511] usb usb1: Product: xHCI Host Controller
[    4.095516] usb usb1: Manufacturer: Linux 6.11.6 xhci-hcd
[    4.095521] usb usb1: SerialNumber: 0000:00:15.0
[    4.095763] hub 1-0:1.0: USB hub found
[    4.095815] hub 1-0:1.0: 9 ports detected
[    4.098089] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 6.11
[    4.098100] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    4.098107] usb usb2: Product: xHCI Host Controller
[    4.098112] usb usb2: Manufacturer: Linux 6.11.6 xhci-hcd
[    4.098117] usb usb2: SerialNumber: 0000:00:15.0
[    4.098283] hub 2-0:1.0: USB hub found
[    4.098315] hub 2-0:1.0: 7 ports detected
[    4.100267] i8042: PNP: No PS/2 controller found.
[    4.100479] rtc_cmos 00:04: RTC can wake from S4
[    4.101288] rtc_cmos 00:04: registered as rtc0
[    4.101436] rtc_cmos 00:04: setting system clock to 2024-11-03T16:10:41 UTC (1730650241)
[    4.101488] rtc_cmos 00:04: alarms up to one month, y3k, 242 bytes nvram
[    4.101747] i801_smbus 0000:00:1f.1: SPD Write Disable is set
[    4.101786] i801_smbus 0000:00:1f.1: SMBus using PCI interrupt
[    4.102215] i2c i2c-3: Successfully instantiated SPD at 0x50
[    4.102358] intel_pstate: Intel P-state driver initializing
[    4.102815] hid: raw HID events driver (C) Jiri Kosina
[    4.102924] usbcore: registered new interface driver usbhid
[    4.102928] usbhid: USB HID core driver
[    4.102957] intel_rapl_common: Found RAPL domain package
[    4.102963] intel_rapl_common: Found RAPL domain core
[    4.102968] intel_rapl_common: Found RAPL domain uncore
[    4.102972] intel_rapl_common: Found RAPL domain dram
[    4.103665] Initializing XFRM netlink socket
[    4.103701] NET: Registered PF_INET6 protocol family
[    4.104015] Segment Routing with IPv6
[    4.104028] In-situ OAM (IOAM) with IPv6
[    4.104066] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver
[    4.104200] NET: Registered PF_PACKET protocol family
[    4.104205] NET: Registered PF_KEY protocol family
[    4.104574] microcode: Current revision: 0x00000042
[    4.104579] microcode: Updated early from: 0x00000032
[    4.104752] IPI shorthand broadcast: enabled
[    4.106620] sched_clock: Marking stable (4113485456, -8753008)->(4119803534, -15071086)
[    4.111023] Btrfs loaded, zoned=no, fsverity=no
[    4.111230] clk: Disabling unused clocks
[    4.151902] i915 0000:00:02.0: [drm] Cannot find any crtc or sizes
[    4.191866] i915 0000:00:02.0: [drm] Cannot find any crtc or sizes
[    4.431342] ata3: SATA link down (SStatus 0 SControl 300)
[    4.641320] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    4.641344] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    4.641899] ata1.00: ATA-9: WDC WD20EFRX-68EUZN0, 82.00A82, max UDMA/133
[    4.642261] ata1.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    4.642995] ata1.00: configured for UDMA/133
[    4.643288] scsi 0:0:0:0: Direct-Access     ATA      WDC WD20EFRX-68E 0A82 PQ: 0 ANSI: 5
[    4.644428] sd 0:0:0:0: [sda] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    4.644435] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    4.644458] sd 0:0:0:0: [sda] Write Protect is off
[    4.644467] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    4.644531] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.644631] sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes
[    4.648095] ata2.00: ATA-8: WDC WD20EARX-00PASB0, 51.0AB51, max UDMA/133
[    4.648662] ata2.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    4.655276] ata2.00: configured for UDMA/133
[    4.655351] scsi 1:0:0:0: Direct-Access     ATA      WDC WD20EARX-00P AB51 PQ: 0 ANSI: 5
[    4.655814] sd 1:0:0:0: [sdb] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    4.655821] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    4.655840] sd 1:0:0:0: [sdb] Write Protect is off
[    4.655847] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    4.655913] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.656011] sd 1:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes
[    4.744847]  sda: sda1 sda2 sda3 sda4
[    4.745362] sd 0:0:0:0: [sda] Attached SCSI disk
[    4.754801]  sdb: sdb1 sdb2 sdb3 sdb4
[    4.755154] sd 1:0:0:0: [sdb] Attached SCSI disk
[    4.991313] ata4: SATA link down (SStatus 0 SControl 300)
[    4.991895] Freeing unused kernel image (initmem) memory: 1164K
[    4.991907] Write protecting the kernel read-only data: 18432k
[    4.992520] Freeing unused kernel image (rodata/data gap) memory: 748K
[    4.992527] Run /init as init process
[    4.992529]   with arguments:
[    4.992530]     /init
[    4.992531]   with environment:
[    4.992532]     HOME=/
[    4.992533]     TERM=linux
[    5.048176] r8169 0000:03:00.0: can't disable ASPM; OS doesn't have ASPM control
[    5.084105] r8169 0000:03:00.0 eth0: RTL8168h/8111h, 70:85:c2:71:79:39, XID 541, IRQ 131
[    5.084120] r8169 0000:03:00.0 eth0: jumbo features [frames: 9194 bytes, tx checksumming: ko]
[    5.487022] BTRFS: device label ROOT.B devid 2 transid 3702882 /dev/sda2 (8:2) scanned by (udev-worker) (131)
[    5.569173] BTRFS: device label SRV.B devid 2 transid 1832248 /dev/sda4 (8:4) scanned by (udev-worker) (144)
[    5.573530] BTRFS: device label ROOT.B devid 1 transid 3702882 /dev/sdb2 (8:18) scanned by (udev-worker) (129)
[    5.673121] BTRFS: device label SRV.B devid 1 transid 1832248 /dev/sdb4 (8:20) scanned by (udev-worker) (130)
[    5.772953] BTRFS info (device sdb2): first mount of filesystem b62736c7-814e-45d1-8d39-fc9c33e06eb2
[    5.772978] BTRFS info (device sdb2): using crc32c (crc32c-intel) checksum algorithm
[    5.772988] BTRFS info (device sdb2): disk space caching is enabled
[    5.772991] BTRFS warning (device sdb2): space cache v1 is being deprecated and will be removed in a future release, please use -o space_cache=v2
[    7.526995] systemd[1]: Inserted module 'autofs4'
[    7.555169] systemd[1]: systemd 256.7-1-arch running in system mode (+PAM +AUDIT -SELINUX -APPARMOR -IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK +XKBCOMMON +UTMP -SYSVINIT +LIBARCHIVE)
[    7.555187] systemd[1]: Detected architecture x86-64.
[    7.749308] systemd[1]: bpf-restrict-fs: BPF LSM hook not enabled in the kernel, BPF LSM not supported.
[    8.235140] systemd-ssh-generator[232]: Binding SSH to AF_UNIX socket /run/ssh-unix-local/socket.
[    8.235153] systemd-ssh-generator[232]: → connect via 'ssh .host' locally
[    9.583113] systemd[1]: Queued start job for default target Graphical Interface.
[    9.584991] systemd[1]: Created slice Slice /system/dirmngr.
[    9.585390] systemd[1]: Created slice Slice /system/getty.
[    9.585698] systemd[1]: Created slice Slice /system/gpg-agent.
[    9.586004] systemd[1]: Created slice Slice /system/gpg-agent-browser.
[    9.586310] systemd[1]: Created slice Slice /system/gpg-agent-extra.
[    9.586615] systemd[1]: Created slice Slice /system/gpg-agent-ssh.
[    9.586923] systemd[1]: Created slice Slice /system/keyboxd.
[    9.587236] systemd[1]: Created slice Slice /system/modprobe.
[    9.587537] systemd[1]: Created slice Slice /system/systemd-fsck.
[    9.587711] systemd[1]: Created slice User and Session Slice.
[    9.587803] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[    9.587887] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    9.588111] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    9.588176] systemd[1]: Expecting device /dev/disk/by-uuid/04dd198c-700a-4b69-b53e-e5c08622e147...
[    9.588221] systemd[1]: Expecting device /dev/disk/by-uuid/4941-740C...
[    9.588258] systemd[1]: Expecting device /dev/disk/by-uuid/552b7b16-7dff-4b3e-96fc-dde1796b5c2e...
[    9.588301] systemd[1]: Expecting device /dev/disk/by-uuid/a368f90a-93f0-4361-a683-b660b1f35fd3...
[    9.588352] systemd[1]: Reached target Local Encrypted Volumes.
[    9.588413] systemd[1]: Reached target Local Integrity Protected Volumes.
[    9.588485] systemd[1]: Reached target Path Units.
[    9.588531] systemd[1]: Reached target Remote File Systems.
[    9.588579] systemd[1]: Reached target Slice Units.
[    9.588640] systemd[1]: Reached target Local Verity Protected Volumes.
[    9.588764] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[    9.590671] systemd[1]: Listening on Process Core Dump Socket.
[    9.591948] systemd[1]: Listening on Credential Encryption/Decryption.
[    9.592091] systemd[1]: Listening on Journal Socket (/dev/log).
[    9.592236] systemd[1]: Listening on Journal Sockets.
[    9.592417] systemd[1]: Listening on Network Service Netlink Socket.
[    9.592500] systemd[1]: TPM PCR Measurements was skipped because of an unmet condition check (ConditionSecurity=measured-uki).
[    9.592529] systemd[1]: Make TPM PCR Policy was skipped because of an unmet condition check (ConditionSecurity=measured-uki).
[    9.592626] systemd[1]: Listening on udev Control Socket.
[    9.592734] systemd[1]: Listening on udev Kernel Socket.
[    9.607415] systemd[1]: Mounting Huge Pages File System...
[    9.608059] systemd[1]: Mounting POSIX Message Queue File System...
[    9.608669] systemd[1]: Mounting Kernel Debug File System...
[    9.608798] systemd[1]: Kernel Trace File System was skipped because of an unmet condition check (ConditionPathExists=/sys/kernel/tracing).
[    9.610359] systemd[1]: Starting Create List of Static Device Nodes...
[    9.613377] systemd[1]: Starting Load Kernel Module configfs...
[    9.662001] systemd[1]: Starting Load Kernel Module dm_mod...
[    9.662959] systemd[1]: Starting Load Kernel Module drm...
[    9.663784] systemd[1]: Starting Load Kernel Module fuse...
[    9.667630] systemd[1]: Starting Load Kernel Module loop...
[    9.667878] systemd[1]: Clear Stale Hibernate Storage Info was skipped because of an unmet condition check (ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67).
[    9.668257] systemd[1]: systemd-journald.service: unit configures an IP firewall, but the local system does not support BPF/cgroup firewalling.
[    9.668266] systemd[1]: systemd-journald.service: (This warning is only shown for the first unit using IP firewalling.)
[    9.668976] systemd[1]: Starting Journal Service...
[    9.669544] systemd[1]: Load Kernel Modules was skipped because no trigger condition checks were met.
[    9.669610] systemd[1]: TPM PCR Machine ID Measurement was skipped because of an unmet condition check (ConditionSecurity=measured-uki).
[    9.670408] systemd[1]: Starting Remount Root and Kernel File Systems...
[    9.671130] systemd[1]: Starting Apply Kernel Variables...
[    9.671230] systemd[1]: Early TPM SRK Setup was skipped because of an unmet condition check (ConditionSecurity=measured-uki).
[    9.675998] systemd[1]: Starting Load udev Rules from Credentials...
[    9.676897] systemd[1]: Starting Coldplug All udev Devices...
[    9.732400] systemd[1]: modprobe@dm_mod.service: Deactivated successfully.
[    9.732554] systemd[1]: Finished Load Kernel Module dm_mod.
[    9.734853] systemd[1]: Finished Create List of Static Device Nodes.
[    9.735181] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[    9.735302] systemd[1]: Finished Load Kernel Module configfs.
[    9.735581] systemd[1]: modprobe@drm.service: Deactivated successfully.
[    9.735700] systemd[1]: Finished Load Kernel Module drm.
[    9.736008] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[    9.736127] systemd[1]: Finished Load Kernel Module fuse.
[    9.736427] systemd[1]: FUSE Control File System was skipped because of an unmet condition check (ConditionPathExists=/sys/fs/fuse/connections).
[    9.736520] systemd[1]: Kernel Configuration File System was skipped because of an unmet condition check (ConditionPathExists=/sys/kernel/config).
[    9.737339] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...
[    9.758487] systemd[1]: Mounted Kernel Debug File System.
[    9.792546] systemd[1]: Mounted Huge Pages File System.
[    9.792774] systemd[1]: Mounted POSIX Message Queue File System.
[    9.793001] systemd[1]: Finished Load udev Rules from Credentials.
[    9.810414] loop: module loaded
[    9.811074] systemd[1]: modprobe@loop.service: Deactivated successfully.
[    9.811212] systemd[1]: Finished Load Kernel Module loop.
[    9.811461] systemd[1]: Repartition Root Disk was skipped because no trigger condition checks were met.
[    9.816037] systemd[1]: Finished Apply Kernel Variables.
[    9.831161] systemd-journald[245]: Collecting audit messages is disabled.
[    9.875737] systemd[1]: Finished Coldplug All udev Devices.
[    9.875928] systemd[1]: Started Journal Service.
[   12.074589] systemd-journald[245]: Received client request to flush runtime journal.
[   13.513131] r8169 0000:03:00.0 eno1: renamed from eth0
[   15.418041] Adding 524284k swap on /dev/sda3.  Priority:-2 extents:1 across:524284k 
[   15.535207] Adding 524284k swap on /dev/sdb3.  Priority:-3 extents:1 across:524284k 
[   15.551458] BTRFS info (device sdb4): first mount of filesystem a368f90a-93f0-4361-a683-b660b1f35fd3
[   15.551478] BTRFS info (device sdb4): using crc32c (crc32c-intel) checksum algorithm
[   15.551488] BTRFS info (device sdb4): using free-space-tree
[   20.476996] BTRFS info (device sdb4): rebuilding free space tree
[   40.071288] Generic FE-GE Realtek PHY r8169-0-300:00: attached PHY driver (mii_bus:phy_addr=r8169-0-300:00, irq=MAC)
[   40.331565] r8169 0000:03:00.0 eno1: Link is Down
[   42.915618] r8169 0000:03:00.0 eno1: Link is Up - 1Gbps/Full - flow control rx/tx
Heiner Kallweit Nov. 4, 2024, 1:57 p.m. UTC | #3
On 04.11.2024 13:47, Felix Braun wrote:
> On 03.11.2024 23:21 +0100 Heiner Kallweit wrote:  
>> Thanks for the report. 6.2 has been out for quite some time, and this is  
>> the first such report. So I don't think there's a general problem.
> 
> I switched from 6.1 (stable) to 6.6 (stable) only recently and then I didn't notice the speed degradation for quite some time.
> 
>> Can you please provide a full dmesg log and elaborate on the type of traffic  
>> and how you measure the speed? BTW: With 100MB/s you refer to 100MBit/s?
> 
> Nono, I mean 100MBytes/s ;-) My testcase is transferring a large file over SMB and looking at the transfer speed as reported by KDE. (I'm attaching a full dmsg of a boot of a 6.11.6 kernel with only irq_coalescing commented out otherwise as released.)
> 
This test case involves several layers. To rule out conflicts on higher levels:
Can you test with iperf to another machine in the same local network?

SMB file transfers are a standard use case, so I would have expected at least some
complaints if performance drops to 10%. So something seems to be special with your system.

>> Also interesting would be whether there are any errors or missed packets  
>> in the ethtool -S <if> output.
> 
> No errors or misses in either patched or unpatched kernel.
> 
>> Instead of commenting out this line you can also adjust the values from userspace:  
>> /sys/class/net/<if>/gro_flush_timeout  
>> /sys/class/net/<if>/napi_defer_hard_irqs  
>> Does increasing the gro_flush_timeout value change something for you?
> 
> That's cool. I've reverted to unchanged 6.11.6 and if I set napi_defer_hard_irqs to 0 I'm back to 100 MBytes/s. Playing with gro_flush_timeout while napi_defer_hard_irqs is set to 1 does not seem to have any effect on the trasfer speed. Default value is 20000. I have tried some values between 1000 and 200000.
> 
>> Somewhat strange is that lspci shows ASPM as disabled in LnkCtl, but  
>> L1 sub-states are enabled in L1SubCtl1. Do you have any downstream kernel code  
>> changes or any specific ASPM settings?
> 
> No. Other than patching the default value for interrupt coalescing, I'm running a vanilla kernel. Maybe it is because I didn't enable ASPM in the kernel configuration?
> 
Would be worth a try to see how system behaves with ASPM enabled in the kernel.
Even though BIOS denies ASPM access for the kernel:
"can't disable ASPM; OS doesn't have ASPM control"

> Thanks for taking this up.
> 
> Regards  
> Felix

Heiner
Felix Braun Nov. 5, 2024, 7:57 p.m. UTC | #4
On 04.11.2024 14:57 +0100 Heiner Kallweit wrote:
> On 04.11.2024 13:47, Felix Braun wrote:
> > Nono, I mean 100MBytes/s ;-) My testcase is transferring a large file over
SMB and looking at the transfer speed as reported by KDE. (I'm attaching a full
dmsg of a boot of a 6.11.6 kernel with only irq_coalescing commented out
otherwise as released.)
> >
> 
> This test case involves several layers. To rule out conflicts on higher
levels:  
> Can you test with iperf to another machine in the same local network?

Measuring the performance with iperf3 I still see a difference in throughput by
a factor of 3:

WITH napi_defer_hard_irqs=0
===========================
[  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 41716 connected to
2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   112 MBytes   941 Mbits/sec    0    315 KBytes
[  5]   1.00-2.00   sec   110 MBytes   927 Mbits/sec    0    340 KBytes
[  5]   2.00-3.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
[  5]   3.00-4.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
[  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    372 KBytes
[  5]   5.00-6.00   sec   111 MBytes   929 Mbits/sec    0    372 KBytes
[  5]   6.00-7.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
[  5]   7.00-8.00   sec   111 MBytes   932 Mbits/sec    0    372 KBytes
[  5]   8.00-9.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
[  5]   9.00-10.00  sec   111 MBytes   928 Mbits/sec    0    372 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec  1.08 GBytes   929 Mbits/sec    0             sender
[  5]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec                  receiver

WITH napi_defer_hard_irqs=1
===========================
Connecting to host leporello, port 5201
[  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 42338 connected to
2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec  37.0 MBytes   310 Mbits/sec    0    806 KBytes
[  5]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
[  5]   2.00-3.00   sec  35.1 MBytes   294 Mbits/sec    0    806 KBytes
[  5]   3.00-4.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
[  5]   4.00-5.00   sec  35.2 MBytes   296 Mbits/sec    0    806 KBytes
[  5]   5.00-6.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
[  5]   6.00-7.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
[  5]   7.00-8.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
[  5]   8.00-9.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
[  5]   9.00-10.00  sec  35.2 MBytes   295 Mbits/sec    0    806 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-10.00  sec   352 MBytes   296 Mbits/sec    0             sender
[  5]   0.00-10.02  sec   349 MBytes   292 Mbits/sec                  receiver


> Would be worth a try to see how system behaves with ASPM enabled in the
kernel.  
> Even though BIOS denies ASPM access for the kernel:  
> "can't disable ASPM; OS doesn't have ASPM control"

I noticed that I disabled ASPM in the BIOS. So far I've not been able to find a
BIOS setting that makes that warning go away.

If you think, that the current settings are the best default values for most
users, I'd defer your better knowledge of the hardware. At least I'm happy
because I can get my performance back by disabling IRQ coalescing on a vanilla
kernel.

Regards
Felix
Heiner Kallweit Nov. 5, 2024, 9:28 p.m. UTC | #5
On 05.11.2024 20:57, Felix Braun wrote:
> 
> On 04.11.2024 14:57 +0100 Heiner Kallweit wrote:
>> On 04.11.2024 13:47, Felix Braun wrote:
>>> Nono, I mean 100MBytes/s ;-) My testcase is transferring a large file over
> SMB and looking at the transfer speed as reported by KDE. (I'm attaching a full
> dmsg of a boot of a 6.11.6 kernel with only irq_coalescing commented out
> otherwise as released.)
>>>
>>
>> This test case involves several layers. To rule out conflicts on higher
> levels:  
>> Can you test with iperf to another machine in the same local network?
> 
> Measuring the performance with iperf3 I still see a difference in throughput by
> a factor of 3:
> 
> WITH napi_defer_hard_irqs=0
> ===========================
> [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 41716 connected to
> 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> [  5]   0.00-1.00   sec   112 MBytes   941 Mbits/sec    0    315 KBytes
> [  5]   1.00-2.00   sec   110 MBytes   927 Mbits/sec    0    340 KBytes
> [  5]   2.00-3.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> [  5]   3.00-4.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> [  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    372 KBytes
> [  5]   5.00-6.00   sec   111 MBytes   929 Mbits/sec    0    372 KBytes
> [  5]   6.00-7.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> [  5]   7.00-8.00   sec   111 MBytes   932 Mbits/sec    0    372 KBytes
> [  5]   8.00-9.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> [  5]   9.00-10.00  sec   111 MBytes   928 Mbits/sec    0    372 KBytes
> - - - - - - - - - - - - - - - - - - - - - - - - -
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-10.00  sec  1.08 GBytes   929 Mbits/sec    0             sender
> [  5]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec                  receiver
> 
> WITH napi_defer_hard_irqs=1
> ===========================
> Connecting to host leporello, port 5201
> [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 42338 connected to
> 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> [  5]   0.00-1.00   sec  37.0 MBytes   310 Mbits/sec    0    806 KBytes
> [  5]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> [  5]   2.00-3.00   sec  35.1 MBytes   294 Mbits/sec    0    806 KBytes
> [  5]   3.00-4.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> [  5]   4.00-5.00   sec  35.2 MBytes   296 Mbits/sec    0    806 KBytes
> [  5]   5.00-6.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> [  5]   6.00-7.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> [  5]   7.00-8.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> [  5]   8.00-9.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> [  5]   9.00-10.00  sec  35.2 MBytes   295 Mbits/sec    0    806 KBytes
> - - - - - - - - - - - - - - - - - - - - - - - - -
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-10.00  sec   352 MBytes   296 Mbits/sec    0             sender
> [  5]   0.00-10.02  sec   349 MBytes   292 Mbits/sec                  receiver
> 
Could you please test also in the other direction (with option -R)?

> 
>> Would be worth a try to see how system behaves with ASPM enabled in the
> kernel.  
>> Even though BIOS denies ASPM access for the kernel:  
>> "can't disable ASPM; OS doesn't have ASPM control"
> 
> I noticed that I disabled ASPM in the BIOS. So far I've not been able to find a
> BIOS setting that makes that warning go away.
> 
> If you think, that the current settings are the best default values for most
> users, I'd defer your better knowledge of the hardware. At least I'm happy
> because I can get my performance back by disabling IRQ coalescing on a vanilla
> kernel.
> 
On a small N100-based system I can't reproduce the issue with the same chip version.
Even 2.5Gbps works with full line speed on this system.
OK, your CPU is even weaker, but this still shouldn't cause such a performance drop.
More the opposite, as software interrupt coalescing reduces the CPU load.
However there's nothing special with your system, according to the dmesg log.

> Regards
> Felix

Heiner
Felix Braun Nov. 6, 2024, 7:17 a.m. UTC | #6
On 05.11.2024 22:28 +0100 Heiner Kallweit wrote:
> On 05.11.2024 20:57, Felix Braun wrote:
> > 
> > Measuring the performance with iperf3 I still see a difference in throughput
by
> > a factor of 3:
> > 
> > WITH napi_defer_hard_irqs=0
> > ===========================
> > [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 41716 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> > [  5]   0.00-1.00   sec   112 MBytes   941 Mbits/sec    0    315 KBytes
> > [  5]   1.00-2.00   sec   110 MBytes   927 Mbits/sec    0    340 KBytes
> > [  5]   2.00-3.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> > [  5]   3.00-4.00   sec   111 MBytes   930 Mbits/sec    0    372 KBytes
> > [  5]   4.00-5.00   sec   110 MBytes   926 Mbits/sec    0    372 KBytes
> > [  5]   5.00-6.00   sec   111 MBytes   929 Mbits/sec    0    372 KBytes
> > [  5]   6.00-7.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> > [  5]   7.00-8.00   sec   111 MBytes   932 Mbits/sec    0    372 KBytes
> > [  5]   8.00-9.00   sec   110 MBytes   924 Mbits/sec    0    372 KBytes
> > [  5]   9.00-10.00  sec   111 MBytes   928 Mbits/sec    0    372 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval           Transfer     Bitrate         Retr
> > [  5]   0.00-10.00  sec  1.08 GBytes   929 Mbits/sec    0             sender
> > [  5]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec                 
receiver
> > 
> > WITH napi_defer_hard_irqs=1
> > ===========================
> > Connecting to host leporello, port 5201
> > [  5] local 2001:a61:11c6:9501:982a:b19f:94fc:71d1 port 42338 connected to
> > 2001:a61:11c6:9501:97a8:b80a:4317:435e port 5201
> > [ ID] Interval           Transfer     Bitrate         Retr  Cwnd
> > [  5]   0.00-1.00   sec  37.0 MBytes   310 Mbits/sec    0    806 KBytes
> > [  5]   1.00-2.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   2.00-3.00   sec  35.1 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   3.00-4.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   4.00-5.00   sec  35.2 MBytes   296 Mbits/sec    0    806 KBytes
> > [  5]   5.00-6.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   6.00-7.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> > [  5]   7.00-8.00   sec  34.9 MBytes   293 Mbits/sec    0    806 KBytes
> > [  5]   8.00-9.00   sec  35.0 MBytes   294 Mbits/sec    0    806 KBytes
> > [  5]   9.00-10.00  sec  35.2 MBytes   295 Mbits/sec    0    806 KBytes
> > - - - - - - - - - - - - - - - - - - - - - - - - -
> > [ ID] Interval           Transfer     Bitrate         Retr
> > [  5]   0.00-10.00  sec   352 MBytes   296 Mbits/sec    0             sender
> > [  5]   0.00-10.02  sec   349 MBytes   292 Mbits/sec                 
receiver
> >
> 
> Could you please test also in the other direction (with option -R)?
> 
WITH napi_defer_hard_irqs=0
===========================
Connecting to host leporello, port 5201
[  5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33400 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[  7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 33414 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec   112 MBytes   939 Mbits/sec    0    409 KBytes
[  7][RX-C]   0.00-1.00   sec   107 MBytes   893 Mbits/sec
[  5][TX-C]   1.00-2.00   sec   110 MBytes   921 Mbits/sec    0    430 KBytes
[  7][RX-C]   1.00-2.00   sec   107 MBytes   896 Mbits/sec
[  5][TX-C]   2.00-3.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   2.00-3.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   3.00-4.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   3.00-4.00   sec   107 MBytes   898 Mbits/sec
[  5][TX-C]   4.00-5.00   sec   110 MBytes   925 Mbits/sec    0    430 KBytes
[  7][RX-C]   4.00-5.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   5.00-6.00   sec   110 MBytes   924 Mbits/sec    0    430 KBytes
[  7][RX-C]   5.00-6.00   sec   107 MBytes   895 Mbits/sec
[  5][TX-C]   6.00-7.00   sec   110 MBytes   926 Mbits/sec    0    430 KBytes
[  7][RX-C]   6.00-7.00   sec   106 MBytes   892 Mbits/sec
[  5][TX-C]   7.00-8.00   sec   110 MBytes   923 Mbits/sec    0    430 KBytes
[  7][RX-C]   7.00-8.00   sec   107 MBytes   894 Mbits/sec
[  5][TX-C]   8.00-9.00   sec   111 MBytes   930 Mbits/sec    0    430 KBytes
[  7][RX-C]   8.00-9.00   sec   107 MBytes   895 Mbits/sec
[  5][TX-C]   9.00-10.00  sec   111 MBytes   932 Mbits/sec    0    526 KBytes
[  7][RX-C]   9.00-10.00  sec   107 MBytes   895 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec  1.08 GBytes   928 Mbits/sec    0            
sender
[  5][TX-C]   0.00-10.00  sec  1.08 GBytes   925 Mbits/sec                 
receiver
[  7][RX-C]   0.00-10.00  sec  1.04 GBytes   895 Mbits/sec    0            
sender
[  7][RX-C]   0.00-10.00  sec  1.04 GBytes   894 Mbits/sec                 
receiver

WITH napi_defer_hard_irqs=1
===========================
Connecting to host leporello, port 5201
[  5] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50504 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[  7] local 2001:a61:11db:401:95c6:dca7:5be7:e7f0 port 50514 connected to
2001:a61:11db:401:f969:3328:8a89:ebd2 port 5201
[ ID][Role] Interval           Transfer     Bitrate         Retr  Cwnd
[  5][TX-C]   0.00-1.00   sec  36.8 MBytes   308 Mbits/sec    0    989 KBytes
[  7][RX-C]   0.00-1.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   1.00-2.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   1.00-2.00   sec  12.6 MBytes   106 Mbits/sec
[  5][TX-C]   2.00-3.00   sec  33.1 MBytes   278 Mbits/sec    0    989 KBytes
[  7][RX-C]   2.00-3.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   3.00-4.00   sec  36.1 MBytes   303 Mbits/sec    0    989 KBytes
[  7][RX-C]   3.00-4.00   sec  12.5 MBytes   105 Mbits/sec
[  5][TX-C]   4.00-5.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   4.00-5.00   sec  12.1 MBytes   102 Mbits/sec
[  5][TX-C]   5.00-6.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   5.00-6.00   sec  12.1 MBytes   102 Mbits/sec
[  5][TX-C]   6.00-7.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   6.00-7.00   sec  11.9 MBytes  99.6 Mbits/sec
[  5][TX-C]   7.00-8.00   sec  34.8 MBytes   292 Mbits/sec    0    989 KBytes
[  7][RX-C]   7.00-8.00   sec  12.0 MBytes   101 Mbits/sec
[  5][TX-C]   8.00-9.00   sec  34.6 MBytes   290 Mbits/sec    0    989 KBytes
[  7][RX-C]   8.00-9.00   sec  11.9 MBytes  99.6 Mbits/sec
[  5][TX-C]   9.00-10.00  sec  33.6 MBytes   282 Mbits/sec    0    989 KBytes
[  7][RX-C]   9.00-10.00  sec  12.0 MBytes   101 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID][Role] Interval           Transfer     Bitrate         Retr
[  5][TX-C]   0.00-10.00  sec   348 MBytes   291 Mbits/sec    0            
sender
[  5][TX-C]   0.00-10.01  sec   345 MBytes   289 Mbits/sec                 
receiver
[  7][RX-C]   0.00-10.00  sec   122 MBytes   103 Mbits/sec    0            
sender
[  7][RX-C]   0.00-10.01  sec   121 MBytes   102 Mbits/sec                 
receiver

BTW the problematic machine is called leporello and it was the iperf _server_ in
all cases. The terminology in the iperf output is from the perspective of the
client machine. So leporello's transmit performance suffers almost 9-fold with
interrupt coalescing (the drop I had been measuring with my GUI tests), while
its receive performance "only" drops 3-fold.

Regarding ASPM I've now tried all possible settings in my BIOS. I can still not
make the warning go away. The above measurements are with ASPM disabled in my
BIOS.

Regards
Felix
diff mbox series

Patch

--- a/drivers/net/ethernet/realtek/r8169_main.c  
+++ b/drivers/net/ethernet/realtek/r8169_main.c  
@@ -5505,6 +5505,8 @@  static int rtl_init_one(struct pci_dev *pdev, const struct pci_device_id *ent)  
dev->hw_features |= NETIF_F_RXALL;  
dev->hw_features |= NETIF_F_RXFCS;

dev->pcpu_stat_type = NETDEV_PCPU_STAT_TSTATS;

- netdev_sw_irq_coalesce_default_on(dev);  
+ //netdev_sq_irq_coalesc_default_on(dev);

/* configure chip for default features */