new throttling on linux at 50C appeared overnight

jessexknight · ‎05-04-2024

Yesterday, my Thinkpad e14 Gen 2 running Linux Mint 20.1 (full specs below) started aggressively throttling down from 2800 MHz base to 200 MHz when CPU temp nears/exceeds 50 C. From cold boot, I go from 35 C to 50 C in about 10 mins, after which the machine becomes almost unusable. I have no idea what tripped this behaviour and provide some debug info below (inxi & turbostat). Please help me recover!

cross-posted here
appeared overnight with no apt upgrade before
does not happen on my Windows 10 boot (got > 60 C)
live confirmation using: watch 'cat /proc/cpuinfo | grep "cpu MHz" && sensors | grep "CPU"'
could MSR_IA32_TEMPERATURE_TARGET (50 C) be the problem? How would this get changed?
I cannot seem to run thermald, getting error: "[/sys/devices/platform/thinkpad_acpi/dytc_lapmode] present: Thermald can't run on this platform"

inxi -Fxxxrz:

System:    Kernel: 5.15.0-105-generic x86_64 bits: 64 compiler: N/A Desktop: Cinnamon 4.8.6 wm: muffin 4.8.1 
           dm: LightDM 1.30.0 Distro: Linux Mint 20.1 Ulyssa base: Ubuntu 20.04 focal 
Machine:   Type: Laptop System: LENOVO product: 20TA004HUS v: ThinkPad E14 Gen 2 serial: <filter> Chassis: type: 10 
           serial: <filter> 
           Mobo: LENOVO model: 20TA004HUS v: SDK0J40697 WIN serial: <filter> UEFI: LENOVO v: R1EET56W(1.56 ) date: 06/29/2023 
Battery:   ID-1: BAT0 charge: 43.7 Wh condition: 45.8/45.0 Wh (102%) volts: 12.3/11.1 model: LGC 5B10X026 type: Li-poly 
           serial: <filter> status: Charging cycles: 2797 
CPU:       Topology: Quad Core model: 11th Gen Intel Core i7-1165G7 bits: 64 type: MT MCP arch: Tiger Lake rev: 1 
           L2 cache: 12.0 MiB 
           flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx bogomips: 44851 
           Speed: 1024 MHz min/max: 400/4700 MHz Core speeds (MHz): 1: 1024 2: 1690 3: 908 4: 941 5: 949 6: 1281 7: 1002 
           8: 600 
Graphics:  Device-1: Intel vendor: Lenovo driver: i915 v: kernel bus ID: 00:02.0 chip ID: 8086:9a49 
           Display: x11 server: X.Org 1.20.13 driver: modesetting unloaded: fbdev,vesa 
           resolution: 1920x1080~60Hz, 1920x1200~60Hz 
           OpenGL: renderer: Mesa Intel Xe Graphics (TGL GT2) v: 4.6 Mesa 21.2.6 direct render: Yes 
Audio:     Device-1: Intel vendor: Lenovo driver: sof-audio-pci-intel-tgl bus ID: 00:1f.3 chip ID: 8086:a0c8 
           Sound Server: ALSA v: k5.15.0-105-generic 
Network:   Device-1: Intel driver: iwlwifi v: kernel port: 4000 bus ID: 00:14.3 chip ID: 8086:a0f0 
           IF: wlp0s20f3 state: up mac: <filter> 
           Device-2: Realtek RTL8111/8168/8411 PCI Express Gigabit Ethernet vendor: Lenovo driver: r8169 v: kernel port: 3000 
           bus ID: 04:00.0 chip ID: 10ec:8168 
           IF: enp4s0 state: down mac: <filter> 
Drives:    Local Storage: total: 476.94 GiB used: 295.95 GiB (62.1%) 
           ID-1: /dev/nvme0n1 vendor: Samsung model: MZALQ512HALU-000L1 size: 476.94 GiB speed: 31.6 Gb/s lanes: 4 
           serial: <filter> rev: BL1QFXV7 scheme: GPT 
Partition: ID-1: / size: 342.50 GiB used: 295.92 GiB (86.4%) fs: ext4 dev: /dev/nvme0n1p6 
           ID-2: swap-1 size: 977.0 MiB used: 0 KiB (0.0%) fs: swap dev: /dev/nvme0n1p5 
Sensors:   System Temperatures: cpu: 48.0 C mobo: N/A 
           Fan Speeds (RPM): fan-1: 0 
Repos:     No active apt repos in: /etc/apt/sources.list 
           No active apt repos in: /etc/apt/sources.list.d/additional-repositories.list 
           Active apt repos in: /etc/apt/sources.list.d/deadsnakes-ppa-focal.list 
           1: deb http://ppa.launchpad.net/deadsnakes/ppa/ubuntu focal main
           Active apt repos in: /etc/apt/sources.list.d/inkscape_dev-stable-focal.list 
           1: deb http://ppa.launchpad.net/inkscape.dev/stable/ubuntu focal main
           No active apt repos in: /etc/apt/sources.list.d/mendeleydesktop.list 
           Active apt repos in: /etc/apt/sources.list.d/official-package-repositories.list 
           1: deb http://mirror.csclub.uwaterloo.ca/linuxmint-packages ulyssa main upstream import backport
           2: deb http://mirror.csclub.uwaterloo.ca/ubuntu focal main restricted universe multiverse
           3: deb http://mirror.csclub.uwaterloo.ca/ubuntu focal-updates main restricted universe multiverse
           4: deb http://mirror.csclub.uwaterloo.ca/ubuntu focal-backports main restricted universe multiverse
           5: deb http://security.ubuntu.com/ubuntu/ focal-security main restricted universe multiverse
           6: deb http://archive.canonical.com/ubuntu/ focal partner
           Active apt repos in: /etc/apt/sources.list.d/signal-xenial.list 
           1: deb [arch=amd64 signed-by=/usr/share/keyrings/signal-desktop-keyring.gpg] https://updates.signal.org/desktop/apt xenial main
           Active apt repos in: /etc/apt/sources.list.d/slack.list 
           1: deb https://packagecloud.io/slacktechnologies/slack/debian/ jessie main
           Active apt repos in: /etc/apt/sources.list.d/sublime-text.list 
           1: deb https://download.sublimetext.com/ apt/stable/
           Active apt repos in: /etc/apt/sources.list.d/ubuntuhandbook1-gimp-focal.list 
           1: deb http://ppa.launchpad.net/ubuntuhandbook1/gimp/ubuntu focal main
           Active apt repos in: /etc/apt/sources.list.d/zotero.list 
           1: deb [signed-by=/usr/share/keyrings/zotero-archive-keyring.gpg by-hash=force] https://zotero.retorque.re/file/apt-package-archive ./
           Active apt repos in: /etc/apt/sources.list.d/librewolf.sources 
           1: deb [arch=amd64] https://deb.librewolf.net focal main
Info:      Processes: 410 Uptime: 39m Memory: 15.32 GiB used: 2.31 GiB (15.0%) Init: systemd v: 245 runlevel: 5 Compilers: 
           gcc: 9.4.0 alt: 9 Shell: bash v: 5.0.17 running in: gnome-terminal inxi: 3.0.38

turbostat:

turbostat version 21.05.04 - Len Brown <lenb@kernel.org>
CPUID(0): GenuineIntel 0x1b CPUID levels
CPUID(1): family:model:stepping 0x6:8c:1 (6:140:1) microcode 0xb4
CPUID(0x80000000): max_extended_levels: 0x80000008
CPUID(1): SSE3 MONITOR - EIST TM2 TSC MSR ACPI-TM HT TM
CPUID(6): APERF, TURBO, DTS, PTM, HWP, HWPnotify, HWPwindow, HWPepp, HWPpkg, EPB
cpu0: MSR_IA32_MISC_ENABLE: 0x00850089 (TCC EIST MWAIT PREFETCH TURBO)
CPUID(7): No-SGX
CPUID(0x15): eax_crystal: 2 ebx_tsc: 146 ecx_crystal_hz: 38400000
TSC: 2803 MHz (38400000 Hz * 146 / 2 / 1000000)
CPUID(0x16): base_mhz: 2800 max_mhz: 4700 bus_mhz: 100
cpu0: MSR_MISC_PWR_MGMT: 0x00401cc0 (ENable-EIST_Coordination DISable-EPB DISable-OOB)
RAPL: 9362 sec. Joule Counter Range, at 28 Watts
cpu0: MSR_PLATFORM_INFO: 0x4043df0811c00
4 * 100.0 = 400.0 MHz max efficiency frequency
28 * 100.0 = 2800.0 MHz base frequency
cpu0: MSR_IA32_POWER_CTL: 0x0024005b (C1E auto-promotion: ENabled)
cpu0: MSR_TURBO_RATIO_LIMIT: 0x2929292929292f2f
41 * 100.0 = 4100.0 MHz max turbo 8 active cores
41 * 100.0 = 4100.0 MHz max turbo 7 active cores
41 * 100.0 = 4100.0 MHz max turbo 6 active cores
41 * 100.0 = 4100.0 MHz max turbo 5 active cores
41 * 100.0 = 4100.0 MHz max turbo 4 active cores
41 * 100.0 = 4100.0 MHz max turbo 3 active cores
47 * 100.0 = 4700.0 MHz max turbo 2 active cores
47 * 100.0 = 4700.0 MHz max turbo 1 active cores
cpu0: MSR_CONFIG_TDP_NOMINAL: 0x0000001c (base_ratio=28)
cpu0: MSR_CONFIG_TDP_LEVEL_1: 0x000c0060 (PKG_MIN_PWR_LVL1=0 PKG_MAX_PWR_LVL1=0 LVL1_RATIO=12 PKG_TDP_LVL1=96)
cpu0: MSR_CONFIG_TDP_LEVEL_2: 0x00110078 (PKG_MIN_PWR_LVL2=0 PKG_MAX_PWR_LVL2=0 LVL2_RATIO=17 PKG_TDP_LVL2=120)
cpu0: MSR_CONFIG_TDP_CONTROL: 0x00000000 ( lock=0)
cpu0: MSR_TURBO_ACTIVATION_RATIO: 0x0000001b (MAX_NON_TURBO_RATIO=27 lock=0)
cpu0: MSR_PKG_CST_CONFIG_CONTROL: 0x74008008 (UNdemote-C1, demote-C1, locked, pkg-cstate-limit=8 (unlimited))
/dev/cpu_dma_latency: 2000000000 usec (default)
current_driver: intel_idle
current_governor: menu
current_governor_ro: menu
cpu0: POLL: CPUIDLE CORE POLL IDLE
cpu0: C1ACPI: ACPI FFH MWAIT 0x0
cpu0: C2ACPI: ACPI FFH MWAIT 0x31
cpu0: C3ACPI: ACPI FFH MWAIT 0x60
cpu0: cpufreq driver: intel_pstate
cpu0: cpufreq governor: powersave
cpufreq intel_pstate no_turbo: 0
cpu0: MSR_MISC_FEATURE_CONTROL: 0x00000000 (L2-Prefetch L2-Prefetch-pair L1-Prefetch L1-IP-Prefetch)
cpu0: MSR_PM_ENABLE: 0x00000001 (HWP)
cpu0: MSR_HWP_CAPABILITIES: 0x010c1c2f (high 47 guar 28 eff 12 low 1)
cpu0: MSR_HWP_REQUEST: 0x80002f04 (min 4 max 47 des 0 epp 0x80 window 0x0 pkg 0x0)
cpu0: MSR_HWP_REQUEST_PKG: 0x8000ff01 (min 1 max 255 des 0 epp 0x80 window 0x0)
cpu0: MSR_HWP_INTERRUPT: 0x00000000 (Dis_Guaranteed_Perf_Change, Dis_Excursion_Min)
cpu0: MSR_HWP_STATUS: 0x00000000 (No-Guaranteed_Perf_Change, No-Excursion_Min)
cpu0: EPB: 6 (balanced)
cpu0: MSR_RAPL_POWER_UNIT: 0x000a0e03 (0.125000 Watts, 0.000061 Joules, 0.000977 sec.)
cpu0: MSR_PKG_POWER_INFO: 0x000000e0 (28 W TDP, RAPL 0 - 0 W, 0.000000 sec.)
cpu0: MSR_PKG_POWER_LIMIT: 0x42820000dd8118 (UNlocked)
cpu0: PKG Limit #1: ENabled (35.000000 Watts, 28.000000 sec, clamp ENabled)
cpu0: PKG Limit #2: ENabled (64.000000 Watts, 0.002441* sec, clamp DISabled)
cpu0: MSR_DRAM_POWER_LIMIT: 0x00000000 (UNlocked)
cpu0: DRAM Limit: DISabled (0.000000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_PP0_POLICY: 0
cpu0: MSR_PP0_POWER_LIMIT: 0x00000000 (UNlocked)
cpu0: Cores Limit: DISabled (0.000000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_PP1_POLICY: 0
cpu0: MSR_PP1_POWER_LIMIT: 0x00000000 (UNlocked)
cpu0: GFX Limit: DISabled (0.000000 Watts, 0.000977 sec, clamp DISabled)
cpu0: MSR_IA32_TEMPERATURE_TARGET: 0x32640000 (50 C) (100 default - 50 offset)
cpu0: MSR_IA32_PACKAGE_THERM_STATUS: 0x88320003 (50 C)
cpu0: MSR_IA32_PACKAGE_THERM_INTERRUPT: 0x00000003 (100 C, 100 C)
cpu0: MSR_PKGC3_IRTL: 0x00000000 (NOTvalid, 0 ns)
cpu0: MSR_PKGC6_IRTL: 0x00008876 (valid, 120832 ns)
cpu0: MSR_PKGC7_IRTL: 0x00008894 (valid, 151552 ns)
cpu0: MSR_PKGC8_IRTL: 0x000088fa (valid, 256000 ns)
cpu0: MSR_PKGC9_IRTL: 0x0000894c (valid, 339968 ns)
cpu0: MSR_PKGC10_IRTL: 0x00008c5a (valid, 2949120 ns)
Core	CPU	Avg_MHz	Busy%	Bzy_MHz	TSC_MHz	IPC	IRQ	SMI	POLL	C1ACPI	C2ACPIC3ACPI	POLL%	C1ACPI%	C2ACPI%	C3ACPI%	CPU%c1	CPU%c6	CPU%c7	CoreTmp	PkgTmp	GFX%rc6	GFXMHzGFXAMHz	Totl%C0	Any%C0	GFX%C0	CPUGFX%	Pkg%pc2	Pkg%pc3	Pkg%pc6	Pkg%pc7	Pkg%pc8	Pkg%pc9	Pk%pc10	CPU%LPI	SYS%LPI	PkgWatt	CorWatt	GFXWatt	RAMWatt	PKG_%	RAM_%
-	-	30	2.19	1352	2803	0.86	3692	0	6	2192	1713	3043	0.00	1.49	8.83	87.56	5.75	0.00	92.06	46	46	95.52	350	100	19.34	14.92	4.42	1.47	24.87	15.60	8.45	1.20	25.29	0.00	0.00	0.00	0.00	1.45	0.40	0.06	0.00	0.00	0.00
0	0	26	2.09	1250	2803	1.00	295	0	1	84	150	342	0.00	0.89	6.83	90.24	4.81	0.00	93.10	44	46	95.54	350	100	19.34	14.92	4.42	1.47	24.87	15.60	8.45	1.20	25.29	0.00	0.00	0.00	0.00	1.45	0.40	0.06	0.00	0.00	0.00
0	4	17	1.46	1159	2803	0.54	775	0	0	218	336	370	0.00	1.95	14.68	82.00	5.44
1	1	67	4.73	1421	2803	0.56	961	0	1	998	362	606	0.00	3.10	11.54	80.75	7.04	0.00	88.23	46
1	5	19	1.44	1333	2803	0.83	446	0	0	274	192	402	0.00	1.67	6.93	90.02	10.33
2	2	32	2.50	1284	2803	1.17	145	0	1	37	108	457	0.01	0.51	5.08	91.98	3.06	0.00	94.44	41
2	6	13	1.16	1159	2803	0.57	282	0	0	47	151	279	0.00	0.40	7.49	91.00	4.40
3	3	27	1.92	1428	2803	1.05	454	0	2	279	214	324	0.01	1.32	8.83	88.02	5.61	0.00	92.47	42
3	7	34	2.21	1557	2803	1.19	334	0	1	255	200	263	0.01	2.06	9.27	86.53	5.33

ACarmona_Intel · ‎05-14-2024

Hello Jessexknight,

Thank you for posting in our communities.

May we know when the issue started? And have you made any changes prior to the issue?

Furthermore, what troubleshooting steps have you already tried? so we can avoid repeating them.

We look forward to your response!

Best regards,

Carmona A.

Intel Customer Support Technician

jessexknight · ‎05-14-2024

As noted in the post, the issue began on 2024 May 3. I also cross-posted this issue here and here with some more info.

I made no major changes between the day before and the next morning when the issue arose. I tried the following without success:

reduce SSD usage from 96 to 91% by deleting some large files
toggled scaling_governor from powersave to performance
tried to activate thermald.service, but was not able due to dytc_lapmode as noted above
investigated /var/log/syslog for any evidence of thermal events between May 2 and 3 but did not find any

Ultimately, I installed throttled, which has succeeded in restoring the behaviour back to normal, as far as I can tell. I had to disable secure boot to make it work.

I want to reiterate that this seems like a common and longstanding issue for Linux users, which does not affect Windows users.

Thanks,

ACarmona_Intel · ‎05-14-2024

Hello Jessexknight,

Thank you so much for the detailed response.

Upon checking your system specifications, here are the validated OS that were listed for your system:

Operating System**

• Windows® 11 Pro

• Windows 11 Home

• Windows 11 Home, Single Language

• Windows 11 DG, Windows 10 Pro 64

• Windows 10 Pro 64

• Windows 10 Home 64

• Windows 10 Home 64 Single Language

This might be one of the reasons; however, it is not yet confirmed. I'll raise our case with our engineers so they can provide us with the appropriate recommendations.

By the way, thank you for sharing with us your workaround to fix the issue by installing the throttled and disabling the secure boot.

I'll post the response on this thread once I have the update from our engineers.

And also, for your reference you may also check out this link: What Is Throttling and How Can It Be Resolved?

Best Regards,

Carmona A.

Intel Customer Support Technician

ACarmona_Intel · ‎05-21-2024

Hello Jessexknight,

Thank you so much for the quick response.

The MSR_IA32_TEMPERATURE_TARGET register controls the temperature at which the CPU will start to throttle. The fact that you're seeing a target temperature of 50 °C in the MSR_IA32_TEMPERATURE_TARGET register is unusual, as this is typically set much higher to prevent premature throttling. It's possible that this value has been altered, either by a system update, a change in BIOS settings, or some other software interaction.

Here are some steps you can take to troubleshoot and potentially resolve the issue:

1. Check BIOS Settings: Restart your computer and enter the BIOS settings. Look for any settings related to CPU temperature targets or thermal management and ensure they are set to default or optimal values.

2. Update the BIOS: Since the issue is not present in Windows, it's less likely to be a hardware fault. However, updating the BIOS can sometimes resolve compatibility issues with the operating system. Check Lenovo's official website for any BIOS updates for your specific model.

3. Check for Software Conflicts: Since you mentioned that thermald cannot run due to dytc_lapmode, it's possible that there are conflicts with other thermal management services or tools. Ensure that there are no other thermal daemons running that could be interfering with the CPU's thermal management.

4. Use throttled: You've mentioned that installing throttled has helped. This utility is specifically designed to stop Intel CPUs from throttling too early. Make sure it's configured correctly and running at startup.

5. Kernel Parameters: Some users have reported success by passing certain kernel parameters that affect CPU power management. You can try adding processor.ignore_ppc=1 to your GRUB configuration, which can sometimes prevent premature throttling.

If the issue persists, try stress-testing your CPU on both Linux and Windows to compare the behaviour.

However, may we know if you have already contacted your Lenovo to confirm if Linux is compatible with your system?

If the problem continues, consider reaching out to Lenovo Technical Support. It's important to note that while these steps can help mitigate the issue, they may not address the root cause if it's related to a deeper compatibility problem between the hardware and the Linux kernel.

Best regards,

Carmona A.

Intel Customer Support Technician

ACarmona_Intel · ‎05-28-2024

Hello Jessexknight,

If the problem continues, please reach out to Lenovo Technical Support, and for additional information, please submit a new question, as this thread will no longer be monitored.

Thank you, and have a great day ahead.

Best regards,

Carmona A.

Intel Customer Support Technician