BUG: soft lockup in __run_timers (2)

Status: premoderation: reported on 2026/11/20 11:03
Reported-by: syzbot+4916226cf0bb96034a11@syzkaller.appspotmail.com
First crash: 2d03h, last: 2d03h
▶ ▼ Similar bugs (15)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
android-5-10 BUG: soft lockup in __run_timers 1 2 824d 893d 0/2 auto-obsoleted due to no activity on 2024/11/18 04:44
android-5-15 BUG: soft lockup in __run_timers (2) 1 1 57d 57d 0/2 premoderation: reported on 2026/09/26 07:23
android-54 BUG: soft lockup in __run_timers 1 1 877d 877d 0/2 auto-obsoleted due to no activity on 2024/09/26 00:22
android-5-15 BUG: soft lockup in __run_timers 1 1 795d 795d 0/2 auto-obsoleted due to no activity on 2024/12/16 23:50
upstream BUG: soft lockup in __run_timers kernel 1 1 1386d 1382d 0/29 auto-obsoleted due to no activity on 2023/05/06 12:08
android-54 BUG: soft lockup in __run_timers (2) 1 2 597d 659d 0/2 auto-obsoleted due to no activity on 2025/07/03 11:27
upstream INFO: rcu detected stall in __run_timers (5) kernel 1 syz, C error error 63 1755d 2269d 0/29 closed as invalid on 2022/02/08 10:39
upstream INFO: rcu detected stall in __run_timers (8) prio:normal kernel 1 1 204d 204d 0/29 auto-obsoleted due to no activity on 2026/07/31 00:54
linux-5.15 INFO: rcu detected stall in __run_timers 1 1 1314d 1314d 0/3 auto-obsoleted due to no activity on 2023/08/15 19:18
linux-6.1 INFO: rcu detected stall in __run_timers (2) origin:upstream 1 syz error 5 16d 406d 0/3 upstream: reported syz repro on 2025/10/12 10:55
upstream INFO: rcu detected stall in __run_timers (7) kernfs 1 25 803d 908d 0/29 auto-obsoleted due to no activity on 2024/11/08 17:44
linux-6.1 INFO: rcu detected stall in __run_timers 1 1 762d 762d 0/3 auto-obsoleted due to no activity on 2025/01/28 16:20
upstream INFO: rcu detected stall in __run_timers (6) kernel 1 2 1723d 1740d 0/29 auto-closed as invalid on 2022/06/02 21:46
linux-5.15 INFO: rcu detected stall in __run_timers (2) 1 16 6d10h 445d 0/3 upstream: reported on 2025/09/03 11:07
linux-6.6 INFO: rcu detected stall in __run_timers 1 2 126d 165d 0/2 auto-obsoleted due to no activity on 2026/10/27 08:44

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 122s! [syz.6.31046:29711]
Modules linked in:
CPU: 0 PID: 29711 Comm: syz.6.31046 Tainted: G        W         syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/06/2026
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:169 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x49/0x70 kernel/locking/spinlock.c:199
Code: 12 48 89 fb 48 c7 c7 70 73 4c 86 e8 01 db 18 fd 48 89 df 48 83 3d 66 fe c5 01 00 74 27 e8 a3 64 c5 fc 66 90 fb bf 01 00 00 00 <e8> 72 5d be fc 65 8b 05 67 f8 7b 7b 85 c0 74 03 5b 5d c3 e8 53 f8
RSP: 0018:ffffc90000007da8 EFLAGS: 00000246
RAX: 0000000000000001 RBX: ffffffff8400f2d0 RCX: dffffc0000000000
RDX: 0000000000000102 RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffffc90000007db0 R08: ffff8881f70478c7 R09: 1ffff1103ee08f18
R10: dffffc0000000000 R11: ffffed103ee08f19 R12: ffff88811a26ba88
R13: dffffc0000000000 R14: ffff8881f7047880 R15: ffff88811a26ba68
FS:  00007f77b30bc6c0(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f77b309aff8 CR3: 00000001574d4000 CR4: 00000000003506b0
DR0: 0000000000000000 DR1: 0000200000000300 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 <IRQ>
 expire_timers kernel/time/timer.c:1494 [inline]
 __run_timers+0x627/0x9a0 kernel/time/timer.c:1789
 run_timer_softirq+0x6a/0xf0 kernel/time/timer.c:1802
 __do_softirq+0x255/0x563 kernel/softirq.c:309
 asm_call_irq_on_stack+0xf/0x20
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:26 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:77 [inline]
 do_softirq_own_stack+0x60/0x80 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:405 [inline]
 __irq_exit_rcu+0x128/0x150 kernel/softirq.c:435
 irq_exit_rcu+0x9/0x10 kernel/softirq.c:447
 sysvec_apic_timer_interrupt+0xbf/0xe0 arch/x86/kernel/apic/apic.c:1106
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:native_restore_fl arch/x86/include/asm/irqflags.h:41 [inline]
RIP: 0010:arch_local_irq_restore arch/x86/include/asm/irqflags.h:84 [inline]
RIP: 0010:generic_exec_single+0x152/0x370 kernel/smp.c:296
Code: c7 44 24 40 00 00 00 00 9c 8f 44 24 40 48 8b 5c 24 40 43 c6 44 3d 04 f8 fa 4c 89 f7 ff 54 24 10 48 89 5c 24 18 ff 74 24 18 9d <31> c0 e9 38 01 00 00 44 8b 3d 70 f0 69 05 44 89 f7 44 89 fe e8 b5
RSP: 0018:ffffc90001137a60 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 0000000000000246 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 00000000ffffffff
RBP: ffffc90001137b10 R08: ffff888155e7a807 R09: 1ffff1102abcf500
R10: dffffc0000000000 R11: ffffed102abcf501 R12: ffffc90001137b68
R13: 1ffff92000226f50 R14: ffffc90001137ca0 R15: dffffc0000000000
 smp_call_function_single+0x1d9/0x490 kernel/smp.c:514
 task_function_call kernel/events/core.c:116 [inline]
 perf_install_in_context+0x4c7/0x770 kernel/events/core.c:2969
 __do_sys_perf_event_open kernel/events/core.c:12286 [inline]
 __se_sys_perf_event_open+0x124f/0x1b40 kernel/events/core.c:11878
 __x64_sys_perf_event_open+0xbf/0xd0 kernel/events/core.c:11878
 do_syscall_64+0x31/0x40 arch/x86/entry/common.c:46
 entry_SYSCALL_64_after_hwframe+0x61/0xcb
RIP: 0033:0x7f77b468f559
Code: ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 e8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f77b30bc028 EFLAGS: 00000246 ORIG_RAX: 000000000000012a
RAX: ffffffffffffffda RBX: 00007f77b490c090 RCX: 00007f77b468f559
RDX: ffefffffffffffff RSI: 0000000000000000 RDI: 0000200000000c00
RBP: 00007f77b471e136 R08: 0000000000000000 R09: 0000000000000000
R10: ffffffffffffffff R11: 0000000000000246 R12: 0000000000000000
R13: 00007f77b490c128 R14: 00007f77b490c090 R15: 00007ffc5aea0fc8
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 287 Comm: kworker/u4:2 Tainted: G        W         syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 11/06/2026
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:229 [inline]
RIP: 0010:smp_call_function_single+0x209/0x490 kernel/smp.c:517
Code: 48 44 89 f6 83 e6 01 31 ff e8 f3 92 0a 00 41 83 e6 01 49 bc 00 00 00 00 00 fc ff df 75 0a e8 2e 8f 0a 00 e9 a4 00 00 00 f3 90 <f7> 44 24 48 01 00 00 00 0f 84 8f 00 00 00 e8 14 8f 0a 00 eb e9 e8
RSP: 0018:ffffc90000c47700 EFLAGS: 00000293
RAX: ffffffff815a2cdc RBX: 0000000000000000 RCX: ffff88811e86bc00
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffc90000c477f0 R08: ffffffff86c41f2f R09: 1ffffffff0d883e5
R10: dffffc0000000000 R11: fffffbfff0d883e6 R12: dffffc0000000000
R13: 0000000000000001 R14: 0000000000000001 R15: 1ffff92000188ee4
FS:  0000000000000000(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f013d70b000 CR3: 000000000640f000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000600
Call Trace:
 smp_call_function_many_cond+0x8f5/0x9d0 kernel/smp.c:653
 smp_call_function_many kernel/smp.c:716 [inline]
 smp_call_function kernel/smp.c:738 [inline]
 on_each_cpu+0xab/0x180 kernel/smp.c:837
 text_poke_sync arch/x86/kernel/alternative.c:1568 [inline]
 text_poke_bp_batch+0x1cb/0x5f0 arch/x86/kernel/alternative.c:1768
 text_poke_flush arch/x86/kernel/alternative.c:1959 [inline]
 text_poke_finish+0x1a/0x30 arch/x86/kernel/alternative.c:1966
 arch_jump_label_transform_apply+0x15/0x30 arch/x86/kernel/jump_label.c:126
 __jump_label_update+0x38f/0x3b0 kernel/jump_label.c:459
 jump_label_update+0x34c/0x3e0 kernel/jump_label.c:825
 static_key_disable_cpuslocked+0xc5/0x1a0 kernel/jump_label.c:207
 static_key_disable+0x1a/0x30 kernel/jump_label.c:215
 toggle_allocation_gate+0x3a5/0x440 mm/kfence/core.c:638
 process_one_work+0x6fd/0xbc0 kernel/workqueue.c:2301
 worker_thread+0xa8e/0x13c0 kernel/workqueue.c:2447
 kthread+0x324/0x3b0 kernel/kthread.c:313
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:298

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2026/11/20 11:02 android13-5.10-lts cff3ede94a35 625aa117 .config console log report info [disk image] [vmlinux] [kernel image] ci2-android-5-10-perf BUG: soft lockup in __run_timers
* Struck through repros no longer work on HEAD.