INFO: rcu detected stall in process_one_work (9)

Status: upstream: reported C repro on 2024/06/03 12:55
Subsystems: kernel
Labels: prio:high
[Documentation on labels]
Reported-by: syzbot+445ada2020fd8c1f5377@syzkaller.appspotmail.com
First crash: 820d, last: 25d
Cause bisection: failed (error log, bisect log)
  
Fix bisection: failed (error log, bisect log)
  
✨ AI Jobs (1)
ID Workflow Result Correct Bug Created Started Finished Revision
d5c62186 assessment-security DenialOfService: ✅ Exploitable: ❌ FilesystemTrigger: ❌ NetworkTrigger: ❌ PeripheralTrigger: ✅ RemoteTrigger: ❌ Unprivileged: ❌ UserNamespace: ❌ VMGuestTrigger: ❌ VMHostTrigger: ❌ INFO: rcu detected stall in process_one_work (9) 2026/05/24 05:16 2026/05/24 05:16 2026/05/24 06:02 c69befb3
Discussions (1)
Title Replies (including bot) Last reply
[syzbot] [usb?] INFO: rcu detected stall in process_one_work (9) 0 (1) 2024/06/03 12:55
Similar bugs (10)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-5.15 INFO: rcu detected stall in process_one_work 1 3 805d 908d 0/3 auto-obsoleted due to no activity on 2024/09/27 05:22
linux-5.15 INFO: rcu detected stall in process_one_work (3) origin:upstream 1 syz error 4 2d08h 353d 0/3 upstream: reported syz repro on 2025/09/13 13:36
upstream INFO: rcu detected stall in process_one_work (2) kernel 1 1 2334d 2334d 0/29 auto-closed as invalid on 2020/07/10 22:43
upstream INFO: rcu detected stall in process_one_work (4) kernel 1 1 1809d 1809d 0/29 auto-closed as invalid on 2021/12/18 04:26
upstream INFO: rcu detected stall in process_one_work (8) kernel 1 3 987d 1037d 0/29 auto-obsoleted due to no activity on 2024/03/18 23:07
linux-5.15 INFO: rcu detected stall in process_one_work (2) 1 1 623d 623d 0/3 auto-obsoleted due to no activity on 2025/03/27 21:48
upstream INFO: rcu detected stall in process_one_work kernel 1 8 2573d 3016d 0/29 auto-closed as invalid on 2019/11/14 14:39
upstream INFO: rcu detected stall in process_one_work (5) kernel 1 1 1454d 1454d 0/29 auto-obsoleted due to no activity on 2022/12/07 18:00
linux-6.1 INFO: rcu detected stall in process_one_work origin:upstream 1 syz, C error 3 35d 966d 0/3 upstream: reported C repro on 2024/01/09 18:19
upstream INFO: rcu detected stall in process_one_work (3) kernel 1 syz, C done done 1 2156d 2197d 15/29 fixed on 2020/11/16 12:12
Last patch testing requests (10)
Created Duration User Patch Repo Result
2026/08/31 09:37 21m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing no crash job log log
2026/07/25 20:28 40m retest repro upstream log
2026/06/20 19:14 22m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2026/04/21 00:28 34m retest repro upstream report log
2026/04/09 18:59 19m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2026/01/29 18:42 14m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2025/11/20 18:22 18m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2025/09/01 09:37 12m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2025/06/19 10:03 1h21m retest repro https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing report log
2025/05/08 01:46 28m retest repro upstream report log
Fix bisection attempts (10)
Created Duration User Patch Repo Result
2026/02/09 21:58 1m bisect fix upstream error job log
2026/01/10 16:32 4h49m bisect fix upstream OK (0) job log log
2025/12/10 08:57 4h08m bisect fix upstream OK (0) job log log
2025/11/06 13:41 2h02m bisect fix upstream OK (0) job log log
2025/09/07 06:54 3h42m bisect fix upstream OK (0) job log log
2025/07/25 12:57 2h49m bisect fix upstream OK (0) job log log
2025/06/24 19:36 2h17m bisect fix upstream OK (0) job log log
2025/05/25 02:11 1h52m bisect fix upstream OK (0) job log log
2025/02/26 10:26 2h23m bisect fix upstream OK (0) job log log
2025/01/06 05:22 1h56m bisect fix upstream OK (0) job log log

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (0 ticks this GP) idle=cd34/1/0x4000000000000000 softirq=13107/13107 fqs=0
rcu: 	(detected by 1, t=10506 jiffies, g=6209, q=431 ncpus=2)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 UID: 0 PID: 9 Comm: kworker/0:1 Not tainted 6.12.0-syzkaller-10689-g7af08b57bcb9 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024
Workqueue: events_freezable_pwr_efficient sync_hw_clock
RIP: 0010:rol32 include/linux/bitops.h:127 [inline]
RIP: 0010:iterate_chain_key kernel/locking/lockdep.c:448 [inline]
RIP: 0010:__lock_acquire+0xd46/0x3c40 kernel/locking/lockdep.c:5214
Code: d3 89 d9 89 d3 01 c2 c1 c3 08 31 cb 89 d9 29 d8 01 d3 c1 c1 10 89 de 31 c8 89 c1 29 c2 01 d8 c1 c9 0d 31 d1 89 ca 29 ce 01 c8 <c1> c2 04 89 c0 31 f2 48 c1 e2 20 48 09 c2 48 b8 00 00 00 00 00 fc
RSP: 0018:ffffc90000007ab0 EFLAGS: 00000007
RAX: 0000000050e626de RBX: 0000000090a735f6 RCX: 000000006fd6bbc0
RDX: 000000006fd6bbc0 RSI: 0000000020d07a36 RDI: ffffffff96e85120
RBP: ffffffff96e8a798 R08: 0000000000000000 R09: fffffbfff2dd0998
R10: ffffffff96e84cc7 R11: 0000000000000001 R12: ffffed10039dea6b
R13: ffff88801cef4880 R14: 0000000000000002 R15: ffff88801cef5388
FS:  0000000000000000(0000) GS:ffff8880b8600000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020000600 CR3: 00000000774c0000 CR4: 00000000003526f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 lock_acquire.part.0+0x11b/0x380 kernel/locking/lockdep.c:5849
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
 _raw_spin_lock_irqsave+0x3a/0x60 kernel/locking/spinlock.c:162
 debug_object_activate+0x149/0x4a0 lib/debugobjects.c:818
 debug_hrtimer_activate kernel/time/hrtimer.c:428 [inline]
 debug_activate kernel/time/hrtimer.c:469 [inline]
 enqueue_hrtimer+0x25/0x3c0 kernel/time/hrtimer.c:1076
 __run_hrtimer kernel/time/hrtimer.c:1756 [inline]
 __hrtimer_run_queues+0x903/0xae0 kernel/time/hrtimer.c:1803
 hrtimer_interrupt+0x392/0x8e0 kernel/time/hrtimer.c:1865
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1038 [inline]
 __sysvec_apic_timer_interrupt+0x10f/0x400 arch/x86/kernel/apic/apic.c:1055
 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1049 [inline]
 sysvec_apic_timer_interrupt+0x9f/0xc0 arch/x86/kernel/apic/apic.c:1049
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702
RIP: 0010:__raw_spin_unlock_irq include/linux/spinlock_api_smp.h:160 [inline]
RIP: 0010:_raw_spin_unlock_irq+0x29/0x50 kernel/locking/spinlock.c:202
Code: 90 f3 0f 1e fa 53 48 8b 74 24 08 48 89 fb 48 83 c7 18 e8 3a 2e 39 f6 48 89 df e8 82 ad 39 f6 e8 dd 3a 64 f6 fb bf 01 00 00 00 <e8> 12 a2 2a f6 65 8b 05 f3 9c d1 74 85 c0 74 06 5b c3 cc cc cc cc
RSP: 0018:ffffc900000e7cb8 EFLAGS: 00000202
RAX: 000000000000c6f1 RBX: ffff8880b863db00 RCX: 1ffffffff20c0c51
RDX: 0000000000000000 RSI: ffffffff8b6ce000 RDI: 0000000000000001
RBP: ffffffff8e1f3c60 R08: 0000000000000001 R09: 0000000000000001
R10: ffffffff9060a4d7 R11: 0000000000000001 R12: ffff88801cef4880
R13: 0000000000000000 R14: 0000000000000001 R15: ffff88801b093400
 process_one_work+0x813/0x1ba0 kernel/workqueue.c:3198
 process_scheduled_works kernel/workqueue.c:3310 [inline]
 worker_thread+0x6c8/0xf00 kernel/workqueue.c:3391
 kthread+0x2c1/0x3a0 kernel/kthread.c:389
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10505 jiffies! g6209 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=2843
rcu: rcu_preempt kthread starved for 10506 jiffies! g6209 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:28288 pid:17    tgid:17    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5369 [inline]
 __schedule+0xe58/0x5ad0 kernel/sched/core.c:6756
 __schedule_loop kernel/sched/core.c:6833 [inline]
 schedule+0xe7/0x350 kernel/sched/core.c:6848
 schedule_timeout+0x124/0x280 kernel/time/sleep_timeout.c:99
 rcu_gp_fqs_loop+0x1eb/0xb00 kernel/rcu/tree.c:2045
 rcu_gp_kthread+0x271/0x380 kernel/rcu/tree.c:2247
 kthread+0x2c1/0x3a0 kernel/kthread.c:389
 ret_from_fork+0x45/0x80 arch/x86/kernel/process.c:147
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244
 </TASK>

Crashes (24):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/11/29 12:07 upstream 7af08b57bcb9 5df23865 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2026/08/07 11:31 upstream 364465ab19de e4ef95d6 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2026/08/03 04:40 upstream bd1dde877520 e611ffe1 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2026/07/11 19:44 upstream d96fcfe1b7f9 d78ea535 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2026/04/26 08:13 upstream 897d54018cc9 9c2d0995 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2025/10/03 15:39 upstream e406d57be7bd 49379ee0 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2025/04/23 23:38 upstream a79be02bba5c d971f7e2 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2025/03/26 18:53 upstream 2df0c02dab82 89d30d73 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2025/01/26 19:06 upstream aa22f4da2a46 9fbd772e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2024/10/20 16:58 upstream 715ca9dd687f cd6fc0a3 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2024/09/10 06:20 upstream bc83b4d1f086 784df80e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2024/08/05 12:06 upstream de9c2c66ad8e e35c337f .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in process_one_work
2026/08/05 02:54 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 5d5fd841c346 52aa2820 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/10/31 19:37 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing c67e9601e29a 96eb609f .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/10/25 11:52 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing c6d9e43954bf 045e728d .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/10/05 23:36 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 4a9fe2a8ac53 d7906eff .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/10/03 11:06 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 9852d85ec9d4 a4c7fd36 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/08/01 15:36 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing d483f034f032 1e9c4cf3 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/07/20 20:41 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 3c3ff7be9729 b88348e9 .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/07/16 14:08 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing b72749301112 b66b37bd .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/07/05 15:01 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 179264157bba 2a40360c .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/07/05 10:21 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 179264157bba 2a40360c .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2024/06/03 05:52 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing 1613e604df0c 3113787f .config console log report syz / log C [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in process_one_work
2026/06/27 20:16 https://kernel.googlesource.com/pub/scm/linux/kernel/git/torvalds/linux master 5a66900afbd6 fb92f11c .config console log report info [disk image (non-bootable)] [vmlinux] [kernel image] ci-qemu2-arm64 BUG: soft lockup in process_one_work
* Struck through repros no longer work on HEAD.