syzbot


INFO: rcu detected stall in schedule_timeout (7)

Status: upstream: reported syz repro on 2024/11/09 08:24
Subsystems: kernel
[Documentation on labels]
Reported-by: syzbot+8926d1b522e7194a4b3e@syzkaller.appspotmail.com
First crash: 307d, last: 9d08h
Cause bisection: failed (error log, bisect log)
  
Fix bisection: failed (error log, bisect log)
  
Discussions (1)
Title Replies (including bot) Last reply
[syzbot] [kernel?] INFO: rcu detected stall in schedule_timeout (7) 0 (1) 2024/11/09 08:24
Similar bugs (8)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in schedule_timeout (3) cgroups mm 1 11 2056d 2056d 0/29 closed as invalid on 2020/01/09 08:13
upstream INFO: rcu detected stall in schedule_timeout (2) kernel 1 2 2056d 2056d 0/29 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in schedule_timeout (4) kernel 1 1 762d 762d 0/29 closed as invalid on 2023/09/01 06:44
linux-6.1 INFO: rcu detected stall in schedule_timeout 1 28 429d 494d 0/3 auto-obsoleted due to no activity on 2024/08/31 04:44
upstream INFO: rcu detected stall in schedule_timeout (5) kernel 1 2 667d 702d 0/29 auto-obsoleted due to no activity on 2024/01/26 16:31
upstream INFO: rcu detected stall in schedule_timeout cgroups mm 1 69 2091d 2093d 0/29 closed as invalid on 2019/12/04 14:14
upstream INFO: rcu detected stall in schedule_timeout (6) usb 1 C done 40 309d 466d 28/29 fixed on 2024/10/22 11:57
linux-5.15 INFO: rcu detected stall in schedule_timeout origin:upstream 1 C 8 28d 460d 0/3 upstream: reported C repro on 2024/05/22 14:45
Last patch testing requests (7)
Created Duration User Patch Repo Result
2025/08/16 12:35 22m retest repro upstream OK log
2025/04/23 05:19 1h04m retest repro upstream OK log
2025/04/23 05:19 46m retest repro upstream report log
2025/02/03 20:53 24m retest repro upstream report log
2025/02/03 20:53 24m retest repro upstream OK log
2025/02/03 20:53 31m retest repro upstream report log
2024/11/19 08:30 30m retest repro upstream report log

Sample crash report:
IPVS: sh: UDP 0.0.0.0:0 - no destination available
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	(detected by 0, t=10502 jiffies, g=151157, q=1659294 ncpus=2)
rcu: All QSes seen, last rcu_preempt kthread activity 3400 (4295087804-4295084404), jiffies_till_next_fqs=1, root ->qsmask 0x0
rcu: rcu_preempt kthread starved for 3400 jiffies! g151157 f0x2 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=1
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:27560 pid:16    tgid:16    ppid:2      task_flags:0x208040 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5357 [inline]
 __schedule+0x1798/0x4cc0 kernel/sched/core.c:6961
 preempt_schedule_irq+0xb5/0x150 kernel/sched/core.c:7288
 irqentry_exit+0x6f/0x90 kernel/entry/common.c:197
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702
RIP: 0010:unwind_next_frame+0x5d/0x2390 arch/x86/kernel/unwind_orc.c:470
Code: 3c 28 00 74 08 48 89 df e8 b0 53 b0 00 48 89 5c 24 18 49 8b 5e 48 4d 8d 6e 38 4c 89 e8 48 c1 e8 03 48 89 44 24 58 80 3c 28 00 <74> 08 4c 89 ef e8 89 53 b0 00 4d 8b 7e 38 4d 89 f4 49 c1 ec 03 41
RSP: 0018:ffffc90000157318 EFLAGS: 00000246
RAX: 1ffff9200002ae84 RBX: ffffffff81ad112e RCX: e06c756616193400
RDX: dffffc0000000000 RSI: ffffffff81ad112e RDI: ffffc900001573e8
RBP: dffffc0000000000 R08: ffffc900001574b0 R09: 0000000000000006
R10: ffffc90000157438 R11: ffffffff81ac3870 R12: ffff88801ce9da00
R13: ffffc90000157420 R14: ffffc900001573e8 R15: ffffc900001573e8
 arch_stack_walk+0x11c/0x150 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x9c/0xe0 kernel/stacktrace.c:122
 kasan_save_stack mm/kasan/common.c:47 [inline]
 kasan_save_track+0x3e/0x80 mm/kasan/common.c:68
 unpoison_slab_object mm/kasan/common.c:330 [inline]
 __kasan_slab_alloc+0x6c/0x80 mm/kasan/common.c:356
 kasan_slab_alloc include/linux/kasan.h:250 [inline]
 slab_post_alloc_hook mm/slub.c:4180 [inline]
 slab_alloc_node mm/slub.c:4229 [inline]
 kmem_cache_alloc_noprof+0x1c1/0x3c0 mm/slub.c:4236
 kmem_alloc_batch lib/debugobjects.c:371 [inline]
 fill_pool+0x100/0x570 lib/debugobjects.c:403
 debug_objects_fill_pool lib/debugobjects.c:725 [inline]
 debug_object_assert_init+0x2b1/0x380 lib/debugobjects.c:1003
 debug_timer_assert_init kernel/time/timer.c:803 [inline]
 debug_assert_init kernel/time/timer.c:848 [inline]
 __try_to_del_timer_sync+0x29/0x3a0 kernel/time/timer.c:1457
 __timer_delete_sync+0x1fe/0x2d0 kernel/time/timer.c:1620
 schedule_timeout+0x133/0x270 kernel/time/sleep_timeout.c:100
 rcu_gp_fqs_loop+0x301/0x1540 kernel/rcu/tree.c:2083
 rcu_gp_kthread+0x99/0x390 kernel/rcu/tree.c:2285
 kthread+0x70e/0x8a0 kernel/kthread.c:463
 ret_from_fork+0x3f9/0x770 arch/x86/kernel/process.c:148
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:245
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 UID: 0 PID: 20291 Comm: kworker/u8:17 Not tainted 6.17.0-rc1-syzkaller-00199-gdfd4b508c8c6 #0 PREEMPT(full) 
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 07/12/2025
Workqueue: events_unbound nsim_dev_trap_report_work
RIP: 0010:process_backlog+0x4b8/0x14f0 net/core/dev.c:-1
Code: 59 f8 49 bf 00 00 00 00 00 fc ff df 4e 8d 24 e5 10 ed bd 8d 4c 89 e0 48 c1 e8 03 42 80 3c 38 00 74 08 4c 89 e7 e8 48 5a bd f8 <4d> 8b 24 24 48 c7 c0 68 0a a2 92 49 01 c4 48 8b 44 24 48 42 0f b6
RSP: 0018:ffffc90000a08b00 EFLAGS: 00000246
RAX: 1ffffffff1b7bda3 RBX: ffffffff8965b8b5 RCX: ffff888033a11e00
RDX: 0000000000000100 RSI: 0000000000000001 RDI: 0000000000000008
RBP: ffffc90000a08c28 R08: ffff8881dda36c8f R09: 0000000000000000
R10: ffff8881dda36c80 R11: ffffed103bb46d92 R12: ffffffff8dbded18
R13: 0000000000000001 R14: ffff8881dda36c80 R15: dffffc0000000000
FS:  0000000000000000(0000) GS:ffff888125d1b000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000200000404030 CR3: 000000000df36000 CR4: 00000000003526f0
DR0: 0000000000000007 DR1: 000000000000000b DR2: 0000000000000002
DR3: 0000000000000010 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 __napi_poll+0xc4/0x360 net/core/dev.c:7494
 napi_poll net/core/dev.c:7557 [inline]
 net_rx_action+0x707/0xe30 net/core/dev.c:7684
 handle_softirqs+0x283/0x870 kernel/softirq.c:579
 do_softirq+0xec/0x180 kernel/softirq.c:480
 </IRQ>
 <TASK>
 __local_bh_enable_ip+0x17d/0x1c0 kernel/softirq.c:407
 spin_unlock_bh include/linux/spinlock.h:396 [inline]
 nsim_dev_trap_report drivers/net/netdevsim/dev.c:835 [inline]
 nsim_dev_trap_report_work+0x7c7/0xb80 drivers/net/netdevsim/dev.c:866
 process_one_work kernel/workqueue.c:3236 [inline]
 process_scheduled_works+0xade/0x17b0 kernel/workqueue.c:3319
 worker_thread+0x8a0/0xda0 kernel/workqueue.c:3400
 kthread+0x70e/0x8a0 kernel/kthread.c:463
 ret_from_fork+0x3f9/0x770 arch/x86/kernel/process.c:148
 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:245
 </TASK>

Crashes (20):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2025/08/16 14:04 upstream dfd4b508c8c6 1804e95e .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in schedule_timeout
2025/07/07 18:06 upstream d7b8f8e20813 4f67c4ae .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in schedule_timeout
2025/05/05 11:26 upstream 92a09c47464d b0714e37 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/04/09 04:59 upstream bec7dcbc242c b133e63a .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in schedule_timeout
2025/03/05 16:23 upstream 48a5eed9ad58 60f5d8d9 .config console log report info [disk image] [vmlinux] [kernel image] ci-qemu-gce-upstream-auto INFO: rcu detected stall in schedule_timeout
2025/02/28 05:07 upstream 1e15510b71c9 6a8fcbc4 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in schedule_timeout
2025/02/21 12:54 upstream 27eddbf34490 0808a665 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/02/09 12:23 upstream 9946eaf552b1 ef44b750 .config console log report info [disk image] [vmlinux] [kernel image] ci-qemu-gce-upstream-auto INFO: rcu detected stall in schedule_timeout
2025/02/06 06:41 upstream 92514ef226f5 577d049b .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/01/20 19:45 upstream ffd294d346d1 6e87cfa2 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce INFO: rcu detected stall in schedule_timeout
2025/01/17 21:40 upstream 9bffa1ad25b8 953d1c45 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/01/17 14:57 upstream 9bffa1ad25b8 953d1c45 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/01/07 05:57 upstream fbfd64d25c7a f3558dbf .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/01/02 14:55 upstream 56e6a3499e14 d3ccff63 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2024/12/25 00:39 upstream 9b2ffa6148b1 444551c4 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2024/12/16 14:46 upstream 78d4f34e2115 f93b2b55 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2024/11/05 08:01 upstream 557329bcecc2 509da429 .config console log report syz / log [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2024/10/22 14:24 upstream c2ee9f594da8 9d74f456 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in schedule_timeout
2025/05/05 00:01 upstream e8ab83e34bdc b0714e37 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-386 INFO: rcu detected stall in schedule_timeout
2024/10/26 16:52 https://git.kernel.org/pub/scm/linux/kernel/git/gregkh/usb.git usb-testing c6d9e43954bf 65e8686b .config console log report info [disk image] [vmlinux] [kernel image] ci2-upstream-usb INFO: rcu detected stall in schedule_timeout
* Struck through repros no longer work on HEAD.