sched: DL replenish lagged too much rcu: INFO: rcu_preempt detected stalls on CPUs/tasks: rcu: Tasks blocked on level-0 rcu_node (CPUs 0-1): P6950/1:b..l P5188/1:b..l P5492/1:b..l rcu: (detected by 0, t=10502 jiffies, g=13881, q=673 ncpus=2) task:dhcpcd state:R running task stack:22800 pid:5492 tgid:5492 ppid:1 flags:0x00000002 Call Trace: <TASK> context_switch kernel/sched/core.c:5369 [inline] __schedule+0x1850/0x4c30 kernel/sched/core.c:6756 preempt_schedule_common+0x84/0xd0 kernel/sched/core.c:6935 preempt_schedule+0xe1/0xf0 kernel/sched/core.c:6959 preempt_schedule_thunk+0x1a/0x30 arch/x86/entry/thunk.S:12 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline] _raw_spin_unlock_irqrestore+0x130/0x140 kernel/locking/spinlock.c:194 spin_unlock_irqrestore include/linux/spinlock.h:406 [inline] __wake_up_common_lock+0x18c/0x1e0 kernel/sched/wait.c:108 sock_def_readable+0x20f/0x5a0 net/core/sock.c:3453 unix_dgram_sendmsg+0x1495/0x1f80 net/unix/af_unix.c:2167 sock_sendmsg_nosec net/socket.c:711 [inline] __sock_sendmsg+0x223/0x270 net/socket.c:726 sock_write_iter+0x2d7/0x3f0 net/socket.c:1147 new_sync_write fs/read_write.c:586 [inline] vfs_write+0xaed/0xd30 fs/read_write.c:679 ksys_write+0x18f/0x2b0 fs/read_write.c:731 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f8a948afbf2 RSP: 002b:00007fff63e79ad8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 RAX: ffffffffffffffda RBX: 00000000000004c5 RCX: 00007f8a948afbf2 RDX: 0000000000000048 RSI: 00007fff63e79af0 RDI: 0000000000000005 RBP: 00007fff63e79af0 R08: 0000000000000008 R09: 0000000000000037 R10: 0000000000000000 R11: 0000000000000246 R12: 0000558059fcb876 R13: 00007fff63e79f20 R14: 0000000000000000 R15: 0000000000000000 </TASK> task:klogd state:R running task stack:22784 pid:5188 tgid:5188 ppid:1 flags:0x00000002 Call Trace: <TASK> context_switch kernel/sched/core.c:5369 [inline] __schedule+0x1850/0x4c30 kernel/sched/core.c:6756 preempt_schedule_common+0x84/0xd0 kernel/sched/core.c:6935 preempt_schedule+0xe1/0xf0 kernel/sched/core.c:6959 preempt_schedule_thunk+0x1a/0x30 arch/x86/entry/thunk.S:12 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline] _raw_spin_unlock_irqrestore+0x130/0x140 kernel/locking/spinlock.c:194 spin_unlock_irqrestore include/linux/spinlock.h:406 [inline] __wake_up_common_lock+0x18c/0x1e0 kernel/sched/wait.c:108 sock_def_readable+0x20f/0x5a0 net/core/sock.c:3453 unix_dgram_sendmsg+0x1495/0x1f80 net/unix/af_unix.c:2167 sock_sendmsg_nosec net/socket.c:711 [inline] __sock_sendmsg+0x223/0x270 net/socket.c:726 __sys_sendto+0x363/0x4c0 net/socket.c:2197 __do_sys_sendto net/socket.c:2204 [inline] __se_sys_sendto net/socket.c:2200 [inline] __x64_sys_sendto+0xde/0x100 net/socket.c:2200 do_syscall_x64 arch/x86/entry/common.c:52 [inline] do_syscall_64+0xf3/0x230 arch/x86/entry/common.c:83 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f4773aef9b5 RSP: 002b:00007ffe162f9048 EFLAGS: 00000246 ORIG_RAX: 000000000000002c RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f4773aef9b5 RDX: 0000000000000066 RSI: 000055d3b86c1a50 RDI: 0000000000000003 RBP: 000055d3b86bb910 R08: 0000000000000000 R09: 0000000000000000 R10: 0000000000004000 R11: 0000000000000246 R12: 0000000000000013 R13: 00007f4773c7d212 R14: 00007ffe162f9148 R15: 0000000000000000 </TASK> task:syz.6.202 state:R running task stack:26232 pid:6950 tgid:6945 ppid:6251 flags:0x00004004 Call Trace: <TASK> context_switch kernel/sched/core.c:5369 [inline] __schedule+0x1850/0x4c30 kernel/sched/core.c:6756 preempt_schedule_common+0x84/0xd0 kernel/sched/core.c:6935 preempt_schedule+0xe1/0xf0 kernel/sched/core.c:6959 preempt_schedule_thunk+0x1a/0x30 arch/x86/entry/thunk.S:12 __raw_spin_unlock include/linux/spinlock_api_smp.h:143 [inline] _raw_spin_unlock+0x3e/0x50 kernel/locking/spinlock.c:186 spin_unlock include/linux/spinlock.h:391 [inline] zap_pte_range mm/memory.c:1705 [inline] zap_pmd_range mm/memory.c:1753 [inline] zap_pud_range mm/memory.c:1782 [inline] zap_p4d_range mm/memory.c:1803 [inline] unmap_page_range+0x36c3/0x4040 mm/memory.c:1824 unmap_vmas+0x3cc/0x5f0 mm/memory.c:1914 exit_mmap+0x275/0xc20 mm/mmap.c:1668 __mmput+0x115/0x3c0 kernel/fork.c:1348 exit_mm+0x220/0x310 kernel/exit.c:570 do_exit+0x9ad/0x28e0 kernel/exit.c:925 do_group_exit+0x207/0x2c0 kernel/exit.c:1087 get_signal+0x16b2/0x1750 kernel/signal.c:3017 arch_do_signal_or_restart+0x96/0x860 arch/x86/kernel/signal.c:337 exit_to_user_mode_loop kernel/entry/common.c:111 [inline] exit_to_user_mode_prepare include/linux/entry-common.h:329 [inline] __syscall_exit_to_user_mode_work kernel/entry/common.c:207 [inline] syscall_exit_to_user_mode+0xce/0x340 kernel/entry/common.c:218 do_syscall_64+0x100/0x230 arch/x86/entry/common.c:89 entry_SYSCALL_64_after_hwframe+0x77/0x7f RIP: 0033:0x7f33acd8592b RSP: 002b:00007f33adb9ef10 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 RAX: fffffffffffffffc RBX: 0000000000000004 RCX: 00007f33acd8592b RDX: 00007f33adb9ffe0 RSI: 0000000080085502 RDI: 0000000000000004 RBP: 00007f33adb9ffe0 R08: 0000000000000000 R09: 00362e6364755f79 R10: 0000000000000000 R11: 0000000000000246 R12: 0000000080085502 R13: 0000000800000000 R14: 0000000020000040 R15: 00007f33ace0bd68 </TASK> rcu: rcu_preempt kthread starved for 10552 jiffies! g13881 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1 rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior. rcu: RCU grace-period kthread stack dump: task:rcu_preempt state:I stack:25976 pid:17 tgid:17 ppid:2 flags:0x00004000 Call Trace: <TASK> context_switch kernel/sched/core.c:5369 [inline] __schedule+0x1850/0x4c30 kernel/sched/core.c:6756 preempt_schedule_irq+0xfb/0x1c0 kernel/sched/core.c:7078 irqentry_exit+0x5e/0x90 kernel/entry/common.c:354 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:native_irq_disable arch/x86/include/asm/irqflags.h:37 [inline] RIP: 0010:arch_local_irq_disable arch/x86/include/asm/irqflags.h:92 [inline] RIP: 0010:arch_local_irq_save arch/x86/include/asm/irqflags.h:124 [inline] RIP: 0010:__raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:108 [inline] RIP: 0010:_raw_spin_lock_irqsave+0xa1/0x120 kernel/locking/spinlock.c:162 Code: 4c 89 e7 e8 31 73 3a f6 48 c7 44 24 20 00 00 00 00 9c 8f 44 24 20 42 80 3c 3b 00 74 08 4c 89 e7 e8 24 72 3a f6 4c 8b 64 24 20 <fa> 41 f7 c4 00 02 00 00 74 05 e8 00 c6 db f5 bf 01 00 00 00 e8 e6 RSP: 0018:ffffc90000167960 EFLAGS: 00000246 RAX: f3f3f300f1f1f1f1 RBX: 1ffff9200002cf30 RCX: ffff88801cec0000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8880b872a700 RBP: ffffc900001679e8 R08: ffffffff818c3092 R09: 1ffffffff2032fce R10: dffffc0000000000 R11: fffffbfff2032fcf R12: 0000000000000246 R13: 1ffff9200002cf2c R14: ffff8880b872a700 R15: dffffc0000000000 lock_timer_base+0x112/0x240 kernel/time/timer.c:1050 __mod_timer+0x1ca/0xeb0 kernel/time/timer.c:1131 schedule_timeout+0x155/0x290 kernel/time/sleep_timeout.c:98 rcu_gp_fqs_loop+0x2df/0x1330 kernel/rcu/tree.c:2045 rcu_gp_kthread+0xa7/0x3b0 kernel/rcu/tree.c:2247 kthread+0x2f2/0x390 kernel/kthread.c:389 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 </TASK> rcu: Stack dump where RCU GP kthread last ran: Sending NMI from CPU 0 to CPUs 1: NMI backtrace for cpu 1 CPU: 1 UID: 0 PID: 6037 Comm: kworker/1:9 Not tainted 6.13.0-rc5-syzkaller-00006-g56e6a3499e14 #0 Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 09/13/2024 Workqueue: wg-crypt-wg2 wg_packet_tx_worker RIP: 0010:unwind_next_frame+0xc5/0x22d0 arch/x86/kernel/unwind_orc.c:482 Code: 8c 24 90 00 00 00 48 89 5c 24 20 bf 01 00 00 00 e8 90 d7 21 00 49 8d 6d 50 48 89 e8 48 c1 e8 03 48 89 44 24 38 42 80 3c 20 00 <74> 08 48 89 ef e8 91 32 ba 00 48 8b 5d 00 48 85 db 74 24 48 81 c3 RSP: 0018:ffffc90000a18130 EFLAGS: 00000046 RAX: 1ffff9200014304a RBX: 1ffff92000143040 RCX: ffffffff9a3ab903 RDX: dffffc0000000000 RSI: ffffffff86d6cace RDI: 0000000000000001 RBP: ffffc90000a18250 R08: 0000000000000005 R09: ffffc90000a182f0 R10: dffffc0000000000 R11: ffffffff818b39d0 R12: dffffc0000000000 R13: ffffc90000a18200 R14: ffffffff86d6cace R15: 0000000000000000 FS: 0000000000000000(0000) GS:ffff8880b8700000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fff63e78ff8 CR3: 0000000070420000 CR4: 0000000000350ef0 Call Trace: <NMI> </NMI> <IRQ> arch_stack_walk+0x11c/0x150 arch/x86/kernel/stacktrace.c:25 stack_trace_save+0x118/0x1d0 kernel/stacktrace.c:122 kasan_save_stack mm/kasan/common.c:47 [inline] kasan_save_track+0x3f/0x80 mm/kasan/common.c:68 poison_kmalloc_redzone mm/kasan/common.c:377 [inline] __kasan_kmalloc+0x98/0xb0 mm/kasan/common.c:394 kasan_kmalloc include/linux/kasan.h:260 [inline] __kmalloc_cache_noprof+0x243/0x390 mm/slub.c:4329 kmalloc_noprof include/linux/slab.h:901 [inline] dummy_urb_enqueue+0x7d/0x780 drivers/usb/gadget/udc/dummy_hcd.c:1272 usb_hcd_submit_urb+0x36e/0x1e80 drivers/usb/core/hcd.c:1533 ath9k_hif_usb_reg_in_cb+0x4ce/0x6e0 drivers/net/wireless/ath/ath9k/hif_usb.c:790 __usb_hcd_giveback_urb+0x42e/0x6e0 drivers/usb/core/hcd.c:1650 dummy_timer+0x856/0x4620 drivers/usb/gadget/udc/dummy_hcd.c:1993 __run_hrtimer kernel/time/hrtimer.c:1739 [inline] __hrtimer_run_queues+0x59d/0xd30 kernel/time/hrtimer.c:1803 hrtimer_run_softirq+0x19a/0x2c0 kernel/time/hrtimer.c:1820 handle_softirqs+0x2d6/0x9b0 kernel/softirq.c:561 __do_softirq kernel/softirq.c:595 [inline] invoke_softirq kernel/softirq.c:435 [inline] __irq_exit_rcu+0xf7/0x220 kernel/softirq.c:662 irq_exit_rcu+0x9/0x30 kernel/softirq.c:678 instr_sysvec_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1049 [inline] sysvec_apic_timer_interrupt+0xa6/0xc0 arch/x86/kernel/apic/apic.c:1049 </IRQ> <TASK> asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:702 RIP: 0010:should_resched arch/x86/include/asm/preempt.h:103 [inline] RIP: 0010:__local_bh_enable_ip+0x170/0x200 kernel/softirq.c:396 Code: 8c e8 e4 03 67 0a 65 66 8b 05 f4 10 a2 7e 66 85 c0 75 5d bf 01 00 00 00 e8 1d bd 0b 00 e8 c8 68 45 00 fb 65 8b 05 b8 10 a2 7e <85> c0 75 05 e8 37 82 a8 ff 48 c7 44 24 20 0e 36 e0 45 49 c7 04 1c RSP: 0018:ffffc90003167a80 EFLAGS: 00000282 RAX: 0000000080000000 RBX: 1ffff9200062cf54 RCX: ffffffff817b274a RDX: dffffc0000000000 RSI: ffffffff8c0a98e0 RDI: ffffffff8c5fb0e0 RBP: ffffc90003167b40 R08: ffffffff942a4987 R09: 1ffffffff2854930 R10: dffffc0000000000 R11: fffffbfff2854931 R12: dffffc0000000000 R13: 1ffff9200062cf58 R14: ffffc90003167ac0 R15: 0000000000000200 keep_key_fresh drivers/net/wireguard/send.c:138 [inline] wg_packet_create_data_done drivers/net/wireguard/send.c:259 [inline] wg_packet_tx_worker+0x705/0x810 drivers/net/wireguard/send.c:276 process_one_work kernel/workqueue.c:3229 [inline] process_scheduled_works+0xa68/0x1840 kernel/workqueue.c:3310 worker_thread+0x870/0xd30 kernel/workqueue.c:3391 kthread+0x2f2/0x390 kernel/kthread.c:389 ret_from_fork+0x4d/0x80 arch/x86/kernel/process.c:147 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:244 </TASK>