BUG: workqueue lockup - pool cpus=0 node=0 flags=0x0 nice=0 stuck for 184s! Showing busy workqueues and worker pools: workqueue events: flags=0x100 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=16 refcnt=17 pending: 5*nsim_dev_hwstats_traffic_work, 4*psi_avgs_work, 6*ovs_dp_masks_rebalance, [ 2286.837183][ C0] pending: 5*nsim_dev_hwstats_traffic_work, 4*psi_avgs_work, 6*ovs_dp_masks_rebalance, vmstat_shepherd workqueue events_long: flags=0x100 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=10 refcnt=11 pending: 6*defense_work_handler, 4*br_fdb_cleanup workqueue events_unbound: flags=0x2 pwq 8: cpus=0-1 flags=0x4 nice=0 active=14 refcnt=15 in-flight: 25249:cfg80211_wiphy_work ,1214:cfg80211_wiphy_work ,6008:cfg80211_wiphy_work ,1164:cfg80211_wiphy_work pending: 6*nsim_dev_trap_report_work, 2*cfg80211_wiphy_work, 2*idle_cull_fn pwq 8: cpus=0-1 flags=0x4 nice=0 active=3 refcnt=4 in-flight: 26287:cfg80211_wiphy_work ,24317:cfg80211_wiphy_work pending: bpf_map_free_deferred workqueue events_freezable: flags=0x104 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: update_balloon_stats_func workqueue events_power_efficient: flags=0x180 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=11 refcnt=12 pending: gc_worker, wg_ratelimiter_gc_entries, 2*neigh_managed_work, 2*neigh_periodic_work, do_cache_clean, 4*check_lifetime workqueue kvfree_rcu_reclaim: flags=0xa pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: kfree_rcu_monitor workqueue mm_percpu_wq: flags=0x8 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: vmstat_update workqueue writeback: flags=0x4a pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wb_workfn workqueue usb_hub_wq: flags=0x104 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=2 refcnt=3 in-flight: 29537:hub_event hub_event pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 in-flight: 8259:hub_event hub_event workqueue ipv6_addrconf: flags=0x6000a pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=7 pending: addrconf_verify_work inactive: 3*addrconf_verify_work workqueue krxrpcd: flags=0x2001a pwq 9: cpus=0-1 node=0 flags=0x4 nice=-20 active=1 refcnt=12 pending: rxrpc_peer_keepalive_worker inactive: 8*rxrpc_peer_keepalive_worker workqueue bat_events: flags=0x6000a pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=5 pending: batadv_bla_periodic_work inactive: batadv_dat_purge workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue bond8: flags=0x2000a pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=5 pending: bond_alb_monitor inactive: bond_mii_monitor workqueue bond17: flags=0x2000a pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=5 pending: bond_mii_monitor inactive: bond_alb_monitor workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=2 refcnt=3 pending: 2*wg_packet_handshake_send_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_queued_expired_zero_key_material workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=3 refcnt=4 pending: wg_packet_handshake_send_worker, 2*wg_queued_expired_zero_key_material workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=2 refcnt=3 pending: 2*wg_packet_handshake_send_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_queued_expired_zero_key_material workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_queued_expired_zero_key_material workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=2 refcnt=3 pending: 2*wg_packet_handshake_send_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue hci1: flags=0x20012 pwq 9: cpus=0-1 node=0 flags=0x4 nice=-20 active=1 refcnt=4 pending: hci_conn_timeout workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x4 nice=0 active=2 refcnt=3 pending: 2*wg_packet_handshake_send_worker pool 2: cpus=0 node=0 flags=0x0 nice=0 hung=184s workers=15 idle: 31521 28587 31629 6089 31628 24314 27646 5924 26077 26699 28422 7123 5978 7183 pool 6: cpus=1 node=0 flags=0x0 nice=0 hung=0s workers=12 idle: 5878 26650 25345 25344 5808 25346 29003 5885 29475 29659 6186 pool 8: cpus=0-1 flags=0x4 nice=0 hung=123s workers=34 idle: 57 1306 3540 26377 8253 26566 3460 3858 979 6088 3617 13 25457 3566 24725 2189 25932 5980 29835 1511 29162 25478 12 43 24791 27174 26687 149 Showing backtraces of running workers in stalled CPU-bound worker pools: pool 2: task:kworker/0:7 state:R running task stack:22464 pid:29537 tgid:29537 ppid:2 task_flags:0x4208060 flags:0x00080000 Workqueue: usb_hub_wq hub_event Call Trace: context_switch kernel/sched/core.c:5256 [inline] __schedule+0x145f/0x5070 kernel/sched/core.c:6863 __schedule_loop kernel/sched/core.c:6945 [inline] schedule+0x165/0x360 kernel/sched/core.c:6960 schedule_timeout+0x12b/0x270 kernel/time/sleep_timeout.c:99 schedule_timeout_uninterruptible kernel/time/sleep_timeout.c:158 [inline] msleep+0xa2/0x100 kernel/time/sleep_timeout.c:318 hub_port_debounce+0x204/0x340 drivers/usb/core/hub.c:4728 hub_port_debounce_be_stable drivers/usb/core/hub.h:184 [inline] hub_port_connect drivers/usb/core/hub.c:5419 [inline] hub_port_connect_change drivers/usb/core/hub.c:5707 [inline] port_event drivers/usb/core/hub.c:5871 [inline] hub_event+0x1d5e/0x4f30 drivers/usb/core/hub.c:5953 process_one_work kernel/workqueue.c:3257 [inline] process_scheduled_works+0xad1/0x1770 kernel/workqueue.c:3340 worker_thread+0x8a0/0xda0 kernel/workqueue.c:3421 kthread+0x711/0x8a0 kernel/kthread.c:463 ret_from_fork+0x510/0xa50 arch/x86/kernel/process.c:158 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:246