BUG: workqueue lockup - pool cpus=1 node=0 flags=0x0 nice=0 stuck for 143s! Showing busy workqueues and worker pools: workqueue events: flags=0x0 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=5 refcnt=6 in-flight: 1210:free_ipc pending: 3*nsim_dev_hwstats_traffic_work, psi_avgs_work pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=12 refcnt=13 in-flight: 5928:reg_todo pending: 2*nsim_dev_hwstats_traffic_work, 2*psi_avgs_work, 3*ovs_dp_masks_rebalance, psi_avgs_work, free_obj_work, delayed_vfree_work, update_super_work workqueue events_long: flags=0x0 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 in-flight: 121:defense_work_handler workqueue events_unbound: flags=0x2 pwq 8: cpus=0-1 flags=0x6 nice=0 active=18 refcnt=19 in-flight: 13:cfg80211_wiphy_work cfg80211_wiphy_work ,2120:cfg80211_wiphy_work cfg80211_wiphy_work ,67:cfg80211_wiphy_work cfg80211_wiphy_work ,37:cfg80211_wiphy_work cfg80211_wiphy_work ,3583:cfg80211_wiphy_work cfg80211_wiphy_work ,6631:cfg80211_wiphy_work cfg80211_wiphy_work pending: 3*nsim_dev_trap_report_work, cfg80211_wiphy_work, toggle_allocation_gate, nsim_dev_trap_report_work pwq 8: cpus=0-1 flags=0x6 nice=0 active=3 refcnt=4 in-flight: 12:cfg80211_wiphy_work cfg80211_wiphy_work pending: nsim_dev_trap_report_work workqueue events_power_efficient: flags=0x80 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=1 refcnt=2 in-flight: 10:neigh_periodic_work pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=8 refcnt=9 pending: nf_flow_offload_work_gc, gc_worker, do_cache_clean, reg_check_chans_work, 4*check_lifetime workqueue mm_percpu_wq: flags=0x8 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: vmstat_update workqueue ipv6_addrconf: flags=0x6000a pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=10 in-flight: 3199(RESCUER):addrconf_verify_work inactive: 5*addrconf_verify_work workqueue bat_events: flags=0x6000a pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=49 in-flight: 3423(RESCUER):batadv_dat_purge inactive: batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, batadv_dat_purge, batadv_bla_periodic_work, 3*batadv_nc_worker, 5*batadv_mcast_mla_update, 4*batadv_iv_send_outstanding_bat_ogm_packet, 2*batadv_purge_orig, 7*batadv_iv_send_outstanding_bat_ogm_packet, 3*batadv_purge_orig, 4*batadv_iv_send_outstanding_bat_ogm_packet, 4*batadv_tt_purge, batadv_nc_worker, batadv_tt_purge, batadv_nc_worker, batadv_dat_purge, batadv_bla_periodic_work workqueue hci0: flags=0x20012 pwq 9: cpus=0-1 node=0 flags=0x6 nice=-20 active=1 refcnt=4 in-flight: 51:hci_cmd_sync_work workqueue hci2: flags=0x20012 pwq 9: cpus=0-1 node=0 flags=0x6 nice=-20 active=1 refcnt=4 in-flight: 5873:hci_cmd_sync_work workqueue hci3: flags=0x20012 pwq 9: cpus=0-1 node=0 flags=0x6 nice=-20 active=1 refcnt=4 in-flight: 5874:hci_cmd_sync_work workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 in-flight: 7030:wg_packet_handshake_send_worker workqueue wg-crypt-wg0: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 in-flight: 36:wg_packet_handshake_send_worker workqueue wg-crypt-wg1: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg2: flags=0x24 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 in-flight: 7029:wg_packet_handshake_send_worker workqueue wg-crypt-wg0: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg0: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg1: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=2 refcnt=3 pending: 2*wg_packet_handshake_send_worker workqueue wg-crypt-wg1: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg2: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 in-flight: 7028:wg_packet_handshake_send_worker workqueue wg-crypt-wg2: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 in-flight: 3980:wg_packet_handshake_send_worker workqueue wg-crypt-wg0: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg0: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg0: flags=0x28 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=2 refcnt=3 in-flight: 6013:wg_packet_encrypt_worker pending: wg_packet_tx_worker pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-crypt-wg1: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_tx_worker, wg_packet_encrypt_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg2: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg1: flags=0x24 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-kex-wg1: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg1: flags=0x28 pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=2 refcnt=3 pending: wg_packet_encrypt_worker, wg_packet_tx_worker workqueue wg-kex-wg2: flags=0x24 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=1 refcnt=2 in-flight: 5920:wg_packet_handshake_receive_worker pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_receive_worker workqueue wg-kex-wg2: flags=0x6 pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=2 pending: wg_packet_handshake_send_worker workqueue wg-crypt-wg2: flags=0x28 pwq 2: cpus=0 node=0 flags=0x0 nice=0 active=1 refcnt=2 in-flight: 5935:wg_packet_decrypt_worker pwq 6: cpus=1 node=0 flags=0x0 nice=0 active=1 refcnt=2 pending: wg_packet_decrypt_worker workqueue bond3: flags=0x2000a pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=6 MAYDAY pending: bond_alb_monitor inactive: bond_mii_monitor workqueue bond1: flags=0x2000a pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=6 MAYDAY pending: bond_mii_monitor inactive: bond_alb_monitor workqueue bond2: flags=0x2000a pwq 8: cpus=0-1 flags=0x6 nice=0 active=1 refcnt=6 MAYDAY pending: bond_mii_monitor inactive: bond_alb_monitor pool 2: cpus=0 node=0 flags=0x0 nice=0 hung=1s workers=8 idle: 5936 7033 9 pool 6: cpus=1 node=0 flags=0x0 nice=0 hung=144s workers=8 idle: 5945 5867 5981 24 44 5921 pool 8: cpus=0-1 flags=0x6 nice=0 hung=0s workers=13 manager: 7032 pool 9: cpus=0-1 node=0 flags=0x6 nice=-20 hung=0s workers=7 manager: 5181 idle: 5862 5872 5869 Showing backtraces of running workers in stalled CPU-bound worker pools: pool 6: task:kworker/1:2 state:R running task stack:23432 pid:121 tgid:121 ppid:2 task_flags:0x4208060 flags:0x00004000 Workqueue: events_long defense_work_handler Call Trace: context_switch kernel/sched/core.c:5357 [inline] __schedule+0x1798/0x4cc0 kernel/sched/core.c:6961 preempt_schedule_common+0x83/0xd0 kernel/sched/core.c:7145 preempt_schedule+0xae/0xc0 kernel/sched/core.c:7169 preempt_schedule_thunk+0x16/0x30 arch/x86/entry/thunk.S:12 __local_bh_enable_ip+0x13e/0x1c0 kernel/softirq.c:414 local_bh_enable include/linux/bottom_half.h:33 [inline] update_defense_level+0x8d2/0xd80 net/netfilter/ipvs/ip_vs_ctl.c:210 defense_work_handler+0x2d/0xd0 net/netfilter/ipvs/ip_vs_ctl.c:235 process_one_work kernel/workqueue.c:3236 [inline] process_scheduled_works+0xae1/0x17b0 kernel/workqueue.c:3319 worker_thread+0x8a0/0xda0 kernel/workqueue.c:3400 kthread+0x711/0x8a0 kernel/kthread.c:463 ret_from_fork+0x3f9/0x770 arch/x86/kernel/process.c:148 ret_from_fork_asm+0x1a/0x30 arch/x86/entry/entry_64.S:245