Got infinite hang when waiting for udev to finish #1273
Description
Current Behavior
Got the kernel to hang during boot (on bpi-r3), Possibly there are something in the kernel config that make this make a kernel OOOPS and then reboot. This should not happen, on any platform, we should get a reboot. That is what i thought the kernel was configured to.
OK ] Verifying D-Bus machine UUID
[ OK ] Starting Device event daemon (udev)
[ OK ] Requesting device events
[ OK ] Requesting subsystem events
[ ⋯ ] Waiting for udev to finish[ 3.536308] mtk-pcie-gen3 11280000.pcie: PCIe link down, current LTSSM state: detect.quiet (0x0)
[ 3.545267] mtk-pcie-gen3 11280000.pcie: probe with driver mtk-pcie-gen3 failed with error -110
[ 3.948346] Trying to vfree() nonexistent vm area (00000000f77ef36d)
[ 3.955048] Unable to handle kernel paging request at virtual address ffff80007a600ad0
[ 3.962948] Mem abort info:
[ 3.965729] ESR = 0x0000000096000007
[ 3.969465] EC = 0x25: DABT (current EL), IL = 32 bits
[ 3.974761] SET = 0, FnV = 0
[ 3.977803] EA = 0, S1PTW = 0
[ 3.980931] FSC = 0x07: level 3 translation fault
[ 3.985795] Data abort info:
[ 3.988663] ISV = 0, ISS = 0x00000007, ISS2 = 0x00000000
[ 3.994136] CM = 0, WnR = 0, TnD = 0, TagAccess = 0
[ 3.999173] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
[ 4.004470] swapper pgtable: 4k pages, 48-bit VAs, pgdp=00000000457d5000
[ 4.011156] [ffff80007a600ad0] pgd=1000000046253003, p4d=1000000046253003, pud=100000004fcf1003, pmd=100000004fc94003, pte=0000000000000000
[ 4.023664] Internal error: Oops: 0000000096000007 [#1] PREEMPT SMP
[ 4.029918] Modules linked in: mt7915e(+) mt76_connac_lib mt76 mac80211 libarc4 tag_mtk mt7530_mdio cfg80211 mt7530 xhci_mtk_hcd phy_mtk_tphy crypto_safexcel i2c_mt65xx xhci_hcd mtk_rng rng_core pcie_mediatek_gen3 auxadc_thermal nvmem_mtk_efuse authenc pwm_mediatek pwm_fan
[ 4.054078] CPU: 1 UID: 0 PID: 1601 Comm: udevd Not tainted 6.12.58 #1
[ 4.060591] Hardware name: Bananapi BPI-R3 (DT)
[ 4.065107] pstate: 600003c5 (nZCv DAIF -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 4.072053] pc : find_kallsyms_symbol+0x50/0x1a0
[ 4.076662] lr : module_address_lookup+0x74/0xf0
[ 4.081269] sp : ffff8000854c2a10
[ 4.084573] x29: ffff8000854c2a10 x28: 0000000000000000 x27: 0000000000000008
[ 4.091697] x26: 00000000ffffffd8 x25: ffff8000854c31a0 x24: ffff80007a5d78e8
[ 4.098822] x23: ffff8000854c2b1e x22: ffff8000854c2aa8 x21: ffff8000854c2ab0
[ 4.105947] x20: ffff8000854c2a98 x19: ffff8000854c2aa0 x18: 00000000fffffffd
[ 4.113071] x17: 3033333566343130 x16: 3030306666666620 x15: 0000000000000000
[ 4.120196] x14: 0000000000000000 x13: 5d62696c5f63616e x12: 6e6f635f3637746d
[ 4.127321] x11: ffff800081efbf30 x10: 0000000000000020 x9 : ffff8000800fb60c
[ 4.127830] usb 1-1: new high-speed USB device number 2 using xhci-mtk
[ 4.134439] x8 : ffff80007a600ac8 x7 : 0000000000000000 x6 : ffff80007a5d78e8
[ 4.134447] x5 : ffff80007a5eb000 x4 : ffff80007a5eae00 x3 : ffff8000854c2aa8
[ 4.155197] x2 : ffff8000854c2ab0 x1 : ffff80007a5d78e8 x0 : ffff80007a5eacc0
[ 4.162322] Call trace:
[ 4.164757] find_kallsyms_symbol+0x50/0x1a0
[ 4.169019] kallsyms_lookup_buildid+0xe8/0x140
[ 4.173542] __sprint_symbol.isra.0+0x68/0x130
[ 4.177976] sprint_symbol_build_id+0x20/0x40
[ 4.182324] symbol_string+0x124/0x170
[ 4.186064] pointer+0x84/0x4b0
[ 4.189197] vsnprintf+0x198/0x790
[ 4.192589] vprintk_store+0x118/0x470
[ 4.196330] vprintk_emit+0xd0/0x2d0
[ 4.199896] vprintk_default+0x40/0x60
[ 4.203635] vprintk+0x44/0xc0
[ 4.206681] _printk+0x68/0xa0
[ 4.209727] dump_backtrace_entry+0x28/0x40
[ 4.213900] arch_stack_walk+0x148/0x3f0
[ 4.217813] dump_backtrace.part.0+0xd8/0xf0
[ 4.222075] dump_backtrace+0x2c/0x40
[ 4.225729] show_regs+0x34/0x50
[ 4.228948] __warn+0x98/0x188
[ 4.231996] report_bug+0x150/0x200
[ 4.235476] bug_handler+0x2c/0x90
[ 4.238867] call_break_hook+0x7c/0xa0
[ 4.242607] brk_handler+0x24/0x70
[ 4.245998] do_debug_exception+0x70/0x110
[ 4.250084] el1_dbg+0x70/0x90
[ 4.253129] el1h_64_sync_handler+0xc4/0xf0
[ 4.257301] el1h_64_sync+0x64/0x68
[ 4.260780] vfree+0x2bc/0x320
[ 4.263829] kvfree+0x2c/0x60
[ 4.266789] vfree+0x12c/0x320
[ 4.269835] free_fw_priv+0xe4/0xf0
[ 4.273317] release_firmware+0x50/0x80
[ 4.277144] mt76_connac2_load_ram+0x15c/0x250 [mt76_connac_lib]
[ 4.283164] Unable to handle kernel paging request at virtual address ffff80007a600ad0
[ 4.291064] Mem abort info:
[ 4.293845] ESR = 0x0000000096000007
[ 4.297581] EC = 0x25: DABT (current EL), IL = 32 bits
[ 4.302879] SET = 0, FnV = 0
[ 4.305921] EA = 0, S1PTW = 0
[ 4.309050] FSC = 0x07: level 3 translation fault
[ 4.313914] Data abort info:
[ 4.316782] ISV = 0, ISS = 0x00000007, ISS2 = 0x00000000
[ 4.322252] CM = 0, WnR = 0, TnD = 0, TagAccess = 0
[ 4.327290] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
[ 4.332588] swapper pgtable: 4k pages, 48-bit VAs, pgdp=00000000457d5000
[ 4.339274] [ffff80007a600ad0] pgd=1000000046253003, p4d=1000000046253003, pud=100000004fcf1003, pmd=100000004fc94003, pte=0000000000000000
[ 6.168380] usb 1-1: Device is not authorized for usage
[ 25.183779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 25.189888] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=959
[ 25.198833] rcu: (detected by 3, t=5255 jiffies, g=-459, q=1489 ncpus=4)
[ 25.205609] Sending NMI from CPU 3 to CPUs 1:
[ 35.205619] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 35.221251] rcu: Possible timer handling issue on cpu=3 timer-softirq=780
[ 35.228109] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[ 35.238438] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 35.247550] rcu: RCU grace-period kthread stack dump:
[ 35.252586] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 35.261882] Call trace:
[ 35.264318] __switch_to+0xe8/0x148
[ 35.267806] __schedule+0x2c8/0x8d8
[ 35.271287] schedule+0x3c/0x120
[ 35.274507] schedule_timeout+0x9c/0x1b0
[ 35.278420] rcu_gp_fqs_loop+0x100/0x4e0
[ 35.282336] rcu_gp_kthread+0x130/0x170
[ 35.286160] kthread+0x118/0x130
[ 35.289381] ret_from_fork+0x10/0x20
[ 35.292948] rcu: Stack dump where RCU GP kthread last ran:
[ 35.298421] CPU: 3 UID: 0 PID: 0 Comm: swapper/3 Not tainted 6.12.58 #1
[ 35.305024] Hardware name: Bananapi BPI-R3 (DT)
[ 35.309541] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 35.316489] pc : default_idle_call+0x34/0x170
[ 35.320837] lr : default_idle_call+0x28/0x170
[ 35.325183] sp : ffff8000823e3df0
[ 35.328486] x29: ffff8000823e3df0 x28: 0000000000000000 x27: 0000000000000000
[ 35.335611] x26: 0000000000000000 x25: ffff0000002c2200 x24: 0000000000000000
[ 35.342736] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff0000002c2200
[ 35.349860] x20: ffff800081ed9ba0 x19: 0000000000000003 x18: 0000000000000000
[ 35.356984] x17: 0000000000001000 x16: 0000000000008588 x15: 0000000000000001
[ 35.364109] x14: 0000000000000400 x13: 0000000000000033 x12: 0000000000000001
[ 35.371233] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 35.378358] x8 : ffff0000002c2cc0 x7 : 0000000000000000 x6 : 0000000000000000
[ 35.385482] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 35.392607] x2 : ffff0000002c2200 x1 : 0000000000000001 x0 : 4000000000000000
[ 35.399732] Call trace:
[ 35.402168] default_idle_call+0x34/0x170
[ 35.406168] do_idle+0x1f8/0x230
[ 35.409390] cpu_startup_entry+0x40/0x50
[ 35.413305] secondary_start_kernel+0x120/0x148
[ 35.417826] __secondary_switched+0xb8/0xc0
[ 65.442920] udevd[1333]: worker [1601] /devices/platform/soc/18000000.wifi is taking a long time
[ 98.423779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 98.429887] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=4111
[ 98.438919] rcu: (detected by 2, t=23565 jiffies, g=-459, q=6307 ncpus=4)
[ 98.445781] Sending NMI from CPU 2 to CPUs 1:
[ 108.445793] rcu: rcu_preempt kthread starved for 2495 jiffies! g-459 f0x0 RCU_GP_DOING_FQS(6) ->state=0x0 ->cpu=3
[ 108.460385] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 108.469500] rcu: RCU grace-period kthread stack dump:
[ 108.474538] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 108.483835] Call trace:
[ 108.486271] __switch_to+0xe8/0x148
[ 108.489759] __schedule+0x2c8/0x8d8
[ 108.493240] schedule+0x3c/0x120
[ 108.496460] schedule_timeout+0x9c/0x1b0
[ 108.500372] rcu_gp_fqs_loop+0x100/0x4e0
[ 108.504287] rcu_gp_kthread+0x130/0x170
[ 108.508113] kthread+0x118/0x130
[ 108.511333] ret_from_fork+0x10/0x20
[ 108.514901] rcu: Stack dump where RCU GP kthread last ran:
[ 108.520373] Sending NMI from CPU 2 to CPUs 3:
[ 108.524723] NMI backtrace for cpu 3 skipped: idling at default_idle_call+0x34/0x170
[ 121.823852] Unable to handle kernel paging request at virtual address 0000fe46b088f048
[ 121.831788] Mem abort info:
[ 121.834571] ESR = 0x0000000096000004
[ 121.838311] EC = 0x25: DABT (current EL), IL = 32 bits
[ 121.843615] SET = 0, FnV = 0
[ 121.846664] EA = 0, S1PTW = 0
[ 121.849797] FSC = 0x04: level 0 translation fault
[ 121.854665] Data abort info:
[ 121.857537] ISV = 0, ISS = 0x00000004, ISS2 = 0x00000000
[ 121.863012] CM = 0, WnR = 0, TnD = 0, TagAccess = 0
[ 121.868056] GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
[ 121.873359] user pgtable: 4k pages, 48-bit VAs, pgdp=0000000054e8c000
[ 121.879789] [0000fe46b088f048] pgd=0000000000000000, p4d=0000000000000000
[ 171.543779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 171.549880] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=7268
[ 171.558913] rcu: (detected by 0, t=41845 jiffies, g=-459, q=7827 ncpus=4)
[ 171.565774] Sending NMI from CPU 0 to CPUs 1:
[ 181.565783] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 181.581406] rcu: Possible timer handling issue on cpu=0 timer-softirq=4280
[ 181.588350] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
[ 181.598678] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 181.607790] rcu: RCU grace-period kthread stack dump:
[ 181.612827] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 181.622121] Call trace:
[ 181.624557] __switch_to+0xe8/0x148
[ 181.628044] __schedule+0x2c8/0x8d8
[ 181.631523] schedule+0x3c/0x120
[ 181.634743] schedule_timeout+0x9c/0x1b0
[ 181.638655] rcu_gp_fqs_loop+0x100/0x4e0
[ 181.642571] rcu_gp_kthread+0x130/0x170
[ 181.646396] kthread+0x118/0x130
[ 181.649617] ret_from_fork+0x10/0x20
[ 181.653185] rcu: Stack dump where RCU GP kthread last ran:
[ 181.658657] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.12.58 #1
[ 181.665258] Hardware name: Bananapi BPI-R3 (DT)
[ 181.669775] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 181.676722] pc : default_idle_call+0x34/0x170
[ 181.681068] lr : default_idle_call+0x28/0x170
[ 181.685414] sp : ffff800081ed3d80
[ 181.688716] x29: ffff800081ed3d80 x28: 00000000bffbcd10 x27: 00000000bffc874a
[ 181.695842] x26: 000000000000008e x25: ffff800081eeb400 x24: 0000000000000000
[ 181.702966] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff800081eeb400
[ 181.710091] x20: ffff800081ed9ba0 x19: 0000000000000000 x18: 0000000000000000
[ 181.717215] x17: 0000000000001000 x16: 0000000000008870 x15: 0000000000000003
[ 181.724340] x14: 0000000000000400 x13: 0000000000000000 x12: 0000000000000002
[ 181.731465] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 181.738589] x8 : ffff800081eebec0 x7 : 0000000000000000 x6 : 0000000000000000
[ 181.745713] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 181.752837] x2 : ffff800081eeb400 x1 : 0000000000000001 x0 : 4000000000000000
[ 181.759961] Call trace:
[ 181.762397] default_idle_call+0x34/0x170
[ 181.766396] do_idle+0x1f8/0x230
[ 181.769617] cpu_startup_entry+0x40/0x50
[ 181.773531] rest_init+0xe0/0xf0
[ 181.776750] start_kernel+0x6e0/0x6e8
[ 181.780405] __primary_switched+0x80/0x90
[ 184.787536] udevd[1333]: worker [1601] /devices/platform/soc/18000000.wifi timeout; kill it
[ 184.795907] udevd[1333]: seq 1529 '/devices/platform/soc/18000000.wifi' killed
[ 244.803779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 244.809883] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=10419
[ 244.819003] rcu: (detected by 2, t=60160 jiffies, g=-459, q=7827 ncpus=4)
[ 244.825865] Sending NMI from CPU 2 to CPUs 1:
[ 254.825874] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 254.841504] rcu: Possible timer handling issue on cpu=2 timer-softirq=4899
[ 254.848450] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=2
[ 254.858778] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 254.867892] rcu: RCU grace-period kthread stack dump:
[ 254.872929] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 254.882224] Call trace:
[ 254.884661] __switch_to+0xe8/0x148
[ 254.888150] __schedule+0x2c8/0x8d8
[ 254.891630] schedule+0x3c/0x120
[ 254.894850] schedule_timeout+0x9c/0x1b0
[ 254.898762] rcu_gp_fqs_loop+0x100/0x4e0
[ 254.902679] rcu_gp_kthread+0x130/0x170
[ 254.906504] kthread+0x118/0x130
[ 254.909725] ret_from_fork+0x10/0x20
[ 254.913293] rcu: Stack dump where RCU GP kthread last ran:
[ 254.918766] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Not tainted 6.12.58 #1
[ 254.925367] Hardware name: Bananapi BPI-R3 (DT)
[ 254.929884] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 254.936831] pc : default_idle_call+0x34/0x170
[ 254.941178] lr : default_idle_call+0x28/0x170
[ 254.945525] sp : ffff8000823dbdf0
[ 254.948827] x29: ffff8000823dbdf0 x28: 0000000000000000 x27: 0000000000000000
[ 254.955952] x26: 0000000000000000 x25: ffff0000002c1100 x24: 0000000000000000
[ 254.963077] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff0000002c1100
[ 254.970202] x20: ffff800081ed9ba0 x19: 0000000000000002 x18: 0000000000000000
[ 254.977327] x17: 0000000000001000 x16: 0000000000008870 x15: 0000000000000003
[ 254.984451] x14: 0000000000000400 x13: 0000000000000000 x12: 0000000000000002
[ 254.991576] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 254.998700] x8 : ffff0000002c1bc0 x7 : 0000000000000000 x6 : 0000000000000000
[ 255.005825] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 255.012950] x2 : ffff0000002c1100 x1 : 0000000000000001 x0 : 4000000000000000
[ 255.020074] Call trace:
[ 255.022510] default_idle_call+0x34/0x170
[ 255.026510] do_idle+0x1f8/0x230
[ 255.029731] cpu_startup_entry+0x40/0x50
[ 255.033645] secondary_start_kernel+0x120/0x148
[ 255.038166] __secondary_switched+0xb8/0xc0
[ 318.043780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 318.049886] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=13571
[ 318.059006] rcu: (detected by 2, t=78470 jiffies, g=-459, q=7841 ncpus=4)
[ 318.065869] Sending NMI from CPU 2 to CPUs 1:
[ 381.119779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 381.125886] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=16225
[ 381.135006] rcu: (detected by 0, t=94239 jiffies, g=-459, q=7841 ncpus=4)
[ 381.141867] Sending NMI from CPU 0 to CPUs 1:
[ 391.141876] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 391.157500] rcu: Possible timer handling issue on cpu=0 timer-softirq=9173
[ 391.164445] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
[ 391.174774] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 391.183886] rcu: RCU grace-period kthread stack dump:
[ 391.188923] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 391.198217] Call trace:
[ 391.200654] __switch_to+0xe8/0x148
[ 391.204140] __schedule+0x2c8/0x8d8
[ 391.207621] schedule+0x3c/0x120
[ 391.210840] schedule_timeout+0x9c/0x1b0
[ 391.214753] rcu_gp_fqs_loop+0x100/0x4e0
[ 391.218669] rcu_gp_kthread+0x130/0x170
[ 391.222493] kthread+0x118/0x130
[ 391.225713] ret_from_fork+0x10/0x20
[ 391.229280] rcu: Stack dump where RCU GP kthread last ran:
[ 391.234753] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.12.58 #1
[ 391.241355] Hardware name: Bananapi BPI-R3 (DT)
[ 391.245872] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 391.252819] pc : default_idle_call+0x34/0x170
[ 391.257166] lr : default_idle_call+0x28/0x170
[ 391.261511] sp : ffff800081ed3d80
[ 391.264814] x29: ffff800081ed3d80 x28: 00000000bffbcd10 x27: 00000000bffc874a
[ 391.271940] x26: 000000000000008e x25: ffff800081eeb400 x24: 0000000000000000
[ 391.279065] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff800081eeb400
[ 391.286191] x20: ffff800081ed9ba0 x19: 0000000000000000 x18: 0000000000000000
[ 391.293315] x17: 0000000000001000 x16: 0000000000018ae8 x15: 0000000000000001
[ 391.300440] x14: 0000000000000400 x13: 0000000000000000 x12: 000000000000004a
[ 391.307565] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 391.314689] x8 : ffff800081eebec0 x7 : 0000000000000000 x6 : 0000000000000000
[ 391.321813] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 391.328937] x2 : ffff800081eeb400 x1 : 0000000000000001 x0 : 4000000000000000
[ 391.336062] Call trace:
[ 391.338497] default_idle_call+0x34/0x170
[ 391.342496] do_idle+0x1f8/0x230
[ 391.345718] cpu_startup_entry+0x40/0x50
[ 391.349632] rest_init+0xe0/0xf0
[ 391.352851] start_kernel+0x6e0/0x6e8
[ 391.356506] __primary_switched+0x80/0x90
[ 454.379779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 454.385883] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=19376
[ 454.395003] rcu: (detected by 2, t=112554 jiffies, g=-459, q=7841 ncpus=4)
[ 454.401951] Sending NMI from CPU 2 to CPUs 1:
[ 464.401959] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 464.417582] rcu: Possible timer handling issue on cpu=2 timer-softirq=10585
[ 464.424614] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=2
[ 464.434943] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 464.444055] rcu: RCU grace-period kthread stack dump:
[ 464.449092] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 464.458386] Call trace:
[ 464.460822] __switch_to+0xe8/0x148
[ 464.464309] __schedule+0x2c8/0x8d8
[ 464.467789] schedule+0x3c/0x120
[ 464.471008] schedule_timeout+0x9c/0x1b0
[ 464.474921] rcu_gp_fqs_loop+0x100/0x4e0
[ 464.478837] rcu_gp_kthread+0x130/0x170
[ 464.482662] kthread+0x118/0x130
[ 464.485883] ret_from_fork+0x10/0x20
[ 464.489451] rcu: Stack dump where RCU GP kthread last ran:
[ 464.494924] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Not tainted 6.12.58 #1
[ 464.501525] Hardware name: Bananapi BPI-R3 (DT)
[ 464.506042] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 464.512990] pc : default_idle_call+0x34/0x170
[ 464.517336] lr : default_idle_call+0x28/0x170
[ 464.521682] sp : ffff8000823dbdf0
[ 464.524985] x29: ffff8000823dbdf0 x28: 0000000000000000 x27: 0000000000000000
[ 464.532110] x26: 0000000000000000 x25: ffff0000002c1100 x24: 0000000000000000
[ 464.539234] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff0000002c1100
[ 464.546359] x20: ffff800081ed9ba0 x19: 0000000000000002 x18: 0000000000000000
[ 464.553483] x17: 0000000000001000 x16: 0000000000018ae9 x15: 0000000000000001
[ 464.560608] x14: 0000000000000400 x13: 0000000000000000 x12: 0000000000000100
[ 464.567732] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 464.574857] x8 : ffff0000002c1bc0 x7 : 0000000000000000 x6 : 0000000000000000
[ 464.581981] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 464.589106] x2 : ffff0000002c1100 x1 : 0000000000000001 x0 : 4000000000000000
[ 464.596230] Call trace:
[ 464.598666] default_idle_call+0x34/0x170
[ 464.602665] do_idle+0x1f8/0x230
[ 464.605886] cpu_startup_entry+0x3c/0x50
[ 464.609800] secondary_start_kernel+0x120/0x148
[ 464.614321] __secondary_switched+0xb8/0xc0
[ 527.619779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 527.625883] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=22527
[ 527.635002] rcu: (detected by 0, t=130864 jiffies, g=-459, q=7841 ncpus=4)
[ 527.641950] Sending NMI from CPU 0 to CPUs 1:
[ 537.641957] rcu: rcu_preempt kthread timer wakeup didn't happen for 2509 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
[ 537.657581] rcu: Possible timer handling issue on cpu=0 timer-softirq=12609
[ 537.664613] rcu: rcu_preempt kthread starved for 2515 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
[ 537.674942] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 537.684054] rcu: RCU grace-period kthread stack dump:
[ 537.689092] task:rcu_preempt state:I stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 537.698387] Call trace:
[ 537.700823] __switch_to+0xe8/0x148
[ 537.704309] __schedule+0x2c8/0x8d8
[ 537.707790] schedule+0x3c/0x120
[ 537.711009] schedule_timeout+0x9c/0x1b0
[ 537.714921] rcu_gp_fqs_loop+0x100/0x4e0
[ 537.718837] rcu_gp_kthread+0x130/0x170
[ 537.722663] kthread+0x118/0x130
[ 537.725885] ret_from_fork+0x10/0x20
[ 537.729452] rcu: Stack dump where RCU GP kthread last ran:
[ 537.734925] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.12.58 #1
[ 537.741525] Hardware name: Bananapi BPI-R3 (DT)
[ 537.746041] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 537.752988] pc : default_idle_call+0x34/0x170
[ 537.757336] lr : default_idle_call+0x28/0x170
[ 537.761682] sp : ffff800081ed3d80
[ 537.764985] x29: ffff800081ed3d80 x28: 00000000bffbcd10 x27: 00000000bffc874a
[ 537.772111] x26: 000000000000008e x25: ffff800081eeb400 x24: 0000000000000000
[ 537.779236] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff800081eeb400
[ 537.786361] x20: ffff800081ed9ba0 x19: 0000000000000000 x18: 0000000000000000
[ 537.793486] x17: 0000000000001000 x16: 0000000000018ae8 x15: 0000000000000001
[ 537.800610] x14: 0000000000000400 x13: 0000000000000000 x12: 000000000000016d
[ 537.807734] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 537.814859] x8 : ffff800081eebec0 x7 : 0000000000000000 x6 : 0000000000000000
[ 537.821983] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 537.829108] x2 : ffff800081eeb400 x1 : 0000000000000001 x0 : 4000000000000000
[ 537.836233] Call trace:
[ 537.838668] default_idle_call+0x34/0x170
[ 537.842668] do_idle+0x1f8/0x230
[ 537.845890] cpu_startup_entry+0x40/0x50
[ 537.849804] rest_init+0xe0/0xf0
[ 537.853023] start_kernel+0x6e0/0x6e8
[ 537.856677] __primary_switched+0x80/0x90
[ 600.879780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 600.885883] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=25679
[ 600.895003] rcu: (detected by 0, t=149179 jiffies, g=-459, q=7841 ncpus=4)
[ 600.901952] Sending NMI from CPU 0 to CPUs 1:
[ 610.901959] rcu: rcu_preempt kthread timer wakeup didn't happen for 2499 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x200
[ 610.917582] rcu: Possible timer handling issue on cpu=0 timer-softirq=14298
[ 610.924614] rcu: rcu_preempt kthread starved for 2505 jiffies! g-459 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x200 ->cpu=0
[ 610.934942] rcu: Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 610.944054] rcu: RCU grace-period kthread stack dump:
[ 610.949091] task:rcu_preempt state:R stack:0 pid:18 tgid:18 ppid:2 flags:0x00000008
[ 610.958385] Call trace:
[ 610.960821] __switch_to+0xe8/0x148
[ 610.964307] __schedule+0x2c8/0x8d8
[ 610.967787] schedule+0x3c/0x120
[ 610.971006] schedule_timeout+0x9c/0x1b0
[ 610.974918] rcu_gp_fqs_loop+0x100/0x4e0
[ 610.978834] rcu_gp_kthread+0x130/0x170
[ 610.982659] kthread+0x118/0x130
[ 610.985880] ret_from_fork+0x10/0x20
[ 610.989447] rcu: Stack dump where RCU GP kthread last ran:
[ 610.994920] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Not tainted 6.12.58 #1
[ 611.001521] Hardware name: Bananapi BPI-R3 (DT)
[ 611.006038] pstate: 60000005 (nZCv daif -PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[ 611.012985] pc : default_idle_call+0x34/0x170
[ 611.017333] lr : default_idle_call+0x28/0x170
[ 611.021678] sp : ffff800081ed3d80
[ 611.024980] x29: ffff800081ed3d80 x28: 00000000bffbcd10 x27: 00000000bffc874a
[ 611.032106] x26: 000000000000008e x25: ffff800081eeb400 x24: 0000000000000000
[ 611.039231] x23: 0000000000000000 x22: ffff800081ed9be0 x21: ffff800081eeb400
[ 611.046355] x20: ffff800081ed9ba0 x19: 0000000000000000 x18: 0000000000000000
[ 611.053479] x17: 0000000000001000 x16: 0000000000018ae8 x15: 0000000000000001
[ 611.060603] x14: 0000000000000400 x13: 0000000000000000 x12: 000000000000022b
[ 611.067728] x11: 00000000000000c0 x10: 0000000000000a60 x9 : ffff800080118d04
[ 611.074853] x8 : ffff800081eebec0 x7 : 0000000000000000 x6 : 0000000000000000
[ 611.081977] x5 : 4000000000000000 x4 : 4000000000000000 x3 : 0000000000000000
[ 611.089101] x2 : ffff800081eeb400 x1 : 0000000000000001 x0 : 4000000000000000
[ 611.096225] Call trace:
[ 611.098661] default_idle_call+0x34/0x170
[ 611.102661] do_idle+0x1f8/0x230
[ 611.105882] cpu_startup_entry+0x40/0x50
[ 611.109796] rest_init+0xe0/0xf0
[ 611.113015] start_kernel+0x6e0/0x6e8
[ 611.116669] __primary_switched+0x80/0x90
[ 663.165567] Unable to handle kernel NULL pointer dereference at virtual address 0000000000000000
[ 663.174361] Mem abort info:
[ 663.177143] ESR = 0x0000000086000004
[ 663.180879] EC = 0x21: IABT (current EL), IL = 32 bits
[ 663.186178] SET = 0, FnV = 0
[ 663.189221] EA = 0, S1PTW = 0
[ 663.192350] FSC = 0x04: level 0 translation fault
[ 663.197213] user pgtable: 4k pages, 48-bit VAs, pgdp=0000000054e8c000
[ 663.203638] [0000000000000000] pgd=0000000000000000, p4d=0000000000000000
[ 674.139778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 674.145861] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=28831
[ 674.154980] rcu: (detected by 2, t=167494 jiffies, g=-459, q=7850 ncpus=4)
[ 674.161927] Sending NMI from CPU 2 to CPUs 1:
[ 737.159778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 737.165859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=31481
[ 737.174977] rcu: (detected by 2, t=183249 jiffies, g=-459, q=7850 ncpus=4)
[ 737.181923] Sending NMI from CPU 2 to CPUs 1:
[ 800.179778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 800.185859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=34131
[ 800.194977] rcu: (detected by 2, t=199004 jiffies, g=-459, q=7850 ncpus=4)
[ 800.201922] Sending NMI from CPU 2 to CPUs 1:
[ 863.199778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 863.205859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=36781
[ 863.214977] rcu: (detected by 2, t=214759 jiffies, g=-459, q=7850 ncpus=4)
[ 863.221923] Sending NMI from CPU 2 to CPUs 1:
[ 926.219778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 926.225859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=39431
[ 926.234976] rcu: (detected by 2, t=230514 jiffies, g=-459, q=7850 ncpus=4)
[ 926.241923] Sending NMI from CPU 2 to CPUs 1:
[ 989.239778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 989.245859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=42081
[ 989.254976] rcu: (detected by 2, t=246269 jiffies, g=-459, q=7850 ncpus=4)
[ 989.261922] Sending NMI from CPU 2 to CPUs 1:
[ 1052.259778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1052.265859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=44731
[ 1052.274976] rcu: (detected by 2, t=262024 jiffies, g=-459, q=7850 ncpus=4)
[ 1052.281923] Sending NMI from CPU 2 to CPUs 1:
[ 1115.279778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1115.285859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=47381
[ 1115.294976] rcu: (detected by 2, t=277779 jiffies, g=-459, q=7850 ncpus=4)
[ 1115.301922] Sending NMI from CPU 2 to CPUs 1:
[ 1178.299778] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1178.305858] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=50031
[ 1178.314976] rcu: (detected by 2, t=293534 jiffies, g=-459, q=7850 ncpus=4)
[ 1178.321921] Sending NMI from CPU 2 to CPUs 1:
[ 1241.319779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1241.325859] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=52681
[ 1241.334976] rcu: (detected by 2, t=309289 jiffies, g=-459, q=7850 ncpus=4)
[ 1241.341922] Sending NMI from CPU 2 to CPUs 1:
[ 1304.339779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1304.345860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=55331
[ 1304.354977] rcu: (detected by 2, t=325044 jiffies, g=-459, q=7850 ncpus=4)
[ 1304.361924] Sending NMI from CPU 2 to CPUs 1:
[ 1367.359779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1367.365860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=57981
[ 1367.374978] rcu: (detected by 2, t=340799 jiffies, g=-459, q=7850 ncpus=4)
[ 1367.381924] Sending NMI from CPU 2 to CPUs 1:
[ 1430.379779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1430.385860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=60631
[ 1430.394978] rcu: (detected by 2, t=356554 jiffies, g=-459, q=7850 ncpus=4)
[ 1430.401924] Sending NMI from CPU 2 to CPUs 1:
[ 1493.399779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1493.405860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=63281
[ 1493.414978] rcu: (detected by 2, t=372309 jiffies, g=-459, q=7850 ncpus=4)
[ 1493.421924] Sending NMI from CPU 2 to CPUs 1:
[ 1556.419779] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1556.425860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=65931
[ 1556.434977] rcu: (detected by 2, t=388064 jiffies, g=-459, q=7850 ncpus=4)
[ 1556.441923] Sending NMI from CPU 2 to CPUs 1:
[ 1619.439780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1619.445860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=68581
[ 1619.454977] rcu: (detected by 2, t=403819 jiffies, g=-459, q=7850 ncpus=4)
[ 1619.461923] Sending NMI from CPU 2 to CPUs 1:
[ 1682.459780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1682.465862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=71231
[ 1682.474979] rcu: (detected by 2, t=419574 jiffies, g=-459, q=7850 ncpus=4)
[ 1682.481925] Sending NMI from CPU 2 to CPUs 1:
[ 1745.479780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1745.485862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=73881
[ 1745.494979] rcu: (detected by 2, t=435329 jiffies, g=-459, q=7850 ncpus=4)
[ 1745.501924] Sending NMI from CPU 2 to CPUs 1:
[ 1808.499780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1808.505860] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=76531
[ 1808.514978] rcu: (detected by 2, t=451084 jiffies, g=-459, q=7850 ncpus=4)
[ 1808.521925] Sending NMI from CPU 2 to CPUs 1:
[ 1871.519780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1871.525861] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=79181
[ 1871.534978] rcu: (detected by 2, t=466839 jiffies, g=-459, q=7850 ncpus=4)
[ 1871.541923] Sending NMI from CPU 2 to CPUs 1:
[ 1934.539780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1934.545861] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=81831
[ 1934.554978] rcu: (detected by 2, t=482594 jiffies, g=-459, q=7850 ncpus=4)
[ 1934.561924] Sending NMI from CPU 2 to CPUs 1:
[ 1997.559781] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1997.565862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=84481
[ 1997.574980] rcu: (detected by 2, t=498349 jiffies, g=-459, q=7850 ncpus=4)
[ 1997.581926] Sending NMI from CPU 2 to CPUs 1:
[ 2060.579780] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2060.585862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=87131
[ 2060.594979] rcu: (detected by 2, t=514104 jiffies, g=-459, q=7850 ncpus=4)
[ 2060.601925] Sending NMI from CPU 2 to CPUs 1:
[ 2123.599781] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2123.605862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=89781
[ 2123.614980] rcu: (detected by 2, t=529859 jiffies, g=-459, q=7850 ncpus=4)
[ 2123.621925] Sending NMI from CPU 2 to CPUs 1:
[ 2186.619781] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2186.625862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=92431
[ 2186.634979] rcu: (detected by 2, t=545614 jiffies, g=-459, q=7850 ncpus=4)
[ 2186.641925] Sending NMI from CPU 2 to CPUs 1:
[ 2249.639781] rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2249.645862] rcu: 1-...0: (4 ticks this GP) idle=3a9c/1/0x4000000000000002 softirq=851/853 fqs=95081
[ 2249.654980] rcu: (detected by 2, t=561369 jiffies, g=-459, q=7850 ncpus=4)
[ 2249.661925] Sending NMI from CPU 2 to CPUs 1:
Expected Behavior
Reboot
Steps To Reproduce
No response
Additional information
No response