Hi, I recently started a balance on a BTRFS filesystem. At least one process failed to write files before or during the balance due to a supposed out-of-space condition. Yes, I know it's not good to allow that to happen. Here is the relevant dmesg output: [694828.101677] BTRFS info (device sdh1): balance: start -dusage=60 [694828.103543] BTRFS info (device sdh1): relocating block group 2933242462208 flags data [694883.648385] BTRFS info (device sdh1): found 76 extents At that point, disk I/O according to iotop dropped to almost zero. After waiting a while, I attempted to cancel the balance, but that just resulted in a hung cancel process. Now, any process that attempts to write to or read from the filesystem hangs. I suppose that means there's a kernel deadlock. The output of dmesg after running echo w >/proc/sysrq-trigger is attached. kernel: 5.0.3-arch1-1-ARCH x86_64 btrfs-progs version: v4.20.2 The data that was being written to the filesystem is not important. - Jared
[731099.741046] sysrq: SysRq : Show Blocked State [731099.741051] task PC stack pid father [731099.741196] pool-Thunar D 0 11343 1 0x00000080 [731099.741201] Call Trace: [731099.741214] ? __schedule+0x30b/0x8b0 [731099.741223] ? preempt_count_add+0x79/0xb0 [731099.741227] schedule+0x32/0x80 [731099.741298] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.741305] ? wait_woken+0x80/0x80 [731099.741332] btrfs_search_slot+0x785/0x990 [btrfs] [731099.741340] ? filldir+0x170/0x170 [731099.741377] btrfs_real_readdir+0x187/0x4a0 [btrfs] [731099.741384] ? __fsnotify_parent+0x96/0x120 [731099.741390] iterate_dir+0x13c/0x190 [731099.741395] ksys_getdents64+0x9c/0x130 [731099.741398] ? filldir+0x170/0x170 [731099.741403] __x64_sys_getdents64+0x16/0x20 [731099.741410] do_syscall_64+0x5b/0x170 [731099.741414] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.741418] RIP: 0033:0x7fa78734a7cb [731099.741425] Code: Bad RIP value. [731099.741428] RSP: 002b:00007fa77effca38 EFLAGS: 00000246 ORIG_RAX: 00000000000000d9 [731099.741432] RAX: ffffffffffffffda RBX: 00007fa7740016d0 RCX: 00007fa78734a7cb [731099.741434] RDX: 0000000000008000 RSI: 00007fa7740016d0 RDI: 0000000000000015 [731099.741436] RBP: ffffffffffffff80 R08: 00007fa7740000f0 R09: 00007fa774072490 [731099.741438] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000002 [731099.741440] R13: 00007fa7740016a0 R14: 00007fff53711db0 R15: 00005602ae813cc0 [731099.741445] pool-Thunar D 0 11500 1 0x00000080 [731099.741448] Call Trace: [731099.741454] ? __schedule+0x30b/0x8b0 [731099.741458] schedule+0x32/0x80 [731099.741464] rwsem_down_read_failed_killable+0x1b5/0x220 [731099.741472] ? __lru_cache_add+0x75/0xa0 [731099.741479] call_rwsem_down_read_failed_killable+0x14/0x30 [731099.741484] down_read_killable+0x13/0x40 [731099.741488] iterate_dir+0x56/0x190 [731099.741493] ksys_getdents64+0x9c/0x130 [731099.741496] ? filldir+0x170/0x170 [731099.741501] __x64_sys_getdents64+0x16/0x20 [731099.741505] do_syscall_64+0x5b/0x170 [731099.741508] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.741511] RIP: 0033:0x7fa78734a7cb [731099.741515] Code: Bad RIP value. [731099.741517] RSP: 002b:00007fa76cbe0a38 EFLAGS: 00000246 ORIG_RAX: 00000000000000d9 [731099.741520] RAX: ffffffffffffffda RBX: 00007fa760001b30 RCX: 00007fa78734a7cb [731099.741522] RDX: 0000000000008000 RSI: 00007fa760001b30 RDI: 0000000000000017 [731099.741523] RBP: ffffffffffffff80 R08: 0000000000000000 R09: 00007fa760000000 [731099.741525] R10: fffffffffffff000 R11: 0000000000000246 R12: 0000000000000002 [731099.741527] R13: 00007fa760001b00 R14: 0000000000000000 R15: 00005602ae813cc0 [731099.741625] btrfs-transacti D 0 25163 2 0x80000080 [731099.741628] Call Trace: [731099.741633] ? __schedule+0x30b/0x8b0 [731099.741640] ? kmem_cache_free+0x1d3/0x200 [731099.741645] ? preempt_count_add+0x79/0xb0 [731099.741649] schedule+0x32/0x80 [731099.741688] btrfs_commit_transaction+0x701/0x8a0 [btrfs] [731099.741694] ? wait_woken+0x80/0x80 [731099.741730] transaction_kthread+0x13c/0x160 [btrfs] [731099.741766] ? btrfs_cleanup_transaction+0x570/0x570 [btrfs] [731099.741770] kthread+0x112/0x130 [731099.741774] ? kthread_park+0x80/0x80 [731099.741777] ret_from_fork+0x35/0x40 [731099.742250] crawl_5 D 0 22426 1 0x00000084 [731099.742253] Call Trace: [731099.742258] ? __schedule+0x30b/0x8b0 [731099.742263] ? preempt_count_add+0x79/0xb0 [731099.742267] schedule+0x32/0x80 [731099.742313] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.742319] ? wait_woken+0x80/0x80 [731099.742347] btrfs_search_forward+0x204/0x390 [btrfs] [731099.742394] search_ioctl+0xf0/0x1a0 [btrfs] [731099.742441] btrfs_ioctl_tree_search_v2.isra.14+0x7b/0xf0 [btrfs] [731099.742488] btrfs_ioctl+0x115f/0x2ce0 [btrfs] [731099.742494] ? _copy_to_user+0x26/0x30 [731099.742498] ? cp_new_stat+0x150/0x180 [731099.742504] ? do_vfs_ioctl+0xa4/0x630 [731099.742507] do_vfs_ioctl+0xa4/0x630 [731099.742511] ? __se_sys_newfstat+0x5f/0x70 [731099.742515] ksys_ioctl+0x60/0x90 [731099.742519] __x64_sys_ioctl+0x16/0x20 [731099.742524] do_syscall_64+0x5b/0x170 [731099.742527] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.742530] RIP: 0033:0x7f40157f82fb [731099.742535] Code: Bad RIP value. [731099.742537] RSP: 002b:00007f400fffb478 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.742540] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f40157f82fb [731099.742542] RDX: 00007f3edc026fc0 RSI: 00000000c0709411 RDI: 000000000000002e [731099.742543] RBP: 00007f400fffb7d0 R08: 0000000000000006 R09: 0000000000000005 [731099.742545] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000068 [731099.742547] R13: 000000000000002e R14: 00007f3edc026fc0 R15: 00007f400fffb848 [731099.742552] crawl_5 D 0 22427 1 0x00000084 [731099.742555] Call Trace: [731099.742559] ? __schedule+0x30b/0x8b0 [731099.742564] ? preempt_count_add+0x79/0xb0 [731099.742568] schedule+0x32/0x80 [731099.742612] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.742618] ? wait_woken+0x80/0x80 [731099.742660] find_parent_nodes+0x30e/0x1160 [btrfs] [731099.742708] btrfs_find_all_roots_safe+0xa8/0x120 [btrfs] [731099.742753] btrfs_find_all_roots+0x57/0x70 [btrfs] [731099.742795] btrfs_qgroup_trace_extent_post+0x37/0x70 [btrfs] [731099.742839] btrfs_add_delayed_data_ref+0x34a/0x380 [btrfs] [731099.742869] btrfs_inc_extent_ref+0x76/0xf0 [btrfs] [731099.742899] __btrfs_mod_ref+0x15a/0x240 [btrfs] [731099.742928] ? add_pinned_bytes+0x40/0x40 [btrfs] [731099.742956] update_ref_for_cow+0x234/0x300 [btrfs] [731099.742984] __btrfs_cow_block+0x240/0x500 [btrfs] [731099.743012] btrfs_cow_block+0xe9/0x1a0 [btrfs] [731099.743040] btrfs_search_slot+0x368/0x990 [btrfs] [731099.743076] btrfs_lookup_file_extent+0x4a/0x70 [btrfs] [731099.743118] __btrfs_drop_extents+0x156/0xcf0 [btrfs] [731099.743162] ? btrfs_drop_extents+0x2c/0x80 [btrfs] [731099.743205] btrfs_drop_extents+0x5a/0x80 [btrfs] [731099.743251] btrfs_clone+0x7fa/0xc30 [btrfs] [731099.743300] btrfs_extent_same_range+0x52/0xc0 [btrfs] [731099.743346] btrfs_remap_file_range+0x34a/0x390 [btrfs] [731099.743354] vfs_dedupe_file_range_one+0x135/0x150 [731099.743359] vfs_dedupe_file_range+0x17b/0x1f0 [731099.743363] do_vfs_ioctl+0x4bf/0x630 [731099.743368] ksys_ioctl+0x60/0x90 [731099.743373] __x64_sys_ioctl+0x16/0x20 [731099.743377] do_syscall_64+0x5b/0x170 [731099.743380] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.743383] RIP: 0033:0x7f40157f82fb [731099.743387] Code: Bad RIP value. [731099.743389] RSP: 002b:00007f400f7fb208 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.743392] RAX: ffffffffffffffda RBX: 00007f3ee00515e0 RCX: 00007f40157f82fb [731099.743394] RDX: 00007f3ee00515e0 RSI: 00000000c0189436 RDI: 000000000000001d [731099.743395] RBP: 00007f400f7fb500 R08: 0000000000000007 R09: 0000000000000006 [731099.743397] R10: 00000000186f056e R11: 0000000000000246 R12: 0000000000000038 [731099.743399] R13: 0000000000000018 R14: 00007f400f7fb508 R15: 00007f3ed80722f8 [731099.743404] crawl_5 D 0 22428 1 0x00000084 [731099.743406] Call Trace: [731099.743411] ? __schedule+0x30b/0x8b0 [731099.743416] ? preempt_count_add+0x79/0xb0 [731099.743421] schedule+0x32/0x80 [731099.743464] btrfs_tree_lock+0x173/0x1f0 [btrfs] [731099.743470] ? wait_woken+0x80/0x80 [731099.743496] btrfs_lock_root_node+0x2f/0x40 [btrfs] [731099.743522] btrfs_search_slot+0x5eb/0x990 [btrfs] [731099.743560] btrfs_lookup_file_extent+0x4a/0x70 [btrfs] [731099.743666] __btrfs_drop_extents+0x156/0xcf0 [btrfs] [731099.743682] ? wake_up_q+0x54/0x70 [731099.743688] ? __mutex_unlock_slowpath.isra.8+0xbc/0x120 [731099.743727] btrfs_drop_extents+0x5a/0x80 [btrfs] [731099.743767] btrfs_clone+0x7fa/0xc30 [btrfs] [731099.743810] btrfs_extent_same_range+0x52/0xc0 [btrfs] [731099.743849] btrfs_remap_file_range+0x34a/0x390 [btrfs] [731099.743856] vfs_dedupe_file_range_one+0x135/0x150 [731099.743861] vfs_dedupe_file_range+0x17b/0x1f0 [731099.743868] do_vfs_ioctl+0x4bf/0x630 [731099.743873] ksys_ioctl+0x60/0x90 [731099.743877] __x64_sys_ioctl+0x16/0x20 [731099.743881] do_syscall_64+0x5b/0x170 [731099.743885] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.743888] RIP: 0033:0x7f40157f82fb [731099.743893] Code: Bad RIP value. [731099.743895] RSP: 002b:00007f400effa768 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.743897] RAX: ffffffffffffffda RBX: 00007f3ed816ae70 RCX: 00007f40157f82fb [731099.743899] RDX: 00007f3ed816ae70 RSI: 00000000c0189436 RDI: 0000000000000084 [731099.743901] RBP: 00007f400effaa60 R08: 0000000000000007 R09: 0000000000000006 [731099.743903] R10: 00000000186f056c R11: 0000000000000246 R12: 0000000000000038 [731099.743905] R13: 0000000000000018 R14: 00007f400effaa68 R15: 00007f3ed8020e78 [731099.743910] crawl_5 D 0 22429 1 0x00000084 [731099.743913] Call Trace: [731099.743918] ? __schedule+0x30b/0x8b0 [731099.743923] ? preempt_count_add+0x79/0xb0 [731099.743927] schedule+0x32/0x80 [731099.743966] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.743972] ? wait_woken+0x80/0x80 [731099.743996] btrfs_search_forward+0x204/0x390 [btrfs] [731099.744038] search_ioctl+0xf0/0x1a0 [btrfs] [731099.744079] btrfs_ioctl_tree_search_v2.isra.14+0x7b/0xf0 [btrfs] [731099.744119] btrfs_ioctl+0x115f/0x2ce0 [btrfs] [731099.744127] ? _copy_to_user+0x26/0x30 [731099.744130] ? cp_new_stat+0x150/0x180 [731099.744136] ? do_vfs_ioctl+0xa4/0x630 [731099.744139] do_vfs_ioctl+0xa4/0x630 [731099.744143] ? __se_sys_newfstat+0x5f/0x70 [731099.744147] ksys_ioctl+0x60/0x90 [731099.744151] __x64_sys_ioctl+0x16/0x20 [731099.744155] do_syscall_64+0x5b/0x170 [731099.744159] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.744161] RIP: 0033:0x7f40157f82fb [731099.744165] Code: Bad RIP value. [731099.744167] RSP: 002b:00007f400e7f9c18 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.744170] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f40157f82fb [731099.744171] RDX: 00007f3ed01909e0 RSI: 00000000c0709411 RDI: 0000000000000003 [731099.744173] RBP: 00007f400e7f9f70 R08: 0000000000000007 R09: 0000000000000006 [731099.744175] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000068 [731099.744177] R13: 0000000000000003 R14: 00007f3ed01909e0 R15: 00007f400e7f9fe8 [731099.744181] crawl_5 D 0 22430 1 0x00000084 [731099.744184] Call Trace: [731099.744189] ? __schedule+0x30b/0x8b0 [731099.744193] ? preempt_count_add+0x79/0xb0 [731099.744197] schedule+0x32/0x80 [731099.744236] btrfs_tree_lock+0xd1/0x1f0 [btrfs] [731099.744241] ? wait_woken+0x80/0x80 [731099.744264] btrfs_lock_root_node+0x2f/0x40 [btrfs] [731099.744289] btrfs_search_slot+0x5eb/0x990 [btrfs] [731099.744320] btrfs_lookup_file_extent+0x4a/0x70 [btrfs] [731099.744356] __btrfs_drop_extents+0x156/0xcf0 [btrfs] [731099.744363] ? wake_up_q+0x54/0x70 [731099.744367] ? __mutex_unlock_slowpath.isra.8+0xbc/0x120 [731099.744406] btrfs_drop_extents+0x5a/0x80 [btrfs] [731099.744445] btrfs_clone+0x7fa/0xc30 [btrfs] [731099.744487] btrfs_extent_same_range+0x52/0xc0 [btrfs] [731099.744526] btrfs_remap_file_range+0x34a/0x390 [btrfs] [731099.744535] vfs_dedupe_file_range_one+0x135/0x150 [731099.744539] vfs_dedupe_file_range+0x17b/0x1f0 [731099.744543] do_vfs_ioctl+0x4bf/0x630 [731099.744548] ksys_ioctl+0x60/0x90 [731099.744552] __x64_sys_ioctl+0x16/0x20 [731099.744556] do_syscall_64+0x5b/0x170 [731099.744559] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.744562] RIP: 0033:0x7f40157f82fb [731099.744566] Code: Bad RIP value. [731099.744567] RSP: 002b:00007f400dff8768 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.744570] RAX: ffffffffffffffda RBX: 00007f3ee8206b00 RCX: 00007f40157f82fb [731099.744572] RDX: 00007f3ee8206b00 RSI: 00000000c0189436 RDI: 00000000000000ba [731099.744574] RBP: 00007f400dff8a60 R08: 0000000000000007 R09: 0000000000000006 [731099.744575] R10: 00000000186f056c R11: 0000000000000246 R12: 0000000000000038 [731099.744577] R13: 0000000000000018 R14: 00007f400dff8a68 R15: 00007f3ee0169d98 [731099.744582] crawl_5 D 0 22431 1 0x00000084 [731099.744584] Call Trace: [731099.744589] ? __schedule+0x30b/0x8b0 [731099.744594] ? preempt_count_add+0x79/0xb0 [731099.744598] schedule+0x32/0x80 [731099.744636] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.744644] ? wait_woken+0x80/0x80 [731099.744681] find_parent_nodes+0x30e/0x1160 [btrfs] [731099.744721] btrfs_find_all_roots_safe+0xa8/0x120 [btrfs] [731099.744759] btrfs_find_all_roots+0x57/0x70 [btrfs] [731099.744796] btrfs_qgroup_trace_extent_post+0x37/0x70 [btrfs] [731099.744832] btrfs_add_delayed_data_ref+0x34a/0x380 [btrfs] [731099.744862] btrfs_inc_extent_ref+0x76/0xf0 [btrfs] [731099.744889] __btrfs_mod_ref+0x15a/0x240 [btrfs] [731099.744915] ? add_pinned_bytes+0x40/0x40 [btrfs] [731099.744939] update_ref_for_cow+0x234/0x300 [btrfs] [731099.744964] __btrfs_cow_block+0x240/0x500 [btrfs] [731099.744992] btrfs_cow_block+0xe9/0x1a0 [btrfs] [731099.745017] btrfs_search_slot+0x368/0x990 [btrfs] [731099.745043] btrfs_insert_empty_items+0x67/0xc0 [btrfs] [731099.745075] btrfs_insert_file_extent+0xa1/0x210 [btrfs] [731099.745114] btrfs_cont_expand+0x3dc/0x520 [btrfs] [731099.745153] btrfs_setattr+0xe4/0x5d0 [btrfs] [731099.745162] notify_change+0x266/0x440 [731099.745167] do_truncate+0x74/0xc0 [731099.745172] do_sys_ftruncate+0xfe/0x110 [731099.745177] do_syscall_64+0x5b/0x170 [731099.745181] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.745184] RIP: 0033:0x7f40157faa9b [731099.745188] Code: Bad RIP value. [731099.745190] RSP: 002b:00007f400d7f7cb8 EFLAGS: 00000202 ORIG_RAX: 000000000000004d [731099.745193] RAX: ffffffffffffffda RBX: 00007f400d7f7db0 RCX: 00007f40157faa9b [731099.745197] RDX: 0000000000000000 RSI: 0000000008e24000 RDI: 0000000000000030 [731099.745199] RBP: 00007f3ee40bc0c0 R08: 00007fff091740a0 R09: 00007fff09174080 [731099.745200] R10: 00000000186f00ce R11: 0000000000000202 R12: 00007f400d7f7d30 [731099.745202] R13: 00007f400d7f7d00 R14: 00007f400d7f7d60 R15: 00007f400d7f7cd8 [731099.745207] crawl_5 D 0 22432 1 0x00000084 [731099.745210] Call Trace: [731099.745215] ? __schedule+0x30b/0x8b0 [731099.745219] ? preempt_count_add+0x79/0xb0 [731099.745225] schedule+0x32/0x80 [731099.745263] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.745273] ? wait_woken+0x80/0x80 [731099.745297] btrfs_search_forward+0x204/0x390 [btrfs] [731099.745339] search_ioctl+0xf0/0x1a0 [btrfs] [731099.745381] btrfs_ioctl_tree_search_v2.isra.14+0x7b/0xf0 [btrfs] [731099.745431] btrfs_ioctl+0x115f/0x2ce0 [btrfs] [731099.745437] ? _copy_to_user+0x26/0x30 [731099.745441] ? cp_new_stat+0x150/0x180 [731099.745446] ? do_vfs_ioctl+0xa4/0x630 [731099.745449] do_vfs_ioctl+0xa4/0x630 [731099.745455] ? __se_sys_newfstat+0x5f/0x70 [731099.745459] ksys_ioctl+0x60/0x90 [731099.745463] __x64_sys_ioctl+0x16/0x20 [731099.745467] do_syscall_64+0x5b/0x170 [731099.745472] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.745475] RIP: 0033:0x7f40157f82fb [731099.745479] Code: Bad RIP value. [731099.745480] RSP: 002b:00007f400cff5478 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.745483] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f40157f82fb [731099.745485] RDX: 00007f3ef41cae70 RSI: 00000000c0709411 RDI: 00000000000000a8 [731099.745488] RBP: 00007f400cff57d0 R08: 0000000000000005 R09: 0000000000000004 [731099.745490] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000068 [731099.745495] R13: 00000000000000a8 R14: 00007f3ef41cae70 R15: 00007f400cff5848 [731099.745499] crawl_5 D 0 22433 1 0x00000084 [731099.745501] Call Trace: [731099.745506] ? __schedule+0x30b/0x8b0 [731099.745511] ? preempt_count_add+0x79/0xb0 [731099.745515] schedule+0x32/0x80 [731099.745554] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.745560] ? wait_woken+0x80/0x80 [731099.745585] btrfs_search_forward+0x204/0x390 [btrfs] [731099.745633] search_ioctl+0xf0/0x1a0 [btrfs] [731099.745683] btrfs_ioctl_tree_search_v2.isra.14+0x7b/0xf0 [btrfs] [731099.745730] btrfs_ioctl+0x115f/0x2ce0 [btrfs] [731099.745737] ? _copy_to_user+0x26/0x30 [731099.745740] ? cp_new_stat+0x150/0x180 [731099.745748] ? do_vfs_ioctl+0xa4/0x630 [731099.745751] do_vfs_ioctl+0xa4/0x630 [731099.745755] ? __se_sys_newfstat+0x5f/0x70 [731099.745760] ksys_ioctl+0x60/0x90 [731099.745764] __x64_sys_ioctl+0x16/0x20 [731099.745769] do_syscall_64+0x5b/0x170 [731099.745772] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.745776] RIP: 0033:0x7f40157f82fb [731099.745780] Code: Bad RIP value. [731099.745782] RSP: 002b:00007f4007ffb478 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.745784] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f40157f82fb [731099.745788] RDX: 00007f3eec4b97e0 RSI: 00000000c0709411 RDI: 00000000000000b2 [731099.745789] RBP: 00007f4007ffb7d0 R08: 0000000000000007 R09: 0000000000000006 [731099.745791] R10: 0000000000000001 R11: 0000000000000246 R12: 0000000000000068 [731099.745793] R13: 00000000000000b2 R14: 00007f3eec4b97e0 R15: 00007f4007ffb848 [731099.745799] hash_prefetch D 0 22436 1 0x00000084 [731099.745801] Call Trace: [731099.745806] ? __schedule+0x30b/0x8b0 [731099.745809] ? path_parentat.isra.12+0x3a/0x80 [731099.745815] schedule+0x32/0x80 [731099.745819] rwsem_down_write_failed+0x15d/0x240 [731099.745826] call_rwsem_down_write_failed+0x13/0x20 [731099.745834] down_write+0x20/0x30 [731099.745839] do_unlinkat+0x13d/0x320 [731099.745844] do_syscall_64+0x5b/0x170 [731099.745847] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.745851] RIP: 0033:0x7f40157f3a7b [731099.745855] Code: Bad RIP value. [731099.745857] RSP: 002b:00007f3f067faf88 EFLAGS: 00000246 ORIG_RAX: 0000000000000107 [731099.745860] RAX: ffffffffffffffda RBX: 00007f3f067fafd0 RCX: 00007f40157f3a7b [731099.745862] RDX: 0000000000000000 RSI: 00007f3efc009fb0 RDI: 0000000000000004 [731099.745865] RBP: 000055c19db43d58 R08: 0000000000000000 R09: 00007f3f067fb080 [731099.745867] R10: 000055c19be6c6a0 R11: 0000000000000246 R12: 00007f3f067fb0e0 [731099.745869] R13: 00007f3f067fb460 R14: 00007f3f067fb2a0 R15: 00007f3f067fb090 [731099.745873] crawl_writeback D 0 22437 1 0x00000084 [731099.745878] Call Trace: [731099.745882] ? __schedule+0x30b/0x8b0 [731099.745887] ? preempt_count_add+0x79/0xb0 [731099.745893] schedule+0x32/0x80 [731099.745926] wait_current_trans+0xb6/0xe0 [btrfs] [731099.745933] ? wait_woken+0x80/0x80 [731099.745970] start_transaction+0x3d8/0x480 [btrfs] [731099.746013] btrfs_create+0x58/0x1f0 [btrfs] [731099.746019] path_openat+0xb75/0x14e0 [731099.746027] do_filp_open+0x93/0x100 [731099.746032] ? __d_rehash+0x5d/0xa0 [731099.746037] ? __check_object_size+0xc1/0x175 [731099.746042] ? _raw_spin_unlock+0x16/0x30 [731099.746047] do_sys_open+0x186/0x220 [731099.746053] do_syscall_64+0x5b/0x170 [731099.746057] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.746060] RIP: 0033:0x7f40157f1df4 [731099.746064] Code: Bad RIP value. [731099.746065] RSP: 002b:00007f3f05ff9cf0 EFLAGS: 00000293 ORIG_RAX: 0000000000000101 [731099.746068] RAX: ffffffffffffffda RBX: 00000000000e09c1 RCX: 00007f40157f1df4 [731099.746070] RDX: 00000000000e09c1 RSI: 00007f3ef0000f70 RDI: 0000000000000004 [731099.746073] RBP: 0000000000000180 R08: 0000000000000000 R09: 00007f3f05ffa0c0 [731099.746075] R10: 0000000000000180 R11: 0000000000000293 R12: 00007f3f05ff9fc0 [731099.746077] R13: 0000000000000004 R14: 00007f3f05ffa580 R15: 00007f3f05ffa080 [731099.746476] photorec D 0 29652 29646 0x00000084 [731099.746479] Call Trace: [731099.746485] ? __schedule+0x30b/0x8b0 [731099.746490] ? preempt_count_add+0x79/0xb0 [731099.746495] schedule+0x32/0x80 [731099.746538] btrfs_tree_read_lock+0x7d/0x110 [btrfs] [731099.746545] ? wait_woken+0x80/0x80 [731099.746571] btrfs_search_slot+0x785/0x990 [btrfs] [731099.746604] btrfs_lookup_file_extent+0x4a/0x70 [btrfs] [731099.746640] btrfs_get_extent+0x15f/0x8e0 [btrfs] [731099.746684] btrfs_dirty_pages+0x1a9/0x2b0 [btrfs] [731099.746723] btrfs_buffered_write.isra.4+0x5aa/0x770 [btrfs] [731099.746764] btrfs_file_write_iter+0x3e2/0x610 [btrfs] [731099.746773] ? _raw_spin_unlock+0x16/0x30 [731099.746778] ? __handle_mm_fault+0x1182/0x1610 [731099.746785] __vfs_write+0x14d/0x1b0 [731099.746791] vfs_write+0xa9/0x1a0 [731099.746797] ksys_write+0x4f/0xb0 [731099.746802] do_syscall_64+0x5b/0x170 [731099.746805] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.746809] RIP: 0033:0x7fe375d63f38 [731099.746813] Code: Bad RIP value. [731099.746815] RSP: 002b:00007ffe188982c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [731099.746819] RAX: ffffffffffffffda RBX: 0000000000000f42 RCX: 00007fe375d63f38 [731099.746821] RDX: 0000000000000f42 RSI: 000055b93212c500 RDI: 000000000000000c [731099.746823] RBP: 000055b93212c500 R08: 0000000000000000 R09: 000055b932144000 [731099.746825] R10: 00007ffe18898390 R11: 0000000000000246 R12: 000055b9321d5020 [731099.746827] R13: 0000000000000f42 R14: 00007fe375e3c280 R15: 00007fe375e3b740 [731099.746845] btrfs D 0 20842 20841 0x00000084 [731099.746848] Call Trace: [731099.746853] ? __schedule+0x30b/0x8b0 [731099.746859] ? preempt_count_add+0x79/0xb0 [731099.746863] schedule+0x32/0x80 [731099.746900] wait_current_trans+0xb6/0xe0 [btrfs] [731099.746923] ? wait_woken+0x80/0x80 [731099.746974] start_transaction+0x3d8/0x480 [btrfs] [731099.746984] ? _raw_spin_unlock+0x16/0x30 [731099.747016] ? btrfs_block_rsv_refill+0x7b/0x80 [btrfs] [731099.747056] relocate_block_group+0x21e/0x570 [btrfs] [731099.747089] btrfs_relocate_block_group+0x18b/0x210 [btrfs] [731099.747106] btrfs_relocate_chunk+0x31/0xa0 [btrfs] [731099.747126] btrfs_balance+0x7b3/0xf00 [btrfs] [731099.747131] ? mem_cgroup_event_ratelimit.isra.11+0x36/0xa0 [731099.747148] btrfs_ioctl_balance+0x36a/0x380 [btrfs] [731099.747150] ? mem_cgroup_commit_charge+0x7a/0x4d0 [731099.747167] btrfs_ioctl+0x1559/0x2ce0 [btrfs] [731099.747172] ? __lru_cache_add+0x75/0xa0 [731099.747174] ? _raw_spin_unlock+0x16/0x30 [731099.747175] ? __handle_mm_fault+0x96b/0x1610 [731099.747179] ? do_vfs_ioctl+0xa4/0x630 [731099.747180] do_vfs_ioctl+0xa4/0x630 [731099.747181] ? handle_mm_fault+0x10a/0x250 [731099.747184] ? syscall_trace_enter+0x1d3/0x2d0 [731099.747186] ksys_ioctl+0x60/0x90 [731099.747188] __x64_sys_ioctl+0x16/0x20 [731099.747189] do_syscall_64+0x5b/0x170 [731099.747191] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.747192] RIP: 0033:0x7fb328e3d2fb [731099.747195] Code: Bad RIP value. [731099.747196] RSP: 002b:00007ffe5ecd1ae8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.747197] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb328e3d2fb [731099.747198] RDX: 00007ffe5ecd1b80 RSI: 00000000c4009420 RDI: 0000000000000003 [731099.747199] RBP: 0000000000000003 R08: 0000000000000078 R09: 000055b5777d0010 [731099.747199] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffe5ecd2520 [731099.747200] R13: 0000000000000001 R14: 00007ffe5ecd1b80 R15: 00007ffe5ecd3770 [731099.747204] kworker/u24:11 D 0 21096 2 0x80000080 [731099.747209] Workqueue: writeback wb_workfn (flush-btrfs-6) [731099.747211] Call Trace: [731099.747213] ? __schedule+0x30b/0x8b0 [731099.747215] schedule+0x32/0x80 [731099.747230] btrfs_tree_lock+0x113/0x1f0 [btrfs] [731099.747234] ? wait_woken+0x80/0x80 [731099.747249] lock_extent_buffer_for_io+0x1b0/0x1d0 [btrfs] [731099.747266] btree_write_cache_pages+0x1ee/0x350 [btrfs] [731099.747271] do_writepages+0x41/0xd0 [731099.747286] ? btrfs_get_token_32+0x6b/0x130 [btrfs] [731099.747289] ? preempt_count_add+0x79/0xb0 [731099.747291] __writeback_single_inode+0x3d/0x3c0 [731099.747293] ? _raw_spin_lock+0x13/0x30 [731099.747295] writeback_sb_inodes+0x1e8/0x4c0 [731099.747299] __writeback_inodes_wb+0x5d/0xb0 [731099.747301] wb_writeback+0x28f/0x340 [731099.747303] ? cpumask_next+0x16/0x20 [731099.747306] wb_workfn+0x172/0x430 [731099.747309] process_one_work+0x1eb/0x410 [731099.747312] worker_thread+0x2d/0x3d0 [731099.747317] ? process_one_work+0x410/0x410 [731099.747318] kthread+0x112/0x130 [731099.747320] ? kthread_park+0x80/0x80 [731099.747322] ret_from_fork+0x35/0x40 [731099.747324] btrfs D 0 23894 23887 0x00000084 [731099.747326] Call Trace: [731099.747329] ? __schedule+0x30b/0x8b0 [731099.747331] ? mem_cgroup_event_ratelimit.isra.11+0x36/0xa0 [731099.747333] ? preempt_count_add+0x79/0xb0 [731099.747335] schedule+0x32/0x80 [731099.747351] btrfs_cancel_balance+0xed/0x160 [btrfs] [731099.747354] ? wait_woken+0x80/0x80 [731099.747368] btrfs_ioctl+0x2af/0x2ce0 [btrfs] [731099.747371] ? __lru_cache_add+0x75/0xa0 [731099.747373] ? _raw_spin_unlock+0x16/0x30 [731099.747375] ? __handle_mm_fault+0x96b/0x1610 [731099.747380] ? do_vfs_ioctl+0xa4/0x630 [731099.747381] do_vfs_ioctl+0xa4/0x630 [731099.747383] ? handle_mm_fault+0x10a/0x250 [731099.747385] ? syscall_trace_enter+0x1d3/0x2d0 [731099.747386] ksys_ioctl+0x60/0x90 [731099.747389] __x64_sys_ioctl+0x16/0x20 [731099.747390] do_syscall_64+0x5b/0x170 [731099.747391] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.747392] RIP: 0033:0x7f0a0ce6d2fb [731099.747394] Code: Bad RIP value. [731099.747395] RSP: 002b:00007fff462515c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 [731099.747397] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0a0ce6d2fb [731099.747398] RDX: 0000000000000002 RSI: 0000000040049421 RDI: 0000000000000003 [731099.747399] RBP: 0000000000000003 R08: 0000000000000078 R09: 00005574a0cc5010 [731099.747400] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fff4625377d [731099.747400] R13: 0000000000000000 R14: 000055749f18404b R15: 0000000000000001 [731099.747403] sync D 0 24853 1 0x00000084 [731099.747404] Call Trace: [731099.747407] ? __schedule+0x30b/0x8b0 [731099.747409] ? preempt_count_add+0x79/0xb0 [731099.747410] ? default_file_splice_write+0x20/0x20 [731099.747412] schedule+0x32/0x80 [731099.747414] wb_wait_for_completion+0x59/0x90 [731099.747416] ? wait_woken+0x80/0x80 [731099.747418] sync_inodes_sb+0xd8/0x290 [731099.747420] ? default_file_splice_write+0x20/0x20 [731099.747422] iterate_supers+0x95/0xe0 [731099.747423] ksys_sync+0x40/0xb0 [731099.747426] __ia32_sys_sync+0xa/0x10 [731099.747427] do_syscall_64+0x5b/0x170 [731099.747431] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.747432] RIP: 0033:0x7f12b3aa818b [731099.747434] Code: Bad RIP value. [731099.747434] RSP: 002b:00007ffe23ad0668 EFLAGS: 00000246 ORIG_RAX: 00000000000000a2 [731099.747436] RAX: ffffffffffffffda RBX: 00007ffe23ad0798 RCX: 00007f12b3aa818b [731099.747436] RDX: 00007f12b3b7f001 RSI: 0000000000000000 RDI: 00007f12b3b44486 [731099.747437] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000000 [731099.747438] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 [731099.747438] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000 [731099.747443] sync D 0 26803 1 0x00000084 [731099.747444] Call Trace: [731099.747446] ? __schedule+0x30b/0x8b0 [731099.747448] ? preempt_count_add+0x79/0xb0 [731099.747450] schedule+0x32/0x80 [731099.747452] wb_wait_for_completion+0x59/0x90 [731099.747454] ? wait_woken+0x80/0x80 [731099.747456] __writeback_inodes_sb_nr+0xaa/0xd0 [731099.747458] sync_filesystem+0x26/0x90 [731099.747460] __se_sys_syncfs+0x38/0x70 [731099.747462] do_syscall_64+0x5b/0x170 [731099.747463] entry_SYSCALL_64_after_hwframe+0x44/0xa9 [731099.747465] RIP: 0033:0x7fb89d6d724b [731099.747468] Code: Bad RIP value. [731099.747469] RSP: 002b:00007ffd96104b98 EFLAGS: 00000246 ORIG_RAX: 0000000000000132 [731099.747470] RAX: ffffffffffffffda RBX: 00007ffd96104cc8 RCX: 00007fb89d6d724b [731099.747472] RDX: 0000000000008000 RSI: 0000000000000004 RDI: 0000000000000003 [731099.747472] RBP: 0000000000000003 R08: 0000000000000000 R09: 0000000000000000 [731099.747473] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000003 [731099.747474] R13: 00007ffd96106bf4 R14: 0000000000000001 R15: 0000000000000000
