Hello,
I have seen this problem multiple times now in my log (every few days).
A btrfs scrub /drive ran without error.
[So Jan 5 13:49:21 2020] INFO: task dockerd:4076 blocked for more than
120 seconds.
[So Jan 5 13:49:21 2020] Tainted: G OE 5.2.8 #1
[So Jan 5 13:49:21 2020] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
[So Jan 5 13:49:21 2020] dockerd D 0 4076 1 0x00004000
[So Jan 5 13:49:21 2020] Call Trace:
[So Jan 5 13:49:21 2020] ? __schedule+0x3e9/0x690
[So Jan 5 13:49:21 2020] schedule+0x33/0x90
[So Jan 5 13:49:21 2020] wait_for_commit+0x41/0x80 [btrfs]
[So Jan 5 13:49:21 2020] ? remove_wait_queue+0x60/0x60
[So Jan 5 13:49:21 2020] btrfs_commit_transaction+0x1ab/0x9d0 [btrfs]
[So Jan 5 13:49:21 2020] ? block_rsv_release_bytes+0x9a/0x150 [btrfs]
[So Jan 5 13:49:21 2020] create_subvol+0x3bf/0x820 [btrfs]
[So Jan 5 13:49:21 2020] ? btrfs_mksubvol+0x30e/0x610 [btrfs]
[So Jan 5 13:49:21 2020] btrfs_mksubvol+0x30e/0x610 [btrfs]
[So Jan 5 13:49:21 2020] ? kmem_cache_alloc_trace+0x148/0x1c0
[So Jan 5 13:49:21 2020] ?
insert_reserved_file_extent.constprop.69+0x2f0/0x2f0 [btrfs]
[So Jan 5 13:49:21 2020] ? _cond_resched+0x16/0x40
[So Jan 5 13:49:21 2020] btrfs_ioctl_snap_create_transid+0x117/0x1a0
[btrfs]
[So Jan 5 13:49:21 2020] ? _copy_from_user+0x31/0x60
[So Jan 5 13:49:21 2020] btrfs_ioctl_snap_create+0x66/0x80 [btrfs]
[So Jan 5 13:49:21 2020] btrfs_ioctl+0x6b5/0x2ac0 [btrfs]
[So Jan 5 13:49:21 2020] ? do_vfs_ioctl+0xa2/0x640
[So Jan 5 13:49:21 2020] ?
btrfs_ioctl_get_supported_features+0x30/0x30 [btrfs]
[So Jan 5 13:49:21 2020] do_vfs_ioctl+0xa2/0x640
[So Jan 5 13:49:21 2020] ? __do_sys_newfstat+0x3c/0x60
[So Jan 5 13:49:21 2020] ksys_ioctl+0x70/0x80
[So Jan 5 13:49:21 2020] __x64_sys_ioctl+0x16/0x20
[So Jan 5 13:49:21 2020] do_syscall_64+0x55/0x110
[So Jan 5 13:49:21 2020] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[So Jan 5 13:49:21 2020] RIP: 0033:0x55a9b81cd5a0
[So Jan 5 13:49:21 2020] Code: 8b 7c 24 10 48 8b 74 24 18 48 8b 54 24
20 49 c7 c2 00 00 00 00 49 c7 c0 00 00 00 00 49 c7 c1 00 00 00 00 48 8b
44 24 08 0f 05 <48> 3d 01 f0 ff ff 76 20 48 c7 44 24 28 ff ff ff ff 48
c7 44 24 30
[So Jan 5 13:49:21 2020] RSP: 002b:000000c4214c6720 EFLAGS: 00000206
ORIG_RAX: 0000000000000010
[So Jan 5 13:49:21 2020] RAX: ffffffffffffffda RBX: 0000000000000000
RCX: 000055a9b81cd5a0
[So Jan 5 13:49:21 2020] RDX: 000000c4214c6760 RSI: 000000005000940e
RDI: 0000000000000076
[So Jan 5 13:49:21 2020] RBP: 000000c4214c7790 R08: 0000000000000000
R09: 0000000000000000
[So Jan 5 13:49:21 2020] R10: 0000000000000000 R11: 0000000000000206
R12: ffffffffffffffff
[So Jan 5 13:49:21 2020] R13: 0000000000000038 R14: 0000000000000037
R15: 00000000000000aa
[So Jan 5 13:51:22 2020] INFO: task dockerd:2900 blocked for more than
120 seconds.
[So Jan 5 13:51:22 2020] Tainted: G OE 5.2.8 #1
[So Jan 5 13:51:22 2020] "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
What could be the reason for this and how can I prevent/fix it?
About my system:
root@homeserver:~# uname -a
Linux homeserver 5.2.8 #1 SMP Thu Aug 15 21:22:00 CEST 2019 x86_64
GNU/Linux
root@homeserver:~# btrfs --version
btrfs-progs v4.20.2
root@homeserver:~# btrfs fi show
Label: 'DockerImages' uuid: 303256f2-6901-4564-892e-cdca9dda50e3
Total devices 1 FS bytes used 12.47GiB
devid 1 size 52.16GiB used 29.05GiB path /dev/sdf3
Label: 'DataPool1' uuid: c4a6a2c9-5cf0-49b8-812a-0784953f9ba3
Total devices 2 FS bytes used 7.22TiB
devid 1 size 7.28TiB used 7.27TiB path /dev/sdg1
devid 2 size 7.28TiB used 7.27TiB path /dev/sdc1
btrfs fi df /srv/dev-disk-by-label-DockerImages/
Data, single: total=25.01GiB, used=11.80GiB
System, single: total=32.00MiB, used=16.00KiB
Metadata, single: total=4.01GiB, used=842.02MiB
GlobalReserve, single: total=85.78MiB, used=0.00B
Yes, there are two btrfs filesystems. I am rather sure it is the
DockerImages one, as I see no reason why the other would make docker
hang.
Regards,
Hendrik