On Sun, Dec 20, 2015 at 6:43 PM, Qu Wenruo <quwenruo@xxxxxxxxxxxxxx> wrote: > > > Chris Murphy wrote on 2015/12/20 15:31 -0700: >> I think the cause is related to bus power with buggy USB 3 LPM >> firmware (these enclosures are cheap maybe $6). I've found some >> threads about this being a problem, but it's not expected to cause any >> corruptions. So, the fact Btrfs picks up one some problems might prove >> that (somewhat) incorrect. > > > Seems possible. Maybe some metadata just failed to reach disk. > BTW, did I asked for a btrfs-show-super output? Nope. I will attach to this email below for both devices. > If that's the case, superblock on device 2 maybe older than superblock on > device 1. Yes, looks iike devid 1 transid 4924, and devid 2 transid 4923. And it's devid 2 that had device reset and write errors when it vanished and reappeared as a different block device. -- Chris Murphy
[liveuser@localhost ~]$ sudo btrfs-show-super -af /dev/sdc superblock: bytenr=65536, device=/dev/sdc --------------------------------------------------------- csum 0x93333bd8 [match] bytenr 65536 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4924 root 714189258752 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4924 uuid_tree_generation 4924 dev_item.uuid 94c62352-2568-4abe-8a58-828d1766719c dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 1 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 714189258752 gen: 4924 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714189324288 gen: 4924 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714189422592 gen: 4924 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 superblock: bytenr=67108864, device=/dev/sdc --------------------------------------------------------- csum 0x33521316 [match] bytenr 67108864 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4924 root 714189258752 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4924 uuid_tree_generation 4924 dev_item.uuid 94c62352-2568-4abe-8a58-828d1766719c dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 1 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 714189258752 gen: 4924 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714189324288 gen: 4924 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714189422592 gen: 4924 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 superblock: bytenr=274877906944, device=/dev/sdc --------------------------------------------------------- csum 0xced54527 [match] bytenr 274877906944 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4924 root 714189258752 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4924 uuid_tree_generation 4924 dev_item.uuid 94c62352-2568-4abe-8a58-828d1766719c dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 1 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 714189258752 gen: 4924 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714189324288 gen: 4924 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714189422592 gen: 4924 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2
[chris@f23m ~]$ sudo btrfs-show-super -af /dev/sdb superblock: bytenr=65536, device=/dev/sdb --------------------------------------------------------- csum 0x3364e6b8 [match] bytenr 65536 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4923 root 714188554240 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4923 uuid_tree_generation 4923 dev_item.uuid f98143e4-24a2-4a2a-8dbf-2871c75f7b78 dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 2 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 809898442752 gen: 4920 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 809898459136 gen: 4920 level: 2 backup_fs_root: 810253713408 gen: 4805 level: 0 backup_dev_root: 809896886272 gen: 4918 level: 1 backup_csum_root: 809898557440 gen: 4920 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 superblock: bytenr=67108864, device=/dev/sdb --------------------------------------------------------- csum 0x9305ce76 [match] bytenr 67108864 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4923 root 714188554240 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4923 uuid_tree_generation 4923 dev_item.uuid f98143e4-24a2-4a2a-8dbf-2871c75f7b78 dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 2 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 809898442752 gen: 4920 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 809898459136 gen: 4920 level: 2 backup_fs_root: 810253713408 gen: 4805 level: 0 backup_dev_root: 809896886272 gen: 4918 level: 1 backup_csum_root: 809898557440 gen: 4920 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 superblock: bytenr=274877906944, device=/dev/sdb --------------------------------------------------------- csum 0x6e829847 [match] bytenr 274877906944 flags 0x1 ( WRITTEN ) magic _BHRfS_M [match] fsid 197606b2-9f4a-4742-8824-7fc93285c29c label verb generation 4923 root 714188554240 sys_array_size 129 chunk_root_generation 4918 root_level 1 chunk_root 715141414912 chunk_root_level 1 log_root 0 log_root_transid 0 log_root_level 0 total_bytes 1500312748032 bytes_used 537228206080 sectorsize 4096 nodesize 16384 leafsize 16384 stripesize 4096 root_dir 6 num_devices 2 compat_flags 0x0 compat_ro_flags 0x0 incompat_flags 0x161 ( MIXED_BACKREF | BIG_METADATA | EXTENDED_IREF | SKINNY_METADATA ) csum_type 0 csum_size 4 cache_generation 4923 uuid_tree_generation 4923 dev_item.uuid f98143e4-24a2-4a2a-8dbf-2871c75f7b78 dev_item.fsid 197606b2-9f4a-4742-8824-7fc93285c29c [match] dev_item.type 0 dev_item.total_bytes 750156374016 dev_item.bytes_used 541199433728 dev_item.io_align 4096 dev_item.io_width 4096 dev_item.sector_size 4096 dev_item.devid 2 dev_item.dev_group 0 dev_item.seek_speed 0 dev_item.bandwidth 0 dev_item.generation 0 sys_chunk_array[2048]: item 0 key (FIRST_CHUNK_TREE CHUNK_ITEM 715141414912) chunk length 33554432 owner 2 stripe_len 65536 type SYSTEM|RAID1 num_stripes 2 stripe 0 devid 2 offset 357557075968 dev uuid: f98143e4-24a2-4a2a-8dbf-2871c75f7b78 stripe 1 devid 1 offset 2185232384 dev uuid: 94c62352-2568-4abe-8a58-828d1766719c backup_roots[4]: backup 0: backup_tree_root: 714616012800 gen: 4921 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714190635008 gen: 4921 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714186326016 gen: 4921 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 1: backup_tree_root: 714186997760 gen: 4922 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714187014144 gen: 4922 level: 2 backup_fs_root: 714186096640 gen: 4921 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714187505664 gen: 4922 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 2: backup_tree_root: 714188554240 gen: 4923 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 714188505088 gen: 4923 level: 2 backup_fs_root: 714188488704 gen: 4923 level: 0 backup_dev_root: 715082776576 gen: 4921 level: 1 backup_csum_root: 714188668928 gen: 4923 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2 backup 3: backup_tree_root: 809898442752 gen: 4920 level: 1 backup_chunk_root: 715141414912 gen: 4918 level: 1 backup_extent_root: 809898459136 gen: 4920 level: 2 backup_fs_root: 810253713408 gen: 4805 level: 0 backup_dev_root: 809896886272 gen: 4918 level: 1 backup_csum_root: 809898557440 gen: 4920 level: 2 backup_total_bytes: 1500312748032 backup_bytes_used: 537228206080 backup_num_devices: 2
