Re: btrfs-transacti hangs system for several seconds every few minutes

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



It started doing what it claims is a "disk checK", where it says it is
doing 4 tasks and gives it 90 seconds to do it.  (It does this every
time I boot.)  However, this time it timed out, and went to 3 minutes,
then 4 minutes 30 seconds and then the boot aborted on the timeout.

However, the filesystems mounted.   I was unable to do the test " btrfs
ins dump-tree -t 10 /dev/vgwaya/root |
                 grep 'owner FREE_SPACE_TREE' | wc -l"
Because I have no device named anything like vgwaya.

My guess was this was the cache clearance taking a very long time, and I
should not have done it at reboot?  My perhaps wrong instinct was that
this would be cleanest but perhaps not.

Normally it takes exactly 90 seconds every time.  It is annoying.  Most
systems have gotten their boot times down very low these days.  While I
often go many months without booting, whenever I am trying to debug
things I end up rebooting frequently and with everything but the RAID on
flash (as I expect most people do these days) every other aspect of the
boot is quick, except the btrfs filesystem mount.  It reminds me of the
days when you had to do fsck too much.

Yes, I need more ram.   Tools have bloated so much that 16gb is no
longer nearly enough for an ordinary desktop with lots of web browser
tabs.   Sadly, to get more ram I will need to get a new
motherboard/cpu/etc.) which is frankly a lot of work.

The v2 cache has done something.  In the past, there were not only the
hangs, but just a lot more activity on the disk (you can hear it.) The
computer is a lot quieter now.    Rebooting, as we know, can fix many
things, and right now I'm not needing any swap. As I use the system more
memory sucks will arrive and I'll start using the swap and I will track it.

On 3/29/20 6:14 AM, Qu Wenruo wrote:
> 
> 
> On 2020/3/29 下午12:03, Brad Templeton wrote:
>> Not using qgroups.  Not doing snapshots.    Did a reboot with the
>> options to upgrade to v2 -- it failed,
> 
> What did you mean about "it failed"
> 
> It failed to mount or something else showed up?
> 
> If failed to mount, would you like to shared the dmesg of that mount
> failure?
> 
>> in that the disk check took more
>> than 6 minutes,
> 
> Please be aware that, btrfs check, unlike e2fsck, will always check all
> metadata of the fs, no matter if the fs is clean unmounted or not.
> 
> In fact, btrfs unlike other journal based fs, has no clear way to
> determine if an fs is unmounted cleanly or not.
> (Log tree is one method, but not a reliable one).
> 
> 6 min looks completely valid to me.
> 
>> but it worked, and the second time I was able to boot,
>> and -- knock on wood -- so far it has not hung.
> 
> If you hit the hang, you could try to use 'perf' command to try to probe
> the runtime of btrfs_commit_transaction() and its major components.
> 
> It would be super helpful if we could determine which is the major cause.

> 
>>
>> I wonder why they put 5.3.0 as the standard advanced Kernel in Ubuntu
>> LTS if it has a data corruption bug.   I don't know if I've seen any
>> release of 5.4.14 in a PPA yet -- manual kernel install is such a pain
>> the few times I have done it.  I could revert, but the reason I switched
>> to 5.3, not long ago, was another problem with sound drivers.
>>
>> BTW, even though it now works, it still takes 90 seconds every boot
>> doing a disk check, even after what I think is a clean shutdown.   I
>> presume that is not normal, any clues on what may cause that?
>>
> Another thing I found is, in your initial report, your swap is heavily used.
> 
> I guess it may be related to the memory pressure, where every metadata
> write needs to do a lot of metadata read before it can do anything.
> 
> If that's the case, it would be good to keep an eye on the memory
> pressure to make sure fs can still have enough metadata cache without
> triggering too much IO in its critical section.
> 
> Thanks,
> Qu
> 



[Index of Archives]     [Linux Filesystem Development]     [Linux NFS]     [Linux NILFS]     [Linux USB Devel]     [Linux Audio Users]     [Yosemite News]     [Linux Kernel]     [Linux SCSI]

  Powered by Linux