Re: Fio benchmark output "error=Too many open files

[yan li <01jay.ly@xxxxxxxxx>]

Hi Jens;
     Thanks for your help. As you asked me, I checked again in the
benchmark system. Selinux is disabled.
     Sorry about my careless, Because setting of limit.conf is not work.

When I ran fio, only 1600 files have opened.
# cat /proc/sys/fs/file-nr
576	0	390196

run fio:
#cat /proc/sys/fs/file-nr
1600	0	390196

# cat /proc/sys/fs/file-max
390196

#cd /proc/fio_pid/fd
# ls -l | grep -c rw
1003

At this time, I knew, the limit.conf setting is not work.
#ulimit -n
1024

I add another line in /etc/security/limits.conf
*	soft	nofile	20480

Now, it 's ok. when I run fio, there are no the error messages.
#ulimit -n
20480


--
Homer Li



2011/9/21 Jens Axboe <axboe@xxxxxxxxx>:
> On 2011-09-20 12:06, yan li wrote:
>> Hi fio users and developers,
>>     When I run fio benchmark, there are some error in the screen.
>>     Does someone meet the same circumstances ?
>>     Thanks, ^_^
>>
>> #fio fio.cfg
>> ......
>> fio: pid=29128, err=24/file:filesetup.c:529,
>> func=open(/mnt/rw1/rw1.168.2), error=Too many open files
>> fio: pid=29039, err=24/file:filesetup.c:529, func=open(/mnt/rw.79.2),
>> error=Too many open files
>> fio: pid=29040, err=24/file:filesetup.c:529, func=open(/mnt/rw.80.2),
>> error=Too many open files
>> fio: pid=29074, err=24/file:filesetup.c:529, func=open(/mnt/rw.114.2),
>> error=Too many open files
>> fio: pid=29026, err=24/file:filesetup.c:529, func=open(/mnt/rw.66.2),
>> error=Too many open files
>> ......
>
> Fio keeps all of its data files open, and from the jobs below, you have
>
> 3*8*128 = 3072
>
> in data files alone, add some house keeping, and perhaps you hit the
> limit? Seems a bit odd, given that the typical max is somewhat larger,
> and your selinux settings allow higher as well. What do
>
> /proc/sys/fs/file-{nr,max}
>
> show when this happens? You could also freeze fio at this point and ls
> -l /proc/pid-of-fio/fd/ to see if something strange is being held open.
>
> --
> Jens Axboe
>
>



-- 
Let one live alone doing no evil, care-free, like an elephant in the
elephant forest
--
To unsubscribe from this list: send the line "unsubscribe fio" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at  http://vger.kernel.org/majordomo-info.html