Hi there,
Probably not a related issue to Scientific Linux, but since the NFS
server is running on SL 6.7 here on my server, I want to know if I can
tweak something to boost up nfs performance.
For what I've read, it seems that nfsv4 forces sync to be used instead.
In the previous versions of nfsv2 respectively nfsv3, async mechanism
was used. That's one of the reasons I put async in the /etc/exports file.
Anyone any idea how to increase NFS performance? Thanks in advance for
your help.
Here is how my nfs configuration looks like:
$ grep -v '^#' /etc/sysconfig/nfs
MOUNTD_NFS_V3="yes"
RPCNFSDCOUNT=60
SECURE_NFS=yes
$ cat /etc/exports
/users *(rw,async,no_root_squash)
$ rpm -qa | grep nfs
nfs4-acl-tools-0.3.3-6.el6.x86_64
nfs-utils-1.2.3-64.el6.x86_64
nfswatch-4.99.9-1.el6.rf.x86_64
nfs-utils-lib-1.1.5-4.el6.x86_64
On my client, I see the following mount information:
client$ nfsstat -m
/Users/users from homeserver.internal.local:/users/users
Flags:
rw,relatime,vers=3,rsize=8192,wsize=8192,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=10.0.6.9,mountvers=3,mountport=35079,mountproto=udp,fsc,local_lock=none,addr=10.0.6.9
And here I've some statistics.
$ nfsstat -l
nfs v2 server total: 611328
------------- ------------- --------
nfs v2 server null: 611328
nfs v3 server total: 8437692958
------------- ------------- --------
nfs v3 server null: 1179459
nfs v3 server getattr: 2319523378
nfs v3 server setattr: 760554371
nfs v3 server lookup: 378038887
nfs v3 server access: 936481720
nfs v3 server readlink: 798140
nfs v3 server read: 1981135953
nfs v3 server write: 919454712
nfs v3 server create: 310017152
nfs v3 server mkdir: 2365925
nfs v3 server symlink: 148599
nfs v3 server mknod: 30460
nfs v3 server remove: 106047358
nfs v3 server rmdir: 2779326
nfs v3 server rename: 211308603
nfs v3 server link: 7769719
nfs v3 server readdir: 1519747
nfs v3 server readdirplus: 57862120
nfs v3 server fsstat: 193795766
nfs v3 server fsinfo: 325580
nfs v3 server pathconf: 118989
nfs v3 server commit: 246436994
nfs v4 server total: 3361267169
------------- ------------- --------
nfs v4 server null: 283535
nfs v4 server compound: 3360983634
nfs v4 servop total: 34484196066
------------- ------------- --------
nfs v4 servop access: 2226709179
nfs v4 servop close: 472390080
nfs v4 servop commit: 1191107646
nfs v4 servop create: 14803947
nfs v4 servop delegreturn: 509614832
nfs v4 servop getattr: 27075450
nfs v4 servop getfh: 3851523450
nfs v4 servop link: 430462551
nfs v4 servop lock: 129974472
nfs v4 servop lockt: 76539043
nfs v4 servop locku: 3805709953
nfs v4 servop lookup: 3772484078
nfs v4 servop open: 2135114882
nfs v4 servop open_conf: 23234350
nfs v4 servop open_dgrd: 403447391
nfs v4 servop putfh: 967175124
nfs v4 servop putrootfh: 371364
nfs v4 servop read: 2044179242
nfs v4 servop readdir: 723470892
nfs v4 servop readlink: 15294215
nfs v4 servop remove: 1491471942
nfs v4 servop rename: 2041280436
nfs v4 servop renew: 2577353588
nfs v4 servop restorefh: 2521228806
nfs v4 servop savefh: 46626591
nfs v4 servop secinfo: 84
nfs v4 servop setattr: 1972386161
nfs v4 servop setcltid: 125203
nfs v4 servop setcltidconf: 125204
nfs v4 servop write: 125168039
nfs v4 servop rellockowner: 887747871
nfs v3 client total: 2717
------------- ------------- --------
nfs v3 client getattr: 504
nfs v3 client setattr: 2
nfs v3 client lookup: 256
nfs v3 client access: 342
nfs v3 client remove: 1
nfs v3 client readdirplus: 81
nfs v3 client fsstat: 1291
nfs v3 client fsinfo: 160
nfs v3 client pathconf: 80
nfs v4 client total: 101151
------------- ------------- --------
nfs v4 client read: 1715
nfs v4 client write: 1294
nfs v4 client commit: 11
nfs v4 client open: 10336
nfs v4 client open_conf: 10138
nfs v4 client close: 10143
nfs v4 client setattr: 40130
nfs v4 client fsinfo: 300
nfs v4 client renew: 138
nfs v4 client setclntid: 21
nfs v4 client confirm: 21
nfs v4 client access: 10795
nfs v4 client getattr: 662
nfs v4 client lookup: 10802
nfs v4 client lookup_root: 127
nfs v4 client symlink: 2
nfs v4 client create: 258
nfs v4 client pathconf: 179
nfs v4 client statfs: 3369
nfs v4 client readlink: 43
nfs v4 client readdir: 188
nfs v4 client server_caps: 479
And here some additional info
$ nfsstat -o all | column -t
Server packet stats:
packets udp tcp tcpconn
3257605549 124831981 3132446109 1354321
Server rpc stats:
calls badcalls badclnt badauth xdrcall
3485640624 847551 847551 0 0
Server reply cache:
hits misses nocache
257630 2320556780 670712805
Server file handle cache:
lookup anon ncachedir ncachedir stale
0 0 0 0 3251412
Server nfs v2:
null getattr setattr root lookup
readlink
611328 100% 0 0% 0 0%
0 0% 0 0% 0 0%
read wrcache write create remove rename
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
link symlink mkdir rmdir readdir fsstat
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
Server nfs v3:
null getattr setattr lookup access
readlink
1179459 0% 2319546575 27% 760563233 9%
378044548 4% 936490970 11% 798140 0%
read write create mkdir symlink mknod
1981156891 23% 919509170 10% 310019266 3%
2365927 0% 148599 0% 30460 0%
remove rmdir rename link readdir
readdirplus
106048680 1% 2779330 0% 211310038 2%
7769762 0% 1519747 0% 57862262 0%
fsstat fsinfo pathconf commit
193797717 2% 325580 0% 118989 0%
246439198 2%
Server nfs v4:
null compound
283535 0% 3360985340 99%
Server nfs v4 operations:
op0-unused op1-unused op2-future access close commit
0 0% 0 0% 0 0%
2226709387 6% 472390169 1% 1191107683 3%
create delegpurge delegreturn getattr getfh link
14803947 0% 0 0% 509614835 1%
27076534 0% 3851523653 11% 430462551 1%
lock lockt locku lookup lookup_root nverify
129974591 0% 76539043 0% 3805710051 11%
3772484251 10% 0 0% 0 0%
open openattr open_conf open_dgrd putfh
putpubfh
2135114974 6% 0 0% 23234350 0%
403447391 1% 967176818 2% 0 0%
putrootfh read readdir readlink remove rename
371364 0% 2044179438 5% 723470894 2%
15294215 0% 1491471955 4% 2041280477 5%
renew restorefh savefh secinfo setattr
setcltid
2577353602 7% 2521228806 7% 46626632 0%
84 0% 1972386230 5% 125203 0%
setcltidconf verify write rellockowner bc_ctl
bind_conn
125204 0% 0 0% 125168413 0%
887747910 2% 0 0% 0 0%
exchange_id create_ses destroy_ses free_stateid getdirdeleg
getdevinfo
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
getdevlist layoutcommit layoutget layoutreturn secinfononam
sequence
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
set_ssv test_stateid want_deleg destroy_clid reclaim_comp
0 0% 0 0% 0 0%
0 0% 0 0%
Client packet stats:
packets udp tcp tcpconn
0 0 0 0
Client rpc stats:
calls retrans authrefrsh
104084 222 104084
Client nfs v3:
null getattr setattr lookup access
readlink
0 0% 504 18% 2 0%
256 9% 342 12% 0 0%
read write create mkdir symlink mknod
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
remove rmdir rename link readdir
readdirplus
1 0% 0 0% 0 0%
0 0% 0 0% 81 2%
fsstat fsinfo pathconf commit
1291 47% 160 5% 80 2%
0 0%
Client nfs v4:
null read write commit open
open_conf
0 0% 1715 1% 1294 1%
11 0% 10336 10% 10138 10%
open_noat open_dgrd close setattr fsinfo renew
0 0% 0 0% 10143 10%
40130 39% 300 0% 138 0%
setclntid confirm lock lockt locku access
21 0% 21 0% 0 0%
0 0% 0 0% 10795 10%
getattr lookup lookup_root remove rename link
662 0% 10802 10% 127 0%
0 0% 0 0% 0 0%
symlink create pathconf statfs readlink readdir
2 0% 258 0% 179 0%
3369 3% 43 0% 188 0%
server_caps delegreturn getacl setacl fs_locations
rel_lkowner
479 0% 0 0% 0 0%
0 0% 0 0% 0 0%
secinfo exchange_id create_ses destroy_ses sequence
get_lease_t
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
reclaim_comp layoutget getdevinfo layoutcommit layoutreturn
getdevlist
0 0% 0 0% 0 0%
0 0% 0 0% 0 0%
(null)
0 0%
$ netstat -r
Server rpc stats:
calls badcalls badclnt badauth xdrcall
3485705832 847551 847551 0 0
Client rpc stats:
calls retrans authrefrsh
104084 222 104084
Yours sincerely,
--
Valentin Bajrami
Kapteyn Astronomical Institute
University of Groningen
Postbus 800
NL-9700 AV Groningen
The Netherlands
Phone: +31-(0)50-3634068
|
