Yaomin,<br> Can you send us the log files?<br><br>--<br>gowda<br><br><div class="gmail_quote">On Fri, Jan 2, 2009 at 8:47 AM, yaomin @ gmail <span dir="ltr"><<a href="mailto:yangyaomin@gmail.com">yangyaomin@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div style="padding-left: 10px; padding-right: 10px; padding-top: 15px;" bgcolor="#ffffff" name="Compose message area">
<div><font face="??" size="2">Hey, Guys</font></div>
<div><font face="??" size="2"></font> </div>
<div> <font face="??" size="2">When I use IOZone to test my
gluster configuration, </font><font face="??" size="2">an error happens if the
file's size is smaller or equal to 1KB.</font></div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2">Thanks,</font></div>
<div><font face="??" size="2">Alfred Yang.</font></div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2"> Below is the message:</font></div>
<div><font face="??" size="2"></font> </div>
<div><font face="??" size="2" color="#333399">/opt/iozone/bin/iozone -f /mnt/new/test1
-s 1k -i 0 -i 1 <br>
Iozone: Performance Test of File
I/O<br>
Version $Revision: 3.315
$<br>
Compiled for 32 bit
mode.<br>
Build: linux </font></div>
<div><font face="??" size="2" color="#333399"></font> </div>
<div><font face="??" size="2" color="#333399"> Contributors:William Norcott,
Don Capps, Isom Crawford, Kirby
Collins<br>
Al Slater, Scott Rhine, Mike Wisner, Ken
Goss<br>
Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain
CYR,<br>
Randy Dunlap, Mark Montague, Dan Million, Gavin
Brebner,<br>
Jean-Marc Zucconi, Jeff Blomberg, Benny
Halevy,<br>
Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root.</font></div>
<div><font face="??" size="2" color="#333399"></font> </div>
<div><font face="??" size="2" color="#333399"> Run began: Fri Jan 2
11:00:14 2009</font></div>
<div><font face="??" size="2" color="#333399"></font> </div>
<div><font face="??" size="2" color="#333399"> File size set to 1
KB<br> Command line used:
/opt/iozone/bin/iozone -f /mnt/new/test1 -s 1k -i 0 -i
1<br> Output is in
Kbytes/sec<br> Time Resolution =
0.000001 seconds.<br> Processor cache
size set to 1024 Kbytes.<br> Processor
cache line size set to 32 bytes.<br>
File stride size set to 17 * record
size.<br>
random random bkwd record
stride
<br>
KB reclen write rewrite
read reread read
write read rewrite
read fwrite frewrite fread
freread<br>
1 4
0 0<br><font color="#ff0000">Error reading
block 0 f6e00000<br>read: Bad file descriptor</font></font></div>
<div><font face="??" size="2" color="#333399"></font> </div>
<div><font face="??" size="2" color="#000000"> </font></div>
<div><font face="??" size="2" color="#000000"></font> </div>
<div><font face="??" size="2" color="#000000"></font> </div>
<div><font face="??" size="2" color="#000000"> Here is the gluster
configurations.(on client)</font></div><font face="??" size="2"></font><font face="??" size="2"></font><font face="??" size="2"></font><font face="??" size="2"></font><font face="??" size="2"></font><font face="??" size="2"></font>
<div><font face="??" size="2"></font><br><font face="??" size="2" color="#333399">volume
client-ns<br> type protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.2 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
name_space # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font face="??" size="2" color="#333399">volume client11<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.2 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick1 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font face="??" size="2" color="#333399">volume client12<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.2 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick2 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div><font face="??" size="2">
<div><br><font color="#333399">volume client21<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.4 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick1 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume client22<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.4 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick2 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume client31</font></div>
<div> <font color="#333399">type protocol/client<br> option
transport-type tcp/client # for TCP/IP
transport<br> option remote-host
192.168.13.5 # IP address of the
remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick1 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume client32<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.5 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick2 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume client41<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.7 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick1 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume client42<br> type
protocol/client<br> option transport-type
tcp/client # for TCP/IP transport<br>
option remote-host 192.168.13.7 # IP
address of the remote brick<br># option remote-port
6996
# default server port is 6996<br># option transport-timeout
30 # seconds
to wait for a
response<br>
# from server for each request<br> option remote-subvolume
brick2 # name of the
remote volume<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume afr1<br> type cluster/afr<br>
subvolumes client11 client21<br> option debug
off # turns on detailed debug
messages
<br>
# in log by default is debugging off<br> option self-heal
on # turn off self healing default is
on<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume afr2<br> type cluster/afr<br>
subvolumes client31 client41<br> option debug
off # turns on detailed debug
messages
<br>
# in log by default is debugging off<br> option self-heal
on # turn off self healing default is
on<br>end-volume<br></font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume afr3<br> type cluster/afr<br>
subvolumes client12 client22<br> option debug
off # turns on detailed debug
messages
<br>
# in log by default is debugging off<br> option self-heal
on # turn off self healing default is
on<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume afr4<br> type cluster/afr<br>
subvolumes client32 client42<br> option debug
off # turns on detailed debug
messages
<br>
# in log by default is debugging off<br> option self-heal
on # turn off self healing default is
on<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume stripe1<br> type
cluster/stripe<br> option block-size
1MB
#default size is 128KB<br> subvolumes afr1
afr2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume stripe2<br> type
cluster/stripe<br> option block-size
1MB
#default size is 128KB<br> subvolumes afr3
afr4<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">volume bricks<br> type cluster/unify<br>
subvolumes stripe1 stripe2<br> option namespace client-ns<br> option
scheduler alu<br># option alu.limits.min-free-disk
5% # Don't create files one a volume with less than 5% free
diskspace<br># option alu.limits.max-open-files 10000 # Don't create
files on a volume with more than 10000 files open</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"> # When deciding where to place a file, first
look at the disk-usage, then at read-usage, write-usage, open files, and finally
the <br>disk-speed-usage.<br> option alu.order
disk-usage:read-usage:write-usage:open-files-usage:disk-speed-usage<br>
option alu.disk-usage.entry-threshold 2GB # Kick in if the
discrepancy in disk-usage between volumes is more than 2GB<br> option
alu.disk-usage.exit-threshold 60MB # Don't stop writing to the
least-used volume until the discrepancy is 1988MB <br> option
alu.open-files-usage.entry-threshold 1024 # Kick in if the
discrepancy in open files is 1024<br> option
alu.open-files-usage.exit-threshold 32 # Don't stop until 992 files
have been written the least-used volume<br> option
alu.read-usage.entry-threshold 20% # Kick in when the read-usage
discrepancy is 20%<br> option alu.read-usage.exit-threshold 4%
# Don't stop until the discrepancy has been reduced to 16% (20% - 4%)<br>
option alu.write-usage.entry-threshold 20% # Kick in when the
write-usage discrepancy is 20%<br> option alu.write-usage.exit-threshold
4% # Don't stop until the discrepancy has been reduced to
16%<br># option alu.disk-speed-usage.entry-threshold # NEVER SET IT. SPEED
IS CONSTANT!!!<br># option alu.disk-speed-usage.exit-threshold #
NEVER SET IT. SPEED IS CONSTANT!!!<br> option alu.stat-refresh.interval
10sec # Refresh the statistics used for decision-making every 10
seconds<br> option alu.stat-refresh.num-file-create 10 #
Refresh the statistics used for decision-making after creating 10
files<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add io-threads feature<br>volume iot<br> type
performance/io-threads<br> subvolumes bricks #stripe #afr
#bricks<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume readahead<br>
type performance/read-ahead<br> option page-size
1MB # unit in bytes<br> option page-count
2 # cache per file = (page-count x
page-size)<br> subvolumes iot<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume iocache<br>
type performance/io-cache<br> option page-size 256KB<br> option
page-count 2<br> subvolumes readahead<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume writeback<br>
type performance/write-behind<br> option aggregate-size 1MB #option
flush-behind off<br> subvolumes iocache<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><br><font color="#333399">### Add io-threads feature<br>volume
iot_stripe1<br> type performance/io-threads<br> subvolumes
stripe1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_stripe1<br> type performance/read-ahead<br> option
page-size 1MB # unit in bytes<br> option
page-count 2 # cache per file =
(page-count x page-size)<br> subvolumes
iot_stripe1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_stripe1<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_stripe1<br>end-volume<br></font></div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_stripe1<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_stripe1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><br><font color="#333399">### Add io-threads feature<br>volume
iot_stripe2<br> type performance/io-threads<br> subvolumes
stripe2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_stripe2<br> type performance/read-ahead<br> option
page-size 1MB # unit in bytes<br> option
page-count 2 # cache per file =
(page-count x page-size)<br> subvolumes
iot_stripe2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_stripe2<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_stripe2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_stripe2<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_stripe2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><br><font color="#333399">### Add io-threads feature<br>volume
iot_afr1<br> type performance/io-threads<br> subvolumes
afr1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_afr1<br> type performance/read-ahead<br> option page-size
1MB # unit in bytes<br> option page-count
2 # cache per file = (page-count x
page-size)<br> subvolumes iot_afr1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_afr1<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_afr1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_afr1<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_afr1<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add io-threads feature<br>volume iot_afr2<br>
type performance/io-threads<br> subvolumes afr2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_afr2<br> type performance/read-ahead<br> option page-size
1MB # unit in bytes<br> option page-count
2 # cache per file = (page-count x
page-size)<br> subvolumes iot_afr2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_afr2<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_afr2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_afr2<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_afr2<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add io-threads feature<br>volume iot_afr3<br>
type performance/io-threads<br> subvolumes
afr3<br>end-volume<br></font></div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_afr3<br> type performance/read-ahead<br> option page-size
1MB # unit in bytes<br> option page-count
2 # cache per file = (page-count x
page-size)<br> subvolumes iot_afr3<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_afr3<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_afr3<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_afr3<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_afr3<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add io-threads feature<br>volume iot_afr4<br>
type performance/io-threads<br> subvolumes afr4<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add readahead feature<br>volume
readahead_afr4<br> type performance/read-ahead<br> option page-size
1MB # unit in bytes<br> option page-count
2 # cache per file = (page-count x
page-size)<br> subvolumes iot_afr4<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add IO-Cache feature<br>volume
iocache_afr4<br> type performance/io-cache<br> option page-size
256KB<br> option page-count 2<br> subvolumes
readahead_afr4<br>end-volume</font></div>
<div><font color="#333399"></font> </div>
<div><font color="#333399">### Add writeback feature<br>volume
writeback_afr4<br> type performance/write-behind<br> option
aggregate-size 1MB #option flush-behind off<br> subvolumes
iocache_afr4<br>end-volume</font></div></font></div>
<br>_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@nongnu.org">Gluster-devel@nongnu.org</a><br>
<a href="http://lists.nongnu.org/mailman/listinfo/gluster-devel" target="_blank">http://lists.nongnu.org/mailman/listinfo/gluster-devel</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>hard work often pays off after time, but laziness always pays off now<br>