<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META content="text/html; charset=unicode" http-equiv=Content-Type>
<META name=GENERATOR content="MSHTML 8.00.6001.18241"></HEAD>
<BODY style="PADDING-LEFT: 10px; PADDING-RIGHT: 10px; PADDING-TOP: 15px"
id=MailContainerBody leftMargin=0 topMargin=0 bgColor=#ffffff
CanvasTabStop="true" name="Compose message area">
<DIV><FONT size=2 face=??>Hey, Guys</FONT></DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV> <FONT size=2 face=??>When I use IOZone to test my
gluster configuration, </FONT><FONT size=2 face=??>an error happens if the
file's size is smaller or equal to 1KB.</FONT></DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??>Thanks,</FONT></DIV>
<DIV><FONT size=2 face=??>Alfred Yang.</FONT></DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT size=2 face=??> Below is the message:</FONT></DIV>
<DIV><FONT size=2 face=??></FONT> </DIV>
<DIV><FONT color=#333399 size=2 face=??>/opt/iozone/bin/iozone -f /mnt/new/test1
-s 1k -i 0 -i 1 <BR>
Iozone: Performance Test of File
I/O<BR>
Version $Revision: 3.315
$<BR>
Compiled for 32 bit
mode.<BR>
Build: linux </FONT></DIV>
<DIV><FONT color=#333399 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#333399 size=2
face=??> Contributors:William Norcott,
Don Capps, Isom Crawford, Kirby
Collins<BR>
Al Slater, Scott Rhine, Mike Wisner, Ken
Goss<BR>
Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain
CYR,<BR>
Randy Dunlap, Mark Montague, Dan Million, Gavin
Brebner,<BR>
Jean-Marc Zucconi, Jeff Blomberg, Benny
Halevy,<BR>
Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root.</FONT></DIV>
<DIV><FONT color=#333399 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#333399 size=2
face=??> Run began: Fri Jan 2
11:00:14 2009</FONT></DIV>
<DIV><FONT color=#333399 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#333399 size=2
face=??> File size set to 1
KB<BR> Command line used:
/opt/iozone/bin/iozone -f /mnt/new/test1 -s 1k -i 0 -i
1<BR> Output is in
Kbytes/sec<BR> Time Resolution =
0.000001 seconds.<BR> Processor cache
size set to 1024 Kbytes.<BR> Processor
cache line size set to 32 bytes.<BR>
File stride size set to 17 * record
size.<BR>
random random bkwd record
stride
<BR>
KB reclen write rewrite
read reread read
write read rewrite
read fwrite frewrite fread
freread<BR>
1 4
0 0<BR><FONT color=#ff0000>Error reading
block 0 f6e00000<BR>read: Bad file descriptor</FONT></FONT></DIV>
<DIV><FONT color=#333399 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#000000 size=2 face=??> </FONT></DIV>
<DIV><FONT color=#000000 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#000000 size=2 face=??></FONT> </DIV>
<DIV><FONT color=#000000 size=2 face=??> Here is the gluster
configurations.(on client)</FONT></DIV><FONT size=2 face=??></FONT><FONT size=2
face=??></FONT><FONT size=2 face=??></FONT><FONT size=2 face=??></FONT><FONT
size=2 face=??></FONT><FONT size=2 face=??></FONT>
<DIV><FONT size=2 face=??></FONT><BR><FONT color=#333399 size=2 face=??>volume
client-ns<BR> type protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.2 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
name_space # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399 size=2 face=??>volume client11<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.2 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick1 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399 size=2 face=??>volume client12<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.2 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick2 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV><FONT size=2 face=??>
<DIV><BR><FONT color=#333399>volume client21<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.4 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick1 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume client22<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.4 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick2 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume client31</FONT></DIV>
<DIV> <FONT color=#333399>type protocol/client<BR> option
transport-type tcp/client # for TCP/IP
transport<BR> option remote-host
192.168.13.5 # IP address of the
remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick1 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume client32<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.5 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick2 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume client41<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.7 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick1 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume client42<BR> type
protocol/client<BR> option transport-type
tcp/client # for TCP/IP transport<BR>
option remote-host 192.168.13.7 # IP
address of the remote brick<BR># option remote-port
6996
# default server port is 6996<BR># option transport-timeout
30 # seconds
to wait for a
response<BR>
# from server for each request<BR> option remote-subvolume
brick2 # name of the
remote volume<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume afr1<BR> type cluster/afr<BR>
subvolumes client11 client21<BR> option debug
off # turns on detailed debug
messages
<BR>
# in log by default is debugging off<BR> option self-heal
on # turn off self healing default is
on<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume afr2<BR> type cluster/afr<BR>
subvolumes client31 client41<BR> option debug
off # turns on detailed debug
messages
<BR>
# in log by default is debugging off<BR> option self-heal
on # turn off self healing default is
on<BR>end-volume<BR></FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume afr3<BR> type cluster/afr<BR>
subvolumes client12 client22<BR> option debug
off # turns on detailed debug
messages
<BR>
# in log by default is debugging off<BR> option self-heal
on # turn off self healing default is
on<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume afr4<BR> type cluster/afr<BR>
subvolumes client32 client42<BR> option debug
off # turns on detailed debug
messages
<BR>
# in log by default is debugging off<BR> option self-heal
on # turn off self healing default is
on<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume stripe1<BR> type
cluster/stripe<BR> option block-size
1MB
#default size is 128KB<BR> subvolumes afr1
afr2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume stripe2<BR> type
cluster/stripe<BR> option block-size
1MB
#default size is 128KB<BR> subvolumes afr3
afr4<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>volume bricks<BR> type cluster/unify<BR>
subvolumes stripe1 stripe2<BR> option namespace client-ns<BR> option
scheduler alu<BR># option alu.limits.min-free-disk
5% # Don't create files one a volume with less than 5% free
diskspace<BR># option alu.limits.max-open-files 10000 # Don't create
files on a volume with more than 10000 files open</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399> # When deciding where to place a file, first
look at the disk-usage, then at read-usage, write-usage, open files, and finally
the <BR>disk-speed-usage.<BR> option alu.order
disk-usage:read-usage:write-usage:open-files-usage:disk-speed-usage<BR>
option alu.disk-usage.entry-threshold 2GB # Kick in if the
discrepancy in disk-usage between volumes is more than 2GB<BR> option
alu.disk-usage.exit-threshold 60MB # Don't stop writing to the
least-used volume until the discrepancy is 1988MB <BR> option
alu.open-files-usage.entry-threshold 1024 # Kick in if the
discrepancy in open files is 1024<BR> option
alu.open-files-usage.exit-threshold 32 # Don't stop until 992 files
have been written the least-used volume<BR> option
alu.read-usage.entry-threshold 20% # Kick in when the read-usage
discrepancy is 20%<BR> option alu.read-usage.exit-threshold 4%
# Don't stop until the discrepancy has been reduced to 16% (20% - 4%)<BR>
option alu.write-usage.entry-threshold 20% # Kick in when the
write-usage discrepancy is 20%<BR> option alu.write-usage.exit-threshold
4% # Don't stop until the discrepancy has been reduced to
16%<BR># option alu.disk-speed-usage.entry-threshold # NEVER SET IT. SPEED
IS CONSTANT!!!<BR># option alu.disk-speed-usage.exit-threshold #
NEVER SET IT. SPEED IS CONSTANT!!!<BR> option alu.stat-refresh.interval
10sec # Refresh the statistics used for decision-making every 10
seconds<BR> option alu.stat-refresh.num-file-create 10 #
Refresh the statistics used for decision-making after creating 10
files<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add io-threads feature<BR>volume iot<BR> type
performance/io-threads<BR> subvolumes bricks #stripe #afr
#bricks<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume readahead<BR>
type performance/read-ahead<BR> option page-size
1MB # unit in bytes<BR> option page-count
2 # cache per file = (page-count x
page-size)<BR> subvolumes iot<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume iocache<BR>
type performance/io-cache<BR> option page-size 256KB<BR> option
page-count 2<BR> subvolumes readahead<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume writeback<BR>
type performance/write-behind<BR> option aggregate-size 1MB #option
flush-behind off<BR> subvolumes iocache<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><BR><FONT color=#333399>### Add io-threads feature<BR>volume
iot_stripe1<BR> type performance/io-threads<BR> subvolumes
stripe1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_stripe1<BR> type performance/read-ahead<BR> option
page-size 1MB # unit in bytes<BR> option
page-count 2 # cache per file =
(page-count x page-size)<BR> subvolumes
iot_stripe1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_stripe1<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_stripe1<BR>end-volume<BR></FONT></DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_stripe1<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_stripe1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><BR><FONT color=#333399>### Add io-threads feature<BR>volume
iot_stripe2<BR> type performance/io-threads<BR> subvolumes
stripe2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_stripe2<BR> type performance/read-ahead<BR> option
page-size 1MB # unit in bytes<BR> option
page-count 2 # cache per file =
(page-count x page-size)<BR> subvolumes
iot_stripe2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_stripe2<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_stripe2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_stripe2<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_stripe2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><BR><FONT color=#333399>### Add io-threads feature<BR>volume
iot_afr1<BR> type performance/io-threads<BR> subvolumes
afr1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_afr1<BR> type performance/read-ahead<BR> option page-size
1MB # unit in bytes<BR> option page-count
2 # cache per file = (page-count x
page-size)<BR> subvolumes iot_afr1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_afr1<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_afr1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_afr1<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_afr1<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add io-threads feature<BR>volume iot_afr2<BR>
type performance/io-threads<BR> subvolumes afr2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_afr2<BR> type performance/read-ahead<BR> option page-size
1MB # unit in bytes<BR> option page-count
2 # cache per file = (page-count x
page-size)<BR> subvolumes iot_afr2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_afr2<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_afr2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_afr2<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_afr2<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add io-threads feature<BR>volume iot_afr3<BR>
type performance/io-threads<BR> subvolumes
afr3<BR>end-volume<BR></FONT></DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_afr3<BR> type performance/read-ahead<BR> option page-size
1MB # unit in bytes<BR> option page-count
2 # cache per file = (page-count x
page-size)<BR> subvolumes iot_afr3<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_afr3<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_afr3<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_afr3<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_afr3<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add io-threads feature<BR>volume iot_afr4<BR>
type performance/io-threads<BR> subvolumes afr4<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add readahead feature<BR>volume
readahead_afr4<BR> type performance/read-ahead<BR> option page-size
1MB # unit in bytes<BR> option page-count
2 # cache per file = (page-count x
page-size)<BR> subvolumes iot_afr4<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add IO-Cache feature<BR>volume
iocache_afr4<BR> type performance/io-cache<BR> option page-size
256KB<BR> option page-count 2<BR> subvolumes
readahead_afr4<BR>end-volume</FONT></DIV>
<DIV><FONT color=#333399></FONT> </DIV>
<DIV><FONT color=#333399>### Add writeback feature<BR>volume
writeback_afr4<BR> type performance/write-behind<BR> option
aggregate-size 1MB #option flush-behind off<BR> subvolumes
iocache_afr4<BR>end-volume</FONT></DIV></FONT></BODY></HTML>