I added the following to the bottom of my spec file:<br><br>volume writebehind<br> type performance/write-behind<br> option aggregate-size 10MB # default is 0bytes<br> option flush-behind off # default is 'off'<br>
subvolumes afr <br>end-volume<br><br>which gives me the following results when making a 10MB file<br><div class="gmail_quote"><div style="margin-left: 40px;"># time dd if=/dev/zero of=/tmp/disktest count=10240 bs=1024<br>
10240+0 records in<br>10240+0 records out<br>10485760 bytes (10 MB) copied, 0.173179 s, 60.5 MB/s<br><br>real 0m0.183s<br>user 0m0.000s<br>sys 0m0.204s<br><br># time dd if=/dev/zero of=/mnt/gluster/disktest count=10240 bs=1024<br>
10240+0 records in<br>10240+0 records out<br>10485760 bytes (10 MB) copied, 5.50861 s, 1.9 MB/s<br><br>real 0m5.720s<br>user 0m0.000s<br>sys 0m0.060s<br></div><br>Although this is better than I had before is there anyway to have gluster write the data to the localBrick and then sync/afr in the background so I could expect to see something closer to the 60 MB/s I see when writing to the local disk directly?<br>
<br>Thanks<br><br>aghavendra G <span dir="ltr"><<a href="mailto:raghavendra@zresearch.com">raghavendra@zresearch.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div class="Ih2E3d">above afr with afr as a subvolume <br><br></div><div><div></div><div class="Wj3C7c"><div class="gmail_quote">On Fri, Jan 23, 2009 at 12:59 AM, Evan <span dir="ltr"><_<a href="mailto:Gluster@devnada.com" target="_blank">Gluster@devnada.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Where should I put the write-behind translator?<br>Just above afr with afr as a subvolume? Or should I put it just above my localBrick volume and below afr?<br><br><br>Here is the output using /dev/zero:<br># time dd if=/dev/zero of=/mnt/gluster/disktest count=1024 bs=1024<div>
<br>
1024+0 records in<br>1024+0 records out<br></div>1048576 bytes (1.0 MB) copied, 1.90119 s, 552 kB/s<br><br>real 0m2.098s<br>user 0m0.000s<br>sys 0m0.016s<br><br># time dd if=/dev/zero of=/tmp/disktest count=1024 bs=1024<div>
<br>
1024+0 records in<br>1024+0 records out<br></div>1048576 bytes (1.0 MB) copied, 0.0195388 s, 53.7 MB/s<br><br>real 0m0.026s<br>user 0m0.000s<br>sys 0m0.028s<br><br><br>Thanks<div><div></div><div>
<br><br><div class="gmail_quote">On Thu, Jan 22, 2009 at 12:52 PM, Anand Avati <span dir="ltr"><<a href="mailto:avati@zresearch.com" target="_blank">avati@zresearch.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">Do you have write-behind loaded on the client side? For IO testing,<br>
use /dev/zero instead of /dev/urandom.<br>
<font color="#888888"><br>
avati<br>
</font><div><div></div><div><br>
On Fri, Jan 23, 2009 at 2:14 AM, Evan <_<a href="mailto:Gluster@devnada.com" target="_blank">Gluster@devnada.com</a>> wrote:<br>
> I have a 2 node single process AFR setup with 1.544Mbps bandwidth between<br>
> the 2 nodes. When I write a 1MB file to the gluster share it seems to AFR to<br>
> the other node in real time killing my disk IO speeds on the gluster mount<br>
> point. Is there anyway to fix this? Ideally I would like to see near real<br>
> disk IO speeds from/to the local gluster mount point and let the afr play<br>
> catch up in the background as the bandwidth becomes available.<br>
><br>
> Gluster Spec File (same on both nodes) <a href="http://pastebin.com/m58dc49d4" target="_blank">http://pastebin.com/m58dc49d4</a><br>
> IO speed tests:<br>
> # time dd if=/dev/urandom of=/mnt/gluster/disktest count=1024 bs=1024<br>
> 1024+0 records in<br>
> 1024+0 records out<br>
> 1048576 bytes (1.0 MB) copied, 8.34701 s, 126 kB/s<br>
><br>
> real 0m8.547s<br>
> user 0m0.000s<br>
> sys 0m0.372s<br>
><br>
> # time dd if=/dev/urandom of=/tmp/disktest count=1024 bs=1024<br>
> 1024+0 records in<br>
> 1024+0 records out<br>
> 1048576 bytes (1.0 MB) copied, 0.253865 s, 4.1 MB/s<br>
><br>
> real 0m0.259s<br>
> user 0m0.000s<br>
> sys 0m0.284s<br>
><br>
><br>
> Thanks<br>
><br>
</div></div><div><div></div><div>> _______________________________________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
> <a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
><br>
><br>
</div></div></blockquote></div><br>
</div></div><br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
<br></blockquote></div><br><br clear="all"><br></div></div>-- <br><font color="#888888">Raghavendra G<br><br>
</font></blockquote></div><br>