<div dir="ltr">Actually there are tons of possible tune ups, but let's start from the beginning.<div><br></div><div>Gluster documents, Red Hat documents, and several other sources suggest using XFS, and NOT ext4.</div>
<div><br></div><div>Second, How did you measure performance ? What tool ?</div><div><br></div><div>From my personal experience, first of all, measure performance of you hardware, before measuring Gluster's.</div><div>
<br></div><div>I found out a major problem with my disk layout. I was naive enough believe that by using a good RAID controller (PERC 6) with fair disks (SAS 7.2 KRPM 3 Gbits) on RAID5 I would be in the safe side. It was a disaster. It never passed 40 MBytes/s.</div>
<div><br></div><div>Changing that to RAID10 made it 10 times faster, at the price of half of the storage space. </div><div><br></div><div>Test your hardware. </div><div><br></div><div>Start with simple stuff like</div><div>
<br></div><div>dd if=/dev/zero of=filename_on_your_local_disks bs=512k count=10000</div><div><br></div><div>check what the result is, and if your hardware is responding as expected. </div><div><br></div><div>Only then move to other areas.</div>
<div><br></div><div>Cheers, </div><div><br></div><div>Carlos</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Apr 29, 2014 at 10:47 AM, Dragon <span dir="ltr"><<a href="mailto:Sunghost@gmx.de" target="_blank">Sunghost@gmx.de</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div style="font-family:Verdana;font-size:12.0px"><div>Hello,</div>
<div> </div>
<div>i have a 3 Node Gluster with one distributed Volume. All 3 Nodes are identically in their Hardware. All have 6x3TB Seagate ST3000DM001. The disk on each Node are in a Softwareraid6 (Blocksize 4096| Stripe 512) with ext4 filesystem on Debian Wheezy. As the Raid was new i testet it with fio:</div>
<div>[sequential-write]<br>
rw=write<br>
size=5g<br>
direct=0<br>
numjobs=3<br>
group_reporting<br>
name=sequential-write-buffered<br>
bs=4k<br>
runtime=10</div>
<div> </div>
<div>Result: WRITE: io=3014.2MB, aggrb=308456KB/s, minb=308456KB/s, maxb=308456KB/s,</div>
<div> </div>
<div>I added a new sata controller Digitus DS-30104-1 4 Port PCIe x4, each Port 6GBits on x16 Slot. Node1 has now 7 Disks in Raid6. I added another Disk 3TB same model too on the Controller and copied files 20-40GB onto the volume. The Volume is mounted on the same node with "mount -t gluster-fs IP-Adress:/vol1" The Problem is that the writespeed is only 20MB/s. This is what i didnt understand. The files are copied on the same machine, not over the network, perhaps the bus-system of the mainboard is to slow? Any kind of performance tuning?</div>
<div> </div>
<div>thx</div></div></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div>