<div dir="ltr">I've also tested with XFS but with the same results.<div><br></div><div>Which are the best performance options to store big files?</div><div><br></div><div>Best regards,</div><div>David</div></div><div class="gmail_extra">
<br><br><div class="gmail_quote">2013/9/27 David Seira <span dir="ltr"><<a href="mailto:davidseira@gmail.com" target="_blank">davidseira@gmail.com</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi list,<div><br></div><div>I'm trying to deploy a GlusterFS cluster to use as a base filesystem storage for VMWare ESXi. I want to test the glusterFS performance to store the virtual machines.</div><div>
<br></div><div>I've created two VMs with only two replicas, both VM have 16GB of RAM and 8 CPU at 2 GHz. I've configured the glusterFS volume with the default parameters. The replication works perfectly; every file is replicated automatically. For the gluster volume I've used an SSD disk (Kingston HyperX SSD 3K 120GB with reads at 555MB/s, writes at 510MB/s).</div>
<div><br></div><div>To test the glusterFS performance, I've configured the GlusterFS cluster as a storage in another ESXi through NFS. Then I've created a ubuntu virtual machine in this ESXi.</div><div><br></div>
<div>
For the test, I've used the fio and dd tool. <span style="line-height:18px">The maximum IOPS I've achieved using fio for random-write is 2000 and a 70MB/s of transfer rate. To compare the results I've installed a VM directly into the SSD (without GlusterFS interaction) and the results are 29K IOPS and 120MB/s. In sequencial access the result are similar.</span></div>
<div><br></div><div>I don't know why the performance is so reduced.</div><div><br></div><div>Are there any special option to configure the replicate mode to increase this behaviour (big files with a lot of writes)?</div>
<div><br></div><div>I've also tested the volume with this options:</div><div><br></div><div><div>nfs.trusted-write: On</div>
<div>performance.write-behind-window-size: 1GB</div><div>performance.io-thread-count: 64</div><div>performance.cache-size: 1GB</div><div>performance.flush-behind: on</div><div>performance.write-behind: on</div></div><div>
<div>performance.low-prio-threads: 64</div><div>performance.least-prio-threads: 64</div><div>performance.high-prio-threads: 64</div><div>performance.normal-prio-threads: 64</div><div>performance.nfs.write-behind: on</div>
</div><div><br></div><div>But with similar results.</div><div><br></div><div>Any of you have tested GlusterFS as a storage for the ESXi?</div><div><br></div><div>Best regards,</div><div>David</div><div>
<br></div><div><br></div></div>
</blockquote></div><br></div>