<html dir="ltr">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style id="owaParaStyle" type="text/css">P {margin-top:0;margin-bottom:0;}</style>
</head>
<body ocsi="0" fpstyle="1" style="word-wrap: break-word;">
<div style="direction: ltr;font-family: Tahoma;color: #000000;font-size: 10pt;">Hi there,<br>
<br>
Appreciate if you could share the following info with us:<br>
<br>
* Are you using GlusterFS hadoop plugin (which is here <a href="http://download.gluster.com/pub/gluster/glusterfs/qa-releases/3.3-beta-2/glusterfs-hadoop-0.20.2-0.1.x86_64.rpm" target="_blank">
http://download.gluster.com/pub/gluster/glusterfs/qa-releases/3.3-beta-2/glusterfs-hadoop-0.20.2-0.1.x86_64.rpm</a> and is still in beta) or are you using GlusterFS as an additional layer below Hadoop's FileSystem (HDFS) ?<br>
<br>
The latter is basically configuring Hadoop to use GlusterFS mount point (e.g. FUSE mount) as the data directory for Hadoop's DFS.<br>
<br>
Let us know your setup (including GlusterFS version) to debug further.<br>
<br>
Thanks,<br>
-Venky<br>
<div style="font-family: Times New Roman; color: rgb(0, 0, 0); font-size: 16px;">
<hr tabindex="-1">
<div style="direction: ltr;" id="divRpF789062"><font face="Tahoma" color="#000000" size="2"><b>From:</b> gluster-users-bounces@gluster.org [gluster-users-bounces@gluster.org] on behalf of andrew [sstrato.kong@gmail.com]<br>
<b>Sent:</b> Wednesday, October 19, 2011 6:15 PM<br>
<b>To:</b> gluster-users@gluster.org<br>
<b>Subject:</b> [Gluster-users] gluster map/reduce performance..<br>
</font><br>
</div>
<div></div>
<div>Hi, all,
<div><br>
</div>
<div>i try to check the performance of Map/Reduce of Gluster File system. </div>
<div><br>
</div>
<div>Mapper side speed is quite good and it is sometimes faster than hadoop's map job. </div>
<div><br>
</div>
<div>But in the Reduce Side job is much slower than hadoop. </div>
<div><br>
</div>
<div>i analyze the result and i found the primary reason of slow speed is bad performance in Merging stage. </div>
<div><br>
</div>
<div>Would you have any suggestion for this issue</div>
<div><br>
</div>
<div><br>
</div>
<div>FYI check the blog <a href="http://storage4com.blogspot.com/" target="_blank">http://storage4com.blogspot.com/</a></div>
<div><br>
</div>
<div>thanks.</div>
</div>
</div>
</div>
</body>
</html>