<div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial"><div><span style="font-size: 18px;">Hi all,<br><br>&nbsp;&nbsp;&nbsp; Now I try glusterfs 3.6.0, use the same configuration to do test. But the situation has not improved, several hours later, bricks' log still says "socket disconnection".<br>&nbsp;&nbsp;&nbsp;&nbsp; I doubt&nbsp; this problem may be caused by epoll, so I patch system using "http://review.gluster.org/#/c/3842/13//COMMIT_MSG", but it seems do <br>not work.<br><br>&nbsp;&nbsp;&nbsp; shuai li</span><br><br></div><br><br><div></div><div id="divNeteaseMailCard"></div>ÔÚ 2014-11-11 13:58:20£¬"Pranith Kumar Karampuri" &lt;pkarampu@redhat.com&gt; Ð´µÀ£º<br> <blockquote id="isReplyContent" style="PADDING-LEFT: 1ex; MARGIN: 0px 0px 0px 0.8ex; BORDER-LEFT: #ccc 1px solid">
  
    
  
  
    <br>
    <div class="moz-cite-prefix">On 11/11/2014 11:21 AM, shuau li wrote:<br>
    </div>
    <blockquote cite="mid:7ba5388f.891d.1499d67f49d.Coremail.lishuai_ujs@126.com" type="cite">
      <div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial">
        <div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial">
          <style type="text/css">P { margin-bottom: 0.08in; }</style>
          <p style="margin-bottom: 0in"><font size="4">Hi everyone, </font>
          </p>
          <div style="margin-bottom: 0in"><font size="4"><br>
              &nbsp;&nbsp;&nbsp; I am trying to run
              multipal jobs using fio benchamark in replica volume</font><font size="4"><br>
              <br>
              with 3 bricks, but some
              hours later, warning message ¡°W
              [socket.c:195:__socket_rwv]</font><font size="4"><br>
              <br>
              0-tcp.ida-server: readv
              failed (Connection timed out)¡± appear in bricks logs, I
              think this</font><font size="4"><br>
              <br>
              waring may due to high
              work loads, glusterfs with high work loads can not respond</font><font size="4"><br>
              <br>
              socket timely. So I add
              codes in rpc/rpc-transport/socket/src/socket.c to expand
              timeout<br>
              <br>
              threshold of socket, now
              the SO_RCVTIMEO is 180s, KEEP_ALIVE is 300s, then run</font><font size="4"><br>
              <br>
              work load again, but it
              does not work.</font>
          </div>
          <p style="margin-bottom: 0in"><br>
          </p>
          <div><font size="4">My test enviroment is as
              follow:</font><font size="4"><br>
              &nbsp;&nbsp;&nbsp; <br>
              &nbsp;&nbsp;&nbsp; Three nodes work as
              gluster cluster, each nodes with 16GB memory, 8 core</font><font size="4"><br>
              <br>
              3.3GHz cpu</font><font face="WenQuanYi Zen Hei"><font size="4"><span lang="zh-CN">£¬
                </span></font></font><font size="4">two 10000baseT/full
              and one
              1000baseT/full network cards, each nodes</font><font size="4"><br>
              <br>
              use 16 * 2T raid5 disks
              working as brick. The glusterfs version is 3.3.1.</font><font size="4"><br>
            </font></div>
        </div>
      </div>
    </blockquote>
    <font size="4">Just wanted to know if there is a possibility of
      using newer versions. No new releases are being made from 3.3.x.
      Could you try the case on newer versions and let us know your
      findings? If for some reasons you can't upgrade then we can
      probably start debugging this in 3.3.x. But I highly recommend you
      use a version that is active i.e. at least 3.4.x<br>
      <br>
      Pranith<br>
    </font>
    <blockquote cite="mid:7ba5388f.891d.1499d67f49d.Coremail.lishuai_ujs@126.com" type="cite">
      <div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial">
        <div style="line-height:1.7;color:#000000;font-size:14px;font-family:Arial">
          <div><font size="4"><br>
              &nbsp;&nbsp;&nbsp; I create a 1*3 replica
              volume use this three nodes, every node use fuse to mount</font><font size="4"><br>
              <br>
              volume through a
              10000baseT/full network card. At the sametime, every node
              use cifs to</font><font size="4"><br>
              <br>
              mount fuse_mount_point
              through another 10000baseT/full card.</font><font size="4"><br>
              <br>
              &nbsp;&nbsp;&nbsp; Each node run two fio
              scripts, read and write jobs. Both scripts do operation in</font><br>
          </div>
          <div style="margin-bottom: 0in"><font size="4"><br>
              cifs_mount_point. scripts
              is as follows:</font>
          </div>
          <div style="margin-bottom: 0in"><font size="4"><br>
              write_jobs:<br>
              while true</font><font size="4"><br>
              do</font><font size="4"><br>
              mkdir -p
              ${DIR}_write_${i}</font><font size="4"><br>
              /usr/local/bin/fio
              --ioengine=libaio --iodepth=256 --numjobs=100 --rw=write
              --bs=1k
              --size=1000m --directory=${DIR}_write_${i}
              --name=job01_1k_write &gt;&gt;
              ${DIR}_write_${i}/job01_1k_write.log </font>
          </div>
          <div><font size="4">i=`expr $i + 1`</font><font size="4"><br>
              done</font>
          </div>
          <p style="margin-bottom: 0in"><br>
          </p>
          <div><font size="4">read jobs:</font><font size="4"><br>
              mkdir -p ${DIR}_read_${i}</font><font size="4"><br>
              /usr/local/bin/fio
              --ioengine=libaio --iodepth=256 --numjobs=100 --rw=read
              --bs=1k
              --size=1000m --directory=${DIR}_read_${i}
              --name=job01_1k_read &gt;&gt;
              ${DIR}_read_${i}/job01_1k_read.log</font><font size="4"><br>
              i=`expr $i + 1`</font><font size="4"><br>
              done </font>
          </div>
          <div style="margin-bottom: 0in"><font size="4">&nbsp; <br>
              &nbsp;&nbsp;&nbsp; I change iodepth from 256
              to 16, numjobs from 100 to 25, but it still does not <br>
              <br>
              work. Is there anybody pay
              attention to this problem?</font>
          </div>
        </div>
        <br>
        <br>
        <span title="neteasefooter"><span id="netease_mail_footer"></span></span></div>
      <br>
      <br>
      <span title="neteasefooter"><span id="netease_mail_footer"></span></span><br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  

</blockquote></div><br><br><span title="neteasefooter"><span id="netease_mail_footer"></span></span>