<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">On 08/21/2013 01:32 PM, kane wrote:<br>
    </div>
    <blockquote cite="mid:20F2DB6A-A287-486E-8D83-FCC3F9AA30F4@163.com"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=ISO-8859-1">
      <meta http-equiv="Content-Type" content="text/html;
        charset=ISO-8859-1">
      Hello&#65306;
      <div><br>
      </div>
      <div><span class="Apple-tab-span" style="white-space:pre"> </span>We
        have used glusterfs3.4 with the lasted&nbsp;samba-glusterfs-vfs lib
        to test samba performance in windows client.</div>
      <div><br>
      </div>
      <div>two glusterfs server nodes export share with name of "gvol":</div>
      <div>hardwares:</div>
      <div><span class="Apple-tab-span" style="white-space:pre"> </span>brick
        use a raid 5 logic disk with 8 * 2T SATA HDDs</div>
      <div><span class="Apple-tab-span" style="white-space:pre"> </span>10G
        network connection</div>
      <div><br>
      </div>
      <div>one linux client mount the "gvol" with cmd:</div>
      <div>[root@localhost current]#&nbsp;&nbsp;mount.cifs //192.168.100.133/gvol
        /mnt/vfs -o user=kane,pass=123456</div>
      <div><br>
      </div>
      <div>then i use iozone to test the write performance in mount dir
        "/mnt/vfs":</div>
      <div>
        <div>[root@localhost current]# ./iozone -s 10G -r 128k -i0 -t 4</div>
        <div>&#8230;..</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>File
          size set to 10485760 KB</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Record
          Size 128 KB</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Command
          line used: ./iozone -s 10G -r 128k -i0 -t 4</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Output
          is in Kbytes/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Time
          Resolution = 0.000001 seconds.</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Processor
          cache size set to 1024 Kbytes.</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Processor
          cache line size set to 32 bytes.</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>File
          stride size set to 17 * record size.</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Throughput
          test with 4 processes</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Each
          process writes a 10485760 Kbyte file in 128 Kbyte records</div>
        <div><br>
        </div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Children
          see throughput for &nbsp;4 initial writers <span
            class="Apple-tab-span" style="white-space:pre"> </span>=
          &nbsp;487376.67 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Parent
          sees throughput for &nbsp;4 initial writers <span
            class="Apple-tab-span" style="white-space:pre"> </span>=
          &nbsp;486184.67 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Min
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;121699.91 KB/sec&nbsp;</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Max
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;122005.73 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Avg
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;121844.17 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Min
          xfer <span class="Apple-tab-span" style="white-space:pre"> </span>=
          10459520.00 KB</div>
        <div><br>
        </div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Children
          see throughput for &nbsp;4 rewriters <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;491416.41 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Parent
          sees throughput for &nbsp;4 rewriters <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;490298.11 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Min
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;122808.87 KB/sec&nbsp;</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Max
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;122937.74 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Avg
          throughput per process <span class="Apple-tab-span"
            style="white-space:pre"> </span>= &nbsp;122854.10 KB/sec</div>
        <div><span class="Apple-tab-span" style="white-space:pre"> </span>Min
          xfer <span class="Apple-tab-span" style="white-space:pre"> </span>=
          10474880.00 KB</div>
      </div>
      <div>
        <div apple-content-edited="true">
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; "><br>
          </div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">linux client mount
            with cifs , write performance reach 480MB/s per client;</div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; "><br>
          </div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">but when i use win7
            client mount the "gvol" with cmd:</div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">net use Z: <a
              moz-do-not-send="true" href="smb://192.168.100.133/gvol">\\192.168.100.133\gvol</a>
            123456 /user:kane</div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; "><br>
          </div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">then also use
            iozone test in dir Z, even with write block 1Mbyte :</div>
          <div class="" style="orphans: 2; text-align: -webkit-auto;
            text-indent: 0px; widows: 2; word-wrap: break-word;
            -webkit-nbsp-mode: space; -webkit-line-break:
            after-white-space; ">
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; File size set to 10485760 KB</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Record Size 1024 KB</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Command line used: iozone -s
              10G -r 1m -i0 -t 4</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Output is in Kbytes/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Time Resolution = -0.000000
              seconds.</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Processor cache size set to
              1024 Kbytes.</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Processor cache line size set
              to 32 bytes.</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; File stride size set to 17 *
              record size.</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Throughput test with 4
              processes</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Each process writes a
              10485760 Kbyte file in 1024 Kbyte records</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Children see throughput for
              &nbsp;4 initial writers &nbsp;= &nbsp;148164.82 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Parent sees throughput for &nbsp;4
              initial writers &nbsp; = &nbsp;148015.48 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Min throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 37039.91 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Max throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 37044.45 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Avg throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 37041.21 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Min xfer &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 10484736.00 KB</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Children see throughput for
              &nbsp;4 rewriters &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp;147642.12 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Parent sees throughput for &nbsp;4
              rewriters &nbsp; &nbsp; &nbsp; &nbsp; = &nbsp;147472.16 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Min throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 36909.13 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Max throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 36913.29 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Avg throughput per process &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= &nbsp; 36910.53 KB/sec</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">&nbsp; &nbsp; &nbsp; &nbsp; Min xfer &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
              &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;= 10484736.00 KB</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">iozone test complete.</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">then reach 140MB/s</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">so , anyone meet with this problem.Is
              there win7 clinet to reconfigure to perform &nbsp;well?</div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; "><br>
            </div>
            <div class="" style="word-wrap: break-word;
              -webkit-nbsp-mode: space; -webkit-line-break:
              after-white-space; ">Thanks!</div>
            <br>
          </div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">kane&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
            &nbsp; &nbsp;</div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">----------------------------------------------------------------</div>
          <div class="" style="color: rgb(0, 0, 0); font-family:
            Helvetica; font-size: medium; font-style: normal;
            font-variant: normal; font-weight: normal; letter-spacing:
            normal; line-height: normal; orphans: 2; text-align:
            -webkit-auto; text-indent: 0px; text-transform: none;
            white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-size-adjust: auto; -webkit-text-stroke-width:
            0px; word-wrap: break-word; -webkit-nbsp-mode: space;
            -webkit-line-break: after-white-space; ">Email: &nbsp;<a
              moz-do-not-send="true" href="mailto:kai.zhou@soulinfo.com">kai.zhou@soulinfo.com</a><br
              class="">
            &#30005;&#35805;: &nbsp; &nbsp;0510-85385788-616</div>
          <span style="color: rgb(0, 0, 0); font-family: Helvetica;
            font-size: medium; font-style: normal; font-variant: normal;
            font-weight: normal; letter-spacing: normal; line-height:
            normal; orphans: 2; text-align: -webkit-auto; text-indent:
            0px; text-transform: none; white-space: normal; widows: 2;
            word-spacing: 0px; -webkit-text-size-adjust: auto;
            -webkit-text-stroke-width: 0px; "><br
              class="Apple-interchange-newline">
          </span></div>
      </div>
    </blockquote>
    <br>
    <br>
    Hi kane,<br>
    <br>
    I do run IOs using win7 client with glusterfs3.4 , but I never&nbsp;
    compared the performance with Linux cifs mount. I don't think we
    need to do any special configuration on Windows side. I hope your
    Linux and Windows client have similar configuration i.e. RAM, cache,
    disk type etc.&nbsp; However I am curious to know if your setup uses the&nbsp;
    vfs plug-in correctly. We can confirm that looking at smb.conf entry
    for the gluster volume which should have been created by "gluster
    start command" automatically&nbsp; .<br>
    <br>
    e.g: entry in smb.conf for one of volume "smbvol" of mine looks like
    below<br>
    <br>
    [gluster-smbvol]<br>
    comment = For samba share of volume smbvol<br>
    vfs objects = glusterfs<br>
    glusterfs:volume = smbvol<br>
    path = /<br>
    read only = no<br>
    guest ok = yes<br>
    <br>
    Kindly copy the entries in smb.conf&nbsp; for your gluster volume in this
    email.<br>
    -Lala<br>
    <blockquote cite="mid:20F2DB6A-A287-486E-8D83-FCC3F9AA30F4@163.com"
      type="cite">
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </body>
</html>