<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Ah, no I didn't. Because I planned on using only TCP. Should I retry
    reinstalling with the rdma .deb?<br>
    <br>
    - brian<br>
    <br>
    On 3/9/12 11:28 AM, Xavier Normand wrote:
    <blockquote
cite="mid:CAP+g188+dtZ-695n_EuD12uSWKjQ4CP381L0S+C1Z9ZcikNHgQ@mail.gmail.com"
      type="cite">I saw two deb file on <a moz-do-not-send="true"
        href="http://gluster.org">gluster.org</a>! did you use the one
      with rdma support? cause i saw some strange "no such file ..." in
      your log file "<span class="Apple-style-span"
        style="font-family:monospace;white-space:pre-wrap;font-size:medium">/usr/lib/glusterfs/3.2.5/rpc-transport/rdma.so:
        cannot open shared object file: No such file or directory"?</span>
      <div>
        <b>Xavier Normand</b><br>
        Administrateur Syst&egrave;me<br>
        De Marque inc.<br>
        418 658-1910 #229<br>
        <br>
        <br>
        <div class="gmail_quote">On Fri, Mar 9, 2012 at 11:23 AM, Brian
          Cipriano <span dir="ltr">&lt;<a moz-do-not-send="true"
              href="mailto:bcipriano@zerovfx.com">bcipriano@zerovfx.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0
            .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> Strange! Our
              procedures are almost exactly the same.<br>
              <br>
              I did use the .deb file from <a moz-do-not-send="true"
                href="http://gluster.org" target="_blank">gluster.org</a>.<br>
              <br>
              The only possible difference is that my bricks are mounted
              differently. My bricks are mounted within /gluster:<br>
              <br>
              /gluster/brick0001<br>
              /gluster/brick0002<br>
              <br>
              and so on.
              <div class="im"><br>
                <br>
                - brian<br>
                <br>
                On 3/9/12 11:19 AM, Xavier Normand wrote: </div>
              <div>
                <div class="h5">
                  <blockquote type="cite">Hi Brian,
                    <div><br>
                    </div>
                    <div>i replicate you setup and try to rebalance. I
                      didn't have any of your issue.</div>
                    <div><br>
                    </div>
                    <div>There is what i did:</div>
                    <div><br>
                    </div>
                    <div>1. Install a Ubuntu 10.04 LTS 64Bit</div>
                    <div>2. Install GlusterFS using the .deb file</div>
                    <div>3. Add two drive two 1TB each format in ext4
                      mount on /data1 &amp; /data2</div>
                    <div>4. Create a volume in glusterfs [ volume create
                      data transport tcp glustertest:/data1 ]</div>
                    <div>5. Start the volume et mount it on the same
                      server on /media</div>
                    <div>6. Copy a bunch on file on it.</div>
                    <div>7. Add the other drive in the volume [ volume
                      add-brick data glustertest:/data2 ]</div>
                    <div>8. Rebalance [ volume rebalance data start ]</div>
                    <div><br>
                    </div>
                    <div>Are you using the .deb file on <a
                        moz-do-not-send="true" href="http://gluster.org"
                        target="_blank">gluster.org</a>?</div>
                    <div><br clear="all">
                      <b>Xavier</b><br>
                      <br>
                      <br>
                      <div class="gmail_quote">On Fri, Mar 9, 2012 at
                        10:57 AM, Brian Cipriano <span dir="ltr">&lt;<a
                            moz-do-not-send="true"
                            href="mailto:bcipriano@zerovfx.com"
                            target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
                        wrote:<br>
                        <blockquote class="gmail_quote" style="margin:0
                          0 0 .8ex;border-left:1px #ccc
                          solid;padding-left:1ex">
                          <div bgcolor="#FFFFFF" text="#000000"> 10.04
                            LTS, 64-bit.
                            <div>
                              <div><br>
                                <br>
                                On 3/9/12 10:57 AM, Xavier Normand
                                wrote:
                                <blockquote type="cite">What version of
                                  Ubuntu are you using? LTS? 32 or 64
                                  bits?
                                  <div><br clear="all">
                                    <b>Xavier Normand</b><br>
                                    Administrateur Syst&egrave;me<br>
                                    De Marque inc.<br>
                                    <a moz-do-not-send="true"
                                      href="tel:418%20658-1910%20%23229"
                                      value="+14186581910"
                                      target="_blank">418 658-1910 #229</a><br>
                                    <br>
                                    <br>
                                    <div class="gmail_quote">On Fri, Mar
                                      9, 2012 at 10:30 AM, Brian
                                      Cipriano <span dir="ltr">&lt;<a
                                          moz-do-not-send="true"
                                          href="mailto:bcipriano@zerovfx.com"
                                          target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
                                      wrote:<br>
                                      <blockquote class="gmail_quote"
                                        style="margin:0 0 0
                                        .8ex;border-left:1px #ccc
                                        solid;padding-left:1ex">
                                        <div bgcolor="#FFFFFF"
                                          text="#000000"> Sure thing. I
                                          believe these are them.<br>
                                          <br>
                                          The volume in question is
                                          called "west".<span><font
                                              color="#888888"><br>
                                              <br>
                                              - brian</font></span>
                                          <div>
                                            <div><br>
                                              <br>
                                              On 3/9/12 10:27 AM,
                                              shylesh kumar wrote:
                                              <blockquote type="cite">Hi
                                                Brian,
                                                <div><br>
                                                </div>
                                                <div>Could you please
                                                  provide the rebalance
                                                  and glusterd logs,
                                                  that would help in
                                                  debugging the problem.</div>
                                                <div><br>
                                                </div>
                                                <div><br>
                                                </div>
                                                <div>Thanks,</div>
                                                <div>Shylesh</div>
                                                <div><br>
                                                </div>
                                                <div><br>
                                                </div>
                                                <div><br>
                                                  <br>
                                                  <div
                                                    class="gmail_quote">On
                                                    Fri, Mar 9, 2012 at
                                                    8:52 PM, Brian
                                                    Cipriano <span
                                                      dir="ltr">&lt;<a
                                                        moz-do-not-send="true"
href="mailto:bcipriano@zerovfx.com" target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
                                                    wrote:<br>
                                                    <blockquote
                                                      class="gmail_quote"
                                                      style="margin:0 0
                                                      0
                                                      .8ex;border-left:1px
                                                      #ccc
                                                      solid;padding-left:1ex">
                                                      I've just
                                                      confirmed that the
                                                      same is happening
                                                      on a totally
                                                      different Ubuntu
                                                      machine. Doesn't
                                                      seem to be
                                                      confined to the
                                                      machine.<br>
                                                      <br>
                                                      Could maybe be
                                                      something I'm
                                                      missing in the
                                                      setup though? Some
                                                      package I haven't
                                                      installed?<span><font
color="#888888"><br>
                                                          <br>
                                                          - brian</font></span>
                                                      <div>
                                                        <div><br>
                                                          <br>
                                                          On 3/9/12 9:59
                                                          AM, Brian
                                                          Cipriano
                                                          wrote:<br>
                                                          <blockquote
                                                          class="gmail_quote"
                                                          style="margin:0
                                                          0 0
                                                          .8ex;border-left:1px
                                                          #ccc
                                                          solid;padding-left:1ex">
                                                          Hi Shylesh -
                                                          thanks for the
                                                          reply.<br>
                                                          <br>
                                                          I've restarted
                                                          a few times -
                                                          glusterd, the
                                                          volume, the
                                                          machine
                                                          itself. Same
                                                          results.<br>
                                                          <br>
                                                          - brian<br>
                                                          <br>
                                                          On 3/9/12
                                                          12:46 AM,
                                                          Shylesh Kumar
                                                          Mohan wrote:<br>
                                                          <blockquote
                                                          class="gmail_quote"
                                                          style="margin:0
                                                          0 0
                                                          .8ex;border-left:1px
                                                          #ccc
                                                          solid;padding-left:1ex">
                                                          Hi Brian,<br>
                                                          <br>
                                                          Could you
                                                          please restart
                                                          glusterd and
                                                          try again
                                                          rebalancing.<br>
                                                          <br>
                                                          <br>
                                                          <br>
                                                          Thanks,<br>
                                                          Shylesh<br>
                                                          <br>
                                                          ----- Original
                                                          Message -----<br>
                                                          From: Brian
                                                          Cipriano&lt;<a
moz-do-not-send="true" href="mailto:bcipriano@zerovfx.com"
                                                          target="_blank">bcipriano@zerovfx.com</a>&gt;<br>
                                                          To: <a
                                                          moz-do-not-send="true"
href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
                                                          Sent: Thu, 08
                                                          Mar 2012
                                                          18:08:22 -0500
                                                          (EST)<br>
                                                          Subject:
                                                          [Gluster-users]
                                                          trouble
                                                          rebalancing
                                                          volume<br>
                                                          <br>
                                                          Hi all -<br>
                                                          <br>
                                                          I'm having
                                                          issues
                                                          rebalancing my
                                                          layout/data
                                                          across a
                                                          two-brick
                                                          volume.<br>
                                                          I'm on Gluster
                                                          3.2.5.<br>
                                                          <br>
                                                          I'm currently
                                                          using a single
                                                          Ubuntu 10.04
                                                          machine. Both
                                                          bricks reside
                                                          on<br>
                                                          this machine.
                                                          Adding the
                                                          brick went
                                                          fine. Here's
                                                          the volume's
                                                          info:<br>
                                                          <br>
                                                          $ sudo gluster
                                                          volume info<br>
                                                          Volume Name:
                                                          branch<br>
                                                          Type:
                                                          Distribute<br>
                                                          Status:
                                                          Started<br>
                                                          Number of
                                                          Bricks: 2<br>
                                                          Transport-type:
                                                          tcp<br>
                                                          Bricks:<br>
                                                          Brick1:
                                                          system01:/gluster/brick0001<br>
                                                          Brick2:
                                                          system01:/gluster/brick0002<br>
                                                          <br>
                                                          brick0001 has
                                                          a bunch of
                                                          files on it,
                                                          brick0002 is
                                                          empty. I'd
                                                          like to<br>
                                                          rebalance the
                                                          directory
                                                          layout and
                                                          data onto the
                                                          new brick. But
                                                          strange<br>
                                                          things happen
                                                          when I try to
                                                          do this.<br>
                                                          <br>
                                                          $ sudo gluster
                                                          volume
                                                          rebalance
                                                          branch
                                                          fix-layout
                                                          status<br>
                                                          rebalance
                                                          stopped<br>
                                                          $ sudo gluster
                                                          volume
                                                          rebalance
                                                          branch
                                                          fix-layout
                                                          start<br>
                                                          Rebalance on
                                                          branch is
                                                          already
                                                          started<br>
                                                          $ sudo gluster
                                                          volume
                                                          rebalance
                                                          branch
                                                          fix-layout
                                                          status<br>
                                                          rebalance
                                                          stopped<br>
                                                          <br>
                                                          Weird! I can't
                                                          seem to get
                                                          this to work.<br>
                                                          <br>
                                                          Am I doing
                                                          some wrong, or
                                                          is this some
                                                          other issue?<br>
                                                          <br>
                                                          Thanks!<br>
                                                          <br>
                                                          - brian<br>
_______________________________________________<br>
                                                          Gluster-users
                                                          mailing list<br>
                                                          <a
                                                          moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                                          <a
                                                          moz-do-not-send="true"
href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users"
                                                          target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                                          <br>
                                                          </blockquote>
                                                          <br>
_______________________________________________<br>
                                                          Gluster-users
                                                          mailing list<br>
                                                          <a
                                                          moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                                          <a
                                                          moz-do-not-send="true"
href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users"
                                                          target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                                          </blockquote>
                                                          <br>
_______________________________________________<br>
                                                          Gluster-users
                                                          mailing list<br>
                                                          <a
                                                          moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                                          <a
                                                          moz-do-not-send="true"
href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users"
                                                          target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                                        </div>
                                                      </div>
                                                    </blockquote>
                                                  </div>
                                                  <br>
                                                  <br clear="all">
                                                  <div><br>
                                                  </div>
                                                  -- <br>
                                                  Thanks &amp; Regards<br>
                                                  Shylesh Kumar M<br>
                                                  &nbsp;<br>
                                                </div>
                                              </blockquote>
                                              <br>
                                            </div>
                                          </div>
                                        </div>
                                        <br>
_______________________________________________<br>
                                        Gluster-users mailing list<br>
                                        <a moz-do-not-send="true"
                                          href="mailto:Gluster-users@gluster.org"
                                          target="_blank">Gluster-users@gluster.org</a><br>
                                        <a moz-do-not-send="true"
                                          href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users"
                                          target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                        <br>
                                      </blockquote>
                                    </div>
                                    <br>
                                  </div>
                                </blockquote>
                                <br>
                              </div>
                            </div>
                          </div>
                        </blockquote>
                      </div>
                      <br>
                    </div>
                  </blockquote>
                  <br>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
  </body>
</html>