I saw two deb file on <a href="http://gluster.org">gluster.org</a>! did you use the one with rdma support? cause i saw some strange &quot;no such file ...&quot; in your log file &quot;<span class="Apple-style-span" style="font-family:monospace;white-space:pre-wrap;font-size:medium">/usr/lib/glusterfs/3.2.5/rpc-transport/rdma.so: cannot open shared object file: No such file or directory&quot;?</span><div>

<b>Xavier Normand</b><br>Administrateur Système<br>De Marque inc.<br>418 658-1910 #229<br>
<br><br><div class="gmail_quote">On Fri, Mar 9, 2012 at 11:23 AM, Brian Cipriano <span dir="ltr">&lt;<a href="mailto:bcipriano@zerovfx.com">bcipriano@zerovfx.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">


  
    
  
  <div bgcolor="#FFFFFF" text="#000000">
    Strange! Our procedures are almost exactly the same.<br>
    <br>
    I did use the .deb file from <a href="http://gluster.org" target="_blank">gluster.org</a>.<br>
    <br>
    The only possible difference is that my bricks are mounted
    differently. My bricks are mounted within /gluster:<br>
    <br>
    /gluster/brick0001<br>
    /gluster/brick0002<br>
    <br>
    and so on.<div class="im"><br>
    <br>
    - brian<br>
    <br>
    On 3/9/12 11:19 AM, Xavier Normand wrote:
    </div><div><div class="h5"><blockquote type="cite">Hi Brian,
      <div><br>
      </div>
      <div>i replicate you setup and try to rebalance. I didn&#39;t have any
        of your issue.</div>
      <div><br>
      </div>
      <div>There is what i did:</div>
      <div><br>
      </div>
      <div>1. Install a Ubuntu 10.04 LTS 64Bit</div>
      <div>2. Install GlusterFS using the .deb file</div>
      <div>3. Add two drive two 1TB each format in ext4 mount on /data1
        &amp; /data2</div>
      <div>4. Create a volume in glusterfs [ volume create data
        transport tcp glustertest:/data1 ]</div>
      <div>5. Start the volume et mount it on the same server on /media</div>
      <div>6. Copy a bunch on file on it.</div>
      <div>7. Add the other drive in the volume [ volume add-brick data
        glustertest:/data2 ]</div>
      <div>8. Rebalance [ volume rebalance data start ]</div>
      <div><br>
      </div>
      <div>Are you using the .deb file on <a href="http://gluster.org" target="_blank">gluster.org</a>?</div>
      <div><br clear="all">
        <b>Xavier</b><br>
        <br>
        <br>
        <div class="gmail_quote">On Fri, Mar 9, 2012 at 10:57 AM, Brian
          Cipriano <span dir="ltr">&lt;<a href="mailto:bcipriano@zerovfx.com" target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div bgcolor="#FFFFFF" text="#000000"> 10.04 LTS, 64-bit.
              <div>
                <div><br>
                  <br>
                  On 3/9/12 10:57 AM, Xavier Normand wrote:
                  <blockquote type="cite">What version of Ubuntu are you
                    using? LTS? 32 or 64 bits?
                    <div><br clear="all">
                      <b>Xavier Normand</b><br>
                      Administrateur Système<br>
                      De Marque inc.<br>
                      <a href="tel:418%20658-1910%20%23229" value="+14186581910" target="_blank">418
                        658-1910 #229</a><br>
                      <br>
                      <br>
                      <div class="gmail_quote">On Fri, Mar 9, 2012 at
                        10:30 AM, Brian Cipriano <span dir="ltr">&lt;<a href="mailto:bcipriano@zerovfx.com" target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
                        wrote:<br>
                        <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                          <div bgcolor="#FFFFFF" text="#000000"> Sure
                            thing. I believe these are them.<br>
                            <br>
                            The volume in question is called &quot;west&quot;.<span><font color="#888888"><br>
                                <br>
                                - brian</font></span>
                            <div>
                              <div><br>
                                <br>
                                On 3/9/12 10:27 AM, shylesh kumar wrote:
                                <blockquote type="cite">Hi Brian,
                                  <div><br>
                                  </div>
                                  <div>Could you please provide the
                                    rebalance and glusterd logs, that
                                    would help in debugging the problem.</div>
                                  <div><br>
                                  </div>
                                  <div><br>
                                  </div>
                                  <div>Thanks,</div>
                                  <div>Shylesh</div>
                                  <div><br>
                                  </div>
                                  <div><br>
                                  </div>
                                  <div><br>
                                    <br>
                                    <div class="gmail_quote">On Fri, Mar
                                      9, 2012 at 8:52 PM, Brian Cipriano
                                      <span dir="ltr">&lt;<a href="mailto:bcipriano@zerovfx.com" target="_blank">bcipriano@zerovfx.com</a>&gt;</span>
                                      wrote:<br>
                                      <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> I&#39;ve
                                        just confirmed that the same is
                                        happening on a totally different
                                        Ubuntu machine. Doesn&#39;t seem to
                                        be confined to the machine.<br>
                                        <br>
                                        Could maybe be something I&#39;m
                                        missing in the setup though?
                                        Some package I haven&#39;t
                                        installed?<span><font color="#888888"><br>
                                            <br>
                                            - brian</font></span>
                                        <div>
                                          <div><br>
                                            <br>
                                            On 3/9/12 9:59 AM, Brian
                                            Cipriano wrote:<br>
                                            <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                              Hi Shylesh - thanks for
                                              the reply.<br>
                                              <br>
                                              I&#39;ve restarted a few times
                                              - glusterd, the volume,
                                              the machine itself. Same
                                              results.<br>
                                              <br>
                                              - brian<br>
                                              <br>
                                              On 3/9/12 12:46 AM,
                                              Shylesh Kumar Mohan wrote:<br>
                                              <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
                                                Hi Brian,<br>
                                                <br>
                                                Could you please restart
                                                glusterd and try again
                                                rebalancing.<br>
                                                <br>
                                                <br>
                                                <br>
                                                Thanks,<br>
                                                Shylesh<br>
                                                <br>
                                                ----- Original Message
                                                -----<br>
                                                From: Brian Cipriano&lt;<a href="mailto:bcipriano@zerovfx.com" target="_blank">bcipriano@zerovfx.com</a>&gt;<br>
                                                To: <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
                                                Sent: Thu, 08 Mar 2012
                                                18:08:22 -0500 (EST)<br>
                                                Subject: [Gluster-users]
                                                trouble rebalancing
                                                volume<br>
                                                <br>
                                                Hi all -<br>
                                                <br>
                                                I&#39;m having issues
                                                rebalancing my
                                                layout/data across a
                                                two-brick volume.<br>
                                                I&#39;m on Gluster 3.2.5.<br>
                                                <br>
                                                I&#39;m currently using a
                                                single Ubuntu 10.04
                                                machine. Both bricks
                                                reside on<br>
                                                this machine. Adding the
                                                brick went fine. Here&#39;s
                                                the volume&#39;s info:<br>
                                                <br>
                                                $ sudo gluster volume
                                                info<br>
                                                Volume Name: branch<br>
                                                Type: Distribute<br>
                                                Status: Started<br>
                                                Number of Bricks: 2<br>
                                                Transport-type: tcp<br>
                                                Bricks:<br>
                                                Brick1:
                                                system01:/gluster/brick0001<br>
                                                Brick2:
                                                system01:/gluster/brick0002<br>
                                                <br>
                                                brick0001 has a bunch of
                                                files on it, brick0002
                                                is empty. I&#39;d like to<br>
                                                rebalance the directory
                                                layout and data onto the
                                                new brick. But strange<br>
                                                things happen when I try
                                                to do this.<br>
                                                <br>
                                                $ sudo gluster volume
                                                rebalance branch
                                                fix-layout status<br>
                                                rebalance stopped<br>
                                                $ sudo gluster volume
                                                rebalance branch
                                                fix-layout start<br>
                                                Rebalance on branch is
                                                already started<br>
                                                $ sudo gluster volume
                                                rebalance branch
                                                fix-layout status<br>
                                                rebalance stopped<br>
                                                <br>
                                                Weird! I can&#39;t seem to
                                                get this to work.<br>
                                                <br>
                                                Am I doing some wrong,
                                                or is this some other
                                                issue?<br>
                                                <br>
                                                Thanks!<br>
                                                <br>
                                                - brian<br>
_______________________________________________<br>
                                                Gluster-users mailing
                                                list<br>
                                                <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                                <a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                                <br>
                                              </blockquote>
                                              <br>
_______________________________________________<br>
                                              Gluster-users mailing list<br>
                                              <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                              <a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                            </blockquote>
                                            <br>
_______________________________________________<br>
                                            Gluster-users mailing list<br>
                                            <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                                            <a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                                          </div>
                                        </div>
                                      </blockquote>
                                    </div>
                                    <br>
                                    <br clear="all">
                                    <div><br>
                                    </div>
                                    -- <br>
                                    Thanks &amp; Regards<br>
                                    Shylesh Kumar M<br>
                                     <br>
                                  </div>
                                </blockquote>
                                <br>
                              </div>
                            </div>
                          </div>
                          <br>
_______________________________________________<br>
                          Gluster-users mailing list<br>
                          <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
                          <a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
                          <br>
                        </blockquote>
                      </div>
                      <br>
                    </div>
                  </blockquote>
                  <br>
                </div>
              </div>
            </div>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <br>
  </div></div></div>

</blockquote></div><br></div>