<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"><html>
<head>
  <meta name="Generator" content="Zarafa WebAccess v7.1.9-44333">
  <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  <title>RE: [Gluster-users] Expand distributed replicated volume</title>
  <style type="text/css">
      body
      {
        font-family: Arial, Verdana, Sans-Serif ! important;
        font-size: 12px;
        padding: 5px 5px 5px 5px;
        margin: 0px;
        border-style: none;
        background-color: #ffffff;
      }

      p, ul, li
      {
        margin-top: 0px;
        margin-bottom: 0px;
      }
  </style>
</head>
<body>
<p>Hi Lalatendu,</p><p>&nbsp;</p><p>I&#39;ve made the same test.</p><p>I&#39;ve create a volume with 2 nodes sharing a 10G disk, without option &quot;replica 2&quot;</p><p>On the client, the share is 20Go.</p><p>The add a brick, the volume was 30Go.</p><p>&nbsp;</p><p>This scenario works fine.</p><p>&nbsp;</p><p>The problem occure when I want to have replication.</p><p>Running the same scenario with 6 nodes, and adding option &quot;replica 2&quot;, finnaly my volume is 20go with 4 and adding 2 more nodes.</p><p>&nbsp;</p><p>If I create the same volume with the 6 nodes from the begining it OK, but I can&#39;t expand it with nodes 7 &amp; 8 to 40Go , still 30go.</p><p>&nbsp;</p><p>For this test I run Fedora 20 with Gluster 3.5 from Fedora repository.</p><p>&nbsp;</p><p>I do not have this problem with MooseFS, but this solution do not have NFS support.</p><p>&nbsp;</p><p>&nbsp;</p><p>Best regards</p><p>Hugues</p><p><br />&nbsp;</p><blockquote style="border-left: 2px solid #325FBA; padding-left: 5px;margin-left:5px;">-----Message initial-----<br /><strong>De:</strong>        Lalatendu Mohanty &lt;lmohanty@redhat.com&gt;<br /><strong>Envoy&eacute;:</strong>        lun. 05-05-2014 15:10<br /><strong>Sujet:</strong>        Re: [Gluster-users] Expand distributed replicated volume<br /><strong>&Agrave;:</strong>        Hugues Lepesant &lt;hugues@lepesant.com&gt;; gluster-users@gluster.org; <br /><style type="text/css">body { font-family: monospace; }</style>                <div style="background-color: #FFFFFF; color: #000000; "><div>On 05/05/2014 03:08 PM, Hugues Lepesant       wrote:</div>     <blockquote type="cite" cite="mid:zarafa.53675c20.2fbf.49c021277ade2c2c@pe1950.lepesant.com">                            <style type="text/css">       .bodyclass       {         font-family: Arial, Verdana, Sans-Serif ! important;         font-size: 12px;         padding: 5px 5px 5px 5px;         margin: 0px;         border-style: none;         background-color: #ffffff;       }        p, ul, li       {         margin-top: 0px;         margin-bottom: 0px;       }   </style>       <p>Hi all,</p>       <p>&nbsp;</p>       <p>Does someone have already meet this ?</p>       <p>&nbsp;</p>       <p>Best regards,</p>       <p>Hugues</p>     </blockquote>     <br />     I tried the similar steps on two Fedora20 VMs (each with 3 100GB     partition) + gluster 3.5.0, but did not hit this issue. Here are the     steps I performed.<br />     <br />     1. Created a distribute replicate volume (2x2).<br />     2. mounted the volume using native glusterfs mount. &quot;df -h&quot; shows     200GB for the mount point.<br />     3. performed add brick with 2 partitions. The volume info shows 3x2)<br />     4.&nbsp; df -h now shows 300GB for the mount point. <br />     <br />     Thanks,<br />     Lala<br />     <blockquote type="cite" cite="mid:zarafa.53675c20.2fbf.49c021277ade2c2c@pe1950.lepesant.com">       <p>&nbsp;</p>       <blockquote style="border-left: 2px solid #325FBA; padding-left:         5px;margin-left:5px;">-----Message initial-----<br />         <strong>De:</strong> Hugues Lepesant <a title="This external link will open in a new window" target="_blank" onclick="parent.webclient.openWindow(this, &#39;createmail&#39;, &#39;index.php?load=dialog&task=createmail_standard&to=hugues@lepesant.com&#39;); return false;" href="mailto:hugues@lepesant.com">&lt;hugues@lepesant.com&gt;</a><br />         <strong>Envoy&eacute;:</strong> mar. 29-04-2014 11:51<br />         <strong>Sujet:</strong> [Gluster-users] Expand distributed         replicated volume<br />         <strong>&Agrave;:</strong> <a title="This external link will open in a new window" target="_blank" onclick="parent.webclient.openWindow(this, &#39;createmail&#39;, &#39;index.php?load=dialog&task=createmail_standard&to=gluster-users@gluster.org&#39;); return false;" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a>; <br />         <style type="text/css">.bodyclass { font-family: monospace; }</style>         <style type="text/css">       .bodyclass       {         font-family: Arial, Verdana, Sans-Serif ! important;         font-size: 12px;         padding: 5px 5px 5px 5px;         margin: 0px;         border-style: none;         background-color: #ffffff;       }        p, ul, li       {         margin-top: 0px;         margin-bottom: 0px;       }   </style>         <div><p>Hi all,</p>           <p>&nbsp;</p>           <p>I want to create a distributed replicated volume.<br />             And I want to be able to expand this volume.</p>           <p><br />             To test this, I have 6 nodes each have a 10G disk to share.<br />             <br />             First I create the initial volume.<br />             <br />             # gluster volume create testvol replica 2 transport tcp             node-01:/export/sdb1/brick node-02:/export/sdb1/brick             node-03:/export/sdb1/brick node-04:/export/sdb1/brick<br />             <br />             On the client, I mount the volume :<br />             <br />             # mount -t glusterfs node-01:/testvol /storage-pool<br />             # df -h /storage-pool/<br />             Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Size&nbsp; Used Avail Use% Mounted on<br />             node-01:/testvol&nbsp;&nbsp; 20G&nbsp; 3.9G&nbsp;&nbsp; 17G&nbsp; 20% /storage-pool<br />             <br />             The volume size is 20G, what I expect.<br />             <br />             Now I want to expand this volume, adding brick.<br />             <br />             To do so, I do on node-01:<br />             # gluster volume add-brick testvol             node-05:/export/sdb1/brick node-06:/export/sdb1/brick<br />             # gluster volume rebalance testvol start<br />             # gluster volume rebalance testvol status<br />             # gluster volume info testvol<br />             <br />             Volume Name: testvol<br />             Type: Distributed-Replicate<br />             Volume ID: cd24ec0f-3503-4d67-9032-1db1d0987f9c<br />             Status: Started<br />             Number of Bricks: 3 x 2 = 6<br />             Transport-type: tcp<br />             Bricks:<br />             Brick1: node-01:/export/sdb1/brick<br />             Brick2: node-02:/export/sdb1/brick<br />             Brick3: node-03:/export/sdb1/brick<br />             Brick4: node-04:/export/sdb1/brick<br />             Brick5: node-05:/export/sdb1/brick<br />             Brick6: node-06:/export/sdb1/brick<br />             <br />             The back on client :<br />             <br />             # df -h /storage-pool/<br />             Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Size&nbsp; Used Avail Use% Mounted on<br />             node-01:/testvol&nbsp;&nbsp; 20G&nbsp; 2.9G&nbsp;&nbsp; 18G&nbsp; 15% /storage-pool<br />             <br />             Even If I umount/mount the volume, It&#39;s always 20G.<br />             Should it not display a size of 30GB ?<br />             Like if I create a distributed volume and the add-brick with             replicate option<br />             <br />             # gluster volume create testvol transport tcp             node-01:/export/sdb1/brick node-02:/export/sdb1/brick             node-03:/export/sdb1/brick<br />             # gluster volume start testvol<br />             # gluster volume add-brick testvol replica 2             node-04:/export/sdb1/brick node-05:/export/sdb1/brick             node-06:/export/sdb1/brick<br />             # gluster volume info testvol<br />             <br />             Volume Name: testvol<br />             Type: Distributed-Replicate<br />             Volume ID: 31159749-85fb-4006-8240-25b74a7eb537<br />             Status: Started<br />             Number of Bricks: 3 x 2 = 6<br />             Transport-type: tcp<br />             Bricks:<br />             Brick1: node-01:/export/sdb1/brick<br />             Brick2: node-04:/export/sdb1/brick<br />             Brick3: node-02:/export/sdb1/brick<br />             Brick4: node-05:/export/sdb1/brick<br />             Brick5: node-03:/export/sdb1/brick<br />             Brick6: node-06:/export/sdb1/brick<br />             <br />             On client : <br />             # df -h /storage-pool/<br />             Filesystem&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Size&nbsp; Used Avail Use% Mounted on<br />             node-01:/testvol&nbsp;&nbsp; 30G&nbsp;&nbsp; 97M&nbsp;&nbsp; 30G&nbsp;&nbsp; 1% /storage-pool<br />             <br />             I&#39;m using glusterfs-server 3.5.0 on Ubuntu 14.04 Trusty.<br />             <br />             Any help is welcome.<br />             Best regards,<br />             Hugues</p></div>         <pre>
_______________________________________________  Gluster-users mailing list  <a title="This external link will open in a new window" target="_blank" onclick="parent.webclient.openWindow(this, &#39;createmail&#39;, &#39;index.php?load=dialog&task=createmail_standard&to=Gluster-users@gluster.org&#39;); return false;" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>  <a title="This external link will open in a new window" target="_blank" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>       </blockquote>       <br />              <br />       <pre wrap="">
_______________________________________________ Gluster-users mailing list <a title="This external link will open in a new window" target="_blank" onclick="parent.webclient.openWindow(this, &#39;createmail&#39;, &#39;index.php?load=dialog&task=createmail_standard&to=Gluster-users@gluster.org&#39;); return false;" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a> <a title="This external link will open in a new window" target="_blank" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>     </blockquote>     </div>    </blockquote>
</body>
</html>