<html><head></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Thanks for your feedback.<div><br></div><div>You can find the logs here.&nbsp;<a href="http://cl.ly/273p0T0E1r2X2C243M2s">http://cl.ly/273p0T0E1r2X2C243M2s</a></div><div><br></div><div><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">gluster&gt; volume info all&nbsp;</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; min-height: 14px; "><br></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Volume Name: gluster_replication</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Type: Distributed-Replicate</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Status: Started</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Number of Bricks: 2 x 2 = 4</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Transport-type: tcp</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Bricks:</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Brick1: 110.1.1.256:/ebs/gluster_2_volume_1</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Brick2: 110.2.2.256:/ebs/gluster_1_volume_1</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Brick3: 110.3.3.256:/ebs/gluster_2_volume_2</div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; ">Brick4: 110.4.4.256:/ebs/gluster_1_volume_2</div></div><div><br><div></div></div></div><div><br></div><div>The error happens when you perform the resize (adding:&nbsp;<span class="Apple-style-span" style="font-size: 12px; ">gluster_2_volume_2 &amp;&nbsp;</span><span class="Apple-style-span" style="font-size: 12px; ">gluster_1_volume_2)</span></div><div>and run the following command at the same time.</div><div><br></div><div><blockquote type="cite"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex; position: static; z-index: auto; "><div style="word-wrap: break-word; "><blockquote style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 40px; border-top-style: none; border-right-style: none; border-bottom-style: none; border-left-style: none; border-width: initial; border-color: initial; padding-top: 0px; padding-right: 0px; padding-bottom: 0px; padding-left: 0px; "><div><div>cp -r rails /gluster/external_copy &amp; cp -r /gluster/original /gluster/internal_copy &amp; rm -rf /gluster/delete</div></div><div></div></blockquote></div></blockquote></div></blockquote></div><div><br></div><div><br></div><div><br></div><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; font: normal normal normal 12px/normal Helvetica; "><span class="Apple-style-span" style="font-size: medium; ">On Sep 8, 2011, at 2:32 AM, Raghavendra Bhat wrote:</span></div></div><div><div><br class="Apple-interchange-newline"><blockquote type="cite">Hi Kazuyoshi Tlacaelel,<br><br>Can you please provide the glusterfs client, glusterfs server and glusterd logs? They will be present in /usr/local/var/log/glusterfs for source installation (if you hace installed with some prefix, then logs will be present in &lt;prefix_path&gt;/var/log/glusterfs). If you have installed from rpm, then logs will be present in /var/log/glusterfs.<br>
<br>Also can you provide the output of gluster volume info &lt;volname&gt;?<br><br>Thanks<br><br>Regards,<br>Raghavendra Bhat<br><br><div class="gmail_quote">On Thu, Sep 8, 2011 at 2:49 AM, Kazuyoshi Tlacaelel <span dir="ltr">&lt;<a href="mailto:kazu.dev@gmail.com">kazu.dev@gmail.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0.8ex; border-left-width: 1px; border-left-color: rgb(204, 204, 204); border-left-style: solid; padding-left: 1ex; position: static; z-index: auto; "><div style="word-wrap:break-word"><div>Two master-servers, one client.</div><div><br><div><b>Client mount point is</b>:&nbsp;<b><font color="#235b21">/gluster</font></b></div>
<div><b>replica is</b>:&nbsp;<b><font color="#235b21">2</font></b></div><div><br></div><div>A&nbsp;<b><font color="#c5471d">testing-directory</font></b>&nbsp;(git repo) with data exists, and is used for testing the following.</div><div>
<br></div><div style="font-size:13px"><b>STEP 1</b></div><div><ul><li>First, we copy the<b>&nbsp;<font color="#c5471d">testing-directory</font></b>&nbsp;to /gluster/original</li><li>Then, we copy the&nbsp;<b><font color="#c5471d">testing-directory</font></b>&nbsp;to /gluster/delete</li>
</ul></div><div style="font-size:13px"><b>STEP 2</b></div><div><ul><li>Copy<font color="#235b21">&nbsp;/gluster/original</font>&nbsp;to&nbsp;<font color="#bb251d">/gluster/internal_copy</font></li><li>Copy&nbsp;<b><font color="#c5471d">testing-directory</font></b>&nbsp;to&nbsp;<font color="#bb251d">/gluster/external_copy</font></li>
<li>Delete&nbsp;<font color="#235b21">/gluster/delete</font></li></ul></div></div><blockquote style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:40px;border-top-style:none;border-right-style:none;border-bottom-style:none;border-left-style:none;border-width:initial;border-color:initial;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px">
<div><div>cp -r rails /gluster/external_copy &amp; cp -r /gluster/original /gluster/internal_copy &amp; rm -rf /gluster/delete</div></div><div><div><br></div></div><div><div>While executing the command above, only the delete part returns an error:</div>
</div><div><div><br></div></div><div><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><b><font color="#bb251d">rm: FATAL: directory `/gluster/delete/activerecord/test/migrations' changed dev/ino</font></b></div>
</div></div><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><br></div></div><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><b>Note</b>: that this corruption only happens while the a new-brick is added to the system.</div>
</div><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">and that that is executed at the same time as&nbsp;<b>STEP 2</b>.</div></div><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
Which purpose is to replicate a live production environment.</div></div></blockquote><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><br></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
<b>RESULT</b></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><br></div></div><blockquote style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:40px;border-top-style:none;border-right-style:none;border-bottom-style:none;border-left-style:none;border-width:initial;border-color:initial;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px">
<div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">I've confirmed that the files within the following directories are consistent:</div></div></blockquote><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
<ul><li>/gluster/original</li><li>/gluster/external_copy</li><li>/gluster/internal_copy</li></ul></div></div><blockquote style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:40px;border-top-style:none;border-right-style:none;border-bottom-style:none;border-left-style:none;border-width:initial;border-color:initial;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px">
<div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">But delete doesn't get deleted, its actually just "<b>partially-deleted</b>".</div></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
then, when everything is done, and a delete is performed manually the directory gets deleted just fine.</div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><br></div></blockquote><span style="font-size:12px"><b>SYSTEM</b></span><br>
<div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">&nbsp;</div></div></div><blockquote style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:40px;border-top-style:none;border-right-style:none;border-bottom-style:none;border-left-style:none;border-width:initial;border-color:initial;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px">
<div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><b>fuse init (API version 7.13)</b><font color="#235b21">&nbsp;Haven't done any gluster-recommended fuse-compilation</font></div>
<div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><b>glusterfs 3.2.3 built on Aug 23 2011 18:54:07&nbsp;</b><font color="#235b21">Error is replicable in this version.</font></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
<b>glusterfs 3.1.2 built on Jan 18 2011 11:19:54<font color="#235b21">&nbsp;</font></b><font color="#235b21">Error is replicable in this version.</font></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
<b>Ubuntu 10.4 64bit&nbsp;</b><font color="#235b21">All tests were performed in this machines.</font></div><div><font color="#235b21"><br></font></div></div></div></blockquote><div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px">
</div></div></div><br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br>
<br></blockquote></div><br>
</blockquote></div><br></div></body></html>