<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
If you change permissions on a 0 length mode 1000 file with
trusted.dht.linkto attributes set, you'll cause all sorts of issues.
If you /need/ to do something with those files, just delete them.<br>
<br>
<div class="moz-cite-prefix">On 08/22/2013 03:53 PM, 符永涛 wrote:<br>
</div>
<blockquote
cite="mid:CADFMGuKmbbs7DLBikhUSvQff3Rww3drS4AJMRPCGJWGeMuyseQ@mail.gmail.com"
type="cite">Sure there's a bug about fd leak during rebalance. It
has been fixed and I have back port it in our production cluster.
About the permission issue I have to run find cmd too. <span></span><br>
<br>
在 2013年8月23日星期五，Justin Dossey 写道：<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I had the same problem after a rebalance (going
from 2 bricks to 6 bricks). It took about a week to get
everything straightened out (and I reported details on what I
did to fix it in this mailing list).
<div>
<br>
</div>
<div>I dread the next rebalance (going from 6 bricks to 8
bricks)! For this rollout, I still have five rebalances
remaining before I can declare the GlusterFS migration
complete.</div>
<div><br>
</div>
<div>To recap, </div>
<div>1. After a rebalance in which one of my nodes (not the
"master", which I initiated the rebalance from) had to be
rebooted due to too many open files on system (caused by the
rebalance), many files appeared to clients to have 000 or
1000 (---------- or T---------) permissions. Many of these
files could not even be chmodded by root over NFS, returning
error 576 when I tried. </div>
<div>2. I found that in many cases, files which had this
problem had entries on more than two bricks (and my replica
count is 2). The entries had different permissions and some
were zero-length files. It appears that different clients
got different entries at different times, so one might see a
file as inaccessible while another could read it without
issues.</div>
<div>3. I wrote a script to remove the zero-length files (and
their .glusterfs shadow links), and set permissions properly
on all the files. Luckily, all the files on my volume have
uniform permissions (files are all 0644, directories are all
0755).</div>
<div>4. I ran a find command every ten minutes to find and
correct bad permissions. The script in (3) didn't appear to
have gotten them all for some reason.</div>
<div>5. No more files have appeared with this problem since
August 6th. I'm still running the find every day.</div>
<div>6. After the permissions problems appeared to be
resolved, I ran a check to verify that all the files present
on the volume before the rebalance were present after the
rebalance. Thankfully, the data appears to have all
survived.</div>
<div><br>
</div>
<div>The only feedback I got on this mailing list was that
nothing was wrong.</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Wed, Aug 21, 2013 at 11:21 PM,
Vijay Bellur <span dir="ltr"><<a moz-do-not-send="true"
href="javascript:_e({}, 'cvml', 'vbellur@redhat.com');"
target="_blank">vbellur@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div>On 08/22/2013 09:12 AM, 符永涛 wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi Joe thank you but the sticky permissions is exposed
to client side<br>
due to potential bug related to glusterfs rebalance.<br>
</blockquote>
<br>
<br>
</div>
Can you please provide output of ls -l that shows these
files after rebalance?<br>
<br>
-Vijay<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
2013/8/20 Joe Julian <<a moz-do-not-send="true"
href="javascript:_e({}, 'cvml',
'joe@julianfamily.org');" target="_blank">joe@julianfamily.org</a>
<mailto:<a moz-do-not-send="true"
href="javascript:_e({}, 'cvml',
'joe@julianfamily.org');" target="_blank">joe@julianfamily.org</a>>>
<div>
<br>
<br>
Sticky pointers are normal. See the extended
attributes on them to<br>
see where they point,<br>
<br>
getfattr -m trusted.* -d $filename<br>
<br>
To diagnose your client issue, look in your client
log.<br>
<br>
<br>
</div>
<div>
"符永涛" <<a moz-do-not-send="true"
href="javascript:_e({}, 'cvml',
'yongtaofu@gmail.com');" target="_blank">yongtaofu@gmail.com</a>
<mailto:<a moz-do-not-send="true"
href="javascript:_e({}, 'cvml',
'yongtaofu@gmail.com');" target="_blank">yongtaofu@gmail.com</a>>>
wrote:<br>
<br>
Dear gluster experts,<br>
<br>
We're running glusterfs 3.3 and we have met
file permission<br>
probelems after gluster volume rebalance.
Files got stick<br>
permissions T--------- after rebalance which
break our client<br>
normal fops unexpectedly.<br>
Any one known this issue?<br>
Thank you for your help.<br>
<br>
<br>
--<br>
Sent from my Android device with K-9 Mail. Please
excuse my brevity.<br>
<br>
<br>
<br>
<br>
--<br>
符永涛<br>
<br>
<br>
</div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true" href="javascript:_e({},
'cvml', 'Gluster-users@gluster.org');" target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
</blockquote>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true" href="javascript:_e({}, 'cvml',
'Gluster-users@gluster.org');" target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
Justin Dossey<br>
CTO, PodOmatic
<div><br>
</div>
</div>
</blockquote>
<br>
<br>
-- <br>
符永涛<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>