<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi All,<br>
<br>
I retested this on Gluster 3.4.2. The problem reoccured.<br>
It doesn't show the "Structure needs cleaning" message, but just a
message that the file doesn't exists.<br>
<br>
I updated the bug with the usecase I used to reproduce it.<br>
<a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=1041109">https://bugzilla.redhat.com/show_bug.cgi?id=1041109</a><br>
<br>
Thanks for taking a look at it and hopefully fixing it.<br>
<br>
Greetings<br>
Johan Huysmans<br>
<br>
<div class="moz-cite-prefix">On 12-12-13 22:38, Anand Avati wrote:<br>
</div>
<blockquote
cite="mid:CAFboF2zNOFFbuM9_ayrw6Wv+DdXVOr+D=9Az0cxNx+gHiPEpaw@mail.gmail.com"
type="cite">
<div dir="ltr">Looks like your issue was fixed by patch <a
moz-do-not-send="true" href="http://review.gluster.org/4989/">http://review.gluster.org/4989/</a>
in master branch. Backporting this to release-3.4 now.
<div><br>
</div>
<div>Thanks!</div>
<div>
Avati</div>
</div>
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Thu, Dec 12, 2013 at 1:26 PM, Anand
Avati <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:avati@gluster.org" target="_blank">avati@gluster.org</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">I have the same question. Do you have
excessively high --entry-timeout parameter to your FUSE
mount? In any case, "Structure needs cleaning" error
should not surface up to FUSE and that is still a bug.</div>
<div class="HOEnZb">
<div class="h5">
<div class="gmail_extra"><br>
<br>
<div class="gmail_quote">On Thu, Dec 12, 2013 at 12:46
PM, Maik Kulbe <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:info@linux-web-development.de"
target="_blank">info@linux-web-development.de</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">How
do you mount your Client? FUSE? I had similar
problems when playing around with the timeout
options for the FUSE mount. If they are too high
they cache the metadata for too long. When you
move the file the inode should stay the same and
on the second node the path should stay in cache
for a while so it still knows the inode for that
moved files old path thus can act on the file
without knowing it's path.<br>
<br>
The problems kick in when you delete a file and
recreate it - the cache tries to access the old
inode, which was deleted, thus throwing errors. If
I recall correctly the "structure needs cleaning"
is one of two error messages I got, depending on
which of the timeout mount options was set to a
higher value.<br>
<br>
-----Original Mail-----<br>
From: Johan Huysmans [<a moz-do-not-send="true"
href="mailto:johan.huysmans@inuits.be"
target="_blank">johan.huysmans@inuits.be</a>]<br>
Sent: 12.12.13 - 14:51:35<br>
To: <a moz-do-not-send="true"
href="mailto:gluster-users@gluster.org"
target="_blank">gluster-users@gluster.org</a> [<a
moz-do-not-send="true"
href="mailto:gluster-users@gluster.org"
target="_blank">gluster-users@gluster.org</a>]<br>
<br>
Subject: Re: [Gluster-users] Structure needs
cleaning on some files
<div>
<div><br>
<br>
<blockquote class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px
#ccc solid;padding-left:1ex">
I created a bug for this issue:<br>
<br>
<a moz-do-not-send="true"
href="https://bugzilla.redhat.com/show_bug.cgi?id=1041109"
target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1041109</a><br>
<br>
gr.<br>
Johan<br>
<br>
On 10-12-13 12:52, Johan Huysmans wrote:<br>
<br>
Hi All,<br>
<br>
It seems I can easily reproduce the problem.<br>
<br>
* on node 1 create a file (touch , cat ,
...).<br>
* on node 2 take md5sum of direct file
(md5sum /path/to/file)<br>
* on node 1 move file to other name (mv file
file1)<br>
* on node 2 take md5sum of direct file
(md5sum /path/to/file), this is<br>
still working although the file is not
really there<br>
* on node 1 change file content<br>
* on node 2 take md5sum of direct file
(md5sum /path/to/file), this is<br>
still working and has a changed md5sum<br>
<br>
This is really strange behaviour.<br>
Is this normal, can this be altered with a a
setting?<br>
<br>
Thanks for any info,<br>
gr.<br>
Johan<br>
<br>
On 10-12-13 10:02, Johan Huysmans wrote:<br>
<br>
I could reproduce this problem with while my
mount point is running in<br>
debug mode.<br>
logfile is attached.<br>
<br>
gr.<br>
Johan Huysmans<br>
<br>
On 10-12-13 09:30, Johan Huysmans wrote:<br>
<br>
Hi All,<br>
<br>
When reading some files we get this error:<br>
md5sum: /path/to/file.xml: Structure needs
cleaning<br>
<br>
in /var/log/glusterfs/mnt-sharedfs.log we
see these errors:<br>
[2013-12-10 08:07:32.256910] W<br>
[client-rpc-fops.c:526:client3_3_stat_cbk]
1-testvolume-client-0:<br>
remote operation failed: No such file or
directory<br>
[2013-12-10 08:07:32.257436] W<br>
[client-rpc-fops.c:526:client3_3_stat_cbk]
1-testvolume-client-1:<br>
remote operation failed: No such file or
directory<br>
[2013-12-10 08:07:32.259356] W
[fuse-bridge.c:705:fuse_attr_cbk]<br>
0-glusterfs-fuse: 8230: STAT()
/path/to/file.xml => -1 (Structure<br>
needs cleaning)<br>
<br>
We are using gluster 3.4.1-3 on CentOS6.<br>
Our servers are 64-bit, our clients 32-bit
(we are already using<br>
--enable-ino32 on the mountpoint)<br>
<br>
This is my gluster configuration:<br>
Volume Name: testvolume<br>
Type: Replicate<br>
Volume ID: ca9c2f87-5d5b-4439-ac32-b7c138916df7<br>
Status: Started<br>
Number of Bricks: 1 x 2 = 2<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: SRV-1:/gluster/brick1<br>
Brick2: SRV-2:/gluster/brick2<br>
Options Reconfigured:<br>
performance.force-readdirp: on<br>
performance.stat-prefetch: off<br>
network.ping-timeout: 5<br>
<br>
And this is how the applications work:<br>
We have 2 client nodes who both have a
fuse.glusterfs mountpoint.<br>
On 1 client node we have a application which
writes files.<br>
On the other client node we have a
application which reads these<br>
files.<br>
On the node where the files are written we
don't see any problem,<br>
and can read that file without problems.<br>
On the other node we have problems (error
messages above) reading<br>
that file.<br>
The problem occurs when we perform a md5sum
on the exact file, when<br>
perform a md5sum on all files in that
directory there is no problem.<br>
<br>
How can we solve this problem as this is
annoying.<br>
The problem occurs after some time (can be
days), an umount and<br>
mount of the mountpoint solves it for some
days.<br>
Once it occurs (and we don't remount) it
occurs every time.<br>
<br>
I hope someone can help me with this
problems.<br>
<br>
Thanks,<br>
Johan Huysmans<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org"
target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org"
target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org"
target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
</div>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a moz-do-not-send="true"
href="mailto:Gluster-users@gluster.org"
target="_blank">Gluster-users@gluster.org</a><br>
<a moz-do-not-send="true"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users"
target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</body>
</html>