<div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, May 20, 2014 at 10:54 PM, Pranith Kumar Karampuri <span dir="ltr"><<a href="mailto:pkarampu@redhat.com" target="_blank">pkarampu@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class=""><br>
<br>
----- Original Message -----<br>
> From: "Anand Avati" <<a href="mailto:avati@gluster.org">avati@gluster.org</a>><br>
> To: "Pranith Kumar Karampuri" <<a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>><br>
</div><div><div class="h5">> Cc: "Edward Shishkin" <<a href="mailto:edward@redhat.com">edward@redhat.com</a>>, "Gluster Devel" <<a href="mailto:gluster-devel@gluster.org">gluster-devel@gluster.org</a>><br>
> Sent: Wednesday, May 21, 2014 10:53:54 AM<br>
> Subject: Re: [Gluster-devel] spurios failures in tests/encryption/crypt.t<br>
><br>
> There are a few suspicious things going on here..<br>
><br>
> On Tue, May 20, 2014 at 10:07 PM, Pranith Kumar Karampuri <<br>
> <a href="mailto:pkarampu@redhat.com">pkarampu@redhat.com</a>> wrote:<br>
><br>
> ><br>
> > > > hi,<br>
> > > > crypt.t is failing regression builds once in a while and most of<br>
> > > > the times it is because of the failures just after the remount in the<br>
> > > > script.<br>
> > > ><br>
> > > > TEST rm -f $M0/testfile-symlink<br>
> > > > TEST rm -f $M0/testfile-link<br>
> > > ><br>
> > > > Both of these are failing with ENOTCONN. I got a chance to look at<br>
> > > > the logs. According to the brick logs, this is what I see:<br>
> > > > [2014-05-17 05:43:43.363979] E [posix.c:2272:posix_open]<br>
> > > > 0-patchy-posix: open on /d/backends/patchy1/testfile-symlink:<br>
> > > > Transport endpoint is not connected<br>
> ><br>
><br>
> posix_open() happening on a symlink? This should NEVER happen. glusterfs<br>
> itself should NEVER EVER by triggering symlink resolution on the server. In<br>
> this case, for whatever reason an open() is attempted on a symlink, and it<br>
> is getting followed back onto gluster's own mount point (test case is<br>
> creating an absolute link).<br>
><br>
> So first find out: who is triggering fop->open() on a symlink. Fix the<br>
> caller.<br>
><br>
> Next: add a check in posix_open() to fail with ELOOP or EINVAL if the inode<br>
> is a symlink.<br>
<br>
</div></div>I think I understood what you are saying. Open call for symlink on fuse mount lead to an open call again for the target on the same fuse mount.</blockquote><div><br></div><div>It's not that simple. The client VFS is intelligent enough to resolve symlinks and send open() only on non-symlinks. And the test case script was doing an obvious unlink() (TEST rm -f <filename>), so it was not initiated by an open() attempt in the first place. My guess is that some xlator (probably crypt?) is doing an open() on an inode and that is going through unchecked in posix. It is a bug in both the caller and posix, but the onus/responsibility is on posix to disallow open() on anything but regular files (even open() on character or block devices should not happen in posix).</div>
<div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> Which lead to deadlock :). That is why we disallow opens on symlink in gluster?<span class="HOEnZb"><font color="#888888"><br>
</font></span></blockquote><div><br></div><div>That's not just why open on symlink is disallowed in gluster, it is a more generic problem of following symlinks in general inside gluster. Symlink resolution must strictly happen only in the outermost VFS. Following symlinks inside the filesystem is not only an invalid operation, but can lead to all kinds of deadlocks, security holes (what if you opened a symlink which points to /etc/passwd, should it show the contents of the client machine's /etc/passwd or the server? Now what if you wrote to the file through the symlink? etc. you get the idea..) and wrong/weird/dangerous behaviors. This is not just related to following symlinks, even open()ing special devices.. e.g if you create a char device file with major/minor number of an audio device and wrote pcm data into it, should it play music on the client machine or in the server machine? etc. The summary is, following symlinks or opening non-regular files is VFS/client operation and are invalid operations in a filesystem context.</div>
<div><br></div></div></div></div>