<div dir="ltr"><div>I forgot to include the versions of the code I am using:<br>fuse-2.8.3-4.el6.x86_64<br>glusterfs-libs-3.4.2-1.el6.x86_64<br>glusterfs-server-3.4.2-1.el6.x86_64<br>glusterfs-3.4.2-1.el6.x86_64<br>glusterfs-fuse-3.4.2-1.el6.x86_64<br>
fuse-libs-2.8.3-4.el6.x86_64<br>glusterfs-cli-3.4.2-1.el6.x86_64<br><br><br></div>Thanks in advance for any ideas on the subject.<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, Feb 25, 2014 at 6:15 PM, Lance Reed <span dir="ltr"><<a href="mailto:reed.r.lance@gmail.com" target="_blank">reed.r.lance@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div><div><div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">I am attempting to setup encrypted user home directories via eCryptfs using gluster as a backend.<br>
<br></span></div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">Very
simple setup currently has a small two node gluster cluster mounted by a
separate client. Normal gluster client and NFS mount / file options
are working fine. <br></span></div><div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><br>
</span><br><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">e.g. <a href="https://wiki.archlinux.org/index.php/ECryptfs#Encrypting_a_home_directory" target="_blank">https://wiki.archlinux.org/index.php/ECryptfs#Encrypting_a_home_directory</a><br>
<br></span></span></div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">In my attempts lay </span><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">ecryptfs
on top of the mounted native gluster setup, I am unable to edit a file,
write etc. I either get zero length or fixed sizes.<br><br></span></div><div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">Only log messages I get are:<br>
"Either
the lower file is not in a valid eCryptfs format, or the key could not
be retrieved. Plaintext passthrough mode is not enabled; returning -EIO"</span><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><br>
<br></span></span></div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">I am posting in this forum to see if anyone knows of any reason why this may be failing from the Glusterfs side.<br>
</span></span></div><div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><br>
</span></span></div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">I am trying Centos / RHEL. <br>
</span></span></div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">See these bugs:<br>
Bug 762976 - (GLUSTER-1244) ecryptfs does not work when the directory to be encrypted is on gluster mount<br><a href="https://bugzilla.redhat.com/show_bug.cgi?id=762976" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=762976</a><br>
</span></span><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="color:rgb(0,0,0);font-family:'DejaVu Sans','Liberation Sans',sans-serif;font-size:16px;font-style:normal;font-variant:normal;font-weight:bold;letter-spacing:normal;line-height:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(208,208,208);display:inline!important;float:none"><br>
</span>A non-empty file created on glusterfs with ecryptfs reports as a file of size zero<br><a href="https://bugzilla.redhat.com/show_bug.cgi?id=989702#c1" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=989702#c1</a><br>
</span></span><div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><br>
</span></span></div><div><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:start;font-style:normal;display:inline!important;font-weight:normal;float:none;line-height:normal;color:rgb(34,34,34);text-transform:none;font-size:small;white-space:normal;font-family:arial;word-spacing:0px">These look to be issues with </span></span>O_DIRECT usage in fuse.<br>
</div><div>I was hoping someone might have an idea or remember some of
this to help me figure out if using glusterfs for a backend with
eCryptfs is even an option.<br><br></div><div>Is it possible that this bug is still the core problem?<br>
"ecryptfs does not work properly over nfs, cifs, samba, WebDAV, or aufs"<br><a href="https://bugs.launchpad.net/ecryptfs/+bug/277578" target="_blank">https://bugs.launchpad.net/ecryptfs/+bug/277578</a><br></div>
<div>It is old but still seems to be open..<br>
</div><div><br></div>Thanks very much in advance for any ideas on the problem.</div>
</blockquote></div><br></div>