<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, Sans-Serif;font-size:12pt">Thanks, Harshavardhana, Anand for the tips!<br><br>I checked out parts of the linux-2.6.34 (the one we are using down here) knfsd/fuse code. I understood (hopefully, rightly) that when we export a fuse directory over NFS and specify an fsid, the handle is constructed somewhat like this:<br><br>fh_size (4 bytes) - fh_version and stuff (4 bytes) - fsid, from export parms (4 bytes) - nodeid (8 bytes) - generation number (4 bytes) - parent nodeid (8 bytes) - parent generation (4 bytes).<br><br>So, since Anand mentions that nodeid's for glusterfs are just the inode_t addresses on servers, I can now relate to the fact that the file handles might not even survive failovers in any and every case, even with the fsid constant. <br><br>That's why I was so confused.. I never faced an issue with stale file
handles during failover yet! Maybe something to do with the order in which files were created on the replica server following heal commencement (our data is quite static btw) - like, if you malloc identical things on two identical platforms by running the same executable on each, you get allocations at the exact same virtual addresses...<br><br>However, now that I understand at least in part how this works, Glusterfs NFS does seem a lot cleaner... Will also try out the Ganesha... <br><div style="display: block;" class="yahoo_quoted"> <br> Thanks!<br><br> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, Sans-Serif; font-size: 12pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <font face="Arial" size="2"> On Tuesday, 24 December 2013 11:04 PM, Harshavardhana <harsha@harshavardhana.net> wrote:<br> </font> </div> <div class="y_msg_container">On Tue, Dec
24, 2013 at 8:21 AM, Anirban Ghoshal<div class="yqt1957888473" id="yqtfd69956"><br clear="none"><<a shape="rect" ymailto="mailto:chalcogen_eg_oxygen@yahoo.com" href="mailto:chalcogen_eg_oxygen@yahoo.com">chalcogen_eg_oxygen@yahoo.com</a>> wrote:<br clear="none">> Hi, and Thanks a lot, Anand!<br clear="none">><br clear="none">> I was initially searching for a good answer to why the glusterfs site lists<br clear="none">> knfsd as NOT compatible with the glusterfs. So, now I know. :)<br clear="none">><br clear="none">> Funnily enough, we didn't have a problem with the failover during our<br clear="none">> testing. We passed constant fsid's (fsid=xxx) while exporting our mounts and<br clear="none">> NFS mounts on client applications haven't called any of the file handles out<br clear="none">> stale while migrating the NFS service from one server to the other. Not sure<br clear="none">> why this happpens.</div><br
clear="none"><br clear="none">Using fsid is just a workaround always used to solve ESTALE on file<br clear="none">handles. The device major/minor numbers are embedded in the NFS file<br clear="none">handle, a problem when an NFS export is failed over or moved to<br clear="none">another node during failover is that these numbers change when the<br clear="none">resource is exported on the new node resulting in client to see a<br clear="none">"Stale NFS file handle" error. We need to make sure the embedded<br clear="none">number stays the same that is where the fsid export option - allowing<br clear="none">us to specify a coherent number across various clients.<br clear="none"><br clear="none">GlusterNFS server is way cleaner solution for such consistency.<br clear="none"><br clear="none">Another thing would be to take the next step, give a go for<br clear="none">'NFS-Ganesha' and 'GlusterFS' integration?<br clear="none"><br clear="none"><a shape="rect"
href="https://forge.gluster.org/nfs-ganesha-and-glusterfs-integration" target="_blank">https://forge.gluster.org/nfs-ganesha-and-glusterfs-integration</a><br clear="none"><a shape="rect" href="http://www.gluster.org/2013/09/gluster-ganesha-nfsv4-initial-impressions/" target="_blank">http://www.gluster.org/2013/09/gluster-ganesha-nfsv4-initial-impressions/</a><br clear="none"><br clear="none">Cheers<br clear="none">-- <br clear="none">Religious confuse piety with mere ritual, the virtuous confuse<br clear="none">regulation with outcomes<div class="yqt1957888473" id="yqtfd94455"><br clear="none"></div><br><br></div> </div> </div> </div> </div></body></html>