<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN">
<html><body style='font-family: Verdana,Geneva,sans-serif'>
<p>Hi, I just started using Gluster today to build a new fileserver, and so far I'm impressed with the ease of set-up and configuration. <br /><br />However, my cluster appears to be working normally, yet no updates are made on the actual filesystem. I change files on one node, and nothing shows up on the other. <br /><br />Since I'm new to this, I don't know what kind of troubleshooting steps to take yet, but I've executed a few commands on the gluster cli:<br /><br /></p>
<p> </p>
<p>root@nfs1:/nfs# gluster volume profile nfspool info<br />Brick: nfs1:/nfs<br />----------------<br />Cumulative Stats:<br /> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop<br /> --------- ----------- ----------- ----------- ------------ ----<br /> 7.32 30.00 us 30.00 us 30.00 us 1 GETXATTR<br /> 18.54 38.00 us 25.00 us 51.00 us 2 STATFS<br /> 74.15 76.00 us 61.00 us 94.00 us 4 LOOKUP<br /> <br /> Duration: 7663 seconds<br /> Data Read: 0 bytes<br />Data Written: 0 bytes<br /> <br />Interval 0 Stats:<br /> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop<br /> --------- ----------- ----------- ----------- ------------ ----<br /> 7.32 30.00 us 30.00 us 30.00 us 1 GETXATTR<br /> 18.54 38.00 us 25.00 us 51.00 us 2 STATFS<br /> 74.15 76.00 us 61.00 us 94.00 us 4 LOOKUP<br /> <br /> Duration: 7663 seconds<br /> Data Read: 0 bytes<br />Data Written: 0 bytes<br /> <br />Brick: nfs2:/nfs<br />----------------<br />Cumulative Stats:<br /> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop<br /> --------- ----------- ----------- ----------- ------------ ----<br /> 7.11 31.00 us 31.00 us 31.00 us 1 GETXATTR<br /> 20.64 45.00 us 42.00 us 48.00 us 2 STATFS<br /> 72.25 78.75 us 64.00 us 91.00 us 4 LOOKUP<br /> <br /> Duration: 7661 seconds<br /> Data Read: 0 bytes<br />Data Written: 0 bytes<br /> <br />Interval 0 Stats:<br /> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop<br /> --------- ----------- ----------- ----------- ------------ ----<br /> 7.11 31.00 us 31.00 us 31.00 us 1 GETXATTR<br /> 20.64 45.00 us 42.00 us 48.00 us 2 STATFS<br /> 72.25 78.75 us 64.00 us 91.00 us 4 LOOKUP<br /> <br /> Duration: 7661 seconds<br /> Data Read: 0 bytes<br />Data Written: 0 bytes<br /> <br />root@nfs1:/nfs# gluster volume status<br />Status of volume: nfspool<br />Gluster process Port Online Pid<br />------------------------------------------------------------------------------<br />Brick nfs1:/nfs 49152 Y 2318<br />Brick nfs2:/nfs 49152 Y 1833<br />NFS Server on localhost 2049 Y 2882<br />Self-heal Daemon on localhost N/A Y 2335<br />NFS Server on nfs2 2049 Y 1985<br />Self-heal Daemon on nfs2 N/A Y 1953<br /> <br />There are no active volume tasks<br /><br /></p>
<p>gluster> peer probe nfs2<br />peer probe: success: host nfs2 port 24007 already in peer list<br />gluster> peer status <br />Number of Peers: 1</p>
<p>Hostname: nfs2<br />Uuid: ab13df7b-d7e7-46c9-8c43-c347b68a2a08<br />State: Peer in Cluster (Connected)<br />gluster> peer status nfs2<br />Usage: peer status<br />gluster> peer status<br />Number of Peers: 1</p>
<p>Hostname: nfs2<br />Uuid: ab13df7b-d7e7-46c9-8c43-c347b68a2a08<br />State: Peer in Cluster (Connected)<br />gluster> volume list<br />nfspool<br />gluster> volume sync<br />Usage: volume sync <HOSTNAME> [all|<VOLNAME>]<br />gluster> volume sync nfs2 all<br />Sync volume may make data inaccessible while the sync is in progress. Do you want to continue? (y/n) y<br />volume sync: success<br /><br />To me, this looks like everything is working and normal. I can probe each peer from each other peer, and pings work as well. This tells me there shouldn't be any split-brain condition either. Yet:<br /><br /></p>
<p>root@nfs1:/nfs# ls<br />file1 file12 file15 file18 file20 file23 file3 file6 file9<br />file10 file13 file16 file19 file21 file24 file4 file7 lost+found<br />file11 file14 file17 file2 file22 file25 file5 file8<br /><br />and on the other node:<br /><span style="font-family: 'Lucida Grande', Verdana, Arial, Helvetica, sans-serif;"></span></p>
<p><span style="font-family: 'Lucida Grande', Verdana, Arial, Helvetica, sans-serif;">root@nfs2:/nfs# ls<br /></span><span style="font-family: 'Lucida Grande', Verdana, Arial, Helvetica, sans-serif;">foo lost+found</span></p>
<div> </div>
</body></html>