<div dir="ltr"><div><font face="courier new, monospace">Looks like the hardlink hidden file are inconsistent, how could I fix this and why it happens?</font></div><div><font face="courier new, monospace"><br></font></div><div>
<font face="courier new, monospace"><b>On machine 1:</b></font></div><div><font face="courier new, monospace"><div>u1@u1-virtual-machine:~$ sudo stat /data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</div>
<div> File: ‘/data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f’</div><div> Size: 79691776 <span class="" style="white-space:pre"> </span>Blocks: 155656 IO Block: 4096 regular file</div>
<div>Device: 811h/2065d<span class="" style="white-space:pre"> </span>Inode: 393231 Links: 2</div><div>Access: (0660/-rw-rw----) Uid: ( 999/ mysql) Gid: ( 1001/ mysql)</div><div>Access: 2014-01-18 23:09:47.567335000 +0800</div>
<div>Modify: 2014-01-18 23:11:48.690740114 +0800</div><div>Change: 2014-01-19 12:12:35.360826648 +0800</div><div> Birth: -</div><div>u1@u1-virtual-machine:~$</div><div>u1@u1-virtual-machine:~$</div><div>u1@u1-virtual-machine:~$</div>
<div>u1@u1-virtual-machine:~$ sudo getfattr -e hex -m . -d /data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</div><div>getfattr: Removing leading '/' from absolute path names</div><div>
# file: data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</div><div>trusted.afr.mysqldata-client-0=0x0000000<b>1</b>0000000000000000</div><div>trusted.afr.mysqldata-client-1=0x0000000<b>1</b>0000000000000000</div>
<div>trusted.gfid=0x0ff1a4e1b14c41d6826be749a4e6ec7f</div></font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace"><b>On machine 2:</b></font></div><div><font face="courier new, monospace"><br>
</font></div><div><font face="courier new, monospace">u1@u2-virtual-machine:/var/lib/glusterd/glustershd$ sudo stat /data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</font></div><div><font face="courier new, monospace"> File: ‘/data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f’</font></div>
<div><font face="courier new, monospace"> Size: 79691776 <span class="" style="white-space:pre"> </span>Blocks: 155656 IO Block: 4096 regular file</font></div><div><font face="courier new, monospace">Device: 811h/2065d<span class="" style="white-space:pre"> </span>Inode: 131087 Links: 2</font></div>
<div><font face="courier new, monospace">Access: (0660/-rw-rw----) Uid: ( 999/ mysql) Gid: ( 1001/ mysql)</font></div><div><font face="courier new, monospace">Access: 2014-01-19 11:38:49.305700766 +0800</font></div>
<div><font face="courier new, monospace">Modify: 2014-01-18 23:11:48.356419703 +0800</font></div><div><font face="courier new, monospace">Change: 2014-01-19 12:12:35.237641763 +0800</font></div><div><font face="courier new, monospace"> Birth: -</font></div>
<div><font face="courier new, monospace">u1@u2-virtual-machine:/var/lib/glusterd/glustershd$ sudo getfattr -e hex -m . -d /data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</font></div><div>
<font face="courier new, monospace">getfattr: Removing leading '/' from absolute path names</font></div><div><font face="courier new, monospace"># file: data/gv0/brick1/mysqldata/.glusterfs/0f/f1/0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f</font></div>
<div><font face="courier new, monospace">trusted.afr.mysqldata-client-0=0x0000000<b>1</b>0000000000000000</font></div><div><font face="courier new, monospace">trusted.afr.mysqldata-client-1=0x0000000<b>1</b>0000000000000000</font></div>
<div><font face="courier new, monospace">trusted.gfid=0x0ff1a4e1b14c41d6826be749a4e6ec7f</font></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">2014/1/18 Yandong Yao <span dir="ltr"><<a href="mailto:yydzero@gmail.com" target="_blank">yydzero@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><font face="courier new, monospace">BTW: This is the output of volume info and status.</font></div>
<div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo gluster volume info</font></div>
<div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Volume Name: mysqldata</font></div><div><font face="courier new, monospace">Type: Replicate</font></div><div><font face="courier new, monospace">Volume ID: 27e6161b-d2d0-4369-8ef0-acf18532af73</font></div>
<div><font face="courier new, monospace">Status: Started</font></div><div><font face="courier new, monospace">Number of Bricks: 1 x 2 = 2</font></div><div><font face="courier new, monospace">Transport-type: tcp</font></div>
<div><font face="courier new, monospace">Bricks:</font></div><div><font face="courier new, monospace">Brick1: 192.168.53.218:/data/gv0/brick1/mysqldata</font></div><div><font face="courier new, monospace">Brick2: 192.168.53.221:/data/gv0/brick1/mysqldata</font></div>
<div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo gluster volume status</font></div><div><font face="courier new, monospace">Status of volume: mysqldata</font></div><div><font face="courier new, monospace">Gluster process<span style="white-space:pre-wrap"> </span>Port<span style="white-space:pre-wrap"> </span>Online<span style="white-space:pre-wrap"> </span>Pid</font></div>
<div><font face="courier new, monospace">------------------------------------------------------------------------------</font></div><div><font face="courier new, monospace">Brick 192.168.53.218:/data/gv0/brick1/mysqldata<span style="white-space:pre-wrap"> </span>49154<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2071</font></div>
<div><font face="courier new, monospace">Brick 192.168.53.221:/data/gv0/brick1/mysqldata<span style="white-space:pre-wrap"> </span>49153<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2170</font></div>
<div><font face="courier new, monospace">NFS Server on localhost<span style="white-space:pre-wrap"> </span>2049<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2066</font></div>
<div><font face="courier new, monospace">Self-heal Daemon on localhost<span style="white-space:pre-wrap"> </span>N/A<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2076</font></div>
<div><font face="courier new, monospace">NFS Server on 192.168.53.221<span style="white-space:pre-wrap"> </span>2049<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2175</font></div>
<div><font face="courier new, monospace">Self-heal Daemon on 192.168.53.221<span style="white-space:pre-wrap"> </span>N/A<span style="white-space:pre-wrap"> </span>Y<span style="white-space:pre-wrap"> </span>2180</font></div>
<div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">There are no active volume tasks</font></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><br><div class="gmail_quote">
2014/1/18 Yandong Yao <span dir="ltr"><<a href="mailto:yydzero@gmail.com" target="_blank">yydzero@gmail.com</a>></span><br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Guys,<div><br></div><div>I am testing glusterfs and have configured replicated volume (replica=2 on two virtual machines), after play with the volume a while, there are un-consistent data reported by 'heal volname info':</div>
<div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo gluster volume heal mysqldata info</font></div><div><font face="courier new, monospace">Gathering Heal info on volume mysqldata has been successful</font></div>
<div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.218:/data/gv0/brick1/mysqldata</font></div><div><font face="courier new, monospace">Number of entries: 1</font></div>
<div><font face="courier new, monospace"><gfid:0ff1a4e1-b14c-41d6-826b-e749a4e6ec7f></font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.221:/data/gv0/brick1/mysqldata</font></div>
<div><font face="courier new, monospace">Number of entries: 1</font></div><div><font face="courier new, monospace">/ibdata1</font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace"><br>
</font></div><div><font face="times new roman, serif"><b>1) What does this means? Why one entry is file itself on one host, while another entry is gfid on another host? </b></font></div><div><font face="courier new, monospace"><br>
</font></div><div><b style="font-family:'times new roman',serif">2) After a while (maybe 2 minutes), re-run heal info, and get following output. What happened behind the scene? Why the entry changes to file from gfid?</b><font face="courier new, monospace"><br>
</font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo gluster volume heal mysqldata info</font></div><div><font face="courier new, monospace">Gathering Heal info on volume mysqldata has been successful</font></div>
<div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.218:/data/gv0/brick1/mysqldata</font></div><div><font face="courier new, monospace">Number of entries: 1</font></div>
<div><font face="courier new, monospace">/ibdata1</font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.221:/data/gv0/brick1/mysqldata</font></div>
<div><font face="courier new, monospace">Number of entries: 1</font></div><div><font face="courier new, monospace">/ibdata1</font></div><div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo gluster volume heal mysqldata info split-brain</font></div>
<div><font face="courier new, monospace">Gathering Heal info on volume mysqldata has been successful</font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.218:/data/gv0/brick1/mysqldata</font></div>
<div><font face="courier new, monospace">Number of entries: 0</font></div><div><font face="courier new, monospace"><br></font></div><div><font face="courier new, monospace">Brick 192.168.53.221:/data/gv0/brick1/mysqldata</font></div>
<div><font face="courier new, monospace">Number of entries: 0</font></div><div><br></div><div><b style="font-family:'times new roman',serif">3) I tried with both heal and heal full, while heal seems not work, I still get above output. How could I heal this case manually? Following is getfattr output.</b><br>
</div><div><b style="font-family:'times new roman',serif"><br></b></div><div><font face="courier new, monospace">u1@u1-virtual-machine:~$ sudo getfattr -e hex -m . -d /data/gv0/brick1/mysqldata/ibdata1</font></div>
<div><font face="courier new, monospace">getfattr: Removing leading '/' from absolute path names</font></div><div><font face="courier new, monospace"># file: data/gv0/brick1/mysqldata/ibdata1</font></div><div><font face="courier new, monospace">trusted.afr.mysqldata-client-0=0x000000010000000000000000</font></div>
<div><font face="courier new, monospace">trusted.afr.mysqldata-client-1=0x000000010000000000000000</font></div><div><font face="courier new, monospace">trusted.gfid=0x0ff1a4e1b14c41d6826be749a4e6ec7f</font></div><div><br>
</div></div><div><br></div><div>Any comments are welcome, and thanks very much in advance!</div><div><br></div><div>Regards,</div><div>Yandong</div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>