<table cellspacing="0" cellpadding="0" border="0"><tr><td valign="top"><div>Hi,<br /><br />Yes, they do, and considerably. I'd forgotten to mention that on my last email. Their mtimes, however, as far as i could tell on separate servers, seemed to coincide. <br /><br />Thanks,<br />Anirban</div></td></tr></table> <div id="_origMsg_">
<div>
<br />
<div>
<div style="font-size:0.9em">
<hr size="1">
<b>
<span style="font-weight:bold">From:</span>
</b>
Pranith Kumar Karampuri <pkarampu@redhat.com>; <br>
<b>
<span style="font-weight:bold">To:</span>
</b>
Anirban Ghoshal <chalcogen_eg_oxygen@yahoo.com>; gluster-users@gluster.org <gluster-users@gluster.org>; <br>
<b>
<span style="font-weight:bold">Subject:</span>
</b>
Re: [Gluster-users] Split-brain seen with [0 0] pending matrix and io-cache page errors <br>
<b>
<span style="font-weight:bold">Sent:</span>
</b>
Sat, Oct 18, 2014 12:26:08 AM <br>
</div>
<br>
<table cellspacing="0" cellpadding="0" border="0">
<tbody>
<tr>
<td valign="top">
hi,<br clear="none">
Could you see if the size of the file mismatches?<br clear="none">
<br clear="none">
Pranith<br clear="none">
<br clear="none">
<div class="yqt8170167658" id="yqt92241"><div class="moz-cite-prefix">On 10/18/2014 04:20 AM, Anirban Ghoshal
wrote:<br clear="none">
</div>
<blockquote type="cite">
<div style="color:#000;background-color:#fff;font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:13px;">
<div class="" style="">Hi everyone,</div>
<div class="" style=""><br clear="none" class="" style="">
</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;">I
have this really confusing split-brain here that's bothering
me. I am running glusterfs 3.4.2 over linux 2.6.34. I have a
replica 2 volume 'testvol' that is It seems I cannot
read/stat/edit the file in question, and `gluster volume heal
testvol info split-brain` shows nothing. Here are the logs
from the fuse-mount for the volume:</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;"><br clear="none" class="" style="">
</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;"><font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:53:02.867111] W
[fuse-bridge.c:1172:fuse_err_cbk] 0-glusterfs-fuse: 4560969:
FLUSH() ERR => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.007799] W
[page.c:991:__ioc_page_error] 0-testvol-io-cache: page error
for page = 0x7fd5c8529d20 & waitq = 0x7fd5c8067d40 </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.007854] W
[fuse-bridge.c:2089:fuse_readv_cbk] 0-glusterfs-fuse:
4561103: READ => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008018] W
[page.c:991:__ioc_page_error] 0-testvol-io-cache: page error
for page = 0x7fd5c8607ee0 & waitq = 0x7fd5c8067d40 </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008056] W
[fuse-bridge.c:2089:fuse_readv_cbk] 0-glusterfs-fuse:
4561104: READ => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008233] W
[page.c:991:__ioc_page_error] 0-testvol-io-cache: page error
for page = 0x7fd5c8066f30 & waitq = 0x7fd5c8067d40 </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008269] W
[fuse-bridge.c:2089:fuse_readv_cbk] 0-glusterfs-fuse:
4561105: READ => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008800] W
[page.c:991:__ioc_page_error] 0-testvol-io-cache: page error
for page = 0x7fd5c860bcf0 & waitq = 0x7fd5c863b1f0 </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.008839] W
[fuse-bridge.c:2089:fuse_readv_cbk] 0-glusterfs-fuse:
4561107: READ => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.009365] W
[page.c:991:__ioc_page_error] 0-testvol-io-cache: page error
for page = 0x7fd5c85fd120 & waitq = 0x7fd5c8067d40 </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.009413] W
[fuse-bridge.c:2089:fuse_readv_cbk] 0-glusterfs-fuse:
4561109: READ => -1 (Input/output error) </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.040549] W
[afr-open.c:213:afr_open] 0-testvol-replicate-0: failed to
open as split brain seen, returning EIO </font><br clear="none" class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">
<font class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;">[2014-09-29 07:54:16.040594] W
[fuse-bridge.c:915:fuse_fd_cbk] 0-glusterfs-fuse: 4561142:
OPEN()
/SECLOG/20140908.d/SECLOG_00000000000000427425_00000000000000000000.log
=> -1 (Input/output error)</font><br clear="none" class="" style="">
</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;"><br clear="none" class="" style="">
</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-style:normal;background-color:transparent;"><span style="font-family:verdana, helvetica, sans-serif;">Could
somebody please give me some clue on where to begin? I
checked the xattrs on <span class="">/SECLOG/20140908.d/SECLOG_00000000000000427425_00000000000000000000.log
and it seems the changelogs are [0, 0] on both replicas,
and the gfid's match.</span></span></div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-style:normal;font-family:verdana, helvetica, sans-serif;background-color:transparent;"><span style="font-family:verdana, helvetica, sans-serif;"><span class=""><br clear="none">
</span></span></div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-style:normal;font-family:verdana, helvetica, sans-serif;background-color:transparent;"><span style="font-family:verdana, helvetica, sans-serif;"><span class="">Thank you very much for any help on this.</span></span></div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-style:normal;font-family:verdana, helvetica, sans-serif;background-color:transparent;"><span style="font-family:verdana, helvetica, sans-serif;"><span class="">Anirban</span></span></div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:Verdana, Arial, Helvetica, sans-serif;font-style:normal;background-color:transparent;"><span class="" style="font-family:Verdana, Arial, Helvetica, sans-serif;"><br clear="none">
</span></div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;"><br clear="none" class="" style="">
</div>
<div class="" style="color:rgb(0, 0, 0);font-size:13px;font-family:'Courier New', courier, monaco, monospace, sans-serif;font-style:normal;background-color:transparent;"><br clear="none" class="" style="">
</div>
</div>
<br clear="none">
<fieldset class="mimeAttachmentHeader"></fieldset>
<br clear="none">
<pre>_______________________________________________
Gluster-users mailing list
<a rel="nofollow" shape="rect" class="moz-txt-link-abbreviated" ymailto="mailto:Gluster-users@gluster.org" target="_blank" href="javascript:return">Gluster-users@gluster.org</a>
<a rel="nofollow" shape="rect" class="moz-txt-link-freetext" target="_blank" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote></div>
<br clear="none">
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>