<div dir="ltr">No, no duplicate UUIDs:<div><br></div><div><div>[root@ox60-gstore01 ~]# gluster peer status |grep -i uuid | uniq -c</div><div> 1 Uuid: 055a13fe-e40a-46ff-9011-6c81832e3ba1</div><div> 1 Uuid: e0c267e6-3dc2-4623-89f1-4516f1285c1a</div>
<div> 1 Uuid: e503bd2e-b2b2-49d4-ae05-45090e24acca</div><div> 1 Uuid: 974a503e-4f0f-44f2-81df-5383c28cdf20</div><div> 1 Uuid: 5517a055-c5f5-41b7-95d2-dedf6900be21</div><div> 1 Uuid: 13cfacc1-65a4-4151-91d5-bc7977e01654</div>
<div> 1 Uuid: a5de08c0-e761-45ee-a7ad-e8c556f2540b</div><div> 1 Uuid: 428e11bc-5a80-41cb-af1d-a9023e2bc11b</div><div> 1 Uuid: 113562a1-e521-4747-ae75-477614ea28cf</div><div> 1 Uuid: 04c6c37b-743d-4f87-9bdc-3dfe1b573709</div>
<div> 1 Uuid: 2225df4c-4510-457c-9958-0b6506ff25e4</div><div> 1 Uuid: 6456206b-fe19-4b65-b7ab-0c9e7ce6221e</div><div> 1 Uuid: 0edce15e-0de2-4496-a520-58c65dbbc7da</div><div> 1 Uuid: a327cd38-f98a-4554-ae62-97a21153f4d3</div>
<div> 1 Uuid: a7d3a064-1bb4-4da0-a680-180db8150e4c</div><div> 1 Uuid: 757297b4-5648-4e31-88f4-00fc167a43e4</div><div> 1 Uuid: 725a2567-b668-4a5f-b2c9-5c7dcc90c846</div><div> 1 Uuid: 303f4cc4-c8ae-42c7-b8cd-eafee8f95122</div>
<div> 1 Uuid: 439f3ffa-e468-4a8b-801e-e2f20062e6f0</div><div> 1 Uuid: cdba3b89-e804-4bf1-afb9-d7c231399955</div></div><div><br></div><div>glusterd (as well as glusterfs and the nfs server, which seemingly never dies if glusterd is shutdown) have all been restarted. Actually, we just went so fas as to bounce one replica then another (reboot). </div>
<div><br></div><div><br></div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr">--<div>Matthew Nicholson<div>Research Computing Specialist</div><div>Harvard FAS Research Computing</div><div><a href="mailto:matthew_nicholson@harvard.edu" target="_blank">matthew_nicholson@harvard.edu</a></div>
<div><br></div></div></div></div>
<br><br><div class="gmail_quote">On Tue, Jun 4, 2013 at 10:30 AM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="HOEnZb"><div class="h5">On 06/04/2013 07:57 PM, Matthew Nicholson wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
So, we've got a volume that is mostly functioning fine (its up<br>
accessible, etc etc). However, volume operations fail/don't return on it.<br>
<br>
<br>
what i mean is<br>
<br>
gluster peer status//probe/etc : works<br>
gluster volume info : works<br>
gluster volume status/remove-brick/etc : sit for a long time and return<br>
nothing.<br>
<br>
The only things coming up in logs are:<br>
<br>
[2013-06-04 10:21:36.398072] I [glusterd-utils.c:285:<u></u>glusterd_lock]<br>
0-glusterd: Cluster lock held by 757297b4-5648-4e31-88f4-<u></u>00fc167a43e4<br>
[2013-06-04 10:21:36.398123] I<br>
[glusterd-handler.c:463:<u></u>glusterd_op_txn_begin] 0-management: Acquired<br>
local lock<br>
[2013-06-04 10:21:36.398424] I<br>
[glusterd-handler.c:502:<u></u>glusterd_handle_cluster_lock] 0-glusterd:<br>
Received LOCK from uuid: 757297b4-5648-4e31-88f4-<u></u>00fc167a43e4<br>
[2013-06-04 10:21:36.398448] E [glusterd-utils.c:277:<u></u>glusterd_lock]<br>
0-glusterd: Unable to get lock for uuid:<br>
757297b4-5648-4e31-88f4-<u></u>00fc167a43e4, lock held by:<br>
757297b4-5648-4e31-88f4-<u></u>00fc167a43e4<br>
[2013-06-04 10:21:36.398483] I<br>
[glusterd-handler.c:1322:<u></u>glusterd_op_lock_send_resp] 0-glusterd:<br>
Responded, ret: 0<br>
[2013-06-04 10:21:36.398498] E [glusterd-op-sm.c:4624:<u></u>glusterd_op_sm]<br>
0-glusterd: handler returned: -1<br>
<br>
If you notice, the UUID holding the lock, and the uuid requesting the<br>
lock, are the same. So it seems like a lock was "forgotten" about?<br>
<br>
any thoughts on clearing this?<br>
</blockquote>
<br></div></div>
Does gluster peer status list the same UUID more than once?<br>
<br>
If not, restarting the glusterd which is the lock owner should address it.<span class="HOEnZb"><font color="#888888"><br>
<br>
-Vijay<br>
<br>
</font></span></blockquote></div><br></div>