<div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="line-height: 1.7;">Hi all,</span></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="line-height: 1.7;">We are using glusterfs on a cluster of some servers, connecting with Infiniband.&nbsp;</span></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="line-height: 1.7;">While using rdma, if one of these servers is down, "mount" is fine but commands such as "df" with hang.</span></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">This is the steps to reproduce.</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="line-height: 1.7;">&nbsp;- create a volume of &nbsp;3 bricks with rdma transport, each brick on a different server</span></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">&nbsp;- start the volume</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">&nbsp;- down a brick server</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">&nbsp;- after mount the volume, "df -h" will hang</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">We have tested on glusterfs3.2.5&amp;3.2.7, all have this problem.</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">Thanks for any help.</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="white-space: pre-wrap; line-height: 1.7;">Let me know if there's anything else I can provide!</span></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div>







<div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><span style="line-height: 1.7;">Here is a piece of</span>&nbsp;glusterfs log:</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">......</div><div><div>[2013-10-22 11:07:41.335497] I [client-handshake.c:1090:select_server_supported_programs] 0-hash-01-client-0: Using Program GlusterFS 3.0.0, Num (1298437), Version (310)</div><div>[2013-10-22 11:07:41.335618] I [client-handshake.c:1090:select_server_supported_programs] 0-hash-01-client-2: Using Program GlusterFS 3.0.0, Num (1298437), Version (310)</div><div>[2013-10-22 11:07:41.335995] I [client-handshake.c:913:client_setvolume_cbk] 0-hash-01-client-0: Connected to 192.168.20.107:24013, attached to remote volume '/data/brick1'.</div><div>[2013-10-22 11:07:41.336119] I [client-handshake.c:913:client_setvolume_cbk] 0-hash-01-client-2: Connected to 192.168.20.108:24014, attached to remote volume '/data/brick1'.</div></div><div><div><div>[2013-10-22 11:07:41.591835] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div><div>[2013-10-22 11:07:41.591950] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div><div>[2013-10-22 11:07:41.591996] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div><div>[2013-10-22 11:07:44.592810] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div><div>[2013-10-22 11:07:44.592917] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div><div>[2013-10-22 11:07:44.592963] E [rdma.c:4417:tcp_connect_finish] 0-hash-01-client-1: tcp connect to &nbsp;failed (No route to host)</div></div></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">(loop)</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial">......</div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div><div style="line-height:1.7;color:#000000;font-size:14px;font-family:arial"><br></div></div><br><br><span title="neteasefooter"><span id="netease_mail_footer"></span></span>