<div dir="ltr">the volume is distributed (replication = 1)<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Jan 27, 2014 at 4:01 PM, Mingfan Lu <span dir="ltr"><<a href="mailto:mingfan.lu@gmail.com" target="_blank">mingfan.lu@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>One of our client (3.3.0.5) crashed when writing data, the log is: <br><br>pending frames:</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(LOOKUP)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(READ)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div>frame : type(1) op(WRITE)</div>
<div> </div>
<div>patchset: git://<a href="http://git.gluster.com/glusterfs.git" target="_blank">git.gluster.com/glusterfs.git</a></div>
<div>signal received: 6</div>
<div>time of crash: 2014-01-27 15:36:32</div>
<div>configuration details:</div>
<div>argp 1</div>
<div>backtrace 1</div>
<div>dlfcn 1</div>
<div>fdatasync 1</div>
<div>libpthread 1</div>
<div>llistxattr 1</div>
<div>setfsid 1</div>
<div>spinlock 1</div>
<div>epoll.h 1</div>
<div>xattr.h 1</div>
<div>st_atim.tv_nsec 1</div>
<div>package-string: glusterfs 3.3.0.5rhs</div>
<div>/lib64/libc.so.6[0x32c5a32920]</div>
<div>/lib64/libc.so.6(gsignal+0x35)[0x32c5a328a5]</div>
<div>/lib64/libc.so.6(abort+0x175)[0x32c5a34085]</div>
<div>/lib64/libc.so.6[0x32c5a707b7]</div>
<div>/lib64/libc.so.6[0x32c5a760e6]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/xlator/performance/write-behind.so(+0x42be)[0x7f79a63012be]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/xlator/performance/write-behind.so(wb_sync_cbk+0xa0)[0x7f79a6307ab0]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/xlator/features/quota.so(quota_writev_cbk+0xed)[0x7f79a651864d]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/xlator/cluster/distribute.so(dht_writev_cbk+0x14f)[0x7f79a6753aaf]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/xlator/protocol/client.so(client3_1_writev_cbk+0x600)[0x7f79a6995340]</div>
<div>/usr/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5)[0x31b020f4f5]</div>
<div>/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x120)[0x31b020fdb0]</div>
<div>/usr/lib64/libgfrpc.so.0(rpc_transport_notify+0x28)[0x31b020aeb8]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/rpc-transport/socket.so(socket_event_poll_in+0x34)[0x7f79a79d4784]</div>
<div>/usr/lib64/glusterfs/3.3.0.5rhs/rpc-transport/socket.so(socket_event_handler+0xc7)[0x7f79a79d4867]</div>
<div>/usr/lib64/libglusterfs.so.0[0x31afe3e4e4]</div>
<div>/usr/sbin/glusterfs(main+0x590)[0x407420]</div>
<div>/lib64/libc.so.6(__libc_start_main+0xfd)[0x32c5a1ecdd]</div>
<div>/usr/sbin/glusterfs[0x404289]</div></div>
</blockquote></div><br></div>