<div dir="ltr"><div><div><div>sorry, our customer remounted, so it is possible to get the full backtrace.<br></div>the full version is glusterfs-3.3.0.5rhs_iqiyi_6-1.el6.x86_64<br></div>it is a self-built version.<br><br>The code started from this change.<br>
<br>%changelog<br>* Wed May 9 2012 Kaleb S. KEITHLEY <kkeithle[at]<a href="http://redhat.com">redhat.com</a>><br>- Add BuildRequires: libxml2-devel so that configure will DTRT on for<br>- Fedora's Koji build system<br>
<br></div>with some backports:<br><br>1. backport patch to avoid fd leek during rebalance see <a href="http://review.gluster.org/4888">http://review.gluster.org/4888</a><br><br><div>2. backport <a href="http://review.gluster.org/#/c/4459/">http://review.gluster.org/#/c/4459/</a> to avoid gfid mismatch during concurrent mkdir<br>
<br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Jan 27, 2014 at 6:04 PM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 01/27/2014 01:34 PM, Mingfan Lu wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
the volume is distributed (replication = 1)<br>
</blockquote>
<br>
Is it possible to obtain a full backtrace using gdb?<br>
<br>
Also, what is the complete version string of this glusterfs release?<br>
<br>
Thanks,<br>
Vijay<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
On Mon, Jan 27, 2014 at 4:01 PM, Mingfan Lu <<a href="mailto:mingfan.lu@gmail.com" target="_blank">mingfan.lu@gmail.com</a><br>
<mailto:<a href="mailto:mingfan.lu@gmail.com" target="_blank">mingfan.lu@gmail.com</a>>> wrote:<br>
<br>
One of our client (3.3.0.5) crashed when writing data, the log is:<br>
<br>
pending frames:<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(LOOKUP)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(READ)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
frame : type(1) op(WRITE)<br>
patchset: git://<a href="http://git.gluster.com/glusterfs.git" target="_blank">git.gluster.com/<u></u>glusterfs.git</a><br>
<<a href="http://git.gluster.com/glusterfs.git" target="_blank">http://git.gluster.com/<u></u>glusterfs.git</a>><br>
signal received: 6<br>
time of crash: 2014-01-27 15:36:32<br>
configuration details:<br>
argp 1<br>
backtrace 1<br>
dlfcn 1<br>
fdatasync 1<br>
libpthread 1<br>
llistxattr 1<br>
setfsid 1<br>
spinlock 1<br>
epoll.h 1<br>
xattr.h 1<br>
st_atim.tv_nsec 1<br>
package-string: glusterfs 3.3.0.5rhs<br>
/lib64/libc.so.6[0x32c5a32920]<br>
/lib64/libc.so.6(gsignal+0x35)<u></u>[0x32c5a328a5]<br>
/lib64/libc.so.6(abort+0x175)[<u></u>0x32c5a34085]<br>
/lib64/libc.so.6[0x32c5a707b7]<br>
/lib64/libc.so.6[0x32c5a760e6]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/xlator/performance/write-<u></u>behind.so(+0x42be)[<u></u>0x7f79a63012be]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/xlator/performance/write-<u></u>behind.so(wb_sync_cbk+0xa0)[<u></u>0x7f79a6307ab0]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/xlator/features/quota.so(<u></u>quota_writev_cbk+0xed)[<u></u>0x7f79a651864d]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/xlator/cluster/<u></u>distribute.so(dht_writev_cbk+<u></u>0x14f)[0x7f79a6753aaf]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/xlator/protocol/client.<u></u>so(client3_1_writev_cbk+0x600)<u></u>[0x7f79a6995340]<br>
/usr/lib64/libgfrpc.so.0(rpc_<u></u>clnt_handle_reply+0xa5)[<u></u>0x31b020f4f5]<br>
/usr/lib64/libgfrpc.so.0(rpc_<u></u>clnt_notify+0x120)[<u></u>0x31b020fdb0]<br>
/usr/lib64/libgfrpc.so.0(rpc_<u></u>transport_notify+0x28)[<u></u>0x31b020aeb8]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/rpc-transport/socket.so(<u></u>socket_event_poll_in+0x34)[<u></u>0x7f79a79d4784]<br>
/usr/lib64/glusterfs/<a href="http://3.3.0." target="_blank">3.3.0.</a><u></u>5rhs/rpc-transport/socket.so(<u></u>socket_event_handler+0xc7)[<u></u>0x7f79a79d4867]<br>
/usr/lib64/libglusterfs.so.0[<u></u>0x31afe3e4e4]<br>
/usr/sbin/glusterfs(main+<u></u>0x590)[0x407420]<br>
/lib64/libc.so.6(__libc_start_<u></u>main+0xfd)[0x32c5a1ecdd]<br>
/usr/sbin/glusterfs[0x404289]<br>
<br>
<br>
<br>
<br>
______________________________<u></u>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.<u></u>org/mailman/listinfo/gluster-<u></u>users</a><br>
<br>
</blockquote>
<br>
</blockquote></div><br></div>