<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:x="urn:schemas-microsoft-com:office:excel" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal">Hi,<o:p></o:p></p>
<p class="MsoNormal"> I’ve run into a kernel bug, triggered by using gluster through FUSE. Wondering if any of you have encountered a similar problem and have worked around it by using an updated version of the kernel, gluster, or FUSE. Here’s
the bug:<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"> KERNEL: /usr/lib/debug/lib/modules/2.6.32-220.el6.x86_64/vmlinux<o:p></o:p></p>
<p class="MsoNormal"> DUMPFILE: /var/crash/127.0.0.1-2013-12-21-13:55:32/vmcore [PARTIAL DUMP]<o:p></o:p></p>
<p class="MsoNormal"> CPUS: 64<o:p></o:p></p>
<p class="MsoNormal"> DATE: Sat Dec 21 13:52:33 2013<o:p></o:p></p>
<p class="MsoNormal"> UPTIME: 16 days, 23:17:25<o:p></o:p></p>
<p class="MsoNormal">LOAD AVERAGE: 3.22, 3.36, 3.57<o:p></o:p></p>
<p class="MsoNormal"> TASKS: 5598<o:p></o:p></p>
<p class="MsoNormal"> NODENAME: uca-amm3.cnda.avaya.com<o:p></o:p></p>
<p class="MsoNormal"> RELEASE: 2.6.32-220.el6.x86_64<o:p></o:p></p>
<p class="MsoNormal"> VERSION: #1 SMP Wed Nov 9 08:03:13 EST 2011<o:p></o:p></p>
<p class="MsoNormal"> MACHINE: x86_64 (2892 Mhz)<o:p></o:p></p>
<p class="MsoNormal"> MEMORY: 32 GB<o:p></o:p></p>
<p class="MsoNormal"><b><span style="color:red"> PANIC: "kernel BUG at fs/inode.c:322!"<o:p></o:p></span></b></p>
<p class="MsoNormal"> PID: 259<o:p></o:p></p>
<p class="MsoNormal"><b><span style="color:red"> COMMAND: "kswapd1"<o:p></o:p></span></b></p>
<p class="MsoNormal"> TASK: ffff880433108b00 [THREAD_INFO: ffff88043310e000]<o:p></o:p></p>
<p class="MsoNormal"> CPU: 8<o:p></o:p></p>
<p class="MsoNormal"> STATE: TASK_RUNNING (PANIC)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">crash> bt<o:p></o:p></p>
<p class="MsoNormal">PID: 259 TASK: ffff880433108b00 CPU: 8 COMMAND: "kswapd1"<o:p></o:p></p>
<p class="MsoNormal">#0 [ffff88043310f7b0] machine_kexec at ffffffff81031fcb<o:p></o:p></p>
<p class="MsoNormal">#1 [ffff88043310f810] crash_kexec at ffffffff810b8f72<o:p></o:p></p>
<p class="MsoNormal">#2 [ffff88043310f8e0] oops_end at ffffffff814f04b0<o:p></o:p></p>
<p class="MsoNormal">#3 [ffff88043310f910] die at ffffffff8100f26b<o:p></o:p></p>
<p class="MsoNormal">#4 [ffff88043310f940] do_trap at ffffffff814efda4<o:p></o:p></p>
<p class="MsoNormal">#5 [ffff88043310f9a0] do_invalid_op at ffffffff8100ce35<o:p></o:p></p>
<p class="MsoNormal">#6 [ffff88043310fa40] invalid_op at ffffffff8100bedb<o:p></o:p></p>
<p class="MsoNormal"><b><span style="color:red"> [exception RIP: clear_inode+248]<o:p></o:p></span></b></p>
<p class="MsoNormal"> RIP: ffffffff81190fb8 RSP: ffff88043310faf0 RFLAGS: 00010202<o:p></o:p></p>
<p class="MsoNormal"> RAX: 0000000000000000 RBX: ffff8800245ce980 RCX: 0000000000000001<o:p></o:p></p>
<p class="MsoNormal"> RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff8800245ce980<o:p></o:p></p>
<p class="MsoNormal"> RBP: ffff88043310fb00 R8: 0000000000000000 R9: 000000000000000d<o:p></o:p></p>
<p class="MsoNormal"> R10: 0000000000000002 R11: 0000000000000001 R12: ffffffff81fbf340<o:p></o:p></p>
<p class="MsoNormal"> R13: 0000000000000000 R14: ffff8800888014f8 R15: 0000000000000001<o:p></o:p></p>
<p class="MsoNormal"> ORIG_RAX: ffffffffffffffff CS: 0010 SS: 0018<o:p></o:p></p>
<p class="MsoNormal">#7 [ffff88043310fb08] generic_delete_inode at ffffffff811916f6<o:p></o:p></p>
<p class="MsoNormal">#8 [ffff88043310fb38] iput at ffffffff81190612<o:p></o:p></p>
<p class="MsoNormal">#9 [ffff88043310fb58] dentry_iput at ffffffff8118d170<o:p></o:p></p>
<p class="MsoNormal">#10 [ffff88043310fb78] d_kill at ffffffff8118d2d1<o:p></o:p></p>
<p class="MsoNormal">#11 [ffff88043310fb98] __shrink_dcache_sb at ffffffff8118d666<o:p></o:p></p>
<p class="MsoNormal">#12 [ffff88043310fc38] shrink_dcache_memory at ffffffff8118d7e9<o:p></o:p></p>
<p class="MsoNormal">#13 [ffff88043310fc98] shrink_slab at ffffffff811299aa<o:p></o:p></p>
<p class="MsoNormal">#14 [ffff88043310fcf8] balance_pgdat at ffffffff8112c75d<o:p></o:p></p>
<p class="MsoNormal">#15 [ffff88043310fe28] kswapd at ffffffff8112caf6<o:p></o:p></p>
<p class="MsoNormal">#16 [ffff88043310fee8] kthread at ffffffff81090886<o:p></o:p></p>
<p class="MsoNormal">#17 [ffff88043310ff48] kernel_thread at ffffffff8100c14a<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"> This bug is reported here: <a href="http://fuse.996288.n3.nabble.com/Kernel-panic-when-using-fuse-with-distributed-filesystem-while-doing-heavy-i-o-td10373.html">
http://fuse.996288.n3.nabble.com/Kernel-panic-when-using-fuse-with-distributed-filesystem-while-doing-heavy-i-o-td10373.html</a>, which shows that this bug is reported on two different bugzilla bug reports
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=644085">https://bugzilla.redhat.com/show_bug.cgi?id=644085</a> and
<a href="https://bugzilla.kernel.org/show_bug.cgi?id=15927">https://bugzilla.kernel.org/show_bug.cgi?id=15927</a>. All of these reports mention using FUSE with high volume on the 2.6 kernel (which we are using). There’s another entry on the red hat network,
but I can’t see it (don’t have the subscription) <a href="https://access.redhat.com/site/solutions/72383">
https://access.redhat.com/site/solutions/72383</a> <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thanks,<o:p></o:p></p>
<p class="MsoNormal">Anne<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>