Hi,<br> Can you try 'glusterfs-1.4.0qa25' ? there were some more updates in that branch. If it happens again. Please mail me the logfile (both server and client). <br><br>Regards,<br>Amar<br><br><div class="gmail_quote">
2008/7/7 Will Rouesnel <<a href="mailto:electricitylikesme@hotmail.com">electricitylikesme@hotmail.com</a>>:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div>
<div><font face="Arial" size="2"><span>I'm trying to run
glusterfs with the posix-locks translaters on my bricks but after a certain
amount of time (or file accesses) they seem to bring down the server-side
process. My logfiles show the following each time it goes
down:</span></font></div>
<div><font face="Arial" size="2"><span></span></font> </div>
<div><font face="Arial" size="1"><span>TLA Repo Revision:
glusterfs--mainline--3.0--patch-198<br>Time : 2008-07-07 17:08:33<br>Signal
Number : 11</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>glusterfs -f
/usr/etc/glusterfs/glusterfs-client.vol -l /usr/var/log/glusterfs/glusterfs.log
-L WARNING /mnt/storage<br>volume fuse<br> type mount/fuse<br>
option direct-io-mode 1<br> option entry-timeout 1<br> option
attr-timeout 1<br> option mount-point /mnt/storage<br> subvolumes
unify <br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
unify<br> type cluster/unify<br> option alu.limits.min-free-disk
1<br> option alu.stat-refresh.num-file-create 1<br> option
alu.disk-usage.exit-threshold 4GB<br> option
alu.disk-usage.entry-threshold 10GB<br> option alu.order
disk-usage<br> option scheduler alu<br> option namespace
brick-ns<br> subvolumes brick0 brick1 brick2 brick3 brick4 brick5 brick6
<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick-ns<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick-ns-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick6<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick6-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick5<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick5-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick4<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick4-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick3<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick3-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick2<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick2-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick1<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick1-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick0<br> type protocol/client<br> option version
1.4.0qa22<br> option remote-subvolume brick0-locks<br> option
remote-host <a href="http://127.0.0.1" target="_blank">127.0.0.1</a><br> option transport-type
tcp<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>frame : type(1)
op(30)<br>frame : type(2) op(0)<br>frame : type(2) op(0)<br>frame : type(2)
op(0)<br>frame : type(2) op(0)<br>frame : type(2) op(0)<br>frame : type(2)
op(0)<br>frame : type(2) op(0)<br>frame : type(2) op(0)</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>2008-07-07 17:08:33
C [common-utils.c:155:gf_print_bytes] : xfer == 31617539801, rcvd ==
407355746<br>/lib/libc.so.6[0x2b239b3e0110]<br>/usr/lib/glusterfs/1.4.0qa22/xlator/protocol/client.so(client_fchmod_cbk+0x33e)[0x2aaaaaab87ce]<br>/usr/lib/glusterfs/1.4.0qa22/xlator/protocol/client.so(protocol_client_interpret+0x1ff)[0x2aaaaaab1e4f]<br>
/usr/lib/glusterfs/1.4.0qa22/xlator/protocol/client.so(protocol_client_pollin+0xbe)[0x2aaaaaab208e]<br>/usr/lib/glusterfs/1.4.0qa22/xlator/protocol/client.so(notify+0x18f)[0x2aaaaaab2d3f]<br>/usr/lib/glusterfs/1.4.0qa22/transport/tcp.so[0x2aaaab01644a]<br>
/usr/lib/libglusterfs.so.0[0x2b239b08da91]<br>[glusterfs](main+0x66a)[0x402bea]<br>/lib/libc.so.6(__libc_start_main+0xda)[0x2b239b3cd4ca]<br>[glusterfs][0x4020aa]</span></font></div>
<div><font face="Arial" size="2"><span></span></font> </div>
<div><font face="Arial" size="2"><span>My Server side
volume spec looks like this:</span></font></div>
<div><font face="Arial" size="1"><span>### file:
glusterfs-server.vol</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span># Local volumes
exported by the server<br>volume
brick0<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick0 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick0-locks<br> type
features/posix-locks<br> subvolumes
brick0<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick1<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick1 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick1-locks<br> type
features/posix-locks<br> subvolumes
brick1<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick2<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick2 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick2-locks<br> type
features/posix-locks<br> subvolumes
brick2<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick3<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick3 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick3-locks<br> type
features/posix-locks<br> subvolumes
brick3<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick4<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick4 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick4-locks<br> type
features/posix-locks<br> subvolumes
brick4<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick5<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick5 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick5-locks<br> type
features/posix-locks<br> subvolumes
brick5<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick6<br> type
storage/posix
# POSIX FS translator<br> option
directory
/mnt/brick6 #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick6-locks<br> type
features/posix-locks<br> subvolumes
brick6<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick-ns<br> type
storage/posix
# POSIX FS translator<br> option
directory /mnt/brick-ns #
Export this directory<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span>volume
brick-ns-locks<br> type
features/posix-locks<br> subvolumes
brick-ns<br> option mandatory
on<br>end-volume</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span># Configure the
glusterfs server side features<br>volume
server<br> type
protocol/server</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span> option
transport-type tcp/server<br> option
client-volume-filename
/usr/etc/glusterfs/glusterfs-client.vol</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span> subvolumes
brick0-locks brick1-locks brick2-locks brick3-locks brick4-locks brick5-locks
brick6-locks brick-ns-locks</span></font></div>
<div><font size="1"></font> </div>
<div><font face="Arial" size="1"><span> option
auth.ip.brick0-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick1-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick2-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick3-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick4-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick5-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick6-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br> option
auth.ip.brick-ns-locks.allow
<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,<a href="http://192.168.1.1" target="_blank">192.168.1.1</a><br>end-volume</span></font></div>
<div><font face="Arial" size="1"><span></span></font> </div>
<div><font face="Arial" size="2"><span>Any ideas as to why
this is happening? If I run without posix-locks gluster kicks out numerous
errors recommending I enable them, and I think I need them since my Apple
clients can't use the cluster apparently because they cannot modify files on the
cluster (neither can anyone else but it's less of an issue, still annoying
though).</span></font></div></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br>Amar Tumballi<br>Gluster/GlusterFS Hacker<br>[bulde on #gluster/<a href="http://irc.gnu.org">irc.gnu.org</a>]<br><a href="http://www.zresearch.com">http://www.zresearch.com</a> - Commoditizing Super Storage!