<div dir="ltr">Peter,<br> Sorry for the delay.. I would be able to test ib-verbs next week. Will get back to you mostly on monday.<br><br> Is it simple stripe setup?<br><br>Regards,<br>Amar<br><br><div class="gmail_quote">
2008/8/8 Peter Pelekis <span dir="ltr"><<a href="mailto:pete.pelekis@wsm.com">pete.pelekis@wsm.com</a>></span><br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Heres some of the errors I'm seeing on the storage servers.<br>
<br>
-Peter<br>
<br>
2008-08-08 13:59:33 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16633d10<br>
2008-08-08 13:59:37 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:37 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x1662f740<br>
2008-08-08 13:59:38 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:38 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16626690<br>
2008-08-08 13:59:39 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:39 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x1662e470<br>
2008-08-08 13:59:41 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:41 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16625080<br>
2008-08-08 13:59:44 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:44 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16624b40<br>
2008-08-08 13:59:46 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:46 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x1663a120<br>
2008-08-08 13:59:46 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 13:59:46 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16623080<br>
2008-08-08 14:00:00 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 14:00:00 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x1662e470<br>
2008-08-08 14:00:02 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 14:00:02 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16625080<br>
2008-08-08 14:00:05 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 14:00:05 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16624b40<br>
2008-08-08 14:00:07 C [ib-verbs.c:1550:ib_verbs_tcp_notify]<br>
transport/ib-verbs: server: notify (2) called on tcp socket<br>
2008-08-08 14:00:07 C [ib-verbs-server.c:233:gf_transport_fini]<br>
ib-verbs/server: server: called fini on transport: 0x16626690<br>
<div><div></div><div class="Wj3C7c"><br>
<br>
Anand Babu Periasamy wrote:<br>
> Hi Peter,<br>
> You need to adjust your time out settings. 1.4.x already addresses<br>
> these issues using non-blocking I/O. Currently 1.4.x code cleanup is<br>
> going<br>
> on, which is leading to rocky road once again, but it is completely<br>
> worth.<br>
> A month from now, 1.4.0 will be all set.<br>
><br>
> --<br>
> Anand Babu Periasamy<br>
> GPG Key ID: 0x62E15A31<br>
> Blog [<a href="http://ab.freeshell.org" target="_blank">http://ab.freeshell.org</a>]<br>
> The GNU Operating System [<a href="http://www.gnu.org" target="_blank">http://www.gnu.org</a>]<br>
> Z RESEARCH Inc [<a href="http://www.zresearch.com" target="_blank">http://www.zresearch.com</a>]<br>
><br>
><br>
><br>
> Peter Pelekis wrote:<br>
>> I'm having some problems with my glusterfs file system when I run<br>
>> benchmarks on it. I'm running iozone in throughput mode and I keep<br>
>> losing the glusterfs mount point on random machines. I get the error<br>
>> "Transport endpoint is not connected" when I try and run df or ls on the<br>
>> node it failed on. The one thing I did notice this morning one of the<br>
>> systems that fail last night started working again when I got in this<br>
>> morning. The failures I'm seeing are at the end of the log files.<br>
>> System:<br>
>> 4 Storage nodes strip<br>
>> 46 compute nodes<br>
>> Centos 5.2<br>
>> 2.6.18-53.el5<br>
>> Glusterfs 1.3.10<br>
>> Fuse fuse-2.7.3glfs10<br>
>> Qlogic QLE7240 IB cards<br>
>><br>
>> Heres some of the messages I'm seeing in the log files from the nodes<br>
>> that are mounting the file system.<br>
>><br>
>> 2008-08-07 19:46:22 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-1: activating bail-out. pending frames = 1. last sent =<br>
>> 2008-08-07 19:45:32. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:46:22 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-1: bailing transport<br>
>> 2008-08-07 19:46:22 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-4: activating bail-out. pending frames = 1. last sent =<br>
>> 2008-08-07 19:45:32. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:46:22 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-4: bailing transport<br>
>> 2008-08-07 19:46:22 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-2: activating bail-out. pending frames = 1. last sent =<br>
>> 2008-08-07 19:45:32. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:46:22 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-2: bailing transport<br>
>> 2008-08-07 19:46:22 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-2:<br>
>> cleaning up state in transport object 0x9625260<br>
>> 2008-08-07 19:46:22 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962f1f0<br>
>> 2008-08-07 19:46:22 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:46:22 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:46:22 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-4:<br>
>> cleaning up state in transport object 0x9629f20<br>
>> 2008-08-07 19:46:22 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962e190<br>
>> 2008-08-07 19:46:22 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:46:22 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:46:22 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-1:<br>
>> cleaning up state in transport object 0x961f350<br>
>> 2008-08-07 19:46:22 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9627630<br>
>> 2008-08-07 19:46:22 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:46:22 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:47:25 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-3: activating bail-out. pending frames = 1. last sent =<br>
>> 2008-08-07 19:45:32. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:47:25 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-3: bailing transport<br>
>> 2008-08-07 19:47:25 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-3:<br>
>> cleaning up state in transport object 0x96278c0<br>
>> 2008-08-07 19:47:25 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c2f0<br>
>> 2008-08-07 19:47:25 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:47:25 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:47:25 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63760: (34) / => -1 (107)<br>
>> 2008-08-07 19:53:20 W [client-protocol.c:280:client_protocol_xfer]<br>
>> trans: attempting to pipeline request type(2) op(4) with handshake<br>
>> 2008-08-07 19:53:20 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:53:20 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:53:20 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:53:20 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:53:23 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(15) with<br>
>> handshake<br>
>> 2008-08-07 19:53:23 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(15) with<br>
>> handshake<br>
>> 2008-08-07 19:53:23 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(15) with<br>
>> handshake<br>
>> 2008-08-07 19:53:23 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(15) with<br>
>> handshake<br>
>> 2008-08-07 19:54:06 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-1: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:53:23. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:54:06 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-1: bailing transport<br>
>> 2008-08-07 19:54:06 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-1:<br>
>> cleaning up state in transport object 0x961f350<br>
>> 2008-08-07 19:54:06 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9629c90<br>
>> 2008-08-07 19:54:06 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:06 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:54:06 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(15) reply=@0x9629c90<br>
>> 2008-08-07 19:54:06 E [client-protocol.c:3884:client_statfs_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:09 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-4: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:53:23. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:54:09 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-4: bailing transport<br>
>> 2008-08-07 19:54:09 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-4:<br>
>> cleaning up state in transport object 0x9629f20<br>
>> 2008-08-07 19:54:09 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962e190<br>
>> 2008-08-07 19:54:09 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:09 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:54:09 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(15) reply=@0x962e190<br>
>> 2008-08-07 19:54:09 E [client-protocol.c:3884:client_statfs_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:10 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-3: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:53:23. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:54:10 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-3: bailing transport<br>
>> 2008-08-07 19:54:10 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-3:<br>
>> cleaning up state in transport object 0x96278c0<br>
>> 2008-08-07 19:54:10 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9627630<br>
>> 2008-08-07 19:54:10 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:10 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:54:10 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(15) reply=@0x9627630<br>
>> 2008-08-07 19:54:10 E [client-protocol.c:3884:client_statfs_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:13 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-2: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:53:23. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:54:13 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-2: bailing transport<br>
>> 2008-08-07 19:54:13 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-2:<br>
>> cleaning up state in transport object 0x9625260<br>
>> 2008-08-07 19:54:13 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c870<br>
>> 2008-08-07 19:54:13 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:13 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:54:13 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63761: (34) / => -1 (107)<br>
>> 2008-08-07 19:54:13 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:13 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:13 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:13 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:13 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(15) reply=@0x962c870<br>
>> 2008-08-07 19:54:13 E [client-protocol.c:3884:client_statfs_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:54:13 E [fuse-bridge.c:2064:fuse_statfs_cbk]<br>
>> glusterfs-fuse: 63762: ERR => -1 (107)<br>
>> 2008-08-07 19:54:31 W [client-protocol.c:280:client_protocol_xfer]<br>
>> trans: attempting to pipeline request type(2) op(4) with handshake<br>
>> 2008-08-07 19:54:31 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:31 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:31 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:54:31 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:14 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-3: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:54:31. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:55:14 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-3: bailing transport<br>
>> 2008-08-07 19:55:14 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-4: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:54:31. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:55:14 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-4: bailing transport<br>
>> 2008-08-07 19:55:14 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-1: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:54:31. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:55:14 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-1: bailing transport<br>
>> 2008-08-07 19:55:14 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-1:<br>
>> cleaning up state in transport object 0x961f350<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9629c90<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9629c90<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:55:14 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-4:<br>
>> cleaning up state in transport object 0x9629f20<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c870<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c870<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:55:14 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-3:<br>
>> cleaning up state in transport object 0x96278c0<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9627630<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:55:14 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9627630<br>
>> 2008-08-07 19:55:14 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:14 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:55:21 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-2: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:54:31. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:55:21 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-2: bailing transport<br>
>> 2008-08-07 19:55:21 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-2:<br>
>> cleaning up state in transport object 0x9625260<br>
>> 2008-08-07 19:55:21 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962e3b0<br>
>> 2008-08-07 19:55:21 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:21 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:55:21 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63761: (34) / => -1 (107)<br>
>> 2008-08-07 19:55:21 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962e3b0<br>
>> 2008-08-07 19:55:21 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:21 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:55:21 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63763: (34) / => -1 (107)<br>
>> 2008-08-07 19:55:21 E [fuse-bridge.c:2699:init] glusterfs-fuse:<br>
>> fuse_mount failed (Transport endpoint is not connected)<br>
>><br>
>> 2008-08-07 19:55:21 E [glusterfs.c:547:main] glusterfs: Initializing<br>
>> FUSE failed<br>
>> 2008-08-07 19:55:21 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:21 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:21 E [ib-verbs.c:1107:ib_verbs_send_completion_proc]<br>
>> transport/ib-verbs: send work request on `ipath0' returned error<br>
>> wc.status = 12, wc.vendor_err = 0, post->buf = 0x2aaaac530000,<br>
>> wc.byte_len = 0, post->reused = 35<br>
>> 2008-08-07 19:55:21 E [ib-verbs.c:1500:ib_verbs_except]<br>
>> transport/ib-verbs: shutdown () - error: Transport endpoint is not<br>
>> connected<br>
>> 2008-08-07 19:55:24 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:24 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:45 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-1: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:45 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-2: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:55:45 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-2: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:55:45 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:55:45 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:55:45 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:55:45 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-4: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:56:32 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-1: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:55:45. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:56:32 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-1: bailing transport<br>
>> 2008-08-07 19:56:32 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-1:<br>
>> cleaning up state in transport object 0x961f350<br>
>> 2008-08-07 19:56:32 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962f690<br>
>> 2008-08-07 19:56:32 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:32 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:56:32 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-1:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962f690<br>
>> 2008-08-07 19:56:32 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:32 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-4: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:55:45. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:56:35 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-4: bailing transport<br>
>> 2008-08-07 19:56:35 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-4:<br>
>> cleaning up state in transport object 0x9629f20<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-3: activating bail-out. pending frames = 2. last sent =<br>
>> 2008-08-07 19:55:45. last received = 1969-12-31 19:00:00<br>
>> transport-timeout = 42<br>
>> 2008-08-07 19:56:35 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-3: bailing transport<br>
>> 2008-08-07 19:56:35 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c870<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:56:35 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-4:<br>
>> forced unwinding frame type(1) op(34) reply=@0x962c870<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:56:35 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-3:<br>
>> cleaning up state in transport object 0x96278c0<br>
>> 2008-08-07 19:56:35 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9629c90<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:56:35 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-3:<br>
>> forced unwinding frame type(1) op(34) reply=@0x9629c90<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:56:35 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63764: (34) / => -1 (107)<br>
>> 2008-08-07 19:56:35 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-1: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-1: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:56:35 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-2: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-2: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 19:56:35 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-4: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:56:35 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-4: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:56:35 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:56:35 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:56:45 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-4: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:25 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-3: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:28 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-1: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:28 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-1: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:57:28 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-1: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:57:28 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-1 returned errno 107<br>
>> 2008-08-07 19:57:28 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-2: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:28 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-2: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:57:28 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:57:28 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 19:57:28 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-3: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:28 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-3: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:57:28 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-3: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:57:28 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-3 returned errno 107<br>
>> 2008-08-07 19:57:28 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-4: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:28 W [client-protocol.c:332:client_protocol_xfer]<br>
>> client-stripe-4: not connected at the moment to submit frame type(1)<br>
>> op(34)<br>
>> 2008-08-07 19:57:28 E [client-protocol.c:4423:client_lookup_cbk]<br>
>> client-stripe-4: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 19:57:28 W<br>
>> [stripe.c:412:stripe_stack_unwind_inode_lookup_cbk] stripe:<br>
>> client-stripe-4 returned errno 107<br>
>> 2008-08-07 19:57:28 E [fuse-bridge.c:468:fuse_entry_cbk]<br>
>> glusterfs-fuse: 63765: (34) /iozone.DUMMY.14 => -1 (107)<br>
>> 2008-08-07 19:57:29 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-2: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 19:57:30 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-2: no valid fd found, returning<br>
>> 2008-08-07 19:57:30 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-3: no valid fd found, returning<br>
>> 2008-08-07 19:57:30 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-4: no valid fd found, returning<br>
>> 2008-08-07 19:57:30 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-1: no valid fd found, returning<br>
>> 2008-08-07 19:57:33 E [ib-verbs-client.c:141:ib_verbs_client_connect]<br>
>> client-stripe-1: connection not in progress - trace: Network is<br>
>> unreachable<br>
>> 2008-08-07 20:00:04 W [client-protocol.c:280:client_protocol_xfer]<br>
>> trans: attempting to pipeline request type(2) op(4) with handshake<br>
>> 2008-08-07 20:00:04 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 20:00:04 W [fuse-bridge.c:398:fuse_entry_cbk]<br>
>> glusterfs-fuse: 2: (34) / => 1 Rehashing 0/0<br>
>> 2008-08-07 23:31:29 W [client-protocol.c:280:client_protocol_xfer]<br>
>> trans: attempting to pipeline request type(2) op(4) with handshake<br>
>> 2008-08-07 23:31:29 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-3: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 23:31:29 W [fuse-bridge.c:398:fuse_entry_cbk]<br>
>> glusterfs-fuse: 2: (34) / => 1 Rehashing 0/0<br>
>> 2008-08-07 23:59:06 W [client-protocol.c:205:call_bail]<br>
>> client-stripe-2: activating bail-out. pending frames = 1. last sent =<br>
>> 2008-08-07 23:58:23. last received = 2008-08-07 23:58:17<br>
>> transport-timeout = 42<br>
>> 2008-08-07 23:59:06 C [client-protocol.c:212:call_bail]<br>
>> client-stripe-2: bailing transport<br>
>> 2008-08-07 23:59:06 W<br>
>> [client-protocol.c:4777:client_protocol_cleanup] client-stripe-2:<br>
>> cleaning up state in transport object 0x87eb260<br>
>> 2008-08-07 23:59:06 E<br>
>> [client-protocol.c:4827:client_protocol_cleanup] client-stripe-2:<br>
>> forced unwinding frame type(1) op(14) reply=@0x87f3d10<br>
>> 2008-08-07 23:59:06 E [client-protocol.c:3247:client_write_cbk]<br>
>> client-stripe-2: no proper reply from server, returning ENOTCONN<br>
>> 2008-08-07 23:59:06 W [stripe.c:3070:stripe_writev_cbk] stripe:<br>
>> client-stripe-2 returned errno 107<br>
>> 2008-08-07 23:59:06 E [fuse-bridge.c:1645:fuse_writev_cbk]<br>
>> glusterfs-fuse: 128670: WRITE => -1 (107)<br>
>> 2008-08-07 23:59:06 W [client-protocol.c:280:client_protocol_xfer]<br>
>> client-stripe-2: attempting to pipeline request type(1) op(34) with<br>
>> handshake<br>
>> 2008-08-07 23:59:28 E [client-protocol.c:1238:client_flush]<br>
>> client-stripe-2: : returning EBADFD<br>
>> 2008-08-07 23:59:28 W [stripe.c:198:stripe_stack_unwind_cbk] stripe:<br>
>> client-stripe-2 returned errno 77<br>
>> 2008-08-07 23:59:28 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-2: no valid fd found, returning<br>
>> 2008-08-08 00:51:00 W [client-protocol.c:1296:client_close]<br>
>> client-stripe-2: no valid fd found, returning<br>
>><br>
>><br>
>> -Peter<br>
>><br>
<br>
<br>
</div></div><div class="Ih2E3d">--<br>
Peter Pelekis 5444 Napa Street<br>
Western Scientific San Diego CA, 92110<br>
Senior Systems Engineer <a href="http://www.wsm.com" target="_blank">www.wsm.com</a><br>
<a href="mailto:pete.pelekis@wsm.com">pete.pelekis@wsm.com</a> Fax 619-220-6590<br>
Phone 619-220-6580 x212 Toll Free 800-443-6699<br>
GSA# GS-35F-5009H<br>
<br>
Visit us at:<br>
<br>
"I'm a great believer in luck, and I find the harder I work the more I have of it."<br>
-Thomas Jefferson<br>
<br>
"If everything seems under control, you're not going fast enough."<br>
-Mario Andretti<br>
<br>
<br>
_______________________________________________<br>
</div><div><div></div><div class="Wj3C7c">Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users</a><br>
<br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>Amar Tumballi<br>Gluster/GlusterFS Hacker<br>[bulde on #gluster/<a href="http://irc.gnu.org">irc.gnu.org</a>]<br><a href="http://www.zresearch.com">http://www.zresearch.com</a> - Commoditizing Super Storage!<br>
</div>