<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 01/17/2014 01:49 AM, Jeffrey
Brewster wrote:<br>
</div>
<blockquote
cite="mid:1389903593.66103.YahooMailNeo@web125002.mail.ne1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:10pt">Thanks! I will try on
6.4. </div>
</blockquote>
<br>
Just checked my GlusterFS version , it is
glusterfs-3.5.0qa3-1.el6.x86_64, I am in the process of updating it
to beta1 . However I am positive that it would work with 3.4.2 also.
Make sure you have covered selinux and iptables settings on your new
set-up.<br>
<br>
-Lala<br>
<blockquote
cite="mid:1389903593.66103.YahooMailNeo@web125002.mail.ne1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:10pt">
<div style="display: block;" class="yahoo_quoted"> <br>
<br>
<div style="font-family: HelveticaNeue, Helvetica Neue,
Helvetica, Arial, Lucida Grande, sans-serif; font-size:
10pt;">
<div style="font-family: HelveticaNeue, Helvetica Neue,
Helvetica, Arial, Lucida Grande, sans-serif; font-size:
12pt;">
<div dir="ltr"> <font face="Arial" size="2"> On Thursday,
January 16, 2014 3:02 PM, Lalatendu Mohanty
<a class="moz-txt-link-rfc2396E" href="mailto:lmohanty@redhat.com"><lmohanty@redhat.com></a> wrote:<br>
</font> </div>
<div class="y_msg_container">
<div id="yiv6040385997">
<div>
<div class="yiv6040385997moz-cite-prefix">On
01/16/2014 08:29 PM, Jeffrey Brewster wrote:<br>
</div>
<blockquote type="cite">
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div><span><br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>Please
find the packages I have installed. I have
been using the quick start doc so I have
been trying to mount locally. Do I need a
3.4.2 client rpm? I have not seen one. <br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span><br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span><br>
</span></div>
</div>
</blockquote>
<br>
Jeffery,<br>
<br>
If you are trying to mount the volume locally on the
gluster-node, you dont need any extra client
packages.<br>
<br>
I believe you are using<b> </b>below link for the
quick start guide. In the guide, the recommended
distribution for these steps to try is Fedora20. I
have tried the same steps on RHEL6.4 , it worked
fine. My guess is there might be a bug with with
EL5. I don't have a EL5 handy , hence couldn't test
it. <br>
<b><br>
</b><a moz-do-not-send="true" rel="nofollow"
class="yiv6040385997moz-txt-link-freetext"
target="_blank"
href="http://www.gluster.org/community/documentation/index.php/QuickStart">http://www.gluster.org/community/documentation/index.php/QuickStart</a><br>
<br>
-Lala<br>
<blockquote type="cite">
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>host1:
<br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>gluster
packages installed:</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>[root@gcvs0139
~]# rpm -qa | grep gluster | cat -n <br>
1 glusterfs-libs-3.4.2-1.el5<br>
2 glusterfs-server-3.4.2-1.el5<br>
3 glusterfs-3.4.2-1.el5<br>
4 glusterfs-cli-3.4.2-1.el5<br>
5
glusterfs-geo-replication-3.4.2-1.el5<br>
6 glusterfs-fuse-3.4.2-1.el5<br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>selinux
disabled:</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span><br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>[root@gcvs0139
~]# getenforce<br>
Disabled<br>
[root@gcvs0139 ~]# <br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span>host
2: SAME<br>
</span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;">[root@gcvs4056
glusterfs]# rpm -qa | grep gluster | cat -n <br>
1 glusterfs-libs-3.4.2-1.el5<br>
2 glusterfs-3.4.2-1.el5<br>
3 glusterfs-cli-3.4.2-1.el5<br>
4 glusterfs-geo-replication-3.4.2-1.el5<br>
5 glusterfs-fuse-3.4.2-1.el5<br>
6 glusterfs-server-3.4.2-1.el5<br>
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br>
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;">[root@gcvs4056
glusterfs]# getenforce <br>
Disabled<br>
[root@gcvs4056 glusterfs]# <br>
<span></span></div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span><br>
</span></div>
<div style="display:block;"
class="yiv6040385997yahoo_quoted"> <br>
<br>
<div style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande, sans-serif;
font-size:10pt;">
<div style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida
Grande, sans-serif;
font-size:12pt;">
<div dir="ltr"> <font face="Arial"
size="2"> On Thursday, January 16,
2014 12:37 AM, Lalatendu Mohanty <a
moz-do-not-send="true"
rel="nofollow"
class="yiv6040385997moz-txt-link-rfc2396E"
ymailto="mailto:lmohanty@redhat.com"
target="_blank"
href="mailto:lmohanty@redhat.com"><lmohanty@redhat.com></a>
wrote:<br>
</font> </div>
<div class="yiv6040385997y_msg_container">
<div id="yiv6040385997">
<div>
<div
class="yiv6040385997moz-cite-prefix">On
01/16/2014 03:58 AM, Jeffrey
Brewster wrote:<br clear="none">
</div>
<blockquote type="cite">
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div><br clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;">I'm
not sure why the mount is
failing. I followed the quick
start guide...<br clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;">Data:</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;">--------------</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
</div>
<div style="color:rgb(0, 0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;">1.
Info check looks good<br
clear="none">
</div>
<pre>gluster volume info
Volume Name: gv2
Type: Replicate
Volume ID: ca9f2409-3004-4287-af6f-1b455048710e
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: gcvs0139:/data/gv0/brick1/app
Brick2: gcvs4056:/data/gv0/brick2/app1
2. Status looks good
gluster volume status
Status of volume: gv2
Gluster process Port Online Pid
------------------------------------------------------------------------------
Brick gcvs0139:/data/gv0/brick1/app 49152 Y 7648
Brick gcvs4056:/data/gv0/brick2/app1 49152 Y 12005
NFS Server on localhost 2049 Y
12017
Self-heal Daemon on localhost N/A Y 12021
NFS Server on gcvs0139 2049 Y 7660
Self-heal Daemon on gcvs0139 N/A Y 7664
There are no active volume tasks
3. peer check looks good
[root@gcvs4056 /]# gluster peer probe gcvs0139
peer probe: success: host gcvs0139 port 24007 already in peer list
[root@gcvs4056 /]#
4. mount fails
[root@gcvs4056 /]# mount -t glusterfs gcvs4056:/gv2 /mnt
Mount failed. Please check the log file for more details.
[root@gcvs4056 /]#
5. mount log
>From the mnt.log:
-------------
[2014-01-15 22:19:57.751543] I [afr-common.c:3698:afr_notify] 0-gv2-replicate-0: Subvolume 'gv2-client-1' came back up; going online.
[2014-01-15 22:19:57.751614] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-gv2-client-0: changing port to
49152 (from 0)
[2014-01-15 22:19:57.751675] I [client-handshake.c:450:client_set_lk_version_cbk] 0-gv2-client-1: Server lk version = 1
[2014-01-15 22:19:57.751712] W [socket.c:514:__socket_rwv] 0-gv2-client-0: readv failed (No data available)
[2014-01-15 22:19:57.759041] W [common-utils.c:2247:gf_get_reserved_ports] 0-glusterfs: could not open the file /proc/sys/net/ipv4/ip_local_reserved_ports for getting reserved ports info (No such file or directory)
[2014-01-15 22:19:57.759080] W [common-utils.c:2280:gf_process_reserved_ports] 0-glusterfs: Not able to get reserved ports, hence there is a possibility that glusterfs may consume reserved port
[2014-01-15 22:19:57.762259] I [client-handshake.c:1659:select_server_supported_programs] 0-gv2-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2014-01-15 22:19:57.762974] I [client-handshake.c:1456:client_setvolume_cbk] 0-gv2-client-0: Connected to 10.131.83.139:49152,
attached to remote volume '/data/gv0/brick1/app'.
[2014-01-15 22:19:57.763008] I [client-handshake.c:1468:client_setvolume_cbk] 0-gv2-client-0: Server and Client lk-version numbers are not same, reopening the fds
[2014-01-15 22:19:57.775406] I [fuse-bridge.c:4769:fuse_graph_setup] 0-fuse: switched to graph 0
[2014-01-15 22:19:57.775695] I [client-handshake.c:450:client_set_lk_version_cbk] 0-gv2-client-0: Server lk version = 1
[2014-01-15 22:19:57.779538] I [fuse-bridge.c:4628:fuse_thread_proc] 0-fuse: unmounting /mnt
[2014-01-15 22:19:57.780102] W [glusterfsd.c:1002:cleanup_and_exit] (-->/lib64/libc.so.6(clone+0x6d) [0x31f6ad40cd] (-->/lib64/libpthread.so.0 [0x31f7e0673d] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0x138) [0x405328]))) 0-: received signum (15), shutting down
[2014-01-15 22:19:57.780206] I [fuse-bridge.c:5260:fini] 0-fuse: Unmounting '/mnt'.
</pre>
<div
class="yiv6040385997yahoo_quoted"
style="display:block;"> <br
clear="none">
<br clear="none">
<div
style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div
style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:12pt;">
<div dir="ltr"> <font
face="Arial" size="2">
On Tuesday, January
14, 2014 5:12 PM,
Jeffrey Brewster <a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
class="yiv6040385997moz-txt-link-rfc2396E"
ymailto="mailto:jab2805@yahoo.com" target="_blank"
href="mailto:jab2805@yahoo.com"><jab2805@yahoo.com></a>
wrote:<br clear="none">
</font> </div>
<div
class="yiv6040385997y_msg_container">
<div id="yiv6040385997">
<div>
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue,
Helvetica, Arial,
Lucida Grande,
sans-serif;font-size:10pt;">
<div
id="yiv6040385997">
<div>
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;font-size:10pt;">
<div
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_30"
style="color:rgb(0,
0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><br
clear="none">
<span
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_23"></span></div>
<div
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_33"
style="color:rgb(0,
0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_23">Hi Ben, <br
clear="none">
<br
clear="none">
1. Port 24007
is open and
all iptable
rules have
been flushed:<br
clear="none">
<br
clear="none">
[root@gcvs4056
run]# telnet
gcvs0139 24007<br
clear="none">
Trying
10.131.83.139...<br
clear="none">
Connected to
gcvs0139.<br
clear="none">
Escape
character is
'^]'.<br
clear="none">
<br
clear="none">
<br
clear="none">
2. gluster
peer status
looks good
from both
boxes: <br
clear="none">
<br
clear="none">
box1<br
clear="none">
[root@gcvs4056
run]# gluster
peer status<br
clear="none">
Number of
Peers: 1<br
clear="none">
<br
clear="none">
Hostname:
gcvs0139<br
clear="none">
Uuid:
d40ba14d-cbb4-40e7-86a2-62afaa99af4d<br
clear="none">
State: Peer in
Cluster
(Connected)<br
clear="none">
<br
clear="none">
box 2:<br
clear="none">
<br
clear="none">
<br
clear="none">
# gluster peer
status<br
clear="none">
Number of
Peers: 1<br
clear="none">
<br
clear="none">
Hostname:
gcvs4056<br
clear="none">
Port: 24007<br
clear="none">
Uuid:
b1aae40a-78be-4303-bf48-49fb41d6bb30<br
clear="none">
State: Peer in
Cluster
(Connected)<br
clear="none">
<br
clear="none">
3. selinux is
disabled on
both boxes.<br
clear="none">
<br
clear="none">
grep dis
/etc/sysconfig/selinux
<br
clear="none">
#
disabled - No
SELinux policy
is loaded.<br
clear="none">
SELINUX=disabled<br clear="none">
<br
clear="none">
<br
clear="none">
</span></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<br clear="none">
I can see that selinux is disabled
in the config file, but this does
not come in to effect unless you
reboot the server. Check the current
status of selinux i.e. run
"getenforce" .<br clear="none">
<br clear="none">
Also what gluster packages are
installed on the client side? <br
clear="none">
<br clear="none">
<blockquote type="cite">
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div
class="yiv6040385997yahoo_quoted"
style="display:block;">
<div
style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:10pt;">
<div
style="font-family:HelveticaNeue,
Helvetica Neue, Helvetica,
Arial, Lucida Grande,
sans-serif;font-size:12pt;">
<div
class="yiv6040385997y_msg_container">
<div id="yiv6040385997">
<div>
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue,
Helvetica, Arial,
Lucida Grande,
sans-serif;font-size:10pt;">
<div
id="yiv6040385997">
<div>
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;font-size:10pt;">
<div
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_33"
style="color:rgb(0,
0,
0);font-size:13.3333px;font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;background-color:transparent;font-style:normal;"><span
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_23"><br clear="none">
Thanks for
your help!<br
clear="none">
<br
clear="none">
</span></div>
<div
class="yiv6040385997yqt1367803407"
id="yiv6040385997yqt50960">
<div
class="yiv6040385997yqt9247668738"
id="yiv6040385997yqt41448">
<div
class="yiv6040385997yahoo_quoted"
id="yiv6040385997yui_3_13_0_ym1_7_1389734926589_17"
style="display:block;">
<br
clear="none">
<br
clear="none">
<div
class="yiv6040385997yui_3_13_0_ym1_1_1389734926589_5028"
style="font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;font-size:10pt;">
<div
class="yiv6040385997yui_3_13_0_ym1_1_1389734926589_5029"
style="font-family:HelveticaNeue,
Helvetica
Neue,
Helvetica,
Arial, Lucida
Grande,
sans-serif;font-size:12pt;">
<div dir="ltr">
<font
face="Arial"
size="2"> On
Tuesday,
January 14,
2014 4:54 PM,
Ben Turner <a
moz-do-not-send="true" rel="nofollow" shape="rect"
class="yiv6040385997moz-txt-link-rfc2396E"
ymailto="mailto:bturner@redhat.com" target="_blank"
href="mailto:bturner@redhat.com"><bturner@redhat.com></a>
wrote:<br
clear="none">
</font> </div>
<div
class="yiv6040385997y_msg_container">-----
Original
Message -----<br
clear="none">
> From:
"Jeffrey
Brewster" <<a
moz-do-not-send="true" rel="nofollow" shape="rect"
ymailto="mailto:jab2805@yahoo.com"
target="_blank" href="mailto:jab2805@yahoo.com">jab2805@yahoo.com</a>><br
clear="none">
> To: "Ben
Turner" <<a
moz-do-not-send="true" rel="nofollow" shape="rect"
ymailto="mailto:bturner@redhat.com"
target="_blank" href="mailto:bturner@redhat.com">bturner@redhat.com</a>><br
clear="none">
> Cc: <a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:gluster-users@gluster.org"
target="_blank" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br
clear="none">
> Sent:
Tuesday,
January 14,
2014 4:35:30
PM<br
clear="none">
> Subject:
Re:
[Gluster-users]
Unable to
mount gfs gv0
volume
Enterprise
Linux
Enterprise
Linux Server
release 5.6<br
clear="none">
>
(Carthage)<br
clear="none">
> <br
clear="none">
> Hi Ben,<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> I don't
have any "E"
(error I
assume) lines
in the mnt.log
file. I check
all<br
clear="none">
> the log
files in the
/var/log/glusterfs/
dir. I
restarted
glusterd to
see<br
clear="none">
> if I
could see any
errors.<br
clear="none">
> <br
clear="none">
<br
clear="none">
Make sure
SELinux is
disabled and
your firewall
is open to
allow gluster
traffic. Have
a look at:<br
clear="none">
<br
clear="none">
<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
target="_blank"
href="http://www.gluster.org/community/documentation/index.php/Basic_Gluster_Troubleshooting">http://www.gluster.org/community/documentation/index.php/Basic_Gluster_Troubleshooting</a><br
clear="none">
<br
clear="none">
For what ports
you need
open. As a
test I would
just try
disabling
iptables and
adding in the
rules after
you confirm it
is working.<br
clear="none">
<br
clear="none">
-b
<div
class="yiv6040385997yqt2019339168"
id="yiv6040385997yqtfd16132"><br clear="none">
<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> Data:<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> Warnings
from mount
log:<br
clear="none">
>
-------------<br
clear="none">
> <br
clear="none">
> # grep W
mnt.log | cat
-n<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> 1
[2014-01-14<br
clear="none">
>
19:32:22.920069]
W
[common-utils.c:2247:gf_get_reserved_ports]<br
clear="none">
>
0-glusterfs:
could not open
the file<br
clear="none">
>
/proc/sys/net/ipv4/ip_local_reserved_ports
for getting
reserv<br
clear="none">
> <br
clear="none">
> 2
[2014-01-14
19:32:22.920108]
W<br
clear="none">
>
[common-utils.c:2280:gf_process_reserved_ports]
0-glusterfs:
Not able to<br
clear="none">
> get
reserved
ports, hence
there is a
possibility
that glusterfs
may c<br
clear="none">
> <br
clear="none">
> 3
[2014-01-14
19:32:22.935611]
W<br
clear="none">
>
[common-utils.c:2247:gf_get_reserved_ports]
0-glusterfs:
could not open<br
clear="none">
> the file
/proc/sys/net/ipv4/ip_local_reserved_ports
for getting
reserv<br
clear="none">
> <br
clear="none">
> 4
[2014-01-14
19:32:22.935646]
W<br
clear="none">
>
[common-utils.c:2280:gf_process_reserved_ports]
0-glusterfs:
Not able to<br
clear="none">
> get
reserved
ports, hence
there is a
possibility
that glusterfs
may c<br
clear="none">
> <br
clear="none">
> 5
[2014-01-14
19:32:22.938783]
W<br
clear="none">
>
[common-utils.c:2247:gf_get_reserved_ports]
0-glusterfs:
could not open<br
clear="none">
> the file
/proc/sys/net/ipv4/ip_local_reserved_ports
for getting
reserv<br
clear="none">
> <br
clear="none">
> 6
[2014-01-14
19:32:22.938826]
W<br
clear="none">
>
[common-utils.c:2280:gf_process_reserved_ports]
0-glusterfs:
Not able to<br
clear="none">
> get
reserved
ports, hence
there is a
possibility
that glusterfs
may c<br
clear="none">
> 7
[2014-01-14
19:32:22.941076]
W
[socket.c:514:__socket_rwv]<br
clear="none">
>
0-gv0-client-1:
readv failed
(No data
available)<br
clear="none">
> <br
clear="none">
> 8
[2014-01-14
19:32:22.945278]
W<br
clear="none">
>
[common-utils.c:2247:gf_get_reserved_ports]
0-glusterfs:
could not open<br
clear="none">
> the file
/proc/sys/net/ipv4/ip_local_reserved_ports
for getting
reserv<br
clear="none">
> <br
clear="none">
> 9
[2014-01-14
19:32:22.945312]
W<br
clear="none">
>
[common-utils.c:2280:gf_process_reserved_ports]
0-glusterfs:
Not able to<br
clear="none">
> get
reserved
ports, hence
there is a
possibility
that glusterfs
may c<br
clear="none">
> 10
[2014-01-14<br
clear="none">
>
19:32:22.946921]
W
[socket.c:514:__socket_rwv]
0-gv0-client-0:
readv failed<br
clear="none">
> (No data
available)<br
clear="none">
> <br
clear="none">
> 11
[2014-01-14
19:32:22.953383]
W<br
clear="none">
>
[common-utils.c:2247:gf_get_reserved_ports]
0-glusterfs:
could not open<br
clear="none">
> the file
/proc/sys/net/ipv4/ip_local_reserved_ports
for getting
reserv<br
clear="none">
> <br
clear="none">
> 12
[2014-01-14
19:32:22.953423]
W<br
clear="none">
>
[common-utils.c:2280:gf_process_reserved_ports]
0-glusterfs:
Not able to<br
clear="none">
> get
reserved
ports, hence
there is a
possibility
that glusterfs
may c<br
clear="none">
> <br
clear="none">
> 13
[2014-01-14
19:32:22.976633]
W
[glusterfsd.c:1002:cleanup_and_exit]<br
clear="none">
>
(-->/lib64/libc.so.6(clone+0x6d)
[0x31f6ad40cd]<br
clear="none">
>
(-->/lib64/libpthread.so.0
[0x<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> After
restarting
glusterd:<br
clear="none">
>
-----------------------------<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> # grep E
* | grep
21:25| cat -n<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> 1
etc-glusterfs-glusterd.vol.log:[2014-01-14
21:25:47.637082]
E<br
clear="none">
>
[rpc-transport.c:253:rpc_transport_load]
0-rpc-transport:<br clear="none">
>
/usr/lib64/glusterfs/3.4.2/rpc-transport/rdma.so:
cannot open
shared<br
clear="none">
>
object file:
No such file
or directory<br
clear="none">
> 2
etc-glusterfs-glusterd.vol.log:[2014-01-14
21:25:49.940650]
E<br
clear="none">
>
[glusterd-store.c:1858:glusterd_store_retrieve_volume]
0-: Unknown
key:<br
clear="none">
>
brick-0<br
clear="none">
> 3
etc-glusterfs-glusterd.vol.log:[2014-01-14
21:25:49.940698]
E<br
clear="none">
>
[glusterd-store.c:1858:glusterd_store_retrieve_volume]
0-: Unknown
key:<br
clear="none">
>
brick-1<br
clear="none">
> 4
etc-glusterfs-glusterd.vol.log:[2014-01-14
21:25:52.075563]
E<br
clear="none">
>
[glusterd-utils.c:3801:glusterd_nodesvc_unlink_socket_file]<br
clear="none">
>
0-management:
Failed to
remove<br
clear="none">
>
/var/run/3096dde11d292c28c8c2f97101c272e8.socket
error:
Resource<br
clear="none">
>
temporarily
unavailable<br
clear="none">
> 5
etc-glusterfs-glusterd.vol.log:[2014-01-14
21:25:53.084722]
E<br
clear="none">
>
[glusterd-utils.c:3801:glusterd_nodesvc_unlink_socket_file]<br
clear="none">
>
0-management:
Failed to
remove<br
clear="none">
>
/var/run/15f2dcd004edbff6ab31364853d6b6b0.socket
error: No such
file or<br
clear="none">
>
directory<br
clear="none">
> 6
glustershd.log:[2014-01-14
21:25:42.392401]
W<br
clear="none">
>
[socket.c:1962:__socket_proto_state_machine]
0-glusterfs:
reading from<br
clear="none">
>
socket failed.
Error (No data
available),
peer
(127.0.0.1:24007)<br
clear="none">
> 7
glustershd.log:[2014-01-14
21:25:53.476026]
E<br
clear="none">
>
[afr-self-heald.c:1067:afr_find_child_position]
0-gv0-replicate-0:<br clear="none">
>
getxattr
failed on
gv0-client-0 -
(Transport
endpoint is
not connected)<br
clear="none">
> 8
nfs.log:[2014-01-14
21:25:42.391560]
W<br
clear="none">
>
[socket.c:1962:__socket_proto_state_machine]
0-glusterfs:
reading from<br
clear="none">
>
socket failed.
Error (No data
available),
peer
(127.0.0.1:24007)<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> Procs
After restrt:<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> ps -ef |
grep gluster<br
clear="none">
> root
6345 1 0
18:35 ?
00:00:00
/usr/sbin/glusterfsd
-s<br
clear="none">
> gcvs4056
--volfile-id
gv0.gcvs4056.data-gv0-brick1-app
-p<br
clear="none">
>
/var/lib/glusterd/vols/gv0/run/gcvs4056-data-gv0-brick1-app.pid
-S<br
clear="none">
>
/var/run/f2339d9fa145fd28662d8b970fbd4aab.socket
--brick-name<br
clear="none">
>
/data/gv0/brick1/app
-l
/var/log/glusterfs/bricks/data-gv0-brick1-app.log<br
clear="none">
>
--xlator-option
*-posix.glusterd-uuid=b1aae40a-78be-4303-bf48-49fb41d6bb30<br
clear="none">
>
--brick-port
49153
--xlator-option
gv0-server.listen-port=49153<br clear="none">
> root
7240 1 0
21:25 ?
00:00:00
/usr/sbin/glusterd<br
clear="none">
>
--pid-file=/var/run/glusterd.pid<br
clear="none">
> root
7266 1 0
21:25 ?
00:00:00
/usr/sbin/glusterfs
-s<br
clear="none">
> localhost
--volfile-id
gluster/nfs -p
/var/lib/glusterd/nfs/run/nfs.pid
-l<br
clear="none">
>
/var/log/glusterfs/nfs.log
-S<br
clear="none">
>
/var/run/3096dde11d292c28c8c2f97101c272e8.socket<br
clear="none">
> root
7273 1 0
21:25 ?
00:00:00
/usr/sbin/glusterfs
-s<br
clear="none">
> localhost
--volfile-id
gluster/glustershd
-p<br
clear="none">
>
/var/lib/glusterd/glustershd/run/glustershd.pid
-l<br
clear="none">
>
/var/log/glusterfs/glustershd.log
-S<br
clear="none">
>
/var/run/15f2dcd004edbff6ab31364853d6b6b0.socket
--xlator-option<br clear="none">
>
*replicate*.node-uuid=b1aae40a-78be-4303-bf48-49fb41d6bb30<br
clear="none">
> root
7331 5375 0
21:34 pts/1
00:00:00 grep
gluster<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> <br
clear="none">
> On
Tuesday,
January 14,
2014 4:08 PM,
Ben Turner
<<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:bturner@redhat.com"
target="_blank" href="mailto:bturner@redhat.com">bturner@redhat.com</a>>
wrote:<br
clear="none">
> <br
clear="none">
> -----
Original
Message -----<br
clear="none">
> >
From: "Jeffrey
Brewster" <<a
moz-do-not-send="true" rel="nofollow" shape="rect"
ymailto="mailto:jab2805@yahoo.com"
target="_blank" href="mailto:jab2805@yahoo.com">jab2805@yahoo.com</a>><br
clear="none">
> > To:
"Ben Turner"
<<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:bturner@redhat.com"
target="_blank" href="mailto:bturner@redhat.com">bturner@redhat.com</a>><br
clear="none">
> > Cc:
<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:gluster-users@gluster.org"
target="_blank" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br
clear="none">
> >
Sent: Tuesday,
January 14,
2014 3:57:24
PM<br
clear="none">
> >
Subject: Re:
[Gluster-users]
Unable to
mount gfs gv0
volume
Enterprise<br
clear="none">
> >
Linux
Enterprise
Linux Server
release 5.6<br
clear="none">
> >
(Carthage)<br
clear="none">
> > <br
clear="none">
> >
Thanks Ben,<br
clear="none">
> > <br
clear="none">
> > <br
clear="none">
> > <br
clear="none">
> > I
tried that it
still failed.<br
clear="none">
> <br
clear="none">
> As Vijay
suggested have
a look at
/var/log/glusterfs,
there should
be a log<br
clear="none">
> there
with the
mountpoint
name that
should give us
a clue as to
what is<br
clear="none">
> going
on. To note
if there is a
problem with
FUSE not being
loaded you
will<br
clear="none">
> see
something
like:<br
clear="none">
> <br
clear="none">
>
[2013-01-12
01:58:22.213417]
I
[glusterfsd.c:1759:main]<br
clear="none">
>
0-/usr/sbin/glusterfs:
Started
running
/usr/sbin/glusterfs
version<br
clear="none">
>
3.3.0.5rhs<br
clear="none">
>
[2013-01-12
01:58:22.213831]
E
[mount.c:596:gf_fuse_mount]
0-glusterfs-fuse:<br clear="none">
> cannot
open /dev/fuse
(No such file
or directory)<br
clear="none">
>
[2013-01-12
01:58:22.213856]
E
[xlator.c:385:xlator_init]
0-fuse:<br
clear="none">
>
Initialization
of volume
'fuse' failed,
review your
volfile again<br
clear="none">
> <br
clear="none">
> If you
can't tell the
problem from
the log shoot
out the
relevant line
and<br
clear="none">
> I'll have
a look.<br
clear="none">
> <br
clear="none">
> -b<br
clear="none">
> <br
clear="none">
> <br
clear="none">
> > <br
clear="none">
> > <br
clear="none">
> > <br
clear="none">
> > On
Tuesday,
January 14,
2014 3:22 PM,
Ben Turner
<<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:bturner@redhat.com"
target="_blank" href="mailto:bturner@redhat.com">bturner@redhat.com</a>><br
clear="none">
> >
wrote:<br
clear="none">
> > <br
clear="none">
> >
----- Original
Message -----<br
clear="none">
> > >
From: "Jeffrey
Brewster" <<a
moz-do-not-send="true" rel="nofollow" shape="rect"
ymailto="mailto:jab2805@yahoo.com"
target="_blank" href="mailto:jab2805@yahoo.com">jab2805@yahoo.com</a>><br
clear="none">
> > >
To: <a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:gluster-users@gluster.org"
target="_blank" href="mailto:gluster-users@gluster.org">gluster-users@gluster.org</a><br
clear="none">
> > >
Sent: Tuesday,
January 14,
2014 1:47:55
PM<br
clear="none">
> > >
Subject:
[Gluster-users]
Unable to
mount gfs gv0
volume
Enterprise
Linux<br
clear="none">
> > >
Enterprise
Linux Server
release 5.6<br
clear="none">
> > >
(Carthage)<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
Hi all,<br
clear="none">
> > >
<br
clear="none">
> > >
I have been
following the
quick start
guide as part
of a POC. I
created a<br
clear="none">
> > >
10GB brick to
be mounted.
I'm unable to
mount the
volume. I
don't see any<br
clear="none">
> > >
thing in the
logs. has
anyone had the
same issues? I
was thinking I
need<br
clear="none">
> > >
to<br
clear="none">
> > >
install
gluster-client
but I don't
see in the
latest release
rpms.<br
clear="none">
> > >
<br
clear="none">
> > >
Data:<br
clear="none">
> > >
===========<br
clear="none">
> > >
<br
clear="none">
> > >
OS Version:<br
clear="none">
> > >
------------<br
clear="none">
> > >
<br
clear="none">
> > >
Description:
Enterprise
Linux
Enterprise
Linux Server
release 5.6<br
clear="none">
> > >
(Carthage<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
Installed
packages on
both servers<br
clear="none">
> > >
------------<br
clear="none">
> > >
<br
clear="none">
> > >
# rpm -qa |
grep gluster |
cat -n<br
clear="none">
> > >
1
glusterfs-libs-3.4.2-1.el5<br
clear="none">
> > >
2
glusterfs-3.4.2-1.el5<br
clear="none">
> > >
3
glusterfs-cli-3.4.2-1.el5<br
clear="none">
> > >
4
glusterfs-geo-replication-3.4.2-1.el5<br
clear="none">
> > >
5
glusterfs-fuse-3.4.2-1.el5<br
clear="none">
> > >
6
glusterfs-server-3.4.2-1.el5<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
gluster peer
probe
successful:<br
clear="none">
> > >
-----------<br
clear="none">
> > >
peer probe:
success: host
gcvs0139 port
24007 already
in peer list<br
clear="none">
> > >
<br
clear="none">
> > >
Gluster info:<br
clear="none">
> > >
---------<br
clear="none">
> > >
gluster volume
info | cat -n<br
clear="none">
> > >
1<br
clear="none">
> > >
2 Volume Name:
gv0<br
clear="none">
> > >
3 Type:
Replicate<br
clear="none">
> > >
4 Volume ID:
30a27041-ba1b-456f-b0bc-d8cdd2376c2f<br
clear="none">
> > >
5 Status:
Started<br
clear="none">
> > >
6 Number of
Bricks: 1 x 2
= 2<br
clear="none">
> > >
7
Transport-type:
tcp<br
clear="none">
> > >
8 Bricks:<br
clear="none">
> > >
9 Brick1:
gcvs0139:/data/gv0/brick1/app<br
clear="none">
> > >
10 Brick2:
gcvs4056:/data/gv0/brick1/app<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
Mount Failure:<br
clear="none">
> > >
----------<br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
[<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:root@gcvs4056"
target="_blank" href="mailto:root@gcvs4056">root@gcvs4056</a>
jbrewster]#
mount -t
glusterfs
gcvs4056:/gv0
/mnt<br
clear="none">
> > >
Mount failed.
Please check
the log file
for more
details.<br
clear="none">
> > >
<br
clear="none">
> > <br
clear="none">
> > I
bet you need
to modprobe
the fuse
module, in el5
its not loaded
by<br
clear="none">
> >
default.<br
clear="none">
> > <br
clear="none">
> > <br
clear="none">
> > -b<br
clear="none">
> > <br
clear="none">
> > >
<br
clear="none">
> > >
<br
clear="none">
> > >
_______________________________________________<br clear="none">
> > >
Gluster-users
mailing list<br
clear="none">
> > >
<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
ymailto="mailto:Gluster-users@gluster.org"
target="_blank" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br
clear="none">
> > >
<a
moz-do-not-send="true"
rel="nofollow"
shape="rect"
target="_blank"
href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd39346"><br clear="none">
<br
clear="none">
</div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd50926"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd55494"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd28858"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd73980"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd12528"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd51255"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd69270"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd53667"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd03321"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd87484"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd17785"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd15465"> <br clear="none">
<br clear="none">
</div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd37890"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd15325"> </div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd37653">
</div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd92381">
</div>
</div>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd13285"> <br
clear="none">
<fieldset
class="yiv6040385997mimeAttachmentHeader"></fieldset>
<br clear="none">
<pre>_______________________________________________
Gluster-users mailing list
<a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv6040385997moz-txt-link-abbreviated" ymailto="mailto:Gluster-users@gluster.org" target="_blank" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv6040385997moz-txt-link-freetext" target="_blank" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
</div>
</blockquote>
<div
class="yiv6040385997yqt1474259036"
id="yiv6040385997yqtfd46673"> <br
clear="none">
</div>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<br>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<br>
</body>
</html>