<html><body><div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12pt">Thanks. Still new to gluster. Just found a bunch of stuff under /var/lib/glusterd and this webpage<br><a href="http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-part-of-a-volume/">http://joejulian.name/blog/glusterfs-path-or-a-prefix-of-it-is-already-part-of-a-volume/</a><br><br>Cleaned up the bricks according to the URL and I was able to recreate the gluster volumes<br><br>[root@onode1 glusterd]# df -k|grep kvm<br>/dev/sdb1 10475504 32980 10442524 1% /data/glusterfs/kvm1/brick1<br>/dev/sdc1
10475504 32980 10442524 1% /data/glusterfs/kvm2/brick1<br><br>[root@onode2 glusterd]# df -k|grep kvm<br>/dev/sdb1 10475504 32980 10442524 1% /data/glusterfs/kvm1/brick2<br>/dev/sdc1 10475504 32980 10442524 1% /data/glusterfs/kvm2/brick2<br><br>[root@onode1 glusterd]# gluster volume create kvm1 replica 2 transport tcp onode1:/data/glusterfs/kvm1/brick1 onode2:/data/glusterfs/kvm1/brick2<br>volume create: kvm1: success: please start the volume to access data<br><br>[root@onode1 glusterd]# gluster volume create kvm2 replica 2 transport tcp onode1:/data/glusterfs/kvm2/brick1 onode2:/data/glusterfs/kvm2/brick2<br>volume create: kvm2:
success: please start the volume to access data<br><br>[root@onode1 glusterd]# gluster volume start kvm1<br>volume start: kvm1: success<br>[root@onode1 glusterd]# gluster volume start kvm2<br>volume start: kvm2: success<br><br>[root@onode1 glusterd]# gluster volume info<br><br>Volume Name: kvm1<br>Type: Replicate<br>Volume ID: d8f26ca7-23bc-41df-a299-d9567fcebd2e<br>Status: Started<br>Number of Bricks: 1 x 2 = 2<br>Transport-type: tcp<br>Bricks:<br>Brick1: onode1:/data/glusterfs/kvm1/brick1<br>Brick2: onode2:/data/glusterfs/kvm1/brick2<br><br>Volume Name: kvm2<br>Type: Replicate<br>Volume ID: 8f3dad35-ae18-4f0f-8cb9-4b722adc20ed<br>Status: Started<br>Number of Bricks: 1 x 2 = 2<br>Transport-type: tcp<br>Bricks:<br>Brick1: onode1:/data/glusterfs/kvm2/brick1<br>Brick2: onode2:/data/glusterfs/kvm2/brick2<br><br><div><span><br></span></div><div style="display: block;" class="yahoo_quoted"> <br> <br> <div style="font-family: HelveticaNeue, Helvetica Neue,
Helvetica, Arial, Lucida Grande, sans-serif; font-size: 12pt;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 12pt;"> <div dir="ltr"> <font size="2" face="Arial"> On Friday, December 27, 2013 11:21 AM, BGM <bernhard.glomm@ecologic.eu> wrote:<br> </font> </div> <div class="y_msg_container"><div id="yiv1250944234"><div><div>with kvm2 u only got onode1 listed as the host?</div><div>sure there is no typo nowhere?</div><div><br clear="none"></div><div>next: AFAIK with the path you give rather</div><div>kvm1 and kvm2 should be the montpoints for your xfs</div><div>while you use the directory brick1/2 to create the gluservolume (or you have to use --force, right?)</div><div><br clear="none"></div><div>next: if volume creation fails, make sure you whip out the paths on BOTH sides</div><div>(i.e. unset the attr flags and remove the .glusterfs directory from inside the brick path... though
know what you are doing!)</div><div><br clear="none"></div><div>I found the later normaly solves this error.</div><div>Gluster seems to set at least one of the attr on at least one side already and don't roll it back although not the whole operation succeeded.</div><div>Unsetting and redoing without typos or other errors (partner daemon reachable? both partner peered with same adress/name?)</div><div><br clear="none"></div><div>hth</div><div>Bernhard</div><div class="yiv1250944234yqt1613892701" id="yiv1250944234yqt13680"><div><br clear="none">On 27.12.2013, at 15:27, William Kwan <<a rel="nofollow" shape="rect" ymailto="mailto:potatok@yahoo.com" target="_blank" href="mailto:potatok@yahoo.com">potatok@yahoo.com</a>> wrote:<br clear="none"><br clear="none"></div><blockquote type="cite"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;font-size:12pt;"><div><span>May be it is confusing or I'm using the wrong naming conventions. what I'm actually testing is</span></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><br clear="none"><span></span></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><span>Each node has one brick for each of glusterfs kvm1 and kvm2</span></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><span><span class="yiv1250944234tab">So
glusterfs kvm1 will have<br clear="none"></span></span></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><span class="yiv1250944234tab"> </span>onode1:/data/glusterfs/kvm1/brick1<br clear="none"></div><div><span class="yiv1250944234tab"> </span>onode2:/data/glusterfs/kvm1/brick2<br clear="none"><br clear="none">while kvm2 will have two bricks<br clear="none"><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><span class="yiv1250944234tab"> </span>onode1:/data/glusterfs/kvm2/brick1</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;background-color:transparent;font-style:normal;"><span class="yiv1250944234tab">
</span>onode1:/data/glusterfs/kvm2/brick2</div><br clear="none">On both systems, "brick1" and "brick2" are mount points of xfs file systems<br clear="none"><br clear="none">Now create volume kvm1 was successful while kvm2 is not.<br clear="none">volume create: kvm2: failed: /data/glusterfs/kvm2/brick1 or a prefix of it is already part of a volume<br clear="none"><br clear="none">Thanks<br clear="none">W<br clear="none"><br clear="none"><br clear="none"></div><div class="yiv1250944234yahoo_quoted" style="display:block;"> <br clear="none"> <br clear="none"> <div style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12pt;"> <div style="font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12pt;"> <div dir="ltr"> <font size="2" face="Arial"> On Thursday, December 26, 2013 5:24 PM, William Kwan <<a rel="nofollow" shape="rect" ymailto="mailto:potatok@yahoo.com"
target="_blank" href="mailto:potatok@yahoo.com">potatok@yahoo.com</a>> wrote:<br clear="none"> </font> </div> <div class="yiv1250944234y_msg_container"><div id="yiv1250944234"><div><div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:12pt;">Hi all,<br clear="none"><br clear="none">Running 3.4.1 on Centos6.<br clear="none"><br clear="none">I have this issue, I created two xfs filesystem on each of two hosts<br clear="none">onode1:/data/glusterfs/kvm1/brick1<br clear="none"><div>onode2:/data/glusterfs/kvm1/brick2</div><div><br clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">onode1:/data/glusterfs/kvm2/brick1</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica,
Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">onode1:/data/glusterfs/kvm2/brick2</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><br clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">The first volume was created successfully</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"># gluster volume create kvm1 replica 2 transport tcp onode1:/data/glusterfs/kvm1/brick1 onode2:/data/glusterfs/kvm1/brick2</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica,
Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><br clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">When I attempt to create the second volume, I got </div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"># gluster volume create kvm2 replica 2 transport tcp onode1:/data/glusterfs/kvm2/brick1 onode2:/data/glusterfs/kvm2/brick2<br clear="none">volume create: kvm2: failed: /data/glusterfs/kvm2/brick1 or a prefix of it is already part of a volume</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><br
clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">I'm not sure I follow what the error means. The 2nd set of
filesystems have to mount under a totally different directory structure?</div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;"><br clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">Thanks in advance<br clear="none"></div><div style="color:rgb(0, 0, 0);font-size:16px;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;background-color:transparent;font-style:normal;">Will<br clear="none"></div></div></div></div><br clear="none"><br clear="none"></div> </div> </div> </div> </div></div></blockquote></div><blockquote type="cite"><div><span>_______________________________________________</span><br clear="none"><span>Gluster-users mailing
list</span><br clear="none"><span><a rel="nofollow" shape="rect" ymailto="mailto:Gluster-users@gluster.org" target="_blank" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a></span><br clear="none"><span><a rel="nofollow" shape="rect" target="_blank" href="http://supercolony.gluster.org/mailman/listinfo/gluster-users">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></span></div></blockquote></div></div><br><br></div> </div> </div> </div> </div></body></html>