<html><body><div style="color:#000; background-color:#fff; font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:10pt"><div><span>On a related note: Now that the PoC has been completed, I'm not able to migrate back to the original brick because of the undocumented, save-you-from-yourself file system attribute feature:</span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda8 192.168.1.1:/srv/sda7 start<br>> /srv/sda7 or a prefix of it is already part of a volume<br></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family:
Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>Is there a simpler, more-direct method of migrating back to the original brick or should I wipe the file system attributes manually? I only ask because:</span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span><br></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>1. the long-term effects of this strategy aren't addressed in the Administration Guide AFAICT, and;<br></span></div><div style="color:
rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>2. though the intent of the feature has merit, it lacks elegance. e.g., the addition of a "force" attribute<br></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span> </span><span><span> (like </span>that of the commit feature) could be justified in this instance, IMHO.</span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span><br></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>
> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda8 192.168.1.1:/srv/sda7 start force<br> > Usage: volume replace-brick <VOLNAME> <BRICK> <NEW-BRICK> {start|pause|abort|status|commit [force]}<br></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><br><span></span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>Eric Pretorious</span></div><div style="color: rgb(0, 0, 0); font-size: 13.3333px; font-family: Courier New,courier,monaco,monospace,sans-serif; background-color: transparent; font-style: normal;"><span>Truckee, CA<br></span></div><div><br><blockquote style="border-left: 2px solid rgb(16, 16, 255); margin-left: 5px; margin-top: 5px;
padding-left: 5px;"> <div style="font-family: Courier New, courier, monaco, monospace, sans-serif; font-size: 10pt;"> <div style="font-family: times new roman, new york, times, serif; font-size: 12pt;"> <div dir="ltr"> <font face="Arial" size="2"> <hr size="1"> <b><span style="font-weight:bold;">From:</span></b> Eric <epretorious@yahoo.com><br> <b><span style="font-weight: bold;">To:</span></b> "gluster-users@gluster.org" <gluster-users@gluster.org> <br> <b><span style="font-weight: bold;">Sent:</span></b> Wednesday, September 5, 2012 5:27 PM<br> <b><span style="font-weight: bold;">Subject:</span></b> Re: [Gluster-users] migration operations: Stopping a migration<br> </font> </div> <br>
<div id="yiv1878189961"><div><div style="color:#000;background-color:#fff;font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:10pt;"><div><span>On a hunch, I attempted the "volume replace-brick <VOLNAME> <BRICK> <NEW-BRICK> commit" command and, without much fanfare, the volume information was updated:</span></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br><span></span></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><span>> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda7 192.168.1.1:/srv/sda8 commit<br>> replace-brick commit successful<br>> <br>> gluster> volume info<br>> <br>> Volume Name: Repositories<br>> Type:
Distributed-Replicate<br>> Volume ID: 926262ae-2aa6-4bf7-b19e-cf674431b06c<br>> Status: Started<br>> Number of Bricks: 2 x 2 = 4<br>> Transport-type: tcp<br>> Bricks:<br>> Brick1: 192.168.1.1:/srv/sda8<br>> Brick2: 192.168.1.2:/srv/sda7<br>> Brick3: 192.168.1.1:/srv/sdb7<br>> Brick4: 192.168.1.2:/srv/sdb7<br>> <br>> gluster> volume status<br>> Status of volume: Repositories<br>> Gluster process Port Online Pid<br>> ------------------------------------------------------------------------------<br>> Brick 192.168.1.1:/srv/sda8 24012 Y 13796<br>> Brick 192.168.1.2:/srv/sda7
24009 Y 4946<br>> Brick 192.168.1.1:/srv/sdb7 24010 Y 5438<br>> Brick 192.168.1.2:/srv/sdb7 24010 Y 4951<br>> NFS Server on localhost 38467 Y 13803<br>> Self-heal Daemon on localhost N/A Y 13808<br>> NFS Server on 192.168.1.2 38467 Y 7969<br>> Self-heal Daemon on 192.168.1.2
N/A Y 7974<br><br></span></div><div>The XFS attributes are still intact on the old brick, however:</div><div><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">> [eric@sn1 ~]$ for x in sda7 sdb7 sda8 ; do sudo getfattr -m - /srv/$x 2> /dev/null ; done<br>> # file: srv/sda7<br>> trusted.afr.Repositories-client-0<br>> trusted.afr.Repositories-client-1<br>> trusted.afr.Repositories-io-threads<br>> trusted.afr.Repositories-replace-brick<br>> trusted.gfid<br>> trusted.glusterfs.dht<br>> trusted.glusterfs.volume-id<br>> <br>> # file: srv/sdb7<br>> trusted.afr.Repositories-client-2<br>> trusted.afr.Repositories-client-3<br>> trusted.gfid<br>> trusted.glusterfs.dht<br>> trusted.glusterfs.volume-id<br>> <br>> # file:
srv/sda8<br>> trusted.afr.Repositories-io-threads<br>> trusted.afr.Repositories-replace-brick<br>> trusted.gfid<br>> trusted.glusterfs.volume-id<br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Is this intentional (i.e., leaving the the attributes intact)? Or functionality that has yet to be implemented?</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Eric
Pretorious</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Truckee, CA</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><blockquote style="border-left:2px solid rgb(16, 16, 255);margin-left:5px;margin-top:5px;padding-left:5px;"> <div style="font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:10pt;"> <div style="font-family:times new roman, new york, times, serif;font-size:12pt;"> <div dir="ltr"> <font face="Arial" size="2"> <hr size="1"> <b><span style="font-weight:bold;">From:</span></b> Eric
<epretorious@yahoo.com><br> <b><span style="font-weight:bold;">To:</span></b> "gluster-users@gluster.org" <gluster-users@gluster.org> <br> <b><span style="font-weight:bold;">Sent:</span></b> Wednesday, September 5, 2012 5:05 PM<br> <b><span style="font-weight:bold;">Subject:</span></b> [Gluster-users] migration operations: Stopping a migration<br> </font> </div> <br>
<div id="yiv1878189961"><div><div style="color:#000;background-color:#fff;font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:10pt;"><div>I've created a distributed replicated volume:</div><div><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">> gluster> volume info<br>> <br>> Volume Name: Repositories<br>> Type: Distributed-Replicate<br>> Volume ID: 926262ae-2aa6-4bf7-b19e-cf674431b06c<br>> Status: Started<br>> Number of Bricks: 2 x 2 = 4<br>> Transport-type: tcp<br>> Bricks:<br>> Brick1: 192.168.1.1:/srv/sda7<br>> Brick2: 192.168.1.2:/srv/sda7<br>> Brick3: 192.168.1.1:/srv/sdb7<br>> Brick4: 192.168.1.2:/srv/sdb7<br></div><div><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace,
sans-serif;background-color:transparent;font-style:normal;">...and begun migrating data from one brick to another as a PoC:</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda7 192.168.1.1:/srv/sda8 start<br>> replace-brick started successfully<br>> <br>> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda7 192.168.1.1:/srv/sda8 status<br>> Number of files migrated = 5147 Current file= /centos/5.8/os/x86_64/CentOS/gnome-pilot-conduits-2.0.13-7.el5.x86_64.rpm <br>> gluster> volume replace-brick Repositories 192.168.1.1:/srv/sda7
192.168.1.1:/srv/sda8 status<br>> Number of files migrated = 24631 Migration complete <br><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">After the migration is finished, though, the list of bricks is wrong:<br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">> gluster> volume heal Repositories
info <br>> Heal operation on volume Repositories has been successful<br>> <br>> Brick 192.168.1.1:/srv/sda7<br>> Number of entries: 0<br>> <br>> Brick 192.168.1.2:/srv/sda7<br>> Number of entries: 0<br>> <br>> Brick 192.168.1.1:/srv/sdb7<br>> Number of entries: 0<br>> <br>> Brick 192.168.1.2:/srv/sdb7<br>> Number of entries: 0</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New,
courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">...and the XFS attributes are still intact on the old brick:</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">> [eric@sn1 ~]$ for x in sda7 sdb7 sda8 ; do sudo getfattr -m - /srv/$x 2> /dev/null ; done<br>> # file: srv/sda7<br>> trusted.afr.Repositories-client-0<br>> trusted.afr.Repositories-client-1<br>> trusted.afr.Repositories-io-threads<br>> trusted.afr.Repositories-replace-brick<br>> trusted.gfid<br>> trusted.glusterfs.dht<br>> trusted.glusterfs.pump-path<br>> trusted.glusterfs.volume-id<br>> <br>> # file:
srv/sdb7<br>> trusted.afr.Repositories-client-2<br>> trusted.afr.Repositories-client-3<br>> trusted.gfid<br>> trusted.glusterfs.dht<br>> trusted.glusterfs.volume-id<br>> <br>> # file: srv/sda8<br>> trusted.afr.Repositories-io-threads<br>> trusted.afr.Repositories-replace-brick<br>> trusted.gfid<br>> trusted.glusterfs.volume-id<br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Have I missed a step? Or: Is this (i.e., clean-up) a bug or functionality that hasn't been implemented yet?</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace,
sans-serif;background-color:transparent;font-style:normal;"><br></div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Eric Pretorious</div><div style="color:rgb(0, 0, 0);font-size:13.3333px;font-family:Courier New, courier, monaco, monospace, sans-serif;background-color:transparent;font-style:normal;">Truckee, CA<br></div></div></div></div><br>_______________________________________________<br>Gluster-users mailing list<br><a rel="nofollow" ymailto="mailto:Gluster-users@gluster.org" target="_blank" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br><a rel="nofollow" target="_blank" href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br><br><br> </div> </div> </blockquote></div>
</div></div></div><br>_______________________________________________<br>Gluster-users mailing list<br><a ymailto="mailto:Gluster-users@gluster.org" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br><a href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users" target="_blank">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a><br><br><br> </div> </div> </blockquote></div> </div></body></html>