<html><head><style type='text/css'>p { margin: 0; }</style></head><body><div style='font-family: times new roman,new york,times,serif; font-size: 12pt; color: #000000'><style>p { margin: 0; }</style><div style="font-family: times new roman,new york,times,serif; font-size: 12pt; color: rgb(0, 0, 0);">OK thanks, I see them now. I wish I could have found somewhere where that was documented, or a post someone made referring to that.<br><br>This all came about because a directory exists from the user view that I wanted to delete. When trying to delete it said "directory not empty" from the user view. On the node side 1 node node still contained data in the directory. I think the directory was added during testing, no sure how.<br><br>(glusterfs mounted on /glusterfs_distribute01)<br>[root@nas1 ~]# ls /glusterfs_distribute01/IT2/<br><br>(XFS file syste mounted on each node on distribute01/)<br><br>[root@clus-node1 ~]# ls /distribute01/IT2<br>[root@clus-node2 ~]# ls /distribute01/IT2<br>[root@clus-node3 ~]# ls /distribute01/IT2<br>omero_data<br>[root@clus-node4 ~]# ls /distribute01/IT2<br><br>[root@nas1 ~]# rm -Rf /glusterfs_distribute01/IT2<br>rm: cannot remove directory `/glusterfs_distribute01/IT2': Directory not empty<br><br><br>So gluster nodes don't agree on the backend with the directory contents. I attempted rebalance "fix-layout" and rebalance "migrate-data" didn't seem to make a difference with that 1 directory "IT2". <br><br><div><span></span>Kent<span></span><br></div><br><hr id="zwchr"><b>From: </b>"Ove K. Pettersen" <ove.k.pettersen@gmail.com><br><b>To: </b>gluster-users@gluster.org<br><b>Sent: </b>Thursday, February 9, 2012 11:57:06 AM<br><b>Subject: </b>Re: [Gluster-users] GFIDs not showing up as extended attributes<br><br>Hi...<br><br>I don't think you will see any gluster-related extended attributes on <br>your /glusterfs_distribute01 directory.<br><br>Try to have a look for them on the bricks (cln1:/distribute01).<br><br><br>On my system I only see extended attributes on the bricks.<br>None visible on the glusterfs-mounted directory. Don't think they are <br>needed to be visible there, since its the "users" view of the filesystem.<br><br>(I also use XFS on the bricks and 3.2.5)<br><br>Regards,<br><br><br><br>Den 09.02.2012 17:42, skrev Kent Nasveschuk:<br>> I am runing CenOS 5.7 on 4 nodes with gluster 3.2.5. I have 1<br>> distributed volume with 1 brick on each node:<br>> [root@clus-node1 ~]# gluster volume info<br>><br>> Volume Name: distribute01<br>> Type: Distribute<br>> Status: Started<br>> Number of Bricks: 4<br>> Transport-type: tcp<br>> Bricks:<br>> Brick1: cln1:/distribute01<br>> Brick2: cln2:/distribute01<br>> Brick3: cln3:/distribute01<br>> Brick4: cln4:/distribute01<br>> Options Reconfigured:<br>> performance.write-behind: on<br>> performance.cache-size: 256MB<br>><br>> The file system for each brick is XFS mounted as such:<br>> [root@clus-node1 ~]# mount<br>> ...<br>> /dev/sdb1 on /distribute01 type xfs (rw,noatime,nodiratime)<br>> ...<br>><br>><br>> Using the native gluster client 3.2.5, on another server, I've mounted<br>> volume "distribute01"<br>> [root@nas1 ~]# mount<br>> ...<br>> glusterfs#172.30.5.18:/distribute01 on /glusterfs_distribute01 type fuse<br>> (rw,allow_other,default_permissions,max_read=131072)<br>> ...<br>><br>> I have yet to find any file/directory with extended attribute,<br>> expecially "trusted.gfid" (don't know what other attributes may be<br>> used). I can set an attribute through the gluster client mounted file<br>> system:<br>><br>> [root@nas1 ~]# setfattr -n user.foo -v<br>> test /glusterfs_distribute01/IT/test.txt<br>> [root@nas1 ~]# attr -l /glusterfs_distribute01/IT/test.txt<br>> Attribute "foo" has a 4 byte value<br>> for /glusterfs_distribute01/IT/test.txt<br>> [root@nas1 ~]# getfattr -n user.foo /glusterfs_distribute01/IT/test.txt<br>> getfattr: Removing leading '/' from absolute path names<br>> # file: glusterfs_distribute01/IT/test.txt<br>> user.foo="test"<br>><br>> setfattr -x user.foo /glusterfs_distribute01/IT/test.txt<br>><br>> The file system supports extended attributes, however there are NO<br>> attributes associated with any files or directories.<br>><br>> Logs are full of "no gfid found"<br>><br>> If I run attr -l<any file> returns nothing<br>><br>> Any help would be appreciated, seems like a gross misconfiguration<br>> somewhere.<br>><br>><br>> _______________________________________________<br>> Gluster-users mailing list<br>> Gluster-users@gluster.org<br>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users<br>><br><br>_______________________________________________<br>Gluster-users mailing list<br>Gluster-users@gluster.org<br>http://gluster.org/cgi-bin/mailman/listinfo/gluster-users<br></div></div></body></html>