<div dir="ltr">We found that it is not gluster issue but zfs.<div><br></div><div><div>[root@fractal-c92e mnt]# touch testfile</div><div><br></div><div>[root@fractal-c92e mnt]# setfacl -m u:14:r testfile</div><div>setfacl: testfile: Operation not supported<br></div></div><div><br></div><div>Thanks,</div><div>Kiran</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 25, 2014 at 10:59 AM, Kiran Patil <span dir="ltr"><<a href="mailto:kiran@fractalio.com" target="_blank">kiran@fractalio.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">d-backends-brick0.log file contents:<div>-----------------------------------------------</div><div><div>[2014-11-25 05:11:33.080409] I [MSGID: 100030] [glusterfsd.c:2018:main] 0-/usr/local/sbin/glusterfsd: Started running /usr/local/sbin/glusterfsd version 3.6.1 (args: /usr/local/sbin/glusterfsd -s fractal-c92e.fractal.lan --volfile-id patchy.fractal-c92e.fractal.lan.d-backends-brick0 -p /var/lib/glusterd/vols/patchy/run/fractal-c92e.fractal.lan-d-backends-brick0.pid -S /var/run/cfe03a7c541a9c1c850d543e6e0918ac.socket --brick-name /d/backends/brick0 -l /var/log/glusterfs/bricks/d-backends-brick0.log --xlator-option *-posix.glusterd-uuid=c96fcb89-965a-4c5c-902a-6a9a80441119 --brick-port 49152 --xlator-option patchy-server.listen-port=49152)</div><div>[2014-11-25 05:11:33.116700] I [graph.c:269:gf_add_cmdline_options] 0-patchy-server: adding option 'listen-port' for volume 'patchy-server' with value '49152'</div><div>[2014-11-25 05:11:33.116761] I [graph.c:269:gf_add_cmdline_options] 0-patchy-posix: adding option 'glusterd-uuid' for volume 'patchy-posix' with value 'c96fcb89-965a-4c5c-902a-6a9a80441119'</div><div>[2014-11-25 05:11:33.119334] I [rpcsvc.c:2142:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64</div><div>[2014-11-25 05:11:33.119548] W [options.c:898:xl_opt_validate] 0-patchy-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction</div><div>[2014-11-25 05:11:33.174277] W [posix.c:5681:init] 0-patchy-posix: Posix access control list is not supported.</div><div>[2014-11-25 05:11:33.181185] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-glusterfs' is not recognized</div><div>[2014-11-25 05:11:33.181295] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-unix' is not recognized</div><div>[2014-11-25 05:11:33.181337] W [graph.c:344:_log_if_unknown_option] 0-patchy-server: option 'rpc-auth.auth-null' is not recognized</div><div>[2014-11-25 05:11:33.181406] W [graph.c:344:_log_if_unknown_option] 0-patchy-quota: option 'timeout' is not recognized</div><div>Final graph:</div><div>+------------------------------------------------------------------------------+</div><div> 1: volume patchy-posix</div><div> 2: type storage/posix</div><div> 3: option glusterd-uuid c96fcb89-965a-4c5c-902a-6a9a80441119</div><div> 4: option directory /d/backends/brick0</div><div> 5: option volume-id 3338a2e4-7c97-4462-854e-e0eee73dc707</div><div> 6: end-volume</div><div> 7: </div><div> 8: volume patchy-changelog</div><div> 9: type features/changelog</div><div> 10: option changelog-brick /d/backends/brick0</div><div> 11: option changelog-dir /d/backends/brick0/.glusterfs/changelogs</div><div> 12: option changelog-barrier-timeout 120</div><div> 13: subvolumes patchy-posix</div><div> 14: end-volume</div><div> 15: </div><div> 16: volume patchy-access-control</div><div> 17: type features/access-control</div><div> 18: subvolumes patchy-changelog</div><div> 19: end-volume</div><div> 20: </div><div> 21: volume patchy-locks</div><div> 22: type features/locks</div><div> 23: subvolumes patchy-access-control</div><div> 24: end-volume</div><div> 25: </div><div> 26: volume patchy-io-threads</div><div> 27: type performance/io-threads</div><div> 28: subvolumes patchy-locks</div><div> 29: end-volume</div><div> 30: </div><div> 31: volume patchy-barrier</div><div> 32: type features/barrier</div><div> 33: option barrier disable</div><div> 34: option barrier-timeout 120</div><div> 35: subvolumes patchy-io-threads</div><div> 36: end-volume</div><div> 37: </div><div> 38: volume patchy-index</div><div> 39: type features/index</div><div> 40: option index-base /d/backends/brick0/.glusterfs/indices</div><div> 41: subvolumes patchy-barrier</div><div> 42: end-volume</div><div> 43: </div><div> 44: volume patchy-marker</div><div> 45: type features/marker</div><div> 46: option volume-uuid 3338a2e4-7c97-4462-854e-e0eee73dc707</div><div> 47: option timestamp-file /var/lib/glusterd/vols/patchy/marker.tstamp</div><div> 48: option xtime off</div><div> 49: option gsync-force-xtime off</div><div> 50: option quota off</div><div> 51: subvolumes patchy-index</div><div> 52: end-volume</div><div> 53: </div><div> 54: volume patchy-quota</div><div> 55: type features/quota</div><div> 56: option volume-uuid patchy</div><div> 57: option server-quota off</div><div> 58: option timeout 0</div><div> 59: option deem-statfs off</div><div> 60: subvolumes patchy-marker</div><div> 61: end-volume</div><div> 62: </div><div> 63: volume /d/backends/brick0</div><div> 64: type debug/io-stats</div><div> 65: option latency-measurement off</div><div> 66: option count-fop-hits off</div><div> 67: subvolumes patchy-quota</div><div> 68: end-volume</div><div> 69: </div><div> 70: volume patchy-server</div><div> 71: type protocol/server</div><div> 72: option transport.socket.listen-port 49152</div><div> 73: option rpc-auth.auth-glusterfs on</div><div> 74: option rpc-auth.auth-unix on</div><div> 75: option rpc-auth.auth-null on</div><div> 76: option transport-type tcp</div><div> 77: option auth.login./d/backends/brick0.allow 2725ffee-f51f-4553-a3dc-143f69b50115</div><div> 78: option auth.login.2725ffee-f51f-4553-a3dc-143f69b50115.password 18f7d813-349b-476e-81a5-3d348e661d60</div><div> 79: option auth.addr./d/backends/brick0.allow *</div><div> 80: subvolumes /d/backends/brick0</div><div> 81: end-volume</div><div> 82: </div><div>+------------------------------------------------------------------------------+</div><div>[2014-11-25 05:11:37.098820] I [login.c:82:gf_auth] 0-auth/login: allowed user names: 2725ffee-f51f-4553-a3dc-143f69b50115</div><div>[2014-11-25 05:11:37.098881] I [server-handshake.c:585:server_setvolume] 0-patchy-server: accepted client from fractal-c92e.fractal.lan-2793-2014/11/25-05:11:33:79268-patchy-client-0-0-0 (version: 3.6.1)</div><div>[2014-11-25 05:12:49.700853] E [posix-helpers.c:939:posix_handle_pair] 0-patchy-posix: /d/backends/brick0/.glusterfs/b4/9b/b49bdf80-6af2-4750-a8ad-fdb56920657a: key:system.posix_acl_access flags: 0 length:44 error:Operation not supported</div></div><div><br><div>Thanks,</div><div>Kiran</div></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Nov 25, 2014 at 12:10 AM, Vijay Bellur <span dir="ltr"><<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>On 11/24/2014 05:55 PM, Kiran Patil wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
getrlimit(RLIMIT_NOFILE, {rlim_cur=1024, rlim_max=4*1024}) = 0<br>
lstat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0<br>
getxattr("testfile", "system.posix_acl_access", 0x7fff9ce10d00, 132) =<br>
-1 ENODATA (No data available)<br>
stat("testfile", {st_mode=S_IFREG|0644, st_size=0, ...}) = 0<br>
setxattr("testfile", "system.posix_acl_access",<br>
"\x02\x00\x00\x00\x01\x00\x06\<u></u>x00\xff\xff\xff\xff\x02\x00\<u></u>x04\x00\x0e\x00\x00\x00\x04\<u></u>x00\x04\x00\xff\xff\xff\xff\<u></u>x10\x00\x04\x00\xff\xff\xff\<u></u>xff<br>
\x00\x04\x00\xff\xff\xff\xff", 44, 0) = -1 EREMOTEIO (Remote I/O error)<br>
</blockquote>
<br></span>
Do you happen to know from the logs which translator sends back this error? Logs from the brick that contain "testfile" and the nfs server to which the nfs client is connected would be a good place to begin with.<br>
<br>
Thanks,<br>
Vijay<br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>