<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=ISO-8859-1">
</head>
<body bgcolor="#FFFFFF" text="#000000">
Hi,<br>
<br>
I'm trying to use glusterfs to mirror the ownCloud "data" area
between 2 servers.<br>
<br>
They are using debian jessie due to some dependancies that I have
for other components.<br>
<br>
This is where my issue rears it's ugly head. This is failing because
I can't stat the files and directories on my glusterfs mount.<br>
<br>
/var/www/owncloud/data is where I am mounting the volume and I can
reproduce the error using a simple php test application, so I don't
think that it is apache or owncloud related.<br>
<br>
I'd be grateful for any pointers on how to resolve this problem.<br>
<br>
Thanks,<br>
<br>
Bill<br>
<br>
Attached is "simple.php" test and the results of executing "strace
php5 simple.php" twice, once with the glusterfs mounted
(simple.php.strace-glusterfs) and once against the file system when
unmounted (simple.php.strace-unmounted).<br>
<br>
<hr size="2" width="100%"><br>
Here is what I get in the gluster log when I run the test (as root):<br>
<br>
/var/log/glusterfs/var-www-owncloud-data.log<br>
<tt><br>
</tt><tt>[2013-12-05 18:33:50.802250] D
[client-handshake.c:185:client_start_ping] 0-gv-ocdata-client-0:
returning as transport is already disconnected OR there are no
frames (0 || 0)</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825132] D
[afr-self-heal-common.c:138:afr_sh_print_pending_matrix]
0-gv-ocdata-replicate-0: pending_matrix: [ 0 0 ]</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825322] D
[afr-self-heal-common.c:138:afr_sh_print_pending_matrix]
0-gv-ocdata-replicate-0: pending_matrix: [ 0 0 ]</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825393] D
[afr-self-heal-common.c:887:afr_mark_sources]
0-gv-ocdata-replicate-0: Number of sources: 0</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825456] D
[afr-self-heal-data.c:825:afr_lookup_select_read_child_by_txn_type]
0-gv-ocdata-replicate-0: returning read_child: 0</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825511] D
[afr-common.c:1380:afr_lookup_select_read_child]
0-gv-ocdata-replicate-0: Source selected as 0 for /</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.825579] D
[afr-common.c:1117:afr_lookup_build_response_params]
0-gv-ocdata-replicate-0: Building lookup response from 0</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.827069] D
[afr-common.c:131:afr_lookup_xattr_req_prepare]
0-gv-ocdata-replicate-0: /check.txt: failed to get the gfid from
dict</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.829409] D
[client-handshake.c:185:client_start_ping] 0-gv-ocdata-client-0:
returning as transport is already disconnected OR there are no
frames (0 || 0)</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.836719] D
[afr-self-heal-common.c:138:afr_sh_print_pending_matrix]
0-gv-ocdata-replicate-0: pending_matrix: [ 0 0 ]</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.836870] D
[afr-self-heal-common.c:138:afr_sh_print_pending_matrix]
0-gv-ocdata-replicate-0: pending_matrix: [ 0 0 ]</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.836941] D
[afr-self-heal-common.c:887:afr_mark_sources]
0-gv-ocdata-replicate-0: Number of sources: 0</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.837002] D
[afr-self-heal-data.c:825:afr_lookup_select_read_child_by_txn_type]
0-gv-ocdata-replicate-0: returning read_child: 0</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.837058] D
[afr-common.c:1380:afr_lookup_select_read_child]
0-gv-ocdata-replicate-0: Source selected as 0 for /check.txt</tt><tt><br>
</tt><tt>[2013-12-05 18:33:50.837129] D
[afr-common.c:1117:afr_lookup_build_response_params]
0-gv-ocdata-replicate-0: Building lookup response from 0</tt><br>
<br>
Other bits of information<br>
<br>
<tt>root@bbb-1:/var/www/owncloud# uname -a</tt><tt><br>
</tt><tt>Linux bbb-1 3.8.13-bone30 #1 SMP Thu Nov 14 02:59:07 UTC
2013 armv7l GNU/Linux</tt><tt><br>
</tt><tt><br>
</tt><tt>root@bbb-1:/var/www/owncloud# dpkg -l glusterfs-*</tt><tt><br>
</tt><tt>Desired=Unknown/Install/Remove/Purge/Hold</tt><tt><br>
</tt><tt>|
Status=Not/Inst/Conf-files/Unpacked/halF-conf/Half-inst/trig-aWait/Trig-pend</tt><tt><br>
</tt><tt>|/ Err?=(none)/Reinst-required (Status,Err: uppercase=bad)</tt><tt><br>
</tt><tt>||/ Name
Version Architecture
Description</tt><tt><br>
</tt><tt>+++-============================================-===========================-===========================-==============================================================================================</tt><tt><br>
</tt><tt>ii glusterfs-client
3.4.1-1 armhf clustered
file-system (client package)</tt><tt><br>
</tt><tt>ii glusterfs-common
3.4.1-1 armhf GlusterFS
common libraries and translator modules</tt><tt><br>
</tt><tt>ii glusterfs-server
3.4.1-1 armhf clustered
file-system (server package)</tt><tt><br>
</tt><br>
mount<br>
<br>
<tt>bbb-1:gv-ocdata on /var/www/owncloud/data type fuse.glusterfs
(rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072)</tt><br>
<br>
/etc/fstab<br>
<br>
<tt>UUID=</tt><tt><tt><tt>xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx</tt></tt>
/sdhc ext4 defaults 0 0</tt><tt><br>
</tt><tt>bbb-1:gv-ocdata /var/www/owncloud/data glusterfs
defaults,_netdev,log-level=DEBUG 0 0</tt><br>
<br>
ls -al on the various paths<br>
<br>
<tt>root@bbb-1:/var/log/glusterfs# ll -d /sdhc/</tt><tt><br>
</tt><tt>drwxrwxr-x 7 root root 4096 Nov 28 19:15 /sdhc/</tt><tt><br>
</tt><tt><br>
root@bbb-1:/var/log/glusterfs# ll -d /sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>drwxrwx--- 5 www-data www-data 4096 Dec 5 00:50
/sdhc/gv-ocdata/</tt><tt><br>
</tt><tt><br>
root@bbb-1:/var/log/glusterfs# ll -d /sdhc/gv-ocdata/check.txt </tt><tt><br>
</tt><tt>-rw-r--r-- 2 root root 10 Dec 5 00:50
/sdhc/gv-ocdata/check.txt</tt><tt><br>
</tt><tt><br>
</tt><tt>root@bbb-1:/var/www/owncloud# ll -d /var/www/owncloud/data/</tt><tt><br>
</tt><tt>drwxrwx--- 5 www-data www-data 4096 Dec 5 00:50
/var/www/owncloud/data/</tt><tt><br>
</tt><tt><br>
root@bbb-1:/var/www/owncloud# ll -d
/var/www/owncloud/data/check.txt </tt><tt><br>
</tt><tt>-rw-r--r-- 1 root root 10 Dec 5 00:50
/var/www/owncloud/data/check.txt</tt><tt><br>
</tt><br>
file & dir attr information:<br>
<br>
<tt>root@bbb-1:/var/www/owncloud# attr -l /var/www/owncloud/data</tt><tt><br>
</tt><tt>Attribute "glusterfs.volume-id" has a 16 byte value for
/var/www/owncloud/data</tt><tt><br>
</tt><tt><br>
root@bbb-1:/var/www/owncloud# attr -l
/var/www/owncloud/data/check.txt </tt><tt><br>
</tt><tt>root@bbb-1:/var/www/owncloud# </tt><tt><br>
</tt><tt><br>
</tt><tt>root@bbb-1:/var/www/owncloud# attr -l /sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>Attribute "glusterfs.volume-id" has a 16 byte value for
/sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>Attribute "gfid" has a 16 byte value for /sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>Attribute "glusterfs.dht" has a 16 byte value for
/sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>Attribute "afr.gv-ocdata-client-0" has a 12 byte value for
/sdhc/gv-ocdata/</tt><tt><br>
</tt><tt>Attribute "afr.gv-ocdata-client-1" has a 12 byte value for
/sdhc/gv-ocdata/</tt><tt><br>
</tt><tt><br>
root@bbb-1:/var/www/owncloud# attr -l /sdhc/gv-ocdata/check.txt </tt><tt><br>
</tt><tt>Attribute "gfid" has a 16 byte value for
/sdhc/gv-ocdata/check.txt</tt><tt><br>
</tt><tt>Attribute "afr.gv-ocdata-client-0" has a 12 byte value for
/sdhc/gv-ocdata/check.txt</tt><tt><br>
</tt><tt>Attribute "afr.gv-ocdata-client-1" has a 12 byte value for
/sdhc/gv-ocdata/check.txt</tt><tt><br>
</tt><tt>root@bbb-1:/var/www/owncloud# </tt><tt><br>
</tt><br>
</body>
</html>