Gordan Bobic send me your kernel/initrd image and also fuse version, glusterfs version and your spec files.<br><br><div class="gmail_quote">On Sun, Nov 23, 2008 at 7:25 AM, Gordan Bobic <span dir="ltr"><<a href="mailto:gordan@bobich.net">gordan@bobich.net</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">I'm trying to add GlusterFS support to the Open Shared Root project, and I'm hitting a problem that is a bit difficult to debug. GlusterFS works fine in the normal full-fat environment (RHEL5), but I can't seem to get it to mount the volume in the init-root environment.<br>
<br>
Things I have checked so far:<br>
<br>
All the libraries and dependencies that glusterfs package lists are included in the initroot:<br>
<br>
# rpm -q --requires glusterfs<br>
/bin/sh<br>
/bin/sh<br>
config(glusterfs) = 1.3.12-1<br>
libc.so.6()(64bit)<br>
libc.so.6(GLIBC_2.2.5)(64bit)<br>
libc.so.6(GLIBC_2.3)(64bit)<br>
libc.so.6(GLIBC_2.3.2)(64bit)<br>
libc.so.6(GLIBC_2.3.3)(64bit)<br>
libdl.so.2()(64bit)<br>
libdl.so.2(GLIBC_2.2.5)(64bit)<br>
libfuse.so.2()(64bit)<br>
libfuse.so.2(FUSE_2.4)(64bit)<br>
libfuse.so.2(FUSE_2.5)(64bit)<br>
libfuse.so.2(FUSE_2.6)(64bit)<br>
libglusterfs.so.0()(64bit)<br>
libibverbs.so.1()(64bit)<br>
libibverbs.so.1(IBVERBS_1.0)(64bit)<br>
libibverbs.so.1(IBVERBS_1.1)(64bit)<br>
libpthread.so.0()(64bit)<br>
libpthread.so.0(GLIBC_2.2.5)(64bit)<br>
libpthread.so.0(GLIBC_2.3.2)(64bit)<br>
rpmlib(CompressedFileNames) <= 3.0.4-1<br>
rpmlib(PayloadFilesHavePrefix) <= 4.0-1<br>
rtld(GNU_HASH)<br>
<br>
The fuse driver is loaded and the device node is there:<br>
# ls -la dev/fuse<br>
crw------- 1 root root 10, 229 Nov 22 22:59 dev/fuse<br>
<br>
There are no errors reported on the console.<br>
<br>
Here is what the debug level log reports:<br>
# cat glusterfs.log<br>
2008-11-23 01:34:16 D [glusterfs.c:167:get_spec_fp] glusterfs: loading spec from /etc/glusterfs/root.vol<br>
2008-11-23 01:34:16 D [spec.y:107:new_section] parser: New node for 'root2'<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/protocol/client.so<br>
2008-11-23 01:34:16 D [spec.y:127:section_type] parser: Type:root2:protocol/client<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:root2:transport-type:tcp/client<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:root2:remote-host:<a href="http://192.168.10.2" target="_blank">192.168.10.2</a><br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:root2:remote-subvolume:root2<br>
2008-11-23 01:34:16 D [spec.y:209:section_end] parser: end:root2<br>
2008-11-23 01:34:16 D [spec.y:107:new_section] parser: New node for 'root-store'<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/storage/posix.so<br>
2008-11-23 01:34:16 D [spec.y:127:section_type] parser: Type:root-store:storage/posix<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:root-store:directory:/mnt/tmproot/gluster/root<br>
2008-11-23 01:34:16 D [spec.y:209:section_end] parser: end:root-store<br>
2008-11-23 01:34:16 D [spec.y:107:new_section] parser: New node for 'root1'<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/features/posix-locks.so<br>
2008-11-23 01:34:16 D [xlator.c:145:xlator_set_type] xlator: dlsym(notify) on /usr/lib64/glusterfs/1.3.12/xlator/features/posix-locks.so: undefined symbol: notify -- neglecting<br>
2008-11-23 01:34:16 D [spec.y:127:section_type] parser: Type:root1:features/posix-locks<br>
2008-11-23 01:34:16 D [spec.y:196:section_sub] parser: child:root1->root-store<br>
2008-11-23 01:34:16 D [spec.y:209:section_end] parser: end:root1<br>
2008-11-23 01:34:16 D [spec.y:107:new_section] parser: New node for 'server'<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/protocol/server.so<br>
2008-11-23 01:34:16 D [spec.y:127:section_type] parser: Type:server:protocol/server<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:server:transport-type:tcp/server<br>
2008-11-23 01:34:16 D [spec.y:196:section_sub] parser: child:server->root1<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:server:auth.ip.root1.allow:<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,192.168.*<br>
2008-11-23 01:34:16 D [spec.y:209:section_end] parser: end:server<br>
2008-11-23 01:34:16 D [spec.y:107:new_section] parser: New node for 'root'<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/cluster/afr.so<br>
2008-11-23 01:34:16 D [spec.y:127:section_type] parser: Type:root:cluster/afr<br>
2008-11-23 01:34:16 D [spec.y:196:section_sub] parser: child:root->root1<br>
2008-11-23 01:34:16 D [spec.y:196:section_sub] parser: child:root->root2<br>
2008-11-23 01:34:16 D [spec.y:141:section_option] parser: Option:root:read-subvolume:root1<br>
2008-11-23 01:34:16 D [spec.y:209:section_end] parser: end:root<br>
2008-11-23 01:34:16 D [glusterfs.c:128:fuse_graph] glusterfs: setting option mount-point to /mnt/newroot<br>
2008-11-23 01:34:16 D [xlator.c:115:xlator_set_type] xlator: attempt to load file /usr/lib64/glusterfs/1.3.12/xlator/mount/fuse.so<br>
2008-11-23 01:34:16 E [fuse-bridge.c:2699:init] glusterfs-fuse: fuse_mount failed (Inappropriate ioctl for device)<br>
<br>
2008-11-23 01:34:16 E [glusterfs.c:547:main] glusterfs: Initializing FUSE failed<br>
<br>
And here is the root volume spec:<br>
# cat /etc/glusterfs/root.vol<br>
volume root2<br>
type protocol/client<br>
option transport-type tcp/client<br>
#option transport-type socket<br>
#option address-family inet<br>
option remote-host <a href="http://192.168.10.2" target="_blank">192.168.10.2</a><br>
option remote-subvolume root2<br>
end-volume<br>
<br>
volume root-store<br>
type storage/posix<br>
option directory /mnt/tmproot/gluster/root<br>
end-volume<br>
<br>
volume root1<br>
type features/posix-locks<br>
subvolumes root-store<br>
end-volume<br>
<br>
volume server<br>
type protocol/server<br>
option transport-type tcp/server<br>
#option transport-type socket<br>
#option address-family inet<br>
subvolumes root1<br>
option auth.ip.root1.allow <a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,192.168.*<br>
#option auth.addr.root1.allow <a href="http://127.0.0.1" target="_blank">127.0.0.1</a>,192.168.*<br>
end-volume<br>
<br>
volume root<br>
type cluster/afr<br>
subvolumes root1 root2<br>
option read-subvolume root1<br>
end-volume<br>
<br>
Any suggestions on where I should even begin to look for the cause of this problem? I tested it in single-user mode, and it seems to mount OK there, so it has that feel of a missing dependency to it, but I can't think of what it could be.<br>
<br>
I can provide an image of the kernel/initrd I'm using which could be dropped into a virtual machine for testing, if it'd help (I'm testing it on a VM myself).<br>
<br>
Many thanks.<br>
<br>
Gordan<br>
<br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@nongnu.org" target="_blank">Gluster-devel@nongnu.org</a><br>
<a href="http://lists.nongnu.org/mailman/listinfo/gluster-devel" target="_blank">http://lists.nongnu.org/mailman/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><br>-- <br>Harshavardhana<br>[y4m4 on #<a href="mailto:gluster@irc.freenode.net">gluster@irc.freenode.net</a>]<br>"Samudaya TantraShilpi"<br>Z Research Inc - <a href="http://www.zresearch.com">http://www.zresearch.com</a><br>
<br>