<html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">Anyone ele having these issues mounting RDMA only volumes under Ubuntu? Install of Gluster via: <a href="https://launchpad.net/~semiosis/+archive/ubuntu-glusterfs-3.4">https://launchpad.net/~semiosis/+archive/ubuntu-glusterfs-3.4</a><div><br></div><div>I'm guessing this build is looking for an include somewhere that is just misplaced?<br><div><br><div>glusterfs 3.4.0beta4 built on Jun 28 2013 16:16:07<br>Repository revision: <a href="git://git.gluster.com/glusterfs.git">git://git.gluster.com/glusterfs.git</a><br>Copyright (c) 2006-2011 Gluster Inc. <<a href="http://www.gluster.com/">http://www.gluster.com</a>><br>GlusterFS comes with ABSOLUTELY NO WARRANTY.<br>You may redistribute copies of GlusterFS under the terms of the GNU General Public License.<br><br>Specifically:<br><br>root@cs3-p:~# mount -t glusterfs cs1-i:/test2.rdma /tmp/test2/<br>[2013-07-02 21:04:51.407554] I [glusterfsd.c:1878:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.4.0beta4 (/usr/sbin/glusterfs --volfile-id=/test2.rmda --volfile-server=cs1-i /tmp/test2/)<br>[2013-07-02 21:04:51.408841] I [socket.c:3480:socket_init] 0-glusterfs: SSL support is NOT enabled<br>[2013-07-02 21:04:51.408872] I [socket.c:3495:socket_init] 0-glusterfs: using system polling thread<br>[2013-07-02 21:04:51.414278] W [rdma.c:4197:__gf_rdma_ctx_create] 0-rpc-transport/rdma: rdma_cm event channel creation failed (No such file or directory)<br>[2013-07-02 21:04:51.414309] E [rdma.c:4485:init] 0-test2-client-1: Failed to initialize IB Device<br>[2013-07-02 21:04:51.414324] E [rpc-transport.c:320:rpc_transport_load] 0-rpc-transport: 'rdma' initialization failed<br>[2013-07-02 21:04:51.414390] W [rpc-clnt.c:972:rpc_clnt_connection_init] 0-test2-client-1: loading of new rpc-transport failed<br>[2013-07-02 21:04:51.414402] I [mem-pool.c:541:mem_pool_destroy] 0-test2-client-1: size=2236 max=0 total=0<br>[2013-07-02 21:04:51.414471] I [mem-pool.c:541:mem_pool_destroy] 0-test2-client-1: size=124 max=0 total=0<br>[2013-07-02 21:04:51.414483] E [client.c:2283:client_init_rpc] 0-test2-client-1: failed to initialize RPC<br>[2013-07-02 21:04:51.414527] E [xlator.c:390:xlator_init] 0-test2-client-1: Initialization of volume 'test2-client-1' failed, review your volfile again<br>[2013-07-02 21:04:51.414534] E [graph.c:292:glusterfs_graph_init] 0-test2-client-1: initializing translator failed<br>[2013-07-02 21:04:51.414540] E [graph.c:479:glusterfs_graph_activate] 0-graph: init failed<br>[2013-07-02 21:04:51.414668] W [glusterfsd.c:970:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5) [0x7fa820b56bd5] (-->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x31b) [0x7fa82120bd1b] (-->/usr/sbin/glusterfs(glusterfs_process_volfp+0x103) [0x7fa821207473]))) 0-: received signum (0), shutting down<br>[2013-07-02 21:04:51.414687] I [fuse-bridge.c:5212:fini] 0-fuse: Unmounting '/tmp/test2/'.<br>Mount failed. Please check the log file for more details.<br><br>Volume Details:<br><br>root@cs1-p:~# gluster volume info test2<br><br>Volume Name: test2<br>Type: Stripe<br>Volume ID: fd2a2fc2-c5b3-4241-9e02-e2d936972357<br>Status: Started<br>Number of Bricks: 1 x 2 = 2<br>Transport-type: rdma<br>Bricks:<br>Brick1: cs1-i:/gluster/test2<br>Brick2: cs2-i:/gluster/test2<br></div></div><div><br></div><div><br></div><div>Other basic stuff:</div><div><br></div><div><div>root@cs3-p:~# ibv_devinfo</div><div>hca_id: mlx4_0</div><div> transport: InfiniBand (0)</div><div> fw_ver: 2.9.1000</div><div> node_guid: 0002:c903:000c:1e82</div><div> sys_image_guid: 0002:c903:000c:1e85</div><div> vendor_id: 0x02c9</div><div> vendor_part_id: 26428</div><div> hw_ver: 0xB0</div><div> board_id: IBM0D90000009</div><div> phys_port_cnt: 1</div><div> port: 1</div><div> state: PORT_ACTIVE (4)</div><div> max_mtu: 4096 (5)</div><div> active_mtu: 4096 (5)</div><div> sm_lid: 125</div><div> port_lid: 604</div><div> port_lmc: 0x00</div></div><div><br></div><div><div>root@cs3-p:~# dpkg --get-selections | grep ibv</div><div>ibverbs-utils install</div><div>libibverbs-dev install</div><div>libibverbs1 install</div><div><br></div><div>root@cs3-p:~# dpkg --get-selections | grep rdma</div><div>librdmacm-dev install</div><div>librdmacm1 install</div><div>librdmacm1-dbg install</div><div>rdmacm-utils install</div></div></div></body></html>