root@typhoon-base-unit0:/usr/var/log/glusterfs>        SUCCESS
[2013-06-21 13:45:10.618287] I [glusterd-handler.c:737:glusterd_handle_cli_probe] 0-glusterd: Received CLI probe req 172.17.23.119 24007
[2013-06-21 13:45:10.618350] D [glusterd-utils.c:289:glusterd_is_local_addr] 0-management: 172.17.23.119
[2013-06-21 13:45:10.623661] D [glusterd-utils.c:289:glusterd_is_local_addr] 0-management: 172.17.23.119
[2013-06-21 13:45:10.628870] D [glusterd-utils.c:289:glusterd_is_local_addr] 0-management: 172.17.23.119
[2013-06-21 13:45:10.634076] D [glusterd-utils.c:302:glusterd_is_local_addr] 0-management: 172.17.23.119 is not local
[2013-06-21 13:45:10.634531] D [glusterd-utils.c:4764:glusterd_friend_find_by_hostname] 0-management: Unable to find friend: 172.17.23.119
[2013-06-21 13:45:10.634648] D [glusterd-utils.c:4764:glusterd_friend_find_by_hostname] 0-management: Unable to find friend: 172.17.23.119
[2013-06-21 13:45:10.634662] D [glusterd-handler.c:442:glusterd_friend_find] 0-management: Unable to find hostname: 172.17.23.119
[2013-06-21 13:45:10.634669] I [glusterd-handler.c:2543:glusterd_probe_begin] 0-glusterd: Unable to find peerinfo for host: 172.17.23.119 (24007)
[2013-06-21 13:45:10.634684] D [glusterd-utils.c:5290:glusterd_sm_tr_log_init] 0-: returning 0
[2013-06-21 13:45:10.634691] D [glusterd-utils.c:5385:glusterd_peerinfo_new] 0-: returning 0
[2013-06-21 13:45:10.634712] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.634739] D [glusterd-store.c:1541:glusterd_store_handle_new] 0-management: Returning 0
[2013-06-21 13:45:10.634785] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.634799] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.634810] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.634816] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.634845] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.634852] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.634885] D [glusterd-handler.c:2432:glusterd_transport_inet_options_build] 0-glusterd: Returning 0
[2013-06-21 13:45:10.634924] I [rpc-clnt.c:961:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600
[2013-06-21 13:45:10.634936] D [rpc-transport.c:248:rpc_transport_load] 0-rpc-transport: attempt to load file /usr/lib64/glusterfs/3.4.0alpha/rpc-transport/socket.so
[2013-06-21 13:45:10.634984] I [socket.c:3459:socket_init] 0-management: SSL support is NOT enabled
[2013-06-21 13:45:10.634992] I [socket.c:3474:socket_init] 0-management: using system polling thread
[2013-06-21 13:45:10.635488] D [common-utils.c:207:gf_resolve_ip6] 0-resolver: returning ip-172.17.23.119 (port-24007) for hostname: 172.17.23.119 and port: 24007
[2013-06-21 13:45:10.635561] W [common-utils.c:2217:gf_get_reserved_ports] 0-glusterfs: could not open the file /proc/sys/net/ipv4/ip_local_reserved_ports for getting reserved ports info (No such file or directory)
[2013-06-21 13:45:10.635571] W [common-utils.c:2250:gf_process_reserved_ports] 0-glusterfs: Not able to get reserved ports, hence there is a possibility that glusterfs may consume reserved port
[2013-06-21 13:45:10.639723] D [glusterd-handler.c:2371:glusterd_rpc_create] 0-management: returning 0
[2013-06-21 13:45:10.639727] D [glusterd-handler.c:3206:glusterd_peer_rpc_notify] 0-management: got RPC_CLNT_CONNECT
[2013-06-21 13:45:10.639745] I [glusterd-handler.c:2525:glusterd_friend_add] 0-management: connect returned 0
[2013-06-21 13:45:10.639765] D [glusterd-handler.c:2575:glusterd_probe_begin] 0-: returning 0
[2013-06-21 13:45:10.640501] D [glusterd-handshake.c:956:glusterd_peer_dump_version_cbk] 0-management: Proceeding to op-version handshake with peer 172.17.23.119
[2013-06-21 13:45:10.641182] D [glusterd-handshake.c:619:gd_validate_peer_op_version] 0-management: Peer 172.17.23.119 accepted
[2013-06-21 13:45:10.641761] D [glusterd-sm.c:934:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_CONNECTED'
[2013-06-21 13:45:10.641790] D [glusterd-handshake.c:562:glusterd_event_connected_inject] 0-: returning 0
[2013-06-21 13:45:10.641798] D [glusterd-sm.c:1012:glusterd_friend_sm] 0-: Dequeued event of type: 'GD_FRIEND_EVENT_CONNECTED'
[2013-06-21 13:45:10.641806] D [glusterd-utils.c:4715:glusterd_friend_find_by_hostname] 0-management: Friend 172.17.23.119 found.. state: 0
[2013-06-21 13:45:10.641857] D [glusterd-store.c:1430:glusterd_store_retrieve_value] 0-: key UUID read
[2013-06-21 13:45:10.641866] D [glusterd-store.c:1433:glusterd_store_retrieve_value] 0-: key UUID found
[2013-06-21 13:45:10.641881] D [glusterd-store.c:1790:glusterd_retrieve_uuid] 0-: Returning 0
[2013-06-21 13:45:10.641890] I [glusterd.c:125:glusterd_uuid_init] 0-management: retrieved UUID: bcf4310c-5275-42a2-b89d-3e7b6f788f03
[2013-06-21 13:45:10.641924] D [glusterd-rpc-ops.c:959:glusterd_rpc_probe] 0-glusterd: Returning 0
[2013-06-21 13:45:10.641934] D [glusterd-sm.c:358:glusterd_ac_friend_probe] 0-: Returning with 0
[2013-06-21 13:45:10.641942] D [glusterd-utils.c:5339:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Establishing Connection' to 'Establishing Connection' due to event 'GD_FRIEND_EVENT_CONNECTED'
[2013-06-21 13:45:10.641954] D [glusterd-utils.c:5341:glusterd_sm_tr_log_transition_add] 0-management: returning 0
[2013-06-21 13:45:10.641965] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.641997] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.642014] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.642026] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.642032] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.642059] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.642066] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.644841] E [rpcsvc.c:448:rpcsvc_check_and_reply_error] 0-rpcsvc: rpc actor failed to complete successfully
[2013-06-21 13:45:10.647798] I [glusterd-handshake.c:428:glusterd_mgmt_hndsk_versions_ack] 0-management: using the op-version 1
[2013-06-21 13:45:10.647848] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.647864] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.656941] I [glusterd-rpc-ops.c:211:glusterd_probe_cbk] 0-glusterd: Received probe resp from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac, host: 172.17.23.119
[2013-06-21 13:45:10.656962] D [glusterd-utils.c:4678:glusterd_friend_find_by_uuid] 0-management: Friend with uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac, not found
[2013-06-21 13:45:10.656971] D [glusterd-handler.c:430:glusterd_friend_find] 0-management: Unable to find peer by uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac
[2013-06-21 13:45:10.656978] D [glusterd-utils.c:4715:glusterd_friend_find_by_hostname] 0-management: Friend 172.17.23.119 found.. state: 0
[2013-06-21 13:45:10.656985] D [glusterd-sm.c:934:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_INIT_FRIEND_REQ'
[2013-06-21 13:45:10.656992] D [glusterd-sm.c:1012:glusterd_friend_sm] 0-: Dequeued event of type: 'GD_FRIEND_EVENT_INIT_FRIEND_REQ'
[2013-06-21 13:45:10.657013] D [glusterd-utils.c:2077:glusterd_build_volume_dict] 0-: Returning with 0
[2013-06-21 13:45:10.657043] D [glusterd-rpc-ops.c:1013:glusterd_rpc_friend_add] 0-glusterd: Returning 0
[2013-06-21 13:45:10.657052] D [glusterd-sm.c:286:glusterd_ac_friend_add] 0-: Returning with 0
[2013-06-21 13:45:10.657058] D [glusterd-utils.c:5339:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Establishing Connection' to 'Probe Sent to Peer' due to event 'GD_FRIEND_EVENT_INIT_FRIEND_REQ'
[2013-06-21 13:45:10.657071] D [glusterd-utils.c:5341:glusterd_sm_tr_log_transition_add] 0-management: returning 0
[2013-06-21 13:45:10.657081] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.657091] D [glusterd-store.c:1580:glusterd_store_handle_destroy] 0-management: Returning 0
[2013-06-21 13:45:10.657121] D [glusterd-store.c:1541:glusterd_store_handle_new] 0-management: Returning 0
[2013-06-21 13:45:10.657153] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657167] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657179] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657185] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.657205] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.657211] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.657218] I [glusterd-rpc-ops.c:281:glusterd_probe_cbk] 0-glusterd: Received resp to probe req
[2013-06-21 13:45:10.657560] I [glusterd-rpc-ops.c:322:glusterd_friend_add_cbk] 0-glusterd: Received ACC from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac, host: 172.17.23.119, port: 0
[2013-06-21 13:45:10.657571] D [glusterd-utils.c:4671:glusterd_friend_find_by_uuid] 0-management: Friend found... state: Probe Sent to Peer
[2013-06-21 13:45:10.657579] D [glusterd-sm.c:934:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_ACC'
[2013-06-21 13:45:10.657626] I [glusterd-handler.c:2718:glusterd_xfer_cli_probe_resp] 0-glusterd: Responded to CLI, ret: 0
[2013-06-21 13:45:10.657636] D [glusterd-sm.c:1012:glusterd_friend_sm] 0-: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_ACC'
[2013-06-21 13:45:10.657643] D [glusterd-sm.c:188:glusterd_ac_none] 0-: Returning with 0
[2013-06-21 13:45:10.657649] D [glusterd-utils.c:5339:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Probe Sent to Peer' to 'Accepted peer request' due to event 'GD_FRIEND_EVENT_RCVD_ACC'
[2013-06-21 13:45:10.657656] D [glusterd-utils.c:5341:glusterd_sm_tr_log_transition_add] 0-management: returning 0
[2013-06-21 13:45:10.657666] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.657699] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657713] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657725] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.657732] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.657756] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.657764] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.657924] I [glusterd-handler.c:2013:glusterd_handle_probe_query] 0-glusterd: Received probe from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac
[2013-06-21 13:45:10.657940] D [glusterd-utils.c:4671:glusterd_friend_find_by_uuid] 0-management: Friend found... state: Accepted peer request
[2013-06-21 13:45:10.657954] E [glusterd-utils.c:505:glusterd_serialize_reply] 0-: Failed to encode message
[2013-06-21 13:45:10.657961] E [glusterd-utils.c:546:glusterd_submit_reply] 0-: Failed to serialize reply
[2013-06-21 13:45:10.658014] I [glusterd-handler.c:2064:glusterd_handle_probe_query] 0-glusterd: Responded to 172.17.23.119, op_ret: 0, op_errno: 0, ret: 0
[2013-06-21 13:45:10.658416] D [socket.c:486:__socket_rwv] 0-socket.management: EOF on socket
[2013-06-21 13:45:10.658442] D [socket.c:2236:socket_event_handler] 0-transport: disconnecting now
[2013-06-21 13:45:10.671090] I [glusterd-handler.c:1739:glusterd_handle_incoming_friend_req] 0-glusterd: Received probe from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac
[2013-06-21 13:45:10.671121] D [glusterd-utils.c:4671:glusterd_friend_find_by_uuid] 0-management: Friend found... state: Accepted peer request
[2013-06-21 13:45:10.671133] D [glusterd-sm.c:934:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ'
[2013-06-21 13:45:10.671140] D [glusterd-sm.c:1012:glusterd_friend_sm] 0-: Dequeued event of type: 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ'
[2013-06-21 13:45:10.671151] D [glusterd-utils.c:3171:glusterd_compare_friend_data] 0-: Returning with ret: 0, status: 0
[2013-06-21 13:45:10.671158] D [glusterd-sm.c:934:glusterd_friend_sm_inject_event] 0-glusterd: Enqueue event: 'GD_FRIEND_EVENT_LOCAL_ACC'
[2013-06-21 13:45:10.671182] I [glusterd-handler.c:2694:glusterd_xfer_friend_add_resp] 0-glusterd: Responded to 172.17.23.117 (0), ret: 0
[2013-06-21 13:45:10.671191] D [glusterd-sm.c:693:glusterd_ac_handle_friend_add_req] 0-: Returning with 0
[2013-06-21 13:45:10.671197] D [glusterd-utils.c:5339:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Accepted peer request' to 'Accepted peer request' due to event 'GD_FRIEND_EVENT_RCVD_FRIEND_REQ'
[2013-06-21 13:45:10.671205] D [glusterd-utils.c:5341:glusterd_sm_tr_log_transition_add] 0-management: returning 0
[2013-06-21 13:45:10.671215] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.671249] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671263] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671274] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671284] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.671308] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.671315] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.671322] D [glusterd-sm.c:1012:glusterd_friend_sm] 0-: Dequeued event of type: 'GD_FRIEND_EVENT_LOCAL_ACC'
[2013-06-21 13:45:10.671334] I [glusterd-sm.c:494:glusterd_ac_send_friend_update] 0-: Added uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac, host: 172.17.23.119
[2013-06-21 13:45:10.671367] D [glusterd-rpc-ops.c:1092:glusterd_rpc_friend_update] 0-glusterd: Returning 0
[2013-06-21 13:45:10.671376] D [glusterd-sm.c:520:glusterd_ac_send_friend_update] 0-: Returning with 0
[2013-06-21 13:45:10.671383] D [glusterd-utils.c:5339:glusterd_sm_tr_log_transition_add] 0-management: Transitioning from 'Accepted peer request' to 'Peer in Cluster' due to event 'GD_FRIEND_EVENT_LOCAL_ACC'
[2013-06-21 13:45:10.671391] D [glusterd-utils.c:5341:glusterd_sm_tr_log_transition_add] 0-management: returning 0
[2013-06-21 13:45:10.671402] D [glusterd-store.c:2802:glusterd_store_create_peer_dir] 0-: Returning with 0
[2013-06-21 13:45:10.671433] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671446] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671458] D [glusterd-store.c:1492:glusterd_store_save_value] 0-management: returning: 0
[2013-06-21 13:45:10.671464] D [glusterd-store.c:2919:glusterd_store_peer_write] 0-: Returning with 0
[2013-06-21 13:45:10.671485] D [glusterd-store.c:2947:glusterd_store_perform_peer_store] 0-: Returning 0
[2013-06-21 13:45:10.671492] D [glusterd-store.c:2968:glusterd_store_peerinfo] 0-: Returning with 0
[2013-06-21 13:45:10.671501] D [glusterd-utils.c:336:glusterd_lock] 0-management: Cluster lock held by bcf4310c-5275-42a2-b89d-3e7b6f788f03
[2013-06-21 13:45:10.671563] D [glusterd-utils.c:4671:glusterd_friend_find_by_uuid] 0-management: Friend found... state: Peer in Cluster
[2013-06-21 13:45:10.671574] I [glusterd-handler.c:1886:glusterd_handle_friend_update] 0-glusterd: Received friend update from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac
[2013-06-21 13:45:10.671590] I [glusterd-handler.c:1931:glusterd_handle_friend_update] 0-: Received uuid: bcf4310c-5275-42a2-b89d-3e7b6f788f03, hostname:172.17.23.117
[2013-06-21 13:45:10.671597] I [glusterd-handler.c:1940:glusterd_handle_friend_update] 0-: Received my uuid as Friend
[2013-06-21 13:45:10.671813] I [glusterd-rpc-ops.c:503:glusterd_friend_update_cbk] 0-management: Received ACC from uuid: 3a686c46-1b4f-4de6-9825-a0abcf3ff9ac
^C