<div dir="ltr">Hello,<div><br></div><div>I have 5 glusterfs nodes with 3.3.1, last week I upgraded them to version 3.4.2, everything works. This week I like adding more node to it with version 3.4.2, whatever I did can not put the new nodes to the cluster, it always says State: </div>
<div><br></div><div>Peer Rejected (Connected)</div><div><br></div><div>Finally I clean up everything on new nodes and install version 3.3.1, I managed to add the new node to cluster. and then I did an upgrade. after this, I tried to  add bricks to volume, glusterfs complains failed.</div>
<div><br></div><div>the following is the log:</div><div><br></div><div>/var/log/glusterfs/glustershd.log</div><div><div>[2014-03-26 14:07:00.853501] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-6: readv failed (No data available)</div>
<div>[2014-03-26 14:07:00.853536] I [client.c:2097:client_rpc_notify] 0-puppet-bucket-client-6: disconnected</div><div>[2014-03-26 14:07:00.854137] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-7: readv failed (No data available)</div>
<div>[2014-03-26 14:07:03.856700] W [socket.c:514:__socket_rwv] 0-puppet-ssl-client-6: readv failed (No data available)</div><div>[2014-03-26 14:07:03.856739] I [client.c:2097:client_rpc_notify] 0-puppet-ssl-client-6: disconnected</div>
<div>[2014-03-26 14:07:03.857543] W [socket.c:514:__socket_rwv] 0-puppet-dist-client-6: readv failed (No data available)</div><div>[2014-03-26 14:07:03.857592] I [client.c:2097:client_rpc_notify] 0-puppet-dist-client-6: disconnected</div>
<div>[2014-03-26 14:07:03.858523] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-6: readv failed (No data available)</div><div>[2014-03-26 14:07:03.858559] I [client.c:2097:client_rpc_notify] 0-puppet-bucket-client-6: disconnected</div>
<div>[2014-03-26 14:07:03.859330] W [socket.c:514:__socket_rwv] 0-puppet-bucket-client-7: readv failed (No data available)</div><div><br></div><div><br></div><div><div>/var/log/glusterfs/bricks/opt-gluster-data-puppet-ssl.log </div>
<div>[2014-03-26 13:34:02.302321] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg002-6006-2014/03/25-20:29:51:414670-puppet-ssl-client-5-0 (version: 3.4.2)</div><div>[2014-03-26 13:34:02.390477] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg002-5999-2014/03/25-20:29:50:410326-puppet-ssl-client-5-0 (version: 3.4.2)</div>
<div>[2014-03-26 13:35:00.968658] I [server.c:762:server_rpc_notify] 0-puppet-ssl-server: disconnecting connectionfrom pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0</div><div>[2014-03-26 13:35:00.968697] I [server-helpers.c:729:server_connection_put] 0-puppet-ssl-server: Shutting down connection pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0</div>
<div>[2014-03-26 13:35:00.968719] I [server-helpers.c:617:server_connection_destroy] 0-puppet-ssl-server: destroyed connection of pup-p-cfg006-3084-2014/03/26-13:27:50:521718-puppet-ssl-client-5-0</div><div>[2014-03-26 13:35:00.973661] I [server.c:762:server_rpc_notify] 0-puppet-ssl-server: disconnecting connectionfrom pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0</div>
<div>[2014-03-26 13:35:00.973707] I [server-helpers.c:729:server_connection_put] 0-puppet-ssl-server: Shutting down connection pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0</div><div>[2014-03-26 13:35:00.973731] I [server-helpers.c:617:server_connection_destroy] 0-puppet-ssl-server: destroyed connection of pup-p-cfg006-3079-2014/03/26-13:27:50:514210-puppet-ssl-client-5-0</div>
<div>[2014-03-26 13:35:35.916298] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg006-6366-2014/03/26-13:35:31:901289-puppet-ssl-client-5-0 (version: 3.3.1)</div><div>[2014-03-26 13:35:35.917272] I [server-handshake.c:567:server_setvolume] 0-puppet-ssl-server: accepted client from pup-p-cfg006-6372-2014/03/26-13:35:31:907067-puppet-ssl-client-5-0 (version: 3.3.1)</div>
<div>^C</div></div><div><br></div><div><br></div><div><div dir="ltr">--<br>Yang<br><div><span>Orange Key: </span>35745318S1</div><div>BBM PIN:7457867C</div></div></div>
</div></div>