<div>Hello,</div><div><br></div><div>I'm back with my replication issues ! :(</div><div>I can't understand why i replicate 3To but no more...</div><div><br></div><div>We have 2 servers with two storage array, and i installed glusterFS to make replication in between this server...</div>
<div>As far as i understand, there are just one command to use ?</div><div><br></div><div><div><span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace">toomba:~# gluster peer status</font></span></div>
<div><span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace">Number of Peers: 1</font></span></div><div><span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace"><br>
</font></span></div><div><span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace">Hostname: kaiserstuhl-svg</font></span></div><div>
<span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace">Uuid: 5b79b4bc-c8d2-48d4-bd43-37991197ab47</font></span></div><div><span class="Apple-style-span" style="background-color: rgb(255, 255, 255);"><font class="Apple-style-span" face="'courier new', monospace">State: Peer in Cluster (Connected)</font></span></div>
</div><div><br></div><div>I have reconfigured default parameters and i try diff algorithm for self-heal : </div><div><br></div><div><div><font class="Apple-style-span" face="'courier new', monospace">toomba:~# gluster volume info all</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace"><br></font></div><div><font class="Apple-style-span" face="'courier new', monospace">Volume Name: REP_SVG</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Type: Replicate</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">Status: Started</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Number of Bricks: 2</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Transport-type: tcp</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">Bricks:</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Brick1: toomba-svg:/storage/backup</font></div><div>
<font class="Apple-style-span" face="'courier new', monospace">Brick2: kaiserstuhl-svg:/storage/backup</font></div><div><font class="Apple-style-span" face="'courier new', monospace">Options Reconfigured:</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">cluster.self-heal-window-size: 64</font></div><div><font class="Apple-style-span" face="'courier new', monospace">cluster.data-self-heal-algorithm: diff</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">diagnostics.client-log-level: WARNING</font></div><div><font class="Apple-style-span" face="'courier new', monospace">performance.write-behind-window-size: 1MB</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">performance.cache-size: 32MB</font></div><div><font class="Apple-style-span" face="'courier new', monospace">diagnostics.brick-log-level: WARNING</font></div>
</div><div><br></div><div>And i just use this command : </div><div><font class="Apple-style-span" face="'courier new', monospace">gluster volume rebalance REP_SVG start</font></div><div><br></div><div>And after 2 or 3 days of "fix layout", i always have the same message :</div>
<div><div><font class="Apple-style-span" face="'courier new', monospace">toomba:~# gluster volume rebalance REP_SVG status</font></div><div><font class="Apple-style-span" face="'courier new', monospace">rebalance failed</font></div>
</div><div><br></div><div>Here are the errors messages :</div><div><div><span class="Apple-style-span" style="font-family: 'courier new', monospace; ">toomba:~# tail /var/log/glusterfs/etc-glusterd-mount-REP_SVG.log</span></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.252272] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.252467] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/help">chaiten.coe.int/usrshare/20110721/wireshark/help</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.252692] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/radius">chaiten.coe.int/usrshare/20110721/wireshark/radius</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.253069] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/wimaxasncp">chaiten.coe.int/usrshare/20110721/wireshark/wimaxasncp</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.253255] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/tpncp">chaiten.coe.int/usrshare/20110721/wireshark/tpncp</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.253400] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/dtds">chaiten.coe.int/usrshare/20110721/wireshark/dtds</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.253758] E [afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk] 0-REP_SVG-replicate-0: creation of /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/init.lua">chaiten.coe.int/usrshare/20110721/wireshark/init.lua</a> on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.258712] W [fuse-bridge.c:2499:fuse_xattr_cbk] 0-glusterfs-fuse: 235921125: GETXATTR(trusted.distribute.fix.layout) /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a> => -1 (No such file or directory)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.271186] W [fuse-bridge.c:582:fuse_fd_cbk] 0-glusterfs-fuse: 235921126: OPENDIR() /Sauvegarde/<a href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a> => -1 (No such file or directory)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.985683] W [glusterfsd.c:712:cleanup_and_exit] (-->/lib/libc.so.6(clone+0x6d) [0x7f0abb79d02d] (-->/lib/libpthread.so.0(+0x68ba) [0x7f0abba358ba] (-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd) [0x40536d]))) 0-: received signum (15), shutting down</font></div>
</div><div><br></div><div><div><font class="Apple-style-span" face="'courier new', monospace">toomba:~# tail /var/log/glusterfs/bricks/storage-backup.log </font></div><div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.255532] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 346366485: 47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.257356] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 346366485: 47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.257807] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 346366485: 47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.258342] E [posix.c:3209:posix_getxattr] 0-REP_SVG-posix: listxattr failed on /storage/backup/diameter: No such file or directory</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:47.271009] E [posix.c:957:posix_opendir] 0-REP_SVG-posix: opendir failed on /diameter: No such file or directory</font></div><div>
<font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:48.168309] W [socket.c:1494:__socket_proto_state_machine] 0-tcp.REP_SVG-server: reading from socket failed. Error (Transport endpoint is not connected), peer (<a href="http://192.168.250.58:1022">192.168.250.58:1022</a>)</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:48.194917] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 431358804: 8f5a01c3-5d35-4b86-8a93-2957403360b4</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:48.224864] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 371344980: c17bbf87-112a-4c45-a481-d923b5780d11</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:48.225068] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 299767723: d8fff55d-80ae-4311-9864-d39daa52c2b8</font></div>
<div><font class="Apple-style-span" face="'courier new', monospace">[2011-08-13 18:36:48.225176] W [inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry for non-root inode 306335003: d7d8dcd2-02ab-4d6a-99ec-c20aa481ef6f</font></div>
</div><div><br></div><div>Please tell me that i missed one option, and you have THE solution...</div><div>Because i have try so many parameters, and all the time the replication failed...</div><div><br></div><div>Let me know if you need more information.</div>
<div><br></div><div>Best regards.</div><br clear="all"><b style="color:rgb(0, 0, 153)">Julien Groselle</b><br><font class="Apple-style-span" face="Arial"><br></font>