<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#ffffff" text="#000000">
hi Julien,<br>
Why did the rebalance operation failed. Could you let us know
what steps lead to this situation.<br>
<br>
Pranith<br>
<br>
On 08/16/2011 12:35 PM, Julien Groselle wrote:
<blockquote
cite="mid:CAL+w8guA3EyjtP7jtxD34SBT4TGMJpX9co4tvn6SfAmOf8v0hQ@mail.gmail.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<div>Hello,</div>
<div><br>
</div>
<div>I'm back with my replication issues ! :(</div>
<div>I can't understand why i replicate 3To but no more...</div>
<div><br>
</div>
<div>We have 2 servers with two storage array, and i installed
glusterFS to make replication in between this server...</div>
<div>As far as i understand, there are just one command to use ?</div>
<div><br>
</div>
<div>
<div><span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace">toomba:~# gluster peer
status</font></span></div>
<div><span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace">Number of Peers: 1</font></span></div>
<div><span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace"><br>
</font></span></div>
<div><span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace">Hostname: kaiserstuhl-svg</font></span></div>
<div>
<span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace">Uuid:
5b79b4bc-c8d2-48d4-bd43-37991197ab47</font></span></div>
<div><span class="Apple-style-span" style="background-color:
rgb(255, 255, 255);"><font class="Apple-style-span"
face="'courier new', monospace">State: Peer in Cluster
(Connected)</font></span></div>
</div>
<div><br>
</div>
<div>I have reconfigured default parameters and i try diff
algorithm for self-heal : </div>
<div><br>
</div>
<div>
<div><font class="Apple-style-span" face="'courier new',
monospace">toomba:~# gluster volume info all</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace"><br>
</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Volume Name: REP_SVG</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Type: Replicate</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Status: Started</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Number of Bricks: 2</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Transport-type: tcp</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Bricks:</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Brick1: toomba-svg:/storage/backup</font></div>
<div>
<font class="Apple-style-span" face="'courier new', monospace">Brick2:
kaiserstuhl-svg:/storage/backup</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">Options Reconfigured:</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">cluster.self-heal-window-size: 64</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">cluster.data-self-heal-algorithm: diff</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">diagnostics.client-log-level: WARNING</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">performance.write-behind-window-size: 1MB</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">performance.cache-size: 32MB</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">diagnostics.brick-log-level: WARNING</font></div>
</div>
<div><br>
</div>
<div>And i just use this command : </div>
<div><font class="Apple-style-span" face="'courier new',
monospace">gluster volume rebalance REP_SVG start</font></div>
<div><br>
</div>
<div>And after 2 or 3 days of "fix layout", i always have the same
message :</div>
<div>
<div><font class="Apple-style-span" face="'courier new',
monospace">toomba:~# gluster volume rebalance REP_SVG status</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">rebalance failed</font></div>
</div>
<div><br>
</div>
<div>Here are the errors messages :</div>
<div>
<div><span class="Apple-style-span" style="font-family: 'courier
new',monospace;">toomba:~# tail
/var/log/glusterfs/etc-glusterd-mount-REP_SVG.log</span></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.252272] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.252467] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/help">chaiten.coe.int/usrshare/20110721/wireshark/help</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.252692] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/radius">chaiten.coe.int/usrshare/20110721/wireshark/radius</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.253069] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/wimaxasncp">chaiten.coe.int/usrshare/20110721/wireshark/wimaxasncp</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.253255] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/tpncp">chaiten.coe.int/usrshare/20110721/wireshark/tpncp</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.253400] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/dtds">chaiten.coe.int/usrshare/20110721/wireshark/dtds</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.253758] E
[afr-self-heal-entry.c:1085:afr_sh_entry_impunge_newfile_cbk]
0-REP_SVG-replicate-0: creation of /Sauvegarde/<a
moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/init.lua">chaiten.coe.int/usrshare/20110721/wireshark/init.lua</a>
on REP_SVG-client-1 failed (File exists)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.258712] W
[fuse-bridge.c:2499:fuse_xattr_cbk] 0-glusterfs-fuse:
235921125: GETXATTR(trusted.distribute.fix.layout)
/Sauvegarde/<a moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a>
=> -1 (No such file or directory)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.271186] W
[fuse-bridge.c:582:fuse_fd_cbk] 0-glusterfs-fuse: 235921126:
OPENDIR() /Sauvegarde/<a moz-do-not-send="true"
href="http://chaiten.coe.int/usrshare/20110721/wireshark/diameter">chaiten.coe.int/usrshare/20110721/wireshark/diameter</a>
=> -1 (No such file or directory)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.985683] W
[glusterfsd.c:712:cleanup_and_exit]
(-->/lib/libc.so.6(clone+0x6d) [0x7f0abb79d02d]
(-->/lib/libpthread.so.0(+0x68ba) [0x7f0abba358ba]
(-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xdd)
[0x40536d]))) 0-: received signum (15), shutting down</font></div>
</div>
<div><br>
</div>
<div>
<div><font class="Apple-style-span" face="'courier new',
monospace">toomba:~# tail
/var/log/glusterfs/bricks/storage-backup.log </font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.255532] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 346366485:
47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.257356] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 346366485:
47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.257807] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 346366485:
47275fbe-a755-40a0-af3c-9545ea0361e9</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.258342] E
[posix.c:3209:posix_getxattr] 0-REP_SVG-posix: listxattr
failed on /storage/backup/diameter: No such file or
directory</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:47.271009] E
[posix.c:957:posix_opendir] 0-REP_SVG-posix: opendir failed
on /diameter: No such file or directory</font></div>
<div>
<font class="Apple-style-span" face="'courier new', monospace">[2011-08-13
18:36:48.168309] W
[socket.c:1494:__socket_proto_state_machine]
0-tcp.REP_SVG-server: reading from socket failed. Error
(Transport endpoint is not connected), peer (<a
moz-do-not-send="true" href="http://192.168.250.58:1022">192.168.250.58:1022</a>)</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:48.194917] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 431358804:
8f5a01c3-5d35-4b86-8a93-2957403360b4</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:48.224864] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 371344980:
c17bbf87-112a-4c45-a481-d923b5780d11</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:48.225068] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 299767723:
d8fff55d-80ae-4311-9864-d39daa52c2b8</font></div>
<div><font class="Apple-style-span" face="'courier new',
monospace">[2011-08-13 18:36:48.225176] W
[inode.c:1035:inode_path] 0-/storage/backup/inode: no dentry
for non-root inode 306335003:
d7d8dcd2-02ab-4d6a-99ec-c20aa481ef6f</font></div>
</div>
<div><br>
</div>
<div>Please tell me that i missed one option, and you have THE
solution...</div>
<div>Because i have try so many parameters, and all the time the
replication failed...</div>
<div><br>
</div>
<div>Let me know if you need more information.</div>
<div><br>
</div>
<div>Best regards.</div>
<br clear="all">
<b style="color: rgb(0, 0, 153);">Julien Groselle</b><br>
<font class="Apple-style-span" face="Arial"><br>
</font>
<pre wrap="">
<fieldset class="mimeAttachmentHeader"></fieldset>
_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a>
</pre>
</blockquote>
<br>
</body>
</html>